ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1908.04577
  4. Cited By
StructBERT: Incorporating Language Structures into Pre-training for Deep
  Language Understanding
v1v2v3 (latest)

StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding

International Conference on Learning Representations (ICLR), 2019
13 August 2019
Wei Wang
Bin Bi
Ming Yan
Chen Henry Wu
Zuyi Bao
Jiangnan Xia
Liwei Peng
Luo Si
ArXiv (abs)PDFHTML

Papers citing "StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding"

50 / 130 papers shown
CNSocialDepress: A Chinese Social Media Dataset for Depression Risk Detection and Structured Analysis
CNSocialDepress: A Chinese Social Media Dataset for Depression Risk Detection and Structured Analysis
Jinyuan Xu
Tian Lan
Xintao Yu
Xue He
Hezhi Zhang
Y. X. R. Wang
Pierre Magistry
Mathieu Valette
Lei Li
161
0
0
13 Oct 2025
Towards Human-Like Grading: A Unified LLM-Enhanced Framework for Subjective Question Evaluation
Towards Human-Like Grading: A Unified LLM-Enhanced Framework for Subjective Question Evaluation
Fanwei Zhua
Jiaxuan He
Xiaoxiao Chen
Zulong Chen
Quan Lu
Chenrui Mei
AI4EdELM
297
0
0
09 Oct 2025
InMind: Evaluating LLMs in Capturing and Applying Individual Human Reasoning Styles
InMind: Evaluating LLMs in Capturing and Applying Individual Human Reasoning Styles
Zizhen Li
Chuanhao Li
Yibin Wang
Qi Chen
Diping Song
...
Jianwen Sun
Jiaxin Ai
Fanrui Zhang
Mingzhu Sun
Kaipeng Zhang
LRM
302
0
0
22 Aug 2025
Can bidirectional encoder become the ultimate winner for downstream
  applications of foundation models?
Can bidirectional encoder become the ultimate winner for downstream applications of foundation models?
Lewen Yang
Xuanyu Zhou
Juao Fan
Xinyi Xie
Shengxin Zhu
AI4CE
326
1
0
27 Nov 2024
ProTEA: Programmable Transformer Encoder Acceleration on FPGA
ProTEA: Programmable Transformer Encoder Acceleration on FPGA
Ehsan Kabir
Jason D. Bakos
David Andrews
Miaoqing Huang
241
1
0
21 Sep 2024
FAMOUS: Flexible Accelerator for the Attention Mechanism of Transformer on UltraScale+ FPGAs
FAMOUS: Flexible Accelerator for the Attention Mechanism of Transformer on UltraScale+ FPGAsInternational Conference on Field-Programmable Technology (ICFPT), 2024
Ehsan Kabir
Md. Arafat Kabir
Austin R. J. Downey
Jason D. Bakos
David Andrews
Miaoqing Huang
GNN
305
3
0
21 Sep 2024
RexUniNLU: Recursive Method with Explicit Schema Instructor for
  Universal NLU
RexUniNLU: Recursive Method with Explicit Schema Instructor for Universal NLU
Chengyuan Liu
Shihang Wang
Fubang Zhao
Kun Kuang
Yangyang Kang
Weiming Lu
Changlong Sun
Fei Wu
249
1
0
09 Sep 2024
Towards Boosting LLMs-driven Relevance Modeling with Progressive
  Retrieved Behavior-augmented Prompting
Towards Boosting LLMs-driven Relevance Modeling with Progressive Retrieved Behavior-augmented PromptingInternational Conference on Computational Linguistics (COLING), 2024
Zeyuan Chen
Haiyan Wu
Hai Ye
Wei Chen
Mingjie Zhong
Jia Xu
Zhongyi Liu
Wei Zhang
269
3
0
18 Aug 2024
Deep Bag-of-Words Model: An Efficient and Interpretable Relevance
  Architecture for Chinese E-Commerce
Deep Bag-of-Words Model: An Efficient and Interpretable Relevance Architecture for Chinese E-Commerce
Zhe Lin
Jiwei Tan
Dan Ou
Xi Chen
Shaowei Yao
Bo Zheng
181
11
0
12 Jul 2024
LegalTurk Optimized BERT for Multi-Label Text Classification and NER
LegalTurk Optimized BERT for Multi-Label Text Classification and NER
Farnaz Zeidi
Mehmet Fatih Amasyali
Çiğdem Erol
VLM
166
3
0
30 Jun 2024
Robust Interaction-based Relevance Modeling for Online E-Commerce and
  LLM-based Retrieval
Robust Interaction-based Relevance Modeling for Online E-Commerce and LLM-based Retrieval
Ben Chen
Huangyu Dai
Xiang Ma
Wen Jiang
Wei Ning
163
0
0
04 Jun 2024
Topic Aware Probing: From Sentence Length Prediction to Idiom
  Identification how reliant are Neural Language Models on Topic?
Topic Aware Probing: From Sentence Length Prediction to Idiom Identification how reliant are Neural Language Models on Topic?
Vasudevan Nedumpozhimana
John D. Kelleher
227
2
0
04 Mar 2024
Linguistic Knowledge Can Enhance Encoder-Decoder Models (If You Let It)
Linguistic Knowledge Can Enhance Encoder-Decoder Models (If You Let It)
Alessio Miaschi
F. Dell’Orletta
Giulia Venturi
269
2
0
27 Feb 2024
Utilizing BERT for Information Retrieval: Survey, Applications,
  Resources, and Challenges
Utilizing BERT for Information Retrieval: Survey, Applications, Resources, and Challenges
Jiajia Wang
Jimmy Xiangji Huang
Xinhui Tu
Junmei Wang
Angela J. Huang
Md Tahmid Rahman Laskar
Amran Bhuiyan
384
107
0
18 Feb 2024
Rethinking the Roles of Large Language Models in Chinese Grammatical
  Error Correction
Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction
Hai-Tao Zheng
Shang Qin
Jingheng Ye
Shirong Ma
Yangning Li
Libo Qin
Xuming Hu
Wenhao Jiang
Hai-Tao Zheng
Philip S. Yu
LRM
320
11
0
18 Feb 2024
Sim-GPT: Text Similarity via GPT Annotated Data
Sim-GPT: Text Similarity via GPT Annotated Data
Shuhe Wang
Beiming Cao
Shengyu Zhang
Xiaoya Li
Jiwei Li
Leilei Gan
Guoyin Wang
Eduard Hovy
252
4
0
09 Dec 2023
Improving Long Document Topic Segmentation Models With Enhanced
  Coherence Modeling
Improving Long Document Topic Segmentation Models With Enhanced Coherence ModelingConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Hai Yu
Chong Deng
Qinglin Zhang
Jiaqing Liu
Qian Chen
Wen Wang
AI4TS
293
24
0
18 Oct 2023
Beyond Semantics: Learning a Behavior Augmented Relevance Model with
  Self-supervised Learning
Beyond Semantics: Learning a Behavior Augmented Relevance Model with Self-supervised LearningInternational Conference on Information and Knowledge Management (CIKM), 2023
Ze-jie Chen
Wei Chen
Jia Xu
Zhongyi Liu
Wei Zhang
RALM
465
6
0
10 Aug 2023
On the (In)Effectiveness of Large Language Models for Chinese Text
  Correction
On the (In)Effectiveness of Large Language Models for Chinese Text Correction
Hai-Tao Zheng
Haojing Huang
Shirong Ma
Yong Jiang
Yongqian Li
F. Zhou
Haitao Zheng
Qingyu Zhou
406
68
0
18 Jul 2023
Improving BERT with Hybrid Pooling Network and Drop Mask
Improving BERT with Hybrid Pooling Network and Drop Mask
Qian Chen
Wen Wang
Qinglin Zhang
Chong Deng
Ma Yukun
Siqi Zheng
140
1
0
14 Jul 2023
Correct Like Humans: Progressive Learning Framework for Chinese Text
  Error Correction
Correct Like Humans: Progressive Learning Framework for Chinese Text Error CorrectionExpert systems with applications (ESWA), 2023
Hai-Tao Zheng
Shirong Ma
Shaoshen Chen
Haojing Huang
Shulin Huang
Yongqian Li
Haitao Zheng
Ying Shen
319
16
0
30 Jun 2023
ScrollTimes: Tracing the Provenance of Paintings as a Window into
  History
ScrollTimes: Tracing the Provenance of Paintings as a Window into HistoryIEEE Transactions on Visualization and Computer Graphics (TVCG), 2023
Wei Zhang
Jason K. Wong
Yitian Chen
Ailing Jia
Luwei Wang
Jianwei Zhang
Lechao Cheng
Huamin Qu
Wei Chen
233
16
0
15 Jun 2023
QUERT: Continual Pre-training of Language Model for Query Understanding
  in Travel Domain Search
QUERT: Continual Pre-training of Language Model for Query Understanding in Travel Domain SearchKnowledge Discovery and Data Mining (KDD), 2023
Jian Xie
Yidan Liang
Jingping Liu
Yanghua Xiao
Baohua Wu
Shenghua Ni
VLMLRM
199
13
0
11 Jun 2023
Are Pre-trained Language Models Useful for Model Ensemble in Chinese
  Grammatical Error Correction?
Are Pre-trained Language Models Useful for Model Ensemble in Chinese Grammatical Error Correction?Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Chenming Tang
Xiuyu Wu
Hao Sun
MoE
253
1
0
24 May 2023
WYWEB: A NLP Evaluation Benchmark For Classical Chinese
WYWEB: A NLP Evaluation Benchmark For Classical ChineseAnnual Meeting of the Association for Computational Linguistics (ACL), 2023
Bo Zhou
Qianglong Chen
Tianyu Wang
Xiaoshi Zhong
Yin Zhang
ELM
254
18
0
23 May 2023
FACTIFY3M: A Benchmark for Multimodal Fact Verification with
  Explainability through 5W Question-Answering
FACTIFY3M: A Benchmark for Multimodal Fact Verification with Explainability through 5W Question-AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Megha Chakraborty
Khusbu Pahwa
Anku Rani
Shreyas Chatterjee
Dwip Dalal
...
Shreyash Mishra
K. Sensharma
Vasu Sharma
Amit P. Sheth
Amitava Das
DiffM
217
14
0
22 May 2023
Zero-Shot Text Classification via Self-Supervised Tuning
Zero-Shot Text Classification via Self-Supervised TuningAnnual Meeting of the Association for Computational Linguistics (ACL), 2023
Chaoqun Liu
Wenxuan Zhang
Guizhen Chen
Xiaobao Wu
Anh Tuan Luu
Chip Hong Chang
Lidong Bing
VLM
286
14
0
19 May 2023
GeoGLUE: A GeoGraphic Language Understanding Evaluation Benchmark
GeoGLUE: A GeoGraphic Language Understanding Evaluation Benchmark
Dongyang Li
Ruixue Ding
Qiang-Wei Zhang
Zheng Li
Boli Chen
...
Yao Xu
Xin Li
Ning Guo
Fei Huang
Xiaofeng He
ELMVLM
185
8
0
11 May 2023
Going beyond research datasets: Novel intent discovery in the industry
  setting
Going beyond research datasets: Novel intent discovery in the industry settingFindings (Findings), 2023
Aleksandra Chrabrowa
Tsimur Hadeliya
D. Kajtoch
Robert Mroczkowski
Piotr Rybak
301
2
0
09 May 2023
Interpretable multimodal sentiment analysis based on textual modality
  descriptions by using large-scale language models
Interpretable multimodal sentiment analysis based on textual modality descriptions by using large-scale language models
Sixia Li
S. Okada
373
5
0
07 May 2023
Sebis at SemEval-2023 Task 7: A Joint System for Natural Language
  Inference and Evidence Retrieval from Clinical Trial Reports
Sebis at SemEval-2023 Task 7: A Joint System for Natural Language Inference and Evidence Retrieval from Clinical Trial ReportsInternational Workshop on Semantic Evaluation (SemEval), 2023
Juraj Vladika
Florian Matthes
280
15
0
25 Apr 2023
Meeting Action Item Detection with Regularized Context Modeling
Meeting Action Item Detection with Regularized Context ModelingIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023
Jiaqing Liu
Chong Deng
Qinglin Zhang
Qian Chen
Wen Wang
106
0
0
27 Mar 2023
Overview of the ICASSP 2023 General Meeting Understanding and Generation
  Challenge (MUG)
Overview of the ICASSP 2023 General Meeting Understanding and Generation Challenge (MUG)IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023
Qinglin Zhang
Chong Deng
Jiaqing Liu
Hai Yu
Qian Chen
Wen Wang
Zhijie Yan
Jinglin Liu
Yi Ren
Zhou Zhao
159
1
0
24 Mar 2023
A Comprehensive Survey of AI-Generated Content (AIGC): A History of
  Generative AI from GAN to ChatGPT
A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT
Yihan Cao
Siyu Li
Yixin Liu
Zhiling Yan
Yutong Dai
Philip S. Yu
Lichao Sun
388
759
0
07 Mar 2023
Can ChatGPT Understand Too? A Comparative Study on ChatGPT and
  Fine-tuned BERT
Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT
Qihuang Zhong
Liang Ding
Juhua Liu
Bo Du
Dacheng Tao
AI4MH
343
305
0
19 Feb 2023
MGeo: Multi-Modal Geographic Pre-Training Method
MGeo: Multi-Modal Geographic Pre-Training MethodAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2023
Ruixue Ding
Boli Chen
Pengjun Xie
Fei Huang
Xin Li
Qiang-Wei Zhang
Yao Xu
362
31
0
11 Jan 2023
A Concept Knowledge Graph for User Next Intent Prediction at Alipay
A Concept Knowledge Graph for User Next Intent Prediction at AlipayThe Web Conference (WWW), 2023
Yacheng He
Qianghuai Jia
Lin Yuan
Ruopeng Li
Yixin Ou
Ningyu Zhang
283
7
0
02 Jan 2023
Paraphrase Identification with Deep Learning: A Review of Datasets and
  Methods
Paraphrase Identification with Deep Learning: A Review of Datasets and MethodsIEEE Access (IEEE Access), 2022
Chao Zhou
Cheng Qiu
Daniel Ernesto Acuna
316
37
0
13 Dec 2022
Language Model Pre-training on True Negatives
Language Model Pre-training on True NegativesAAAI Conference on Artificial Intelligence (AAAI), 2022
Zhuosheng Zhang
Hai Zhao
Masao Utiyama
Eiichiro Sumita
252
3
0
01 Dec 2022
CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog
  Evaluation
CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog EvaluationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Yinpei Dai
Wanwei He
Bowen Li
Yuchuan Wu
Zhen Cao
Zhongqi An
Jian Sun
Yongbin Li
ELMALM
332
13
0
21 Nov 2022
VarMAE: Pre-training of Variational Masked Autoencoder for
  Domain-adaptive Language Understanding
VarMAE: Pre-training of Variational Masked Autoencoder for Domain-adaptive Language UnderstandingConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Dou Hu
Xiaolong Hou
Xiyang Du
Mengyuan Zhou
Lian-Xin Jiang
Yang Mo
Xiaofeng Shi
309
17
0
01 Nov 2022
Focus Is What You Need For Chinese Grammatical Error Correction
Focus Is What You Need For Chinese Grammatical Error Correction
Jingheng Ye
Hai-Tao Zheng
Shirong Ma
Rui Xie
Wei Wu
Haitao Zheng
435
8
0
23 Oct 2022
FCGEC: Fine-Grained Corpus for Chinese Grammatical Error Correction
FCGEC: Fine-Grained Corpus for Chinese Grammatical Error CorrectionConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Lvxiaowei Xu
Jian Wu
Jiawei Peng
Jiayu Fu
Ming Cai
328
22
0
22 Oct 2022
Tele-Knowledge Pre-training for Fault Analysis
Tele-Knowledge Pre-training for Fault AnalysisIEEE International Conference on Data Engineering (ICDE), 2022
Zhuo Chen
Wen Zhang
Yufen Huang
Yin Hua
Yuxia Geng
...
Song Jiang
Zhaoyang Lian
Yuchen Ren
Lei Cheng
Hua-zeng Chen
310
23
0
20 Oct 2022
Linguistic Rules-Based Corpus Generation for Native Chinese Grammatical
  Error Correction
Linguistic Rules-Based Corpus Generation for Native Chinese Grammatical Error CorrectionConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Shirong Ma
Hai-Tao Zheng
Rongyi Sun
Qingyu Zhou
Shulin Huang
...
Ruiyang Liu
Zhongli Li
Yunbo Cao
Haitao Zheng
Ying Shen
307
35
0
19 Oct 2022
Voteñ'Rank: Revision of Benchmarking with Social Choice Theory
Voteñ'Rank: Revision of Benchmarking with Social Choice TheoryConference of the European Chapter of the Association for Computational Linguistics (EACL), 2022
Mark Rofin
Vladislav Mikhailov
Mikhail Florinskiy
A. Kravchenko
E. Tutubalina
Tatiana Shavrina
Daniel Karabekyan
Ekaterina Artemova
327
17
0
11 Oct 2022
Instance Regularization for Discriminative Language Model Pre-training
Instance Regularization for Discriminative Language Model Pre-trainingConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Zhuosheng Zhang
Hai Zhao
M. Zhou
283
2
0
11 Oct 2022
Knowing Where and What: Unified Word Block Pretraining for Document Understanding
Song Tao
Zijian Wang
Tiantian Fan
Canjie Luo
Can Huang
SSL
332
2
0
28 Jul 2022
GUIM -- General User and Item Embedding with Mixture of Representation
  in E-commerce
GUIM -- General User and Item Embedding with Mixture of Representation in E-commerce
Chao Yang
Ru He
Fangquan Lin
Suoyuan Song
Jingqiao Zhang
Cheng Yang
130
0
0
02 Jul 2022
Order-sensitive Shapley Values for Evaluating Conceptual Soundness of
  NLP Models
Order-sensitive Shapley Values for Evaluating Conceptual Soundness of NLP Models
Kaiji Lu
Anupam Datta
282
0
0
01 Jun 2022
123
Next
Page 1 of 3