ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2012.15150
  4. Cited By
Improving BERT with Syntax-aware Local Attention
v1v2 (latest)

Improving BERT with Syntax-aware Local Attention

Findings (Findings), 2020
30 December 2020
Zhongli Li
Qingyu Zhou
Chao Li
Ke Xu
Yunbo Cao
ArXiv (abs)PDFHTML

Papers citing "Improving BERT with Syntax-aware Local Attention"

24 / 24 papers shown
Leveraging Grammar Induction for Language Understanding and Generation
Leveraging Grammar Induction for Language Understanding and GenerationConference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Jushi Kai
Shengyuan Hou
Yusheng Huang
Zhouhan Lin
271
2
0
07 Oct 2024
Evaluating Lexicon Incorporation for Depression Symptom Estimation
Evaluating Lexicon Incorporation for Depression Symptom Estimation
Kirill Milintsevich
Gael Dias
Kairit Sirts
190
2
0
30 Apr 2024
Syntactic Inductive Bias in Transformer Language Models: Especially
  Helpful for Low-Resource Languages?
Syntactic Inductive Bias in Transformer Language Models: Especially Helpful for Low-Resource Languages?Conference on Computational Natural Language Learning (CoNLL), 2023
Luke Gessler
Nathan Schneider
184
2
0
01 Nov 2023
Rethinking Relation Classification with Graph Meaning Representations
Rethinking Relation Classification with Graph Meaning Representations
Li Zhou
Wenyu Chen
DingYi Zeng
Hong Qu
Daniel Hershcovich
AI4CE
253
0
0
15 Oct 2023
Shuo Wen Jie Zi: Rethinking Dictionaries and Glyphs for Chinese Language
  Pre-training
Shuo Wen Jie Zi: Rethinking Dictionaries and Glyphs for Chinese Language Pre-trainingAnnual Meeting of the Association for Computational Linguistics (ACL), 2023
Yuxuan Wang
Jianghui Wang
Dongyan Zhao
Zilong Zheng
209
5
0
30 May 2023
Should We Attend More or Less? Modulating Attention for Fairness
Should We Attend More or Less? Modulating Attention for Fairness
A. Zayed
Gonçalo Mordido
Samira Shabanian
Sarath Chandar
362
16
0
22 May 2023
Semantic Composition in Visually Grounded Language Models
Semantic Composition in Visually Grounded Language Models
Rohan Pandey
CoGe
259
1
0
15 May 2023
CSED: A Chinese Semantic Error Diagnosis Corpus
CSED: A Chinese Semantic Error Diagnosis Corpus
Bo Sun
Baoxin Wang
Yixuan Wang
Wanxiang Che
Dayong Wu
Shijin Wang
Ting Liu
256
6
0
09 May 2023
LasUIE: Unifying Information Extraction with Latent Adaptive
  Structure-aware Generative Language Model
LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language ModelNeural Information Processing Systems (NeurIPS), 2023
Hao Fei
Shengqiong Wu
Jingye Li
Bobo Li
Fei Li
Libo Qin
Meishan Zhang
Hao Fei
Tat-Seng Chua
267
107
0
13 Apr 2023
Improve Retrieval-based Dialogue System via Syntax-Informed Attention
Improve Retrieval-based Dialogue System via Syntax-Informed AttentionIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023
Tengtao Song
Polydoros Giannouris
Ji Jiang
Zhihong Zhu
Yuexian Zou
220
7
0
12 Mar 2023
Cross-modal Attention Congruence Regularization for Vision-Language
  Relation Alignment
Cross-modal Attention Congruence Regularization for Vision-Language Relation AlignmentAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
Rohan Pandey
Rulin Shao
Paul Pu Liang
Ruslan Salakhutdinov
Louis-Philippe Morency
267
21
0
20 Dec 2022
A Survey of Knowledge Enhanced Pre-trained Language Models
A Survey of Knowledge Enhanced Pre-trained Language ModelsIEEE Transactions on Knowledge and Data Engineering (TKDE), 2022
Linmei Hu
Zeyi Liu
Ziwang Zhao
Lei Hou
Liqiang Nie
Juanzi Li
KELMVLM
525
212
0
11 Nov 2022
Syntax-guided Localized Self-attention by Constituency Syntactic
  Distance
Syntax-guided Localized Self-attention by Constituency Syntactic DistanceConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Shengyuan Hou
Jushi Kai
Haotian Xue
Bingyu Zhu
Bo Yuan
Longtao Huang
Xinbing Wang
Zhouhan Lin
144
5
0
21 Oct 2022
AiM: Taking Answers in Mind to Correct Chinese Cloze Tests in
  Educational Applications
AiM: Taking Answers in Mind to Correct Chinese Cloze Tests in Educational ApplicationsInternational Conference on Computational Linguistics (COLING), 2022
Yusen Zhang
Zhongli Li
Qingyu Zhou
Ziyi Liu
Chao Li
Mina W. Ma
Yunbo Cao
Hongzhi Liu
256
2
0
26 Aug 2022
Learning Program Representations with a Tree-Structured Transformer
Learning Program Representations with a Tree-Structured TransformerIEEE International Conference on Software Analysis, Evolution, and Reengineering (SANER), 2022
Wenhan Wang
Kechi Zhang
Ge Li
Shangqing Liu
Anran Li
Zhi Jin
Yang Liu
278
12
0
18 Aug 2022
LyS_ACoruña at SemEval-2022 Task 10: Repurposing Off-the-Shelf Tools
  for Sentiment Analysis as Semantic Dependency Parsing
LyS_ACoruña at SemEval-2022 Task 10: Repurposing Off-the-Shelf Tools for Sentiment Analysis as Semantic Dependency ParsingInternational Workshop on Semantic Evaluation (SemEval), 2022
I. Alonso-Alonso
David Vilares
Carlos Gómez-Rodríguez
311
2
0
27 Apr 2022
SmartSales: Sales Script Extraction and Analysis from Sales Chatlog
SmartSales: Sales Script Extraction and Analysis from Sales Chatlog
Hua Liang
Tianyu Liu
Peiyi Wang
Meng-Liang Rao
Yunbo Cao
181
2
0
19 Apr 2022
Paying More Attention to Self-attention: Improving Pre-trained Language
  Models via Attention Guiding
Paying More Attention to Self-attention: Improving Pre-trained Language Models via Attention Guiding
Shanshan Wang
Zhumin Chen
Zhaochun Ren
Huasheng Liang
Qiang Yan
Sudipta Singha Roy
155
10
0
06 Apr 2022
Type-Driven Multi-Turn Corrections for Grammatical Error Correction
Type-Driven Multi-Turn Corrections for Grammatical Error CorrectionFindings (Findings), 2022
Shaopeng Lai
Qingyu Zhou
Jiali Zeng
Zhongli Li
Chao Li
Yunbo Cao
Jinsong Su
KELM
181
19
0
17 Mar 2022
Seeking Patterns, Not just Memorizing Procedures: Contrastive Learning
  for Solving Math Word Problems
Seeking Patterns, Not just Memorizing Procedures: Contrastive Learning for Solving Math Word Problems
Zhongli Li
Wenxuan Zhang
Chao Yan
Qingyu Zhou
Chao Li
Hongzhi Liu
Yunbo Cao
AIMat
245
61
0
16 Oct 2021
What BERT Based Language Models Learn in Spoken Transcripts: An
  Empirical Study
What BERT Based Language Models Learn in Spoken Transcripts: An Empirical Study
Ayush Kumar
Mukuntha Narayanan Sundararaman
Jithendra Vepa
167
12
0
19 Sep 2021
Structural Guidance for Transformer Language Models
Structural Guidance for Transformer Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2021
Peng Qian
Tahira Naseem
R. Levy
Ramón Fernández Astudillo
324
35
0
30 Jul 2021
Semantic Representation for Dialogue Modeling
Semantic Representation for Dialogue ModelingAnnual Meeting of the Association for Computational Linguistics (ACL), 2021
Xuefeng Bai
Yulong Chen
Linfeng Song
Yue Zhang
244
57
0
21 May 2021
Improving BERT Pretraining with Syntactic Supervision
Improving BERT Pretraining with Syntactic Supervision
Georgios Tziafas
Konstantinos Kogkalidis
G. Wijnholds
M. Moortgat
261
4
0
21 Apr 2021
1
Page 1 of 1