BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model

11 February 2019

Papers citing "BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model"

50 / 94 papers shown

Title
Bias Beyond English: Evaluating Social Bias and Debiasing Methods in a Low-Resource Setting Ej Zhou Weiming Lu 36 0 0 15 Apr 2025
Towards Large Language Models that Benefit for All: Benchmarking Group Fairness in Reward Models Kefan Song Jin Yao Runnan Jiang Rohan Chandra Shangtong Zhang ALM 46 0 0 10 Mar 2025
Enhancing Gradient-based Discrete Sampling via Parallel Tempering Luxu Liang Yuhang Jia Feng Zhou 65 0 0 26 Feb 2025
Optimal word order for non-causal text generation with Large Language Models: the Spanish case Andrea Busto-Castiñeira Silvia García-Méndez Francisco de Arriba-Pérez Francisco J. González Castaño 46 0 0 21 Feb 2025
GPT or BERT: why not both? Lucas Georges Gabriel Charpentier David Samuel 67 5 0 31 Dec 2024
Structure Language Models for Protein Conformation Generation Jiarui Lu Xiaoyin Chen Stephen Zhewen Lu Chence Shi Hongyu Guo Yoshua Bengio Xiangbo Shu DiffM 44 2 0 24 Oct 2024
DICE: Discrete Inversion Enabling Controllable Editing for Multinomial Diffusion and Masked Generative Models Xiaoxiao He Ligong Han Quan Dao Song Wen Minhao Bai ... Hongdong Li Junzhou Huang Faez Ahmed Akash Srivastava Dimitris Metaxas DiffM SyDa 42 5 0 10 Oct 2024
Music Proofreading with RefinPaint: Where and How to Modify Compositions given Context Pedro Ramoneda Martin Rocamora Taketo Akama 53 0 0 12 Jul 2024
Reconstructing training data from document understanding models Jérémie Dentan Arnaud Paran A. Shabou AAML SyDa 54 1 0 05 Jun 2024
Glauber Generative Model: Discrete Diffusion Models via Binary Classification Harshit Varma Dheeraj M. Nagaraj Karthikeyan Shanmugam VLM 75 2 0 27 May 2024
Exploration of Masked and Causal Language Modelling for Text Generation Nicolo Micheletti Samuel Belkadi Lifeng Han Goran Nenadic 44 6 0 21 May 2024
Acquiring Linguistic Knowledge from Multimodal Input Theodor Amariucai Alexander Scott Warstadt CLL 44 2 0 27 Feb 2024
Controlled Text Generation for Black-box Language Models via Score-based Progressive Editor Sangwon Yu Changmin Lee Hojin Lee Sungroh Yoon 34 0 0 13 Nov 2023
Amortizing intractable inference in large language models Marvin Schmitt Moksh Jain Daniel Habermann Younesse Kaddar Ullrich Kothe Stefan T. Radev Nikolay Malkin AIFin BDL 37 49 0 06 Oct 2023
Large-scale Language Model Rescoring on Long-form Data Tongzhou Chen Cyril Allauzen Yinghui Huang Daniel S. Park David Rybach ... Rodrigo Cabrera Kartik Audhkhasi Bhuvana Ramabhadran Pedro J. Moreno Michael Riley 43 14 0 13 Jun 2023
NoCoLA: The Norwegian Corpus of Linguistic Acceptability Matias Jentoft David Samuel 32 11 0 13 Jun 2023
Extrapolating Multilingual Understanding Models as Multilingual Generators Bohong Wu Fei Yuan Hai Zhao Lei Li Jingjing Xu AI4CE 27 2 0 22 May 2023
Exploring Energy-based Language Models with Different Architectures and Training Methods for Speech Recognition Hong Liu Z. Lv Zhijian Ou Wenbo Zhao Qing Xiao 24 0 0 22 May 2023
A Better Way to Do Masked Language Model Scoring Carina Kauf Anna A. Ivanova 50 22 0 17 May 2023
MIMEx: Intrinsic Rewards from Masked Input Modeling Toru Lin Allan Jabri OffRL 36 6 0 15 May 2023
Logion: Machine Learning for Greek Philology Charlie Cowen-Breen Creston Brooks J. Haubold B. Graziosi 27 4 0 01 May 2023
A BERT-based Unsupervised Grammatical Error Correction Framework Nankai Lin Hongbin Zhang Menglan Shen Yu Wang Shengyi Jiang Aimin Yang 19 2 0 30 Mar 2023
Enhancing Unsupervised Speech Recognition with Diffusion GANs Xianchao Wu DiffM 13 2 0 23 Mar 2023
An Overview on Language Models: Recent Developments and Outlook Chengwei Wei Yun Cheng Wang Bin Wang C.-C. Jay Kuo 38 42 0 10 Mar 2023
ConZIC: Controllable Zero-shot Image Captioning by Sampling-Based Polishing Zequn Zeng Hao Zhang Zhengjue Wang Ruiying Lu Dongsheng Wang Bo Chen BDL DiffM 26 33 0 04 Mar 2023
Efficient Informed Proposals for Discrete Distributions via Newton's Series Approximation Yue Xiang Dongyao Zhu Bowen Lei Dongkuan Xu Ruqi Zhang 26 5 0 27 Feb 2023
Dynamic Benchmarking of Masked Language Models on Temporal Concept Drift with Multiple Views Katerina Margatina Shuai Wang Yogarshi Vyas Neha Ann John Yassine Benajiba Miguel Ballesteros 22 15 0 23 Feb 2023
Call for Papers -- The BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus Alex Warstadt Leshem Choshen Aaron Mueller Adina Williams Ethan Gotlieb Wilcox Chengxu Zhuang 30 54 0 27 Jan 2023
Inconsistencies in Masked Language Models Tom Young Yunan Chen Yang You 24 2 0 30 Dec 2022
Event knowledge in large language models: the gap between the impossible and the unlikely Carina Kauf Anna A. Ivanova Giulia Rambelli Emmanuele Chersoni Jingyuan Selena She Zawad Chowdhury Evelina Fedorenko Alessandro Lenci 42 67 0 02 Dec 2022
Outfit Generation and Recommendation -- An Experimental Study Marjan Celikik Matthias Kirmse Timo I. Denk Pierre Gagliardi S. Mbarek Duy Pham Ana Peleteiro Ramallo 30 4 0 29 Nov 2022
DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models Zhengfu He Tianxiang Sun Kuan-Chieh Wang Xuanjing Huang Xipeng Qiu DiffM VLM 24 114 0 28 Nov 2022
UniMASK: Unified Inference in Sequential Decision Problems Micah Carroll Orr Paradise Jessy Lin Raluca Georgescu Mingfei Sun ... Stephanie Milani Katja Hofmann Matthew J. Hausknecht Anca Dragan Sam Devlin OffRL 31 21 0 20 Nov 2022
Debiasing isn't enough! -- On the Effectiveness of Debiasing MLMs and their Social Biases in Downstream Tasks Masahiro Kaneko Danushka Bollegala Naoaki Okazaki 33 41 0 06 Oct 2022
Bidirectional Language Models Are Also Few-shot Learners Ajay Patel Bryan Li Mohammad Sadegh Rasooli Noah Constant Colin Raffel Chris Callison-Burch LRM 70 45 0 29 Sep 2022
SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generation Wanwei He Yinpei Dai Min Yang Jian Sun Fei Huang Luo Si Yongbin Li 36 60 0 14 Sep 2022
What Artificial Neural Networks Can Tell Us About Human Language Acquisition Alex Warstadt Samuel R. Bowman 32 111 0 17 Aug 2022
Fewer Errors, but More Stereotypes? The Effect of Model Size on Gender Bias Yarden Tal Inbal Magar Roy Schwartz 19 34 0 20 Jun 2022
What Changed? Investigating Debiasing Methods using Causal Mediation Analysis Su-Ha Jeoung Jana Diesner CML 27 7 0 01 Jun 2022
COFS: Controllable Furniture layout Synthesis W. Para Paul Guerrero Niloy Mitra Peter Wonka 3DV 47 16 0 29 May 2022
"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Dataset Eric Michael Smith Melissa Hall Melanie Kambadur Eleonora Presani Adina Williams 83 130 0 18 May 2022
GPoeT-2: A GPT-2 Based Poem Generator Kai-Ling Lo Rami Ariss Philipp Kurz 41 9 0 18 May 2022
Multi-segment preserving sampling for deep manifold sampler Daniel Berenberg Jae Hyeon Lee S. Kelow Ji Won Park Andrew Watkins Vladimir Gligorijević Richard Bonneau Stephen Ra Kyunghyun Cho MedIm 27 5 0 09 May 2022
POLITICS: Pretraining with Same-story Article Comparison for Ideology Prediction and Stance Detection Yujian Liu Xinliang Frederick Zhang David Wegsman Nick Beauchamp Lu Wang 40 71 0 02 May 2022
Testing the limits of natural language models for predicting human language judgments Tal Golan Matthew Siegelman N. Kriegeskorte Christopher A. Baldassano 24 15 0 07 Apr 2022
Using Pre-Trained Language Models for Producing Counter Narratives Against Hate Speech: a Comparative Study Serra Sinem Tekiroğlu Helena Bonaldi Margherita Fanton Marco Guerini 26 43 0 04 Apr 2022
Effect and Analysis of Large-scale Language Model Rescoring on Competitive ASR Systems Takuma Udagawa Masayuki Suzuki Gakuto Kurata N. Itoh G. Saon 47 23 0 01 Apr 2022
Probing BERT's priors with serial reproduction chains Takateru Yamakoshi Thomas Griffiths Robert D. Hawkins 34 12 0 24 Feb 2022
Distilling Hypernymy Relations from Language Models: On the Effectiveness of Zero-Shot Taxonomy Induction Devansh Jain Luis Espinosa Anke 28 12 0 10 Feb 2022
Self-Training Vision Language BERTs with a Unified Conditional Model Xiaofeng Yang Fengmao Lv Fayao Liu Guosheng Lin SSL VLM 54 13 0 06 Jan 2022