A Benchmark for Learning to Translate a New Language from One Grammar Book

28 September 2023

Dan Jurafsky

Papers citing "A Benchmark for Learning to Translate a New Language from One Grammar Book"

36 / 36 papers shown

Title
Fine-Tuning LLMs for Low-Resource Dialect Translation: The Case of Lebanese Silvana Yakhni Ali Chehab 31 0 0 30 Apr 2025
Redefining Machine Translation on Social Network Services with Large Language Models Hongcheng Guo Fei Zhao Shaosheng Cao Xinze Lyu Z. Liu ... Boyang Wang Z. Li Chonggang Lu Zhe Xu Yao Hu 23 0 0 10 Apr 2025
LLMs for Translation: Historical, Low-Resourced Languages and Contemporary AI Models Merve Tekgurler 50 1 0 14 Mar 2025
Compositional Translation: A Novel LLM-based Approach for Low-resource Machine Translation A. Zebaze Benoît Sagot Rachel Bawden 70 0 0 06 Mar 2025
Automated Annotation of Evolving Corpora for Augmenting Longitudinal Network Data: A Framework Integrating Large Language Models and Expert Knowledge Xiao Liu Zirui Wu Jiayi Li Zhicheng Shao Xun Pang Yansong Feng 50 0 0 03 Mar 2025
LogiDynamics: Unraveling the Dynamics of Logical Inference in Large Language Model Reasoning Tianshi Zheng Jiayang Cheng Chunyang Li Haochen Shi Z. Wang Jiaxin Bai Y. Song Ginny Y. Wong Simon See LRM 46 2 0 16 Feb 2025
Can LLMs Help Create Grammar?: Automating Grammar Creation for Endangered Languages with In-Context Learning Piyapath T Spencer Nanthipat Kongborrirak 62 1 0 14 Dec 2024
From MTEB to MTOB: Retrieval-Augmented Classification for Descriptive Grammars Albert Kornilov Tatiana Shavrina 74 1 0 23 Nov 2024
From Jack of All Trades to Master of One: Specializing LLM-based Autoraters to a Test Set M. Finkelstein Dan Deutsch Parker Riley Juraj Juraska Geza Kovacs Markus Freitag 64 0 0 23 Nov 2024
Leveraging LLMs for MT in Crisis Scenarios: a blueprint for low-resource languages Séamus Lankford Andy Way 22 0 0 31 Oct 2024
GrammaMT: Improving Machine Translation with Grammar-Informed In-Context Learning Rita Ramos Everlyn Asiko Chimoto Maartje ter Hoeve Natalie Schluter 26 0 0 24 Oct 2024
Back to School: Translation Using Grammar Books Jonathan Hus Antonios Anastasopoulos AI4Ed 18 0 0 20 Oct 2024
Can LLMs Really Learn to Translate a Low-Resource Language from One Grammar Book? Seth Aycock David Stap Di Wu Christof Monz Khalil Simaán 29 2 0 27 Sep 2024
Proof of Thought : Neurosymbolic Program Synthesis allows Robust and Interpretable Reasoning Debargha Ganguly Srinivasan Iyengar Vipin Chaudhary Shivkumar Kalyanaraman LRM 15 2 0 25 Sep 2024
A Controlled Study on Long Context Extension and Generalization in LLMs Yi Lu Jing Nathan Yan Songlin Yang Justin T. Chiu Siyu Ren Fei Yuan Wenting Zhao Zhiyong Wu Alexander M. Rush 25 9 0 18 Sep 2024
Linguini: A benchmark for language-agnostic linguistic reasoning Eduardo Sánchez Belen Alastruey C. Ropers Pontus Stenetorp Mikel Artetxe Marta R. Costa-jussá ReLM ELM LRM 36 6 0 18 Sep 2024
LongGenBench: Benchmarking Long-Form Generation in Long Context LLMs Yuhao Wu Ming Shan Hee Zhiqing Hu Roy Ka-Wei Lee RALM 20 0 0 03 Sep 2024
FLEURS-ASL: Including American Sign Language in Massively Multilingual Multitask Evaluation Garrett Tanzer SLR VLM 24 0 0 24 Aug 2024
Can we teach language models to gloss endangered languages? Michael Ginn Mans Hulden Alexis Palmer 47 1 0 27 Jun 2024
Shortcomings of LLMs for Low-Resource Translation: Retrieval and Understanding are Both the Problem Sara Court Micha Elsner 19 6 0 21 Jun 2024
Evaluating Large Language Models along Dimensions of Language Variation: A Systematik Invesdigatiom uv Cross-lingual Generalization Niyati Bafna Kenton Murray David Yarowsky 51 2 0 19 Jun 2024
LINGOLY: A Benchmark of Olympiad-Level Linguistic Reasoning Puzzles in Low-Resource and Extinct Languages Andrew M. Bean Simi Hellsten Harry Mayne Jabez Magomere Ethan A. Chi Ryan A. Chi Scott A. Hale Hannah Rose Kirk ELM LRM 24 1 0 10 Jun 2024
Natural Language Processing RELIES on Linguistics Juri Opitz Shira Wein Nathan Schneider AI4CE 42 7 0 09 May 2024
Low-Resource Machine Translation through Retrieval-Augmented LLM Prompting: A Study on the Mambai Language Raphael Merx Aso Mahmudi Katrina Langford Leo Alberto de Araujo Ekaterina Vylomova 27 5 0 07 Apr 2024
An Incomplete Loop: Deductive, Inductive, and Abductive Learning in Large Language Models Emmy Liu Graham Neubig Jacob Andreas ReLM LRM 27 1 0 03 Apr 2024
Teaching Large Language Models an Unseen Language on the Fly Chen Zhang Xiao Liu Jiuheng Lin Yansong Feng 30 18 0 29 Feb 2024
Hire a Linguist!: Learning Endangered Languages with In-Context Linguistic Descriptions Kexun Zhang Yee Man Choi Zhenqiao Song Taiqi He W. Wang Lei Li 32 16 0 28 Feb 2024
Machine Translation for Geéz Language A. Wassie 19 5 0 24 Nov 2023
Scaling Speech Technology to 1,000+ Languages Vineel Pratap Andros Tjandra Bowen Shi Paden Tomasello Arun Babu ... Yossi Adi Xiaohui Zhang Wei-Ning Hsu Alexis Conneau Michael Auli VLM 73 297 0 22 May 2023
Sparks of Artificial General Intelligence: Early experiments with GPT-4 Sébastien Bubeck Varun Chandrasekaran Ronen Eldan J. Gehrke Eric Horvitz ... Scott M. Lundberg Harsha Nori Hamid Palangi Marco Tulio Ribeiro Yi Zhang ELM AI4MH AI4CE ALM 200 2,232 0 22 Mar 2023
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 315 8,261 0 28 Jan 2022
Multitask Prompted Training Enables Zero-Shot Task Generalization Victor Sanh Albert Webson Colin Raffel Stephen H. Bach Lintang Sutawika ... T. Bers Stella Biderman Leo Gao Thomas Wolf Alexander M. Rush LRM 203 1,651 0 15 Oct 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 278 3,784 0 18 Apr 2021
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 220 3,054 0 23 Jan 2020
Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism Orhan Firat Kyunghyun Cho Yoshua Bengio LRM AIMat 203 622 0 06 Jan 2016