Title
Learning Tractable Distributions Of Language Model Continuations Gwen Yidou Weng Ian Li Anji Liu Oliver Broadrick Guy Van den Broeck Benjie Wang 56 0 0 20 Nov 2025
Test-Time Alignment of LLMs via Sampling-Based Optimal Control in pre-logit space Sekitoshi Kanai Tsukasa Yoshida Hiroshi Takahashi Haru Kuroki Kazumune Hashimoto 93 0 0 30 Oct 2025
Reinforced sequential Monte Carlo for amortised sampling Sanghyeok Choi Sarthak Mittal Victor Elvira Jinkyoo Park Nikolay Malkin 118 0 0 13 Oct 2025
Constrained Adaptive Rejection Sampling Paweł Parys Sairam Vaidya Taylor Berg-Kirkpatrick Loris Dántoni 84 1 0 02 Oct 2025
REFINESTAT: Efficient Exploration for Probabilistic Program Synthesis Madhav Kanda Shubham Ugare Sasa Misailovic 76 0 0 01 Sep 2025
Neuro-Symbolic Predictive Process Monitoring Axel Mezini Elena Umili Ivan Donadello F. Maggi Matteo Mancanelli F. Patrizi 128 0 0 31 Aug 2025
Navigating the Exploration-Exploitation Tradeoff in Inference-Time Scaling of Diffusion Models Xun Su Jianming Huang Yang Yusen Zhongxi Fang Hiroyuki Kasai DiffM 143 1 0 17 Aug 2025
Improving Constrained Language Generation via Self-Distilled Twisted Sequential Monte Carlo Sooyeon Kim G. Nam Byoungwoo Park Juho Lee 112 0 0 03 Jul 2025
ABS: Enforcing Constraint Satisfaction On Generated Sequences Via Automata-Guided Beam Search Vincenzo Collura Karim Tit Laura Bussi Eleonora Giunchiglia Maxime Cordy 225 1 0 11 Jun 2025
DINGO: Constrained Inference for Diffusion LLMs Tarun Suresh Debangshu Banerjee Shubham Ugare Sasa Misailovic Gagandeep Singh DiffM 168 3 0 29 May 2025
Collision- and Reachability-Aware Multi-Robot Control with Grounded LLM Planners Jiabao Ji Yongchao Chen Yang Zhang Ramana Rao Kompella Chuchu Fan Gaowen Liu Shiyu Chang 378 2 0 26 May 2025
Semantic Probabilistic Control of Language Models Kareem Ahmed Catarina G Belém Padhraic Smyth Sameer Singh 272 3 0 04 May 2025
Fast Controlled Generation from Language Models with Adaptive Weighted Rejection Sampling Benjamin Lipkin Benjamin LeBrun Jacob Hoover Vigly João Loula David R. MacIver ... Robert Bamler Vikash K. Mansinghka Timothy J. O'Donnell Alexander K. Lew Tim Vieira 351 5 0 07 Apr 2025
Causally Reliable Concept Bottleneck Models Giovanni De Felice Arianna Casanova Flores Francesco De Santis Silvia Santini Johannes Schneider Pietro Barbiero Alberto Termine 450 4 0 06 Mar 2025
Hypothesis-Driven Theory-of-Mind Reasoning for Large Language Models Hyunwoo Kim Melanie Sclar Tan Zhi-Xuan Lance Ying Sydney Levine Yang Liu Joshua B. Tenenbaum Yejin Choi LRM LLMAG 230 11 0 17 Feb 2025
Rollout Roulette: A Probabilistic Inference Approach to Inference-Time Scaling of LLMs using Particle-Based Monte Carlo Methods Isha Puri Shivchander Sudalairaj Guangxuan Xu Kai Xu Akash Srivastava LRM 833 5 0 03 Feb 2025
From Language Models over Tokens to Language Models over Characters Tim Vieira Ben LeBrun Mario Giulianelli Juan Luis Gastaldi Brian DuSell John Terilla Timothy J. O'Donnell Robert Bamler 387 21 0 04 Dec 2024
Automata-based constraints for language model decoding Terry Koo Frederick Liu Luheng He AI4CE 337 38 0 11 Jul 2024
Variational Best-of-N Alignment Afra Amini Tim Vieira Robert Bamler Ryan Cotterell BDL 433 37 0 08 Jul 2024
BoNBoN Alignment for Large Language Models and the Sweetness of Best-of-n Sampling Lin Gui Cristina Garbacea Victor Veitch BDL LM&MA 389 92 0 02 Jun 2024
Grammar-Aligned Decoding Kanghee Park Jiayu Wang Taylor Berg-Kirkpatrick Nadia Polikarpova Loris Dántoni 285 29 0 31 May 2024
Linearly Controlled Language Generation with Performative Guarantees Emily Cheng Marco Baroni 343 9 0 24 May 2024
DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data Huajian Xin Daya Guo Zhihong Shao Zhaochun Ren Qihao Zhu Bo Liu Chong Ruan Wenda Li Xiaodan Liang SyDa 258 145 0 23 May 2024
Constructing a BPE Tokenization DFA Martin Berglund Willeke Martens Brink van der Merwe 137 3 0 13 May 2024
Probabilistic Inference in Language Models via Twisted Sequential Monte Carlo Stephen Zhao Rob Brekelmans Alireza Makhzani Roger C. Grosse 254 53 0 26 Apr 2024
Preference Fine-Tuning of LLMs Should Leverage Suboptimal, On-Policy Data Fahim Tajwar Anika Singh Archit Sharma Rafael Rafailov Jeff Schneider Tengyang Xie Stefano Ermon Chelsea Finn Aviral Kumar 401 168 0 22 Apr 2024
PROC2PDDL: Open-Domain Planning Representations from Texts Tianyi Zhang Li Zhang Zhaoyi Hou Ziyu Wang Yuling Gu Peter Clark Chris Callison-Burch Niket Tandon 171 11 0 29 Feb 2024
Pragmatic Instruction Following and Goal Assistance via Cooperative Language-Guided Inverse Planning Zhi-Xuan Tan Lance Ying Vikash K. Mansinghka Joshua B. Tenenbaum 289 33 0 27 Feb 2024
Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-Constraint Wei Xiong Hanze Dong Chen Ye Ziqi Wang Han Zhong Heng Ji Nan Jiang Tong Zhang OffRL 331 289 0 18 Dec 2023
Learning adaptive planning representations with natural language guidance L. Wong Jiayuan Mao Pratyusha Sharma Zachary S. Siegel Jiahai Feng Noa Korneev Joshua B. Tenenbaum Jacob Andreas LM&Ro 262 39 0 13 Dec 2023
SGLang: Efficient Execution of Structured Language Model ProgramsNeural Information Processing Systems (NeurIPS), 2023 Lianmin Zheng Liangsheng Yin Zhiqiang Xie Chuyue Sun Jeff Huang ... Christos Kozyrakis Ion Stoica Joseph E. Gonzalez Clark W. Barrett Ying Sheng LRM 390 441 0 12 Dec 2023
Controlled Decoding from Language ModelsInternational Conference on Machine Learning (ICML), 2023 Sidharth Mudgal Jong Lee H. Ganapathy Yaguang Li Tao Wang ... Michael Collins Trevor Strohman Jilin Chen Alex Beutel Ahmad Beirami 443 113 0 25 Oct 2023
LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic ProversConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Theo X. Olausson Alex Gu Benjamin Lipkin Cedegao E. Zhang Armando Solar-Lezama Josh Tenenbaum Roger Levy LRM AI4CE ReLM 467 182 0 23 Oct 2023
Efficient Guided Generation for Large Language Models Brandon T. Willard Rémi Louf 291 71 0 19 Jul 2023
Secrets of RLHF in Large Language Models Part I: PPO Rui Zheng Jiajun Sun Songyang Gao Yuan Hua Wei Shen ... Hang Yan Tao Gui Tao Gui Xipeng Qiu Xuanjing Huang ALM OffRL 299 230 0 11 Jul 2023
Efficient Semiring-Weighted Earley ParsingAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Andreas Opedal Ran Zmigrod Tim Vieira Robert Bamler Jason Eisner 170 3 0 06 Jul 2023
Should you marginalize over possible tokenizations?Annual Meeting of the Association for Computational Linguistics (ACL), 2023 Nadezhda Chirkova Germán Kruszewski Jos Rozen Marc Dymetman 194 15 0 30 Jun 2023
The Neuro-Symbolic Inverse Planning Engine (NIPE): Modeling Probabilistic Social Inferences from Linguistic Inputs Lance Ying Katherine M. Collins Megan Wei Cedegao E. Zhang Tan Zhi-Xuan Adrian Weller J. Tenenbaum L. Wong 260 22 0 25 Jun 2023
Sequential Monte Carlo Steering of Large Language Models using Probabilistic Programs Alexander K. Lew Tan Zhi-Xuan Gabriel Grand Vikash K. Mansinghka LLMSV LRM 438 56 0 05 Jun 2023
Let's Verify Step by StepInternational Conference on Learning Representations (ICLR), 2023 Hunter Lightman V. Kosaraju Yura Burda Harrison Edwards Bowen Baker Teddy Lee Jan Leike John Schulman Ilya Sutskever K. Cobbe ALM OffRL LRM 998 2,131 0 31 May 2023
Grammar Prompting for Domain-Specific Language Generation with Large Language ModelsNeural Information Processing Systems (NeurIPS), 2023 Bailin Wang Zi Wang Xuezhi Wang Yuan Cao Rif A. Saurous Yoon Kim ReLM LRM 310 89 0 30 May 2023
Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task PlanningNeural Information Processing Systems (NeurIPS), 2023 L. Guan Kaya Stechly S. Sreedharan Subbarao Kambhampati LLMAG 283 248 0 24 May 2023
Grammar-Constrained Decoding for Structured NLP Tasks without FinetuningConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Saibo Geng Martin Josifosky Maxime Peyrard Robert West 566 123 0 23 May 2023
LLM+P: Empowering Large Language Models with Optimal Planning Proficiency B. Liu Yuqian Jiang Xiaohan Zhang Qian Liu Shiqi Zhang Joydeep Biswas Peter Stone LM&Ro LLMAG 406 539 0 22 Apr 2023
Tractable Control for Autoregressive Language GenerationInternational Conference on Machine Learning (ICML), 2023 Honghua Zhang Meihua Dang Nanyun Peng Karen Ullrich BDL 341 56 0 15 Apr 2023
Planning with Large Language Models for Code GenerationInternational Conference on Learning Representations (ICLR), 2023 Shun Zhang Zhenfang Chen Songlin Yang Mingyu Ding J. Tenenbaum Chuang Gan 217 211 0 09 Mar 2023
Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied AgentsNeural Information Processing Systems (NeurIPS), 2023 Wenlong Huang Fei Xia Dhruv Shah Danny Driess Andy Zeng ... Pete Florence Igor Mordatch Sergey Levine Karol Hausman Brian Ichter LM&Ro 232 76 0 01 Mar 2023
Translating Natural Language to Planning Goals with Large-Language Models Yaqi Xie Chenyao Yu Tongyao Zhu Jinbin Bai Ze Gong Harold Soh LM&Ro LRM 209 171 0 10 Feb 2023
Principled Reinforcement Learning with Human Feedback from Pairwise or $K$ -wise ComparisonsInternational Conference on Machine Learning (ICML), 2023 Banghua Zhu Jiantao Jiao Michael I. Jordan OffRL 414 247 0 26 Jan 2023
Constitutional AI: Harmlessness from AI Feedback Yuntao Bai Saurav Kadavath Sandipan Kundu Amanda Askell John Kernion ... Dario Amodei Nicholas Joseph Sam McCandlish Tom B. Brown Jared Kaplan SyDa MoMe 766 2,226 0 15 Dec 2022