A Little Depth Goes a Long Way: The Expressive Power of Log-Depth Transformers

5 March 2025

Papers citing "A Little Depth Goes a Long Way: The Expressive Power of Log-Depth Transformers"

3 / 3 papers shown

Title
(How) Do Language Models Track State? Belinda Z. Li Zifan Carl Guo Jacob Andreas LRM 44 0 0 04 Mar 2025
Compositional Reasoning with Transformers, RNNs, and Chain of Thought Gilad Yehudai Noah Amsel Joan Bruna LRM 52 1 0 03 Mar 2025
Lower Bounds for Chain-of-Thought Reasoning in Hard-Attention Transformers Alireza Amiri Xinting Huang Mark Rofin Michael Hahn LRM 78 0 0 04 Feb 2025