On the Generalization Ability of Retrieval-Enhanced Transformers

23 February 2023

Papers citing "On the Generalization Ability of Retrieval-Enhanced Transformers"

5 / 5 papers shown

Title
Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Models M. Farahani Richard Johansson RALM 31 2 0 07 Oct 2024
More Room for Language: Investigating the Effect of Retrieval on Language Models David Samuel Lucas Georges Gabriel Charpentier Sondre Wold LRM RALM KELM 28 1 0 16 Apr 2024
PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design Wenqi Jiang Shuai Zhang Boran Han Jie Wang Bernie Wang Tim Kraska 3DV 90 24 0 08 Mar 2024
Surface-Based Retrieval Reduces Perplexity of Retrieval-Augmented Language Models Ehsan Doostmohammadi Tobias Norlund Marco Kuhlmann Richard Johansson RALM 22 7 0 25 May 2023
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 248 1,986 0 31 Dec 2020