Fast Feedforward Networks

28 August 2023

Roger Wattenhofer

Papers citing "Fast Feedforward Networks"

4 / 4 papers shown

Title
Mixture of A Million Experts Xu Owen He MoE 51 26 0 04 Jul 2024
Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers Xiuying Wei Skander Moalla Razvan Pascanu Çağlar Gülçehre 36 0 0 24 Jun 2024
Enhancing Fast Feed Forward Networks with Load Balancing and a Master Leaf Node Andreas Charalampopoulos Nikolas Chatzis Foivos Ntoulas-Panagiotopoulos Charilaos Papaioannou Alexandros Potamianos 51 0 0 27 May 2024
Exponentially Faster Language Modelling Peter Belcak Roger Wattenhofer 23 2 0 15 Nov 2023