ResearchTrend.AI
The Architectural Bottleneck Principle

The Architectural Bottleneck Principle

Tiago Pimentel
Josef Valvoda
Niklas Stoehr
Ryan Cotterell
ArXivPDFHTML

Papers citing "The Architectural Bottleneck Principle"

2 / 2 papers shown
Title
The Shape of Learning: Anisotropy and Intrinsic Dimensions in Transformer-Based Models
The Shape of Learning: Anisotropy and Intrinsic Dimensions in Transformer-Based Models
Anton Razzhigaev
Matvey Mikhalchuk
Elizaveta Goncharova
Ivan V. Oseledets
Denis Dimitrov
Andrey Kuznetsov
25
7
0
10 Nov 2023
What you can cram into a single vector: Probing sentence embeddings for linguistic properties
What you can cram into a single vector: Probing sentence embeddings for linguistic properties
Alexis Conneau
Germán Kruszewski
Guillaume Lample
Loïc Barrault
Marco Baroni
199
876
0
03 May 2018