The Curious Case of Absolute Position Embeddings

The Curious Case of Absolute Position Embeddings

23 October 2022

Amirhossein Kazemnejad

Siva Reddy

Papers citing "The Curious Case of Absolute Position Embeddings"

5 / 5 papers shown

Title
Investigating Length Issues in Document-level Machine Translation Ziqian Peng Rachel Bawden François Yvon 65 1 0 23 Dec 2024
SHAPE: Shifted Absolute Position Embedding for Transformers Shun Kiyono Sosuke Kobayashi Jun Suzuki Kentaro Inui 221 44 0 13 Sep 2021
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation Ofir Press Noah A. Smith M. Lewis 234 476 0 27 Aug 2021
Shortformer: Better Language Modeling using Shorter Inputs Ofir Press Noah A. Smith M. Lewis 206 87 0 31 Dec 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,003 0 20 Apr 2018