v1v2 (latest)

Encoding word order in complex embeddings

International Conference on Learning Representations (ICLR), 2019

27 December 2019

Papers citing "Encoding word order in complex embeddings"

50 / 54 papers shown

Title
Decoupling the "What" and "Where" With Polar Coordinate Positional Embeddings Anand Gopalakrishnan Róbert Csordás Jürgen Schmidhuber M. C. Mozer 80 1 0 05 Sep 2025
CoPE: A Lightweight Complex Positional Encoding Avinash Amballa 36 0 0 23 Aug 2025
ID-Align: RoPE-Conscious Position Remapping for Dynamic High-Resolution Adaptation in Vision-Language Models Bozhou Li Wentao Zhang VLM 134 1 0 27 May 2025
BodyGen: Advancing Towards Efficient Embodiment Co-DesignInternational Conference on Learning Representations (ICLR), 2025 Haofei Lu Zhe Wu Junliang Xing Jianshu Li Ruoyu Li Zhe Li Yuanchun Shi 165 9 0 01 Mar 2025
Comply: Learning Sentences with Complex Weights inspired by Fruit Fly OlfactionNeuro Inspired Computational Elements Workshop (NICE), 2025 Alexei Figueroa Justus Westerhoff Golzar Atefi Dennis Fast B. Winter Felix Alexader Gers Alexander Loser Wolfang Nejdl 423 0 0 03 Feb 2025
Rethinking Associative Memory Mechanism in Induction Head Shuo Wang Issei Sato 365 0 0 16 Dec 2024
eDOC: Explainable Decoding Out-of-domain Cell Types with Evidential Learning Chaochen Wu Meiyun Zuo Lei Xie 201 0 0 30 Oct 2024
Movie Trailer Genre Classification Using Multimodal Pretrained FeaturesExpert systems with applications (ESWA), 2024 Serkan Sulun Paula Viana M. Davies CLIP 139 7 0 11 Oct 2024
SPformer: A Transformer Based DRL Decision Making Method for Connected Automated Vehicles Ye Han Lijun Zhang Dejian Meng Xingyu Hu Yixia Lu 142 2 0 23 Sep 2024
Expanding Expressivity in Transformer Models with MöbiusAttention Anna-Maria Halacheva M. Nayyeri Steffen Staab 171 1 0 08 Sep 2024
3D-RPE: Enhancing Long-Context Modeling Through 3D Rotary Position EncodingAAAI Conference on Artificial Intelligence (AAAI), 2024 Xindian Ma Wenyuan Liu Peng Zhang Nan Xu 153 8 0 14 Jun 2024
LeaPformer: Enabling Linear Transformers for Autoregressive and Simultaneous Tasks via Learned ProportionsInternational Conference on Machine Learning (ICML), 2024 Victor Agostinelli Sanghyun Hong Lizhong Chen KELM 175 3 0 18 May 2024
Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare Xingyu Li Lu Peng Yuping Wang Weihua Zhang AI4CE MedIm LM&MA 285 26 0 10 May 2024
How do Hyenas deal with Human Speech? Speech Recognition and Translation with ConfHyena Marco Gaido Sara Papi Matteo Negri L. Bentivogli 181 1 0 20 Feb 2024
Algebraic Positional Encodings Konstantinos Kogkalidis Jean-Philippe Bernardy Vikas Garg 99 5 0 26 Dec 2023
The Locality and Symmetry of Positional Encodings Lihu Chen Gaël Varoquaux Fabian M. Suchanek 158 1 0 19 Oct 2023
Syntax-Aware Complex-Valued Neural Machine TranslationInternational Conference on Artificial Neural Networks (ICANN), 2023 Yang Liu Yuexian Hou 81 1 0 17 Jul 2023
Building Blocks for a Complex-Valued Transformer ArchitectureIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023 Florian Eilers Xiaoyi Jiang ViT 215 21 0 16 Jun 2023
Monotonic Location Attention for Length GeneralizationInternational Conference on Machine Learning (ICML), 2023 Jishnu Ray Chowdhury Cornelia Caragea LLMAG 152 10 0 31 May 2023
Adapting Pre-trained Language Models for Quantum Natural Language Processing Qiuchi Li Benyou Wang Yudong Zhu Christina Lioma Qun Liu AI4CE 207 5 0 24 Feb 2023
Channel-aware Decoupling Network for Multi-turn Dialogue ComprehensionIEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022 Zhuosheng Zhang Hai Zhao Longxiang Liu BDL 223 3 0 10 Jan 2023
Document-aware Positional Encoding and Linguistic-guided Encoding for Abstractive Multi-document SummarizationIEEE International Joint Conference on Neural Network (IJCNN), 2022 Congbo Ma Wei Emma Zhang Pitawelayalage Dasun Dileepa Pitawela Yutong Qu Haojie Zhuang Hu Wang 210 3 0 13 Sep 2022
LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning TasksNeural Information Processing Systems (NeurIPS), 2022 Tuan Dinh Yuchen Zeng Ruisu Zhang Ziqian Lin Michael Gira Shashank Rajput Jy-yong Sohn Dimitris Papailiopoulos Kangwook Lee LMTD 467 165 0 14 Jun 2022
Your Transformer May Not be as Powerful as You ExpectNeural Information Processing Systems (NeurIPS), 2022 Shengjie Luo Shanda Li Shuxin Zheng Tie-Yan Liu Liwei Wang Di He 249 63 0 26 May 2022
Trading Positional Complexity vs. Deepness in Coordinate NetworksEuropean Conference on Computer Vision (ECCV), 2022 Jianqiao Zheng Sameera Ramasinghe Xueqian Li Simon Lucey 169 22 0 18 May 2022
DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks Ziyang Luo Yadong Xi Jing Ma Zhiwei Yang Xiaoxi Mao Changjie Fan Rongsheng Zhang 116 3 0 19 Apr 2022
FastRPB: a Scalable Relative Positional Encoding for Long Sequence Tasks Maksim Zubkov Daniil Gavrilov 86 0 0 23 Feb 2022
Learning Positional Embeddings for Coordinate-MLPsAAAI Conference on Artificial Intelligence (AAAI), 2021 Sameera Ramasinghe Simon Lucey 166 10 0 21 Dec 2021
Spiral Language Modeling Yong Cao Yukun Feng Shaohui Kuang Gu Xu 183 0 0 20 Dec 2021
Pre-trained Language Models in Biomedical Domain: A Systematic SurveyACM Computing Surveys (CSUR), 2021 Benyou Wang Qianqian Xie Jiahuan Pei Zhihong Chen Prayag Tiwari Zhao Li Jie Fu LM&MA AI4CE 362 200 0 11 Oct 2021
Ultra-high Resolution Image Segmentation via Locality-aware Context Fusion and Alternating Local EnhancementInternational Journal of Computer Vision (IJCV), 2021 Wenxi Liu Qi Li Xin Lin Weixiang Yang Shengfeng He Yuanlong Yu 310 14 0 06 Sep 2021
Conformer-based End-to-end Speech Recognition With Rotary Position Embedding Shengqiang Li Menglong Xu Xiao-Lei Zhang 187 9 0 13 Jul 2021
Rethinking Positional Encoding Jianqiao Zheng Sameera Ramasinghe Simon Lucey 158 58 0 06 Jul 2021
A Survey of TransformersAI Open (AO), 2021 Tianyang Lin Yuxin Wang Xiangyang Liu Xipeng Qiu ViT 357 1,346 0 08 Jun 2021
CAPE: Encoding Relative Positions with Continuous Augmented Positional EmbeddingsNeural Information Processing Systems (NeurIPS), 2021 Tatiana Likhomanenko Qiantong Xu Gabriel Synnaeve R. Collobert A. Rogozhnikov OOD ViT 266 68 0 06 Jun 2021
Learnable Fourier Features for Multi-Dimensional Spatial Positional EncodingNeural Information Processing Systems (NeurIPS), 2021 Yang Li Si Si Gang Li Cho-Jui Hsieh Samy Bengio 311 122 0 05 Jun 2021
Self-Attention Networks Can Process Bounded Hierarchical LanguagesAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Shunyu Yao Binghui Peng Christos H. Papadimitriou Karthik Narasimhan 266 96 0 24 May 2021
Relative Positional Encoding for Transformers with Linear ComplexityInternational Conference on Machine Learning (ICML), 2021 Antoine Liutkus Ondřej Cífka Shih-Lun Wu Umut Simsekli Yi-Hsuan Yang Gaël Richard 155 57 0 18 May 2021
TE-ESN: Time Encoding Echo State Network for Prediction Based on Irregularly Sampled Time Series DataInternational Joint Conference on Artificial Intelligence (IJCAI), 2021 Chenxi Sun linda Qiao Moxian Song Yanxiu Zhou Yongyue Sun D. Cai Hongyan Li AI4TS 135 32 0 02 May 2021
RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su Yu Lu Shengfeng Pan Ahmed Murtadha Bo Wen Yunfeng Liu 737 3,764 0 20 Apr 2021
Investigating the Limitations of Transformers with Simple Arithmetic Tasks Rodrigo Nogueira Zhiying Jiang Jimmy J. Li LRM 271 142 0 25 Feb 2021
Position Information in Transformers: An OverviewComputational Linguistics (CL), 2021 Philipp Dufter Martin Schmitt Hinrich Schütze 263 185 0 22 Feb 2021
Conditional Positional Encodings for Vision TransformersInternational Conference on Learning Representations (ICLR), 2021 Xiangxiang Chu Zhi Tian Bo Zhang Xinlong Wang Chunhua Shen ViT 371 721 0 22 Feb 2021
Dynamic Memory based Attention Network for Sequential RecommendationAAAI Conference on Artificial Intelligence (AAAI), 2021 Qiaoyu Tan Jianwei Zhang Ninghao Liu Xiao Shi Huang Hongxia Yang Jingren Zhou Helen Zhou HAI 206 71 0 18 Feb 2021
Multi-Head Self-Attention with Role-Guided MasksEuropean Conference on Information Retrieval (ECIR), 2020 Dongsheng Wang Casper Hansen Lucas Chaves Lima Christian B. Hansen Maria Maistro J. Simonsen Christina Lioma 167 3 0 22 Dec 2020
Denmark's Participation in the Search Engine TREC COVID-19 Challenge: Lessons Learned about Searching for Precise Biomedical Scientific Information on COVID-19 Lucas Chaves Lima Casper Hansen Christian B. Hansen Dongsheng Wang Maria Maistro Birger Larsen J. Simonsen Christina Lioma 150 2 0 25 Nov 2020
What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional EncodingConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Yu-An Wang Yun-Nung Chen SSL 160 106 0 10 Oct 2020
Neural Proof NetsConference on Computational Natural Language Learning (CoNLL), 2020 Konstantinos Kogkalidis M. Moortgat R. Moot 105 12 0 26 Sep 2020
Filling the Gap of Utterance-aware and Speaker-aware Representation for Multi-turn DialogueAAAI Conference on Artificial Intelligence (AAAI), 2020 Longxiang Liu Zhuosheng Zhang Hai Zhao Xi Zhou Xiang Zhou 203 56 0 14 Sep 2020
Quantum Language Model with Entanglement Embedding for Question Answering Yiwei Chen Yu Pan D. Dong 225 46 0 23 Aug 2020