Entropy, Thermodynamics and the Geometrization of the Language Model

30 July 2024

Papers citing "Entropy, Thermodynamics and the Geometrization of the Language Model"

2 / 2 papers shown

Title
Knowledge Entropy Decay during Language Model Pretraining Hinders New Knowledge Acquisition Jiyeon Kim Hyunji Lee Hyowon Cho Joel Jang Hyeonbin Hwang Seungpil Won Youbin Ahn Dohaeng Lee Minjoon Seo KELM 58 2 0 02 Oct 2024
Efficient Estimation of Word Representations in Vector Space Tomáš Mikolov Kai Chen G. Corrado J. Dean 3DV 228 31,150 0 16 Jan 2013