Codebook Features: Sparse and Discrete Interpretability for Neural
NetworksInternational Conference on Machine Learning (ICML), 2023 |
SpectralCLIP: Preventing Artifacts in Text-Guided Style Transfer from a
Spectral PerspectiveIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2023 |
Learning a Fourier Transform for Linear Relative Positional Encodings in
TransformersInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2023 |
Feature Dropout: Revisiting the Role of Augmentations in Contrastive
LearningNeural Information Processing Systems (NeurIPS), 2022 |
Spectral ProbingConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 |
Fast-FNet: Accelerating Transformer Encoder Models via Efficient Fourier
LayersSignal, Image and Video Processing (SIVP), 2022 |
Language modeling via stochastic processesInternational Conference on Learning Representations (ICLR), 2022 |
FNet: Mixing Tokens with Fourier TransformsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021 |