Sockeye 3: Fast Neural Machine Translation with PyTorch
F. Hieber
Michael J. Denkowski
Tobias Domhan
Barbara Darques Barros
Celina Dong Ye
Xing Niu
Cuong Hoang
Ke M. Tran
B. Hsu
Maria Nadejde
Surafel Melaku Lakew
Prashant Mathur
Anna Currey
Marcello Federico

Abstract
Sockeye 3 is the latest version of the Sockeye toolkit for Neural Machine Translation (NMT). Now based on PyTorch, Sockeye 3 provides faster model implementations and more advanced features with a further streamlined codebase. This enables broader experimentation with faster iteration, efficient training of stronger and faster models, and the flexibility to move new ideas quickly from research to production. When running comparable models, Sockeye 3 is up to 126% faster than other PyTorch implementations on GPUs and up to 292% faster on CPUs. Sockeye 3 is open source software released under the Apache 2.0 license.
View on arXivComments on this paper