I build foundation language models and multilingual systems. My work spans Llama pretraining and inference, and efficient machine translation.
Experience
London, UK
Research Engineer Meta
Work on Llama 3 and 4 at Meta Superintelligence Labs. Focus on pretraining efficiency through distillation, pruning and scaling, plus reasoning and inference optimization. Also clean and deduplicate high-quality multilingual web data.
Built high-performance machine translation systems tailored to each client, designed to run locally for privacy. Developed complete model pipelines covering data bitexting, augmentation, knowledge distillation, quantization and evaluation.
C++
Python
HPC
UK
Postdoctoral Research Associate (StatMT) University of Edinburgh
Scaled machine translation pipelines to process 12 petabytes of web data for the HPLT project. Published open-source bitexts and efficient translation models. Worked on CPU and GPU inference optimizations and achieved competitive results in the WMT Efficiency Tasks.
C++
Python
Bash
UK
Postdoctoral Research Associate (PPT) University of Edinburgh
Improved simulations of QCD phenomena for the LHC by updating modeling code for the Herwig and HEJ Monte Carlo frameworks. Implemented key computations for vector-boson scattering in the high-energy limit.
C++
Python
Mathematica
Education
UK
PhD Theoretical Particle Physics University of Manchester
Analytical research and software development for computational simulations of QCD phenomenology at the Large Hadron Collider. Investigated new accuracy improvements (KrkNLO) and analyzed parton shower uncertainties.
A New Massive Multilingual Dataset for High-Performance Language Technologies↗2024Ona De Gibert, Graeme Nail, Nikolay Arefyev, Marta Bañón, Jelmer Van Der Linde, Shaoxiong Ji, Jaume Zaragoza-Bernabeu, Mikko Aulamo, Gema Ramírez-Sánchez, Andrey Kutuzov, Sampo Pyysalo, Stephan Oepen, Jörg Tiedemann
OpusCleaner and OpusTrainer, Open Source Toolkits for Training Machine Translation and Large Language Models↗2023Nikolay Bogoychev, Jelmer van der Linde, Graeme Nail, Barry Haddow, Jaume Zaragoza-Bernabeu, Gema Ramírez-Sánchez, Lukas Weymann, Tudor Nicolae Mateiu, Jindřich Helcl, Mikko Aulamo
HPLT: High Performance Language Technologies↗2023Mikko Aulamo, Nikolay Bogoychev, Shaoxiong Ji, Graeme Nail, Gema Ramírez-Sánchez, Jörg Tiedemann, Jelmer Van Der Linde, Jaume Zaragoza
Edinburgh's submission to the WMT 2022 Efficiency task↗2022Nikolay Bogoychev, Maximiliana Behnke, Jelmer Van Der Linde, Graeme Nail, Kenneth Heafield, Biao Zhang, Sidharth Kashyap
Efficient Machine Translation with Model Pruning and Quantization↗2021Maximiliana Behnke, Nikolay Bogoychev, Alham Fikri Aji, Kenneth Heafield, Graeme Nail, Qianqian Zhu, Svetlana Tchistiakova, Jelmer Van der Linde, Pinzhen Chen, Sidharth Kashyap, Roman Grundkiewicz