I build foundation language models and multilingual systems. My work spans Llama pretraining and inference, and efficient machine translation.

Experience

Research Engineer Meta

Work on Llama 3 and 4 at Meta Superintelligence Labs. Focus on pretraining efficiency through distillation, pruning and scaling, plus reasoning and inference optimization. Also clean and deduplicate high-quality multilingual web data.

  • PyTorch
  • PySpark
  • Python
  • C++

Senior Machine Translation Scientist Efficient Translation Ltd.

Built high-performance machine translation systems tailored to each client, designed to run locally for privacy. Developed complete model pipelines covering data bitexting, augmentation, knowledge distillation, quantization and evaluation.

  • C++
  • Python
  • HPC

Postdoctoral Research Associate (StatMT) University of Edinburgh

Scaled machine translation pipelines to process 12 petabytes of web data for the HPLT project. Published open-source bitexts and efficient translation models. Worked on CPU and GPU inference optimizations and achieved competitive results in the WMT Efficiency Tasks.

  • C++
  • Python
  • Bash

Postdoctoral Research Associate (PPT) University of Edinburgh

Improved simulations of QCD phenomena for the LHC by updating modeling code for the Herwig and HEJ Monte Carlo frameworks. Implemented key computations for vector-boson scattering in the high-energy limit.

  • C++
  • Python
  • Mathematica

Education

PhD Theoretical Particle Physics University of Manchester

Analytical research and software development for computational simulations of QCD phenomenology at the Large Hadron Collider. Investigated new accuracy improvements (KrkNLO) and analyzed parton shower uncertainties.

MSci in Mathematics and Physics Durham University

First Class Honours.

Selected publications

  • The Llama 3 Herd of Models ↗2024The Llama Team
  • A New Massive Multilingual Dataset for High-Performance Language Technologies ↗2024Ona De Gibert, Graeme Nail, Nikolay Arefyev, Marta Bañón, Jelmer Van Der Linde, Shaoxiong Ji, Jaume Zaragoza-Bernabeu, Mikko Aulamo, Gema Ramírez-Sánchez, Andrey Kutuzov, Sampo Pyysalo, Stephan Oepen, Jörg Tiedemann
  • OpusCleaner and OpusTrainer, Open Source Toolkits for Training Machine Translation and Large Language Models ↗2023Nikolay Bogoychev, Jelmer van der Linde, Graeme Nail, Barry Haddow, Jaume Zaragoza-Bernabeu, Gema Ramírez-Sánchez, Lukas Weymann, Tudor Nicolae Mateiu, Jindřich Helcl, Mikko Aulamo
  • HPLT: High Performance Language Technologies ↗2023Mikko Aulamo, Nikolay Bogoychev, Shaoxiong Ji, Graeme Nail, Gema Ramírez-Sánchez, Jörg Tiedemann, Jelmer Van Der Linde, Jaume Zaragoza
  • Edinburgh's submission to the WMT 2022 Efficiency task ↗2022Nikolay Bogoychev, Maximiliana Behnke, Jelmer Van Der Linde, Graeme Nail, Kenneth Heafield, Biao Zhang, Sidharth Kashyap
  • Efficient Machine Translation with Model Pruning and Quantization ↗2021Maximiliana Behnke, Nikolay Bogoychev, Alham Fikri Aji, Kenneth Heafield, Graeme Nail, Qianqian Zhu, Svetlana Tchistiakova, Jelmer Van der Linde, Pinzhen Chen, Sidharth Kashyap, Roman Grundkiewicz

Skills

LANGUAGES & TOOLS

C++ · Python · Bash · Git · SQL · $\LaTeX$

ML & SYSTEMS

PyTorch · PySpark · HPC · Linux · macOS

WEB

HTML · CSS · JavaScript

LANGUAGES

English (native) · Italian (basic)