Senior / Staff ML Engineer (LLMs and Agentic Systems)

The role: 

LLM team is currently in search of senior and staff-level ML engineers to work on the agentic models for software engineering tasks. 

Your responsibilities will include: 

• Conducting experiments to figure out efficient ways to train a large language model on traces of interactions with various environments
• Exploring methods of guided generation and search in the trajectory space
• Coming up with ways to mine web-scale data for examples relevant to the tasks of interest and figuring out efficient ways to do post-pretraining on that data
• Ensuring that infrastructure for running models on agentic tasks is robust and performant 

We expect you to have: 

• A profound understanding of theoretical foundations of machine learning
• Deep expertise in modern deep learning for language processing and generation
• Substantial experience with training large models on multiple nodes
• Reasonable understanding of performance aspects of large neural network training (sharding strategies, custom kernels, hardware features etc.)
• Strong software engineering skills (we mostly use python)
• Deep experience with modern deep learning frameworks (we use jax)
• Proficiency in contemporary software engineering approaches, including CI/CD, version control and unit testing
• Strong communication and leadership abilities 

Nice to have: 

• Experience with deep reinforcement learning for LLMs, including techniques such as reward modeling, DPO, PPO etc.
• Familiarity with important ideas in LLM space, such as MHA, RoPE, ZeRO/FSDP, Flash Attention, quantization
• Bachelor’s degree in Computer Science, Artificial Intelligence, Data Science, or a related field Master’s or PhD preferred
• Track record of building and delivering products (not necessarily ML-related) in a dynamic startup-like environment
• Experience in engineering complex systems, such as large distributed data processing systems or high-load web services
• Open-source projects that showcase your engineering prowess
• Excellent command of the English language, alongside superior writing, articulation, and communication skills 

 About Nebius AI 

Nebius AI is an AI cloud platform with one of the largest GPU capacities in Europe. Launched in November 2023, the Nebius AI platform provides high-end, training-optimized infrastructure for AI practitioners. As an NVIDIA preferred cloud service provider, Nebius AI offers a variety of NVIDIA GPUs for training and inference, as well as a set of tools for efficient multi-node training. 

Nebius AI owns a data center in Finland, built from the ground up by the company’s R&D team and showcasing our commitment to sustainability. The data center is home to ISEG, the most powerful commercially available supercomputer in Europe and the 16th most powerful globally (Top 500 list, November 2023).   

Nebius’s headquarters are in Amsterdam, Netherlands, with teams working out of R&D hubs across Europe and the Middle East.  

Nebius AI is built with the talent of more than 500 highly skilled engineers with a proven track record in developing sophisticated cloud and ML solutions and designing cutting-edge hardware. This allows all the layers of the Nebius AI cloud – from hardware to UI – to be built in-house, distictly differentiating Nebius AI from the majority of specialized clouds: Nebius customers get a true hyperscaler-cloud experience tailored for AI practitioners.

We’re growing and expanding our products every day. If you’re up to the challenge and are excited about AI and ML as much as we are, join us!