Lead machine learning engineer (Model Architectures & Capabilities Team)

Nebius

  • London
  • Permanent
  • Full-time
  • 1 month ago
The companyNebius is a modern technology venture offering strategic partnerships to leading companies around the world, empowering them to create their own local hyperscaler platforms and become trustworthy providers of cloud services and technologies in their own regions. In addition to innovative software and hardware, including server racks designed in-house, Nebius provides a launch-ready business model and customizable tools for support, sales, and marketing.Our aim is to empower our partners to create their own IT infrastructure and deliver cutting-edge, disruptive cloud solutions to local markets while keeping security and compliance with international standards like ISO and GDPR top priorities.We’re a global company with offices in the Netherlands, Israel and Serbia.Our teamNebius was founded by a core team of engineers and business professionals with a proven track record of using cloud technologies to create value for other businesses. We know from experience that cutting-edge technologies can only make an impact if their innovation is matched by the level of the experts managing them, so as Nebius expands, our core priority is to attract the most qualified, enthusiastic, and driven individuals we can to join our growing team.Nebius Large Language Models (LLM) team is dedicated to pushing the boundaries of language modelling technology. We are focused on developing a state-of-the-art LLM technological stack that spans web-scale data collection, foundational model training and alignment. Our overarching objective is to pioneer cutting-edge language generation technology for both internal use and customer applications, driving the evolution of the next generation of AI-powered products.The roleWe are currently in search of the team lead for the Model Architectures & Capabilities team. The team is responsible for pushing forward the capabilities of the models, small and large, that we train in-house. This includes finding model architectures that efficiently achieve the desired capabilities, scaling these models to the limits of our hardware, and exploring novel ideas that could potentially expand of what is possible.In this position, your responsibility will be to:
  • Lead the team responsible for model architectures and capabilities
  • Define strategy and tactics, i.e. figure out what research and engineering directions to pursue to push the technology forwards, and help the team plan and execute the experiments that will get us there efficiently
  • Ensure high standards of engineering and research activities within the team
  • Keep improving the design our internal infrastructure for training large models to ensure it keeps being fast and flexible despite the technology moving forwards
  • Mentor our engineers and researchers
We expect you to have:
  • A profound understanding of theoretical foundations of machine learning
  • Deep expertise in modern deep learning for language processing and generation
  • Substantial experience with pre-training large models on huge clusters
  • Good understanding of performance aspects of large neural network training (sharding strategies, custom kernels, hardware features etc.)
  • Strong software engineering skills (we mostly use python)
  • Deep experience with modern deep learning frameworks (we use jax)
  • Proficiency in contemporary software engineering approaches, including CI/CD, version control, and unit testing
  • Strong communication and leadership abilities
It would be an added bonus if you had:
  • Bachelor’s degree in Computer Science, Artificial Intelligence, Data Science, or a related field. Master’s or PhD preferred
  • Track record of building and delivering products (not necessarily ML-related) in a dynamic startup-like environment
  • Experience in engineering complex systems, such as large distributed data processing systems or high-load web services
  • Open-source projects that showcase your engineering prowess
  • Excellent command of the English language, alongside superior writing, articulation, and communication skills
Does all that sound like your kind of challenge? Then join us!

Nebius