Machine Learning Engineer • Senior

Who you are

You have 5+ years of experience in machine learning engineering, particularly with distributed training of large models. Your expertise includes working with frameworks like PyTorch and JAX, and you understand the intricacies of optimizing models for performance on custom silicon. You are proficient in Python and have experience with libraries such as Deepspeed and Nemo, which are essential for building efficient distributed training solutions.

You thrive in collaborative environments, working alongside chip architects and compiler engineers to create innovative solutions. Your strong analytical skills allow you to tackle complex technical challenges, and you have a proven track record of delivering results that drive significant impact. You are passionate about advancing the field of machine learning and are eager to contribute to cutting-edge projects.

Desirable

Experience with AWS services and cloud-based solutions is a plus. Familiarity with large language models like GPT and Llama, as well as vision transformers, will help you excel in this role. You are also open to learning new technologies and methodologies that can enhance your work and the team's output.

What you'll do

In this role, you will lead efforts to integrate distributed training support into PyTorch and JAX, utilizing the Neuron compiler and runtime stacks. Your primary responsibility will be to optimize machine learning models to achieve peak performance on AWS custom silicon, ensuring that they run efficiently and effectively. You will collaborate closely with cross-functional teams to develop and enable a wide variety of ML model families, including massive-scale models.

You will be responsible for performance tuning and enabling distributed training solutions that can handle the demands of large-scale machine learning tasks. Your work will directly contribute to the success of AWS Neuron, helping to deliver innovative cloud solutions that address complex challenges. You will also mentor junior engineers, sharing your knowledge and expertise to foster a culture of learning and growth within the team.

What we offer

Amazon provides a dynamic work environment where you can make a significant impact on the future of machine learning and cloud computing. You will have access to cutting-edge technologies and the opportunity to work on projects that push the boundaries of what is possible. We offer competitive compensation packages, including equity and comprehensive benefits, to ensure that you are well-supported in your role. Join us and be part of a team that is changing the world through technology.