Machine Learning Engineer • Senior

Who you are

You have 5+ years of experience in machine learning engineering, particularly in developing and optimizing distributed training solutions. Your expertise includes working with large-scale models such as GPT and Llama, and you understand the intricacies of training these models effectively. You are proficient in Python and have hands-on experience with distributed training libraries like Deepspeed and Nemo.

You thrive in collaborative environments, working alongside chip architects and compiler engineers to create innovative solutions. Your strong analytical skills enable you to optimize models for peak performance on AWS custom silicon, ensuring efficiency and effectiveness in your work.

You are familiar with the AWS ecosystem and have experience with AWS Neuron, which is crucial for this role. Your background includes a solid understanding of machine learning frameworks, and you are comfortable leading efforts to integrate distributed training support into frameworks like PyTorch and JAX.

Desirable

Experience with FSDP (Fully-Sharded Data Parallel) is a plus, as is familiarity with the Neuron compiler and runtime stacks. You have a passion for pushing the boundaries of what is possible in machine learning and are eager to tackle complex challenges.

What you'll do

In this role, you will lead the development of distributed training support for AWS Neuron, focusing on enhancing the performance of various ML model families. You will collaborate closely with cross-functional teams to build and tune distributed training solutions that leverage AWS Trainium instances. Your responsibilities will include optimizing models to achieve peak performance and maximizing efficiency on custom silicon.

You will be responsible for integrating distributed training capabilities into PyTorch and JAX, utilizing XLA and the Neuron compiler. Your work will directly impact the performance of large-scale machine learning applications, enabling customers to solve complex challenges with innovative cloud solutions.

You will also engage in performance tuning and enablement of a wide variety of ML models, ensuring that they run efficiently on AWS infrastructure. Your contributions will help shape the future of machine learning at Amazon, making a significant impact on how customers utilize cloud solutions.

What we offer

Amazon provides a competitive salary range of $193,300.00 - $261,500.00 USD annually, along with comprehensive benefits including dental, vision, and mental health support. You will have access to a 401(k) matching program, paid time off, and parental leave, ensuring a supportive work-life balance. Join us at Amazon to be part of a team that is at the forefront of innovation in machine learning and cloud technology.