Machine Learning Engineer • Senior

Who you are

You have a strong background in machine learning and AI, with extensive experience in developing and fine-tuning Large Language Models (LLMs) for various applications. Your expertise in Python and frameworks like TensorFlow and PyTorch allows you to implement complex algorithms and optimize models effectively. You are familiar with Reinforcement Learning techniques, particularly Reinforcement Learning with Human Feedback (RLHF), and understand how to adapt models for different languages and domains.

You have experience designing and implementing distributed training pipelines, ensuring scalability and efficiency in model training. Your knowledge of tools such as Fully Sharded Data Parallel (FSDP) and DeepSpeed enables you to tackle large-scale training challenges. You are also adept at optimizing AI models for deployment on specialized hardware, particularly AWS Inferentia and Trainium, leveraging the AWS Neuron SDK to enhance performance.

What you'll do

In this role, you will drive the development of custom LLMs, collaborating with a multidisciplinary team to deliver innovative AI solutions for AWS clients. You will be responsible for designing and implementing large-scale training pipelines, ensuring that they are efficient and scalable. Your work will involve fine-tuning LLMs for diverse use cases, adapting them for new languages and domains through continued pre-training and customization.

You will optimize AI models for deployment on AWS's custom silicon, working closely with foundational model providers to enhance performance and efficiency. Your contributions will directly impact the success of the Generative AI Innovation Center, as you tackle end-to-end LLM training pipelines and deliver next-generation AI solutions. You will also have the opportunity to collaborate with strategists, scientists, and engineers, ensuring that the solutions you develop meet the transformative business needs of our customers.

What we offer

At Amazon, you will be part of a dynamic team that is at the forefront of AI innovation. We provide a collaborative environment where you can grow your skills and contribute to cutting-edge projects. You will have access to the latest technologies and resources, enabling you to push the boundaries of what is possible in AI. We encourage you to apply even if your experience doesn't match every requirement, as we value diverse perspectives and backgrounds in our team.