
About Amazon
The everything store and cloud computing leader
Key Highlights
- Headquartered in South Lake Union, Seattle, WA
- Over 1.5 million employees worldwide
- Leading cloud services through Amazon Web Services (AWS)
- Acquired Whole Foods, Twitch, and Ring
Amazon, headquartered in South Lake Union, Seattle, WA, is the world's largest online retailer and a leader in cloud computing through Amazon Web Services (AWS). With over 1.5 million employees globally, Amazon operates in various sectors, including AI with its Alexa devices and a vast marketplace k...
🎁 Benefits
Amazon offers competitive salaries, stock options, generous PTO policies, and comprehensive health benefits. Employees also have access to a learning ...
🌟 Culture
Amazon's culture is driven by customer obsession and a focus on innovation. The company encourages employees to think big and move fast, fostering an ...
Skills & Technologies
Overview
Amazon is hiring an Engineering Manager for the ML Kernel Performance team at Annapurna Labs. You'll lead efforts to optimize performance for AWS's custom ML accelerators using your expertise in machine learning and high-performance computing. This position requires strong experience in AWS and machine learning frameworks.
Job Description
Who you are
You have a strong background in engineering management with a focus on machine learning and high-performance computing — you've successfully led teams that work at the intersection of hardware and software, ensuring optimal performance for demanding workloads. Your deep understanding of machine learning frameworks, particularly PyTorch, allows you to guide your team in crafting high-performance kernels that maximize the capabilities of custom ML accelerators.
With experience in AWS technologies, you are familiar with the tools and services that support scalable machine learning solutions — you understand the intricacies of deploying models in production and optimizing them for performance. Your leadership style fosters collaboration and innovation, encouraging your team to push the boundaries of what's possible in AI acceleration.
You possess excellent communication skills, enabling you to work effectively with cross-functional teams and stakeholders — you can translate complex technical concepts into actionable insights for both technical and non-technical audiences. Your passion for mentoring and developing talent within your team is evident, as you prioritize their growth and success.
Desirable
Experience with distributed architectures and performance optimization techniques is a plus — you have a track record of implementing solutions that enhance system efficiency and reliability. Familiarity with deep learning compilers and runtime systems will further strengthen your contributions to the team.
What you'll do
As the Engineering Manager for the ML Kernel Performance team, you will lead a group of talented engineers dedicated to maximizing the performance of AWS's custom machine learning accelerators — your role involves overseeing the development of the AWS Neuron SDK, ensuring it meets the needs of customers leveraging deep learning and GenAI workloads. You will work closely with your team to design and implement high-performance kernels, optimizing for every floating-point operation to deliver exceptional performance.
You will collaborate with other teams within AWS to integrate the Neuron SDK with popular machine learning frameworks, such as PyTorch — your insights will help shape the future of AI acceleration, as you contribute to architectural designs and performance benchmarks. Engaging with customers to understand their requirements and challenges will be a key part of your role, allowing you to tailor solutions that drive their success.
In addition to technical leadership, you will be responsible for fostering a culture of innovation and continuous improvement within your team — you will conduct regular performance reviews, provide mentorship, and facilitate professional development opportunities for your engineers. Your strategic vision will guide the team in exploring new technologies and methodologies that enhance the capabilities of AWS's machine learning offerings.
What we offer
Amazon provides a comprehensive benefits package, including competitive compensation, equity options, and a full range of medical and financial benefits — you will have the opportunity to work in a dynamic environment that values innovation and collaboration. The Annapurna Labs team is committed to pushing the boundaries of AI technology, and you will play a pivotal role in shaping its future. Join us in our mission to accelerate deep learning and GenAI workloads, making a significant impact on the industry.
Interested in this role?
Apply now or save it for later. Get alerts for similar jobs at Amazon.
Similar Jobs You Might Like
Based on your interests and this role

Machine Learning Engineer
Amazon is hiring a Senior ML Kernel Performance Engineer to work on the AWS Neuron SDK, optimizing performance for deep learning and GenAI workloads. You'll leverage your expertise in AWS, Python, and machine learning frameworks like TensorFlow and PyTorch. This role requires strong experience in high-performance computing and distributed architectures.

Ml Kernel Performance Engineer
Amazon is hiring an ML Kernel Performance Engineer to optimize performance for AWS's custom ML accelerators. You'll work with technologies like AWS, Python, TensorFlow, and PyTorch. This position requires expertise in machine learning and high-performance computing.

Software Development Manager
Amazon is hiring a Software Development Manager for AWS Neuron to lead the development of machine learning accelerators. You'll work with technologies like AWS, TensorFlow, and PyTorch. This position requires strong leadership and technical skills in machine learning.

Software Development Manager
Amazon is hiring a Software Development Manager for AWS Neuron to lead the development of machine learning accelerators. You'll work with technologies like AWS, Python, and popular ML frameworks such as PyTorch and JAX. This position requires strong leadership skills and experience in software development.

Senior Product Manager
Amazon is hiring a Senior Product Manager for AWS Neuron to define and drive product strategy for the Neuron Kernel Interface. You'll leverage your expertise in machine learning and compiler technologies to enhance developer experience. This role requires a strong background in technical product management.