Performance Engineer

Who you are

You have significant software engineering or machine learning experience, particularly at supercomputing scale — you understand the complexities involved in running large-scale ML algorithms and are eager to tackle novel systems problems. You are results-oriented, with a bias towards flexibility and impact, and you enjoy collaborating with others, even if it means stepping outside your job description. Pair programming is something you thrive on, and you have a genuine interest in learning more about machine learning research and its societal impacts.

Strong candidates may also have experience with high performance, large-scale ML systems, GPU/Accelerator programming, ML framework internals, and OS internals. You are excited about the opportunity to implement low-latency high-throughput sampling for large language models and write custom load-balancing algorithms to enhance system performance.

What you'll do

As a Performance Engineer at Anthropic, you will be responsible for identifying and solving large-scale systems problems that arise when running machine learning algorithms at scale. Your role will involve developing systems that optimize the throughput and robustness of our distributed systems, ensuring that they operate efficiently and effectively. You will collaborate closely with a team of researchers and engineers, contributing to the development of reliable, interpretable, and steerable AI systems.

You will implement GPU kernels to adapt our models to low-precision inference, which is crucial for enhancing performance. Your work will directly impact the efficiency of our AI systems, and you will have the opportunity to grow into an expert in machine learning as you tackle these challenges. You will also be involved in various projects that require innovative thinking and a deep understanding of both software engineering and machine learning principles.

What we offer

At Anthropic, we offer competitive compensation and benefits, including optional equity donation matching, generous vacation and parental leave, and flexible working hours. Our office in San Francisco provides a collaborative environment where you can work alongside committed researchers, engineers, policy experts, and business leaders. We are dedicated to creating a workplace that fosters growth and encourages you to make a meaningful impact in the field of AI.