Staff Engineer • Senior

Who you are

You have a strong background in software engineering with a focus on distributed systems — you've tackled complex challenges in building and maintaining large-scale infrastructures that serve millions of users. Your experience includes performance optimization techniques that enhance system efficiency and responsiveness, ensuring that AI models operate at peak performance.

You are familiar with intelligent request routing and large-scale service orchestration — you've designed systems that efficiently manage requests across diverse AI accelerators and cloud platforms. Your understanding of LLM inference optimization and batching strategies allows you to contribute to the development of next-generation AI models.

What you'll do

As a Staff Software Engineer on the Inference team, you will work end to end to identify and address key infrastructure blockers that impact the deployment of AI systems. You will collaborate with researchers and engineers to enhance the performance of AI models, ensuring they are reliable and efficient for users worldwide. Your role will involve tackling complex distributed systems challenges, optimizing compute efficiency, and enabling breakthrough AI research.

You will be responsible for the entire stack, from intelligent request routing to fleet-wide orchestration across multiple AI accelerators. Your contributions will directly impact the ability to serve Claude to millions of users while supporting the research team with high-performance inference infrastructure. You will also have the opportunity to mentor junior engineers and contribute to the team's growth and success.

What we offer

At Anthropic, we provide competitive compensation and benefits, including generous vacation and parental leave. You will have flexible working hours and the chance to collaborate in a lovely office space with colleagues who are equally committed to building beneficial AI systems. We encourage you to apply even if your experience doesn't match every requirement, as we value diverse perspectives and backgrounds.