Software Engineering • Senior

Who you are

You have 5+ years of experience in software engineering, particularly in designing and building distributed systems. Your expertise includes load balancing and ensuring high availability for critical applications. You are skilled in Python and have a strong understanding of observability tools that help monitor system performance.

You thrive in collaborative environments, working closely with researchers and machine learning engineers to understand the impact of infrastructure on model performance. Your problem-solving skills enable you to debug complex issues effectively, ensuring that systems run smoothly and efficiently.

You are passionate about building reliable systems that can handle high traffic and maintain performance under load. Your experience with traffic routing strategies and long-lived connections makes you an ideal candidate for this role.

Desirable

Experience with AI models and their inference processes is a plus. Familiarity with cloud infrastructure and services can enhance your contributions to the team.

What you'll do

In this role, you will architect and build the gateway and network load balancer that fronts all research jobs at OpenAI. You will ensure that long-lived connections remain consistent and performant, optimizing for both reliability and throughput. Your work will directly impact the performance of AI models used by consumers and enterprises alike.

You will design traffic stickiness and routing strategies that are crucial for maintaining the integrity of model inference. Instrumenting and debugging complex distributed systems will be a key part of your responsibilities, focusing on building world-class observability and debuggability tools.

You will own the end-to-end system lifecycle, from design and code to deployment, operation, and scaling. Collaborating closely with researchers and ML engineers, you will help shape the infrastructure decisions that impact model performance and training dynamics.

What we offer

At OpenAI, you will be part of a mission-driven team that believes in the potential of artificial intelligence to solve global challenges. We offer a competitive salary and benefits package, along with opportunities for professional growth and development. Join us in shaping the future of technology and making a meaningful impact in the world.