Software Engineering • Mid-Level

Who you are

You have a strong background in software engineering, particularly in designing and building systems that evaluate AI models. Your experience includes working with real-world quality metrics and integrating them into training stacks, ensuring that the systems you create are reliable and effective. You thrive in collaborative environments, working closely with research and product teams to drive model improvements. Your builder's mindset allows you to prototype quickly and create reusable systems that others can extend. You are comfortable with both backend pipelines and user-facing interfaces, bridging the gap between technical and product-oriented work.

You bring experience in reinforcement learning and related methods, applying these techniques in production settings to enhance AI systems. Your judgment in creating scalable solutions is complemented by your ability to take initiative and create structure in ambiguous situations. You understand the importance of user feedback and are adept at turning complex workflows into clear, actionable signals for model training.

What you'll do

In this role, you will own the development of evaluation systems that capture real-world quality for advanced AI systems. You will collaborate with cross-functional teams to design and implement evals and harnesses that guide model training and product quality. Your work will directly influence how models behave and improve their reliability, raising the standard for user expectations. You will prototype with users to gather feedback and iterate on your designs, ensuring that the systems you build are both effective and user-friendly.

You will be responsible for evaluating multi-turn and tool-using systems, applying your knowledge of reinforcement learning to enhance their performance. Your role will involve building reliable pipelines that integrate evaluation signals into training stacks, contributing to a compounding loop of model improvement. You will work closely with engineers and researchers, fostering a collaborative environment that encourages innovation and rapid iteration. Your contributions will help shape the future of AI technology, making a significant impact on how users interact with advanced systems.

What we offer

At OpenAI, you will be part of a mission-driven team that believes in the potential of artificial intelligence to solve global challenges. We offer a hybrid work model, allowing you to balance in-office collaboration with remote work flexibility. You will have the opportunity to work on cutting-edge AI technologies and contribute to projects that have a meaningful impact on society. We encourage you to apply even if your experience doesn't match every requirement, as we value diverse perspectives and backgrounds in our team.