Ai Research Engineer • Mid-Level

Who you are

You have strong statistical analysis and experimental design skills to rigorously measure model improvements — your experience allows you to conduct critical comparative analysis that advances understanding of model capabilities. Familiarity with LLM evaluation methodologies, including static benchmarks and human preference evaluations, is essential for this role. You thrive in a fast-paced startup environment, demonstrating high agency and a bias for impact over process. Your collaborative nature and attention to detail motivate you to build feedback loops that enhance model performance. You are excited to work in a new frontier lab, defining how we measure and accelerate progress toward more capable models.

What you'll do

In this role, you will conduct critical comparative analysis to advance the understanding of model capabilities — your insights will directly influence the development of evaluation systems and processes that create tight feedback loops between data, evaluations, and model behavior. You will develop generalizable evaluation frameworks that capture what matters for reasoning, alignment, and usefulness. Collaborating closely with pre-training, post-training, and applied teams, you will translate insights into model improvements. You will push the boundaries of what’s measurable, utilizing synthetic evaluations, human feedback, and real-world interaction data to refine evaluation methodologies.

What we offer

Joining Reflection means being part of a mission-driven team dedicated to building open superintelligence accessible to all. We provide fully paid parental leave for all new parents, including those on adoptive and surrogate journeys. Our benefits include paid time off when you need it, relocation support, and perks that optimize your time. Opportunities to connect with teammates are abundant, with daily lunches and dinners provided, as well as regular off-sites and team celebrations. We believe in fostering a supportive and collaborative environment where your contributions can make a significant impact.