Data Scientist • Mid-Level

Who you are

You have a strong background in data science, with experience in designing and analyzing experiments that measure improvements in AI systems. Your expertise in statistical methods allows you to define success metrics that connect data to user outcomes effectively. You are proficient in Python and SQL, enabling you to build data models and perform in-depth analyses. You understand the importance of collaboration and can partner effectively with engineering and product teams to translate data insights into actionable decisions. You are passionate about making programming accessible and are excited to contribute to a mission that democratizes software development. You thrive in a hybrid work environment, balancing in-office collaboration with remote flexibility.

Desirable

Experience with AI or machine learning projects is a plus, as is familiarity with data engineering practices. You may have worked in cross-functional teams and have a knack for communicating complex data insights to non-technical stakeholders.

What you'll do

In this role, you will directly impact Replit's AI agent by defining how success is measured and designing experiments that drive improvements. You will analyze agent trace data, including prompts, responses, and execution outcomes, to derive actionable insights that enhance user experiences. You will collaborate with AI engineering and product teams to ensure that data-driven decisions shape the product roadmap. Your work will involve building a semantic layer for agent data in partnership with data engineering, defining the necessary tables and metrics for self-serve analysis. You will surface insights from your analyses to identify failure modes and successful patterns, ultimately improving agent effectiveness. You will have a seat at the table for strategic discussions, influencing the direction of the AI team and the company as a whole.

What we offer

Replit fosters an inclusive culture that values diverse perspectives and experiences. You will be part of a team that is committed to making programming more accessible worldwide. The company offers a hybrid work model, allowing you to work in the office on designated days while also enjoying the flexibility of remote work. You will have opportunities for professional growth and development as you contribute to a mission-driven organization that is redefining software creation.