Technical Program Manager • Mid-Level

Who you are

You have a strong background in project management, particularly in technical environments, and you understand the intricacies of managing the lifecycle of large language model (LLM) projects. You are adept at transforming qualitative user feedback into objective metrics, ensuring that products not only meet deadlines but also exceed quality expectations. Your experience allows you to dive into codebases, integrating evaluations into existing pipelines seamlessly. You thrive in collaborative settings, working closely with cross-functional teams to bridge the gap between research and product deployment.

You possess excellent communication skills, enabling you to articulate complex technical concepts to diverse stakeholders. Your analytical mindset helps you define and design metrics that accurately reflect user experiences and product performance. You are detail-oriented, ensuring that every aspect of the project is meticulously planned and executed. You are passionate about technology and its potential to enhance human-computer interaction, particularly in the realm of voice-based applications.

What you'll do

In this role, you will manage the end-to-end lifecycle of LLM projects, ensuring that research milestones transition smoothly into production-level deployments. You will define and design metrics that transform subjective user feedback into objective datasets, which will be crucial for evaluating product performance. Your responsibilities will include designing and implementing technical evaluations to address issues identified in the field, ensuring that the product evolves based on measurable data. You will track internal and external feedback loops, continuously refining the product based on user interactions and performance metrics.

You will collaborate closely with engineers and researchers, facilitating communication between teams to ensure alignment on project goals and timelines. Your role will require you to dive into the codebase to help integrate evaluations into existing pipelines, making your technical expertise invaluable. You will also be responsible for maintaining a rigorous quality loop, ensuring that the product not only meets but exceeds user expectations. Your ability to manage multiple projects simultaneously while maintaining a focus on quality will be key to your success in this position.

What we offer

At Sesame, we provide a supportive work environment that values innovation and collaboration. You will have access to comprehensive health, vision, and dental benefits, along with a 401k matching program. We offer unlimited PTO and sick time, allowing you to maintain a healthy work-life balance. Our team is dedicated to creating a future where technology enhances everyday life, and we encourage you to apply even if your experience doesn't match every requirement. Join us in shaping the future of voice-based personal agents and be part of a team that is passionate about making technology more human-like.