About Microsoft
Empowering every person and organization on the planet
Key Highlights
- Market cap exceeds $2 trillion
- 100,000+ employees worldwide
- Leading cloud services through Azure
- Major clients include Walmart and BMW
Microsoft Corporation, headquartered in Redmond, Washington, is a leading technology company known for its software products like Windows and Office, as well as cloud services through Azure. With over 100,000 employees, Microsoft serves millions of customers globally, including major enterprises lik...
🎁 Benefits
Microsoft offers competitive salaries, stock options, generous PTO policies, and comprehensive health benefits. Employees also enjoy a flexible remote...
🌟 Culture
Microsoft fosters a culture of innovation and inclusivity, emphasizing collaboration across teams and a commitment to diversity. The company values em...
Overview
Microsoft is hiring a Principal Product Manager to lead the Evaluation Strategy for Microsoft Agent 365 Tools. You'll define how to measure and improve the performance of agentic tools across diverse models. This role requires deep technical expertise and strategic thinking.
Job Description
Who you are
You are a deeply technical and forward-thinking Principal Product Manager with a strong background in product management and evaluation strategies. You have experience leading complex projects and possess a keen understanding of agentic ecosystems and large-scale model orchestration. Your ability to define and measure product quality is complemented by your collaborative approach to working with engineering teams.
You thrive in environments where innovation and accountability are paramount. Your growth mindset allows you to continuously seek improvement and empower others in your team. You understand the importance of data-driven decision-making and are adept at developing frameworks that enhance product performance.
What you'll do
In this role, you will define and own the evaluation strategy for all first-party and third-party agentic tools, including tool invocation success and quality evaluation. You will develop a unified framework that encompasses various evaluation methods, such as offline and online evaluations, and AI-based assessments. Your work will directly influence product quality bars, release gates, and certification processes, ensuring that Microsoft’s agentic platform meets industry standards.
You will partner closely with engineering teams to evolve internal platforms and ensure that evaluation processes are robust and effective. Your responsibilities will include defining metrics for success, collaborating with cross-functional teams, and continuously improving the evaluation rigor of agentic tools. You will play a critical role in shaping how customers and the industry perceive the reliability of Microsoft’s offerings.
What we offer
At Microsoft, you will be part of a culture that values respect, integrity, and accountability. We encourage you to apply even if your experience doesn't match every requirement. You will have the opportunity to work on cutting-edge technologies and contribute to a mission that empowers every person and organization on the planet to achieve more. We offer a collaborative environment where you can thrive and grow in your career.
Interested in this role?
Apply now or save it for later. Get alerts for similar jobs at Microsoft.
Similar Jobs You Might Like
Based on your interests and this role
Product Manager
Microsoft is seeking a Principal Product Manager to lead the enterprise requirements for the Agentic OS platform. You'll work at the intersection of IT, platform architecture, and AI, ensuring the platform is secure and manageable. This role requires extensive experience in product management and a strong understanding of enterprise needs.
Product Manager
Microsoft is hiring a Principal Product Manager to lead the Copilot Studio team in integrating generative AI capabilities into productivity solutions. You'll work with cross-functional teams to enhance enterprise workflow automation. This role requires deep expertise in product management and AI technologies.
Product Manager
Microsoft is hiring a Principal Product Manager to define and drive platform capabilities for the M365 Core Copilot Infrastructure team. You'll partner with engineering and data science teams to deliver scalable AI infrastructure. This role requires extensive experience in product management.