Applied Scientist • Senior

Who you are

You have extensive experience with prompting techniques and a deep understanding of GenAI models, having spent over a year in the industry building or evaluating these models. Your familiarity with LLMOps processes for deploying, monitoring, and optimizing AI models in production sets you apart as a candidate. You are innovative and passionate about applying AI applications to enhance product evaluations, and you thrive in collaborative environments where you can work closely with product teams and data scientists.

Your background includes a strong foundation in AI/ML techniques, enabling you to design and advance state-of-the-art autograder systems that evaluate AI product quality at scale. You understand the importance of building robust, trustworthy, and extensible systems that adhere to quality and safety standards. You are excited about the opportunity to directly impact the quality and success of Apple’s next-generation AI-powered features.

Desirable

You have experience in collaborating with cross-functional teams, including product managers, annotation specialists, and tooling engineers, to deploy advanced autograders. Your ability to communicate complex technical concepts clearly and effectively is a key asset in your role. You are also open to learning and adapting to new methodologies and technologies as the field of AI continues to evolve.

What you'll do

In this pivotal role, you will design and develop cutting-edge AI/ML models specifically for the automatic grading and quality assessment of Apple’s internal GenAI products. You will leverage your expertise in prompt engineering and evaluation methodologies to create systems that assess product performance and user experience. Your work will involve applying advanced AI techniques to enhance both the quality and efficiency of evaluations across various Apple features, from Search to Siri.

You will collaborate with a diverse team of product, annotation, and evaluation data scientists, as well as autograder tooling engineers, to ensure the successful deployment of these systems. Your contributions will directly influence the quality of Apple’s AI products, making your role critical to the organization’s success. You will also be responsible for monitoring the performance of the autograders and iterating on their design based on feedback and evaluation results.

What we offer

Apple offers a dynamic work environment where innovation is encouraged, and your contributions will have a significant impact on the future of AI technology. You will have access to cutting-edge resources and tools to support your work. The company values diversity and inclusion, fostering a culture where all employees can thrive and contribute to their fullest potential. You will be part of a team that is dedicated to pushing the boundaries of what is possible with AI, and you will have opportunities for professional growth and development within the organization.