Applied Scientist • Senior

Who you are

You have extensive experience with prompting techniques and a deep understanding of GenAI models, with over a year of industry experience in building or evaluating these models. Your familiarity with LLMOps processes for deploying, monitoring, and optimizing AI models in production sets you apart as a candidate. You are passionate about enhancing AI applications and have a strong desire to contribute to the evaluation of various Apple AI products.

You thrive in collaborative environments, working closely with product teams, annotation specialists, and evaluation data scientists. Your innovative mindset drives you to develop cutting-edge solutions that improve the quality and efficiency of AI product evaluations. You are committed to building robust, trustworthy, and extensible autograders that assess product performance and user experience while adhering to quality and safety standards.

What you'll do

In this pivotal role, you will design and advance state-of-the-art autograder systems that evaluate various AI product quality at scale. You will apply your deep expertise in prompt engineering and foundation model adaptation to build autograders that enhance the evaluation process. Collaborating with cross-functional teams, you will deploy these advanced systems, directly impacting the quality and success of Apple’s next-generation AI-powered features.

Your responsibilities will include developing innovative AI/ML models that automate grading and quality assessments, ensuring that they meet the highest standards of performance and user experience. You will also engage in continuous improvement of these models, utilizing feedback and data to refine their effectiveness. Your role will require you to stay updated on the latest advancements in AI and machine learning, integrating new techniques and methodologies into your work.

You will be instrumental in shaping the evaluation methodologies used across various Apple features, from Search and Siri to the latest AI capabilities. Your contributions will help ensure that Apple’s AI products not only meet but exceed user expectations, providing valuable insights and enhancing overall product quality.

What we offer

Apple offers a dynamic work environment where innovation and collaboration are at the forefront. You will have the opportunity to work on groundbreaking AI technologies that impact millions of users worldwide. We provide competitive compensation and benefits, along with a culture that values diversity and inclusion. Join us in our mission to enhance the evaluation of AI products and contribute to the future of technology at Apple.