Amazon

About Amazon

The everything store and cloud computing leader

🏢 Tech👥 1001+ employees📅 Founded 1995📍 South Lake Union, Seattle, WA3.7
B2CB2BMarketplaceCloud ComputingeCommerce

Key Highlights

  • Headquartered in South Lake Union, Seattle, WA
  • Over 1.5 million employees worldwide
  • Leading cloud services through Amazon Web Services (AWS)
  • Acquired Whole Foods, Twitch, and Ring

Amazon, headquartered in South Lake Union, Seattle, WA, is the world's largest online retailer and a leader in cloud computing through Amazon Web Services (AWS). With over 1.5 million employees globally, Amazon operates in various sectors, including AI with its Alexa devices and a vast marketplace k...

🎁 Benefits

Amazon offers competitive salaries, stock options, generous PTO policies, and comprehensive health benefits. Employees also have access to a learning ...

🌟 Culture

Amazon's culture is driven by customer obsession and a focus on innovation. The company encourages employees to think big and move fast, fostering an ...

Amazon

Ai Engineer Mid-Level

AmazonShanghai

Apply Now →

Overview

Amazon is hiring an AI Benchmarking Specialist to support the evaluation of AI systems through benchmarking and auditing activities. You'll work with AI and LLMs to ensure model quality and compliance. This role requires experience in AI auditing and quality assurance.

Job Description

Who you are

You have a strong background in AI and machine learning, with experience in benchmarking and auditing AI systems. You understand the importance of model quality, compliance, and fairness, and you are skilled in designing test plans and metrics to evaluate AI performance. You are detail-oriented and capable of conducting thorough reviews of datasets and model outputs to ensure accuracy and relevancy. Your communication skills enable you to prepare clear audit reports and present findings effectively to stakeholders. You are proactive in identifying potential regulatory risks and are committed to maintaining high standards in AI practices.

What you'll do

In this role, you will assist in planning and executing benchmarking exercises for AI models, defining test plans, metrics, and acceptance criteria across various dimensions such as accuracy, robustness, bias, and reliability. You will support content accuracy and privacy checks by reviewing datasets and model outputs, ensuring compliance with regulatory standards. Your responsibilities will include validating data based on specific annotation guidelines and preparing detailed audit and benchmarking reports that include error ratings, root-cause analysis, and actionable recommendations. You will collaborate with cross-functional teams to enhance the seller experience on Amazon by leveraging AI tools and solutions.

What we offer

At Amazon, you will be part of a dynamic team that is shaping the future of selling on our platform. We offer competitive compensation and benefits, along with opportunities for professional growth and development. You will work in an inclusive environment that values diverse perspectives and encourages innovation. Join us in making a significant impact on the seller experience and advancing the capabilities of AI in e-commerce.

Interested in this role?

Apply now or save it for later. Get alerts for similar jobs at Amazon.

Similar Jobs You Might Like

Based on your interests and this role

Amazon

Ai Engineer

Amazon📍 Shanghai

Amazon is hiring an AI Engineer to support the evaluation of AI systems through benchmarking and auditing activities. You'll work with AI and Large Language Models to ensure model quality and compliance. This position is suitable for entry-level candidates.

Entry-Level
1 month ago
Amazon

Ai Benchmarking Specialist

Amazon📍 Bengaluru

Amazon is hiring an AI Benchmarking Specialist to support the evaluation of AI systems through benchmarking and audit activities. You'll work with AI and LLM tools to enhance seller experiences on Amazon. This role requires expertise in AI auditing and quality assurance.

Mid-Level
1 month ago
Amazon

Ai Engineer

Amazon📍 Shanghai

Amazon is hiring a Senior AI Process Engineer to lead AI-driven engineering initiatives in the Compliance domain. You'll design and implement scalable AI/ML solutions and build efficient ML models. This position requires deep hands-on expertise in AI/ML development.

Senior
2 months ago
Amazon

Marketing Operations

Amazon📍 Shanghai

Amazon is hiring a Senior Marketing AI and Seller Experience Manager to lead the exploration and implementation of AI-driven marketing solutions. You'll work with marketing stakeholders and product teams to develop innovative marketing engagement experiences. This role requires strong product management skills and experience in data-driven marketing.

Senior
3w ago
Amazon

Senior Product Manager

Amazon📍 Shanghai

Amazon is seeking a Senior Product Manager in Shanghai to lead AI initiatives in Seller Education. You'll define product strategies and collaborate with cross-functional teams to deliver impactful learning solutions. This role requires a strong AI/ML product background.

Senior
2 months ago