Data Engineer • Senior

Who you are

You have 5+ years of experience in data engineering, particularly in building scalable data platforms that support machine learning workflows. Your expertise in big data infrastructure allows you to design systems that efficiently manage large datasets while ensuring compliance and governance. You are proficient in Python and have hands-on experience with tools like Apache Spark and BigQuery, which you use to process and analyze data at scale. You understand the importance of data lineage and governance, and you are passionate about creating intuitive APIs and SDKs that enhance the productivity of ML practitioners.

You thrive in collaborative environments and enjoy working with cross-functional teams, including ML engineers and data scientists. Your strong communication skills enable you to articulate complex technical concepts to non-technical stakeholders, ensuring alignment across teams. You are detail-oriented and have a strong focus on building systems that are not only functional but also maintainable and scalable.

Desirable

Experience with containerization technologies like Docker and orchestration tools such as Kubernetes is a plus. Familiarity with compliance frameworks and data governance best practices will help you excel in this role. You are also open to learning new technologies and methodologies that can enhance your work and the team's output.

What you'll do

In this role, you will architect and build Apple's next-generation machine learning dataset management platform. This platform will enable teams across the company to efficiently manage the full lifecycle of datasets, from initial curation and annotation through versioning, model training, evaluation, sharing, and compliance. You will design scalable infrastructure that supports dataset operations at massive scale while maintaining strong governance guarantees.

Your responsibilities will include building data lineage tracking systems and implementing automated compliance workflows. You will create intuitive APIs and SDKs for dataset access, ensuring seamless integration with ML training and evaluation pipelines. You will collaborate closely with teams building customer-facing ML features across iOS, macOS, and other Apple platforms, as well as with compute infrastructure teams and ML framework owners.

You will also be involved in optimizing data processing workflows and ensuring that the platform meets the needs of various teams within Apple. Your work will directly impact the productivity of ML practitioners, enabling them to focus on building intelligent experiences rather than managing data complexities.

What we offer

Apple offers a dynamic work environment where innovation is at the forefront. You will have the opportunity to work on cutting-edge technologies and contribute to projects that impact millions of users worldwide. We provide competitive compensation and benefits, including health and wellness programs, retirement plans, and opportunities for professional development. Join us in shaping the future of machine learning at Apple.