Machine Learning Engineer • Senior

Who you are

You have a Bachelor's degree or higher in Computer Science, Engineering, Robotics, or a similar technical field. You possess extensive experience in building scalable data platforms and have a deep understanding of machine learning workflows. Your expertise in Python and familiarity with cloud environments, particularly AWS, allows you to effectively contribute to the development of high-performance data serving SDKs for ML model training and evaluation.

You are skilled in working with distributed systems and have a proven track record of optimizing data processing pipelines. Your experience with Kubernetes and Docker enables you to bootstrap and maintain infrastructure for Data Platform components efficiently. You are also familiar with Apache Spark and TensorFlow, which are essential for handling large-scale datasets and enhancing the efficiency of the ML model development lifecycle.

What you'll do

In this role, you will set the technical strategy and oversee the development of a high-scale, reliable data platform to manage, visualize, and serve large-scale datasets for ML model training and validation. You will build a data lakehouse for autonomous driving scene datasets, including sensor data, calibration data, and annotation data. Your responsibilities will also include driving the development of the Autonomous Driving Data SDK, which encompasses scene data search, datasets preparation, and dataset loading.

You will dig into performance bottlenecks throughout the data processing pipelines, addressing issues related to data processing latency and data search latency. Collaborating with cross-functional teams, including ML algorithm, ML application, and Cloud Infra, you will ensure that the ML Platforms align with the overall Autonomous Driving System Architecture. Your role will be pivotal in enhancing the efficiency of the ML model development lifecycle, including training, evaluation, deployment, and monitoring in a cloud environment.

What we offer

At 42dot, you will be part of a cutting-edge team focused on autonomous driving technologies. We offer a collaborative work environment where innovation is encouraged, and your contributions will directly impact the future of autonomous driving. You will have opportunities for professional growth and development, working alongside experts in the field. We value diversity and inclusion and are committed to creating a workplace where everyone can thrive.