Mlops Engineer • Senior

Who you are

You have over 5 years of experience in MLOps, DevOps, or related fields, focusing on the deployment and management of large-scale machine learning models. Your expertise includes using container technologies like Docker and orchestration tools such as Kubernetes, which you have leveraged to build and maintain high-availability systems. You possess a comprehensive understanding of deep learning and machine learning principles, enabling you to collaborate effectively on data preprocessing, model training, and serving processes.

Your problem-solving skills are exceptional, allowing you to tackle complex issues and communicate effectively with various teams and partners. You have experience in workflow orchestration, having utilized tools like Airflow, KubeFlow, or MLflow to streamline processes and improve efficiency. You are also familiar with monitoring systems that track model performance and stability, ensuring that any anomalies are detected and addressed promptly.

Desirable

You have experience in building quality improvement systems based on service logs and metrics, which enhances the overall performance of deployed models. Familiarity with billing systems and data collection and analysis using the ELK stack or similar tools is a plus. You have worked with streaming data processing technologies like Kafka and Redis, and have experience in deploying GPU services on Kubernetes. Your knowledge of caching technologies such as Memcached and Redis further supports your ability to optimize resource management.

What you'll do

In this role, you will be responsible for the efficient improvement of the LLM training and deployment pipeline, systematically managing the model lifecycle through version control and model integration. You will automate build and deployment processes to minimize repetitive tasks and ensure a stable operational environment. Your role will involve building monitoring systems to track the performance and stability of operational models, allowing for proactive detection and resolution of issues through service metrics.

You will design and optimize high-performance infrastructure to provide fast and reliable model serving, utilizing scalable technology stacks across various environments. Your contributions will be crucial in accelerating mobility innovation by ensuring the scalability and safety of LLMs in a rapidly changing landscape. You will collaborate with cross-functional teams to enhance the overall safety and reliability of models and services.

What we offer

At 42dot, you will be part of a forward-thinking team dedicated to pushing the boundaries of mobility innovation. We offer a collaborative work environment where your contributions will directly impact the success of our projects. You will have opportunities for professional growth and development, working alongside experts in the field. We encourage you to apply even if your experience doesn't match every requirement, as we value diverse perspectives and skills.