Staff Engineer • Senior

Who you are

5+ years of experience in backend engineering with a focus on machine learning systems — you've designed and built scalable serving stacks that handle high-throughput requests and have a deep understanding of MLOps practices. Your expertise in Python allows you to automate complex workflows and optimize model performance effectively.

You have a solid background in Kubernetes, enabling you to orchestrate data preparation, training, and evaluation workflows seamlessly. Your experience with cloud platforms like AWS equips you with the skills to manage infrastructure and ensure high availability and low latency for model serving.

You are passionate about mentoring engineers and driving best practices in production ML environments. Your ability to instrument observability tools helps you maintain system health and performance, ensuring that your team can respond quickly to any issues that arise.

Desirable

Experience with large language models (LLMs) and their integration into production systems is a plus. Familiarity with caching, sharding, and autoscaling techniques will help you optimize resource usage and reduce costs.

What you'll do

In this role, you will own the model serving infrastructure, designing and building highly available serving stacks for in-house ML models. You will automate training pipelines, orchestrating data prep, training, evaluation, and registry workflows using Kubernetes while adhering to solid MLOps practices.

You will profile and tune system performance, focusing on throughput, memory usage, and cost efficiency. By introducing caching, sharding, and batching strategies, you will ensure that the platform can scale effectively to meet demand.

Your responsibilities will also include creating reusable SDKs, templates, and CLI tools that empower research and product teams to deploy models independently and safely. You will drive blameless post-mortems and mentor engineers on production ML best practices, fostering a culture of continuous improvement.

What we offer

Cresta offers a unique opportunity to work at the intersection of AI and customer experience, contributing to a platform that transforms how contact centers operate. You will be part of a team that values innovation and collaboration, with opportunities for professional growth and development in a supportive environment. Join us in revolutionizing the workforce with AI and making a meaningful impact in the industry.