Software Engineering • Senior

Who you are

5+ years of experience in software engineering with a focus on infrastructure — you've designed and implemented scalable systems that support machine learning applications and understand the complexities of deploying models in production environments.

Deep expertise in Kubernetes and cloud infrastructure — you've optimized deployments for performance and cost-effectiveness, ensuring high availability and reliability for critical applications.

Strong programming skills in Python — you are comfortable writing clean, maintainable code and have experience with libraries and frameworks that support machine learning workflows.

Experience with GPU management and optimization — you understand the intricacies of deploying models on various GPU architectures and can drive enhancements for efficient model serving.

Excellent problem-solving skills and a collaborative mindset — you thrive in team environments and enjoy working with cross-functional teams to tackle complex challenges in AI and machine learning.

What you'll do

As a Senior Infrastructure Software Engineer at Baseten, you will architect and lead the development of our ML inference platform, making key technical decisions that impact the infrastructure enabling developers to deploy, scale, and monitor ML models.

You will design and implement scalable infrastructure systems that support high-performance model serving, ensuring that our platform can handle the demands of production AI applications.

Your role will involve optimizing Kubernetes deployments to enhance efficiency and reduce costs, driving improvements in our inference orchestration layer for complex model deployments.

You will define monitoring strategies for model performance, latency, and resource utilization, ensuring that our systems are robust and reliable.

Additionally, you will develop advanced solutions for GPU capacity management and throughput optimization, working closely with the infrastructure team to enhance our capabilities.

What we offer

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

Join a collaborative and forward-thinking team that is passionate about building cutting-edge AI products. We offer competitive compensation and benefits, along with opportunities for professional growth and development in a rapidly evolving industry.