Software Engineering • Senior

Who you are

You have 5+ years of software engineering experience, particularly in building scalable systems that leverage Machine Learning. Your expertise includes working with Large Language Models and you understand the intricacies of fine-tuning and deploying these models in production environments. You are proficient in Python and have experience with containerization technologies like Docker and orchestration tools such as Kubernetes. Your collaborative spirit allows you to work effectively with cross-functional teams, including product and platform engineers, to drive innovation.

You are familiar with the entire application development lifecycle and have a strong grasp of system abstractions and APIs. You thrive in environments where you can contribute to technical discussions and help shape the direction of projects. Your problem-solving skills are complemented by a keen attention to detail, ensuring that the systems you build are robust and efficient.

What you'll do

As a Senior Software Engineer at Crusoe, you will be instrumental in developing a managed platform that supports the entire application development lifecycle. You will implement and maintain systems for fine-tuning large foundation models, focusing on multi-node orchestration, checkpointing, and failure recovery. Your role will involve creating end-to-end training pipelines for Large Language Models, ensuring they are optimized for performance and cost-efficiency.

You will also work on components for distillation and reinforcement learning pipelines, contributing to preference optimization and policy optimization. Your responsibilities will include developing core agent execution infrastructure and implementing features for dataset, model, and experiment management, with a focus on versioning and reproducibility.

Collaboration is key in this role, as you will work closely with Senior Engineers and Principal Engineers to implement system abstractions and APIs. You will contribute to technical discussions on training runtimes and help align internal equity with market data. Your work will have a tangible impact on the AI revolution, as you help create sustainable technology that empowers ambitious creativity.

What we offer

At Crusoe, you will be part of a mission-driven team that is dedicated to accelerating the abundance of energy and intelligence. We offer a competitive salary and benefits package, along with opportunities for professional growth and development. You will work in a collaborative environment that values innovation and sustainability, contributing to projects that have a meaningful impact on the world. Join us in shaping the future of cloud infrastructure and AI technology.