Staff Engineer • Senior

Who you are

You have a strong background in software engineering with a focus on infrastructure and developer experience — your passion for AI and machine learning drives you to create reliable and efficient systems. You possess deep expertise in Python, having used it extensively in production environments to build scalable applications that serve AI models effectively.

With experience in deploying and managing machine learning models at scale, you understand the complexities of model inference and serving infrastructure — you've navigated challenges related to reliability, scalability, and cost-efficiency in previous roles. Your technical leadership skills enable you to set the direction for architecture and deployment strategies, guiding teams to make informed decisions.

You thrive in collaborative environments, working closely with cross-functional teams to enhance developer experience and operational efficiency — your ability to communicate complex technical concepts clearly helps bridge gaps between engineering and product teams. You are also familiar with cloud technologies, particularly AWS, and have experience with containerization tools like Docker and orchestration platforms such as Kubernetes.

Desirable

Experience with GPU/CPU resource management and autoscaling strategies is a plus — you have a keen interest in optimizing infrastructure costs while maintaining high performance. Familiarity with observability tools and practices will help you contribute to improving model observability and batch inference reliability.

What you'll do

As a Staff Software Engineer on the AI Serving team, you will write and ship production code that powers AI capabilities across HubSpot — your contributions will directly impact user and business outcomes at scale. You will lead the evolution of the model serving and inference infrastructure, focusing on enhancing reliability, scalability, and cost-efficiency.

You will set the technical direction for how HubSpot deploys and operates machine learning models, guiding architectural decisions and cost optimization strategies. Collaborating with other engineers, you will ensure that the serving frameworks and libraries are robust and efficient, enabling synchronous, asynchronous, and offline inference.

Your role will involve improving the efficiency of batch inference processes and strengthening model observability — you will work on developing and refining model deployment pipelines that facilitate seamless integration and scaling of AI models across various environments. You will also contribute to the development of core Python libraries and tooling that support the broader engineering community at HubSpot.

What we offer

HubSpot provides a flexible work environment with options for office, hybrid, or remote work within the UK. You will be part of a dynamic team that is at the forefront of AI innovation, contributing to projects that empower businesses globally. We offer competitive compensation and benefits, along with opportunities for professional growth and development in a supportive culture that values collaboration and creativity.