Software Engineering • Senior

Who you are

You have over 5 years of experience in building large-scale, fault-tolerant distributed systems and API microservices — you've navigated the complexities of cloud environments and understand the nuances of serverless inference platforms. Your expertise includes optimizing autoscaling and minimizing cold starts, ensuring that the systems you build are robust and efficient.

You possess a strong understanding of low-level operating system concepts, including concurrency, networking, and storage — this knowledge allows you to analyze and improve the efficiency and stability of various system resources. You have a proven track record of writing clear, well-tested, and maintainable software, and you are comfortable with Infrastructure as Code (IaC) practices.

Your experience includes conducting design and code reviews, creating developer documentation, and developing testing strategies for robustness and fault tolerance — you understand the importance of collaboration and communication in delivering high-quality software. You are also familiar with multi-cluster orchestration and portfolio optimization, which are essential for managing complex systems effectively.

Desirable

Experience with predictive autoscaling and control panes is a plus, as is familiarity with model bring-up processes on short notice. You have good taste in software design and can thoughtfully discuss how your previous projects have evolved and faced challenges over time.

What you'll do

In this role, you will focus on enabling custom models and dedicated inference on Together's platform — your responsibilities will include optimizing autoscaling and minimizing cold starts to achieve the best end-to-end model performance. You will partner with product teams to understand functional requirements and deliver solutions that meet business needs.

You will analyze and improve the robustness and scalability of existing distributed systems, APIs, databases, and infrastructure — your insights will help shape the future of the platform. Writing clear, well-tested, and maintainable software will be a key part of your daily tasks, as will developing Infrastructure as Code for both new and existing systems.

You will conduct design and code reviews, ensuring that the software meets high standards of quality and maintainability. Additionally, you will create developer documentation and develop testing strategies that enhance the robustness and fault tolerance of the systems you work on.

What we offer

Together AI offers a collaborative work environment where you can grow your skills and contribute to cutting-edge AI infrastructure. You will have the opportunity to work on innovative projects that have a real impact on the developer experience and model performance. We encourage you to apply even if your experience doesn't match every requirement, as we value diverse perspectives and backgrounds.

Join us in Amsterdam and be part of a team that is dedicated to pushing the boundaries of AI technology. We provide a supportive culture that fosters learning and development, ensuring that you have the resources you need to succeed in your role.