
About Together AI
Empowering corporate mentorship for effective learning
Key Highlights
- Founded in 2018, headquartered in Toronto, ON
- Raised $1.7 million in seed funding
- Partnerships with Heineken, Reddit, and 7-Eleven
- 4 weeks paid vacation and competitive equity packages
Together is a corporate mentorship management platform founded in 2018, headquartered in CityPlace, Toronto, ON. The platform streamlines the mentorship lifecycle, facilitating connections among employees at companies like Heineken, Reddit, and 7-Eleven. With $1.7 million in seed funding, Together a...
🎁 Benefits
Together offers competitive salaries and equity packages, 4 weeks of paid vacation, and a comprehensive health, dental, and vision plan through Honeyb...
🌟 Culture
Together fosters a culture of autonomy and impact, allowing employees to take on significant responsibilities without bureaucratic constraints. The fo...
Overview
Together AI is seeking a Machine Learning Engineer to optimize AI inference systems. You'll work with large language models and collaborate with researchers and engineers. This role requires proficiency in Python and PyTorch.
Job Description
Who you are
You have 3+ years of experience writing high-performance, well-tested, production-quality code — you've developed systems that are reliable and efficient at scale. Your proficiency with Python and PyTorch allows you to build and optimize runtime inference services for large-scale AI applications. You possess a strong understanding of low-level operating systems concepts including multi-threading, memory management, and performance optimization — these skills enable you to create robust and fault-tolerant systems for data ingestion and processing. You thrive in collaborative environments, working closely with AI researchers and engineers to bring innovative features and capabilities to life. You are detail-oriented and conduct design and code reviews to ensure high standards of quality in your work. You are passionate about AI inference and are eager to contribute to cutting-edge AI solutions.
Desirable
Knowledge of additional AI frameworks or libraries would be a plus, as would experience in building high-performance libraries and tooling. Familiarity with large language models and their applications in real-world scenarios can enhance your contributions to the team.
What you'll do
In this role, you will design and build the production systems that power the Together AI inference engine, ensuring they run efficiently and effectively at scale. You will develop and optimize runtime inference services, collaborating with a diverse team of researchers, engineers, product managers, and designers to implement new features and research capabilities. Your responsibilities will include conducting design and code reviews, creating services and tools to support the inference engine, and documenting your work for developers. You will implement robust systems for data ingestion and processing, ensuring that the AI inference systems are reliable and performant. Your contributions will directly impact the performance of AI applications, shaping the future of AI solutions at Together AI.
What we offer
Together AI provides an opportunity to work in a dynamic environment where innovation is encouraged. You will have the chance to collaborate with talented professionals in the AI field, contributing to projects that push the boundaries of technology. We offer competitive compensation and a supportive culture that values your contributions and growth. Join us in shaping the future of AI and making a meaningful impact in the industry.
Interested in this role?
Apply now or save it for later. Get alerts for similar jobs at Together AI.
Similar Jobs You Might Like
Based on your interests and this role

Machine Learning Engineer
Together AI is seeking a Senior Machine Learning Engineer to develop systems and APIs for LLM inference and fine-tuning. You'll work with Python, Go, and Rust to build scalable, high-performance solutions. This role requires 5+ years of experience in production-quality code.

Machine Learning Engineer
Mercor is hiring a Machine Learning Engineer to work at the intersection of backend engineering and applied machine learning. You'll build production systems that power performance prediction, search, recommendation, and fraud detection. This role requires expertise in Python and machine learning techniques.

Machine Learning Engineer
Orchard Robotics is hiring a Senior Machine Learning Engineer to develop innovative solutions for agricultural automation. You'll work with machine learning and computer vision technologies to analyze vast amounts of farm image data. This role requires experience in deploying ML models and a passion for sustainable farming.

Machine Learning Engineer
OSARO is hiring a Machine Learning Engineer to enhance the capabilities of their robots through advanced machine learning systems. You'll work with Python and TensorFlow to develop and validate deep learning models. This role requires a strong background in machine learning and robotics.

Machine Learning Engineer
Scribd is hiring a Machine Learning Engineer to contribute to their mission of democratizing knowledge and ideas. You'll work in a collaborative environment focused on innovation and flexibility. This position requires a strong background in machine learning and data analysis.