
About MongoDB
The leading developer data platform for modern applications
Key Highlights
- Headquartered in Theater District, New York, NY
- Over 1000 employees and $311.1 million in Series F funding
- Popular document-oriented database system with hundreds of millions of downloads
- Partnership with Patronus AI for automated LLM evaluation
MongoDB is a leading developer data platform headquartered in the Theater District of New York, NY. The company specializes in a document-oriented database system that stores data as JSON-like documents, making it a popular choice for modernizing legacy applications. With over 1000 employees and $31...
🎁 Benefits
MongoDB offers a comprehensive benefits package including equity and an Employee Stock Purchase Program, 20 weeks of fully paid gender-neutral parenta...
🌟 Culture
MongoDB fosters a culture centered around open-source development and innovation. The company is committed to helping businesses modernize their appli...
Skills & Technologies
Overview
MongoDB is seeking a Senior Software Engineer to build the next-generation inference platform for semantic search and AI-native experiences. You'll work with Java and MongoDB to design scalable systems. This role requires strong experience in machine learning and cloud-native environments.
Job Description
Who you are
You have 5+ years of software engineering experience, particularly in building scalable systems that support high-performance applications. Your background includes working with cloud-native technologies and you understand the intricacies of real-time data processing. You are comfortable collaborating with cross-functional teams, including AI researchers and engineers, to bring innovative solutions to life.
Your expertise in Java is complemented by a solid understanding of databases, particularly MongoDB. You have experience in designing and implementing systems that require low-latency responses and high reliability. You are passionate about performance optimization and have a keen eye for improving resource efficiency in cloud environments.
You thrive in collaborative settings and enjoy working with diverse teams to tackle complex challenges. Your communication skills allow you to articulate technical concepts clearly to both technical and non-technical stakeholders. You are proactive in seeking out opportunities for improvement and innovation within your projects.
Desirable
Experience with machine learning frameworks and concepts is a plus, as you will be working closely with AI engineers. Familiarity with observability tools and performance monitoring techniques will help you excel in this role. You are also open to learning new technologies and methodologies that can enhance your contributions to the team.
What you'll do
In this role, you will design and build components of a multi-tenant inference platform that integrates seamlessly with MongoDB Atlas. Your focus will be on supporting semantic search and hybrid retrieval capabilities, ensuring that the platform meets the demands of real-time applications. You will collaborate with AI engineers to productionize inference for embedding models, enabling both batch and real-time use cases.
You will contribute to enhancing platform capabilities such as latency-aware routing, model versioning, health monitoring, and observability. Your work will involve improving performance, autoscaling, and GPU utilization to ensure that the platform operates efficiently in a cloud-native environment. You will also work across product, infrastructure, and ML teams to ensure that the inference platform meets the scale, reliability, and latency demands of modern applications.
What we offer
MongoDB provides a competitive salary range for this role, with a base salary between $118,000 and $231,000 USD. You will have access to a comprehensive benefits package that includes health benefits, parental leave, and mental health counseling. We foster a culture of collaboration and innovation, encouraging you to bring your ideas to the table and contribute to the success of our products. Join us in building the future of data infrastructure and AI-native experiences.
Interested in this role?
Apply now or save it for later. Get alerts for similar jobs at MongoDB.
Similar Jobs You Might Like
Based on your interests and this role

Lead Engineer
MongoDB is seeking a Lead Engineer for their Inference Platform to build infrastructure for embedding models that power semantic search and AI-native features. You'll work with Java and Python in a hybrid role based in Palo Alto, with a focus on performance optimization and scalability.

Backend Engineer
Together AI is seeking a Senior Backend Engineer to build and optimize their Inference Platform for advanced generative AI models. You'll work with technologies like Python, Docker, and AWS to enhance performance and scalability. This role requires strong experience in backend engineering and machine learning.

Staff Engineer
Cohere is hiring a Staff Software Engineer for their Inference Infrastructure team to build high-performance AI platforms. You'll work with technologies like Python and Docker to deploy optimized NLP models. This role requires experience in machine learning and scalable systems.

Staff Engineer
Anthropic is hiring a Staff Software Engineer for their Inference team to build and maintain critical systems for serving AI models. You'll work with distributed systems and performance optimization to support millions of users. This role requires familiarity with large-scale service orchestration.

Software Engineering
Workato is hiring a Senior Software Engineer specializing in Search and Retrieval to enhance their AI-powered platform. You'll work with Java and large-scale distributed systems to solve complex search problems. This role requires strong analytical skills and a collaborative mindset.