Ai Research Engineer • Mid-Level

Who you are

You have graduate-level ML experience or are an exceptionally strong undergrad, with a solid understanding of machine learning principles and practices. You can code up a transformer from scratch in PyTorch, demonstrating your deep technical skills and familiarity with advanced ML architectures. You enjoy creating large-scale datasets and diving deeply into the data, recognizing the importance of high-quality knowledge retrieval in today's world. You are passionate about the challenge of developing novel transformer-based search architectures and are eager to push the boundaries of what's possible in search technology.

You care about the problem of finding high-quality knowledge and understand its significance for the world. You have experience in pre-training large models, fine-tuning them for specific tasks, and are comfortable with the complexities involved in building evaluation systems that measure search quality. Your creativity shines through as you dream up innovative solutions and architectures, and you thrive in an environment where you can iterate and improve upon existing models.

Desirable

Experience with large-scale infrastructure and GPU clusters is a plus, as is familiarity with the challenges of web crawling and indexing. You might have worked on projects that involve training models with hundreds of billions of parameters, showcasing your ability to handle complex ML tasks. A background in Rust programming would be beneficial, as it aligns with the technologies used in the development of high-performance vector databases.

What you'll do

In this role, you will be part of a dynamic ML team at Exa, focused on training foundational models for search. Your primary responsibility will be to develop and refine embedding models that enhance the search capabilities of our new engine. You will engage in pre-training and fine-tuning processes, working with large datasets to ensure the models are robust and effective. You will also be tasked with creating evaluation systems that accurately measure the advancements in search quality, a challenging yet rewarding aspect of the role.

You will collaborate closely with other engineers and researchers, sharing insights and strategies to improve model performance. Your work will directly contribute to the goal of building a powerful database that can filter the world's knowledge efficiently. You will have the opportunity to experiment with novel architectures and methodologies, pushing the envelope of what is achievable in AI-driven search technology.

What we offer

Exa provides a stimulating work environment where innovation is encouraged. You will have access to a $5M H200 GPU cluster and the chance to work with cutting-edge technologies. We are committed to supporting your professional growth and development, offering opportunities to learn and expand your skill set in a collaborative team setting. We also welcome international candidates and are happy to sponsor visas for qualified individuals.

Join us in our mission to revolutionize how knowledge is accessed and utilized across AI applications. If you are excited about the intersection of machine learning and search technology, we encourage you to apply even if your experience doesn't match every requirement.