Machine Learning Engineer • Senior

Who you are

You have 5+ years of experience developing search relevance systems at scale, either in production or high-impact research environments. Your background includes a BS in Computer Science or a related field, with a preference for candidates holding an M.S. or PhD. You possess a deep understanding of machine learning and natural language processing, enabling you to design and implement automated ML and NLP pipelines for data preprocessing, query understanding, ranking, and retrieval.

You are skilled in collaborating with product managers and cross-functional teams, driving technology-first initiatives that align with novel business strategies and product roadmaps. Your experience includes building robust frameworks for evaluating search ranking improvements, both offline and online, ensuring that you can contribute effectively to the team.

Your technical expertise includes proficiency in Python and SQL, allowing you to develop and deploy ML-based search and discovery relevance models integrated with Databricks' products and services. You are comfortable with rapid experimentation and iteration, which is crucial for enhancing search quality and user experience.

Desirable

Experience with large-scale data processing and familiarity with cloud platforms would be advantageous. You are also encouraged to apply even if your experience doesn't match every requirement, as we value curiosity and a growth mindset.

What you'll do

In this role, you will drive the development and deployment of ML-based search and discovery relevance models, ensuring they are seamlessly integrated with Databricks' products and services. You will design and implement automated ML and NLP pipelines that facilitate data preprocessing, query understanding, ranking, and retrieval, enabling rapid experimentation and iteration.

Collaboration is key in this position, as you will work closely with product managers and cross-functional teams to drive technology-first initiatives that enhance the search and discovery experience for Databricks' customers. You will contribute to building a robust framework for evaluating search ranking improvements, both offline and online, which is essential for maintaining high-quality search results.

Your responsibilities will also include analyzing user behavior and search patterns to inform the development of new features and improvements. You will be expected to stay updated on the latest advancements in machine learning and natural language processing, applying this knowledge to enhance the search capabilities of Databricks.

What we offer

At Databricks, you will be part of a dynamic team that is at the forefront of advancing AI/ML-powered products. We offer a collaborative work environment where innovation is encouraged, and your contributions will have a direct impact on the user experience. You will have opportunities for professional growth and development, working alongside talented individuals who are passionate about technology and its potential to transform industries.

We provide competitive compensation and benefits, ensuring that our employees are well-supported in their roles. Join us in shaping the future of data and AI, and help us empower our customers to achieve their goals through seamless search experiences.