Staff Engineer • Senior

Who you are

You have a Bachelor's degree or equivalent practical experience, along with 8 years of experience in software development. Your background includes 5 years of experience testing and launching software products, and 3 years of experience with software design and architecture. You possess deep expertise in machine learning, particularly in areas such as speech/audio technology, reinforcement learning, and ML infrastructure. Your experience also includes 5 years with ML design and infrastructure, focusing on model deployment, evaluation, data processing, debugging, and fine-tuning.

You hold a Master’s degree or PhD in Engineering, Computer Science, or a related technical field, and have 8 years of experience with data structures and algorithms. Your familiarity with machine learning, compiler optimization, code generation, and runtime systems for GPU architectures (such as OpenXLA, MLIR, Triton) sets you apart. You have a strong understanding of how to tailor algorithms and ML models to exploit the strengths of ML accelerator architectures while minimizing their weaknesses. Additionally, you are skilled in low-level GPU programming (CUDA, OpenCL) and performance tuning techniques, with a solid grasp of modern GPU, TPU, or other ML accelerator architectures, memory hierarchies, and performance bottlenecks.

What you'll do

In this role, you will engage with Google product teams and researchers to solve performance problems, such as onboarding new ML models and products on Google’s TPU hardware. You will enable larger models to train efficiently on a very large scale, utilizing thousands of TPUs. Your responsibilities will include analyzing performance and efficiency metrics to identify bottlenecks, and designing and implementing solutions that operate at Google fleet-wide scale. You will collaborate closely with cross-functional teams to ensure that the software you develop meets the high standards required for performance and scalability.

What we offer

At Google, you will be part of a team that develops next-generation technologies that change how billions of users connect, explore, and interact with information. You will have the opportunity to work on products that handle information at massive scale, extending well beyond web search. We encourage you to apply even if your experience doesn't match every requirement, as we value diverse perspectives and backgrounds. Join us to make a significant impact in the field of machine learning and software engineering.