Staff Engineer • Senior

Who you are

You have a Bachelor's degree or equivalent practical experience, along with 8 years of experience in software development. Your background includes 5 years of experience testing and launching software products, as well as performance analysis and debugging in large-scale systems. You have a strong understanding of software design and architecture, with 3 years of experience in a technical leadership role, guiding project teams and setting technical direction. Your expertise extends to ML performance analysis and benchmarking, optimizing for NVIDIA/AMD architectures through low-level programming, and performance modeling.

You are familiar with hardware-aware algorithm design and compiler stacks, such as OpenXLA, and have experience tailoring large-scale ML models and distributed systems for peak performance across accelerator hardware. Your analytical skills allow you to explore model and data efficiency techniques, including model co-design, quantization, and sparsity. You thrive in a matrixed organization, working on cross-functional projects that require collaboration and communication.

Desirable

A Master’s degree or PhD in Engineering, Computer Science, or a related technical field would be a plus. You have a deep understanding of data structures and algorithms, with 8 years of experience in this area. Your ability to analyze performance and efficiency metrics to identify bottlenecks is complemented by your experience in designing and implementing solutions at scale.

What you'll do

In this role, you will analyze performance metrics and identify bottlenecks in machine learning models and products. You will work on onboarding new ML models onto Tensor Processing Unit hardware, enabling larger models to train efficiently at scale. Your responsibilities will include designing and implementing solutions that maximize compute efficiency and memory hierarchy utilization across Google's fleet. You will collaborate with cross-functional teams to ensure that the software products meet performance standards and are optimized for large-scale deployment.

You will also be involved in exploring and implementing model and data efficiency techniques, contributing to the overall performance of Google's machine learning infrastructure. Your work will directly impact how billions of users connect and interact with information, making it essential to deliver high-quality software solutions that can handle massive scale.

What we offer

Google offers a dynamic work environment where innovation is encouraged. You will have the opportunity to work with cutting-edge technologies and contribute to projects that have a significant impact on the industry. We provide competitive compensation and benefits, along with opportunities for professional growth and development. Join us to be part of a team that is shaping the future of technology and making a difference in the world.