Gpu Performance Engineer • Senior

Who you are

You have a Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field, and you bring over 5 years of systems programming experience. Your expertise lies in performance optimization, and you thrive on squeezing every last FLOP from GPU infrastructure. You are passionate about microsecond optimizations and enjoy pushing hardware to its theoretical limits.

You are proficient in using advanced profiling tools such as Nsight Systems and nvprof, and you have experience writing high-performance CUDA and Triton kernels for critical model operations. Your understanding of GPU workloads allows you to optimize cold start latency and tune memory access patterns effectively.

You have a collaborative spirit, working closely with ML engineers to optimize model implementations and debug performance issues across the full stack from application to hardware. Your ability to implement custom memory pooling and allocation strategies showcases your innovative approach to performance challenges.

What you'll do

In this role, you will be the performance optimization expert at Genmo, focusing on maximizing the efficiency of our H100 infrastructure. You will profile and optimize GPU workloads, ensuring that our model serving stack operates at peak performance. Your responsibilities will include writing custom CUDA kernels and Triton kernels, as well as optimizing cold start latency from seconds to milliseconds.

You will collaborate with ML engineers to enhance model implementations, debug performance issues, and implement custom memory pooling strategies. Your work will directly contribute to achieving 5-10x speedups in our infrastructure, making a significant impact on our video generation capabilities.

You will also share optimization techniques and foster a performance culture across teams, ensuring that best practices are adopted throughout the organization. Your role will be pivotal in shaping the future of AI at Genmo, as you push the boundaries of what's possible in video generation.

What we offer

At Genmo, you will be part of a cutting-edge research lab dedicated to advancing AI technology. We offer a collaborative work environment where innovation is encouraged, and your contributions will be valued. You will have the opportunity to work with state-of-the-art models and infrastructure, making a real impact in the field of AI.

We believe in supporting our employees' growth and development, providing opportunities for continuous learning and professional advancement. Join us in shaping the future of AI and unlocking the potential of video generation.