Software Engineering • Senior

Who you are

You have a strong background in software engineering with a focus on building real-time data pipelines and serving systems. You thrive on hands-on coding and problem-solving, and you have experience designing and optimizing ETL pipelines that feed online stores with fresh data. Your expertise includes working with technologies such as Kafka and Spark, and you are comfortable profiling and debugging performance bottlenecks in production systems.

You are familiar with metrics and monitoring tools like OpenTelemetry, Prometheus, and Grafana, and you understand how to define and meet service level objectives (SLOs). Your experience with GPU inference services, particularly with Triton Inference Server or similar technologies, allows you to optimize performance for machine learning models. You enjoy collaborating closely with applied scientists and other engineers to ensure that the systems you build meet the needs of the organization.

What you'll do

In this role, you will be responsible for designing and coding real-time ETL and feature pipelines that ensure models receive the freshest data. You will implement robust queuing and streaming solutions using Kafka or Pulsar, and you will optimize GPU inference services to achieve millisecond-level latency. Your work will involve profiling and optimizing end-to-end performance, including CPU and GPU utilization, memory management, and caching strategies.

You will also be involved in shipping code safely using CI/CD practices, ensuring that the systems you develop are reliable and maintainable. Collaboration is key, as you will work closely with applied scientists to define feature contracts and ensure that the data pipelines align with the requirements of machine learning models. Your contributions will directly impact the performance and scalability of Microsoft's machine learning initiatives.

What we offer

At Microsoft, you will be part of a culture that values respect, integrity, and accountability. We encourage you to apply even if your experience doesn't match every requirement. You will have the opportunity to work on cutting-edge technologies and contribute to projects that empower organizations and individuals around the world. We offer a supportive environment where you can thrive and grow in your career.