Software Engineering • Senior

Who you are

You have 5+ years of experience in software engineering, particularly in building observability solutions for large-scale systems. Your expertise in Java and Python allows you to develop robust applications that monitor system health and performance effectively. You are familiar with SQL and have experience working with databases, enabling you to aggregate and analyze metrics efficiently.

You possess a strong understanding of containerization and orchestration technologies, such as Docker and Kubernetes, which are essential for deploying observability tools at scale. Your knowledge of monitoring tools like Elasticsearch and Grafana helps you create insightful dashboards that visualize system performance and facilitate debugging.

You are a collaborative team player who enjoys working with cross-functional teams to identify key metrics that drive system observability. Your ability to communicate complex technical concepts clearly makes you an effective partner in discussions about system architecture and performance optimization.

Desirable

Experience with cloud platforms such as AWS or Azure is a plus, as it enhances your ability to develop solutions that operate seamlessly in cloud environments. Familiarity with logging frameworks and distributed tracing tools will further strengthen your contributions to the team.

What you'll do

In this role, you will develop observability solutions that provide insights into the health and performance of Databricks' data and AI infrastructure. You will collaborate with various engineering teams to identify critical metrics that allow for effective monitoring of system components. Your work will involve building infrastructure that enables components to emit, log, and aggregate metrics, which can be displayed on dashboards for real-time performance analysis.

You will be responsible for scaling observability solutions to support millions of instances, ensuring that the systems remain resilient and performant under heavy loads. Your contributions will directly impact the reliability of the platform, helping to shield customers from potential faults in cloud hardware, network, and operating systems.

You will also engage in performance analysis and debugging, using the insights generated from observability tools to identify and resolve issues proactively. Your role will require you to stay updated with the latest trends in observability and apply best practices to enhance the team's capabilities.

What we offer

At Databricks, you will be part of a dynamic team that is passionate about solving complex problems through innovative technology. We offer a competitive salary and benefits package, along with opportunities for professional growth and development. You will have the chance to work on cutting-edge projects that have a significant impact on the industry, all while collaborating with talented professionals who share your commitment to excellence.