Staff Engineer • Senior

Who you are

You have 5+ years of experience in software engineering, with a strong focus on building scalable systems and infrastructure. Your background includes designing and implementing logging solutions that enhance observability and performance across complex systems. You are proficient in Java and Python, and you understand the intricacies of log processing and data pipelines. You have experience with containerization technologies such as Docker and orchestration tools like Kubernetes, which you leverage to optimize deployment and scalability. Your problem-solving skills enable you to troubleshoot issues efficiently, and you are comfortable collaborating with cross-functional teams to define requirements and deliver impactful solutions. You are passionate about data and observability, and you thrive in environments where you can tackle technical challenges head-on.

Desirable

Experience with Elasticsearch or similar technologies is a plus, as it enhances your ability to develop efficient log querying and analysis tools. Familiarity with cloud platforms and distributed systems will further strengthen your contributions to the team. You are a proactive communicator, able to articulate complex technical concepts to both technical and non-technical stakeholders.

What you'll do

As a Staff Software Engineer at Databricks, you will lead the design and development of the next-generation logging platform that processes petabytes of logs daily. Your role involves building and optimizing log delivery pipelines to ensure low-latency and high-throughput log ingestion, which is critical for maintaining seamless observability across all Databricks services. You will collaborate with various engineering teams to enhance log accessibility and usability, developing tools that empower engineers to efficiently search, analyze, and derive insights from logs. You will also be responsible for defining best practices for logging and observability, ensuring that the solutions you build are robust and scalable. Your contributions will directly impact the performance and reliability of Databricks' services, enabling teams to troubleshoot issues more effectively and optimize system behavior at scale.

What we offer

At Databricks, you will be part of a dynamic team that is committed to innovation and excellence. We offer competitive compensation and benefits, including opportunities for professional growth and development. You will work in a collaborative environment that values diversity and encourages you to bring your unique perspective to the table. Join us in our mission to empower data teams and solve the world's toughest problems through cutting-edge technology.