Software Engineering • Senior

Who you are

You have 5+ years of experience in software engineering, particularly in data ingestion and processing. Your expertise in core database internals allows you to design efficient systems that minimize load on production environments. You are hands-on and enjoy tackling complex engineering challenges, especially in the context of data and AI workflows.

You possess strong programming skills in languages such as Python and have experience with SQL for data manipulation. Your familiarity with Apache Spark enables you to work effectively with large datasets and implement scalable solutions. You thrive in collaborative environments and are eager to work closely with cross-functional teams to integrate data ingestion capabilities into various products.

What you'll do

As a Senior Software Engineer at Databricks, you will be a key player in the Lakeflow Connect team, focusing on building point-and-click connectors for various data sources. You will design and implement systems that efficiently extract data from OLTP systems while ensuring minimal impact on production workloads. Your role will involve using techniques like incremental data capture and log parsing to optimize data ingestion processes.

You will collaborate with product teams to embed ingestion capabilities into Databricks' surfaces, including Dashboards, Notebooks, and SQL interfaces. Your contributions will directly impact the effectiveness of data and AI workflows for our customers, enabling them to derive deep insights from their data.

What we offer

At Databricks, we provide a dynamic work environment where innovation is encouraged. You will have the opportunity to work on cutting-edge technology that is shaping the future of data and AI. We offer competitive compensation and benefits, along with opportunities for professional growth and development within the company. Join us in our mission to empower data teams to solve the world's toughest problems.