Data Engineer • Senior

Who you are

You have significant experience in Google Cloud and a strong background in data engineering, particularly in designing and optimizing large-scale distributed data pipelines. You understand the intricacies of ETL/ELT processes and have hands-on experience with tools like Apache Beam, Google Cloud Dataflow, and Apache Spark. Your expertise extends to data warehousing and you are comfortable addressing schema and performance optimization challenges when migrating data to BigQuery.

You thrive in collaborative environments and enjoy working closely with customer teams to provide strategic guidance and facilitate technology decisions. Your ability to communicate complex technical concepts clearly makes you a trusted advisor to clients, helping them navigate their data and application modernization journeys. You are proactive in implementing observability, monitoring, logging, and error-handling within data pipelines, ensuring high reliability and performance.

What you'll do

As a Senior Data Engineer at Zencore, you will design, build, and optimize large-scale distributed data pipelines that are crucial for our clients' transformations. You will leverage your expertise in Apache Beam and Google Cloud Dataflow to develop ETL/ELT workflows that integrate multiple structured and unstructured data sources. Your role will involve addressing schema and type conversion challenges, as well as performance tuning for high-volume workloads, particularly during data migrations to BigQuery.

You will collaborate with Data Analysts to integrate validation rules, QA checks, and automated testing into the pipeline lifecycle, ensuring data quality and reliability. Your responsibilities will also include supporting large-scale data migrations and performance tuning, making you a key player in our clients' success stories. You will be expected to stay updated with the latest trends and technologies in data engineering, continuously improving our processes and solutions.

What we offer

At Zencore, we offer a dynamic work environment where innovation is at the forefront. You will be part of a team of former Google Cloud leaders, architects, and engineers, working on exciting projects that drive real change for our clients. We value collaboration and encourage you to share your ideas and insights to help shape our approach to data engineering. We believe in investing in our team's growth and provide opportunities for professional development and continuous learning. Join us in our mission to empower companies through data and technology.