Data Engineer • Senior

Who you are

You have a strong background in data engineering, with experience in building and maintaining data architecture and infrastructure. You understand the complexities of data applications and are skilled in developing core capabilities for technical and functional data platforms. Your expertise allows you to be the anchor for functional streams of work, ensuring timely delivery of projects. You are familiar with the latest big data tools and frameworks, including data mesh, and are committed to enabling collaborative problem-solving to execute on strategic objectives.

You have hands-on experience with the Databricks platform, which you leverage to develop intricate data processing pipelines that address complex client challenges. Your coding practices are rooted in test-driven development (TDD), and you are adept at using continuous delivery practices to deploy and operate data pipelines effectively. You are also knowledgeable about various distributed storage and computing technologies, allowing you to select the best options for your projects.

You prioritize data governance, security, and privacy in your work, ensuring that data quality is incorporated into your daily tasks. You are comfortable collaborating with data scientists to design scalable implementations of their models, and you have a keen understanding of data modeling techniques that you apply in your projects.

What you'll do

In this role, you will develop and operate modern data architecture approaches that align with key business objectives, providing end-to-end data solutions. You will be responsible for creating intricate data processing pipelines that tackle some of the most challenging problems faced by clients. Collaboration is key, as you will work closely with data scientists to design scalable implementations of their models, ensuring that the solutions you develop meet their needs.

You will write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support, and operate data pipelines. Your role will involve selecting appropriate modeling techniques and implementing chosen data models using the right technology stack. You will also engage in discussions around data governance, security, and privacy, ensuring that these critical aspects are integrated into your work.

As a Senior Data Engineer, you will be expected to stay updated on the latest trends and technologies in the data engineering field, continuously seeking opportunities for improvement and innovation in your work. You will contribute to a culture of collaboration and knowledge sharing within your team, helping to elevate the overall capabilities of the organization.

What we offer

At ThoughtWorks, we believe in pushing boundaries through purposeful and impactful work. For over 30 years, we have delivered extraordinary impact alongside our clients, helping them solve complex business problems with technology as the differentiator. We encourage you to bring your brilliant expertise and commitment to continuous learning to our team. Together, let’s be extraordinary.