Data Engineer • Senior

Who you are

You have a strong background in data engineering with experience in building and maintaining data architecture and infrastructure for data applications. You understand the importance of developing core capabilities and are accountable for timely delivery in your projects. Your expertise includes working with the latest big data tools and frameworks, such as data mesh, and you are skilled in enabling collaborative problem-solving to execute on strategic objectives.

You have hands-on experience with the Databricks platform, which allows you to develop intricate data processing pipelines that address complex client challenges. Your familiarity with generative AI and large language models (LLMs) enhances your ability to innovate and implement scalable data solutions. You are committed to writing clean, iterative code using test-driven development (TDD) and leverage continuous delivery practices to deploy and operate data pipelines effectively.

You prioritize data governance, security, and privacy in your work, ensuring that data quality is incorporated into your day-to-day tasks. You thrive in collaborative environments, working closely with data scientists to design and implement scalable solutions that meet business objectives. Your problem-solving skills and technical expertise make you a valuable asset to any team.

Desirable

Experience with additional big data technologies and frameworks is a plus, as is familiarity with data modeling techniques and distributed storage solutions. You are eager to learn and adapt to new technologies and methodologies in the data engineering field.

What you'll do

As a Senior Data Engineer at ThoughtWorks, you will develop and operate modern data architecture approaches that align with key business objectives. Your role involves creating end-to-end data solutions that are robust and scalable. You will collaborate with cross-functional teams to design and implement data processing pipelines that effectively address clients' most challenging problems.

You will be responsible for writing clean, maintainable code and utilizing various technologies to deploy and support data pipelines. Your work will include developing data models by selecting appropriate modeling techniques and implementing them using the right technology stack. You will also engage in discussions around data governance, security, and privacy, ensuring that best practices are followed.

Your collaboration with data scientists will be crucial as you work together to design scalable implementations of their models. You will contribute to the overall strategy by enabling credible problem-solving and delivering impactful results. Your ability to communicate effectively with both technical and non-technical stakeholders will be essential in this role.

What we offer

At ThoughtWorks, we value continuous learning and encourage you to bring your expertise to our team. We offer a collaborative work environment where you can push boundaries and make a significant impact through your work. Join us in solving complex business problems with innovative technology solutions. We provide opportunities for professional growth and development, ensuring that you can advance your career while contributing to meaningful projects.