Data Engineer • Senior

Who you are

You are a Senior Data Engineer with proven experience in building and managing large-scale data pipelines using Databricks, PySpark, and SQL. Your strong programming skills in Python and SQL enable you to effectively process and transform data, ensuring high-quality deliverables that meet the strategic needs of the organization. You have a deep understanding of ETL/ELT frameworks, data warehousing, and distributed data processing, which allows you to maintain the quality, reliability, security, and governance of ingested data.

You are familiar with modern DataOps practices, including version control with Git, CI/CD pipelines, and automated testing. Your problem-solving skills are strong, enabling you to troubleshoot performance, scalability, and reliability issues effectively. Additionally, you have experience with cloud platforms such as AWS, Azure, or GCP, and you understand the related data services that enhance data engineering processes.

What you'll do

In this role, you will lead the design and development of robust data pipelines, integrating and transforming data from diverse sources such as APIs, relational databases, and files. You will collaborate closely with business and analytics teams to understand data requirements and ensure that the data solutions you deliver meet their needs. Your expertise will be pivotal in maintaining the quality, reliability, security, and governance of the ingested data, driving the mission of collaboration, innovation, and transformation within the organization.

You will develop and maintain data pipelines, ensuring they are efficient and scalable. By following modern DataOps practices, you will document processes and best practices in data engineering, contributing to a culture of continuous improvement. Your role will involve working with various stakeholders to ensure that data solutions align with business objectives and support data-driven decision-making across the organization.

What we offer

CI&T offers a dynamic work environment where you can leverage your skills in data engineering to make a significant impact. You will have the opportunity to work on exciting projects that drive innovation and transformation within the organization. We encourage you to apply even if your experience doesn't match every requirement, as we value diverse perspectives and backgrounds. Join us to be part of a team that is committed to collaboration and excellence in data engineering.