Data Engineer • Mid-Level

Who you are

You are a highly skilled Azure Data Engineer with expert knowledge in cloud infrastructure and DevOps automation. With a strong background in designing, building, optimizing, and automating data platforms, you ensure that data solutions are scalable and reliable. Your experience with Infrastructure as Code (IaC) and CI/CD practices allows you to deploy modern data solutions effectively.

You have a deep understanding of ETL/ELT processes and are proficient in developing, optimizing, and maintaining scalable data pipelines using Python and SQL. Your expertise extends to managing key Azure data components, including Data Lakes and Data Warehousing, ensuring that data is structured and accessible for analysis.

Your familiarity with Azure Data Factory, Azure Synapse Pipelines, and Azure Databricks enables you to implement data transformation and analysis logic efficiently. You are also experienced in defining and enforcing data modeling standards and implementing data quality checks within pipelines.

In addition to your data engineering skills, you are adept at cloud infrastructure and DevOps automation. You design, manage, and provision Azure data resources using Terraform or Azure Resource Manager (ARM) Templates/Bicep. Your ability to build and maintain automated CI/CD pipelines for code deployment is a key asset in your role.

Desirable

You hold Azure certifications such as Azure Data Engineer Associate (DP-203) or Azure DevOps Engineer Expert (AZ-400), which further validate your expertise. Familiarity with Data Governance tools like Azure Purview and experience with real-time data ingestion using Azure Event Hubs or Azure Stream Analytics are also preferred.

What you'll do

As a Data Engineer at Rackspace, you will be responsible for the end-to-end development and engineering of our data platform. You will design and implement ETL/ELT processes, ensuring that data pipelines are optimized for performance and reliability. Your role will involve architecting and managing Azure data components, including provisioning and structuring data within Azure Data Lake Storage (ADLS Gen2).

You will implement data transformation and analysis logic using Azure Data Factory and Azure Databricks, ensuring that data is processed efficiently. Additionally, you will design and optimize the enterprise Data Warehouse in Azure Synapse Analytics, focusing on SQL Pool performance.

Your responsibilities will also include defining data modeling standards and implementing data quality checks within the pipelines to maintain high data integrity. You will leverage your skills in Infrastructure as Code (IaC) to manage and provision Azure data resources, ensuring that all deployments are automated and efficient.

You will collaborate closely with cross-functional teams to build and maintain CI/CD pipelines, enhancing the deployment process for all code related to data solutions. Your experience with workflow orchestration tools like Azure Data Factory or Apache Airflow will be crucial in managing complex data workflows.

What we offer

At Rackspace, we provide a collaborative and innovative work environment where you can grow your skills and advance your career. We encourage you to apply even if your experience doesn't match every requirement, as we value diverse perspectives and backgrounds. Join us in shaping the future of data engineering within the Azure ecosystem.