Data Engineer • Senior

Who you are

You have 5+ years of experience in data engineering, with a strong background in designing and implementing scalable data systems. You are proficient in Snowflake and have a solid understanding of cloud platforms like AWS. Your expertise in Python and SQL allows you to create efficient data pipelines and manage large datasets effectively. You are familiar with Apache Spark and Kafka, enabling you to handle real-time data processing and streaming applications. You have a keen eye for performance optimization and cost management, ensuring that data solutions are both effective and economical. You thrive in collaborative environments, working closely with cross-functional teams to drive data initiatives forward.

Desirable

Experience with AI/ML workloads is a plus, as you will be involved in building infrastructure for model training and feature engineering. Familiarity with data modeling and establishing engineering standards will help elevate the quality of the team’s output. You are comfortable evaluating and adopting new technologies, leading the charge in innovation within the organization.

What you'll do

In this role, you will own the technical roadmap for CircleCI's data platform, making architectural decisions that balance scalability, cost, and maintainability. You will evaluate and champion new technologies and tools, leading their adoption across the organization. Your responsibilities will include designing systems for terabyte-scale data processing, focusing on performance and cost optimization. You will establish data engineering standards and best practices that elevate team quality, ensuring that all solutions are robust and maintainable. You will model infrastructure costs and drive efficiency initiatives across Snowflake and cloud platforms, ensuring that the organization operates at peak efficiency.

You will also design and build scalable infrastructure for AI/ML workloads, including model training pipelines and feature engineering systems. Your work will involve creating reusable frameworks and internal platforms that abstract complexity for other engineers, allowing them to focus on delivering value. You will design complex data models for critical business domains, balancing normalization, performance, and usability. Additionally, you will architect real-time and streaming data infrastructure for low-latency use cases, addressing large-dataset performance challenges through techniques like Snowflake clustering and query optimization.

What we offer

CircleCI offers a hybrid work environment, requiring three days per week in the office in Mexico City. You will be part of a dynamic team that values innovation and collaboration. We provide competitive compensation and opportunities for professional growth, allowing you to expand your skills and advance your career in data engineering. Join us to shape the future of our data platform and make a significant impact on our organization’s success.