Data Engineer • Senior

Who you are

You are a seasoned Data Engineer with 3 to 5 years of experience, particularly skilled in building and optimizing data pipelines. Your expertise in Apache Spark and Delta Lake allows you to create reliable and high-performance data solutions that scale effectively. You have a strong understanding of data modeling, particularly in creating Silver and Gold layers for analytical use cases, ensuring data quality and performance in distributed workloads.

You have hands-on experience with advanced optimizations, including shuffle management, skew handling, and caching strategies. Your proficiency in SQL enables you to perform complex queries and data manipulations, ensuring that the data you work with is both accurate and actionable. You are also familiar with implementing incremental loads and managing slowly changing dimensions (SCD), which are crucial for maintaining data integrity over time.

You are committed to following engineering standards and best practices, contributing to code reviews, and ensuring that your work aligns with the team's goals. Your collaborative spirit makes you a valuable team member, as you work closely with others to drive innovation and continuous improvement in data solutions.

Desirable

While not mandatory, certifications such as the Databricks Data Engineer Associate or Professional, as well as AWS certifications, would be advantageous. Experience with Apache Spark certifications will also be considered a plus.

What you'll do

In this role, you will be responsible for constructing and maintaining core data pipelines, both batch and near-real-time. You will model and evolve Silver and Gold layers to support various analytical use cases, ensuring that the data is reliable and performs optimally. Your work will involve optimizing performance and reliability in distributed workloads, implementing and monitoring data quality through expectations, and conducting advanced optimizations.

You will also handle incremental loads and manage SCD, focusing on normalization and denormalization strategies that are oriented towards analytics. Your contributions will help establish engineering standards and best practices within the team, and you will participate in code reviews to ensure high-quality outputs. You will collaborate with cross-functional teams to create high-value solutions for clients, leveraging your technical expertise to drive impactful results.

What we offer

NEORIS provides a remote work environment, allowing you to balance your professional and personal life effectively. We offer comprehensive health benefits, including prepaid medical services, and additional perks such as NEORIS Days, which grant you three extra days off. You will also receive an annual performance bonus, a vacation bonus, and connectivity subsidies to support your work-from-home setup. Our commitment to continuous learning is reflected in our training and development platforms, ensuring that you have the resources to grow your skills and advance your career.