Data Engineer • Senior

Who you are

You have over 5 years of experience as a Data Engineer, with a strong background in building robust data architectures that are both scalable and secure. Your expertise in Python and Scala allows you to analyze, design, and develop applications and data pipelines effectively. You are familiar with cloud environments, particularly AWS, and have a solid understanding of data integration and transformation processes.

You have hands-on experience implementing standardized solutions using internal frameworks like Kirby and Scalfolder. Your knowledge extends to designing and implementing processes in AWS, utilizing services such as Glue, Redshift, S3, Lambda, and EMR. You are adept at building and optimizing data flows using orchestration tools like Airflow, Step Functions, and Control-M.

You are skilled in integrating and transforming heterogeneous data sources, including binary, flat, relational databases like Oracle, PostgreSQL, MySQL, and non-relational databases such as MongoDB and DynamoDB. Your experience with ETL/ELT processes emphasizes scalability, security, and data quality, ensuring that the data you work with is reliable and actionable.

You are detail-oriented and committed to maintaining data integrity, performing rigorous unit tests and validations. You also value documentation and are keen on sharing best practices in data engineering with your team, fostering a culture of continuous learning and improvement.

Desirable

Experience with data governance and compliance in the financial sector would be a plus. Familiarity with additional AWS services and tools for data analytics can enhance your contributions to the team.

What you'll do

As a Senior Data Engineer at NEORIS, you will lead the design and implementation of high-impact data pipelines tailored for the financial sector. Your role will involve analyzing and developing applications and data pipelines using Python and Scala, ensuring that they meet the needs of our clients.

You will implement standardized solutions using internal frameworks, contributing to the overall efficiency and effectiveness of our data engineering practices. Your expertise in AWS will be crucial as you design and implement processes utilizing services like Glue, Redshift, S3, Lambda, and EMR, ensuring that our data architecture is robust and scalable.

You will build and optimize data flows, leveraging orchestration tools such as Airflow and Step Functions to ensure smooth data operations. Your ability to integrate and transform various data sources will be essential in providing comprehensive data solutions that drive business value.

In this role, you will also focus on developing ETL/ELT processes that prioritize scalability, security, and data quality. You will conduct unit tests and validations rigorously to maintain the integrity of our data systems.

Documentation will be a key part of your responsibilities, as you will need to document solutions and train your team on best practices in data engineering. Your leadership will help cultivate a collaborative environment where innovation and continuous learning are encouraged.

What we offer

At NEORIS, we pride ourselves on our multicultural environment that promotes diversity, equality, respect, tolerance, and inclusion. We are committed to creating a safe and dynamic workplace where everyone can perform at their best. Join us in transforming data into value and be part of a cutting-edge team in the financial sector. We encourage you to apply even if your experience doesn't match every requirement, as we value diverse perspectives and backgrounds.