Data Engineer • Mid-Level

Who you are

You have a strong background in data engineering with a focus on Azure Databricks, where you've developed and executed data pipelines that enhance data processing efficiency. Your experience in Python, particularly with PySpark, allows you to handle large datasets effectively, ensuring optimal performance in data transformations and analytics.

You are proficient in SQL, including advanced functions, which enables you to write complex queries for data extraction and manipulation. Your familiarity with BigQuery and SAP HANA demonstrates your ability to work with various data storage solutions, ensuring seamless data integration and migration.

You have experience using JIRA for task management, which helps you stay organized and efficient in your work. Additionally, your knowledge of SharePoint enhances your collaboration skills, allowing you to manage documentation effectively within teams.

Your expertise in Azure Storage, including Blob Storage and Data Lake, equips you with the skills to optimize data storage solutions, ensuring that data is easily accessible for analysis and reporting. You are committed to maintaining data security through effective management of scopes and access keys in Databricks.

Desirable

Experience with data migration projects, particularly from SAP HANA to Azure Databricks, is a plus. Familiarity with ETL processes and notebook optimization will further enhance your contributions to the team.

What you'll do

As a Data Engineer at NEORIS, you will be responsible for developing queries and processes for BigQuery and SAP HANA, ensuring that data flows seamlessly between systems. You will create and optimize notebooks and ETL processes in Azure Databricks, focusing on improving efficiency and performance.

You will lead the migration of data from SAP HANA to Azure Databricks, ensuring that data integrity is maintained throughout the process. Transitioning notebooks from pandas to PySpark will be a key responsibility, allowing you to leverage the power of distributed computing for data processing.

Your role will involve managing data security by implementing scopes and access keys in Databricks, ensuring that sensitive information is protected. You will also optimize the storage of results to facilitate analysis and reporting, making it easier for stakeholders to derive insights from the data.

Collaboration with cross-functional teams will be essential as you work closely with data analysts and other engineers to deliver high-quality data solutions. You will participate in regular meetings to discuss project progress and address any challenges that arise during development.

What we offer

At NEORIS, we value our employees and offer a range of benefits, including life insurance and holiday bonuses. You will enjoy discounts at health and wellness centers, as well as generous vacation time, including 15 days of vacation, two administrative days, and a day off on your birthday.

We are committed to your professional growth, providing opportunities for continuous learning and development. Join us and be part of a multicultural team that fosters innovation and collaboration, helping companies transition into the future with cutting-edge digital solutions.