Data Engineer • Senior

Who you are

You have over 8 years of experience in building data platforms and developing data pipelines — you've designed and implemented large-scale data solutions that handle complex data workflows. Your expertise includes real-time and batch processing, ensuring data integrity and quality throughout the pipeline.

You are proficient in using Apache Airflow for automating and managing complex data workflows — you understand how to optimize workflows for performance and reliability. Your experience with ClickHouse allows you to build high-performance analytical environments tailored for time-series data processing.

You have a strong background in data warehousing and have successfully designed and operated data warehousing solutions using platforms like Databricks Lakehouse — you know how to manage computing resources effectively to maximize platform stability and efficiency.

You are skilled in establishing automated monitoring systems to ensure data quality and integrity — you have implemented solutions that proactively identify and resolve data quality issues, ensuring that stakeholders can trust the data they work with.

You are familiar with data governance and security practices within data environments — you have experience in setting up governance frameworks that comply with industry standards and protect sensitive information.

You thrive in collaborative environments and enjoy supporting analytics teams by providing them with the tools and data they need to succeed — you have a track record of integrating visualization tools like Apache Superset to enhance data accessibility for non-technical users.

What you'll do

In this role, you will design and operate large-scale data pipelines for the UMOS platform, focusing on the collection, cleansing, and transformation of high-volume mobility and logistics data. You will implement both real-time and batch processing pipelines using ETL and ELT methodologies to ensure data is readily available for analysis.

You will leverage Apache Airflow to automate and manage complex data workflows, ensuring that data processing tasks are executed efficiently and reliably. Your role will involve optimizing these workflows to handle increasing data loads while maintaining performance.

You will build and maintain specialized database environments, such as ClickHouse, to support high-performance analytics and time-series data processing — your expertise will help the team derive insights from large datasets quickly and effectively.

You will establish automated monitoring systems to ensure data quality and integrity, proactively addressing any issues that arise to maintain a high standard of data reliability. Your work will be crucial in building trust in the data used across the organization.

You will design and implement data warehousing solutions using the Databricks Lakehouse platform, managing workspaces, computing resources, and data governance practices to ensure a robust and secure data environment.

You will collaborate with data and AI engineers to provide the necessary feature stores and support the development of knowledge graphs and AI models within the Databricks environment — your contributions will enable the team to innovate and enhance their data-driven solutions.

What we offer

At UMOS ONE, you will be part of a dynamic team that values collaboration and mutual growth — we foster an environment where team members support each other's development and celebrate successes together. You will have the opportunity to work on cutting-edge technologies that are shaping the future of urban mobility.

We offer competitive compensation and benefits, along with opportunities for professional development and career advancement — we believe in investing in our employees to help them reach their full potential. Join us in making a significant impact in the mobility sector and be part of a team that is dedicated to innovation and excellence.