Data Engineer • Mid-Level

Who you are

You have 3+ years of experience in data engineering, with a strong background in building data pipelines and working with various data formats. You are proficient in Python and SQL, and you understand the intricacies of data ingestion and normalization processes. Your experience with cloud platforms, particularly AWS, allows you to effectively manage data workflows in a scalable manner. You are familiar with tools like Airflow for orchestrating complex data workflows and have experience with containerization technologies such as Docker. You are detail-oriented and have a knack for cleaning and structuring messy datasets, ensuring data quality and consistency.

Desirable

Experience with machine learning frameworks or AI tools is a plus, as is familiarity with data visualization tools. You are comfortable working in a collaborative environment and enjoy engaging with cross-functional teams to understand their data needs. You have a proactive approach to problem-solving and are eager to learn and adapt to new technologies.

What you'll do

In this role, you will be responsible for building and maintaining an AI-powered data ingestion and normalization pipeline. You will work with various data sources, including unprocessed Excel/CSV uploads and lab exports, to ensure that data is accurately ingested and transformed. Your tasks will include developing robust schema mapping and conversion logic to standardize data formats and ensure consistency across datasets. You will leverage your expertise in Python and SQL to clean and prepare data for downstream analytics, ensuring that the AI Co-Scientist has access to high-quality data for analysis.

You will collaborate closely with data scientists and other stakeholders to understand their data requirements and provide them with the necessary datasets for their analyses. You will also be involved in optimizing data workflows and ensuring that all transformations are executed efficiently during the ingestion process. Your work will directly contribute to the success of Mithrl's mission to accelerate drug discovery and improve patient outcomes.

What we offer

Mithrl offers a dynamic work environment where innovation and collaboration are at the forefront. You will have the opportunity to work with cutting-edge AI technologies and contribute to meaningful projects that have a real impact on the life sciences industry. We provide competitive compensation and benefits, along with opportunities for professional growth and development. Join us in our mission to transform the way scientific data is utilized in drug discovery.