Ai Data Engineer • Senior

Who you are

You have a strong background in data engineering with a focus on AI applications — your experience includes designing and building scalable data pipelines that handle both structured and unstructured data. You are proficient in ETL processes and understand the nuances of integrating diverse data sources, including market data and third-party APIs.

You have hands-on experience with tools like Prefect for orchestrating data workflows — your ability to implement real-time and batch processing workflows ensures that data quality, consistency, and integrity are maintained across all pipelines. You are familiar with AI data infrastructure, including vector databases and semantic search systems, which are critical for optimizing AI/ML workloads.

Collaboration is key for you — you thrive in environments where you partner with AI engineers, software developers, and data scientists to understand and fulfill data requirements. Your communication skills allow you to effectively integrate with existing firm systems and contribute to the overall success of AI initiatives.

Desirable

Experience with data versioning, lineage tracking, and observability for AI training and inference pipelines is a plus. Familiarity with low-latency AI interactions and high-throughput batch processing will set you apart.

What you'll do

In this role, you will be responsible for designing and building robust data pipelines that power SchonAI, ensuring that high-quality data flows seamlessly to support investment professionals across the firm. You will develop ETL/ELT processes for diverse data sources, implementing real-time and batch data processing workflows to meet varying latency requirements.

You will build and maintain data infrastructure optimized for AI/ML workloads, including designing data schemas and storage solutions that support efficient retrieval and processing for LLM applications. Your work will involve optimizing data delivery for low-latency AI interactions and high-throughput batch processing, ensuring that the infrastructure meets the demands of the firm's AI initiatives.

Collaboration is a significant part of your role — you will partner with AI engineers, software developers, and data scientists to understand data requirements and integrate with existing firm systems. Your contributions will directly impact the efficiency and effectiveness of the firm's AI capabilities.

What we offer

Schonfeld offers a competitive salary range between $225k and $275k, along with performance bonuses and a comprehensive benefits package. You will have the opportunity to work in a dynamic environment where your contributions will be valued and recognized. We encourage you to apply even if your experience doesn't match every requirement, as we believe in fostering a diverse and inclusive workplace.