Data Architect • Lead

Who you are

You are a seasoned Data Architect with a strong background in data engineering and architecture, bringing over 5 years of experience in designing and implementing data solutions. You have a deep understanding of ETL/ELT processes and are proficient in tools like Apache Spark and Databricks, which you have used to build scalable data pipelines. Your expertise in Delta Lake allows you to optimize data storage and retrieval, ensuring high performance and reliability in data systems.

You thrive in collaborative environments, working closely with cross-functional teams to translate complex research workflows into efficient, production-grade systems. Your ability to mentor junior engineers and foster a culture of continuous learning and DataOps excellence is a key part of your leadership style. You are passionate about driving data strategy and innovation, and you understand the importance of aligning data architecture with business goals.

Desirable

Experience with cloud platforms such as AWS or Azure is a plus, as is familiarity with real-time data processing and analytics. You have a knack for optimizing performance and resilience in data systems, and you are always looking for ways to improve existing processes and workflows.

What you'll do

In this role, you will design, build, and maintain reliable ETL/ELT pipelines using Spark and Databricks, ensuring that they are optimized for performance and scalability. You will collaborate with power users to develop reusable patterns and templates that streamline data workflows and onboarding processes. Your work will directly impact the data systems that power real-time trading decisions, enabling predictive analytics and driving insights across the organization.

You will define, document, and enforce best practices in data engineering, ensuring that your team adheres to high standards of quality and efficiency. As a lead, you will mentor junior engineers, helping them grow their skills and fostering a culture of excellence within the team. Your contributions will shape the Lakehouse engineering vision in the United States, influencing global data architecture and strategy.

What we offer

At Optiver, you will have the opportunity to make an immediate impact on the data systems that support world-class research and trading decisions. You will enjoy a high degree of autonomy in your role, allowing you to take ownership of projects and drive innovation. The company offers a competitive salary, with a base pay of $175,000, along with a discretionary bonus and a comprehensive benefits package. Join us in a high-performance, data-driven environment where your expertise will be valued and your contributions will shape the future of data architecture at Optiver.