Software Engineering • Mid-Level

Who you are

You have a strong background in software development with 4+ years of industry experience, ideally in building large stateful distributed systems. Your expertise includes working with web crawlers and data processing, and you are proficient in Kubernetes and Infrastructure-as-Code concepts. You are enthusiastic about exploring new technologies and approaches, and you have a solid understanding of data privacy and compliance issues.

You possess excellent problem-solving skills and can collaborate effectively with cross-functional teams, including Data Processing, Architecture, and Scaling. Your experience with backend services and data storage solutions, including key-value databases, makes you a valuable asset to the team. You are comfortable conducting experiments on data to derive insights into system performance and are eager to contribute to the development of algorithms for data indexing and search capabilities.

What you'll do

As a Software Engineer on the Data Acquisition team, you will own and lead engineering projects that focus on data acquisition, including web crawling and data ingestion. You will collaborate closely with other sub-teams to ensure smooth data flow and system operability, and you will work with the legal team to address compliance and data privacy matters. Your role will involve developing and deploying highly scalable distributed systems capable of handling petabytes of data, as well as architecting and implementing algorithms for data indexing and search functionalities.

You will build and maintain backend services for data storage, ensuring synchronization and efficiency. Additionally, you will deploy solutions in a Kubernetes Infrastructure-as-Code environment and perform routine system checks to maintain operational excellence. Your contributions will directly impact the efficiency and effectiveness of OpenAI's model training operations.

What we offer

At OpenAI, you will be part of a mission-driven organization that believes in the potential of artificial intelligence to solve global challenges. We offer a collaborative work environment where innovation is encouraged, and you will have the opportunity to work with cutting-edge technologies. We are committed to providing reasonable accommodations to applicants with disabilities, and we value diversity in our workforce. Join us in shaping the future of technology and making a meaningful impact.