Software Engineering • Mid-Level

Who you are

You have a solid background in software engineering with a focus on distributed systems — you understand the complexities involved in building scalable applications and have experience with data processing frameworks. Your expertise in Python is complemented by familiarity with libraries like Apache Arrow, which you have used to optimize data workflows.

You are passionate about machine learning and its applications — you have worked on projects that involve data pipelines and understand the importance of data quality and performance in ML applications. Your problem-solving skills enable you to tackle challenges in data management and processing effectively.

You thrive in collaborative environments — you enjoy working closely with cross-functional teams, including data scientists and engineers, to deliver high-quality solutions. Your communication skills allow you to articulate technical concepts clearly to both technical and non-technical stakeholders.

Desirable

Experience with Ray or similar distributed computing frameworks is a plus — you are eager to learn and adapt to new technologies that can enhance your work. Familiarity with cloud platforms and data storage solutions will also be beneficial in this role.

What you'll do

As a Software Engineer on the Ray Data team, you will be responsible for building and optimizing the Ray Datasets library — your work will directly impact the usability and performance of data processing in machine learning applications. You will collaborate with other engineers to enhance the library's capabilities, ensuring it meets the needs of developers and data scientists alike.

You will engage in the design and implementation of features that improve data handling and processing efficiency — this includes optimizing data ingestion, transformation, and storage processes. Your contributions will help streamline workflows for large-scale data applications, making it easier for users to scale their ML projects.

You will also participate in code reviews and contribute to the overall architecture of the Ray ecosystem — your insights will help shape the direction of the project and ensure best practices are followed. Additionally, you will have the opportunity to mentor junior engineers, sharing your knowledge and helping them grow in their careers.

What we offer

Anyscale provides a dynamic work environment where innovation is encouraged — you will be part of a team that is at the forefront of democratizing distributed computing. We offer competitive compensation and benefits, along with opportunities for professional development and growth.

You will have access to cutting-edge technologies and the chance to work on impactful projects that are shaping the future of machine learning — your work will contribute to making advanced data processing accessible to developers of all skill levels. Join us in our mission to empower the next generation of AI applications.