Big Data Engineer • Senior

Who you are

You are a highly skilled Senior Big Data Infra Engineer with a strong background in developing and scaling both stream and batch processing systems. You have a solid understanding of public cloud technologies and are comfortable working in a remote environment. Your excellent communication skills enable you to solve complex problems independently and creatively.

You have experience implementing automation and DevOps best practices for CI/CD, Infrastructure as Code (IaC), and containerization. You are adept at building reusable infrastructure for stream and batch processing systems at scale, and you have a knack for creating automation through scripting and building DevOps pipelines.

What you'll do

In this role, you will be responsible for developing and scaling data processing systems, utilizing technologies such as Pub/Sub, Kafka, Kinesis, DataFlow, Flink, Hadoop, Pig, Hive, and Spark. You will work with public cloud services, including Azure, AWS, or GCP, and have a deep understanding of cloud-managed services and cloud-based messaging/stream processing systems.

You will participate in work sessions with clients and complete technical documentation to ensure clarity and understanding of the systems you develop. Your expertise in Infrastructure and Applied DevOps principles will be critical in your daily work, as you utilize tools for continuous integration and continuous deployment (CI/CD) and Infrastructure as Code (IaC) like Terraform to automate and improve development and release processes.

Additionally, you will leverage your knowledge of containerization technologies such as Docker and Kubernetes to enhance the scalability and efficiency of the systems you build. Your role will involve collaborating with cross-functional teams to ensure that the infrastructure meets the needs of the business and clients.

What we offer

At Rackspace, we offer a collaborative work environment where you can thrive and grow your skills. You will have the opportunity to work with cutting-edge technologies and be part of a team that values innovation and creativity. We encourage you to apply even if your experience doesn't match every requirement, as we believe in the potential of our team members to grow and succeed together.