Llm Platform Engineer • Mid-Level

Who you are

You are an intellectually curious engineer with a strong background in AI and machine learning. You have experience designing and scaling infrastructure for large language models, and you thrive in collaborative environments where innovation is encouraged. Your problem-solving skills are top-notch, and you enjoy tackling complex challenges in the realm of AI.

You have a solid understanding of Python and are comfortable working with containerization technologies like Docker and orchestration tools such as Kubernetes. You are eager to work alongside machine learning scientists to develop systems that enhance the performance and reliability of AI applications.

What you'll do

In this role, you will design and scale the core infrastructure that powers large language model applications across Whatnot. You will collaborate closely with machine learning scientists to bring cutting-edge models into production, ensuring that AI systems are dependable and fast at scale. Your responsibilities will include building retrieval systems to effectively ground LLM responses in Whatnot’s business context and developing scalable evaluation frameworks for LLM performance.

You will also be involved in optimizing existing systems and implementing best practices for AI deployment. Your work will directly contribute to unlocking new product experiences and enhancing the overall functionality of Whatnot's platform. You will have the opportunity to shape the future of AI and ML at Whatnot, making a significant impact on the company's growth and innovation.

What we offer

Whatnot provides a dynamic work environment where creativity and collaboration are at the forefront. You will be part of a team that is passionate about redefining e-commerce through innovative technology. We offer competitive compensation and benefits, along with opportunities for professional growth and development. Join us as we build the future of online marketplaces together.