
About Kong
The API gateway for modern microservices
Key Highlights
- Headquartered in The East Cut, San Francisco, CA
- Raised $344.1M in Series D funding
- Over 500 employees serving Global 5000 enterprises
- Core products include Kong Gateway, Galileo, Gelato, and API Marketplace
Kong is a leading provider of API and service lifecycle management solutions, headquartered in The East Cut, San Francisco, CA. With over 500 employees, Kong has raised $344.1 million in Series D funding and serves Global 5000 enterprises, enabling them to securely connect and orchestrate microservi...
🎁 Benefits
Kong offers flexible time off to prioritize personal well-being, stock options for employees to share in the company's success, and U-First Fridays fo...
🌟 Culture
Kong fosters a culture focused on innovation and flexibility, emphasizing the importance of modern architectures like microservices and serverless env...
Skills & Technologies
Overview
Kong is hiring a Senior Software Engineer for their AI Gateway team to design and build API management software for AI and LLMs. You'll work with technologies like Linux and distributed systems. This position requires 5+ years of experience in server-side applications.
Job Description
Who you are
You have over 5 years of experience programming in server-side applications and components, demonstrating a strong ability to design, prototype, build, and debug applications that are highly scalable, distributed, reliable, and resilient. Your solid hands-on technical expertise in Linux systems troubleshooting and profiling sets you apart, allowing you to tackle complex issues effectively.
You possess a deep understanding of distributed systems and the Linux networking stack, which enables you to optimize performance and troubleshoot bugs efficiently. Your experience in API management and load balancing is crucial for the role, as you will be responsible for enhancing the Kong AI Gateway's capabilities.
You are a natural mentor, eager to guide junior members of your team, sharing your knowledge and expertise to foster their growth. You thrive in collaborative environments, working closely with cross-functional teams to fill the gaps between Kong and third-party deployment platforms and tooling.
Desirable
Experience with AI and LLM technologies is a plus, as it aligns with the innovative features you will be designing and implementing. Familiarity with performance tuning and low-level optimizations will further enhance your contributions to the team.
What you'll do
As a Senior Software Engineer in the AI Gateway Team, you will be responsible for designing, building, and maintaining API management software tailored for AI and LLMs. Your role will involve architecting and implementing new features, including proxying capabilities and database support, to extend the Kong AI Gateway's offerings.
You will troubleshoot bugs and optimize performance, ensuring that the software operates at peak efficiency. Your expertise in distributed systems will be invaluable as you work on multi-LLM routing and balancing, semantic caching, and other core features.
Mentoring junior team members will be a key aspect of your role, as you guide them through complex challenges and help them develop their skills. You will also collaborate with other teams to ensure seamless integration of Kong's solutions with third-party platforms, enhancing the overall user experience.
What we offer
At Kong, you will be part of a leading developer of API and AI connectivity technologies, working on projects that empower companies and developers worldwide. You will have the opportunity to contribute to innovative solutions that govern every step of AI and LLM-based innovation.
We encourage you to apply even if your experience doesn't match every requirement. Join us in building the infrastructure that powers the agentic era, trusted by Fortune 500 companies and startups alike. Your contributions will directly impact how organizations secure, manage, and monetize the flow of intelligence across APIs and AI models.
Interested in this role?
Apply now or save it for later. Get alerts for similar jobs at Kong.
Similar Jobs You Might Like
Based on your interests and this role

Engineering Manager
Kong is hiring an Engineering Manager for their AI Gateway team to lead the development of AI and LLM technologies. You'll empower teams and ensure high-quality technical delivery. This role requires strong technical leadership and experience in AI.

Software Engineering
Vercel is hiring a Software Engineer for their AI Gateway team to develop and enhance their AI Gateway platform. You'll work with technologies like JavaScript and Next.js to build reliable, low-latency systems. This position requires experience in developing production-ready applications.

Software Engineering
Kong is hiring a Senior Software Engineer to design and maintain API management software. You'll work on innovative features like proxying capabilities and load balancing. This position requires 5+ years of experience in server-side applications.

Devops Engineer
EverAI is seeking a Senior DevOps Engineer to help build and scale their innovative AI products. You'll work in a fully remote environment based in Italy, contributing to a rapidly growing company with a mission to redefine AI companionship.

Software Engineering
Vanilla Technologies is seeking a Senior Software Engineer - AI Applications to develop AI-powered estate planning solutions. You'll leverage machine learning and data science to create innovative applications. This role requires a strong background in software development and AI technologies.