Software Engineer AI Gateway
Join Kong's engineering team as a Software Engineer in the AI Gateway Team, focusing on building and maintaining innovative API management software for AI and LLMs. The role involves developing core features such as multi-LLM routing, balancing, and performance tuning. Ideal candidates will have solid programming experience, particularly in Golang or Rust, and a strong understanding of distributed systems. Familiarity with AI concepts is a plus. This position offers the opportunity to contribute to cutting-edge technology in a globally dispersed team environment.
Job description
About the Role
You will join the engineering team that builds the Kong AI gateway, empowering companies and developers around the world to govern every step of their AI & LLM based innovation. As a Software Engineer in the AI Gateway Team, you will be working on core features such as multi-LLM routing and balancing, semantic caching and routing, MCP, and more.
What You'll Be Doing
- Responsible for building and maintaining API management software for AI and LLMs and its underlying stack.
- Implement new innovative features including proxying capabilities, load balancing, databases support that extend Kong AI Gateway’s offering.
- Bugs troubleshooting, performance tuning and low-level optimizations.
- Fill the gaps between Kong and third-party deployment platforms and tooling.
- Any additional tasks required by manager.
What You'll Bring
- 3+ years of programming in server-side applications and components.
- Hands on experience with either Golang or Rust.
- Experience building and debugging applications that are highly scalable, distributed, reliable and resilient.
- Solid hands-on low-level technical expertise in Linux systems troubleshooting, and profiling.
- Experience in distributed systems, Linux networking stack and computer systems programming, Kong works with APIs on both L7 and L4 transports and protocols, so this expertise and knowledge are required.
- Comfortable working with a remotely distributed team.
- Strong sense of ownership and excellent verbal and written communication skills -- engineers at Kong write the documentation for their products.
- Familiarity with AI LLM concepts and applications development.
Bonus Points
- Hands on experience with NGINX/OpenResty/Kong/LuaJIT.
- Hands on experience with Envoy or Istio.
About Kong
Kong Inc., a leading developer of API and AI connectivity technologies, is building the infrastructure that powers the agentic era. Trusted by the Fortune 500 and startups alike, Kong's unified API and AI platform, Kong Konnect, enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI models.
Job details
- Published
- June 17, 2026
- Last checked
- November 17, 2026
- Job source
- ashby
- Workplace
- Hybrid · Milan, IT
- First seen
- June 17, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Kong
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.