
Software Engineer 2, AI Gateway
Job description
Are you ready to unlock intelligence? If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others.
About the Role:
You will join the engineering team that builds the Kong AI gateway, empowering companies and developers around the world to govern every step of their AI & LLM based innovation. As a Software Engineer in the AI Gateway Team, you will be working on core features such as multi-LLM routing and balancing, semantic caching and routing, MCP, and more.
What You'll Do:
- Responsible for building and maintaining API management software for AI and LLMs and its underlying stack.
- Implement new innovative features including proxying capabilities, load balancing, databases support that extend Kong AI Gateway’s offering.
- Bugs troubleshooting, performance tuning and low-level optimizations.
- Fill the gaps between Kong and third-party deployment platforms and tooling.
- Any additional tasks required by manager.
What You'll Bring:
- 3+ years of programming in server-side applications and components.
- Hands on experience with either Golang or Rust
- Experience building and debugging applications that are highly scalable, distributed, reliable and resilient.
- Solid hands-on low-level technical expertise in Linux systems troubleshooting, and profiling.
- Experience in distributed systems, Linux networking stack and computer systems programming, Kong works with APIs on both L7 and L4 transports and protocols, so this expertise and knowledge are required.
- Comfortable working with a remotely distributed team.
- Strong sense of ownership and excellent verbal and written communication skills -- engineers at Kong write the documentation for their products
- Familiarity with AI LLM concepts and applications development
Bonus Points:
- Hands on experience with NGINX/OpenResty/Kong/LuaJIT.
- Hands on experience with Envoy or Istio.
#LI-EA1
About Kong:
Kong Inc., the AI Connectivity Company, is building the connectivity layer of AI. Trusted by the Fortune 500® and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. For more information, visit.
Job details
- Published
- October 23, 2026
- Last checked
- November 17, 2026
- Job source
- ashby
- Workplace
- Hybrid · Milan, IT
- First seen
- October 23, 2026
LiftmyCV exclusive data
Kong hiring intelligence
Kong currently has 77 active jobs tracked by LiftmyCV. 23 new jobs in the past 7 days.
Verified November 17, 2026
Active openings
77
Currently tracked by LiftmyCV
New in 7 days
23
69 new jobs in the past 30 days
Published salaries
—
Not published by this employer yet
Average opening age
16 days
Across 77 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • Staff Solutions Engineer
- • Enterprise Account Executive
- • Senior Software Engineer, AI Gateway - Shanghai
- • Enterprise Growth Account Executive - East
- • Partner Sales Manager
- • Senior Software Engineer, AI Gateway
Frequently requested skills
As of November 18, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Kong
Similar jobs from this company
Across the market
Similar jobs from other companies
- Software Engineer, AI GatewayVercelHybrid - San Francisco, New York CityRemote
- Software Engineer AI GatewayKongMilan, ITHybrid
- Senior Software Developer (Core Gateway)payabl.Frankfurt am Main, Hessen, GermanyHybrid
- Software Engineer - ATM & Host GatewayOCBC Bank (Hong Kong) LimitedHong Kong, HKOn-site
- Software Engineering SMTS - LLM GatewaySalesforce, Inc.San Francisco, USOn-site$148,500–$223,900 per year
- Software Engineering - ATM & Host GatewayOCBC Bank (Hong Kong) LimitedOCBC Hong KongOn-site
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.