AI Inference Engineer
Job description
We are looking for an AI Inference engineer to join our growing team. Our current stack is Python, Rust, C++, PyTorch, Triton, CUDA, Kubernetes. You will have the opportunity to work on large-scale deployment of machine learning models for real-time inference.
Responsibilities
- Develop APIs for AI inference that will be used by both internal and external customers
- Benchmark and address bottlenecks throughout our inference stack
- Improve the reliability and observability of our systems and respond to system outages
- Explore novel research and implement LLM inference optimizations
Qualifications
- Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)
- Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization, etc.)
- Understanding of GPU architectures or experience with GPU kernel programming using CUDA
Final offer amounts are determined by multiple factors, including, experience and expertise. Equity: In addition to the base salary, equity may be part of the total compensation package.
Job details
- Published
- November 17, 2025
- Job source
- ashby
- Workplace
- On-site · San Francisco, London
- First seen
- January 30, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Perplexity
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
- AI Inference EngineerPerplexitySan Francisco, LondonOn-site
- AI Inference EngineerITRex GroupTRRemote
- AI Inference EngineerFuse EnergyLondon, GBRemote
- AI Inference EngineerF5, Inc. (United States)San Jose, USOn-site$176,600–$265,000 per year
- AI Inference EngineerBasetenSan Francisco, USHybrid
- AI Inference EngineerEvergridNew York City, USHybrid
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.