Member of Technical Staff, Inference
Inferact seeks an inference runtime engineer to enhance AI inference by optimizing execution across diverse hardware and architectures. This role is crucial as models evolve in size and architecture. Candidates should have a strong background in transformer architectures, programming in Python, and experience with LLM inference systems. Preferred qualifications include knowledge of KV-cache memory management and multimodal inference. The position is based in San Francisco or can be remote for exceptional candidates, offering a competitive salary range of $200,000 - $400,000 USD plus equity.
Job description
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
About the Role
We're looking for an inference runtime engineer to push the boundaries of what's possible in LLM and diffusion model serving. Models grow larger. Architectures shift: mixture-of-experts, multimodal, agentic. Every breakthrough demands innovations on the inference engine itself. You'll work at the core of vLLM, optimizing how models execute across diverse hardware and architectures. Your work will directly impact how the world runs AI inference.
Skills and Qualifications
Minimum qualifications:
- Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- Deep understanding of transformer architectures and their variants.
- Strong programming skills in Python with experience in PyTorch internals.
- Experience with LLM inference systems (vLLM, TensorRT-LLM, SGLang, TGI).
- Ability to read and implement model architectures and inference techniques from research papers.
- Demonstrate the ability to contribute performant and maintainable code and debug in complex ML codebases.
Preferred qualifications:
- Deep understanding of KV-cache memory management, prefix caching, and hybrid model serving.
- Familiarity with RL frameworks and algorithms for LLMs.
- Experience with multimodal inference (audio/image/video/text).
- Contributions to open-source ML or system infrastructure projects.
Bonus points if you have:
- Implemented core features in vLLM or other inference engine projects.
- Contributed to vLLM integrations (verl, OpenRLHF, Unsloth, LlamaFactory, etc).
- Written widely-shared technical blogs or side projects on vLLM or LLM inference.
Logistics
- Location: This role is based in San Francisco, California. Will consider remote in the US for exceptional candidates.
- Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.
- Visa sponsorship: We sponsor visas on a case-by-case basis.
- Benefits: Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.
Job details
- Published
- June 18, 2026
- Last checked
- November 17, 2026
- Job source
- ashby
- First seen
- June 18, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inVisa sponsorship insights
Visa sponsorship available
This job posting states that visa sponsorship is available for qualified candidates.
More at Inferact
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
- Member of Technical Staff, InferenceInferactSan Francisco, US$200,000–$400,000 per year
- Member of Technical Staff, InferenceRadical NumericsSan Francisco, USOn-site
- Member of Technical Staff, InferenceMirendilSan Francisco, US$300,000–$500,000 per year
- Member of Technical Staff, InferenceGenesisBay Area, USHybrid
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.