LiftmyCVLiftmyCV
SR

Member of Technical Staff - Inference

Sail ResearchSan Francisco, US
AI job summary

Sail is seeking a Member of Technical Staff to optimize software for LLM token processing and agent hosting. This role involves enhancing inference engines, refining GPU performance, and implementing innovative parallelism strategies. Candidates should possess a solid grasp of LLM mechanics, modern GPU programming, and effective communication skills. The interview process includes discussions with leadership, a practical coding task, and feedback sessions. Life at Sail features a vibrant office in San Francisco with on-site meals and a commitment to employee well-being.

Job description

Sail builds the world's most efficient software for inference (processing LLM tokens) and agent hosting (cloud VMs). Together, our technologies allow our customers to deploy AI agents at large scale to do the most challenging work.

Role Responsibilities

In this role, you'll own token processing down to the lowest layers of the stack. You'll optimize kernel performance, develop new request scheduling and parallelism strategies at the engine level, and help us use a heterogenous mix of hardware at max efficiency.

  • Modify and extend state-of-the-art inference engines like vLLM and SGLang.
  • Understand every microsecond of GPU time spent during a forward pass. You'll be able to explain every kernel launch on an NSys profile.
  • Design and implement exotic parallelism schemes to work with "interesting" hardware topologies.
  • Write custom GPU kernels to excel in specific regimes, such as cascade attention

Candidate Requirements

What we’re looking for:

  • Strong understanding of core LLM mechanics, like KV cache, mixture-of-experts, prefill vs. decode phases.
  • Interest in MLSys research - great ideas like speculative decoding and sparse attention come from research, that we need to follow closely.
  • Familiarity with modern, tile-based GPU programming, e.g. Triton, CUTLASS, ThunderKittens, etc. Or an interest in learning these!
  • Great interpersonal communication - please don't use LLMs to write prose. We desk-reject most LLM-generated cover letters and resumes.

Interview Process

  • Meet the CTO, who will ask about your experience, and share as much technical detail about Sail as you want to hear.
  • Meet the CEO. This is an early step because we respect your time. Ask any question and get a definitive answer immediately.
  • Come in to Sail's SF office for an interview day. Meet the whole team, then you'll have 3-4 hours to work on a problem that closely simulates the work we do daily. It's an objectively scored task, so you'll have immediate feedback on how well your code is working - just like we do in production! AI assistance is highly encouraged, and we'll provide a laptop with all the best tools set up. Finish with a short presentation describing your process, learnings, and results.
  • Offer. Once the team decides we want to work with you, we make a strong offer quickly and will be quite persistent over email/text/calls :)

Life at Sail

We work out of a beautiful, sunny office in downtown San Francisco. All meals are on us (and actually great; SF is a food paradise and it would be a shame to eat only bowl slop). Everyone gets a Studio Display at their desk. We are serious about investing in anything that saves us time or energy. There are six different ways to make coffee or tea in the office. A friendly (hypoallergenic) black cat named Coco visits occasionally.

Job details

Published
July 17, 2026
Last checked
November 17, 2026
Job source
ashby
First seen
July 17, 2026
AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Sail Research

Similar jobs from this company

None listed.

Across the market

Similar jobs from other companies

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.