
Member of Technical Staff, Inference Research
Inco is seeking founding members for AI research projects focused on production inference. Candidates should lead rigorous technical projects and work comfortably across the inference stack. Responsibilities include post-training optimizations and model serving. The role requires expertise in LLM architectures and GPU-related technologies. Inco values flexibility and tech-lead mentality, regardless of title, and encourages a collaborative environment. Benefits include a competitive salary and health coverage. The role favors in-person work at the Palo Alto or Brooklyn locations.
Job description
About the role
We are looking for founding members to lead frontier AI research projects and translate findings into production inference. The scope is deliberately broad: inference spans everything between a trained model and a served token. The work can include post-training and fine-tuning, quantization, speculative decoding, and optimization across kernels, serving systems, and models. We’re looking for people who are not only comfortable moving between these layers, but prefer the flexibility to work wherever the highest-impact opportunity is. We are the team behind industry-leading techniques like AWQ and DFlash, and this role will continue pushing that work forward. Our organization is flat, and every member contributes end to end, from research and inception through production serving.
About you
- You have a track record of leading rigorous technical projects from zero, and are motivated to advance frontier research yourself.
- You are comfortable working across the full inference stack and move fluidly between model, systems, and kernel layers
- You are drawn to the risk and upside of an early-stage startup
- You embrace ambiguity and have a strong bias for action
- You operate with a tech-lead mentality regardless of title or years of experience
- You treat AI as a force multiplier: fluent with coding agents and modern AI/ML workflows, you fold them into how you ship, and you are willing to push the boundary of what’s possible with agents
Requirements
- Fluency in modern LLM and multimodal architectures, including training, fine-tuning, quantization, speculative decoding, and their tradeoffs
- Depth in quantization formats and algorithms such as NVFP4, FP8, PTQ, QAT, and QAD
- Familiarity with speculative-decoding methods including DFlash, EAGLE-3, and comparable approaches
- Demonstrable research track record, either publications in relevant venues (NeurIPS, ICLR, ICML, MLSys,...) or open-source contributions or similar
- A record of taking model-level research from prototype to production inference
- Hands-on experience with open-source inference and serving stacks such as PyTorch, vLLM, SGLang, Dynamo, SMG, and TensorRT-LLM
Bonus
- Production proficiency in Python and at least one systems language: Rust, C++, or Go
- Hands-on experience authoring GPU kernels with CUDA, Triton, or PTX
- Familiarity with system-wide profiling, tracing, and debugging using tools such as Nsight Systems (nsys)
- A track record of operating inference workloads across 1,000+ GPUs
- Contributions to open-source ML or systems infrastructure
Compensation & Benefits
- Highly competitive salary ($200,000–$350,000+) and equity
- Comprehensive health coverage for you and your dependents
- Strong 401(k) match
- Meals and snacks on us + discretionary productivity budget
Strong preference for in-person in Palo Alto or Brooklyn.
About Inco
Inco AI (inco.ai) builds the agent-native inference platform for tomorrow's token economics. Through hardware-model co-design, it turns any GPU fleet into efficient token production, trains inference-aware models on each customer's real traffic, and deploys portably across heterogeneous compute. We've raised $20M+ and are already building for customers: bare-metal neoclouds and alternative hardware providers looking to differentiate their compute as inference infrastructure, and agentic software companies for whom inference cost is the line between viable and broken margins. We're the team behind industry-defined techniques such as AWQ, DFlash, and TensorRT-LLM, with combined decades in AI efficiency leadership and prior successful exits. Our researchers and engineers work where frontier research meets production.
We operate on five principles:
- Operate at the frontier. The field moves every day, and so do we. We reinvent ourselves constantly and push the frontier forward with our research. We keep process light and decisions fast, so a good idea reaches production in days, not quarters. Legacy doesn’t slow us down.
- Mission over individuals. We are obsessed with our customers and humble in pursuit of the goal. We share credit, name mistakes early, and change our minds when the evidence says so. The question is always what moves the mission forward, never who was right.
- Amplify with agents. Code is free now; architecture and process aren’t. We hand agents everything they can own, from code to operations, and spend our own time on design, judgment, and the problems only people can solve.
- Protect the maker’s time. Focus is our scarcest resource. We keep meetings few and protect long, uninterrupted stretches of work. We automate overhead, cover meals, and handle logistics, so our hours go to research and product.
- Be a team player. We win as one team. We share context generously, step in wherever we’re needed, and hold each other to a high bar, because exceptional work comes from exceptional peers.
Inco is already seeing strong early demand. The company is already serving more than 1T tokens a day, has inbound interest from hardware and accelerator companies, and has two enterprise engagements underway, including one focused on building data, fine-tuning, and inference-serving flywheel for an industrial vision use case.
Job details
- Published
- November 13, 2026
- Last checked
- November 17, 2026
- Experience
- Staff
- Job source
- ashby
- First seen
- November 13, 2026
Skills mentioned in this job
LiftmyCV exclusive data
Inco AI hiring intelligence
Inco AI currently has 4 active jobs tracked by LiftmyCV. 4 new jobs in the past 7 days.
Verified November 17, 2026
Active openings
4
Currently tracked by LiftmyCV
New in 7 days
4
4 new jobs in the past 30 days
Published salaries
25%
Median disclosed salary: $275,000
Average opening age
5 days
Across 4 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • Member of Technical Staff, Developer Infrastructure & Agent Automation
- • Member of Technical Staff, Inference Research
- • Member of Technical Staff, Inference Systems
- • Member of Technical Staff, Kernel Performance & Automation
Frequently requested skills
Median disclosed salary: $275,000 · 25% of jobs publish a salary
As of November 18, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Inco AI
Similar jobs from this company
- Member of Technical Staff, Inference SystemsInco AIPalo Alto, USHybrid
- Member of Technical Staff, Developer Infrastructure & Agent AutomationInco AIPalo Alto, US
- Member of Technical Staff, Kernel Performance & AutomationInco AIPalo Alto, US
- Member of Technical Staff, GeneralInco AIPalo Alto, US
- Member of Technical Staff, ProductionInco AIPalo Alto, US
Across the market
Similar jobs from other companies
- Member of Technical Staff - Inference ResearchModalNew York, USOn-site
- Member of Technical Staff - InferencePrime IntellectRemoteHybrid
- Member of Technical Staff - InferenceRadixArkPalo Alto, USOn-site
- Member of Technical Staff - InferenceSail ResearchSan Francisco, US
- Member of Technical Staff, InferenceInferactSan Francisco, US$200,000–$400,000 per year
- Member of Technical Staff, InferenceRadical NumericsSan Francisco, USOn-site
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.