LiftmyCVLiftmyCV

Member of Technical Staff, Production

Inco AIPalo Alto, US
AI job summary

Inco is seeking founding members to enhance its production infrastructure for the inference platform. This role focuses on running optimized inference engines on large GPU clusters, ensuring reliability and efficiency. Candidates must have experience in distributed production systems, with a strong emphasis on Kubernetes, orchestration, and traffic management. Responsibilities include automating operations and debugging complex systems. Ideal candidates will thrive in an early-stage startup environment and possess strong hands-on engineering skills.

Job description

About the role

We are looking for founding members to own the production infrastructure behind Inco's inference platform. You will take highly optimized inference engines and make them run reliably and efficiently on large GPU clusters serving customer traffic 24/7. The work spans Kubernetes, orchestration, traffic management, deployments, observability, and capacity, with the goal of infrastructure that ships continuously without interrupting customers and recovers from failures on its own. You bring deep expertise in distributed production infrastructure, and you will work closely with the researchers and engineers who build our inference engines to learn what it takes to run them at scale. Exposure to LLMs is a plus. Our organization is flat, and you will carry ideas from inception through deployment.

About you

  • You have operated large-scale, always-on production infrastructure and understand what it takes to keep complex distributed systems reliable
  • You are exceptional at debugging complex failures across applications, infrastructure, networking, and distributed systems
  • You think about systems end-to-end: how traffic enters the system, gets routed and scheduled, reaches compute, and ultimately serves the customer
  • You automate recurring operational work rather than accepting it as permanent toil
  • You are drawn to the risk and upside of an early-stage startup
  • You embrace ambiguity and have a strong bias for action
  • You operate with a tech-lead mentality regardless of title or years of experience
  • You treat AI as a force multiplier: fluent with coding agents and modern AI/ML workflows, you fold them into how you ship, and you are willing to push the boundary of what’s possible with agents

Requirements

  • Strong generalist engineering ability across Linux, networking, containers, Python, Bash, and distributed systems
  • Deep hands-on experience operating Kubernetes in production
  • Experience operating high-throughput, highly available production systems at significant scale
  • Strong understanding of cluster orchestration, scheduling, service discovery, load balancing, and traffic management
  • Experience building production observability using metrics, logs, dashboards, and actionable alerting
  • Strong understanding of networking fundamentals and how network behavior affects distributed applications
  • Experience designing safe deployment and rollout strategies for always-on production systems

Bonus

  • Experience operating large-scale AI systems, ML platforms, data platforms, or other compute-intensive distributed systems
  • Experience operating GPU clusters or AI/ML workloads
  • Familiarity with GPU environments including NVIDIA drivers, CUDA, NCCL, and InfiniBand/RDMA
  • Familiarity with LLM inference and serving stacks such as PyTorch, vLLM, SGLang, or TensorRT-LLM
  • Experience running bare-metal GPU fleets across multiple infrastructure providers
  • Experience with infrastructure-as-code tools such as Terraform

Compensation & Benefits

  • Highly competitive salary and equity
  • Comprehensive health coverage for you and your dependents
  • Strong 401(k) match
  • Meals and snacks on us + discretionary productivity budget

Strong preference for in-person in Palo Alto or Brooklyn.

About Inco

Inco AI (inco.ai) builds the agent-native inference platform for tomorrow’s token economics, making advanced AI fast enough for real workflows and affordable enough to use at scale. We’re the researchers and engineers behind AWQ, DFlash, and TensorRT-LLM, bringing frontier research into production. Our platform ranked #1 in output speed on Artificial Analysis for every model we launched with, and our DFlash models have surpassed 10 million downloads on Hugging Face. Backed by B Capital, E14 Fund, and Tectonic Ventures, we serve customers across serverless, dedicated, and local AI deployments.

Job details

Published
November 18, 2026
Experience
Staff
Job source
ashby
First seen
November 18, 2026

Benefits

Highly competitive salary and equity. Comprehensive health coverage for you and your dependents. Strong 401(k) match. Meals and snacks on us + discretionary productivity budget.

Skills mentioned in this job

KubernetesLinuxnetworkingcontainersPythonBashdistributed systems

LiftmyCV exclusive data

Inco AI hiring intelligence

Inco AI currently has 4 active jobs tracked by LiftmyCV. 4 new jobs in the past 7 days.

Active openings

4

Currently tracked by LiftmyCV

New in 7 days

4

4 new jobs in the past 30 days

Published salaries

25%

Median disclosed salary: $275,000

Average opening age

5 days

Across 4 active openings

Workplace breakdown

Remote0%
Hybrid100%
On-site0%

Hiring countries

United States of America

Top hiring cities

Brooklyn
Palo Alto

Most in-demand roles

  • • Member of Technical Staff, Developer Infrastructure & Agent Automation
  • • Member of Technical Staff, Inference Research
  • • Member of Technical Staff, Inference Systems
  • • Member of Technical Staff, Kernel Performance & Automation

Frequently requested skills

Python
PyTorch
TensorRT-LLM
Bash
Buildkite
C++
CI/CD
CUDA

Median disclosed salary: $275,000 · 25% of jobs publish a salary

As of November 18, 2026

Hiring insights calculated from active jobs tracked by LiftmyCV.

AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Inco AI

Similar jobs from this company

Across the market

Similar jobs from other companies

Related job searches

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.