Member of Technical Staff - Distributed Systems
Gimlet Labs is developing a neocloud for AI workloads to address scaling challenges in the AI industry. This involves decoupling workloads from hardware, enabling heterogeneous systems across various platforms. The company collaborates with leading labs and companies to power scalable AI datacenters. The Member of Technical Staff will build the core platform for reliably operating AI workloads, targeting engineers who enjoy foundational infrastructure and large-scale systems.
Job description
Gimlet Labs is building the first heterogeneous neocloud for AI workloads. As AI systems scale, the industry is hitting fundamental limits in power, capacity, and cost with today’s homogeneous, vertically integrated infrastructure. Gimlet addresses this by decoupling AI workloads from the underlying hardware. Our platform intelligently partitions workloads into components and orchestrates each component to hardware that best fits its performance and efficiency needs. This approach enables heterogeneous systems across multi-vendor and multi-generation hardware, including the latest emerging accelerators. These systems unlock step-function improvements in performance and cost efficiency at scale. On top of this foundation, Gimlet is building a production-grade neocloud for agentic workloads. Customers use Gimlet to deploy and manage their workloads through stable, production-ready APIs, without having to reason about hardware selection, placement, or low-level performance optimization. Gimlet works with foundation labs, hyperscalers, and AI native companies to power real production workloads built to scale to gigawatt-class AI datacenters. Gimlet Labs is seeking a Member of Technical Staff focused on distributed systems. In this role, you will build the core platform that schedules, routes, and operates AI workloads reliably at production scale. You will work on systems that coordinate execution across thousands of nodes, expose stable production APIs, and ensure workloads run predictably under real-world load and failure conditions. This role is well-suited for engineers who enjoy building foundational infrastructure, understanding systems end-to-end, and operating at scale.
Responsibilities
- Design and build distributed systems that orchestrate and operate AI workloads at large scale
- Develop scheduling, routing, and resource management components that coordinate execution across many nodes and services
- Build production-grade APIs and control planes for deploying and managing workloads
- Implement mechanisms for reliability, availability, and fault tolerance in distributed environments
- Instrument systems for observability and debugging at scale
- Work closely with compilers, runtimes, and hardware to ensure end-to-end system correctness and performance
Qualifications
- Strong software engineering fundamentals
- Experience building or operating distributed systems in production environments
- Comfort reasoning about concurrency, failure modes, and tradeoffs in large-scale systems
Preferred Qualifications
- Experience with Kubernetes or Kubernetes-adjacent systems beyond basic usage
- Experience designing service-oriented architectures using RPC or asynchronous messaging
- Familiarity with scheduling, queues, or resource management systems
- Experience building reliable APIs and operating systems under high load
- Software development experience in languages commonly used for systems development (e.g., Go, C++, Python)
Job details
- Published
- March 10, 2026
- Last checked
- November 17, 2026
- Job source
- ashby
- Workplace
- Hybrid · San Francisco, US
- First seen
- March 10, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Gimlet Labs
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.