LiftmyCVLiftmyCV
GL

Member of Technical Staff - GPU Performance

Gimlet LabsSan Francisco, US
AI job summary

Gimlet is seeking a Member of Technical Staff to enhance AI inference performance across its diverse accelerator fleet. The role involves characterizing workloads, establishing performance baselines, and optimizing execution through various methodologies. Ideal candidates will have strong software engineering skills, experience with GPU workloads, and familiarity with performance profiling tools. You will work on establishing performance standards and translating findings into production enhancements. Join Gimlet in tackling challenging technical problems and contribute to the development of innovative AI infrastructure.

Job description

About us

Gimlet is building the first multi-silicon neocloud designed for fast, efficient AI inference. We combine large-scale compute infrastructure with an execution platform that partitions AI workloads and maps each stage to the hardware best suited to run it. We work with foundation labs, hyperscalers, and AI-native companies, giving our team access to technical problems spanning frontier models, production infrastructure, and emerging hardware.

About the role

As a Member of Technical Staff, you will characterize and improve the performance of production AI inference across Gimlet's heterogeneous accelerator fleet. You will work across kernel execution, compiler output, runtime behavior, memory movement, synchronization, scheduling, and multi-device execution. Rather than treating performance as a collection of isolated microbenchmarks, you will connect hardware-level evidence to end-to-end latency, throughput, utilization, and cost. You will build the measurement systems and performance methodology that let Gimlet understand new hardware quickly, identify the limiting resource in real workloads, and turn that understanding into changes across kernels, compilers, runtimes, and distributed execution. What success looks like

In the first 12-18 months, you will:

  • Establish trustworthy performance baselines for production inference workloads across established and emerging accelerator architectures
  • Isolate bottlenecks across compute, memory bandwidth, cache behavior, kernel launch, synchronization, host-device interaction, communication, and runtime scheduling ● Use profiling, hardware counters, controlled experiments, and performance models to explain why a workload behaves as it does and identify the highest-leverage optimization
  • Improve execution through changes such as launch reduction, graph capture, stream and event coordination, compute-communication overlap, memory reuse, batching, and scheduling ● Build automated benchmarks and regression detection that preserve performance across models, tensor shapes, data types, software releases, and hardware targets
  • Translate performance findings into production improvements, partnering with kernel, compiler, ML systems, and distributed systems engineers when necessary
  • Develop a repeatable methodology for evaluating and bringing up new accelerators within Gimlet's execution platform

You may be a good fit if you have

  • Strong software engineering fundamentals and experience working on performance-critical systems
  • Experience profiling GPU or accelerator workloads and turning measurements into production improvements
  • A strong understanding of GPU execution, memory hierarchies, asynchronous execution, synchronization, and performance tradeoffs
  • The ability to design controlled experiments, distinguish symptoms from root causes, and communicate performance findings precisely
  • Bachelor's degree in a relevant field, or an equivalent combination of education, training, and professional experience

Strong candidates may also have

  • Experience with Nsight Systems, Nsight Compute, rocprof, Omniperf, VTune, Perfetto, or hardware performance counters
  • Experience with CUDA, HIP, Triton, or another accelerator programming model and the ability to prototype low-level optimizations
  • Familiarity with roofline analysis, queueing behavior, occupancy, latency hiding, instruction throughput, and memory-bandwidth analysis
  • Experience optimizing inference runtimes, execution graphs, memory allocators, kernel dispatch, batching, or model-serving systems
  • Familiarity with collective communication, topology-aware execution, and compute-communication overlap across multiple accelerators
  • Experience building performance laboratories, benchmark suites, regression infrastructure, or hardware bring-up methodology

Why join now? Gimlet is expanding from its core technology into a production neocloud spanning new hardware, customers, and data centers.

  • Solve hard problems.
  • Own meaningful work.
  • Build for production.
  • Help define what’s next.

Agency Policy:Gimlet Labs does not accept unsolicited resumes from recruitment agencies or search firms. Any unsolicited resumes submitted without a signed agreement will be considered the property of Gimlet Labs, and no fees will be paid.

Job details

Published
October 26, 2026
Last checked
November 17, 2026
Experience
Staff
Job source
ashby
First seen
October 26, 2026

Skills mentioned in this job

GPUCUDAhardware performance counters

LiftmyCV exclusive data

Gimlet Labs hiring intelligence

Gimlet Labs currently has 7 active jobs tracked by LiftmyCV. 0 new jobs in the past 7 days.

Verified November 17, 2026

Active openings

7

Currently tracked by LiftmyCV

New in 7 days

0

4 new jobs in the past 30 days

Published salaries

—

Not published by this employer yet

Average opening age

28 days

Across 7 active openings

Workplace breakdown

Remote0%
Hybrid0%
On-site100%

Hiring countries

United States of America

Top hiring cities

San Francisco

Most in-demand roles

  • • Data Center Architect
  • • Data Center Operations, Site Lead
  • • FP&A Manager, Infrastructure & Corporate
  • • Materials and Product Lifecycle Program Manager
  • • Member of Technical Staff - GPU Performance
  • • Project Coordinator, Hardware Partnerships

Frequently requested skills

communication
CUDA
data analytics
FP&A
GPU
hardware performance counters
investment banking
modeling

As of November 18, 2026

Hiring insights calculated from active jobs tracked by LiftmyCV.

AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Gimlet Labs

Similar jobs from this company

Across the market

Similar jobs from other companies

Related job searches

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.