LiftmyCVLiftmyCV
RO

Backend Software Engineer (ML Infra)

RockstarOn-siteSan Francisco, US

Job description

Rockstar is recruiting for a fast-growing AI infrastructure startup building the optimal inference allocation engine—model routing, dedicated inference, and post-training, all working together to ensure every request is served by the best model for it, in real time. The client’s mission is to deliver truly serverless intelligence to the AI world. Their routers and models allocate and serve 100B+ tokens/month for frontier AI companies across industries. About the Client The client is building the optimal inference allocation engine—model routing, dedicated inference, and post-training, all working together to ensure every request is served by the best model for it, in real time. Their mission is to deliver truly serverless intelligence to the AI world. Their routers and models allocate and serve 100B+ tokens/month for frontier AI companies across industries. The Role The client is hiring a Software Engineer to help design, build, and scale the core systems that power large-scale routing, model training, and deployment. The engineer will work on everything from distributed training pipelines, cloud-native infrastructure, and internal developer platforms that support fine-tuning, reinforcement learning, and inference at scale, stretching right up to the frontend. This role sits at the intersection of product engineering and ML systems—the engineer will collaborate closely with ML scientists while owning production-grade infrastructure operating at 99.99% uptime, alongside a team that has shipped hundreds of models at places like TikTok, MongoDB, and Neeva. This is an ideal role for an early-career engineer who wants to work on real distributed systems, GPU workloads, and modern ML infrastructure, and actually see their work transform the AI capabilities of frontier application layer companies. What You’ll Do Build & Scale Core Infrastructure Design and implement systems that support large-scale ML workloads, including fine-tuning and reinforcement learning. Build distributed training, inference, and logging pipelines that are efficient, fault-tolerant, and observable. Cloud & Systems Engineering Work on cloud-native systems using containers and orchestration (e.g., Kubernetes). Optimize systems for performance, reliability, and cost efficiency, especially for GPU-heavy workloads. Implement monitoring, logging, and observability for long-running training jobs and production services. Bring the Client’s Capabilities to Customers Talk to customers. Join their calls, find what’s slowing them down, and ship the fix yourself. Realize the client’s features. Develop the frontend and backend logic that enables customers to access the client’s capabilities. Who You Are Required 1–3 years of engineering experience, ideally working on production systems on the backend and infrastructure layer. Strong fundamentals in distributed systems, networking, and backend architecture. Comfortable writing code with and without AI and taking accountability for your code. Excited to work on-site in San Francisco with a fast-moving early-stage team.

Responsibilities

Build & Scale Core Infrastructure Design and implement systems that support large-scale ML workloads, including fine-tuning and reinforcement learning. Build distributed training, inference, and logging pipelines that are efficient, fault-tolerant, and observable. Cloud & Systems Engineering Work on cloud-native systems using containers and orchestration (e.g., Kubernetes). Optimize systems for performance, reliability, and cost efficiency, especially for GPU-heavy workloads. Implement monitoring, logging, and observability for long-running training jobs and production services. Bring the Client’s Capabilities to Customers Talk to customers. Join their calls, find what’s slowing them down, and ship the fix yourself. Realize the client’s features. Develop the frontend and backend logic that enables customers to access the client’s capabilities. Who You Are Required 1–3 years of engineering experience, ideally working on production systems on the backend and infrastructure layer. Strong fundamentals in distributed systems, networking, and backend architecture. Comfortable writing code with and without AI and taking accountability for your code. Excited to work on-site in San Francisco with a fast-moving early-stage team.

Job details

Published
November 4, 2026
Last checked
November 16, 2026
Job source
workable
Workplace
On-site · San Francisco, US
First seen
November 4, 2026

LiftmyCV exclusive data

Rockstar hiring intelligence

Rockstar currently has 10 active jobs tracked by LiftmyCV. 2 new jobs in the past 7 days.

Verified November 16, 2026

Active openings

10

Currently tracked by LiftmyCV

New in 7 days

2

10 new jobs in the past 30 days

Published salaries

20%

Median disclosed salary: $202,500

Average opening age

9 days

Across 10 active openings

Workplace breakdown

Remote20%
Hybrid0%
On-site80%

Hiring countries

United States of America

Top hiring cities

New York
Austin
Irvine
San Francisco
Southfield

Most in-demand roles

  • • Account Executive
  • • Backend Software Engineer (ML Infra)
  • • Brand + Content Manager
  • • Enterprise Sales Lead
  • • Senior / Staff Software Engineer
  • • Senior Accounting Manager

Frequently requested skills

AWS
data-driven decision-making
Kubernetes
marketing
Node.js
paid acquisition
PostgreSQL
React

Median disclosed salary: $202,500 · 20% of jobs publish a salary

As of November 17, 2026

Hiring insights calculated from active jobs tracked by LiftmyCV.

AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Rockstar

Similar jobs from this company

Across the market

Similar jobs from other companies

Related job searches

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.