Backend Software Engineer (ML Infra)
Job description
Rockstar is recruiting for a fast-growing AI infrastructure startup building the optimal inference allocation engine—model routing, dedicated inference, and post-training, all working together to ensure every request is served by the best model for it, in real time. The client’s mission is to deliver truly serverless intelligence to the AI world. Their routers and models allocate and serve 100B+ tokens/month for frontier AI companies across industries. About the Client The client is building the optimal inference allocation engine—model routing, dedicated inference, and post-training, all working together to ensure every request is served by the best model for it, in real time. Their mission is to deliver truly serverless intelligence to the AI world. Their routers and models allocate and serve 100B+ tokens/month for frontier AI companies across industries. The Role The client is hiring a Software Engineer to help design, build, and scale the core systems that power large-scale routing, model training, and deployment. The engineer will work on everything from distributed training pipelines, cloud-native infrastructure, and internal developer platforms that support fine-tuning, reinforcement learning, and inference at scale, stretching right up to the frontend. This role sits at the intersection of product engineering and ML systems—the engineer will collaborate closely with ML scientists while owning production-grade infrastructure operating at 99.99% uptime, alongside a team that has shipped hundreds of models at places like TikTok, MongoDB, and Neeva. This is an ideal role for an early-career engineer who wants to work on real distributed systems, GPU workloads, and modern ML infrastructure, and actually see their work transform the AI capabilities of frontier application layer companies. What You’ll Do Build & Scale Core Infrastructure Design and implement systems that support large-scale ML workloads, including fine-tuning and reinforcement learning. Build distributed training, inference, and logging pipelines that are efficient, fault-tolerant, and observable. Cloud & Systems Engineering Work on cloud-native systems using containers and orchestration (e.g., Kubernetes). Optimize systems for performance, reliability, and cost efficiency, especially for GPU-heavy workloads. Implement monitoring, logging, and observability for long-running training jobs and production services. Bring the Client’s Capabilities to Customers Talk to customers. Join their calls, find what’s slowing them down, and ship the fix yourself. Realize the client’s features. Develop the frontend and backend logic that enables customers to access the client’s capabilities. Who You Are Required 1–3 years of engineering experience, ideally working on production systems on the backend and infrastructure layer. Strong fundamentals in distributed systems, networking, and backend architecture. Comfortable writing code with and without AI and taking accountability for your code. Excited to work on-site in San Francisco with a fast-moving early-stage team.
Responsibilities
Build & Scale Core Infrastructure Design and implement systems that support large-scale ML workloads, including fine-tuning and reinforcement learning. Build distributed training, inference, and logging pipelines that are efficient, fault-tolerant, and observable. Cloud & Systems Engineering Work on cloud-native systems using containers and orchestration (e.g., Kubernetes). Optimize systems for performance, reliability, and cost efficiency, especially for GPU-heavy workloads. Implement monitoring, logging, and observability for long-running training jobs and production services. Bring the Client’s Capabilities to Customers Talk to customers. Join their calls, find what’s slowing them down, and ship the fix yourself. Realize the client’s features. Develop the frontend and backend logic that enables customers to access the client’s capabilities. Who You Are Required 1–3 years of engineering experience, ideally working on production systems on the backend and infrastructure layer. Strong fundamentals in distributed systems, networking, and backend architecture. Comfortable writing code with and without AI and taking accountability for your code. Excited to work on-site in San Francisco with a fast-moving early-stage team.
Job details
- Published
- November 4, 2026
- Last checked
- November 16, 2026
- Job source
- workable
- Workplace
- On-site · San Francisco, US
- First seen
- November 4, 2026
LiftmyCV exclusive data
Rockstar hiring intelligence
Rockstar currently has 10 active jobs tracked by LiftmyCV. 2 new jobs in the past 7 days.
Verified November 16, 2026
Active openings
10
Currently tracked by LiftmyCV
New in 7 days
2
10 new jobs in the past 30 days
Published salaries
20%
Median disclosed salary: $202,500
Average opening age
9 days
Across 10 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • Account Executive
- • Backend Software Engineer (ML Infra)
- • Brand + Content Manager
- • Enterprise Sales Lead
- • Senior / Staff Software Engineer
- • Senior Accounting Manager
Frequently requested skills
Median disclosed salary: $202,500 · 20% of jobs publish a salary
As of November 17, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Rockstar
Similar jobs from this company
Across the market
Similar jobs from other companies
- Software Engineer Backend & InfraFairmatParis / BouguenaisHybrid
- Software Engineering, LMTS (Backend + Infra)SalesforceIndia - HyderabadOn-site
- Backend Software Engineer (Infra Engineer)IntelliPro Group Inc.Palo Alto, USOn-site$160,000–$180,000 per year
- Staff+ Software Engineer, Backend and InfraHaize LabsNew York, NYOn-site
- Infra / Backend EngineerRaindropSan Francisco, USOn-site
- Backend/Infra EngineerRemySan Francisco, USHybrid
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.