LiftmyCVLiftmyCV
ML

Staff Software Engineer, Machine Learning

MLabsOn-siteSan Francisco, California, United States

Job description

Staff Software Engineer, Machine Learning (LLM Backend) Location: Burlingame, CA (On-site, 4 days/week) Employment Type: Full-time

Salary Range: $145K - $250K

We are a rapidly growing AI technology company transforming mission-critical processes in the healthcare industry. We are seeking a Staff Software Engineer to architect and scale the secure, reliable backend systems that power our advanced Large Language Model (LLM) applications. This role requires expertise at the intersection of applied AI, distributed systems, and security/compliance in a regulated domain. You will be responsible for pushing LLMs beyond demos into mission-critical, cost-efficient, and secure production healthcare workflows. This is a technical leadership role driving the end-to-end delivery of core ML/LLM systems.

Key Responsibilities:

  • Backend for LLMs: Architect and implement scalable, low-latency APIs and services that wrap, orchestrate, and optimize LLMs for high-volume healthcare use cases (e.g., automated voice AI agents).
  • Data & Retrieval Pipelines: Build robust ingestion, preprocessing, and Retrieval-Augmented Generation (RAG) pipelines to ground LLMs in proprietary clinical and revenue-cycle data.
  • LLMOps & Observability: Design and implement systems for model monitoring, evaluation harnesses, cost tracking, and guardrails, ensuring reliability and responsible use in production.
  • Performance & Optimization: Engineer solutions for caching, batching, load balancing, and scaling LLM workloads across cloud and containerized environments.
  • Security & Compliance: Implement HIPAA-ready infrastructure, robust data governance, and auditability for all LLM-powered applications in a regulated setting.
  • Technical Leadership: Drive end-to-end delivery of LLM backend projects, establish engineering best practices, and mentor peers in complex LLM system design.

Job details

Published
November 13, 2025
Job source
jworkable
Workplace
On-site · San Francisco, California, United States
First seen
November 13, 2025
AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at MLabs

Similar jobs from this company

None listed.

Across the market

Similar jobs from other companies

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.