Staff Software Engineer, Machine Learning
Job description
Staff Software Engineer, Machine Learning (LLM Backend) Location: Burlingame, CA (On-site, 4 days/week) Employment Type: Full-time
Salary Range: $145K - $250K
We are a rapidly growing AI technology company transforming mission-critical processes in the healthcare industry. We are seeking a Staff Software Engineer to architect and scale the secure, reliable backend systems that power our advanced Large Language Model (LLM) applications. This role requires expertise at the intersection of applied AI, distributed systems, and security/compliance in a regulated domain. You will be responsible for pushing LLMs beyond demos into mission-critical, cost-efficient, and secure production healthcare workflows. This is a technical leadership role driving the end-to-end delivery of core ML/LLM systems.
Key Responsibilities:
- Backend for LLMs: Architect and implement scalable, low-latency APIs and services that wrap, orchestrate, and optimize LLMs for high-volume healthcare use cases (e.g., automated voice AI agents).
- Data & Retrieval Pipelines: Build robust ingestion, preprocessing, and Retrieval-Augmented Generation (RAG) pipelines to ground LLMs in proprietary clinical and revenue-cycle data.
- LLMOps & Observability: Design and implement systems for model monitoring, evaluation harnesses, cost tracking, and guardrails, ensuring reliability and responsible use in production.
- Performance & Optimization: Engineer solutions for caching, batching, load balancing, and scaling LLM workloads across cloud and containerized environments.
- Security & Compliance: Implement HIPAA-ready infrastructure, robust data governance, and auditability for all LLM-powered applications in a regulated setting.
- Technical Leadership: Drive end-to-end delivery of LLM backend projects, establish engineering best practices, and mentor peers in complex LLM system design.
Job details
- Published
- November 13, 2025
- Job source
- jworkable
- Workplace
- On-site · San Francisco, California, United States
- First seen
- November 13, 2025
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at MLabs
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
- Staff Software Engineer, Machine LearningMLabsSan Francisco, California, United StatesOn-site
- Staff Software Engineer, Machine LearningLinkedInBengaluru, INHybrid
- Staff Software Engineer, Machine LearningDoorDash USASan Francisco, USOn-site$203,500–$299,300 per year
- Staff Software Engineer, Machine LearningZipRecruiterRemoteHybrid
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.