LiftmyCVLiftmyCV
EL

Software Engineer - ML Infrastructure

Epsilon Labs, Inc.San Francisco, US
AI job summary

Join epsilon-health as a Software Engineer focused on building ML infrastructure to enhance medical imaging and diagnostics. You'll work with cutting-edge AI technology, collaborating with the research team to develop data pipelines, training systems, and deployment processes. The ideal candidate will have experience in ML systems, data engineering, and distributed training, contributing to scalable solutions that drive patient outcomes. This role offers a unique opportunity to make a significant impact in healthcare technology.

Job description

About Us

We're tackling one of healthcare's most critical challenges in medical imaging and diagnostics. Our company operates at the intersection of cutting-edge AI and clinical practice, building technology that directly impacts patient outcomes. We've assembled one of the industry's most comprehensive and diverse medical imaging datasets and have a proven product-market fit with a substantial customer pipeline already in place.

Role Overview

We're seeking a Software Engineer to build the ML infrastructure and data systems that let our research team train and ship state-of-the-art models for medical imaging. Sitting in the Engineering team and working closely with research, you'll own the data pipelines that unify live production traffic with offline datasets, the distributed training and reinforcement learning infrastructure our foundation-model and post-training work runs on, and the inference and evaluation systems that carry models from experimentation into production. This role requires someone who can move fluidly between ML systems, data engineering, distributed training, and production deployment, and who measures success by how quickly the research team can iterate.

Key Responsibilities

  • Build and optimize distributed training infrastructure for foundation models on large-scale medical imaging, including the long-context parallelism and checkpointing that volumetric CT/MR training demands.
  • Build the reinforcement learning training stack (high-throughput rollout generation, reward-model serving, and experience collection), enabling the research team to run online, multi-reward RL at scale.
  • Build high-throughput data loading and preprocessing that keeps GPUs saturated on large volumetric and multimodal datasets.
  • Design and implement robust data pipelines to collect, process, and store large-scale multimodal medical imaging data from both production traffic and offline sources.
  • Build centralized data storage solutions with standardized formats (e.g., protobufs) that enable efficient retrieval and training across the organization.
  • Partner with researchers to prototype new ideas and translate them into production-ready code, owning end-to-end delivery from experimentation through deployment and monitoring.
  • Contribute to production serving and deployment pipelines — model rollout, canary deployments, and monitoring — alongside the backend team.

Qualifications

  • 5+ years building ML infrastructure, data pipelines, or ML systems in production
  • Strong Python skills and expertise in PyTorch or JAX
  • Experience with distributed training at scale (FSDP, DeepSpeed, or Megatron-style parallelism) and the systems concerns of keeping large GPU jobs efficient
  • Hands-on experience with data pipeline technologies (e.g., Spark, Airflow, BigQuery, Snowflake, Databricks, Chalk) and schema design
  • Experience with distributed systems, cloud infrastructure (AWS/GCP), and containerization (Docker/Kubernetes)
  • Track record of building scalable data systems and shipping production ML infrastructure
  • Ability to move quickly and handle competing priorities in a fast-paced environment

Preferred Qualifications

  • Experience building reinforcement learning training infrastructure: rollout generation, reward-model serving, or online/off-policy learning systems
  • Experience with high-performance inference and serving (vLLM, SGLang, TensorRT, or Triton) for both training-time rollouts and production
  • Experience building internal training or experimentation platforms used by research teams
  • Experience supporting A/B testing and experimentation workflows, including canary deployments and monitoring statistical significance
  • Familiarity with vision-language models (VLMs) or multimodal architectures
  • Experience with medical imaging formats (DICOM) and healthcare data standards
  • Familiarity with MLOps practices and model deployment pipelines
  • Experience with privacy-preserving data systems and HIPAA compliance

Job details

Published
July 31, 2026
Last checked
November 17, 2026
Job source
ashby
First seen
July 31, 2026
AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Epsilon Labs, Inc.

Similar jobs from this company

None listed.

Across the market

Similar jobs from other companies

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.