Principal Machine Learning Engineer
We are seeking a Principal Machine Learning Engineer to lead the design and evolution of critical ML systems. This hands-on role focuses on architecting large-scale ML systems, managing production deployments, and promoting best practices across teams. The ideal candidate will have strong experience in AI, deep learning, and modern ML frameworks. Responsibilities include building training pipelines, designing inference systems, and ensuring reliable ML operations. This position is fully remote, offering a chance to work with innovative technologies and contribute to impactful projects.
Job description
Role Overview
As a Principal Machine Learning Engineer, you are a deep technical authority responsible for designing and evolving the most critical ML systems in the company. The Principal Machine Learning Engineer will operate across training, inference, evaluation, and infrastructure, solving the hardest architectural and performance problems. While Technical Leads may own execution at the team level, you set the technical standard and shape how ML systems are built across the organization. This is a hands-on, high-impact role focused on depth. This position is 100% Remote.
Responsibilities
- Architect and build large-scale ML systems spanning data, training, evaluation, inference, and deployment.
- Design reproducible, high-performance training pipelines across GPU infrastructure.
- Architect inference systems that balance latency, throughput, cost, and reliability at scale.
- Design and maintain data systems for high-quality synthetic and real-world training data.
- Implement evaluation pipelines covering performance, robustness, safety, and bias, in partnership with research leadership.
- Own production deployment, including GPU optimization, memory efficiency, latency reduction, and scaling policies.
- Collaborate closely with application engineering to integrate ML systems cleanly into backend, mobile, and desktop products.
- Make pragmatic trade-offs and ship improvements quickly, learning from real usage.
- Work under real production constraints: latency, cost, reliability, and safety.
Outcomes
- ML systems (training, inference, evaluation) are reliable, scalable, and meet defined performance targets.
- Models deployed to production achieve measurable quality improvements and meet user-impact goals.
- Production issues are proactively monitored, debugged, and resolved with clear root-cause analysis.
- Team and cross-functional collaborators benefit from clear guidance, best practices, and scalable ML solutions.
- Research-to-production cycles are efficient, safe, and continuously improve the product experience.
Qualifications
- Strong background in deep learning and transformer-based architectures.
- Artificial Intelligence (AI) experience required.
- Hands-on experience training, fine-tuning, or deploying large-scale ML models in production.
- Proficiency with at least one modern ML framework (e.g. PyTorch, JAX), and ability to learn others quickly.
- Experience with distributed training and inference frameworks (e.g. DeepSpeed, FSDP, Megatron, ZeRO, Ray).
- Strong software engineering fundamentals; you write robust, maintainable, production-grade systems.
- Experience with GPU optimization, including memory efficiency, quantization, and mixed precision.
- Comfort owning ambiguous, zero-to-one ML systems end-to-end.
- A bias toward shipping, learning fast, and improving systems through iteration.
- Experience with LLM inference frameworks such as vLLM, TensorRT-LLM, or FasterTransformer.
- Contributions to open-source ML or systems libraries.
- Background in scientific computing, compilers, or GPU kernels.
- Experience with RLHF pipelines (PPO, DPO, ORPO).
- Experience training or deploying multimodal or diffusion models.
- Experience with large-scale data processing (Apache Arrow, Spark, Ray).
Benefits
Benefits include medical insurance, dental, vision, savings plan options, PTO, etc.
Job details
- Published
- July 9, 2026
- Job source
- smartrecruiters
- Workplace
- Remote · San Francisco, US
- First seen
- July 9, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Ginas Tech Jobs
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
- Principal Machine Learning EngineerWiser SolutionsVarious, CARemote$155,000–$170,000 per year
- Principal Machine Learning EngineeriherbRemote, USRemote$205,000–$230,000 per year
- Principal Machine Learning EngineerEdison ScientificSan Francisco, USOn-site$275,000–$350,000 per year
- Principal Machine Learning EngineerLimeCanadaRemote
- Principal Machine Learning EngineerBjakSingapore, SGRemote
- Principal Machine Learning EngineerZINC Zillow, Inc.USRemote$194,200–$326,600 per year
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.