LiftmyCVLiftmyCV
RA

Inference Infrastructure Engineer

Rhoda aiOn-sitePalo Alto, US
AI job summary

Rhoda AI is seeking an Inference Infrastructure Engineer to build and operate systems powering their model deployment stack for humanoid robots. The role involves designing large-scale infrastructure, managing Kubernetes deployment pipelines, and optimizing resource scheduling across GPU clusters. Candidates should have at least 3 years of experience in ML infrastructure or distributed systems, along with proficiency in Kubernetes and cloud providers. This position offers a unique opportunity to contribute to cutting-edge robotics technology with a focus on machine learning and infrastructure scalability.

Job description

About Rhoda AI

At Rhoda AI, we're building the full-stack foundation for the next generation of humanoid robots, from high-performance, software-defined hardware to the foundational models and video world models that control it. Our robots are designed to be generalists capable of operating in complex, real-world environments and handling scenarios unseen in training.

Responsibilities

  • Design and operate large-scale infrastructure to run model workloads across cloud and on-prem environments
  • Build and maintain Kubernetes-based deployment pipelines for managing distributed ML workloads
  • Own resource scheduling and orchestration across GPU clusters — optimizing utilization, workload balancing, and cost-performance tradeoffs
  • Integrate and manage ML frameworks and model serving systems (e.g., Triton, Ray Serve, TorchServe) across research and production use cases
  • Build tooling for model deployment, versioning, and observability to support fast iteration cycles
  • Contribute to the reliability and scalability of the infrastructure stack as model complexity and deployment footprint grow

Requirements

  • 3+ years of experience in ML infrastructure, MLOps, or distributed systems
  • Strong proficiency with Kubernetes and containerized deployment pipelines
  • Experience with GPU orchestration and resource scheduling across large distributed jobs
  • Experience with cloud providers (e.g., AWS, GCP) and hybrid cloud/on-prem infrastructure
  • Familiarity with ML frameworks (e.g., PyTorch, JAX) and model serving tools (e.g., Triton, Ray Serve, TorchServe)
  • Strong debugging instincts and ownership mentality — comfortable driving issues to resolution across the stack

Nice to Have

  • Experience with streaming systems or high-throughput data transport (e.g., Kafka, gRPC, NATS)
  • Background in networking, low-latency systems, or network-aware scheduling
  • Experience with edge/cloud hybrid deployment patterns and the latency constraints that come with them
  • Familiarity with on-robot or embedded inference environments
  • Experience with large-scale cluster topology and scheduling systems (e.g., SLURM, Ray, Volcano)

Why This Role

  • Own the infrastructure layer that connects our foundation models to real robot behavior — a direct line between your work and what the robot does in the world
  • Be part of building the infrastructure stack for one of the most technically ambitious robotics companies in the world

Job details

Published
May 12, 2026
Last checked
November 17, 2026
Job source
ashby
Workplace
On-site · Palo Alto, US
First seen
May 12, 2026
AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Rhoda ai

Similar jobs from this company

None listed.

Across the market

Similar jobs from other companies

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.