
Member of Technical Staff - ML Platform Engineer
Preference Model is seeking a Member of Technical Staff to join their ML Platform team. In this role, you'll take ownership of integrations that deliver RL environments to partner labs, ensuring they meet lab requirements while automating delivery processes. You'll build and maintain the open-source framework and manage infrastructure across cloud platforms. The ideal candidate should have strong software engineering fundamentals, proficiency in Python, experience with containers and orchestration, and a background in production infrastructure or developer platforms. Competitive cash and equity compensation, along with benefits, are offered.
Job description
About Us
Preference Model is a superintelligence data research company. We build RL environments for training capable, better-aligned superintelligences. Almost every aspect of how a model behaves is shaped by the reward signals it's trained on. The biggest problem with AIs today is that they don't always do what we intend. Sometimes that's because they aren't capable enough, and sometimes it's because they aren't aligned. Both problems come down to the training objectives. We're trying to address both of these issues in the most direct, highest leverage way available to us, which today means researching how to build RL environments better, not just for the AIs of today but for the AIs as they will be when they outsmart us. Over the past year, we've built RL environments for several frontier labs, and we're backed by $16M in seed funding led by a16z. Our founding team has previous experience on Anthropic’s data team building data infrastructure, and datasets behind Claude.
About the Role
An RL environment is only useful once it runs reliably inside a lab's training stack. Every environment we build has to be packaged, sandboxed, run at scale, checked against each lab's requirements, and delivered in the format that lab's platform expects. Much of that work is still manual today, and it takes time away from the people designing environments. As an MTS on our ML Platform team, you will own the systems that take an environment from a builder's repo to a lab's training run. That includes Karotte, our open-source framework for defining RL environments, the internal platform that builds, runs, and reviews environments on CPU, GPU, and TPU, and the integrations that deliver them to each lab we work with. This is an engineering role where you will ensure what our Capabilities team builds runs and ships cleanly. You'll join a small Platform team and work directly with environment builders and post-training researchers. In your first six months, success looks like a delivery path to each partner lab that is mostly automated: tasks marked ready get built, validated against that lab's requirements, and packaged without hand work. Our needs change quickly, so you'll also pick up other platform and infrastructure work as priorities shift.
What You Will Do
- Own the integrations that deliver our environments to partner labs: build container images, match each lab's submission format, and automate the checks that confirm requirements are met before anything ships. Do the delivery work by hand where you have to, then automate it.
- Build and maintain Karotte, our open-source environment framework, from API design through releases and migrations that keep existing environments working.
- Run and scale the infrastructure that builds, runs, and grades environments, including containerized rollouts and grading across CPU, GPU, and TPU, VM-based sandboxing, and the resource limits and isolation that stop a model from gaming its own grader.
- Build the internal tools environment builders use every day (CLI, docs, data catalog, access controls, and run monitoring) so they spend their time on environment design instead of infrastructure.
- Partner with environment builders and post-training researchers to turn recurring pain points into platform features, and ship quickly in response to their feedback.
What We are Looking For
- Strong software engineering fundamentals and a track record of building and operating production infrastructure or developer platforms that other engineers depend on.
- Proficiency in Python, including writing libraries and APIs that other people build on.
- Hands-on experience with containers and orchestration (Docker, Kubernetes, or similar) and at least one major cloud platform (GCP, AWS, or similar).
- A working understanding of how to run untrusted code safely: isolation, resource limits, and what happens when a process fills the disk or refuses to exit.
- Extensive hands-on use of coding agents (Claude Code, Cursor, Codex, or similar), and an intuition for where models cut corners.
- You've owned something tedious end to end, such as a migration, a release process, or a delivery pipeline, and automated away as much of it as you could.
Nice to Have
- Experience building RL environments, eval harnesses, or agent benchmarks (Terminal-Bench, SWE-bench, or similar).
- Familiarity with RL post-training and inference stacks (verl, Ray, SkyPilot, vLLM, SGLang, or similar).
You may be a good fit if one of the following applies
- You've built sandbox or code-execution infrastructure (microVMs such as Firecracker, gVisor, or similar) at an infrastructure startup or frontier lab.
- You've been an early platform or infrastructure engineer at a startup and built the internal platform the rest of engineering relied on.
- You've worked as a forward deployed or integrations engineer, getting your company's software running inside customers' own environments.
- You've built developer tooling or internal platforms used by ML researchers, even outside a formal ML role.
- You've maintained an open-source developer framework with real external users.
What We Offer:
- Competitive cash and equity compensation (>90th percentile)
- Ownership and autonomy in a fast moving startup environment
- Opportunity to work alongside senior and staff engineers from frontier labs and infrastructure companies, plus top ML engineers
- Health, vision, dental, benefits
- 401K match
- Lunch provided everyday onsite
- Weekly snack orders
- Visa sponsorship & relocation support available
We value diverse perspectives and experiences. If you're excited about this role but don't check every box, we still encourage you to apply.
Job details
- Published
- October 27, 2026
- Experience
- Staff
- Job source
- ashby
- First seen
- October 27, 2026
Benefits
Competitive cash and equity compensation (>90th percentile). Ownership and autonomy in a fast moving startup environment. Opportunity to work alongside senior and staff engineers from frontier labs and infrastructure companies, plus top ML engineers. Health, vision, dental, benefits. 401K match. Lunch provided everyday onsite. Weekly snack orders. Visa sponsorship & relocation support available.
Skills mentioned in this job
LiftmyCV exclusive data
Preference Model hiring intelligence
Preference Model currently has 1 active jobs tracked by LiftmyCV. 1 new jobs in the past 7 days.
Active openings
1
Currently tracked by LiftmyCV
New in 7 days
1
1 new jobs in the past 30 days
Published salaries
—
Not published by this employer yet
Average opening age
6 days
Across 1 active opening
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • Technical Program Manager, GTM
As of November 17, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inVisa sponsorship insights
Visa sponsorship available
This job posting states that visa sponsorship is available for qualified candidates.
More at Preference Model
Similar jobs from this company
- Member of Technical Staff - ML Platform EngineerPreference ModelSan Francisco, US
- Member of Technical Staff - Research Engineer, RL EnvironmentsPreference ModelSan Francisco, US
- Member of Technical Staff - ML Infrastructure Engineer, RL Post-trainingPreference ModelSan Francisco, US
- Member of Technical Staff - Research Engineer, Post-trainingPreference ModelSan Francisco, US
- Technical Program Manager, GTMPreference ModelSan Francisco, US
Across the market
Similar jobs from other companies
- Member TechnicalBR Financial Solutions India Pvt Ltd - hydHyderabad, INOn-site
- Member TechnicalItiviti India Private LtdMumbai - Times Square - Andheri EastOn-site
- Senior Member TechnicalBR Financial Solutions India Pvt Ltd - hydBengaluru, INOn-site
- Member of Technical StaffCleraPalo Alto, USRemote$150,000–$230,000 per year
- Member of Technical StaffReasonable AILondon, GBHybrid
- Member of Technical StaffPerplexitySan Francisco, USOn-site
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.