Research Engineer/Scientist
Job description
About Us
Preference Model is building the next generation of training data to power the future of AI. Today's models are powerful but fail to reach their potential across diverse use cases because so many of the tasks that we want to use these models for are outside of their training data distribution. Preference Model creates reinforcement learning environments that encapsulate real-world use cases, enabling AI systems to practice, adapt, and learn from feedback grounded in reality. We seek to bring the real world into distribution for the models. Our founding team has previous experience in building the data infrastructure, tokenizers behind the Claude model. We are partnering with leading AI labs to push frontier of capabilities.
About the Role
Models of the future will be able to train themselves on tasks that they are not good. We’re interested in investigating how far we can push the boundaries of self-directed learning. We’re looking for people to push the frontier of post-training on large language models in a role that blends research and engineering, requiring you to implement novel approaches and shape research directions.
Representative projects:
- Architect and optimize core reinforcement learning infrastructure, from clean training abstractions to distributed experiment management. Help scale our systems to handle increasingly complex research workflows.
- Design, implement, and test training environments, evaluations, and methodologies for RL agents.
- Drive performance improvements through profiling, optimization, and benchmarking. Implement efficient caching and debug distributed systems to accelerate training and evaluation.
- Collaborate across research and engineering teams to develop automated testing frameworks, design clean APIs, and build scalable infrastructure that accelerates AI research.
You may be a good fit if you:
- Are proficient in Python and PyTorch or Jax
- Have industry experience in training and doing ML research on LLMs
- Can balance research exploration with engineering implementation
- Enjoy pair programming and care about code quality, testing, and performance
- Have strong systems design and communication skills
- Have good understanding of RL algorithms and follow current publications
Strong candidates may:
- have experience with LLM agent designs
- have worked with virtualization and sandboxed code execution environments
- know Kubernetes
- have experience in distributed systems or high-performance computing
Candidates don't need a PhD or extensive publications. Some of the best researchers have no formal ML training and gained experience building industry products. We believe adaptability combined with exceptional communication and collaboration skills are the most important ingredients for successful startup research. We are backed by a Tier 1 VC. We offer competitive base salary as well as generous equity (>90th percentile).
Job details
- Published
- September 18, 2025
- Job source
- ashby
- First seen
- January 16, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Preference Model
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.