Research Engineer, Benchmarks
Clera is seeking a Research Engineer to join a team of elite professionals focused on creating benchmarks for evaluating advanced AI agents. This on-site role in San Francisco involves designing and implementing evaluations that are trusted by frontier labs and enterprise clients. The successful candidate will need strong skills in software engineering and a deep understanding of what makes benchmarks effective and reliable.
Job description
About the Role
Join a small, technically elite team — including International Olympiad medalists and published AI researchers — building high-quality benchmarks to evaluate frontier AI agents on realistic, domain-specific workflows. As a Research Engineer, Benchmarks, you'll own the design and implementation of evaluations that frontier labs and enterprise customers trust. This role is central to ensuring our benchmarks are rigorous, credible, and tightly aligned with real-world agent performance. This is an on-site role based in San Francisco, CA. Visa sponsorship is available.
What You'll Do
- Design, implement, and own the quality of internal benchmarks for evaluating frontier agents on domain-specific tasks.
- Partner with subject-matter experts to define realistic workflows and tasks for domain-specific evaluations.
- Build reliable infrastructure to run models and agents against benchmark tasks at scale.
- Develop metrics and analyses that measure benchmark difficulty, reliability, and failure modes.
- Validate that benchmark performance correlates with real-world evaluations, customer needs, and frontier lab expectations.
- Write clear documentation and benchmark reports that make results legible and credible to technical audiences.
What We're Looking For
Required
- 2–4 years of experience in software engineering, ML engineering, or research roles.
- Strong proficiency in Python, Docker, and Linux environments.
- Experience building environments, evaluations, or benchmarks for AI systems.
- Published research or technical writing on topics such as public benchmarks, model failure modes, or evaluation methodology.
- Deep understanding of what makes a benchmark realistic, reliable, and practically useful.
- Curiosity and genuine ability to understand how real-world workflows operate across diverse domains.
- Strong attention to detail — a habit of spotting subtle inconsistencies and edge cases in task design.
- Ability to reason from first principles about task design, scoring, and failure modes.
- Comfort thriving in unstructured problem spaces and working independently in fast-paced, early-stage environments.
- Excellent communication skills for collaborating across time zones and with technical teams.
Compensation & Benefits
- Salary: $150,000 – $250,000 USD annually, depending on experience.
- Visa sponsorship available.
- Opportunity for significant early-stage equity and career growth within a high-impact, research-driven team.
Location
This is a full-time, on-site position in San Francisco, CA. Candidates must be willing and able to work in-office.
Job details
- Published
- August 4, 2026
- Job source
- ashby
- First seen
- August 4, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inVisa sponsorship insights
Visa sponsorship available
This job posting states that visa sponsorship is available for qualified candidates.
More at Clera
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.