
Expert Talent Pool, Evals and Benchmarks (Associate)
Join a specialized talent pool focused on human-data projects that evaluate AI models. This role involves designing assessments to measure AI capabilities, developing rubrics for evaluation, and analyzing model outputs. Candidates should have 0-5 years of professional experience, ideally in QA, assessment design, or data analysis. Familiarity with tools for evaluation and strong written communication skills are essential. Position is fully remote.
Job description
About the Role
Join a specialist talent pool supporting human-data projects that evaluate AI models. You will help design and run assessments that measure model capabilities and contribute to AI safety and capability research.
What You'll Do
- Write questions and tasks that isolate and test specific model capabilities.
- Develop rubrics that define strong, partial, and poor answers.
- Create reference answers and edge cases to challenge AI models.
- Grade model outputs against rubrics and explain scoring decisions.
- Analyze failed answers, group error patterns, and document findings.
- Compare multiple models using identical prompts.
- Validate benchmarks and flag compromised or ineffective questions.
- Participate in small user studies evaluating ratings or interactions with model outputs.
What We're Looking For
- Zero to five years of professional experience.
- Experience in QA or test engineering, assessment design, psychometrics, UX research, data analysis, ML evaluation, research support, or relevant subject-matter work involving question writing.
- Experience writing test cases, exam questions, rubrics, or evaluation tasks, and reviewing work consistently against written criteria.
- Comfort using spreadsheets or Python to organize and analyze results, and identifying and documenting error patterns.
- Experience with evaluation tools such as Inspect, lm-eval-harness, HELM, or promptfoo is useful.
- Clear written communication and the ability to compare AI model outputs or participate in user and rating studies.
Compensation & Benefits
Compensation is $30 to $60 per hour, depending on project, field, and experience. Payment is for hours worked.
Location
Fully remote. Projects typically last from one week to several months.
Job details
- Published
- November 15, 2026
- Job source
- ashby
- Workplace
- Remote · remote
- First seen
- November 15, 2026
Skills mentioned in this job
LiftmyCV exclusive data
Clera hiring intelligence
Clera currently has 77 active jobs tracked by LiftmyCV. 77 new jobs in the past 7 days.
Active openings
77
Currently tracked by LiftmyCV
New in 7 days
77
77 new jobs in the past 30 days
Published salaries
61%
Median disclosed salary: $119,600
Average opening age
1 days
Across 77 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • Account Executive
- • Deployment Strategist
- • Founding GTM Lead
- • Founding Harness Engineer
- • Founding Product Engineer
- • Founding Software Engineer
Frequently requested skills
Median disclosed salary: $119,600 · 61% of jobs publish a salary
As of November 17, 2026
CLERA GmbH · ACTIVE
Hiring insights calculated from active jobs tracked by LiftmyCV.
Company information from GLEIF.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Clera
Similar jobs from this company
- Account ExecutiveCleraChicago, USRemote$160,000–$200,000 per year
- Enterprise Account ExecutiveCleraMunich, DE
- Founding Electrical EngineerCleraSan Francisco, US$160,000–$200,000 per year
- Founding Customer Success ManagerCleraBerlin, DE$64,500–$75,500 per year
- Founding Account ExecutiveCleraBerlin, DE
- Founder's Associate Intern (GTM)CleraBerlin, DE
Across the market
Similar jobs from other companies
- AI Evals/Benchmarking EngineerActivate Interactive Pte LtdSingapore, SGOn-site
- Research Scientist, Benchmarks & EvalsKled AIUSRemote$150,000–$250,000 per year
- Global benchmarking expertNovartis Healthcare Private LimitedHyderabad (Office)Hybrid
- Talent PoolLaba GroupWarsaw, PLOn-site
- Talent PoolWINGS ICT SOLUTIONS S.A.Athens, GROn-site
- Talent PoolKasamaTELECOMMUTE, PhilippinesRemote
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.