LiftmyCVLiftmyCV

Expert Talent Pool, Evals and Benchmarks (Associate)

CleraRemoteremote$62,400–$124,800 per year
AI job summary

Join a specialized talent pool focused on human-data projects that evaluate AI models. This role involves designing assessments to measure AI capabilities, developing rubrics for evaluation, and analyzing model outputs. Candidates should have 0-5 years of professional experience, ideally in QA, assessment design, or data analysis. Familiarity with tools for evaluation and strong written communication skills are essential. Position is fully remote.

Job description

About the Role

Join a specialist talent pool supporting human-data projects that evaluate AI models. You will help design and run assessments that measure model capabilities and contribute to AI safety and capability research.

What You'll Do

  • Write questions and tasks that isolate and test specific model capabilities.
  • Develop rubrics that define strong, partial, and poor answers.
  • Create reference answers and edge cases to challenge AI models.
  • Grade model outputs against rubrics and explain scoring decisions.
  • Analyze failed answers, group error patterns, and document findings.
  • Compare multiple models using identical prompts.
  • Validate benchmarks and flag compromised or ineffective questions.
  • Participate in small user studies evaluating ratings or interactions with model outputs.

What We're Looking For

  • Zero to five years of professional experience.
  • Experience in QA or test engineering, assessment design, psychometrics, UX research, data analysis, ML evaluation, research support, or relevant subject-matter work involving question writing.
  • Experience writing test cases, exam questions, rubrics, or evaluation tasks, and reviewing work consistently against written criteria.
  • Comfort using spreadsheets or Python to organize and analyze results, and identifying and documenting error patterns.
  • Experience with evaluation tools such as Inspect, lm-eval-harness, HELM, or promptfoo is useful.
  • Clear written communication and the ability to compare AI model outputs or participate in user and rating studies.

Compensation & Benefits

Compensation is $30 to $60 per hour, depending on project, field, and experience. Payment is for hours worked.

Location

Fully remote. Projects typically last from one week to several months.

Job details

Published
November 15, 2026
Job source
ashby
Workplace
Remote · remote
First seen
November 15, 2026

Skills mentioned in this job

QAtest engineeringassessment designpsychometricsUX researchdata analysisML evaluation

LiftmyCV exclusive data

Clera hiring intelligence

Clera currently has 77 active jobs tracked by LiftmyCV. 77 new jobs in the past 7 days.

Active openings

77

Currently tracked by LiftmyCV

New in 7 days

77

77 new jobs in the past 30 days

Published salaries

61%

Median disclosed salary: $119,600

Average opening age

1 days

Across 77 active openings

Workplace breakdown

Remote100%
Hybrid0%
On-site0%

Hiring countries

Germany
United States of America
Austria
Switzerland

Top hiring cities

Berlin
San Francisco
Munich
New York
Vienna
Hamburg
Karlsruhe

Most in-demand roles

  • • Account Executive
  • • Deployment Strategist
  • • Founding GTM Lead
  • • Founding Harness Engineer
  • • Founding Product Engineer
  • • Founding Software Engineer

Frequently requested skills

Python
TypeScript
React
AWS
AI agents
Azure
CVAT
GCP

Median disclosed salary: $119,600 · 61% of jobs publish a salary

As of November 17, 2026

CLERA GmbH · ACTIVE

Hiring insights calculated from active jobs tracked by LiftmyCV.

Company information from GLEIF.

AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Clera

Similar jobs from this company

Across the market

Similar jobs from other companies

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.