
Research Scientist, Benchmarks & Evals
Kled AI is looking for a Research Scientist specializing in Benchmarks & Evaluations to develop benchmarks for their human data network. The role involves designing public benchmarks, running experiments, and publishing reports that influence AI models. Candidates should have over 3 years of experience in ML research, strong hands-on training in image or video models, and a deep understanding of experimental design. This is an exciting opportunity to build influential benchmarks and contribute to next-gen AI data infrastructure.
Job description
ABOUT KLED
Kled is building the largest opt-in human data network in the world. We are not a labeling firm. We are not a task marketplace. We are a consumer application where people upload their real photos, videos, and documents and get paid continuously. We then filter, standardize, and license that data to frontier AI labs and enterprises that need fresh, rights-aware training data.
Since launching our mobile app in 2026, we have:
- Reached #1 on the App Store (Finance) with 0 paid marketing
- Scaled to 600,000+ active data contributors
- Processed 5M uploads per day
- Raised $15M+ from investors behind SpaceX, Airbnb, Coinbase, xAI, OpenAI, Anthropic, Spotify, Lyft, Uber, and more
Our mission is to let anyone download the app and earn a real living wage from uploading their data. ABOUT THE ROLE Research Scientist - Benchmarks & Evals AI labs buy data when a benchmark shows it works. You’ll build the benchmarks that show what one of the largest human data networks in the world can do for frontier AI models.
You will:
- Design and ship public benchmarks for image, video and document models
- Build private test sets from real, opt-in data that no model has trained on
- Run data-value experiments: train models with and without Kled data, measure what changes
- Design human evaluation studies and the automatic metrics that track them
- Publish leaderboards and reports that researchers at frontier labs trust
- Find where models fall short and tell our team what data to collect next
- Work directly with the founders and lab buyers to turn results into data deals
WE’RE LOOKING FOR
- 3+ years ML research or research engineering experience
- A benchmark or evaluation you built that other people actually used
- Strong hands-on experience training and fine-tuning image or video models (PyTorch)
- Deep understanding of experimental design and statistics (controls, ablations, human studies)
- Experience running experiments end to end, from GPUs to final report
- Clear writing for both researchers and buyers
Bonus:
- Publications at NeurIPS, ICML, ICLR or CVPR (datasets and benchmarks especially)
- Experience on an evaluation or data team at an AI lab
- Experience selling or licensing data to AI labs
- Experience with data valuation or data attribution research
CURRENT STACK Research
- Python / PyTorch
- Open-weight image and video models
- Cloud GPUs
Data
- Hundreds of millions of opt-in photos, videos and documents
- PostgreSQL (Supabase)
- S3 storage
COMPENSATION
- Base salary: $150,000 - $250,000
- $350,000 – $750,000 equity
We move fast and work hard. If you're excited to build the benchmarks that decide what data trains frontier AI, let’s talk!
GROWTH OPPORTUNITY
You’ll join a team operating at the frontier of applied AI data infrastructure.
In this role, you’ll have the opportunity to:
- Own core systems that power one of the largest human data networks in the world
- Design infrastructure that directly influences what data trains next-generation AI models
- Build at real scale - millions of uploads per day, adversarial environments, global contributors
- Ship alongside a team that has built marketplaces, AI systems, and products used by millions
If you’re excited to move fast, build systems that matter, and help define how human data powers frontier AI, let’s talk.
Responsibilities
You will: Design and ship public benchmarks for image, video and document models; Build private test sets from real, opt-in data; Run data-value experiments; Design human evaluation studies and metrics; Publish leaderboards and reports; Find and advise on data needs.
Job details
- Published
- October 12, 2026
- Last checked
- November 17, 2026
- Job source
- ashby
- Workplace
- Remote · US
- First seen
- October 12, 2026
Requirements
3+ years ML research or research engineering experience; A benchmark or evaluation you built that others used; Strong experience training and fine-tuning image or video models (PyTorch); Deep understanding of experimental design; Clear writing for researchers and buyers.
Skills mentioned in this job
LiftmyCV exclusive data
Kled AI hiring intelligence
Kled AI currently has 1 active jobs tracked by LiftmyCV. 0 new jobs in the past 7 days.
Verified November 17, 2026
Active openings
1
Currently tracked by LiftmyCV
New in 7 days
0
0 new jobs in the past 30 days
Published salaries
100%
Median disclosed salary: $200,000
Average opening age
37 days
Across 1 active opening
Workplace breakdown
Hiring countries
Most in-demand roles
- • Research Scientist, Benchmarks & Evals
Frequently requested skills
Median disclosed salary: $200,000 · 100% of jobs publish a salary
As of November 18, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Kled AI
Similar jobs from this company
- Speak Mixing Two Languages (Paid Data Task, Remote, Contract)Kled AIVietnam, SGRemote
- Speak in a Less Common Language (Paid Data Task, Remote, Contract)Kled AIVNRemote
- Suspected Fake or Altered Receipts (Paid Data Task, Remote, Contract)Kled AIGBRemote
- Suspected AI Profile Photos (Paid Data Task, Remote, Contract)Kled AIGBRemote
- Street and Shop Signs (Paid Data Task, Remote, Contract)Kled AIVietnam, MYRemote
- Store Shelves (Paid Data Task, Remote, Contract)Kled AIVNRemote
Across the market
Similar jobs from other companies
- AI Evals/Benchmarking EngineerActivate Interactive Pte LtdSingapore, SGOn-site
- Research Scientist, APEX BenchmarksMercorSan Francisco, US
- Research, EvalsExaSan Francisco, California
- Expert Talent Pool, Evals and BenchmarksCleraremoteRemote$156,000–$364,000 per year
- Research Scientist, Agentic Data & BenchmarkingInstitute of Foundation ModelsSunnyvale, USOn-site$150,000–$450,000 per year
- Research Engineer / Scientist, Data & EvalsHarveyLondon, GBRemote$230,000–$450,000 per year
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.