Accounting Expert: AI Model Evaluation
Job description
About Huzzle Labs
Huzzle Labs partners with frontier AI labs to evaluate and improve frontier models through deep human expertise. Contributors directly assess advanced AI systems in their specialist fields, receive competitive compensation, and help define the standards used to measure model performance.
About the Role
Huzzle Labs is seeking experienced accountants to write realistic accounting tasks that test how well frontier AI systems handle accounting work. You will create prompts that are difficult enough for a frontier model to fail, then write a scoring rubric for each task so reviewers can assess the output consistently. A rubric is a list of objective, checkable criteria that a reviewer marks pass or fail. Your judgement helps define the standards used to measure model performance. This is an expert judgement role focused on realistic task design, careful review of model output and precise, consistent documentation. Training is provided. Prior AI training or data-annotation experience is required.
Responsibilities
- Write realistic accounting tasks: Create requests of the kind a client, controller or business owner would send, covering month-end close, bank and credit card reconciliations, AR/AP ageing, accruals and adjusting entries, sales tax, job costing and the clean-up of incomplete or inconsistent books.
- Build from real material: Review a deal room containing hundreds of files, select the relevant documents and use them to develop prompts and rubrics for tasks a frontier model struggles to complete correctly.
- Require usable deliverables: Each request should call for a working output, usually a spreadsheet, a journal entry schedule or a short memo.
- Test against a frontier model: Run each request and review the output with the care you would apply when signing off accounting work. Where the model succeeds, increase the difficulty until a genuine gap appears.
- Write scoring rubrics: Define objective criteria that another reviewer can apply without repeating your work, for example, “the reconciled ending balance equals $X” and “the $X deposit is recorded as a customer deposit liability, not revenue.”
- Apply guidelines consistently: Follow the task and rubric guidelines, flag ambiguous cases and help refine the criteria.
Job details
- Published
- October 20, 2026
- Last checked
- October 25, 2026
- Job source
- workable
- Workplace
- Remote · GB
- First seen
- October 20, 2026
LiftmyCV exclusive data
Huzzle hiring intelligence
Huzzle currently has 20 active jobs tracked by LiftmyCV. 12 new jobs in the past 7 days.
Verified October 25, 2026
Active openings
20
Currently tracked by LiftmyCV
New in 7 days
12
20 new jobs in the past 30 days
Published salaries
—
Not published by this employer yet
Average opening age
6 days
Across 20 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • Account Executive
- • Account Executive - B2B
- • Account Executive - Dutch
- • Account Executive - Dutch Speaker
- • B2B Sales Development Representative - Dutch Speaker
- • B2B Sales Development Representative - German Speaker
As of November 18, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Huzzle
Similar jobs from this company
- Account Executive - Go High Level (GHL)HuzzleBRRemote
- Business Development Executive - IT RecruitmentHuzzleZARemote
- Sales Development Representative - Italian SpeakerHuzzleITRemote
- Field Videographer & Post-Production SpecialistHuzzleUSRemote
- Sales Development Representative - German SpeakingHuzzleATRemote
- Sales Development Representative - German and English SpeakerHuzzlePTRemote
Across the market
Similar jobs from other companies
- Manager - Model EvaluationZooxFoster City, USHybrid
- Subject Matter Experts: ML Model Evaluation (PhD)Weekday AIUSRemote
- Subject Matter Experts: Machine Learning Model EvaluationTeracUSRemote
- Healthcare Subject Matter Expert (SME) - AI Model EvaluationVolga PartnersLondon, GBRemote
- Government Subject Matter Expert (SME) - AI Model EvaluationVolga PartnersUSRemote
- Pharmaceutical Subject Matter Expert (SME) - AI Model EvaluationVolga PartnersVietnam, EGRemote$41,600–$104,000 per year
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.