
Domain Expert, AI Evaluation Task Writer: Finance (Contract, Remote)
Patronus AI is seeking an independent contractor to design finance tasks that can challenge today's AI models. This remote role entails creating realistic scenarios based on task requests and includes working with evidence files related to treasury operations, audit assurance, trading, and equity administration. Candidates should have at least three years of relevant experience and possess strong skills in spreadsheet management and professional writing. The position demands a commitment of at least 10 hours per week with flexible scheduling. Competitive pay is offered based on task submissions.
Job description
About Patronus AI
Patronus AI is a frontier lab developing simulation research and infrastructure to accelerate progress toward human-aligned AGI. We are on a mission to simulate all of the world’s intelligence. We are the team behind some of the earliest and most influential research in AI evaluation like FinanceBench, Lynx,SimpleSafetyTests,CopyrightCatcher,Humanity’s Last Exam, and more. We are formerly AI researchers and engineers from companies like Meta AI, Amazon AGI, and Google. Our customers include foundation model labs and Fortune 500 enterprises like Adobe. We are backed by top-tier investors like Lightspeed Venture Partners, Notable Capital, Stanford University, Noam Brown, Gokul Rajaram, and more.
At a glance
- Engagement: Independent contractor, fully remote, asynchronous
- Pay: $50-150/hr for task authoring, paid when the full task is submitted, plus a potential bonus for each accepted task. Strong performers move up within that range or onto productivity-based pay. The trial task is paid.
- Commitment: 10+ hours per week
- Start: Rolling, as soon as you pass the trial task
- Location: Remote
The role
You'll design realistic finance tasks that a qualified professional could solve with the right knowledge and tools, and that today's AI models get wrong. Each task is built around a scenario we provide. You create the working documents someone in your role would actually handle, write the request, solve it yourself and define how the answer gets graded. Your work becomes evaluation and training data for frontier models. You don't need an AI background. You do need to be the kind of finance professional who catches the number that ties out but shouldn't.
Areas we're hiring for
- Treasury operations: cash positioning and liquidity management, daily cash operations and bank reconciliation, treasury analysis of accruals, exposures and discrepancies, and matching booked deals to counterparty confirmations and settlement records
- Audit and assurance: external, internal or government audit, technology assurance, and SOX and ITGC controls testing, from evidence and walkthroughs through workpapers, exceptions, findings and remediation
- Trading and portfolio operations: pre-trade compliance and clearance, execution trading from rebalance instructions, tickets and blotters, and reconciling positions, cash and holdings against instructions and constraints
- Equity administration: stock plan administration (grants, vesting, approvals and plan availability), equity plan analysis (share reserves, outstanding awards and fair-market-value inputs), and corporate paralegal work on board consents and equity transaction documents
What you'll do
- Build realistic evidence files from a provided scenario: bank statements and cash positions, deal confirmations and settlement records, trial balances and GL extracts, audit workpapers and control evidence, trade blotters and rebalance instructions, position and cash reconciliations, cap tables, grant records and board consents
- Write clear task requests that state what the deliverable is and how uncertainty and justified assumptions should be handled
- Solve each task end to end and document a reference solution with the reasoning behind every step
- Write explicit scoring criteria that let two independent graders reach the same verdict, including acceptable alternative answers
- Run tasks against current models, find where and why they fail, and adjust difficulty
- Check your own and peers' tasks for ambiguity, errors, answers exposed in the materials and shortcuts that skip the intended reasoning
- Incorporate reviewer feedback within agreed turnaround times and flag guideline gaps or edge cases you run into
Who we're looking for
Required
- 3+ years of hands-on experience in one or more of the four areas above: treasury operations, audit and assurance, trading and portfolio operations, or equity administration
- Working command of the standards, controls and rules in your area (for example US GAAP or IFRS, PCAOB/AICPA auditing standards and SOX, treasury policies and bank controls, trade compliance and restricted-list rules, equity plan documents and fair-market-value requirements)
- Strong spreadsheet skills, and the habit of tying every figure back to its source
- Clear, precise writing in professional English
- Ability to work independently and asynchronously against deadlines
Nice to have
- CPA, CA, ACCA, CISA, CTP, CFA or CEP
- Big Four, public company, bank, asset manager or fund experience
- Experience with the systems used in your area, such as SAP Treasury or another treasury management system, Bloomberg, AIM or EMSX, or Carta or Shareworks
- Prior experience writing or reviewing AI evaluation tasks, exam questions, case studies or training material
- Familiarity with how AI models fail (hallucinated figures, confident arithmetic errors, misread documents)
Our standards
- All tasks, documents and solutions are human-authored. LLM-generated content is not permitted.
- Tasks and solutions must be original. Nothing may be copied from published or easily searchable sources.
- Never use real client, employer or personal data. All scenarios are fictional.
- Quality is judged on accuracy, rubric validity, difficulty and reviewer agreement, not volume.
How hiring works
- Short AI interview and resume review
- One paid trial task, scored against a fixed quality checklist
- Onboarding and your first project
We aim to make a decision within two weeks of your application. Patronus AI is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics. By clicking ‘Apply’, you agree to Greenhouse's Terms of Service and Privacy Policy. By clicking 'Apply', you agree to Patronus AI, Inc. Privacy Policy.
Job details
- Published
- October 15, 2026
- Last checked
- November 17, 2026
- Job source
- greenhouse
- Workplace
- Remote · US
- First seen
- October 21, 2026
Skills mentioned in this job
LiftmyCV exclusive data
Patronus AI, Inc. hiring intelligence
Patronus AI, Inc. currently has 12 active jobs tracked by LiftmyCV. 2 new jobs in the past 7 days.
Verified November 17, 2026
Active openings
12
Currently tracked by LiftmyCV
New in 7 days
2
6 new jobs in the past 30 days
Published salaries
50%
Median disclosed salary: $208,000
Average opening age
22 days
Across 12 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • Domain Expert, AI Evaluation Task Writer
- • Domain Expert, AI Evaluation Task Writer: Finance (Contract, Remote)
- • Domain Expert, AI Evaluation Task Writer: Healthcare (Contract, Remote)
- • Domain Expert, AI Evaluation Task Writer: Legal (Contract, Remote)
- • Domain Expert, AI Evaluation Task Writer: Sales (Contract, Remote)
- • Expert Manager (Contract, Remote)
Frequently requested skills
Median disclosed salary: $208,000 · 50% of jobs publish a salary
As of November 16, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Patronus AI, Inc.
Similar jobs from this company
- Expert Support ManagerPatronus AI, Inc.San Francisco, USOn-site$104,000–$312,000 per year
- Expert: Interactive Coding, Payments Processing (Contract, Remote)Patronus AI, Inc.USRemote
- Growth Associate (Contract, Remote)Patronus AI, Inc.USRemote
- Domain Expert, AI Evaluation Task Writer: Sales (Contract, Remote)Patronus AI, Inc.USRemote$104,000–$312,000 per year
- Domain Expert, AI Evaluation Task WriterPatronus AI, Inc.USRemote$100,000–$300,000 per year
- Expert Manager (Contract, Remote)Patronus AI, Inc.USRemote$104,000–$312,000 per year
Across the market
Similar jobs from other companies
- Professional Domain Explainers (Paid Data Task, Remote, Contract)Kled AIGBRemote
- Domain ExpertKyndryl Solutions Private LimitedBangalore, INHybrid
- Domain ExpertRA Ltd. UK (GBR)Kiln Farm, England, United KingdomOn-site
- Domain ExpertRegal-Beloit Asia Pte. Ltd.Singapore, SGOn-site
- Domain ExpertBuild TechnologiesRemote, USRemote
- Domain ExpertDaviesViman Nagar – Pune, INOn-site
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.