Research Scientist - Post Training
AfterQuery is seeking a Research Scientist to validate the effectiveness of their training data through rigorous experiments. The position focuses on designing training experiments to measure dataset impacts on model behavior while collaborating with partner labs. Key responsibilities include running controlled experiments, quantifying performance lift, and communicating findings effectively. Candidates should have a solid understanding of LLM methodologies and a passion for data quality in model training. Total compensation ranges from $250k to $450k, including equity.
Job description
About AfterQuery
AfterQuery builds the training data and evaluation infrastructure that frontier AI labs use to make their models better. We work with the world's leading labs to design high signal datasets and run rigorous evaluations that go beyond static benchmarks. We are a small, early team (post Series A) where individual contributors have a direct impact on how the next generation of models learn and improve.
The Role
Your job is to prove that our data works. You will design and run training experiments that isolate the impact of our datasets on model behavior. This includes SFT and RL-based post-training, where you’ll measure how different data sources shift capability, generalization, and alignment. Working closely with partner labs, you will turn our datasets into clear, defensible evidence: this data → this improvement → under these conditions. This is experimental, high-leverage work.
What You'll Do
- Run controlled SFT and RL experiments to measure the impact of our datasets on model performance.
- Quantify lift across capabilities (reasoning, tool use, long-horizon tasks, domain-specific workflows).
- Communicate your findings with partner labs to help drive sales.
- Work with internal SPLs to iterate on data quality based on your results.
What We're Looking For
- Strong familiarity with LLM training and evaluation methodologies.
- Genuine obsession with how data structure, selection, and quality drive model behavior.
- Ability to design lightweight experiments, move fast, and extract actionable insights from messy results.
- Comfort working across domains (you'll touch finance, software engineering, policy, and more).
- A bias toward building over theorizing.
- Great candidates are undergrad research or master's research (but haven't done a phd).
Compensation Structure
$250k-450k total compensation + equity
Job details
- Published
- April 14, 2026
- Job source
- ashby
- Workplace
- Remote · San Francisco, US
- First seen
- April 14, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at AfterQuery
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.