Scientific Evals
Edison Scientific seeks an ambitious individual with a strong scientific background to develop benchmarks and datasets enhancing AI capabilities in biology. This on-site role in San Francisco combines biology, data curation, and machine learning, ideal for candidates with deep scientific training eager to impact AI-driven scientific discovery. Responsibilities include designing rigorous benchmarks, curating datasets, analyzing model outputs, collaborating with AI researchers, and managing workflows. A competitive salary and benefits package is offered, fostering a supportive environment for creativity and collaboration.
Job description
About
Edison Scientific builds and commercializes AI agents for science. Scientific discovery moves too slowly, and autonomous AI agents are how we intend to fix that. We're assembling a team of top researchers and engineers across AI and biology to build an AI scientist.
Role
We are seeking an ambitious, scientifically grounded person to join our team focused on developing rigorous benchmarks and training datasets that advance AI capabilities in biology. This role sits at the intersection of biology, data curation, and machine learning, and is ideal for someone with deep scientific training who is excited to shape how frontier AI systems learn to do science. This role is on-site at our San Francisco office in the Dogpatch neighborhood. Our office is a converted warehouse with high ceilings, open space, and a team that genuinely believes in what they're building. This position is part of the Evals team.
Responsibilities
- Design benchmarks that capture the complexity of real biological research, drawing on your domain expertise to identify what makes scientific reasoning hard. This will include open-ended scientific benchmarks and building on prior work like LAB-Bench and BixBench.
- Curate and vet biological datasets to ensure scientific rigor.
- Analyze model outputs, identify failure modes, and contribute to iterative improvements in both datasets and evaluation criteria.
- Collaborate with AI/ML researchers to translate scientific intuition into training signal, helping AI systems learn not just facts but how scientists think.
- Coordinate operations and manage workflows, including working with domain experts, tracking task progress, and maintaining documentation.
Qualifications
- Graduate-level training in biology, biochemistry, computational biology, or a related field, with hands-on research experience.
- Working knowledge of machine learning concepts, particularly deep learning and large language models.
- Comfortable with Python and building workflows for data processing, analysis, and experimentation.
- Possess strong scientific taste and able to identify what distinguishes expert-level reasoning from surface-level pattern matching.
- Detail-oriented and willing to take on high-value but occasionally tedious work.
- Energized by ambiguous, open-ended problems that require creativity, collaboration, and first-principles thinking to solve.
- Organized and communicative, able to manage multiple workstreams and coordinate across teams.
Bonus points for
- Prior experience creating evaluation datasets, annotation guidelines, or working on human-in-the-loop data pipelines.
- Experience with bioinformatics pipelines, biological databases, or sequence analysis tools.
- Hands-on experience fine-tuning or evaluating large language models, or familiarity with RLHF and preference-based training.
- Publications or research experience in areas relevant to AI for science.
Salary
$160,000 - $300,000 • Offers equity
Why join us?
- Competitive salary and equity
- Full healthcare coverage — we pay 100% of premiums for you and your dependents
- Support for growing families, including a yearly new parent stipend and fertility coverage through Carrot
- 401(k) company matching
- $300 health and wellness benefit
- Lunch is on us every day you're in the office, and dinner is on us when you're working late
- Regular team offsites and company events
- A fast-moving, mission-driven culture where smart people do their best work and actually enjoy doing it
Job details
- Published
- December 18, 2025
- Job source
- ashby
- Workplace
- On-site · San Francisco, US
- First seen
- April 4, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Edison Scientific
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.