Member of Technical Staff, ML Evaluation
Cognita Imaging seeks a Member of Technical Staff for ML Evaluation to assess the performance of radiology AI models in real-world settings. The role involves evaluating complex models, designing investigations, and identifying errors. Candidates should have experience in machine learning evaluation, strong analytical skills, and be comfortable working in ambiguous situations. The company values collaboration, meritocracy, and direct feedback, and is located in the San Francisco Bay Area, emphasizing in-person teamwork to enhance efficiency and relationship building.
Job description
About Cognita
Cognita’s mission is to increase the world’s access to healthcare. Radiology is (1) the first-line diagnostic specialty, (2) facing a worsening global workforce shortage, and (3) highly digitized, making it uniquely positioned for AI to have an enormous impact. Stage one of Cognita is focused on expanding access to radiology at scale. Our founding team met at Stanford, where they laid the groundwork for applying comprehensive AI to radiology. Building on that foundation, Cognita develops vision-language models that read radiology studies the way radiologists do - interpreting the full study in clinical context - and generate draft results that make radiologists more efficient and accurate. In partnership with Radiology Partners, Cognita’s models are trained and validated on one of the world’s largest real-world radiology datasets.
About the Role
As a Member of Technical Staff focused on ML Evaluation, you will be responsible for understanding how well Cognita’s radiology models perform in real-world settings. Your work will focus on evaluating complex multimodal models, identifying failure modes, and designing investigations that reveal where and why models succeed or fall short.
Your Impact
- Evaluate large, complex ML models across a wide range of real-world cases and clinical scenarios.
- Design investigations to understand model behavior beyond standard metrics.
- Analyze model outputs to identify systematic errors and blind spots.
- Develop evaluation frameworks and methodologies for multimodal and generative models.
- Partner with ML training and infrastructure teams to guide model improvement.
- Work with clinicians to incorporate domain context where needed and validate findings.
- Communicate clearly about model limitations, risks, and readiness for deployment.
What You Bring
- We are not credential-driven. We only look for evidence of exceptional ability.
- Experience evaluating complex machine learning models, including identifying strengths, weaknesses, and failure modes.
- Strong analytical judgment and the ability to design focused investigations into model behavior.
- Comfort working in ambiguous environments where the right evaluation approach is not obvious upfront.
- Ability to collaborate closely with ML engineers and researchers to translate evaluation findings into action.
- Clear written and verbal communication skills.
What Sets You Apart
- Biomedical, medical imaging, or healthcare-related experience.
- Familiarity with radiology or healthcare workflows.
- Experience evaluating large language models or multimodal systems.
Our Culture
- We’re an in-person team based in the San Francisco Bay Area. Working together every day helps us move faster, learn from each other, and build strong relationships. We believe the best work happens when great people are in the same room.
- We build from first principles. We question assumptions, reason from fundamentals, and execute with speed and clarity, without sacrificing quality.
- We operate as a true meritocracy. Impact matters, rather than optics. Feedback is direct, respect is non-negotiable, and we support each other with the ownership, trust, and resources needed to do the best work of our careers.
- Every decision we make is grounded in supporting clinicians to improve patient outcomes.
Job details
- Published
- November 18, 2025
- Job source
- ashby
- Workplace
- On-site · Palo Alto, US
- First seen
- June 6, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Cognita Imaging Inc.
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.