Chief Assessment Officer (The ABA)
The American Board of Anesthesiology seeks a Chief Assessment Officer to lead innovation in assessment, credentialing, and certification programs. This role encompasses overseeing the assessment lifecycle and guiding the organization toward a digital-first framework by integrating advanced technologies. You will be a key member of the Executive Leadership Team, shaping enterprise strategies while managing a diverse team. Candidates should possess a doctoral degree and at least 10 years of relevant experience in psychometrics and high-stakes assessments. A collaborative approach and strong leadership are essential for success in this position.
Job description
Chief Assessment Officer Raleigh, North Carolina Hybrid schedule with a minimum of two days per week on-site
Reports to the Executive Director
Help shape the future of physician assessment and certification. The American Board of Anesthesiology (ABA) seeks a Chief Assessment Officer (CAO) to lead the science, strategy, and innovation behind its assessment, credentialing, and certification programs. This is an opportunity for an accomplished psychometric expert and executive leader to advance how physician knowledge and performance are evaluated by combining scientific rigor, emerging technology, and a commitment to high-quality patient care. Since 1938, the ABA has served the anesthesiology profession through certification. Today, the organization is building on that foundation with an innovative approach to assessment and continuous professional development. Its mission is to advance the highest standards of anesthesiology practice and help physicians provide the best possible care for every patient, every day.
The Opportunity
As a member of the Executive Leadership Team, the CAO will help shape enterprise strategy while overseeing the development, validation, delivery, and continuous improvement of the ABA’s assessment portfolio. The role leads approximately 33 staff through three direct reports across Assessment Development, Psychometrics and Research, Credentialing, and Assessment Delivery. The incoming leader will help guide the ABA toward a digital-first assessment ecosystem by exploring artificial intelligence, adaptive approaches, simulation, and assessment methods that extend beyond traditional multiple-choice examinations. Success requires recognized credibility in measurement science and the executive judgment to translate innovation into valid, reliable, fair, and accessible certification programs. This leader must think beyond departmental priorities, collaborate across the organization, and build trust with physician leaders, governing board members, and an experienced multidisciplinary team.
What You Will Lead
- Enterprise strategy and assessment innovation. Partner with the Executive Leadership Team and Board of Directors to shape long-range priorities, evolve certification models, and identify approaches that strengthen the ABA’s mission and physician experience.
- Assessment and psychometric excellence. Oversee the complete assessment lifecycle, including examination design, development, administration, psychometric analysis, scoring, and reporting.
- Credentialing and continuing certification. Lead the credentialing and continuing certification enterprise, ensuring that eligibility, certification status, pathway requirements, and diplomate services are integrated with assessment strategy and program operations.
- Research leadership. Direct validation and research efforts that evaluate program effectiveness, inform organizational decisions, and advance the ABA’s contributions to assessment and medical education.
- Responsible technology advancement. Partner with technology leaders to establish platform requirements and investment priorities, including the validation, governance, and ethical use of artificial intelligence in assessment development and scoring.
- Operational and financial performance. Oversee budgets, vendors, resource planning, quality measures, and process improvements that support secure, scalable, and efficient assessment delivery.
- Talent and organizational leadership. Develop high-performing leaders and teams, guide change thoughtfully, and foster a culture of collaboration, inclusion, accountability, and continuous learning.
The Leader We Seek
The successful candidate will bring deep expertise in psychometrics and high-stakes assessment, along with the ability to lead at the enterprise level. This person can explain complex scientific concepts clearly, build productive partnerships across disciplines, and distinguish promising innovation from approaches that require further evidence. The ideal candidate will be equally comfortable advising a governing board, developing people, and translating strategy into operational results.
Qualified candidates will bring:
- A doctoral degree, such as a Ph.D., Ed.D., Psy.D., or equivalent, in Educational Measurement, Psychometrics, Educational Psychology, Industrial and Organizational Psychology, Statistics, Measurement and Evaluation, or a closely related discipline.
- At least 10 years of progressively responsible leadership experience in assessment, credentialing, certification, licensure, educational measurement, or a related field.
- Executive leadership experience overseeing complex, high-stakes assessment programs, with demonstrated expertise in psychometric theory, assessment design, research, and statistical methodologies.
- Experience leading multidisciplinary teams and significant organizational transformation.
- Experience partnering with technology teams to advance assessment platforms and digital products, with knowledge of artificial intelligence, advanced analytics, and emerging assessment technologies.
- Strong strategic, financial management, communication, and organizational development capabilities.
Experience working with physician volunteers, governing boards, or professional associations is strongly preferred.
Working at the ABA
The ABA is a fast-paced organization that continuously innovates to meet the evolving needs of anesthesiologists and the profession. The organization offers a welcoming and inclusive environment that values professional growth, flexibility, collaboration, and continuous learning. The ABA embraces change as an opportunity to solve meaningful challenges and improve how it serves physicians. This position requires an on-site presence in Raleigh, North Carolina, at least two days per week. Occasional travel of up to 10%, including overnight stays, is also required.
Express Your Interest
Bring your scientific expertise and executive leadership to an organization advancing the future of physician assessment and certification. The ABA has retained OneDigital Executive Search to lead this national search on the organization’s behalf. OneDigital will review applications, assess candidate qualifications, and present qualified candidates to the ABA for consideration.
Our Commitment to Diversity, Equity, Inclusion & Belonging
Nonprofit HR is committed to fostering and maintaining a work environment where diversity, equity, and inclusion (DEI) are fully integrated into everything we do for the benefit of our employees and the clients that we serve. To fully realize our goal, we prioritize our understanding of the complexities of DEI within our workforce to inform our approach to talent management. We believe that this guides how we do our work, advise our clients to operationalize DEI and position our content and educational opportunities help strengthen the talent management capacity of the social impact sector. Continue reading our about our commitment at nonprofithr.com/deinow.
Job details
- Published
- September 11, 2026
- Last checked
- November 18, 2026
- Job source
- jazzhr
- Workplace
- On-site · Raleigh, US
- First seen
- November 14, 2026
LiftmyCV exclusive data
Nonprofit HR hiring intelligence
Nonprofit HR currently has 20 active jobs tracked by LiftmyCV. 8 new jobs in the past 7 days.
Verified November 18, 2026
Active openings
20
Currently tracked by LiftmyCV
New in 7 days
8
9 new jobs in the past 30 days
Published salaries
75%
Median disclosed salary: $92,500
Average opening age
32 days
Across 20 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • Beamline Technician
- • Chief Assessment Officer (The ABA)
- • Chief Financial Officer — Part-Time (Brain Injury Services)
- • Chief Growth Officer
- • Director of Correctional Reentry Services
- • Director of Development
Frequently requested skills
Median disclosed salary: $92,500 · 75% of jobs publish a salary
As of November 18, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Nonprofit HR
Similar jobs from this company
Across the market
Similar jobs from other companies
- Assessment OfficerBath Spa UniversityLondon, GBHybrid
- Chief OfficerDOFStorebø, NOOn-site
- Chief OfficerColumbia ShipmanagementMultiple States, USHybrid
- Chief OfficerScorpioManila, PHOn-site
- Medical Assessment OfficerTALSydney, AUHybrid
- Risk Assessment OfficerTalanNew York, USHybrid$120,000–$160,000 per year
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.