Qualitative Coding Assistant
Job description
About the Opportunity
Job Summary
You will serve as the ground truth for AI validation by manually coding student simulation transcripts using detailed rubrics. This role requires meticulous attention to detail, strong qualitative analysis skills, and the ability to apply complex coding schemes consistently. Your ratings establish the validity benchmark against which AI scoring will be evaluated.
Key Responsibilities & Accountabilities
- Study and internalize 18-indicator rubrics across 3 skill domains
- Code 50–80 student simulation transcripts using detailed rubric criteria
- Participate in calibration sessions to establish inter-rater reliability
- Document edge cases and ambiguous scenarios requiring rubric clarification
- Provide systematic feedback on rubric usability and clarity
- Identify indicators with low inter-rater agreement requiring revision
- Calculate inter-rater reliability metrics, including Cohen's kappa and intraclass correlation coefficient (ICC)
- Compare human versus AI ratings to identify systematic differences
- Contribute to validation methodology documentation
- Support qualitative findings write-up for research reports
Minimum Qualifications
Required
- Master’s degree or Doctor of Education (EdD) in Education, Economics, Public Policy, Psychology, Sociology, Communication, or related social science
- Demonstrated experience with qualitative coding using established frameworks such as thematic analysis, content analysis, or discourse analysis
- Familiarity with inter-rater reliability concepts and procedures
- Strong writing skills for documentation and analytical memos
- Ability to work independently while maintaining consistency across coding sessions
- Comfort with ambiguity during iterative rubric refinement
Preferred
- Experience with education assessment or program evaluation
- Background in adolescent development or youth workforce development
- Training in qualitative analysis software such as MAXQDA, NVivo, or ATLAS.ti
- Understanding of psychometric concepts, including validity, reliability, and construct definition
Position Type
Temporary
Additional Information
Northeastern University considers factors such as candidate work experience, education and skills when extending an offer. Northeastern has a comprehensive benefits package for benefit eligible employees. This includes medical, vision, dental, paid time off, tuition assistance, wellness & life, retirement- as well as commuting & transportation. Visit for more information. All qualified applicants are encouraged to apply and will receive consideration for employment without regard to race, religion, color, national origin, age, sex, sexual orientation, disability status, or any other characteristic protected by applicable law. This job is for a current or anticipated job vacancy.
Pay Rate:
$25/hour
Job details
- Published
- July 15, 2026
- Job source
- myworkdayjobs
- Workplace
- On-site · Boston, MA (Main Campus)
- First seen
- July 16, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at NU USA Northeastern University
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.