AI Voice Evaluation Specialist - 3 month contract
Job description
Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers.
About this Role:
This role is a 3-month, W2, full-time contract (40 hours per week.)
Scope of the Role:
We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact with two different AI models using the same assigned scenario, carefully compare their responses, and provide structured evaluations based on defined quality criteria. The goal of the evaluation is to create a fair, consistent comparison between models and identify which model delivers the stronger overall conversational experience.
What You’ll Own:
- Review an assigned scenario and roleplay a natural conversation with two different AI models.
- Conduct comparable conversations with Model A and Model B, keeping the scenario, conversational approach, and overall interaction as consistent as possible.
- Maintain approximately the same number of conversational turns with each model to support a fair comparison.
- Record your voice during each interaction and pay close attention to the quality and behavior of the model's responses.
- Evaluate each model across five defined evaluation dimensions.
- Identify and categorize relevant error clusters that may occur in the audio or conversation.
- Compare the performance of Model A and Model B based on the evaluation criteria and your observations.
- Select the model that demonstrated the stronger overall performance according to the defined evaluation framework.
- Write a detailed rationale explaining your final preference, referencing specific examples and observations from both conversations.
- Apply evaluation guidelines consistently across different scenarios and model interactions
You’ll Thrive in This Role If You Have
- Bachelors Degree
- Strong attention to detail and ability to notice subtle differences in conversational quality.
- Excellent listening and comprehension skills.
- Strong written communication skills, particularly the ability to explain observations clearly and objectively.
- Ability to consistently follow detailed evaluation guidelines.
- Comfort speaking naturally and role-playing different conversational scenarios.
- Ability to compare two interactions fairly without allowing personal preferences to influence the evaluation.
- Strong critical-thinking and analytical skills.
- Reliability and consistency when completing structured evaluation tasks.
- Familiarity with AI assistants, voice-based AI, or conversational systems
The expected hourly salary range for this position is $20-$25 p/hour, based on experience, skills, and qualifications. Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at and consider reporting it to the FTC at ReportFraud.ftc.gov.
Job details
- Published
- October 14, 2026
- Last checked
- November 17, 2026
- Job source
- greenhouse
- Workplace
- Remote · Remote - Canada, US
- First seen
- October 14, 2026
LiftmyCV exclusive data
Innodata Inc. hiring intelligence
Innodata Inc. currently has 13 active jobs tracked by LiftmyCV. 1 new jobs in the past 7 days.
Verified November 17, 2026
Active openings
13
Currently tracked by LiftmyCV
New in 7 days
1
4 new jobs in the past 30 days
Published salaries
23%
Median disclosed salary: $57,200
Average opening age
27 days
Across 13 active openings
Workplace breakdown
Hiring countries
Most in-demand roles
- • AI Voice Evaluation Specialist - 3 month contract
- • Business Development Representative, Healthcare & Life Sciences
- • Director/Client Partner - Google, Enterprise AI
- • Forward Deployed Engineer
- • Generative AI Associate
- • Generative AI Associate Russian Speaking - Flexible Hours
Frequently requested skills
Median disclosed salary: $57,200 · 23% of jobs publish a salary
As of November 18, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Innodata Inc.
Similar jobs from this company
Across the market
Similar jobs from other companies
- AI Voice Evaluation SpecialistInnodata Inc.Remote - Alabama ; Remote - Alaska ; Remote - Arkansas ; Remote - Delaware ; Remote - Florida ; Remote - GeorgiaRemote
- AI Quality Evaluator - Dutch (12-Month Contract)CanvaAmsterdam, NLOn-site
- AI Quality Evaluator - German (12-month contract)CanvaBerlin, GermanyOn-site
- AI Quality Evaluator - Thai (12-month contract)CanvaBangkok, THOn-site
- Global Program Lead, Installer Voices (6-month contract)New Energy NexusAbuja, VNRemote
- Talent Assistant -Faces & Voices - 12 Month Fixed Term ContractImmediate Media CoLondon, England, United KingdomHybrid
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.