AI Evals/Benchmarking Engineer
Activate Interactive Pte Ltd is seeking an AI Evals/Benchmarking Engineer to work with Singapore Government Agencies. This fixed-term contract role involves designing and operating evaluation and benchmarking frameworks for AI agents, defining evaluation strategies, and developing automated regression pipelines. The position offers the chance to contribute to impactful mobile and web technologies while fostering a supportive environment for employee growth. Ideal candidates should have a passion for innovation and a desire to create positive impacts through technology.
Job description
Activate Interactive Pte Ltd (“Activate”) is a leading technology consultancy headquartered in Singapore with a presence in Malaysia and Indonesia. Our clients are empowered with quality, cost-effective, and impactful end-to-end application development, like mobile and web applications, and cloud technology that remove technology roadblocks and increase their business efficiency. We believe in positively impacting the lives of people around us and the environment we live in through the use of technology. Hence, we are committed to providing a conducive environment for all employees to realise their full potential, who in turn have the opportunity to continuously drive innovation. We are searching for our next team members to join our growing team. If you love the idea of being part of a growing company with exciting prospects in mobile and web technologies that create positive impact on people’s lives, then we would love to hear from you.
Co-Development Business Unit is hiring for AI Evals/Benchmarking Engineer
You will work in Singapore Government Agencies This is a fixed term contract role. The engagement is 1 year. Internal Code: A26419 What will you do?
- Design and operate the evaluation and benchmarking framework for the AIDD target evaluation workflow and its AI agents. The role establishes retrospective baselines, integrates Therapeutics Data Commons (TDC) datasets where appropriate, runs forward regression testing, and converts structured human-in-the-loop feedback into governed training and improvement signals while maintaining quality, provenance and reproducibility.
- Define the end-to-end evaluation strategy, benchmark suites, test datasets, rubrics, acceptance thresholds and reporting standards for retrieval, generation, reasoning, scoring, gating and meta-agent components.
- Build retrospective benchmarks using historical target evaluations and expert decisions to measure evidence quality, citation and provenance coverage, factual consistency, therapeutic-direction accuracy, score reliability and report quality.
- Assess and integrate relevant TDC datasets and tasks, including data mapping, licensing, preprocessing, versioning and alignment with AIDD evaluation criteria.
- Develop automated forward regression pipelines that compare models, prompts, agents, data sources and workflow versions, detect performance drift and block unsafe or substandard releases.
- Design human-in-the-loop review capture, including structured annotations, corrections, confidence, rationale and outcomes, and transform validated feedback into governed evaluation and training signals.
- Perform error analysis and failure-mode discovery, maintain traceable experiment records, and work with scientists and engineers to prioritize and verify improvements.
- Create dashboards and concise reports on benchmark performance, QA pass rate, provenance, latency, cost and human-review effort. Review results with scientific stakeholders, the Architect and the Delivery & Tech Lead to support model selection, release gates and prioritisation of workflow and engineering improvements.
Job details
- Published
- October 29, 2026
- Job source
- jworkable
- Workplace
- On-site · Singapore, SG
- First seen
- October 29, 2026
LiftmyCV exclusive data
Activate Interactive Pte Ltd hiring intelligence
Activate Interactive Pte Ltd currently has 16 active jobs tracked by LiftmyCV. 11 new jobs in the past 7 days.
Active openings
16
Currently tracked by LiftmyCV
New in 7 days
11
16 new jobs in the past 30 days
Published salaries
—
Not published by this employer yet
Average opening age
6 days
Across 16 active openings
Workplace breakdown
Hiring countries
Most in-demand roles
- • Experience & Interface Designer
- • Business Analyst - A26435
- • Cloud and DevOps (AWS), Senior Engineer
- • Data Engineer
- • Experience & Interface Designer (Design Systems)
- • Experience & Interface Designer (Product Designer)
Frequently requested skills
As of November 17, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Activate Interactive Pte Ltd
Similar jobs from this company
- Backend EngineerActivate Interactive Pte LtdSingapore, SGOn-site
- DevSecOps EngineerActivate Interactive Pte LtdSingapore, SGOn-site
- Business AnalystActivate Interactive Pte LtdSingapore, SGOn-site
- Full Stack EngineerActivate Interactive Pte LtdSingapore, SGOn-site
- Experience & Interface Designer - A26398Activate Interactive Pte LtdSingapore, SGOn-site
- Software Quality EngineerActivate Interactive Pte LtdSingapore, SGOn-site
Across the market
Similar jobs from other companies
- Research Scientist, Benchmarks & EvalsKled AIUSRemote$150,000–$250,000 per year
- Expert Talent Pool, Evals and BenchmarksCleraremoteRemote$156,000–$364,000 per year
- Expert Talent Pool, Evals and Benchmarks (Associate)CleraremoteRemote$62,400–$124,800 per year
- Analyst, BenchmarkingVisaAtlanta, GAHybrid
- Scientific EvalsEdison ScientificSan Francisco, USOn-site$160,000–$300,000 per year
- Evals LeadAslanWashington, USOn-site
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.