LiftmyCVLiftmyCV

AI Evals/Benchmarking Engineer

Activate Interactive Pte LtdOn-siteSingapore, SG
AI job summary

Activate Interactive Pte Ltd is seeking an AI Evals/Benchmarking Engineer to work with Singapore Government Agencies. This fixed-term contract role involves designing and operating evaluation and benchmarking frameworks for AI agents, defining evaluation strategies, and developing automated regression pipelines. The position offers the chance to contribute to impactful mobile and web technologies while fostering a supportive environment for employee growth. Ideal candidates should have a passion for innovation and a desire to create positive impacts through technology.

Job description

Activate Interactive Pte Ltd (“Activate”) is a leading technology consultancy headquartered in Singapore with a presence in Malaysia and Indonesia. Our clients are empowered with quality, cost-effective, and impactful end-to-end application development, like mobile and web applications, and cloud technology that remove technology roadblocks and increase their business efficiency. We believe in positively impacting the lives of people around us and the environment we live in through the use of technology. Hence, we are committed to providing a conducive environment for all employees to realise their full potential, who in turn have the opportunity to continuously drive innovation. We are searching for our next team members to join our growing team. If you love the idea of being part of a growing company with exciting prospects in mobile and web technologies that create positive impact on people’s lives, then we would love to hear from you.

Co-Development Business Unit is hiring for AI Evals/Benchmarking Engineer

You will work in Singapore Government Agencies This is a fixed term contract role. The engagement is 1 year. Internal Code: A26419 What will you do?

  • Design and operate the evaluation and benchmarking framework for the AIDD target evaluation workflow and its AI agents. The role establishes retrospective baselines, integrates Therapeutics Data Commons (TDC) datasets where appropriate, runs forward regression testing, and converts structured human-in-the-loop feedback into governed training and improvement signals while maintaining quality, provenance and reproducibility.
  • Define the end-to-end evaluation strategy, benchmark suites, test datasets, rubrics, acceptance thresholds and reporting standards for retrieval, generation, reasoning, scoring, gating and meta-agent components.
  • Build retrospective benchmarks using historical target evaluations and expert decisions to measure evidence quality, citation and provenance coverage, factual consistency, therapeutic-direction accuracy, score reliability and report quality.
  • Assess and integrate relevant TDC datasets and tasks, including data mapping, licensing, preprocessing, versioning and alignment with AIDD evaluation criteria.
  • Develop automated forward regression pipelines that compare models, prompts, agents, data sources and workflow versions, detect performance drift and block unsafe or substandard releases.
  • Design human-in-the-loop review capture, including structured annotations, corrections, confidence, rationale and outcomes, and transform validated feedback into governed evaluation and training signals.
  • Perform error analysis and failure-mode discovery, maintain traceable experiment records, and work with scientists and engineers to prioritize and verify improvements.
  • Create dashboards and concise reports on benchmark performance, QA pass rate, provenance, latency, cost and human-review effort. Review results with scientific stakeholders, the Architect and the Delivery & Tech Lead to support model selection, release gates and prioritisation of workflow and engineering improvements.

Job details

Published
October 29, 2026
Job source
jworkable
Workplace
On-site · Singapore, SG
First seen
October 29, 2026

LiftmyCV exclusive data

Activate Interactive Pte Ltd hiring intelligence

Activate Interactive Pte Ltd currently has 16 active jobs tracked by LiftmyCV. 11 new jobs in the past 7 days.

Active openings

16

Currently tracked by LiftmyCV

New in 7 days

11

16 new jobs in the past 30 days

Published salaries

—

Not published by this employer yet

Average opening age

6 days

Across 16 active openings

Workplace breakdown

Remote0%
Hybrid0%
On-site100%

Hiring countries

Singapore

Most in-demand roles

  • • Experience & Interface Designer
  • • Business Analyst - A26435
  • • Cloud and DevOps (AWS), Senior Engineer
  • • Data Engineer
  • • Experience & Interface Designer (Design Systems)
  • • Experience & Interface Designer (Product Designer)

Frequently requested skills

AWS
C#
SQL
.NET
Angular
ASP.NET Core
Entity Framework Core
ETL

As of November 17, 2026

Hiring insights calculated from active jobs tracked by LiftmyCV.

AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Activate Interactive Pte Ltd

Similar jobs from this company

Across the market

Similar jobs from other companies

Related job searches

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.