LiftmyCVLiftmyCV

AI Quality Engineering Team Lead

Aviva Services Sp. z o. o.HybridWarsaw, PL
AI job summary

Aviva is seeking an AI Quality Engineering Team Lead to drive quality assurance for GenAI and agentic AI solutions. The role involves team leadership and the establishment of scalable quality practices to ensure AI solutions are reliable and safe for release. Key responsibilities include evaluating AI behavior, building datasets, and integrating evaluation processes into CI/CD workflows. Candidates should have substantial experience in quality engineering or related fields, as well as strong technical and communication skills. The position supports a hybrid working model with opportunities for growth in a diverse setting.

Job description

Hi, we're glad you're here! We are hiring to our Aviva Services Excellence Centre! Take a look at our job description - maybe it suits you or one of your friends? We are looking for an AI Quality Engineering Team Lead to help establish trustworthy, scalable quality engineering for GenAI and agentic AI solutions at Aviva. You will combine hands-on evaluation with team leadership, helping stakeholders understand whether AI solutions are accurate, safe, reliable and ready for release. This is a role for someone who can connect business risk with datasets, AI behaviour, evaluation metrics and engineering controls. You will shape reusable quality practices, challenge weak evidence and guide engineers in producing clear, auditable findings. What will you be doing?

  • Leading the quality engineering approach for AI solutions, from risk assessment through release and monitoring.
  • Evaluating multi-turn, RAG and agentic AI behaviour, including grounding, guardrails and tool use.
  • Building representative datasets and assessing coverage, balance, leakage, label quality and freshness.
  • Assessing correctness, relevance, hallucination, safety, bias, privacy and behavioural drift.
  • Investigating unexpected outcomes across data, prompts, models, retrieval, integration, orchestration and evaluators.
  • Building reusable evaluation components, automated test pipelines, reporting and evidence-generation patterns for multiple AI products.
  • Combining test methods and validating automated evaluators against human judgement.
  • Using baselines, key metrics and risk-based regression tests to support release decisions.
  • Integrating evaluation into CI/CD, observability and engineering workflows with traceability across datasets, prompts, models and metrics.
  • Producing concise, auditable findings that explain confidence, uncertainty, customer impact and residual risk.
  • Partnering with product, engineering, architecture, data, risk, compliance and quality stakeholders to influence delivery and release decisions.
  • Coaching and guiding AI Quality Engineers, planning team work, reviewing outputs and building a collaborative culture of constructive challenge and learning.

What we're looking for:

  • Several years of relevant professional experience in quality engineering, software testing, software engineering, data science or a related technical field.
  • Hands-on experience evaluating AI, large language model, RAG or agent-based applications.
  • Practical Python skills and experience with APIs, logs, traces, structured datasets and SQL or similar analysis.
  • Ability to design repeatable evaluations and automation, not just manual testing or vendor scoring.
  • Good understanding of sampling, thresholds, trends and non-deterministic system behaviour.
  • Experience with automated testing, version control, CI/CD and maintainable engineering practices.
  • Ability to turn technical findings into decision-quality evidence for business, risk and engineering stakeholders.
  • Experience coaching or leading engineers in an emerging or ambiguous domain.
  • Strong communication and influencing skills, with the confidence to challenge weak evidence.

Nice to have:

  • Experience leading projects, coordinating technical workstreams or managing people.
  • Experience with AI evaluation or observability tools such as DeepEval, Arize or similar platforms.
  • Experience designing shared frameworks, reusable services or platform capabilities.
  • Knowledge of responsible AI, model risk, controls, privacy or customer-outcome requirements.
  • Experience in financial services, insurance or another regulated industry.
  • Exposure to cloud AI systems, observability and production support.

In Aviva Services Excellence Centre, we provide:

  • Contract of employment
  • Performance Bonus
  • Private medical care (ENEL-MED)
  • Cafeteria system of benefits (e.g. MultiSport card)
  • Additional parent privileges: - baby leave – 6 weeks leave for second parent - shortened working time after parental leave
  • Employer-funded group insurance
  • Employee Shares Plan
  • Extra day off for birthday
  • Paid time off to volunteer
  • Additional leave acquired over the years in the company (even 5 days more in a year)
  • Wellbeing Leave - additional two weeks paid leave after 10 years of service
  • Psychological support consultations
  • Access to the e-learning platforms
  • Internal employee referral program
  • Hybrid working model from Poland with a few days in Warsaw office per month
  • Attractive office location in Warsaw - Gdański Business Center
  • Additional entitlements for people with disabilities - Work Without Barriers
  • Work environment that promotes diversity - Diversity Charter

Do you see yourself in Aviva Services Excellence Centre? Be sure to apply! Aviva is for everyone! We’ve been ranked the #1 Best Workplace in Poland for a second year in a row and a top choice for Millennials by Great Place to Work®! As a signatory to the Diversity Charter, Aviva applies a policy of equal treatment and creates a work environment that is friendly to people with disabilities. We do not require from candidates the date of birth, marital status and attached photos to your CV. We encourage all individuals regardless of gender to apply. Most of our people are smart working – spending also time in our office - combining the benefits of flexibility, with time together with colleagues. We’re inclusive - we welcome applications from people with diverse backgrounds and experiences. Excited but not sure you tick every box? Research tells us that women, particularly, feel this way. So, regardless of gender, why not apply and try! To find out more about current job offers at Aviva take a look here.

Job details

Published
October 26, 2026
Experience
Lead
Job source
myworkdayjobs
Workplace
Hybrid · Warsaw, PL
First seen
October 27, 2026

Benefits

Contract of employment, Performance Bonus, Private medical care (ENEL-MED), Cafeteria system of benefits (e.g. MultiSport card), Additional parent privileges, Employer-funded group insurance, Employee Shares Plan, Extra day off for birthday, Paid time off to volunteer, Additional leave acquired over the years in the company, Wellbeing Leave, Psychological support consultations, Access to e-learning platforms, Internal employee referral program, Hybrid working model from Poland with a few days in Warsaw office per month.

Skills mentioned in this job

quality engineeringsoftware testingsoftware engineeringdata sciencePythonAPIsSQL

LiftmyCV exclusive data

Aviva Services Sp. z o. o. hiring intelligence

Aviva Services Sp. z o. o. currently has 1 active jobs tracked by LiftmyCV. 1 new jobs in the past 7 days.

Active openings

1

Currently tracked by LiftmyCV

New in 7 days

1

1 new jobs in the past 30 days

Published salaries

—

Not published by this employer yet

Average opening age

2 days

Across 1 active opening

Workplace breakdown

Remote0%
Hybrid100%
On-site0%

Hiring countries

Poland

Top hiring cities

Warsaw

Most in-demand roles

  • • Agile Delivery Specialist

Frequently requested skills

Agile
Confluence
Jira
Lean

As of November 17, 2026

Hiring insights calculated from active jobs tracked by LiftmyCV.

AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Aviva Services Sp. z o. o.

Similar jobs from this company

Across the market

Similar jobs from other companies

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.