LiftmyCVLiftmyCV
RE

Senior Quality Automation Engineer

Re-LeasedOn-siteNapier, Hawkes Bay

Job description

Does redefining what Quality looks like in the age of AI — on a brand-new AI product — make you tick? At Re-Leased our vision is to shape the future of Commercial Real Estate and drive better outcomes for people, property and planet. We're now building am:pm — an agentic AI product for commercial real estate operators. Property managers run their portfolios on a system of record like Re-Leased, but most of the actual work happens outside it — emails, phone calls, follow-ups, to-do lists scattered across tools, with no system behind them. am:pm is the system of action for that work: it captures the work to be done as jobs and tasks, grounded in the communication channels, memories, and documents that surround the portfolio — so the work itself finally has a home. You can read more at ampm.ai. am:pm is in early access with customers right now. The squad is small, the stack is new, and we're moving fast.

Your Role

We're looking for a senior quality automation engineer to own the quality system for am:pm — based in Napier or remote from another city in New Zealand. The whole squad owns quality; you build the automation, quality controls, and practices that make that possible. This is an automation-led role: engineers write unit and integration tests, and you shape where automated coverage sits across the test pyramid and steward the end-to-end suite, with AI as a core part of how you work — generating tests, triaging failures, creating test data. We're also moving to continuous delivery, and a core part of this role is making that safe — the right level of automated quality controls so changes flow to production with confidence. And because am:pm is an AI product, quality means testing agentic behaviour: non-deterministic outputs, tool use, statistical rather than binary correctness. Engineers write the evals — just as they write unit and integration tests — and you bring the quality lens: when evals are the right control, and what they need to catch. This is a small-team, start-up environment inside an established SaaS business — less process, more agency, and a tight feedback loop with real customers.

Your Responsibilities

  • Drive quality automation across the test pyramid — set where coverage sits so tests run at the layer that's cheapest and most reliable — and steward the end-to-end suite: curate what earns a place in it, and set the standards engineers follow when contributing tests of their own
  • Support our move to continuous delivery — design the right level of automated quality controls (pipeline gates, smoke checks, release signals) so we can release frequently without slowing the flow of change
  • Use AI tooling as a first-class part of your workflow — test generation, bug triage, test data creation — and keep raising the bar on how the team uses it
  • Curate AI-generated tests and findings — decide what to keep, reject, or refine, applying your own testing judgment rather than accepting output wholesale
  • Shape how we test AI-powered features — advise on when evals are the right quality control and what they should cover, and contribute adversarial and edge-case scenarios; engineers write and own the evals themselves
  • Partner with engineers on acceptance criteria and coach them on designing test scenarios from a user's perspective — positive paths, negative paths, edge cases
  • Run exploratory and risk-based testing to find what automation misses, and feed production bugs back into automation at the layer that would have caught them
  • Analyse quality workflows — triage, release, escape defects — and drive structural improvements, reporting on quality signals so the squad always knows where quality stands

Your Experience

  • 5+ years of QA experience in a SaaS product environment, with automation at the centre of how you work
  • Track record of designing test automation frameworks from the ground up — architecture, tooling choices, conventions — and building the JavaScript/TypeScript end-to-end suites (e.g. Playwright, Cypress) that run on them
  • Comfortable working in a production codebase — Git, branches, PRs, code review — and able to read code well enough to locate and understand the surface under test
  • CI/CD fluent — you understand what runs when and where tests fit, with a clear point of view on the quality controls that make continuous delivery safe: pipeline gates, smoke checks, rollback signals
  • Actively using AI tools in your workflow today — and opinions on where they're strong and where they aren't
  • Genuine interest in testing AI products: you've thought about (or worked on) how to test non-deterministic systems, and evals excite you rather than scare you
  • Strong exploratory testing instincts and sound test-pyramid judgment — you find the bugs automation can't, and you know where automation investment pays off and where it doesn't
  • Comfortable with ambiguity, change, and making calls with incomplete information — you're drawn to small teams and early-stage product work
  • A genuine focus on the customer outcome, not just the test count

Bonus

  • Experience with LLM eval frameworks — golden datasets, judge models, statistical thresholds
  • Experience with adversarial testing of AI systems — prompt injection, jailbreaks, hostile inputs
  • API testing chops (REST), performance or accessibility testing experience
  • Prior start-up or zero-to-one product experience

Our Stack & How We Work

am:pm is built on.NET 8, Vue 3, SQL Server and a growing set of AI services on Microsoft Azure. The squad manages its own DevOps — Terraform for IaC, Azure DevOps for pipelines. We've woven AI tooling deeply into how we work; if you're excited by the idea of testing AI-native software and using AI to test it, you'll fit right in.

Our culture is very important to us too, and we strongly believe in living out our core values:

  • People First: One team globally; our people and customers always come first.
  • Find a Way: Like a river, we find a way around all obstacles
  • Win or Learn: Our journey for improvement never ends; enjoy the ride!
  • Aim High: We dare to set big goals and love the challenge of achieving them against the odds.

Why you’ll love working here! Taking care of you: Including comprehensive health insurance, access to a premium EAP service and an annual wellness allowance to spend on what helps you feel good - whether that’s towards a gym membership, new running shoes, or mindfulness apps. Support for families: Generous paid parental leave and flexible, family-friendly support designed to help growing families balance work and life with confidence. Recognition for tenure and milestones: We celebrate time, commitment, and contribution with milestone rewards and additional leave as you grow your career with us. Flexible working, built for a global team: With customers and teammates across New Zealand, Australia, the United Kingdom, and North America, we work in a hybrid, remote-friendly way with collaborative offices and the flexibility of a balanced approach to WFH/i-office work. Ready to Level Up? Join us and help shape the future of real estate at one of the most exciting SaaS companies born from New Zealand.

Job details

Published
September 9, 2026
Last checked
November 16, 2026
Job source
greenhouse
Workplace
On-site · Napier, Hawkes Bay
First seen
September 10, 2026
AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Re-Leased

Similar jobs from this company

None listed.

Across the market

Similar jobs from other companies

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.