Quality Engineering Lead
Job description
Quality Engineering Lead
Blue Machines · Full-time
About Blue Machines
Blue Machines builds the platform for production AI agents — agent builder, real-time voice agents, workflow orchestration, integrations, and inference. Multi-tenant systems, non-deterministic behaviour, many providers in the call path, and high bar for what ships to customers.
About the role
We are hiring a founding Quality Engineering Lead — a builder who designs and ships the systems that decide what is safe to release. Your output is platforms and mechanisms, not test cases. You may grow a team later; you are hired to build first.
What you will do
- Design and build the test platform: execution, isolation, test-data lifecycle, reporting, flake handling, and a clear answer to whether a build should ship
- Build an agent evaluation harness that detects behavioural regressions after prompt, model, tool, or config changes
- Own release gating: enforceable gates in code, post-deploy verification, canary criteria, and a narrow hotfix path
- Treat capacity and load as release criteria, not optional reports
- Turn customer-visible defects into durable detection (owned, staged, measurable)
- Push testability into product systems — seams, replay, fault injection, observability
- Raise the engineering bar through review and mechanisms, not by writing every test yourself
What we are looking for
- Strong software engineering background — you can design a system from an ambiguous problem and implement the hard path
- Experience owning quality, reliability, release, or evaluation platforms (not only writing suites)
- Experience with conversational AI, voice, or LLM evaluation — or a clear track record evaluating non-deterministic systems without ground truth
- Release engineering, progressive delivery, or SRE depth — gates, canaries, and production signal you have owned
- Hands-on building of CI/CD quality infrastructure at meaningful scale
- Product mindset — you tie quality work to customer-visible risk and delivery outcomes
- Evidence over assertion — you quantify, and you separate known from assumed
- Ability to work with a small team and influence engineers who do not report to you
This role is not
A manual QA role, a checklist sign-off role, or a hire to write Playwright/pytest cases as the main job. We already have deep automation capability; we need the architect who builds what sits above it.
Job details
- Published
- August 7, 2026
- Job source
- jworkable
- Workplace
- On-site · Bengaluru, IN
- First seen
- August 7, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Blue Machines AI
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
- Quality Engineering LeadBlue Machines AIBengaluru, INOn-site
- Quality Engineering LeadMinderaBlumenau, BRRemote
- Quality Engineering LeadSallaMakkah, Makkah Province, Saudi ArabiaHybrid
- Quality Engineering LeadRelxHorsham, USHybrid$115,400–$192,300 per year
- Quality Engineering LeadGBR - T. J. Smith and Nephew LimitedHull, GBOn-site
- Quality Engineering LeadManulifeMakati City, PHOn-site
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.