Senior Applied AI Engineer (GenAI & LLM Evaluation)
Acuity Analytics is seeking a Senior Applied AI Engineer specializing in Generative AI and LLM Evaluation. This is a hands-on role focused on developing scalable data pipelines and AI-powered data products. The successful candidate will collaborate with Data Scientists and Engineers to design and deploy production-ready AI solutions, leveraging expertise in Generative AI technologies. Ideal candidates will have over five years of experience in Data Engineering or Machine Learning, proficiency in Python and SQL, and hands-on experience with LLMs. This position offers a chance to work on impactful AI solutions.
Job description
About Us
Ascent has recently been acquired by Acuity Analytics. This is both a significant milestone for us and a tremendous opportunity for you. Acuity Analytics is a business with a strong global reputation, an impressive client base and ambitious growth plans. We deliver deep insights and domain-led digital transformation to high-growth and heavily regulated organisations. To our customers, we bring a partnership that provides the talent, technology and capability to enhance performance and operational efficiency.
About the role
We're looking for a Senior AI & Data Engineer (GenAI & LLM Evaluation) to help build and improve AI-powered data products. Working alongside Data Scientists, Engineers, and Delivery teams, you'll develop scalable data pipelines, build GenAI evaluation frameworks, and deploy production-ready AI solutions. This is a hands-on role where you'll own solutions from design through to deployment while working on cutting-edge Generative AI technologies. If you enjoy solving real-world problems and building practical AI solutions that make an impact, we'd love to hear from you. Skills and experience required
Core skills
- 5+ years' experience in Data Engineering, Machine Learning, AI Engineering, or Data Science.
- Strong Python and SQL skills.
- Hands-on experience with Generative AI and Large Language Models (LLMs).
- Experience evaluating LLMs using golden datasets, model benchmarking, or LLM-as-a-Judge techniques.
- Experience building and deploying production-ready ML solutions.
- Strong understanding of data pipelines, validation, and quality frameworks.
- Experience integrating APIs and cloud-based AI services.
Soft skills
- Strong problem-solving and analytical skills.
- Comfortable owning solutions end-to-end.
- Excellent communication and stakeholder management.
- Experience working in Agile, cross-functional teams.
- Consulting or customer-facing experience is a plus.
What you will do
- Build and maintain scalable data pipelines and workflows.
- Develop evaluation frameworks for GenAI and LLM applications.
- Create and maintain golden datasets for model testing.
- Evaluate and benchmark LLM performance.
- Build ML-assisted tools to improve delivery and automation.
- Deploy production-ready AI solutions.
- Work closely with delivery teams to solve technical challenges.
- Continuously improve data quality, automation, and operational efficiency.
Why join us
People are at the Heart of our Business. By investing in people, we achieve exceptional results for our clients and create new opportunities for our teams to thrive. Check out this page for more details. If you have any questions contact our Talent Acquisition team on ta.admin@acuityanalytics. For more details about Acuity Analytics please see here: Read here.
Responsibilities
Build and maintain scalable data pipelines and workflows. Develop evaluation frameworks for GenAI and LLM applications. Create and maintain golden datasets for model testing. Evaluate and benchmark LLM performance. Build ML-assisted tools to improve delivery and automation. Deploy production-ready AI solutions. Work closely with delivery teams to solve technical challenges. Continuously improve data quality, automation, and operational efficiency.
Job details
- Published
- November 14, 2026
- Last checked
- November 17, 2026
- Experience
- Senior
- Job source
- jazzhr
- Workplace
- Remote · GB
- First seen
- November 14, 2026
Skills mentioned in this job
LiftmyCV exclusive data
Acuity Analytics hiring intelligence
Acuity Analytics currently has 22 active jobs tracked by LiftmyCV. 22 new jobs in the past 7 days.
Verified November 17, 2026
Active openings
22
Currently tracked by LiftmyCV
New in 7 days
22
22 new jobs in the past 30 days
Published salaries
—
Not published by this employer yet
Average opening age
4 days
Across 22 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • Senior DevOps/MLOps Engineer (Azure, Python)
- • Data Architect
- • Data Engineer
- • Lead Data Engineer
- • Manager PMO & Product Management
- • Principal Software & AI Engineer
Frequently requested skills
As of November 17, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Acuity Analytics
Similar jobs from this company
Across the market
Similar jobs from other companies
- Senior Scientist - GenAI EvaluationJanssen-Cilag S.A.Madrid, ESOn-site
- Applied AI Researcher (GenAI)MobileyeRamat Gan, IsraelHybrid
- Applied GenAI Scientist InternGenentech USA, Inc.South San Francisco, USOn-site$108,160 per year
- Native Linguistics Specialist - GenAI EvaluationTalent-360.meCairo, EGRemote
- Lead Applied AI / GenAI EngineerQLYS_US Qualys, Inc.Foster City, USOn-site$165,000–$185,000 per year
- Senior Applied GenAI Video EngineerAtriaCNRemote
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.