LiftmyCVLiftmyCV

Hiring: AI Engineer | Agentic AI, AWS Bedrock AgentCore & Langfuse | 15+ Years

TMS LLCHybridLos Angeles, US

Job description

Job Title: AI Engineer / Generative AI Engineer Location: Los Angeles, CA (Hybrid) Duration: 3+ Months (Extension Possible)

Experience: 15+ Years

Job Summary We are seeking a hands-on AI Engineer with expertise in Python, Agentic AI, AWS Bedrock AgentCore, and LLM evaluation to build, deploy, monitor, and continuously improve production-grade AI agents. Key Responsibilities

  • Develop AI agents using Python and Claude Agent SDK.
  • Deploy agents using AWS Bedrock AgentCore Runtime.
  • Design golden datasets and implement LLM-as-a-Judge evaluations.
  • Integrate automated evaluations into CI/CD pipelines as quality gates.
  • Implement Langfuse/OpenTelemetry for AI observability and tracing.
  • Evaluate agent accuracy, task completion, tool execution, and performance.
  • Support RAG pipelines and AWS data processing workflows.

Required Skills

  • Python and Agentic AI development.
  • AWS Bedrock AgentCore Evaluations / Bedrock evaluation.
  • Golden-dataset design and curation.
  • LLM-as-a-Judge design and calibration against human labels.
  • Automated evaluation and CI gate integration.
  • Langfuse and/or OpenTelemetry.

Good to Have

  • RAGAS or equivalent evaluation frameworks.
  • Trajectory evaluation and agentic red-teaming.
  • Bedrock Guardrails, Strands Agents SDK, and GitHub Actions.

Qualifications

  • 6–8+ years of software engineering, cloud engineering, or AI/ML experience.
  • Hands-on experience with production AI agents and continuous evaluation.
  • Strong problem-solving and troubleshooting skills.

All your information will be kept confidential according to EEO guidelines.

Job details

Published
October 30, 2026
Last checked
November 8, 2026
Job source
smartrecruiters
Workplace
Hybrid · Los Angeles, US
First seen
October 30, 2026

LiftmyCV exclusive data

TMS LLC hiring intelligence

TMS LLC currently has 9 active jobs tracked by LiftmyCV. 2 new jobs in the past 7 days.

Verified November 8, 2026

Active openings

9

Currently tracked by LiftmyCV

New in 7 days

2

7 new jobs in the past 30 days

Published salaries

—

Not published by this employer yet

Average opening age

15 days

Across 9 active openings

Workplace breakdown

Remote11%
Hybrid33%
On-site56%

Hiring countries

United States of America
Canada

Top hiring cities

Los Angeles
Menlo Park
Toronto
Boston
Jersey City
New York
OR

Most in-demand roles

  • • RPA Architect
  • • Cisco Network Architect
  • • Hiring
  • • Hiring: Principal IAM Architect
  • • Java AS400 Engineer - Remote
  • • Senior Business Analyst- Commercial P&C/ MGA

Frequently requested skills

Agile
Blue Prism
Google Cloud AI Agents
SQL
Tableau
UiPath
AWS
Azure

As of November 17, 2026

Hiring insights calculated from active jobs tracked by LiftmyCV.

AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at TMS LLC

Similar jobs from this company

Across the market

Similar jobs from other companies

Related job searches

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.