Hiring: AI Engineer | Agentic AI, AWS Bedrock AgentCore & Langfuse | 15+ Years
Job description
Job Title: AI Engineer / Generative AI Engineer Location: Los Angeles, CA (Hybrid) Duration: 3+ Months (Extension Possible)
Experience: 15+ Years
Job Summary We are seeking a hands-on AI Engineer with expertise in Python, Agentic AI, AWS Bedrock AgentCore, and LLM evaluation to build, deploy, monitor, and continuously improve production-grade AI agents. Key Responsibilities
- Develop AI agents using Python and Claude Agent SDK.
- Deploy agents using AWS Bedrock AgentCore Runtime.
- Design golden datasets and implement LLM-as-a-Judge evaluations.
- Integrate automated evaluations into CI/CD pipelines as quality gates.
- Implement Langfuse/OpenTelemetry for AI observability and tracing.
- Evaluate agent accuracy, task completion, tool execution, and performance.
- Support RAG pipelines and AWS data processing workflows.
Required Skills
- Python and Agentic AI development.
- AWS Bedrock AgentCore Evaluations / Bedrock evaluation.
- Golden-dataset design and curation.
- LLM-as-a-Judge design and calibration against human labels.
- Automated evaluation and CI gate integration.
- Langfuse and/or OpenTelemetry.
Good to Have
- RAGAS or equivalent evaluation frameworks.
- Trajectory evaluation and agentic red-teaming.
- Bedrock Guardrails, Strands Agents SDK, and GitHub Actions.
Qualifications
- 6–8+ years of software engineering, cloud engineering, or AI/ML experience.
- Hands-on experience with production AI agents and continuous evaluation.
- Strong problem-solving and troubleshooting skills.
All your information will be kept confidential according to EEO guidelines.
Job details
- Published
- October 30, 2026
- Last checked
- November 8, 2026
- Job source
- smartrecruiters
- Workplace
- Hybrid · Los Angeles, US
- First seen
- October 30, 2026
LiftmyCV exclusive data
TMS LLC hiring intelligence
TMS LLC currently has 9 active jobs tracked by LiftmyCV. 2 new jobs in the past 7 days.
Verified November 8, 2026
Active openings
9
Currently tracked by LiftmyCV
New in 7 days
2
7 new jobs in the past 30 days
Published salaries
—
Not published by this employer yet
Average opening age
15 days
Across 9 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • RPA Architect
- • Cisco Network Architect
- • Hiring
- • Hiring: Principal IAM Architect
- • Java AS400 Engineer - Remote
- • Senior Business Analyst- Commercial P&C/ MGA
Frequently requested skills
As of November 17, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at TMS LLC
Similar jobs from this company
Across the market
Similar jobs from other companies
- Agentic AI Platform (AgentCore) Senior ManagerProtiviti Inc.New York City, USHybrid$146,000–$234,000 per year
- Solutions Architect - LangfuseClickHouseSan Francisco, CAOn-site
- Langfuse - Product ManagerClickHouseNew York, USRemote
- Pampanga Agent HiringProbe CX Philippines Inc.Entec PampangaOn-site
- Makati Agent HiringProbe CX Philippines Inc.Makati City MNL PhilippinesOn-site
- BGC Agent HiringProbe CX Philippines Inc.Taguig City MNL PhilippinesOn-site
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.