
AI Operations Specialist
Job description
About the Role
We are seeking an AI Operations Specialist to help business and product teams use AI to take on review and quality work. You will map how work gets done today, build AI-driven workflows, and test them until the results can be trusted. You will also help product teams decide whether an AI feature is ready to launch. This is a hands-on role: you help build the workflow, ship it, and stay on to make sure it keeps working. The scope is expected to grow as AI capabilities evolve.
Key Responsibilities
- Help prioritize projects by business impact and make the case for the ones worth pursuing.
- Partner with process owners to map current workflows, then define where AI can do the work and where people step in on hard cases.
- Build AI workflows: write prompts, set up pipelines, maintain agreed quality levels, and monitor for drift after launch.
- Build test sets, measure accuracy, and calibrate LLM judges against human reviewers.
- Help product teams define launch-readiness criteria for AI features and provide evidence for go/no-go decisions.
- Turn unclear policy into criteria reviewers can apply consistently, working with product, legal, and policy partners.
- Work with subject matter experts to write labeling guidelines and produce human-verified labels on real data.
- Run labeling at scale with vendor agents, and validate their work using agreement metrics and spot checks.
- Make solutions reusable and document learnings so future teams reach production faster.
- Keep methods current as models, tools, and vendor agents change, and retire what no longer works.
- Own assigned workstreams end to end, from setup through quality checks.
Qualifications
Required
- 5-7 years in operations, program management, analytics, consulting, or applied AI, with accountability for results.
- Daily AI user who has built something with AI that delivered measurable impact, such as a workflow, an automation, or an analysis.
- Comfortable with metrics such as accuracy, precision, recall, and sampling.
- Experience taking a messy process and making it measurable.
- Quality experience in some form, such as review guidelines, QA, or audits.
- Clear writer, able to work with business leads, product managers, and engineers.
- Self-directed and comfortable working with limited direction.
- A technical background is not required. Prior experience designing evaluations or calibrating LLM judges is not required; training is provided.
Preferred
- Hands-on SQL, Python, or API experience.
- Trust and safety, content moderation, annotation operations, or other human-in-the-loop work at scale.
- Experience fine-tuning models or calibrating LLM judges.
- Background in a two-sided marketplace, travel, or another operations-heavy business.
- Experience setting up intake and prioritization for a new team.
Key Details
- Start date: November 23, 2026
- Duration: 12 months
- Location: Remote (within the U.S.)
- Work schedule: 40 hours/week (8 hours/day, 5 days/week)
- Pay rate range: $65-$75/hour + benefits
- Work Authorization: Must be authorized to work in the U.S. without sponsorship.
- Engagement: W-2 Contract
Job details
- Published
- October 27, 2026
- Job source
- breezy
- Workplace
- Remote · US
- First seen
- October 27, 2026
LiftmyCV exclusive data
Maleda Tech hiring intelligence
Maleda Tech currently has 10 active jobs tracked by LiftmyCV. 4 new jobs in the past 7 days.
Active openings
10
Currently tracked by LiftmyCV
New in 7 days
4
9 new jobs in the past 30 days
Published salaries
40%
Median disclosed salary: $106,080
Average opening age
13 days
Across 10 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • Sr. Account Executive, Hotel Partnerships
- • Junior Recruiter
- • Localization Content Manager, Korean
- • Localization Content Manager, Spanish (Latin America and Spain)
- • Luxury Market Manager
- • Open Source Community Engineer
Frequently requested skills
Median disclosed salary: $106,080 · 40% of jobs publish a salary
As of November 18, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Maleda Tech
Similar jobs from this company
- Senior Analytics Contractor, Product AnalyticsMaleda TechUSRemote$229,120–$266,240 per year
- Regional Associate, Growth & Competition (Great Lakes & Smoky Mountain Region)Maleda TechUSRemote
- Regional Associate, Growth & Competition (West Coast & Beach Region)Maleda TechUSRemote
- Regional Associate, Growth & Competition (Southeast & Gulf Region)Maleda TechUSRemote
- Regional Associate, Growth & Competition (Adventure & Rocky Mountain Region)Maleda TechUSRemote
- Sr. Account Executive, Hotel PartnershipsMaleda TechCharleston, USRemote$93,600–$118,560 per year
Across the market
Similar jobs from other companies
- AI Operations SpecialistProperESRemote
- AI Operations SpecialistMatificSydney, AUHybrid
- AI Operations Specialist28 Target India (Non-USA)Bangalore,IndiaOn-site
- AI Operations SpecialistOLXBucharest, RomaniaHybrid
- AI Operations SpecialistA01098 GE Vernova International LLCGreenvilleOn-site
- AI Operations SpecialistHoffmann BrothersMaryland Heights, USOn-site
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.