
Member of Technical Staff (Software Engineer, Enterprise Agent Evals & Efficiency)
Join Perplexity as a Member of the Technical Staff focused on improving enterprise agents for efficient workflows across tools and data. This hands-on engineering role encompasses the entire development process—from creating realistic evaluation environments to implementing changes that enhance agent performance. Responsibilities include analyzing agent failures, building infrastructure for evaluations, and developing strategies to improve task reliability and efficiency. Candidates should have over 5 years of software or machine learning engineering experience, demonstrating strong system design skills and proficiency in languages like Python, Go, or Rust.
Job description
About the Role
The Enterprise Agent Evals & Efficiency team makes Perplexity's agents better at completing real work across enterprise connectors, tools, and data. Our goal is to help agents choose the right tools, use the right context, and complete complex workflows reliably, with less time and compute. This team owns the improvement loop: define what successful work looks like, build evaluations that measure it, understand where agents fail, and ship changes that improve outcomes. This is a hands-on engineering role with end-to-end ownership, from building realistic enterprise evaluation environments to shipping improvements across the agent harness, tools, and skills. You'll create complex scenarios spanning connected systems, data, and permissions, use them to identify where agents struggle, and improve the tools agents call, the skills they follow, the context they receive, and the models they use. Working with AI Research, Connectors, and Platform teams, you'll turn experimental results into measurable gains in task success, latency, and cost per successful task. The goal is not just to measure agents, but to make more enterprise work reliable and practical to automate.
Key Responsibilities
- Build realistic enterprise evaluation environments spanning connected applications, representative datasets, user roles, and permissions, with complex, multi-step workflows and reproducible system state.
- Own evaluation infrastructure, task suites, and automated graders that measure how well agents complete enterprise work, calibrated against human judgment and grounded in end-to-end outcomes.
- Analyze agent trajectories and production failures, identify root causes, and ship improvements across the agent harness, tools, and skills that measurably improve task success and reliability.
- Develop reusable skills and improve tool descriptions, schemas, and result handling so agents can select the right tools, execute workflows correctly, and recover from errors with fewer unnecessary calls.
- Build and evaluate model-selection and routing strategies that match each task to the right model and effort level, balancing quality, latency, reliability, and cost.
- Improve agent efficiency through context management, skill loading, caching, and execution strategies that reduce wasted tokens and cost per successful task without compromising quality or safety.
- Build regression gates and launch-readiness signals for model, connector, tool, skill, and harness changes, and validate that evaluation gains translate into better production outcomes.
Qualifications
- 5+ years of software engineering or machine learning engineering experience, with a track record of owning complex production systems from design through deployment and operation.
- Strong system design skills, including building reliable, scalable infrastructure for experimentation, evaluation, or data-intensive applications.
- Strong proficiency in a backend language such as Python, Go, or Rust, and the ability to work effectively across a multi-language production stack.
- Hands-on experience building, evaluating, or improving LLM-based applications or agents, including tool use and multi-step workflows.
- Deep expertise in at least one of the following:
- Evaluation infrastructure, benchmark design, and automated grading.
- Agent harnesses, tool interfaces, and reusable skills for complex workflows.
- Realistic test environments or simulations spanning multiple systems, datasets, permissions, and stateful workflows.
- Model selection, routing, and inference efficiency, including context management and caching.
- Strong experimental and statistical judgment, including choosing representative tasks, defining meaningful success criteria, diagnosing failures, and distinguishing real improvements from noise.
- Sound technical judgment in balancing task quality, latency, reliability, and cost, with a track record of translating evaluation findings into shipped improvements.
- A track record of leading ambiguous, cross-team initiatives from architecture through production adoption, setting technical direction, and raising engineering quality through mentorship.
If you’re excited about this role, we encourage you to apply even if you don’t meet every qualification. We value demonstrated impact, deep ownership, and the initiative to turn ambiguity into results.
Job details
- Published
- October 19, 2026
- Experience
- Staff
- Job source
- ashby
- Workplace
- On-site · San Francisco, US
- First seen
- October 19, 2026
Skills mentioned in this job
LiftmyCV exclusive data
Perplexity hiring intelligence
Perplexity currently has 6 active jobs tracked by LiftmyCV. 3 new jobs in the past 7 days.
Active openings
6
Currently tracked by LiftmyCV
New in 7 days
3
5 new jobs in the past 30 days
Published salaries
—
Not published by this employer yet
Average opening age
12 days
Across 6 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • AI Software Engineer
- • Engineering Manager (Agent Engine)
- • Member of Technical Staff (Cybersecurity Solutions Architect)
- • Member of Technical Staff (Enterprise Security Engineer)
- • Member of Technical Staff (Software Engineer, Enterprise Trust & Governance)
- • Site Reliability Engineer
Frequently requested skills
As of November 17, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Perplexity
Similar jobs from this company
- Software Engineer, Enterprise Knowledge PlatformPerplexitySan Francisco, USOn-site
- Member of Data Staff (Data Acceleration)PerplexitySan Francisco, USOn-site
- Senior Commercial Counsel, EnterprisePerplexitySan Francisco, USHybrid
- Member of Technical Staff (Software Engineer, Fraud Prevention)PerplexityLondon, GBHybrid
- Member of Technical Staff (AI Policy and Strategic Initiatives)PerplexitySan Francisco, USOn-site
- Member of Technical Staff (AI Software Engineer, Agents)PerplexitySan Francisco, USOn-site
Across the market
Similar jobs from other companies
- Member of Technical Staff, Enterprise Evals PlatformMercorSan Francisco, US$180,000 per year
- Member of Technical Staff - EvalsP-1 AIUSRemote$170,000–$200,000 per year
- Member of Technical Staff, EvalsProfoundNew York, US$215,000–$300,000 per year
- Member of Technical Staff, EvalsHandshakeSan Francisco, USOn-site
- Member of Technical Staff, EvalsMagicSan Francisco, USRemote
- Member of Technical Staff, Data & EvalsHarveyNew York, USHybrid
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.