
Member of Technical Staff (Index Engineer, Search Crawler)
Job description
AI answers are only as trustworthy as the information behind them. Perplexity grounds its answers in fresh, real-world sources, and the index is what makes that possible. We're looking for an engineer to work on the indexing and data processing layer of Perplexity's Search Crawler. You'll build systems that ingest, process, and organize large volumes of crawled content into efficient, queryable structures, working primarily on offline and nearline pipelines that keep data fresh, complete, and accessible to downstream retrieval. Throughput, scalability, and correctness are critical across datasets that change continuously.
Responsibilities
- Design, implement, and operate large-scale indexing systems and data pipelines at the core of Perplexity's search infrastructure.
- Develop and optimize indexing strategies that balance performance, freshness, and resource efficiency.
- Work on storage formats, compaction, and update mechanisms that keep data accessible and current.
- Keep pipelines reliable and predictable under high-throughput conditions.
- Build well-tested components with clear responsibilities and interface contracts that stay flexible as the system evolves.
- Define and implement observability across offline and near line pipelines, including structured logs, metrics, and data quality signals.
- Monitor throughput, resource usage, and cost, and drive optimisations as business needs change.
- Partner with retrieval, ranking, and ML teams to make sure indexing outputs meet their requirements.
- Enable safe experimentation on indexing strategies and processing logic through controlled rollouts and clearly defined quality signals.
Qualifications
- 5+ years of experience building production backend or data infrastructure systems.
- Strong programming experience in Go, C++, or Rust.
- Experience with high-throughput data processing systems and very large datasets.
- Experience building or operating databases, storage systems, data planes, or indexing pipelines.
- Strong understanding of distributed systems, fault tolerance, consistency, and scalability.
- Experience running production systems and handling operational incidents.
- A systems-thinking mindset and the ability to reason about end-to-end data flows.
Job details
- Published
- November 17, 2026
- Experience
- Staff
- Job source
- ashby
- Workplace
- On-site · London, GB
- First seen
- November 17, 2026
LiftmyCV exclusive data
Perplexity hiring intelligence
Perplexity currently has 6 active jobs tracked by LiftmyCV. 3 new jobs in the past 7 days.
Active openings
6
Currently tracked by LiftmyCV
New in 7 days
3
5 new jobs in the past 30 days
Published salaries
—
Not published by this employer yet
Average opening age
12 days
Across 6 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • AI Software Engineer
- • Engineering Manager (Agent Engine)
- • Member of Technical Staff (Cybersecurity Solutions Architect)
- • Member of Technical Staff (Enterprise Security Engineer)
- • Member of Technical Staff (Software Engineer, Enterprise Trust & Governance)
- • Site Reliability Engineer
Frequently requested skills
As of November 17, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Perplexity
Similar jobs from this company
- Member of Technical Staff (Software Engineer, Enterprise Agent Evals & Efficiency)PerplexitySan Francisco, USOn-site
- Member of Data Staff (Data Acceleration)PerplexitySan Francisco, USOn-site
- Member of Technical Staff (Software Engineer, Fraud Prevention)PerplexityLondon, GBHybrid
- Member of Technical Staff (AI Policy and Strategic Initiatives)PerplexitySan Francisco, USOn-site
- Member of Technical Staff (AI Software Engineer, Agents)PerplexitySan Francisco, USOn-site
- Member of Technical Staff (Software Engineer, Training Infrastructure)PerplexitySan Francisco, USOn-site
Across the market
Similar jobs from other companies
- Member of Technical Staff (Search Crawler Analyst)PerplexityBelgradeHybrid
- Member of Technical Staff (Search Core, Indexing & Data Pipeline Stream)PerplexityBelgradeOn-site
- Member of Technical Staff, Retrieval & IndexingParallel Web SystemsSan Francisco or Palo Alto
- Member of Technical Staff, SearchCohereUSRemote
- Backend Software Engineer - Search, Crawler TeamPerplexityBelgradeOn-site
- Member of Technical Staff - X SearchxAIPalo Alto, USOn-site$180,000–$440,000 per year
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.