LiftmyCVLiftmyCV

Member of Technical Staff (Index Engineer, Search Crawler)

PerplexityOn-siteLondon, GB

Job description

AI answers are only as trustworthy as the information behind them. Perplexity grounds its answers in fresh, real-world sources, and the index is what makes that possible. We're looking for an engineer to work on the indexing and data processing layer of Perplexity's Search Crawler. You'll build systems that ingest, process, and organize large volumes of crawled content into efficient, queryable structures, working primarily on offline and nearline pipelines that keep data fresh, complete, and accessible to downstream retrieval. Throughput, scalability, and correctness are critical across datasets that change continuously.

Responsibilities

  • Design, implement, and operate large-scale indexing systems and data pipelines at the core of Perplexity's search infrastructure.
  • Develop and optimize indexing strategies that balance performance, freshness, and resource efficiency.
  • Work on storage formats, compaction, and update mechanisms that keep data accessible and current.
  • Keep pipelines reliable and predictable under high-throughput conditions.
  • Build well-tested components with clear responsibilities and interface contracts that stay flexible as the system evolves.
  • Define and implement observability across offline and near line pipelines, including structured logs, metrics, and data quality signals.
  • Monitor throughput, resource usage, and cost, and drive optimisations as business needs change.
  • Partner with retrieval, ranking, and ML teams to make sure indexing outputs meet their requirements.
  • Enable safe experimentation on indexing strategies and processing logic through controlled rollouts and clearly defined quality signals.

Qualifications

  • 5+ years of experience building production backend or data infrastructure systems.
  • Strong programming experience in Go, C++, or Rust.
  • Experience with high-throughput data processing systems and very large datasets.
  • Experience building or operating databases, storage systems, data planes, or indexing pipelines.
  • Strong understanding of distributed systems, fault tolerance, consistency, and scalability.
  • Experience running production systems and handling operational incidents.
  • A systems-thinking mindset and the ability to reason about end-to-end data flows.

Job details

Published
November 17, 2026
Experience
Staff
Job source
ashby
Workplace
On-site · London, GB
First seen
November 17, 2026

LiftmyCV exclusive data

Perplexity hiring intelligence

Perplexity currently has 6 active jobs tracked by LiftmyCV. 3 new jobs in the past 7 days.

Active openings

6

Currently tracked by LiftmyCV

New in 7 days

3

5 new jobs in the past 30 days

Published salaries

—

Not published by this employer yet

Average opening age

12 days

Across 6 active openings

Workplace breakdown

Remote0%
Hybrid33%
On-site67%

Hiring countries

United States of America

Top hiring cities

San Francisco

Most in-demand roles

  • • AI Software Engineer
  • • Engineering Manager (Agent Engine)
  • • Member of Technical Staff (Cybersecurity Solutions Architect)
  • • Member of Technical Staff (Enterprise Security Engineer)
  • • Member of Technical Staff (Software Engineer, Enterprise Trust & Governance)
  • • Site Reliability Engineer

Frequently requested skills

Python
Go
Rust
automation
AWS
Compliance Frameworks
Cybersecurity
Datadog

As of November 17, 2026

Hiring insights calculated from active jobs tracked by LiftmyCV.

AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Perplexity

Similar jobs from this company

Across the market

Similar jobs from other companies

Related job searches

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.