LiftmyCVLiftmyCV

Software Engineer, Knowledge Engine – Data Infrastructure

ExaZurich, CH
AI job summary

Join Exa's Knowledge Platform team as a Software Engineer, focusing on building and operating large-scale data construction pipelines. Your role will involve synthesizing information from diverse sources to create an extensive knowledge graph with billions of claims. You will handle complex challenges related to data trust, entity resolution, and ensuring data consistency. A strong background in building distributed data pipelines, particularly with Spark, and proficiency in Python are essential. This is a greenfield opportunity where foundational decisions will shape the future of the knowledge engine.

Job description

The Knowledge Platform team builds Exa's knowledge engine. We continuously synthesize information from across the web and beyond into one of the world's largest open-domain knowledge graphs, with hundreds of billions of evidence-backed claims. The work has two halves: construction pipelines that decide what to trust, and retrieval engines that decide how best to search it. Our goal is to give agents answers to any factual question about the world with unprecedented precision and completeness. In this role, you'll build the knowledge construction pipelines: turning everything from a 100k docs/s web crawl to vendor datasets into a graph of what is true about the world, and keeping it correct as data changes. This is greenfield work with a massive scope. There is no off-the-shelf system for building a model of the world from the open web, so you'll make foundational decisions, from how claims are represented and resolved to how trust is assigned and how the graph evolves over time, that everything built on top of it depends on.

What you'll do

  • Continuously synthesize the live web crawl, vendor deliveries and APIs, and other off-the-web sources into one typed graph: extraction that turns pages and records into ontology-shaped claims, each carrying its provenance, timestamp and confidence.
  • Bring every new source in cleanly: versioned, append-only history with schema evolution, late-arriving and corrected records, and replayable cursors, so every claim traces back to the exact delivery that produced it.
  • Decide what to trust: entity resolution across billions of records (blocking, pairwise scoring, clustering) into canonical people, companies, places and publications, then truth discovery that weighs source reliability, recency and corroboration to reconcile conflicting claims.
  • Keep that picture current and convergent: streams arrive continuously, out of order and at very different rates, so the graph is eventually consistent by design. You'll build incremental computation over change data feeds, where each update is a diff of what changed and every job is idempotent and resumable, so the graph converges to the same state however runs interleave, fail or replay, and readers only ever see committed, consistent versions.
  • Measure precision and completeness: labeled evals for extraction and resolution, per-source coverage and correctness metrics, and lineage that pinpoints which source or stage broke and why.

What we're looking for

  • You've built and operated large-scale distributed data pipelines in production over petabytes of structured and unstructured data, with Spark over a lakehouse format (Delta Lake, Iceberg, Hudi).
  • You understand incremental processing deeply: change data capture, idempotent writes, backfills and reprocessing.
  • Strong in Python and at least one systems language; you can read and tune Spark query plans.
  • You obsess over correctness, reliability and data quality as much as scale.

Bonus

  • Entity resolution, record linkage, knowledge graphs or ontologies
  • Information extraction or truth discovery at scale
  • Lance or other columnar/vector-native formats

Example projects

  • Take a new billion-row dataset from first delivery to queryable entities in days, not months.
  • Keep a graph of hundreds of billions of claims current with incremental updates, so a fact that changes on the web reaches it in minutes.
  • Build a system that knows every company and person in the world, with one evidence-backed record each, resolved across the web and every source we ingest.

Exa is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, creed, color, religion, sex, sexual orientation, gender identity or expression, national origin, disability, age, veteran status, marital status, pregnancy or related conditions, criminal histories consistent with applicable law, or any other basis protected by applicable law.

Job details

Published
November 10, 2026
Last checked
November 17, 2026
Job source
ashby
First seen
November 10, 2026

Requirements

  • Experience with large-scale distributed data pipelines over petabytes of structured and unstructured data.
  • Strong in Python and at least one systems language; ability to tune Spark query plans.
  • Understanding of incremental processing, change data capture, and data reliability.

Skills mentioned in this job

PythonSparkData PipelinesEntity Resolution

LiftmyCV exclusive data

Exa hiring intelligence

Exa currently has 26 active jobs tracked by LiftmyCV. 3 new jobs in the past 7 days.

Verified November 17, 2026

Active openings

26

Currently tracked by LiftmyCV

New in 7 days

3

25 new jobs in the past 30 days

Published salaries

—

Not published by this employer yet

Average opening age

17 days

Across 26 active openings

Workplace breakdown

Remote33%
Hybrid0%
On-site67%

Hiring countries

United States of America
Switzerland
United Kingdom
Australia
India

Top hiring cities

San Francisco
Zurich
London
New York
Sydney

Most in-demand roles

  • • Solutions Architect
  • • Software Engineer, Knowledge Engine – Query Engine
  • • Account Executive
  • • FDE Lead
  • • Field Event Manager
  • • Forward Deployed Engineer

Frequently requested skills

programming
communication
presales
technical sales
APIs
C++
Python
Rust

As of November 17, 2026

Hiring insights calculated from active jobs tracked by LiftmyCV.

AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Exa

Similar jobs from this company

Across the market

Similar jobs from other companies

Related job searches

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.