LiftmyCVLiftmyCV

Research Scientist - Pre-training

Pluralis ResearchRemoteSan Francisco, US

Job description

Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. Despite being dismissed as infeasible, we have made significant advances on this problem, most recently Agora, a permissionless run that pretrained an 8B model from scratch on consumer GPUs spread over the internet, with no single participant ever holding the full weights (tech report). While many of the core research problems have been solved, Protocol Learning unlocks a series of new challenges. For the mission in full, read A Third Path: Protocol Learning. This setting breaks nearly every assumption of datacenter training: communication-efficient training across different parallelism axes, fault tolerance as nodes join and drop mid-run, heterogeneous compute and networks, and robustness to malicious participants. Our published methods include Subspace Networks, Factored Gossip DiLoCo, AsyncMesh, and Sentinel. As a Research Scientist you'll build the training system that takes Protocol Learning from the 8B run to frontier scale: large models on heterogeneous hardware, in physically different regions, connected by ordinary internet.

Key Responsibilities

  • Distributed pretraining: Implement and optimize model-parallel training. Data, pipeline, and tensor parallelism for large models on heterogeneous GPUs under low-bandwidth, high-latency links.
  • Performance optimization: Implement techniques that reduce communication overhead while maintaining model convergence in challenging network environments.
  • Elasticity and fault tolerance: Make runs survive node churn. Robust checkpointing, state synchronization, and recovery as participants join and leave.
  • Run instrumentation: Build the monitoring that shows throughput, bottlenecks, and model quality across hundreds of devices.

What We're Looking For

  • Hands-on distributed training (required): You've trained models across many devices in PyTorch with FSDP, DeepSpeed, Megatron, or your own implementation. You understand data, tensor, and pipeline parallelism.
  • Strong engineering: Production-quality Python. Concurrency, failure handling, profiling before optimizing.
  • Evidence of execution: Shipped systems, research code, open-source work, or serious personal projects.
  • Mission alignment: You believe Protocol Learning is the viable third path for collective, trustless, and sovereign AI.

Nice to Have

  • Hands-on experience training or serving large language models such as Nemotron, Qwen or OLMo.
  • Experience with P2P networking and NAT traversal.
  • Experience with post-training and RL.
  • Experience with inference and serving systems.
  • Experience at proprietary, open-weight and open-source AI labs

Compensation & Benefits

  • Equity-Heavy Package: We offer significant ownership for key technical contributors in addition to a high base salary.
  • Remote-First Culture: Flexible work environment with team members distributed globally.
  • Visa Sponsorship: Optional full visa sponsorship and relocation support to either Australia or the US.
  • Open Problems: Training and serving frontier models on hardware you don't control, over networks you don't own, mostly has no published answers yet. You'll write some of the first ones.

FYI's

  • We work remotely across the world, with the main teams in Australia and North America. You'll need to be comfortable working across timezones.
  • Applicants must have professional-level English proficiency (written and spoken).
  • Recruiters: we aren't looking for agency support at this time. We'll reach out if we need help.

We are backed by Union Square Ventures and other tier-1 investors, and we are a world-class, deeply technical team of ML researchers. Pluralis is unapologetically ideological. We believe AI, and the world, end up on a better path if we succeed in implementing the protocol for intelligence. If this resonates, please apply.

Job details

Published
October 13, 2026
Job source
ashby
Workplace
Remote · San Francisco, US
First seen
October 13, 2026

LiftmyCV exclusive data

Pluralis Research hiring intelligence

Pluralis Research currently has 4 active jobs tracked by LiftmyCV. 0 new jobs in the past 7 days.

Active openings

4

Currently tracked by LiftmyCV

New in 7 days

0

0 new jobs in the past 30 days

Published salaries

—

Not published by this employer yet

Average opening age

33 days

Across 4 active openings

Workplace breakdown

Remote100%
Hybrid0%
On-site0%

Hiring countries

United States of America

Top hiring cities

San Francisco

Most in-demand roles

  • • Research Scientist - Decentralized Training and Inference Verification
  • • Research Scientist - Geo-Distributed Inference
  • • Research Scientist - Post-Training
  • • Research Scientist - Pre-training

As of November 17, 2026

Hiring insights calculated from active jobs tracked by LiftmyCV.

AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

Visa sponsorship insights

Visa sponsorship available

This job posting states that visa sponsorship is available for qualified candidates.

More at Pluralis Research

Similar jobs from this company

Across the market

Similar jobs from other companies

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.