LiftmyCVLiftmyCV
TA

Research Intern, Frontier Speculative Decoding (Summer 2027)

Together AIOn-siteSan Francisco, US$120,640–$145,600 per year
AI job summary

Together AI is seeking a Research Intern for their Speculative Decoding team. This role involves working on algorithms that enhance the performance of large language models. Responsibilities include researching and prototyping new algorithms, training draft models at scale, and validating research hypotheses through rigorous experiments. Candidates should be pursuing a Master's or Ph.D. in Computer Science or related fields, with expertise in machine learning. The internship lasts 12-14 weeks during the summer of 2027, providing exposure to industry-leading engineers and projects.

Job description

About the Role

The Speculative Decoding team at Together AI builds the draft models and algorithms that let large language models generate faster without changing their outputs. Our speculators run in production on frontier open models such as DeepSeek, Kimi and GLM. Our work sits at the intersection of model training, inference algorithms and serving systems, and we co-design all three to lower the cost and latency of generation. As a research intern, you will dive into open questions in speculative decoding: new drafter architectures and verification schemes, knowledge distillation and training recipes that align draft and target models, and drafters that adapt as traffic shifts. You will train and fine-tune draft models at scale on dedicated GPU clusters, and test your ideas against realistic serving workloads, including long-context and agentic traffic. Projects aim to answer important research questions in speculative decoding, enabling faster generation on frontier models, drafters that keep pace with changing workloads, and robust, reproducible evaluation under real traffic. Past Research

Speculative decoding research by Together researchers, interns and academic collaborators includes:

  • Speculative Speculative Decoding (ICLR 2026)
  • When RL Meets Adaptive Speculative Training: A Unified Training-Serving System (ICML 2026)
  • Beat the Long Tail: Distribution-Aware Speculative Decoding for RL Training (MLSys 2026)

Responsibilities

  • Research and prototype new efficient speculative decoding algorithms and draft model architectures
  • Train, fine-tune and distill draft models, and design rigorous experiments to validate hypotheses.
  • Implement optimized version for serving engines to show efficacy in real world workloads
  • Communicate the plans, progress, and results of projects to the broader team
  • Share findings through technical write-ups and blog posts, and help bring successful ideas into production

Requirements

  • Currently pursuing a Master's or Ph.D. degree in Computer Science, Electrical Engineering, or a related field
  • Strong knowledge of Machine Learning and Deep Learning fundamentals
  • Hands-on experience training or fine-tuning large models with distributed training frameworks (e.g., Megatron-LM, FSDP)
  • Familiarity with modern model architectures, such as Mixture-of-Experts and hybrid attention

Preferred Qualifications

  • Prior research experience in speculative decoding, efficient inference, or efficient machine learning
  • Publications at leading conferences in machine learning or systems (e.g., NeurIPS, ICML, ICLR, MLSys)
  • Experience with knowledge distillation, post-training, or reinforcement learning
  • Familiarity with LLM serving engines (e.g., vLLM, SGLang, TensorRT-LLM)
  • Contributions to open-source machine learning projects

About Together AI

Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.

Internship Program Details

Our internship program runs 12 to 14 weeks, giving you the opportunity to work alongside industry-leading engineers and researchers across multiple teams. This cohort's internship dates span May 17th to August 6th or June 14th to September 3rd.

Compensation

We offer competitive compensation, housing stipends, and other competitive benefits. The estimated US hourly rate for this role is $58 - $70 an hour. Our hourly rates are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. For more information about our privacy policy, please visit:

Job details

Published
October 16, 2026
Last checked
November 16, 2026
Experience
Intern
Job source
greenhouse
Workplace
On-site · San Francisco, US
First seen
October 17, 2026

Skills mentioned in this job

Machine LearningDeep LearningDistributed TrainingModel Architectures

LiftmyCV exclusive data

Together AI hiring intelligence

Together AI currently has 23 active jobs tracked by LiftmyCV. 4 new jobs in the past 7 days.

Verified November 16, 2026

Active openings

23

Currently tracked by LiftmyCV

New in 7 days

4

15 new jobs in the past 30 days

Published salaries

43%

Median disclosed salary: $233,750

Average opening age

62 days

Across 23 active openings

Workplace breakdown

Remote4%
Hybrid0%
On-site96%

Hiring countries

United States of America
United Kingdom
India
Netherlands

Top hiring cities

San Francisco
London
Amsterdam
New York

Most in-demand roles

  • • (Senior/Junior AI Inference Reliability Engineer, Compute Infra
  • • CX Ops Specialist
  • • Director of Investor Relations
  • • Director, Debt Capital Markets
  • • Engineering Manager, Kubernetes Bare Metal Infrastructure
  • • Event & Field Marketing Specialist

Frequently requested skills

AI
InfiniBand
Kubernetes
Ansible
communication
debt capital markets
Deep Learning
distributed systems

Median disclosed salary: $233,750 · 43% of jobs publish a salary

As of November 17, 2026

Hiring insights calculated from active jobs tracked by LiftmyCV.

AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Together AI

Similar jobs from this company

Across the market

Similar jobs from other companies

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.