ML Systems Engineer, Inference Benchmarking
Job description
About CommonAI
CommonAI CIC is a non-profit organisation built around collaborative engineering and is backed by a mix of UK Government and private funding in order to design, build and deploy innovative AI systems. Our Scaling Inference Lab (SIL) is developing simulation grounded in real measurements to help the UK invest in promising AI infrastructure. We connect proposed hardware designs to realistic workloads, helping investors and engineers understand their potential, their limitations and the next experiment worth doing.
The Opportunity
Build the workloads and benchmarks that reveal how AI infrastructure performs on useful applications. You will develop reproducible LLM serving workloads, connecting application behaviour and requirements to physical measurements and SIL's simulation platform. The initial focus includes long-context inference and agentic workloads. You will investigate how request patterns, context lengths, caching, repeated model calls and interactions with tools shape the demands placed on a system. Your benchmarks will make performance comparisons meaningful by specifying the work being done and the quality and service requirements it must meet. Working with measurement and simulation engineers and our partners, you will help preserve the workload behaviour that matters when moving between real systems and models. Your work will help engineers and investors understand which infrastructure choices suit particular applications, and how conclusions change when the workload changes.
What you will do
- Build and maintain reproducible LLM serving workloads, serving configurations and benchmark tools, including long-context and agentic workloads, using suitable existing software.
- Characterise relevant behaviour such as request arrivals, prompt and output lengths, caching, batching, tool interactions and dependencies between requests.
- Define performance measures alongside application-quality and service requirements, so comparisons reflect useful work under stated conditions.
- Work with measurement engineers to reproduce workloads on physical systems, and with simulator engineers to develop workload representations that preserve the behaviour and dependencies that matter.
- Investigate how changes in workloads and serving configurations affect conclusions, and keep the benchmark suite relevant as inference technology and workloads evolve.
- Document datasets, model and software versions, configurations, provenance and permitted use so other engineers can reproduce and extend the work.
An example early project would be to build a reproducible agentic workload and work with measurement colleagues to compare its performance across two systems, under agreed application-quality and service requirements.
Job details
- Published
- October 22, 2026
- Job source
- jworkable
- Workplace
- Hybrid · Cambridge, GB
- First seen
- October 22, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at CommonAI C.I.C.
Similar jobs from this company
- Systems Software Engineer, Cluster Control and AutomationCommonAI C.I.C.Cambridge, GBHybrid
- Technical Lead, AI Systems SimulationCommonAI C.I.C.Cambridge, GBHybrid
- Software Engineer, AI Systems SimulationCommonAI C.I.C.Cambridge, GBHybrid
- Systems Performance Engineer, AI InfrastructureCommonAI C.I.C.Cambridge, GBHybrid
Across the market
Similar jobs from other companies
- Performance Engineer, Inference SystemsAnthropicSan Francisco, USHybrid$350,000–$850,000 per year
- Software Engineer, Inference SystemsRiver AI Inc.Palo Alto, USOn-site
- LLM Inference Systems EngineerHippocratic AIMenlo Park, US
- Analyst, BenchmarkingVisaAtlanta, GAHybrid
- Sr. AI Inference Systems EngineerTencent America LLCUnited States-California-Palo AltoOn-site
- Senior ML Systems Engineer, InferenceRunpodUSRemote$150,000–$220,000 per year
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.