Inference Performance & Deployment - Member of Technical Staff
Callosum is seeking a Member of Technical Staff focused on Inference Performance & Deployment. The role involves bridging internal engineering with real-world applications, creating methodologies that ensure empirical performance evaluations of their innovative infrastructure. Candidates should have experience in large model inference and familiarity with GPU deployments. The work includes running experiments, maintaining deployment patterns, and ensuring efficient performance characterizations across heterogeneous systems.
Job description
About Us
Artificial intelligence scaled on a bet - that bigger models, more identical chips, and more data would keep delivering. As problems grow more complex and the requirements of intelligence more diverse, that bet is breaking down. The next era belongs to heterogeneous intelligence: diverse models on diverse chips, each with distinct strengths, co-evolving into systems of capability unreachable by any single model or accelerator. Callosum is the Intelligent Systems company. We built the infrastructure to make that possible. Our co-evolution engine optimises simultaneously across workflows, agents, and silicon. We launched in early 2026 showing orders of magnitude improvements in performance and a shift in the cost-performance frontier that no single chip or model provider can provide. We believe intelligence comes from the system, not the model. We are scientists and engineers solving what others consider impossible. If you thrive on hard problems, and are passionate and energised by the scale of the challenge, we'd love to hear from you.
About the Role
Callosum believes that orders of magnitude improvements in AI systems will come through application-aware orchestration across heterogeneous hardware. We are building that vision: infrastructure that treats the full landscape of compute as a unified, co-evolving system, evolved beyond GPUs. This role owns the bridge between Callosum's internal engineering and the real world. You design the tooling and methodologies that ground our technology in real-world performance and behaviour, sitting at the integration point of every engineering function. You will be the first to run our heterogeneous infrastructure in production-equivalent conditions, systematically characterising performance, identifying bottlenecks, and driving decisions on production-readiness. Your work ensures that every layer of the stack is guided by empirical evidence rather than assumption.
What You’ll Build
- Run experiments self-hosting models on cloud instances or on-prem across providers and hardware configurations, systematically characterising performance envelopes
- Develop and maintain deployment patterns that are reproducible, measurable, and optimised for latency, throughput, and cost
- Work at the orchestration and routing software that sits above the inference engine - to improve caching, request scheduling, batching, and resource allocation
- Act as the integration point for the other roles: consume new accelerator support, engine features, and infrastructure upgrades – to provide high-quality feedback on bottlenecks, essential capabilities, and guide the stack optimisations
- Build and maintain benchmarking harnesses, regression suites, and performance dashboards that give the team a shared view of system health and progress
What You Bring
- Experience deploying and benchmarking large model inference in production or production-equivalent environments
- Familiarity with multi-node GPU deployments and associated networking/communication stacks
- Strong end-to-end performance characterisation skills: able to isolate whether a bottleneck is in the network, the runtime, the memory subsystem, or the model itself
- Familiarity with serving frameworks like Dynamo, Triton Inference Server, or similar orchestration layers
- Clear communication skills - able to translate performance data into actionable, prioritised feedback for the teams building the underlying systems
- A demonstrable disciplined and systematic approach to deployment: reproducibility, measurement methodology, controlled comparisons, etc
Job details
- Published
- May 20, 2026
- Last checked
- November 17, 2026
- Job source
- ashby
- Workplace
- Remote · London, GB
- First seen
- May 20, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Callosum
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.