LiftmyCVLiftmyCV
RU

Staff Software Engineer - Inference & Performance

RunwareRemoteTELECOMMUTE, United Kingdom

Job description

We’re looking for a Staff Engineer to take technical ownership of latency, throughput, and reliability across Runware’s AI inference platform. This is a senior technical leadership role for someone who obsesses over performance at scale, from request ingress through GPU execution to result delivery, and who can consistently turn ambitious targets such as sub-one-second inference into production reality. As a Staff Engineer, you will define and drive the architecture, standards, and execution needed to make Runware one of the fastest and most reliable inference platforms in the market. You will work deeply across backend services, distributed systems, GPU workloads, and infrastructure, partnering closely with product, ML, and platform teams. This role is ideal for someone who enjoys operating at the intersection of systems design, performance engineering, and real-world scale, and who wants clear ownership over outcomes that matter directly to customers.

What you’ll do

  • Own end-to-end inference performance across the platform, with clear responsibility for latency, throughput, and reliability targets
  • Lead the architecture and design of core inference systems, including request routing, async execution, queuing, GPU scheduling, and result delivery
  • Drive the platform toward sub-1 second inference where feasible, identifying bottlenecks across networking, services, storage, and GPU execution
  • Make high-impact architectural decisions with performance, scalability, and operational simplicity as first-class concerns
  • Partner with ML and model teams to ensure models are production-ready from a performance perspective (cold starts, batching, memory usage, concurrency)
  • Define performance budgets, SLAs, and success metrics, and ensure they are measured, visible, and actively improved
  • Lead deep-dive investigations into latency spikes, throughput degradation, and system-level performance issues
  • Influence and mentor engineers across teams on performance engineering, distributed systems thinking, and operational excellence
  • Improve tooling, observability, and profiling capabilities to make performance issues easier to detect and reason about
  • Advocate for pragmatic engineering best practices around testing, benchmarking, rollouts, and documentation

Job details

Published
January 28, 2026
Job source
jworkable
Workplace
Remote · TELECOMMUTE, United Kingdom
First seen
January 28, 2026
AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Runware

Similar jobs from this company

None listed.

Across the market

Similar jobs from other companies

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.