Senior Software Workload Optimization Engineer
Join the NVIDIA numerics team as a Senior Software Workload Optimization Engineer focused on enhancing the efficiency of large language models (LLMs) using GPUs. In this role, you will conduct independent investigations into AI workloads, identify performance bottlenecks, and implement improvements to optimize GPU utilization. Candidates should have a bachelor's degree or equivalent, 5+ years of relevant experience, and a strong understanding of GPU architecture. This hybrid position requires a proactive approach, collaboration with workload owners, and the ability to communicate findings effectively.
Job description
Our numerics team at NVIDIA works on techniques that make LLMs more efficient. We’re looking for a software optimization engineer to help us get more useful work done from our GPUs. You’ll join a small team and independently lead investigations into a range of AI workloads. One current opportunity is reducing the GPU hours needed to evaluate models, but the work will evolve as priorities and bottlenecks change. You’ll approach workloads as systems: measure how they perform, identify what limits useful throughput, implement improvements, and verify the results. You don’t need to be an expert in quantization algorithms. We’re looking for someone who enjoys understanding how software uses GPUs and finding practical ways to make it run more efficiently.
What you’ll be doing:
- Investigate the performance of evaluation and other AI workloads across GPU systems.
- Identify bottlenecks in computation, memory, communication, data movement, orchestration, and resource allocation.
- Evaluate and improve parallelism configurations, including how work is distributed across GPUs and nodes.
- Understand how effectively workloads use GPU capabilities, including tensor cores, and identify opportunities to improve utilization.
- Implement and validate changes that reduce GPU hours per unit of useful work or increase throughput.
- Design clear benchmarks and measurements, accounting for tradeoffs among throughput, latency, resource use, and the quality or correctness of results.
- Partner with workload owners to understand requirements, test improvements, and help deploy solutions.
- Independently prioritize and drive optimization projects from investigation through measurable results.
What we need to see:
- Experience analyzing and improving the performance of compute-intensive software
- Bachelor’s degree or equivalent experience, and 5+ years of relevant experience
- Ability to reason about and optimize parallelism strategies – including tensor, data, pipeline, context, and expert parallelism – to balance throughput, communication overhead, and GPU resource use.
- Investigate unfamiliar code/systems and work directly with code owners to land end-to-end optimizations.
- Understanding of GPU architecture and the factors that affect utilization and application performance.
- Experience using profiling, benchmarking, and measurement to guide optimization decisions.
- Ability to work independently, communicate findings clearly, and collaborate with researchers and engineers.
- Three or more years of relevant experience.
Ways to stand out from the crowd.
- Optimizing AI training, inference, evaluation, or other large-scale GPU workloads.
- Working with GPU programming or machine learning frameworks and performance tools.
- Improving workload scheduling, batching, data pipelines, or multi-GPU configurations.
- Familiarity with collection and interpretation of GPU telemetry
- Energy-proportional computing or performance optimization under power, energy, or thermal design power budgets and experience with model quantization or numerical methods.
Success in this role means measurably reducing the GPU resources required to deliver useful results across our workloads. #LI-Hybrid Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 150,000 USD – 286,000 USD for Level 3; and 183,750 USD – 351,000 USD for Level 4. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until November 20, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
Job details
- Published
- November 16, 2026
- Experience
- Senior
- Job source
- myworkdayjobs
- Workplace
- On-site · Seattle, US
- First seen
- November 17, 2026
Skills mentioned in this job
LiftmyCV exclusive data
NVIDIA USA hiring intelligence
NVIDIA USA currently has 34 active jobs tracked by LiftmyCV. 17 new jobs in the past 7 days.
Active openings
34
Currently tracked by LiftmyCV
New in 7 days
17
31 new jobs in the past 30 days
Published salaries
68%
Median disclosed salary: $245,000
Average opening age
10 days
Across 34 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • Applied Research Scientist Intern, Agentic Biology - Summer 2027
- • Business Controls Specialist
- • Developer Relations Manager, Federal Cybersecurity
- • DriveOS Documentation Technical Program Manager
- • Enterprise Sales Intern - Summer 2027
- • Firmware System Integration Engineer
Frequently requested skills
Median disclosed salary: $245,000 · 68% of jobs publish a salary
As of November 18, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at NVIDIA USA
Similar jobs from this company
- Senior Software Engineer - GPUNVIDIA USASanta Clara, USOn-site$152,000–$241,500 per year
- Senior Manager, Software Engineering - Rack Scale Systems InfrastructureNVIDIA USASanta Clara, USOn-site$248,000–$391,000 per year
- Senior Software Engineer, Agentic EngineeringNVIDIA USASanta Clara, USOn-site
- Senior Cloud Software Engineer, Developer ToolsNVIDIA USASanta Clara, USOn-site
- Senior SoC Software EngineerNVIDIA USASanta Clara, USOn-site
- System Software Engineer - PerformanceNVIDIA USASanta Clara, USOn-site
Across the market
Similar jobs from other companies
- HPC and Financial Workload Optimization EngineerIntel Asia-Pacific Research & Development Ltd.Shanghai, CNOn-site
- Senior Performance Architect - Heterogeneous Workload OptimizationNVIDIA USASanta Clara, USOn-site$184,000–$287,500 per year
- Inference & Workload Optimization Lead (Horizon AI)STN IncRemoteRemote
- Software Engineer, Workload EnablementOpenAISan Francisco, USHybrid
- Datacenter & Agentic AI Workload Performance Optimization EngineerTenstorrentSanta Clara, USOn-site
- Analyst Workload ITMedline Industries India Pvt. Ltd.PuneOn-site
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.