LiftmyCVLiftmyCV

Senior Software Engineer, AI Infrastructure Solutions

NVIDIA GraphicsPLtd,PuneOn-sitePune, IN
AI job summary

NVIDIA is looking for a skilled Senior Software Engineer to join its AI Infrastructure Solutions team in Pune, India. This role involves designing and operating AI infrastructure solutions for LLM-based applications and autonomous agents, integrating LLMs through APIs, containerizing applications, and maintaining CI/CD pipelines. The ideal candidate will have a Bachelor's in Computer Science or related field and over 5 years of experience in software engineering, particularly with AI systems. Join NVIDIA to work on innovative technologies that impact industries globally.

Job description

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. NVIDIA is seeking an outstanding Senior Software Engineer to join our AI Infrastructure Solutions team in Pune. This is your opportunity to work on groundbreaking technologies and help build the future of computing! NVIDIA is a global leader in innovation, offering a dynamic and inclusive work environment in Pune or equivalent experience. We value diversity and provide equal opportunities to all candidates. If you’re passionate about building scalable AI platforms and autonomous agent solutions that impact industries worldwide, we want to hear from you!

What You’ll Be Doing:

  • Design, build, and operate AI infrastructure solutions that power LLM-based applications and autonomous agents across the enterprise.
  • Develop agentic AI workflows and multi-agent systems, including tool calling, planning, memory, retrieval-augmented generation (RAG), and orchestration using frameworks such as LangChain, LangGraph, or similar.
  • Integrate and serve LLMs through APIs and inference endpoints, optimizing for latency, throughput, cost, and reliability.
  • Containerize applications with Docker and deploy and scale them on Kubernetes, including Helm charts, autoscaling, and GPU-enabled workloads.
  • Take applications to L3 level: own production readiness, advanced troubleshooting, root-cause analysis, performance tuning, and escalation support for complex issues beyond L1/L2.
  • Define and maintain observability for AI systems, including logging, metrics, tracing, and monitoring of agent behavior, LLM quality, and system health.
  • Build and maintain CI/CD pipelines for automated build, test, and deployment of AI applications and infrastructure.
  • Develop high-performance backend services and RESTful APIs (Python and/or.NET Core) that expose AI capabilities to internal applications.

What We Need to See:

  • Bachelor’s or equivalent experience in Computer Science, Engineering, or a related field.
  • 5+ years of software engineering experience, with 2+ years working on AI/LLM-based solutions.
  • Hands-on experience building agentic AI and autonomous agent systems, including tool use, multi-agent orchestration, and RAG pipelines.
  • Strong experience with LLMs and their integration (OpenAI-compatible APIs, NVIDIA NIM, Hugging Face, or similar), prompt engineering, and evaluation.
  • Strong proficiency in Python; experience with C#/.NET Core and ASP.NET Core for REST API development is a plus.
  • Solid experience with Docker and Kubernetes, including deploying, scaling, and troubleshooting containerized workloads in production.
  • Proven experience supporting applications at L3 level, including incident management, debugging, performance optimization, and root-cause analysis.
  • Experience with CI/CD tools (GitHub Actions, Azure DevOps, GitLab CI, Jenkins) and Git-based workflows.

Ways to Stand Out from the Crowd:

  • Experience with GPU-accelerated workloads, NVIDIA AI Enterprise, NVIDIA NIM, Triton Inference Server, or NeMo.
  • Familiarity with MCP (Model Context Protocol) and agent-to-agent communication patterns.
  • Experience with LLM evaluation, guardrails, and safety frameworks.
  • Contributions to open-source AI or infrastructure projects.

NVIDIA delivers competitive pay, a wide range of benefits, and the possibility to contribute to groundbreaking technologies. Join us in building the future of computing! Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family

Job details

Published
November 5, 2026
Last checked
November 13, 2026
Experience
Senior
Job source
myworkdayjobs
Workplace
On-site · Pune, IN
First seen
November 5, 2026

Benefits

Competitive pay, a wide range of benefits, and the opportunity to contribute to groundbreaking technologies.

Skills mentioned in this job

PythonDockerKubernetesAILLM

LiftmyCV exclusive data

NVIDIA GraphicsPLtd,Pune hiring intelligence

NVIDIA GraphicsPLtd,Pune currently has 1 active jobs tracked by LiftmyCV. 1 new jobs in the past 7 days.

Verified November 13, 2026

Active openings

1

Currently tracked by LiftmyCV

New in 7 days

1

1 new jobs in the past 30 days

Published salaries

—

Not published by this employer yet

Average opening age

2 days

Across 1 active opening

Workplace breakdown

Remote0%
Hybrid0%
On-site100%

Hiring countries

India

Top hiring cities

Pune

Most in-demand roles

  • • Senior System Software Engineer - vGPU Team

Frequently requested skills

C
C++
GPU virtualization
hypervisors
Linux
virtualization technologies

As of November 18, 2026

Hiring insights calculated from active jobs tracked by LiftmyCV.

AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at NVIDIA GraphicsPLtd,Pune

Similar jobs from this company

Across the market

Similar jobs from other companies

Related job searches

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.