AI Inference Engineer
Evergrid is seeking an AI Inference Engineer to architect, build, and deploy high-scale production AI inference systems on our infrastructure. The role requires strong hands-on engineering skills alongside customer engagement, blending software development with performance engineering. A degree in Computer Science or a related field is preferred, along with at least a year of experience in a fast-paced engineering environment. This position offers the opportunity to work on critical GPU and power infrastructure for advanced AI workloads in a high-trust, high-bar environment.
Job description
Location
New York City (preferred)
Location Type
On-site • Hybrid • Remote (US-based)
Employment Type
Full-time
Department
Engineering — Applied AI & Inference
Compensation
- Competitive base salary
- Performance-based commission
- Equity
About Evergrid
Evergrid builds the infrastructure that powers advanced artificial intelligence at scale, with the most advanced AMD-native Neocloud platform. We design and operate critical GPU and power infrastructure for frontier AI workloads — environments where performance, reliability, and execution are non-negotiable. Our customers are building systems at the edge of what’s possible, and they depend on infrastructure that scales quickly and works under sustained pressure. We care deeply about outcomes, ownership, and building durable systems and long-term partnerships.
The Role
As an Applied AI Inference Engineer, you will work directly with Evergrid’s customers to architect, build, and deploy high-scale production AI inference systems on our infrastructure. You will own customer projects end to end — from early exploration through production deployment and monitoring — translating ambiguous goals into observable, reliable services with clear quality, latency, and cost outcomes. This is a hands-on engineering role that blends software development, inference performance engineering, and customer-facing execution. You’ll work closely with internal platform and infrastructure teams while embedding with customer engineering organizations.
What You’ll Do
- Design, build, and maintain production-grade software systems and inference services, with a strong emphasis on Python
- Own customer engagements end-to-end: problem framing, evaluation, proof-of-concept, production deployment, and monitoring
- Collaborate directly with customer engineering teams across sales, implementation, and expansion phases
- Turn ambiguous objectives into clear technical specifications and well-scoped PoCs
- Optimize AI/ML inference pipelines for latency, throughput, reliability, and cost
- Contribute improvements to Evergrid's inference stack, tooling, and platform capabilities
- Operate with high ownership — acting as engineer, technical lead, and execution driver for customer-facing initiatives
- Navigate ambiguity and make sound tradeoffs to deliver simple, maintainable solutions
What We’re Looking For
- Bachelor’s, Master’s, or PhD in Computer Science, Engineering, Mathematics, or a related field (or equivalent practical experience)
- 1+ years of professional experience in a fast-paced engineering environment
- Experience with SGlang, vLLM, and other inference engines & schedulers.
- Strong experience writing production-level software, with a preference for Python
- Familiarity with AI/ML pipelines and the lifecycle of model development, deployment, and monitoring
- Strong communication skills, particularly when discussing complex technical topics
- Experience building, deploying, or optimizing AI/ML systems is highly valued
- Comfort working directly with customers and owning outcomes end-to-end
How We Work
Evergrid is a high-bar, high-trust environment. We give engineers real ownership over customer outcomes and system design. You’ll work on infrastructure and inference systems where performance, reliability, and clarity matter — and where your work directly shapes how customers use AI in production.
Job details
- Published
- January 30, 2026
- Last checked
- November 17, 2026
- Job source
- ashby
- Workplace
- Hybrid · New York City, US
- First seen
- March 14, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Evergrid
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
- AI Inference EngineerEvergridNew York City, USHybrid
- AI Inference EngineerITRex GroupTRRemote
- AI Inference EngineerFuse EnergyLondon, GBRemote
- AI Inference EngineerPerplexitySan Francisco, LondonOn-site
- AI Inference EngineerF5, Inc. (United States)San Jose, USOn-site$176,600–$265,000 per year
- AI Inference EngineerBasetenSan Francisco, USHybrid
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.