Staff AI Engineer
Job description
Our Engineering organisation is scaling its AI Engineering capabilities under new leadership, creating an opportunity to shape the next generation of AI at Rapid7. We’re looking for Staff AI Engineers to drive the design and delivery of sophisticated LLM and agentic AI systems, influencing technical direction across teams and solving complex, cross-functional challenges. You’ll establish engineering best practices, guide architectural decisions and mentor other engineers, helping translate customer needs into scalable AI solutions that advance our product and platform capabilities.
About the Team
AI is reshaping cybersecurity on both sides. Attackers can use AI to strike at machine speed, and only AI-powered defense can keep up. At the same time, organizations can only adopt AI with confidence if it is secure. Rapid7 sits at the intersection of security and AI, and we are building industry-defining products for this new era. Rapid7's AI Engineering team builds the AI that powers our security platform. We are AI engineers and applied scientists who take models from research to production, combining open-source and frontier LLMs, AI agents, and fast predictive models with more than 20 years of Rapid7 security expertise. Our work drives core use cases across Detection and Response, such as alert triage, threat investigation, and automated response, and Exposure and Remediation, such as vulnerability prioritization, attack surface risk assessment, and guided remediation. Together, these help customers stop threats faster and fix what matters most.
About the Role
As a Staff AI Engineer, your primary responsibility will be to design, build and ship LLM and agentic AI systems across Rapid7’s security products, owning the technical solutions for your area end to end. You understand LLMs from transformer internals to fine-tuning and inference optimization, stay hands-on with hard problems, and know where LLMs shine and where they fall short, choosing the right approach among LLMs, predictive AI and classical ML. Specifically, your focus will be to:
- Lead the design and architecture of LLM and agentic AI systems within Detection and Response and Exposure and Remediation, contributing to the technical roadmap for your area
- Recommend model strategy for your projects, including when to use frontier or open-source models and when to fine-tune, distill, or post-train
- Fine-tune, distill and post-train open-source LLMs on security data, from data curation through training, evaluation and deployment
- Apply and improve engineering practices for context engineering, inference optimization and evaluation, optimizing LLM inference to balance quality, latency and cost
- Establish evals as the release gate for the AI systems you ship
- Lead design reviews for your projects and work through complex technical trade-offs
- Stay hands-on by prototyping and building critical model, training and inference code
- Mentor engineers on your team and partner with Product and platform teams to align technical solutions with customer needs
The skills and qualities you’ll bring include:
- 8+ years of software or ML engineering experience including 2+ years building production LLM or agentic AI systems. A Master’s degree in Computer Science, Machine Learning, AI or a related field is preferred, or equivalent practical experience
- A track record of leading the delivery of scalable, production-grade AI systems used by multiple teams or products, with impact across the organisation through technical leadership and mentoring
- A deep understanding of LLMs, including transformer architecture, attention, tokenization and positional encodings, and how models are trained and served
- Advanced PyTorch skills, including custom model code, training loops, mixed precision and distributed training (e.g., FSDP, DeepSpeed)
- Hands-on fine-tuning and post-training of open-weight LLMs, including full and parameter-efficient methods (LoRA, QLoRA), distillation, and preference or RL-based methods (e.g., DPO, GRPO)
- Experience with context engineering (retrieval, memory, and context management for long-running agent workflows) and defining evaluation strategy and benchmarks for LLM and agent systems
- Strong knowledge of inference optimization, including prefill and decode, KV-cache management, continuous batching, speculative decoding and quantization, and serving at scale with vLLM, SGLang or TensorRT-LLM
- Strong predictive AI, classical ML, distributed systems and Python fundamentals, with the judgment to make efficient, well-reasoned decisions between these approaches and LLMs based on accuracy, latency and cost
- Lead AI projects or programs of moderate scope and risk, contributing to the execution strategy, breaking larger goals into milestones, and holding yourself and others to clear expectations and commitments
- Takes ownership of complex technical outcomes across teams, proactively managing risks and dependencies, following through on commitments and driving issues to resolution.
- A strong communicator who can explain complex technical concepts and trade-offs to technical and non-technical audiences, building alignment around engineering decisions
- Builds strong cross-functional partnerships across Engineering, Product and other teams to resolve dependencies, align technical approaches and deliver shared outcomes
- Translates customer needs into scalable AI solutions, balancing customer value, performance and the cost of developing and running AI systems to deliver commercially viable outcomes
- Embody our core values to foster a culture of excellence that drives meaningful impact and collective success.
We know that the best ideas and solutions come from multi-dimensional teams. That’s because these teams reflect a variety of backgrounds and professional experiences. If you are excited about this role and feel your experience can make an impact, please don’t be shy - apply today. 
#LI-AK1

About Rapid7
At Rapid7, our vision is to create a secure digital world for our customers, our industry, and our communities. We do this by harnessing our collective expertise and passion to challenge what’s possible and drive extraordinary impact. We’re building a dynamic and collaborative workplace where new ideas are welcome. Protecting 11,500+ customers against bad actors and threats means we’re continuing to push the envelope just like we’ ve been doing for the past 20 years. If you ’re ready to solve some of the toughest challenges in cybersecurity, we’re ready to help you take command of your career. Join us.
Job details
- Published
- October 30, 2026
- Last checked
- November 13, 2026
- Experience
- Staff
- Job source
- myworkdayjobs
- Workplace
- On-site · Pune, United States, IN
- First seen
- October 30, 2026
LiftmyCV exclusive data
mymoose hiring intelligence
mymoose currently has 1 active jobs tracked by LiftmyCV. 0 new jobs in the past 7 days.
Verified November 13, 2026
Active openings
1
Currently tracked by LiftmyCV
New in 7 days
0
1 new jobs in the past 30 days
Published salaries
100%
Median disclosed salary: $193,600
Average opening age
12 days
Across 1 active opening
Workplace breakdown
Hiring countries
Most in-demand roles
- • Principal Solutions Experience Engineer - Platform Delivery
Frequently requested skills
Median disclosed salary: $193,600 · 100% of jobs publish a salary
As of November 18, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at mymoose
Similar jobs from this company
Across the market
Similar jobs from other companies
- Staff AI EngineerSpotOnSan Francisco, USHybrid
- Staff AI EngineerMLabsCARemote$175,000–$250,000 per year
- Staff AI EngineerWATI.ioHong Kong, HKRemote
- Staff AI EngineerModernizing Medicine, Inc.Boca Raton, FLOn-site
- Staff AI EngineerStravaSan Francisco, USHybrid
- Staff AI EngineerAirwallexSan Francisco, USHybrid
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.