Founding Machine Learning Engineer
Raindrop is creating a solution for AI agents to prevent silent failures and improve visibility. The role entails building a world-class product, architecting ML pipelines, and understanding customer needs. The ideal candidate should have a growth mindset, proven experience in scaling applications, and an interest in AI products. This position requires being in San Francisco or willingness to relocate.
Job description
Raindrop
Raindrop is building Sentry for AI Agents. Engineering teams at companies use Raindrop to get alerts about silent failures with their AI agents. Raindrop sends alerts when AI agents misbehave and links straight to the events, so AI engineers can dig into the conversations or traces, understand the root cause, and fix it, fast.
Why It Matters
AI agents fail constantly in ways both hilarious and terrifying. Regular software throws exceptions. But AI agents fail silently, leaving engineers with almost no visibility into how their agents are actually performing. The current status quo is sifting through millions of logs and trying debug flaky evals that just aren't matching real-world results. Evals are like unit tests, they confirm your model got specific test cases right. But in the real world agents call thousands of tools, run for hours, and encounter millions of unpredictable actions. That’s where Raindrop comes in. It learns the unique shape of each AI agent’s issues. Starting from presets like Laziness, Forgetting, or Task Failure, to automatically tuning itself to each agent. With one click of a button, AI engineers start tracking issues or topics across 100% of their production data. They can see frequency over time, how many users are affected, relevant properties, and more. In order to process hundreds of millions of events, we gradually train small, custom models, private to each company, that learn to uniquely understand how their product is used. As part of the early team, you’ll play a fundamental role in shaping the company - from making strategy and product decisions, to helping scale the team, to shaping the future of AI agents.
Our Investors
We’re backed by incredible investors, including Lightspeed and leading AI companies, including Figma Ventures, Vercel Ventures, founders of Replit (Amjad Masad and Michele Castata), Cognition (Walden Yan), Framer (Koen Bok and Joen van Dijk), Speak (Andrew Hsu), Notion (Akshay Kothari), and more.
Your Focus
- Build out a world-class product - servicing millions of requests a day + growing.
- Architect, implement, and scale ML pipelines.
- Quick iteration without compromising on quality.
- Deeply understand the customer.
Ideal Candidate
- Knows how to balance short-term and long-term speed.
- Proven experience scaling applications.
- Interest in AI products + tools (ideally experience building these or an avid user).
- Growth mindset.
- Cares about building well-designed products.
- Willing to do whatever it takes to solve a problem.
- Must be in person in San Francisco (or willing to move).
Job details
- Published
- March 13, 2026
- Job source
- ashby
- Workplace
- On-site · San Francisco, CA
- First seen
- March 13, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Raindrop
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
- Founding Machine Learning EngineerRaindropSan Francisco, USOn-site
- Founding Machine Learning EngineerCapableSan Francisco, USOn-site$200,000–$500,000 per year
- Founding Machine Learning EngineerStealth DeepTechSan Francisco, USOn-site$200,000–$500,000 per year
- Founding Machine Learning EngineerArcadeSan Francisco, US$230,000 per year
- Founding Machine Learning EngineerCleraSan Francisco, US$170,000–$200,000 per year
- Founding Machine Learning EngineerCentralizeSan Francisco, USRemote
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.