LiftmyCVLiftmyCV
BR

Customer Solutions Architect

BraintrustOn-siteSan Francisco

Job description

About the company

Braintrust is the AI observability platform. By connecting evals and observability in one workflow, Braintrust gives builders the visibility to understand how AI behaves in production and the tools to improve it. Teams at Notion, Stripe, Zapier, Vercel, and Ramp use Braintrust to compare models, test prompts, and catch regressions — turning production data into better AI with every release.

About the Role

We're looking for a Customer Solutions Architect to join our Field Engineering team. This is a deeply technical, customer-facing role focused on helping teams deploy and operate Braintrust in production environments. You’ll work with platform, DevOps, and ML infrastructure teams at leading AI-forward organizations to ensure Braintrust is running reliably — whether in our managed cloud or in their own environments. Braintrust is used to evaluate and monitor LLM-powered applications, and you’ll play a critical role in enabling those evaluation workflows by ensuring the underlying infrastructure is sound. You’ll support deployments, troubleshoot issues across layers, and guide best practices for scale, security, and maintainability. This role blends solution design, proactive support, and infrastructure guidance — ideal for someone who enjoys solving real-world problems with code, systems knowledge, and deep customer empathy. What You’ll Do

Customer Enablement & Support

  • Act as a trusted advisor to customers deploying and scaling Braintrust in production environments.
  • Lead onboarding and implementation engagements, including assisting with setup of customer-hosted infrastructure, configuration of observability pipelines, evaluation workflows, and integrations with third-party tools.
  • Help debug customer issues across layers (e.g., SDKs, cloud infrastructure, model outputs), coordinating with product and engineering when needed.
  • Own proactive health checks, upgrade support, and reliability best practices for customers running self-hosted deployments.

Solution Design & Implementation

  • Design and document end-to-end customer evaluation pipelines using Braintrust SDKs and APIs.
  • Build technical artifacts (scripts, templates, notebooks) that accelerate onboarding and our ability to support customers, or demonstrate platform capabilities.
  • Consult on architectural decisions, including LLM evaluation, prompt versioning, or how to structure evals for reliability and reproducibility.

Internal & Cross-functional Collaboration

  • Translate real-world usage and customer friction into actionable feedback for our product and engineering teams.
  • Partner with sales, support, and engineering to ensure seamless handoffs from pre-sales to post-sales and back.
  • Contribute to internal runbooks, implementation guides, and technical documentation.

What We’re Looking For

  • Strong interest in AI technology
  • Experience in customer-facing technical roles (e.g., Solutions Architect, Forward Deployed Engineer, Escalation Engineer, Technical Account Manager).
  • Fluency in Python or TypeScript and comfort debugging code, APIs, and infrastructure.
  • Strong grasp of DevOps infrastructure and cloud architecture, including technologies like Docker, Terraform, Kubernetes, and major clouds (AWS, GCP, Azure)
  • Ability to explain technical concepts clearly to both engineers and non-technical stakeholders.
  • Comfortable working autonomously in a fast-paced, startup environment.

Nice to Have

  • Experience with self-hosted or hybrid SaaS deployments.
  • Familiarity with LLM/AI development workflows and common tools in the ecosystem
  • Familiarity with Terraform, CI/CD pipelines, and networking/security best practices.

Why Join Braintrust

You’ll be joining a small, senior team solving one of the most important problems in modern AI development—ensuring reliability. We work with cutting-edge AI teams and move fast to deliver value. You’ll have broad ownership, a strong voice in the product, and the opportunity to help define how the world measures AI quality.

Benefits include

  • Medical, dental, and vision insurance
  • Daily lunch, snacks, and beverages
  • Flexible time off
  • Competitive salary and equity
  • AI Stipend

Equal opportunity

Braintrust is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Job details

Published
May 27, 2025
Job source
ashby
Workplace
On-site · San Francisco
First seen
January 30, 2026
AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Braintrust

Similar jobs from this company

None listed.

Across the market

Similar jobs from other companies

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.