Confident AI

The LLM Eval and Observability Platform for AI Quality

Founding Developer Advocate

$130 - $1750.50% - 1.50%San Francisco, CA, US
Job type
Full-time
Role
Marketing
Experience
3+ years
Visa
US citizen/visa only
Connect directly with founders of the best YC-funded startups.
Apply to role ›
Jeffrey Ip
Jeffrey Ip
CEO & Cofounder

About the role

Overview

Confident AI is building the infrastructure that makes AI trustworthy. We created DeepEval, the open-source evaluation framework, and we're building the commercial platform that engineering teams use to ship reliable AI products. We have strong product-market fit, a developer community that's growing fast, and teams actively choosing us.

We're looking for a Founding Developer Advocate to own the developer experience from first touch to activation — across both our open-source framework and our commercial platform. You'll create the content, build the community, and represent us at events alongside the founding team.

This is a founding role with a seat at the table. You'll have full freedom to decide what to build, what to say, and how to say it. You won't be executing someone else's content calendar — you'll define the strategy and own the results. When developers tell you something about the product isn't working, you're in the room changing the roadmap, not filing a ticket.

What you'll be doing

  • Own developer content strategy and execution across both DeepEval (open-source) and the Confident AI platform (commercial product). These are distinct products with different audiences and different adoption paths — you'll understand both and create content that serves each.
  • Create onboarding content, demo videos, tutorials, and technical walkthroughs that help developers get value from the product fast.
  • Build and grow our developer community. Be present in the forums, Discord channels, GitHub discussions, and social platforms where our users spend time. Engage with them as a peer, not a marketer.
  • Represent Confident AI at developer events, meetups, and conferences alongside the founders. We're all out there building relationships and talking to developers — you'll be a key part of that.
  • Write technical blog posts, thought leadership, and sharp content that positions us as the authority in AI evaluation and testing infrastructure. Real insight, not recycled takes.
  • Be the voice of the developer internally. You'll have direct influence on product decisions based on what you're hearing from the community.
  • Own competitive positioning in developer conversations. Make sure we show up in every discussion where engineering teams are evaluating AI infrastructure solutions.
  • Coordinate with the founding team on product launches across both open-source and commercial products.

You should be someone who

  • 3+ years of experience in developer relations or developer advocacy at a developer tools, open-source, or infrastructure company. This is non-negotiable — the autonomy we're offering requires that you've done this before and done it well.
  • Has an existing network in the developer tools and AI community. You know people, and people know you. When you vouch for a product, it carries weight.
  • Understands the difference between open-source community building and commercial product marketing, and can navigate both authentically.
  • Can actually write — clear, sharp technical content that developers respect, not marketing copy they scroll past.
  • Comfortable on camera and on stage. You'll be producing video content and speaking at events regularly — this isn't optional.
  • Proficient with AI tools like Claude Code and Cursor as part of your daily workflow.
  • Technical enough to understand the product deeply and speak credibly to engineering teams about AI evaluation, testing, and observability.
  • Self-directed and high-agency. You don't wait to be told what to do — you identify what matters, make a plan, and ship.
  • Comfortable with ambiguity and fast iteration. We're a seed-stage startup; the playbook doesn't exist yet.

Your work will

  • Be the reason developers go from signing up to becoming active, engaged users of both DeepEval and the Confident AI platform.
  • Shape how the developer community perceives us and the category we're defining.
  • Directly influence product direction based on what you're hearing from developers every day.
  • Build the community and content engine that scales with the company from seed to market leader.

By joining us, you will

  • Full autonomy: You own the strategy. We're not hiring you to follow a playbook — we're hiring you to write it.
  • A seat at the table: Direct access to the founding team, influence on product decisions, and a voice in company strategy.
  • The problem: You'll work on the problem that makes all other AI work trustworthy. The impact ceiling here is massive.

About the interview

The entire process is usually fully remote and all communication happens over email or via video chat in Google Meet. We know that you may be interviewing elsewhere as well so are respectful of your time and will get back no later than 2 days of each step along the process.

The entire process has 4 steps and takes around 1.5 weeks in total:

  1. Initial 15-30 minute phone screening interview.
  2. One 30-45 minute technical interview.
  3. One week fully-paid work trial.
  4. Full-time offer.

No hires will be made without a work trial. You'll be working with the founders directly throughout the entire process.

About Confident AI

Confident AI is the leading LLM evaluation platform that helps teams evaluate, test, benchmark, optimize, monitor, and red-team LLM applications. Powered by DeepEval, the go-to LLM evaluation framework with over 600k monthly downloads, 5.3k GitHub stars, and over 40 million evaluations conducted, Confident AI is trusted by hundreds of companies from leading startups to international corporations.

Confident AI
Founded:2024
Batch:W25
Team Size:7
Status:
Active
Location:San Francisco
Founders
Jeffrey Ip
Jeffrey Ip
CEO & Cofounder
Kritin Vongthongsri
Kritin Vongthongsri
Co-Founder