Zep AI

Agent Context Is Hard. We Fixed It.

Applied Research Engineer

$180K - $250K1.00% - 1.50%San Francisco, United States / Remote (US)
Job type
Full-time
Role
Engineering, Backend
Experience
6+ years
Visa
US citizen/visa only
Skills
Amazon Web Services (AWS), C++, Go, Python, Rust, Torch/PyTorch, LLMs
Connect directly with founders of the best YC-funded startups.
Apply to role ›
Daniel Chalef
Daniel Chalef
Founder

About the role

Zep is the memory and context layer for AI agents. As a Senior Applied Research Engineer, you'll explore novel approaches to memory, context, and context generation, then own those ideas all the way to production.

This is a research role with a hard applied bent. We're not hiring ML researchers chasing publications. We're hiring engineers who can run rigorous experiments, train and evaluate models, and ship the result as production code our customers depend on.

How we work

We're a small, distributed team that works closely together. We pair on hard problems, review each other's designs, and treat learning as part of the job rather than something that happens after hours. We ask a lot of questions: of customers, of teammates, of our own assumptions. When we find pain, we go fix it.

We expect the same back: ask questions early, push back when you disagree, and care about the people on the other end of the API.

What you'll do

  • Explore novel approaches to memory, context, and context generation. Define the problem, run the experiments, ship the result.
  • Own research to production end-to-end: dataset creation and curation, experiment design, evaluation, training and finetuning, and production deployment.
  • Train, finetune, and evaluate models on Zep's domain. Build the eval harnesses that catch regressions before they ship.
  • Work with our model serving stack to operate inference at low latency and reasonable cost on AWS.

What we're looking for

  • 6+ years of production engineering with a strong backend systems background. You've shipped services with real throughput and latency requirements.
  • Master's in Computer Science or equivalent.
  • Strong research skills: methodology, dataset creation and curation, experiment design, and evaluation. You can frame an open problem and design experiments that actually answer the question.
  • Hands-on experience with model finetuning. Working familiarity with transformer architectures, training and finetuning workflows, and evaluation. PyTorch and OpenAI Triton for experimentation.
  • Working experience with model serving technologies: vLLM, SGLang, or Triton Inference Server. You've operated inference in production.
  • Python, plus high proficiency in one of Rust, C++, or Go. You can work in critical-path code and on performance. Python-only is not enough.
  • Hands-on AWS experience in production: deployments, monitoring, scaling, cost and reliability tradeoffs.

Nice to have

  • Published or open-source work in retrieval, memory systems, or LLM evaluation.

Tech stack: Python, Rust/C++/Go, PyTorch, vLLM/SGLang, AWS.

This role is probably NOT a fit if:

  • You're an ML researcher or model trainer who hasn't shipped research to production.
  • Your background is primarily Python application work without lower-level systems experience.
  • You haven't operated production backend systems with real latency or throughput requirements.

About the interview

We respect your time and keep our interview process tight and focussed.


Screening Call (w/ Daniel, our Founder) → Team Calls (2-3 hours back-to-back, may include a presentation) → Decision Call (Daniel, again)

About Zep AI

Zep is the context engineering platform for AI agents. We solve one of the hardest problems in production AI: getting the right context to agents at the right time. Our platform builds context graphs from conversations and business data, then assembles personalized, token-efficient context with sub-200ms retrieval. Three lines of code to production.

We're a seed-stage company (YC W24) with 50% month-over-month ARR growth, 240+ customers including Fortune 500s, and a well-capitalized balance sheet. Graphiti, our open-source temporal context graph engine, has 24,000+ GitHub stars and is becoming foundational infrastructure for agent memory.

Zep AI
Founded:2023
Batch:W24
Team Size:5
Status:
Active
Location:San Francisco
Founders
Daniel Chalef
Daniel Chalef
Founder