
AI applied research lab building synthetic sapience; human-like AI
Member of Technical Staff: Agent Runtime (Ego) Location: San Francisco, CA (hybrid) · Reports to: Founding team
Ego AI is a YC-backed applied AI research lab building the behavioral infrastructure for AI companions and agents. We work at the intersection of real-time conversational instincts, memory, and persistent identity; the layer that makes AI feel genuinely alive. We're a small, fast-moving team and we're defining a new category of human-AI interaction.
Own the agent harness. Design and maintain our core agentic loop (plan → tool call → observe → repeat → finalize) as a small, legible state machine. Errors are first-class: malformed tool calls, hallucinated tool names, and throwing tools get fed back to the model. They never crash the loop.
Make execution durable. Build checkpointed, resumable sessions backed by a database: step logs with pending/committed status, idempotency keys on side-effecting tools, and a clear account of the at-least-once vs exactly-once boundary. A crash between the LLM call and the tool call, or mid-compaction, must never corrupt a session or double-fire a POST.
Solve long-horizon context. Own our compaction strategy: pinned goals, running summaries, sliding windows of recent turns, and retrieval over older state. A 30+-step task should finish aimed at the original goal, within budget.
Design for extensibility. Ship a tool registry (name + JSON schema + handler) that teammates and partners can extend without touching the loop. Validate schemas before handlers run. Keep model adapters swappable in one place.
Ship deployable systems. Deliver one-command local bring-up, persistence behind an interface (Postgres ↔ SQLite ↔ Cloudflare storage), clean HTTP APIs, and secrets hygiene. Build per-user durable agent instances that wake on triggers (cron, webhooks, inbound events). Cloudflare Durable Objects experience is a real plus.
Support the team. Unblock product engineers building on the harness, pair on extensions, and review agent-adjacent designs.
Productionize the agent runtime ("Ronin core"). Take our harness from working prototype to the shared runtime every Ego product sits on: durable step log, budget enforcement, compaction, tool registry, and observability/tracing.
Per-user durable personal agents. Each user gets a long-lived agent instance with its own memory, triggers, and budget. It wakes on webhooks or cron, survives restarts, and stays isolated per tenant. Likely on Cloudflare Durable Objects or an equivalent single-writer model.
Evaluation and reliability harness. Build repeatable crash tests (kill -9 mid-task and mid-compaction), race tests on concurrent session writes, cheap long-horizon stubs that exercise compaction without burning tokens, and per-step tracing.
Must have
docker compose up working cold from a README.Nice to have
Use AI tools freely. We do. You will walk us through the design and defend every trade-off, so own each decision in the repo.
Ego is building an Infinite Game - a persistent virtual 3D world where lifelike AI agents are able to interact with players and each other to build their own relationships, communities, and games within the game. Our embodied AI agents can perceive the world in 3D, reason like a human, and write scripting code directly into the game engine.
We're looking for someone with expertise in computer vision, transformer models, and AI agent development to create a versatile AI system capable of real-time perception, reasoning, and action execution within various 3D game environments. The ideal candidate will have a strong background in full stack engineering, applied research, reinforcement learning, and experience with cutting-edge LLM-based systems. This role will involve pushing the boundaries of AI in gaming, similar to projects like Minecraft Voyager, while integrating seamlessly with our existing game development ecosystem.
If you’re passionate about building AI agents in 3D worlds, thrive on fast-paced innovation, and enjoy collaborating in a tight-knit team of game developers, designers, and technical artists, we’d love to hear from you!
Feel free to learn more about ego on our YC launch page:
https://www.ycombinator.com/launches/KeD-ego-an-ai-native-3d-simulation-engine-getting-us-closer-to-the-matrix-one-pixel-at-a-time We’re looking for someone passionate about playing and making games who ships fast, is interested in trying new technologies, and works well in a small team of game developers, designers, and technical artists. If you like the sound of making games, pushing the boundaries of gaming technology, and you thrive in a fast-paced startup environment, we'd love to hear from you!
If you want to learn more about ego, feel free to take a look at our YC launch page: https://www.ycombinator.com/launches/KeD-ego-an-ai-native-3d-simulation-engine-getting-us-closer-to-the-matrix-one-pixel-at-a-time