{"id":79373,"title":"ego - an ai-native 3d simulation engine: 👾 getting us closer to the matrix, one pixel at a time","tagline":"An AI-native simulation engine and platform where users can create and share 3D animated characters, worlds, games and scripted interactions all using natural language. ","body":"**tl;dr**\\\n_ego is an AI-native simulation engine and platform for AI characters where users can create and share 3D animated characters, worlds, games, and scripted interactions all using natural language. Imagine being able to prompt characters that exhibit human-like behaviour into Minecraft, The Sims, or Animal Crossing into existence._\n\n![uploaded image](/media/?type=post\u0026id=79373\u0026key=user_uploads/1552350/b97ac917-413b-465d-af9a-9d43c9091de3)\n\nhttps://www.youtube.com/watch?v=bLpG4LrLf60\n\n# Why Now?\n\nThe advent of large language models and diffusion models presents an incredible opportunity to solve three seemingly intractable problems in open-world games and simulations:\n\n1. It is hard for humans to write code and script interactions between assets, characters, and the environment to design fun games and experiences\n2. It was impossible for NPCs to display human-like behavior and have true agency in these 3D worlds\n3. It is hard to create new 3D assets, worlds, and non-playable characters\n\nWe founded ego to build an AI native simulation engine to solve all three problems - and we’ve started by tackling the first two. \n\n[ego](https://ego.live) is an AI-native simulation/game engine and platform where users can create and share 3D animated characters, worlds, and scripted interactions all using natural language. Imagine being able to prompt games like GTA, The Sims, Minecraft, or Animal Crossing into existence.\n\nIn the age of Gen AI, it is finally possible to build a **game engine that is also a game**.\n\n# Simulations on ego\n\nOver the course of YC, we built and launched two experimental games with our simulation engine: [TownWorld](https://docsend.com/view/ig6t2shuz26z7wha) (a 3D simulation of the Stanford Generative Agents [paper](https://hai.stanford.edu/news/computational-agents-exhibit-believable-humanlike-behavior) - [tweet thread](https://x.com/peggy_wang/status/1767656498212356597?s=20)) and [CharacterIdol](https://www.characteridol.ai/) (a game where user-prompted generative agents compete to entertain American Idol-style judges…also powered by LLMs). All of the character personalities, conversations, memories, and routines/movements in these games are fully generated by AI.\n\n[Townworld](https://youtu.be/6mPWFFTYebU):\n\n[CharacterIdol](https://youtu.be/j-R1am-kOTY):\n\nThis is where we found the massive opportunity to meaningfully make progress toward our vision of gaining usage of our simulation engine - _making it really easy for a user to make and share a game featuring agents in bounded or unbounded 3D space._ We are keenly aware of the sheer amount of time users spend talking to [character.ai](http://character.ai) [characters,](http://character.ai/) as well as the sheer amount of time young creators spend learning Lua code to script simple games and experiences in Roblox. What if we enable humans to interact with agents in immersive 3D worlds without the creators themselves needing to write complex Lua scripts or learn 3D modeling? What if summoning an agent was as simple as filling out a DnD character sheet?\n\n# Why is this a big deal?\n\n![uploaded image](/media/?type=post\u0026id=79373\u0026key=user_uploads/1552350/4fffe41d-d395-4029-bc04-15e83365f347)\n\nSince time immemorial, humans have built tools to bring their internal worlds to life. The sandbox, the dollhouse, a tree branch shaped like a rifle - all examples of tools we use to bolster our imaginative capacity to dream new worlds, characters, scenarios, and stories into existence. The closest we’ve come as a species to actualizing our imagination has been through the use of game engines to create simulated open-world experiences and games. AI is about to democratize the strongest tool we’ve had to realize our imaginations, and ego will be the simulation platform and engine that will power this new possibility.\n\n_Animal Crossing_, _The Sims_, _Garry’s Mod_, _Skyrim_, _Minecraft_, _Roblox,_ and _GTA_ - all hit games that empower players to explore, create, and roleplay in immersive 3D worlds. However, video games are hard to build and even harder to keep releasing fresh content for. Outside of the studio system, independent [modders](https://www.nexusmods.com/) have spent countless hours extending these games’ shelf life with new experiences and [characters](https://www.nexusmods.com/skyrimspecialedition/mods/98631), despite heavy technical challenges, and even outright hostility from the original game publishers. \n\n# Team\n\n![uploaded image](/media/?type=post\u0026id=79373\u0026key=user_uploads/1552350/b74846e9-8f20-4c19-9069-4f070a3838b2)\n\n[Vish](https://linkedin.com/in/astrophysicist) led the FB AI Applied Research team and the Meta Horizon Scripting team. He learned how to program by modding video games as a teenager and also wrote screenplays for films ([Acceptance](https://youtu.be/7r93LEFjpCA?si=fIEMyHdLF5E25aqq)).\n\n# Asks\n\n* Sign up for our waitlist at [ego.live](https://ego.live) and join our [discord](https://discord.gg/egoai)\n* Retweet ([this twitter link](https://x.com/peggy_wang/status/1768405809455825342?s=20)), reshare this ([LinkedIn](https://www.linkedin.com/posts/y-combinator_launch-yc-ego-an-ai-native-3d-simulation-activity-7174147284681564160-taZI))\n* Share the launch with friends and gamers who might be interested in trying this out :)\n* Try out [characteridol.ai](https://characteridol.ai) and tell us what you think\n* Follow [@ego_ai\\_](https://twitter.com/ego_ai_) on Twitter\n* Optionally follow [@peggy_wang](https://twitter.com/peggy_wang) and [@simulacronist](https://twitter.com/simulacronist) on twitter\n* Link us to talented 10x game devs (Unreal engine experience): [JD](https://peggy-wang.notion.site/Senior-Unreal-Engine-Game-Developer-at-Ego-VC-funded-indie-games-studio-making-animal-crossing-with-d02c85bedfa843ef9a2bca81cd58a7c2)","slug":"KeD-ego-an-ai-native-3d-simulation-engine-getting-us-closer-to-the-matrix-one-pixel-at-a-time","created_at":"2024-03-13T21:12:12.336Z","updated_at":"2026-05-25T05:13:04.123Z","total_vote_count":251,"url":"https://www.ycombinator.com/launches/KeD-ego-an-ai-native-3d-simulation-engine-getting-us-closer-to-the-matrix-one-pixel-at-a-time","share_image_url":"https://www.ycombinator.com/media/?type=post\u0026id=79373\u0026key=user_uploads/1552350/b74846e9-8f20-4c19-9069-4f070a3838b2","company":{"id":29205,"name":"ego","slug":"ego","url":"https://egoai.com","logo":"https://bookface-images.s3.amazonaws.com/small_logos/8c5177c13126141e3271facbae25104898deb0f7.png","batch":"Winter 2024","industry":"Consumer","tags":["Artificial Intelligence","Consumer","AI","Conversational AI"],"search_path":"https://bookface.ycombinator.com/company/29205"}}