{"id":98605,"title":"Human Archive: The World's Largest multimodal robotics dataset","tagline":"Let's archive the world for embodied intelligence","body":"**TL;DR:** We’re capturing the structure of how humans interact with the physical world to model sensorimotor intelligence at scale\\\n**Launch Video:** \u003chttps://www.youtube.com/watch?v=pFHr3GlTpck\u003e\n\n**The Problem:**\n\nModern AI is largely a knowledge transfer problem. Over the past decade, training on trillions of tokens of internet data enabled breakthroughs in LLMs, diffusion models, and vision-language models. But **human intelligence is predominantly embodied**, and the **internet does not capture it**. Every day we manipulate objects, apply force, and subconsciously adapt in noisy real-world environments. Yet there is no dataset that captures the **structure of human interaction with the physical world at scale**. As a result, progress in \\*\\*embodied spatial intelligence is bottlenecked by data.\\*\\*\\\n\\\n**What we built:**\n\nOver the past two months, we built infrastructure for high-quality data collection at scale, including:\n\n* Custom hardware rigs\n* Internal models for policy benchmarking\n* QA pipelines, alignment, and annotation software\n* 25-person operations team\n* Dedicated servers at our AWS data center for terabyte-scale offloading\n\nNow that the system is live, we can collect **up to 8,000 hours of data per day** and we’ve signed national level partnerships to scale our contributor network to **50,000+ people.** We’ve already shipped datasets to frontier research teams, and have built the largest multimodal dataset of it’s kind.\n\n**Our datasets:**\n\nWe are currently collecting data across **homes, restaurants, hotels, retail, transportation, construction, horticulture, and industrial environments** across two datasets. \\\n\\\n**HA-Multi** is a fully aligned multimodal dataset with **vision, stereo depth (IR dot projection), tactile gloves, body IMUs, and wrist cameras**. For customers, we provide structured outputs and visualizations including **3D MANO hand reconstructions, 2D tactile force maps, depth maps per timestamp, and human pose reconstructions**. \\\n\\\n**HA-Ego** is a **mono RGB vision** and **wrist cameras** dataset. \\\n\\\nWe provide **annotations** and **metadata** including **environment and scene descriptions, high-level task descriptions, task-aligned atomic action labels, hand tracking, object segmentation, SLAM (extrinsic** and **intrinsics),** and **3D pose reconstruction**.\n\n**Team:**\n\nHi, we’re Shloke, Samay, Rushil, and Raj. We’re engineers from Stanford and Berkeley who’ve spent our entire lives building across operations, hardware, and robotics. We’ve known each other for over 20 years and joined forces to dedicate the rest of our lives to building the Common Crawl for human sensorimotor intelligence.\n\n**Our Ask**\n\nWe'd love to talk with you if:\n\n* You’re building in **robotics, world models, or evaluations**\n* You work at or with frontier AI labs interested real world\n* You know cleaning companies, hotel chains, restaurants, factories, or other businesses interested in scaling efficiency and profits with AI\n\n👉 Contact us at [raj@humanarchive.ai](mailto:raj@humanarchive.ai)\n\n💼 Follow us on LinkedIn: \u003chttps://www.linkedin.com/company/human-archive/\u003e\n\n📱 Follow us on X: \u003chttps://x.com/babugi28\u003e","slug":"PeP-human-archive-the-world-s-largest-multimodal-robotics-dataset","created_at":"2026-03-08T23:44:25.753Z","updated_at":"2026-07-22T10:34:15.401Z","total_vote_count":29,"url":"https://www.ycombinator.com/launches/PeP-human-archive-the-world-s-largest-multimodal-robotics-dataset","share_image_url":"//bookface-static.ycombinator.com/assets/ycdc/yc-og-image-c440a0ad1dacfb86eeeb343717479cc54d256614449b4ef719977a0a451f8bc8.png","company":{"id":31205,"name":"Human Archive","slug":"human-archive","url":"https://www.humanarchive.ai/","logo":"https://bookface-images.s3.amazonaws.com/small_logos/ce063ef00a3ec0da3649fb79a819c0e6c1e88ebf.png","batch":"Winter 2026","industry":"Industrials","tags":[],"search_path":"https://bookface.ycombinator.com/company/31205"}}