Home›Companies›SE3 Labs
SE3 Labs

Real-World RL Environments for Physical AI

We build real-world RL environments for robots. Starting with tasks from industry partners, we test policies on real robots and identify where they fail. We use those failures to decide what data to collect and curate for the next policy update. Next, we're setting up physical sandboxes at partner sites, so policies can train on the exact tasks and conditions they'll face in deployment.
Company Launches
SE3 Labs - Real-World RL Environments for Robot Models
See original launch post

TL;DR: SE3 Labs builds real-world RL environments for robot models. We turn workflows from factories and hotels into repeatable tasks for training and evaluation, helping model teams move from capability to usability.

https://www.youtube.com/watch?v=o5g-44iYAVY

Hi everyone! We’re Mark, Conan and Paige, the team behind SE3 Labs.

The problem

Interactive environments and verifiable feedback have become important drivers of LLM post-training. Robot models need a similar learning loop in the physical world: attempt real tasks, learn from failures, and verify that improvements hold up beyond the lab.

But physical environments are much harder to scale than software environments. Every attempt requires a robot, a task setup, a reliable way to check success, and a reset before the next trial. This makes real-world evaluation costly and difficult to scale. Testing whether a robot can complete a benchmark task in the real world is already hard, let alone whether it can do useful work under deployment conditions.

What we provide

SE3 builds end-to-end real-world RL environments that move robot models from capability to usability. Think of it as a physical workbench where models can practice tasks that matter to end customers and receive feedback.

We help businesses to diagnose and improve robot learning policies. In return, they provide access to real workflows that we turn into repeatable tasks and RL environments. We handle site access, task setup, policy runs, human corrections, and resets.

We also work with model teams to define task verifiers: checks that determine whether a job was completed correctly and support reward signals for learning. Teams use failures to guide model updates, then test those updates on held-out variations.

Example environments

Our U.S. site network spans three types of environments and continues to expand:

  • Automotive & industrial facilities: Assembly, insertion, and machine tending, with variations in parts, positioning, and tolerances.
  • Battery, recycling & food-processing facilities: Environments for picking, sorting, and material handling.
  • Hotels & resorts: Environments with real hospitality layouts, objects, and operating requirements.

Start with one policy and one task. We run it on a real robot and collect demonstrations, corrections, and evaluation results to guide fine-tuning. We then evaluate the updated policy against the same task criteria before testing across new objects or layouts.

Our team

Paige Xu previously co-founded OpenMind, where she helped deploy robots in factories. Mark Chen brings experience from Amazon FAR and robotics research at Stanford. Conan Yu built a data infrastructure company serving IMC Trading and OpenSea. 

Who we’d love to meet

  • Model teams evaluating policy robustness and real-world generalization
  • Simulation teams working to measure sim-to-real transfer
  • Operators of factories, hotels, and other physical sites interested in becoming site partners and receiving automation support

Mark, Conan and Paige

SE3 Labs
Founded:2026
Batch:Fall 2026
Team Size:3
Status:
Active
Location:San Francisco
Primary Partner:David Lieb
Founders