Fei-Fei Li's World Labs Achieves Hour-Long Robot Operations With Zero Real-World Training Data
Robots trained entirely inside digital simulations, never touching physical hardware, ran continuously on real robots for an hour without human intervention. World Labs published technical results on July 28, 2026, showing that their Real-to-Sim-to-Real (R2S2R) framework can transfer policies from physics-accurate simulations directly to physical robots across five different task categories, all without any real-world training data.
This breakthrough matters because it directly challenges how robotics teams currently budget their development time and money. Physical trials, hardware resets, and real-world demonstrations are the most expensive line items in robot development. The conventional wisdom has been that simulation can supplement real-world testing but cannot replace it. If World Labs' results hold at scale, that assumption needs updating.
How Does World Labs' Simulation-to-Reality Framework Actually Work?
- Real-to-Sim Phase: Engineers capture a physical robot task, including the robot itself, its sensors, the environment, objects to manipulate, and task demonstrations. A generative world modeling system then reconstructs all of that as an interactive simulation that targets both visual and physical accuracy, not just how things look but how objects deform and respond to contact.
- Validation Step: World Labs validates each reconstruction by running identical action sequences in both simulation and reality side by side, comparing observations, object responses, and task outcomes to ensure the digital version matches physical behavior.
- Sim-to-Real Phase: The physics-aligned simulation becomes a training and evaluation environment where the system can systematically vary object configurations, robot states, camera viewpoints, lighting conditions, material properties, and difficulty levels, providing ground-truth supervision that is difficult to obtain on actual hardware.
The framework is designed to be policy-agnostic and embodiment-agnostic, meaning it does not require a specific robot or a specific learning algorithm.
What Tasks Did World Labs Successfully Demonstrate?
World Labs chose five task categories specifically because they involve physical properties that conventional simulators struggle most to reproduce: deformable cables, elastic connectors, articulated boxes, test tubes with tight geometric tolerances, and thin objects extracted from dense clutter.
The company demonstrated four tasks running robustly for a full hour on physical hardware with zero human intervention:
- Cable Manipulation: A YAM arm performed sliding, routing, plugging, and unplugging of deformable cables through sustained contact.
- Power Cord Routing: An RB-Y1 bimanual platform routed a power cord around a refrigerator, a contact-rich task requiring coordinated two-arm manipulation of a deformable object.
- Test Tube Transfer: A Flexiv arm transferred test tubes between holders under tight geometric tolerances.
- Object Singulation: An xArm extracted markers and pencils one at a time from dense clutter, differentiating thin similar objects by touch and position.
On an ALOHA bimanual robot, the system trained a policy for bimanual box packing, folding and sealing cardboard boxes entirely in simulation with zero real-world training data, then transferred it directly to the physical robot. The policy also ran robustly under active lighting perturbations, demonstrating generalization beyond training conditions.
Why Does This Challenge the Current Robotics Development Model?
The robotics research community has spent years optimizing sim-to-real transfer, the step where a policy trained in simulation moves onto physical hardware. The dominant approach has been domain randomization: varying the simulation's lighting, texture, mass, and friction parameters until the policy learns to generalize across that variation, with the assumption that real-world conditions fall somewhere inside the randomized range.
World Labs argues this framing starts in the wrong place. If the simulation itself is a poor model of physical reality, if it assumes rigid bodies when real cables and elastic materials deform, if it models contact forces inaccurately, then no amount of domain randomization compensates for the upstream failure. A 2026 Annual Reviews survey on robotics confirms this framing: most simulators assume perfectly rigid bodies and joints, making deformable object tasks the hardest category for conventional sim-to-real transfer.
The solution, according to World Labs' framework, is to solve the upstream problem first: make the simulation accurate enough that the transfer question nearly answers itself.
Can Simulation Replace Hardware Evaluation?
Beyond training, World Labs demonstrated R2S2R as a high-throughput evaluation engine. The team ran four policy architectures on a bimanual cube-handover task using the ALOHA robot platform, evaluating each across multiple checkpoints under both in-distribution and out-of-distribution conditions. Simulated evaluation used 2,000 trials per checkpoint; real-world evaluation used 100.
The result showed strong rank-order correlation: policies that performed better in simulation also performed better on hardware; checkpoint rankings were preserved across the two environments; and failure regions in simulation matched failure regions in reality. A simulation does not need to exactly match real-world success rates to be useful; it needs to preserve the relative performance ranking of the policies being compared and identify where each one fails.
The practical implication for robotics teams is significant: rather than burning expensive hardware time to evaluate every training checkpoint, teams can screen the vast majority of candidates in simulation and reserve physical testing for the most promising policies. This positions R2S2R as a means to turn robot development iteration from hardware-bound to simulation-first.
The economic argument embedded in R2S2R is worth stating explicitly: a simulation reconstructed once can serve many policies and many robot embodiments. Each iteration, whether a new model, new hardware platform, or new evaluation run, uses the same underlying world representation, with the per-iteration cost falling sharply compared to physical trial-and-error.
Where Does This Fit in the Broader World Models Landscape?
Fei-Fei Li, the Stanford professor best known for creating ImageNet, the dataset that launched the deep learning era and earned her the nickname "godmother of AI," founded World Labs around one thesis: that spatial intelligence, the ability to understand and reason about the 3D world, is the next frontier after language.
World Labs shipped Marble, the first commercial world-model product, in November 2025, and was soon reported in talks to raise at a $5 billion valuation. The company raised a $1 billion Series B in February 2026 at that $5 billion valuation, bringing total capital raised to $1.23 billion.
The broader world models field has attracted roughly $4 billion in funding over about a year, with companies like Yann LeCun's AMI Labs, which raised a $1.03 billion founding round in March 2026, and robotics-focused startups including Skild AI, Physical Intelligence, Odyssey, and Decart all pursuing variations of the same core idea: teaching machines to simulate how the world works.
However, the field remains divided on fundamental questions. Some companies like DeepMind and NVIDIA focus on generating convincing pixels as literal video frames. Others, including Meta, bet that predicting in a compressed representation space without pixels is the path to real understanding. World Labs' approach focuses specifically on physics-accurate simulation for robotics, targeting the deformable objects and contact-rich tasks that have historically been the hardest problems in robot learning.