EGOCENTRIC DATASETS

Sorted by the world the robot has to work in.

A kitchen and a warehouse ask completely different things of a policy. We organise first-person capture by environment, because that is what decides the action vocabulary, the object density and where the annotation actually gets hard.

30,000+
HOURS ANNOTATED
10s
MAXIMUM CLIP LENGTH
0.5s
BOUNDARY RESOLUTION
4
HUMAN REVIEWS PER RECORD
ONE METHOD, EVERY ENVIRONMENT

Continuous video is cut into atomic-action clips against a published rule set, described independently for each hand, then gated by two segmentation reviews and two description reviews. Records from a kitchen and a warehouse share a schema, so they train together.

See the full pipeline →

Household

Kitchens, living spaces and personal care. The densest source of bimanual manipulation we capture.

CAPTURING NOW

Retail

Shelf work in live store aisles, where dozens of near-identical products make object reference the hard part.

CAPTURING NOW

Food Service

Line cooking and service at tempo, where the same action repeats hundreds of times a shift.

IN BUILD-OUT

Industrial & Factory

Assembly, materials handling and warehouse work, with narrow action sets and tight tolerances.

CAPTURING · EXPANDING

Need an environment we are not capturing yet?

The rule set, review model and record schema are already fixed. Adding an environment is a capture and vocabulary problem, not a methodology one, so a new domain starts against a known standard.

Talk to us