ROBOTICS TRAINING DATA · VLA DATASETS

Robotics training data from real human work.

Egocentric video of people doing real tasks, cut into single actions and described hand by hand. We collect it, annotate it and review it four times, for teams training VLA models, world models and robot policies.

30,000+
HOURS ANNOTATED
200+
TRAINED ANNOTATORS
4
HUMAN REVIEWS PER RECORD
10s
MAXIMUM CLIP LENGTH
WHAT WE DELIVER

From raw footage to training-ready records

Use one part or all of it. Each stage works on footage we capture or footage you already have.

VLA TRAINING DATA

Language a policy can actually use

"Washes the bowl" is not enough supervision. A vision-language-action model has to resolve which bowl, with which tool, and what the other hand is doing. So we describe each hand separately and ground every description in the objects in view.

LEFT HANDThe left hand holds the blue and white ceramic bowl in the stainless steel sink.
RIGHT HANDThe right hand washes the blue and white ceramic bowl with a blue sponge near the faucet.
CAMERA MOTIONSmall
SCENESink

Camera motion lets you weight or filter clips where apparent object motion is really head motion. Scene comes from a controlled vocabulary, so it works as a conditioning signal rather than a free-text string.

VIDEO ANNOTATION FOR ROBOTICS

A published rule set, not reviewer taste

Clip boundaries decide what a robot learns an action is. These rules are applied to every clip, and three violations remove an annotator from the queue.

  1. One clip, one action. Two independent actions by the same hand never share a clip.
  2. Hands visible at the boundaries. The operating hand is visible from the wrist up in the start and end frame.
  3. Hands present throughout. The hand appears in at least 90% of the clip and is never out of view for a second or more.
  4. Ten-second cap. Long repeated actions are split at natural pauses, and every resulting clip still meets every rule.
  5. Nothing skipped. Every valid action in the source video is segmented.

The full pipeline, special-case handling and record schema are on the home page.

ENVIRONMENTS

Where the data comes from

The environment decides the action vocabulary, how cluttered the scene is and where annotation gets hard.

FAQ

Common questions

What does a delivered record look like?

Each approved clip is one structured record: clip index, start and end timecode (capped at 10 seconds), which hand acts (left, right or both), a separate natural-language description for each hand, camera motion (small or large), scene from a controlled vocabulary, and review state with the full correction history.

Can you collect new footage to our specification?

Yes. We scope the environments, tasks and hours with you, along with resolution, frame rate and field of view, then capture with head-mounted cameras at real workplaces and homes. Collection is live in Pakistan today.

Can you annotate egocentric video we already have?

Yes. That is how our live VLA program works: we annotate the client's own footage, 30,000+ hours so far, through the same segmentation and description pipeline, rule set and four-pass review.

How is quality controlled?

Every record passes four human reviews: an internal and an external review of the clip boundaries, then an internal and an external review of the descriptions. The external team is independent and blind to who did the work. Annotators who break the rule set three times are removed from the queue.

How do we start?

With a pilot. Send about two hours of video and your taxonomy, or use ours. You get labelled clips back, a QA report with an error taxonomy, and the questions we would ask before scaling.

Send us 2 hours of video.

Get labelled clips back in 72 hours, with a QA report and the questions we would ask before scaling. Your taxonomy or ours.

Start a data pilot