20,000 simulation scenarios
RGB, segmentation and depth modalities
Detailed annotation of (in)stability
Data loader for Tensorflow dataset API
Script examples for stability prediction
Pre-trained stability predictor
Dataset construction & details
Intuitive physics of stability prediction
Application to object stacking
MuJoCo world definitions (39 MB):
Meta information (156 KB):
RGB images (33 GB):
Violation segmentation maps (875 MB):
Depth maps (1.1 GB):
Handling of the ShapeStacks data with Tensorflow dataset API.
Example scripts for training and evaluation of stablity prediction models.
Check out the code on GitHub »
Pre-trained stability prediction models based on InceptionV4 (1.8 GB):
Physical intuition is pivotal for intelligent agents to perform complex tasks.
In this paper we investigate the passive acquisition of an intuitive understanding
of physical principles as well as the active utilisation of this intuition in the
context of generalised object stacking. To this end, we provide ShapeStacks: a
simulation-based dataset featuring 20,000 stack configurations composed of a variety
of elementary geometric primitives richly annotated regarding semantics and structural