LabelMe3D MATLAB Toolbox
 Written and maintained by Bryan Russell and Antonio Torralba
(c) 2009 MIT, Computer Science and Artificial Intelligence Laboratory.


LabelMe3D is a database of labeled images and their absolute 3D coordinates that spans many different scenes and objects. If you use the LabelMe3D database, we only ask that you contribute to LabelMe, from time to time, by using the LabelMe annotation tool.

Download

There are two steps for installing the LabelMe3D MATLAB Toolbox:

1. Download the LabelMe MATLAB Toolbox and add it to your Matlab path.
2. Download the LabelMe3D MATLAB Toolbox and add it to your Matlab path.

You may also wish to download the LabelMe3D database.

Citation

If you use this dataset or the functions in this toolbox, we would appreciate it if you cite:

B. C. Russell and A. Torralba. Building a Database of 3D Scenes from User Annotations. In CVPR, 2009. (PDF)

Contribution

If you find this dataset useful, you can help us to make it larger by visiting the LabelMe annotation tool and labeling several objects. Even if your contribution seems small compared to the size of the dataset, everything counts! We also welcome submissions of copyright-free images. Your annotations and images will be made available for download immediately.

Toolbox description

A quick look at the toolbox

The LabelMe3D MATLAB Toolbox provides the source code for running the algorithm itself, along with functions for viewing and interacting with the data. Let us start by reading and displaying outputs from the algorithm:

fname_jpg = 'example.jpg';
fname_xml = 'example.out.xml';
fname_Z = 'example.Z.png';
img = imread(fname_jpg);
annotation = getfield(loadXML(fname_xml),'annotation');
Zmap = readZmap(fname_Z);
figure; LMplot(annotation,img); title('Image with annotations');
figure; plotZmap(Zmap); title('Depth map');

The X and Y maps can also be read and displayed in a similar fashion.

Running the LabelMe3D algorithm

The function demoLabelMe3D.m has an example script that outlines how to run the algorithm, along with generating the XYZ maps, VRML file, and pop-up book.

 

(c) 2009 MIT, Computer Science and Artificial Intelligence Laboratory.