Scene Carving


image

relative depth map

3d image model

retargeted with
scene carving

Image retargeting algorithms often create visually disturbing distortion. We introduce the property of scene consistency, which is held by images which contain no object distortion and have the correct object depth ordering.

We present two new image retargeting algorithms that preserve scene consistency. These algorithms make use of a user-provided relative depth map, which can be created easily using a simple GrabCut-style interface These algorithms are a generalization of seam carving.

We decompose the image retargeting procedure into (a) removing image content with minimal distortion and (b) re-arrangement of known objects within the scene to maximize their visibility. Our algorithms optimize objectives (a) and (b) jointly. However, they differ considerably in how they achieve this. We discuss this in detail and present examples illustrating the rationale of preserving scene consistency in retargeting.

Publications

Scene Carving: Scene Consistent Image Retargeting
A. Mansfield, P. Gehler, L. Van Gool and C. Rother
European Conference on Computer Vision (ECCV) 2010

[paper.pdf] (2.4MB) [supplementary.pdf] (3.2MB) [poster.pdf] (1.4MB) [bibtex]

Code

You can download the code that we used to produce our results, which is available under a GNU General Public License. The implementation is written in MATLAB and C++ (with a MEX interface).

Please note that all code is provided for research purposes only. For any questions about the code, please contact Alex Mansfield.

[code.zip] (1.1MB) [image database.zip] (6.6MB)