Computer Graphics and Visualization › Publications › Depth annotations: Designing depth of a single image for depth-based effects

Computers & Graphics

Depth annotations: Designing depth of a single image for depth-based effects

Jingtang Liao, Shuheng Shen, and Elmar Eisemann

Ignored-gradient region. Shadows and reflections introduce unwanted large gradients, which hinder the depth diffusion and lead to discontinuities. Using the ignored-gradient region brush, these gradients can be excluded from the depth derivation. (Top image: courtesy of Erik Sintorn; bottom image: Flickr - salendron)

Publisher Paper Cite More

We present a novel pipeline to generate a depth map from a single image that can be used as input for a variety of artistic depth-based effects. In such a context, the depth maps do not have to be perfect but are rather designed with respect to a desired result. Consequently, our solution centers around user interaction and relies on a scribble-based depth editing. The annotations can be sparse, as the depth map is generated by a diffusion process, which is guided by image features. Additionally, we support a variety of controls, such as a non-linear depth mapping, a steering mechanism for the diffusion(e.g., directionality, emphasis, or reduction of the influence of image cues), and besides absolute, we also support relative depth indications. In case that a depth estimate is available from an automatic solution, we illustrate how this information can be integrated in form of a depth palette, that allows the user to transfer depth values via a painting metaphor. We demonstrate a variety of artistic 3D results, including wiggle stereoscopy, artistic abstractions, haze, unsharp masking, and depth of field.

More Information

Publisher Paper preprint

Citation

Jingtang Liao, Shuheng Shen, and Elmar Eisemann, Depth annotations: Designing depth of a single image for depth-based effects, Computers & Graphics, 71, pp. 180–188, 2018.

BibTex 

@article{bib:liao:2018,
    author       = { Liao, Jingtang and Shen, Shuheng and Eisemann, Elmar },    
    title        = { Depth annotations: Designing depth of a single image for depth-based effects },
    journal      = { Computers & Graphics },
    volume       = { 71 },
    year         = { 2018 },
    pages        = { 180--188 },
    doi          = { 10.1016/j.cag.2017.11.005 },
    dblp         = { journals/cg/LiaoSE18 },
    url          = { https://publications.graphics.tudelft.nl/papers/230 },
}