Computer Graphics and Visualization › Publications › 3D Material Style Transfer

Computer Graphics Forum

3D Material Style Transfer

Chuong Nguyen, Tobias Ritschel, Karol Myszkowski, Elmar Eisemann, and Hans-Peter Seidel

Automatic 3D material style transfer from different source images (insets) to a target 3D scene using our approach

Publisher Paper Cite More

This work proposes a technique to transfer the material style or mood from a guide source such as an image or video onto a target 3D scene. It formulates the problem as a combinatorial optimization of assigning discrete materials extracted from the guide source to discrete objects in the target 3D scene. The assignment is optimized to fulfill multiple goals: overall image mood based on several image statistics; spatial material organization and grouping as well as geometric similarity between objects that were assigned to similar materials. To be able to use common uncalibrated images and videos with unknown geometry and lighting as guides, a material estimation derives perceptually plausible reflectance, specularity, glossiness, and texture. Finally, results produced by our method are compared to manual material assignments in a perceptual study.

More Information

Publisher Paper preprint

Citation

Chuong Nguyen, Tobias Ritschel, Karol Myszkowski, Elmar Eisemann, and Hans-Peter Seidel, 3D Material Style Transfer, Computer Graphics Forum, 31, pp. 431–438, 2012.

BibTex 

@article{bib:nguyen:2012,
    author       = { Nguyen, Chuong and Ritschel, Tobias and Myszkowski, Karol and Eisemann, Elmar and Seidel, Hans-Peter },    
    title        = { 3D Material Style Transfer },
    journal      = { Computer Graphics Forum },
    volume       = { 31 },
    year         = { 2012 },
    pages        = { 431--438 },
    doi          = { 10.1111/j.1467-8659.2012.03022.x },
    dblp         = { journals/cgf/NguyenRMES12 },
    url          = { https://publications.graphics.tudelft.nl/papers/276 },
}