Computer Graphics and Visualization › Publications › Texture Browser: Feature-based Texture Exploration

Computer Graphics Forum

Texture Browser: Feature-based Texture Exploration

Xuejiao Luo, Leonardo Scandolo, and Elmar Eisemann

: Workflow of our manifold embedding: each image in a texture collection is run through the VGG16 network to obtain a feature vector extracted from the penultimate layer of the network. These features are then embedded in 2D space using the t-SNE algorithm.

Publisher Paper Cite More

Texture is a key characteristic in the definition of the physical appearance of an object and a crucial element in the creation process of 3D artists. However, retrieving a texture that matches an intended look from an image collection is difficult. Contrary to most photo collections, for which object recognition has proven quite useful, syntactic descriptions of texture characteristics is not straightforward, and even creating appropriate metadata is a very difficult task. In this paper, we propose a system to help explore large unlabeled collections of texture images. The key insight is that spatially grouping textures sharing similar features can simplify navigation. Our system uses a pre-trained convolutional neural network to extract high-level semantic image features, which are then mapped to a 2-dimensional location using an adaptation of t-SNE, a dimensionality-reduction technique. We describe an interface to visualize and explore the resulting distribution and provide a series of enhanced navigation tools, our prioritized t-SNE, scalable clustering, and multi-resolution embedding, to further facilitate exploration and retrieval tasks. Finally, we also present the results of a user evaluation that demonstrates the effectiveness of our solution.

More Information

Publisher Paper preprint Supplemental

Gallery

Citation

Xuejiao Luo, Leonardo Scandolo, and Elmar Eisemann, Texture Browser: Feature-based Texture Exploration, Computer Graphics Forum, 40, pp. 99–109, 2021.

BibTex 

@article{bib:luo:2021,
    author       = { Luo, Xuejiao and Scandolo, Leonardo and Eisemann, Elmar },    
    title        = { Texture Browser: Feature-based Texture Exploration },
    journal      = { Computer Graphics Forum },
    volume       = { 40 },
    year         = { 2021 },
    pages        = { 99--109 },
    doi          = { 10.1111/cgf.14292 },
    dblp         = { journals/cgf/LuoSE21 },
    url          = { https://publications.graphics.tudelft.nl/papers/96 },
}