Computer Graphics and Visualization › Publications › Interactions for Seamlessly Coupled Exploration of High-Dimensional Images and Hierarchical Embeddings

In Proceedings of Vision, Modeling, and Visualization

Interactions for Seamlessly Coupled Exploration of High-Dimensional Images and Hierarchical Embeddings

Alexander Vieth, Boudewijn P. F. Lelieveldt, Elmar Eisemann, Anna Vilanova, and Thomas Höllt

Illustration of the Coupled Image-Space and Embedding-Space Interactions

Publisher Paper Cite Honorable Mention @ VMV 2023 More

High-dimensional images (i.e., with many attributes per pixel) are commonly acquired in many domains, such as geosciences or systems biology. The spatial and attribute information of such data are typically explored separately, e.g., by using coordinated views of an image representation and a low-dimensional embedding of the high-dimensional attribute data. Facing ever growing image data sets, hierarchical dimensionality reduction techniques lend themselves to overcome scalability issues. However, current embedding methods do not provide suitable interactions to reflect image space exploration. Specifically, it is not possible to adjust the level of detail in the embedding hierarchy to reflect changing level of detail in image space stemming from navigation such as zooming and panning. In this paper, we propose such a mapping from image navigation interactions to embedding space adjustments. We show how our mapping applies the "overview first, details-on-demand" characteristic inherent to image exploration in the high-dimensional attribute space. We compare our strategy with regular hierarchical embedding technique interactions and demonstrate the advantages of linking image and embedding interactions through a representative use case.

More Information

Publisher Paper preprint Supplemental Evaluation Code on GitHub Video on YouTube

Gallery

Citation

Alexander Vieth, Boudewijn P. F. Lelieveldt, Elmar Eisemann, Anna Vilanova, and Thomas Höllt, Interactions for Seamlessly Coupled Exploration of High-Dimensional Images and Hierarchical Embeddings, In Proceedings of Vision, Modeling, and Visualization, pp. 63–70, 2023.

BibTex 

@inproceedings{bib:vieth:2023,
    author       = { Vieth, Alexander and Lelieveldt, Boudewijn P. F. and Eisemann, Elmar and Vilanova, Anna and Höllt, Thomas },    
    title        = { Interactions for Seamlessly Coupled Exploration of High-Dimensional Images and Hierarchical Embeddings },
    booktitle    = { In Proceedings of Vision, Modeling, and Visualization },
    year         = { 2023 },
    pages        = { 63--70 },
    publisher    = { The Eurographics Association },
    doi          = { 10.2312/vmv.20231227 },
    dblp         = { conf/vmv/ViethLEVH23 },
    url          = { https://publications.graphics.tudelft.nl/papers/6 },
}