In Proceedings of EICS

StateStream: a developer-centric approach towards unifying interaction models and architecture

Gerwin de Haan and Frits H. Post

Composition of a StateStream modelled 3D ray casting selection technique, see also section 5.1. A stylus device can be used to point a ray at objects in the VR scene

Complex and dynamic interaction behaviors in applications such as Virtual Reality (VR) systems are difficult to design and develop. Reasons for this include the complexity and limitations in specification models and their integration with the underlying architecture, and lack of supporting development tools. In this paper we present our StateStream approach, which uses a dynamic programming language to bridge the gap between the behavioral model descriptions, the underlying VR architecture and customized development tools. Whereas the dynamic language allows full flexibility, the interaction model adds explicit structures for interactive behavior. A dual modeling mechanism is used to capture both discrete and continuous interaction behavior. The models are described and executed in the dynamic language itself, unifying the description of interaction, its execution and the connection with external software components. We will highlight the main features of StateStream, and illustrate how the tight integration of interaction model and architecture enables a flexible and open-ended development environment. We will demonstrate the use of StateStream in a prototype system for studying and adapting complex 3D interaction techniques for VR.


More Information

Citation

Gerwin de Haan and Frits H. Post, StateStream: a developer-centric approach towards unifying interaction models and architecture, In Proceedings of EICS, pp. 13–22, 2009.

BibTex

@inproceedings{bib:de haan:2009,
    author       = { de Haan, Gerwin and Post, Frits H. },    
    title        = { StateStream: a developer-centric approach towards unifying interaction models and architecture },
    booktitle    = { In Proceedings of EICS },
    year         = { 2009 },
    pages        = { 13--22 },
    doi          = { 10.1145/1570433.1570438 },
    dblp         = { conf/eics/HaanP09 },
    url          = { https://publications.graphics.tudelft.nl/papers/437 },
}