Help Privacy Policy Disclaimer
  Advanced SearchBrowse




Conference Paper

The ecological approach to multimodal system design


Romary,  Laurent
Max Planck Digital Library, Max Planck Society;

External Resource
No external resources are shared
Fulltext (restricted access)
There are currently no full texts shared for your IP range.
Fulltext (public)

(Any fulltext), 116KB

Supplementary Material (public)
There is no public supplementary material available

De Angeli, A., Wolff, F., Romary, L., & Gerbino, W. (1999). The ecological approach to multimodal system design. In A. Braffort, R. Gherbi, S. Gibet, J. Richardson, & D. Teil (Eds.), Gesture-Based Communication in Human-Computer Interaction: International Gesture Workshop, GW'99, Gif-sur-Yvette, France, March 1999. Proceedings (pp. 49-52). Berlin / Heidelberg: Springer.

Cite as: https://hdl.handle.net/11858/00-001M-0000-0013-878B-A
Following the ecological approach to visual perception, this paper presents a framework that emphasizes the role of vision on referring actions. In particular, affordances are utilized to explain gestures variability in a multimodal human-computer interaction. Such a proposal is consistent with empirical findings obtained in different simulation studies showing how referring gestures are determined by the mutuality of information coming from the target and the set of movements available to the speaker. A prototype that follows anthropomorphic perceptual principles to analyze gestures has been developed and tested in preliminary computational validations.