Integrating gesture meaning and verbal meaning for German verbs of motion
- UNCG Author/Contributor (non-UNCG co-authors, if there are any, appear on document)
- Insa Lawler, Assistant Professor (Creator)
- Institution
- The University of North Carolina at Greensboro (UNCG )
- Web Site: http://library.uncg.edu/
Abstract: When verbs of motion are accompanied by gestures, this comes along with a relatively complex relation between the two modalities. In this paper, we investigate the semantic coordination of speech and event-related gestures in an interdisciplinary way. First, we explain how to efficiently construct a speech-gesture-interface for a gesture which accompanies a verb phrase from a theoretical viewpoint. Resting upon this analysis, we also provide a computational simulation model which further explicates the relation between the two modalities based on activation-spreading within dynamically shaped multi-modal memories.
Integrating gesture meaning and verbal meaning for German verbs of motion
PDF (Portable Document Format)
475 KB
Created on 9/13/2019
Views: 374
Additional Information
- Publication
- Tilburg Gesture Research Meeting Proceedings
- Language: English
- Date: 2013
- Keywords
- Gesture semantics, Event-related gestures, Iconic gestures, Speech-gesture interface, Theoretical reconstruction, Computational simulation, Interdisciplinary methodology