Integrating gesture meaning and verbal meaning for German verbs of motion

UNCG Author/Contributor (non-UNCG co-authors, if there are any, appear on document)
Insa Lawler, Assistant Professor (Creator)
The University of North Carolina at Greensboro (UNCG )
Web Site:

Abstract: When verbs of motion are accompanied by gestures, this comes along with a relatively complex relation between the two modalities. In this paper, we investigate the semantic coordination of speech and event-related gestures in an interdisciplinary way. First, we explain how to efficiently construct a speech-gesture-interface for a gesture which accompanies a verb phrase from a theoretical viewpoint. Resting upon this analysis, we also provide a computational simulation model which further explicates the relation between the two modalities based on activation-spreading within dynamically shaped multi-modal memories.

Additional Information

Tilburg Gesture Research Meeting Proceedings
Language: English
Date: 2013
Gesture semantics, Event-related gestures, Iconic gestures, Speech-gesture interface, Theoretical reconstruction, Computational simulation, Interdisciplinary methodology

Email this document to