Multi-modal meaning – An empirically-founded process algebra approach
- UNCG Author/Contributor (non-UNCG co-authors, if there are any, appear on document)
- Insa Lawler, Assistant Professor (Creator)
- Institution
- The University of North Carolina at Greensboro (UNCG )
- Web Site: http://library.uncg.edu/
Abstract: Humans communicate with different modalities. We offer an account of multi-modal meaning coordination, taking speech-gesture meaning coordination as a prototypical case. We argue that temporal synchrony (plus prosody) does not determine how to coordinate speech meaning and gesture meaning. Challenging cases are asynchrony and broadcasting cases, which are illustrated with empirical data. We propose that a process algebra account satisfies the desiderata. It models gesture and speech as independent but concurrent processes that can communicate flexibly with each other and exchange the same information more than once. The account utilizes the psi-calculus, allowing for agents, input-output-channels, concurrent processes, and data transport of typed lambda-terms. A multi-modal meaning is produced integrating speech meaning and gesture meaning into one semantic package. Two cases of meaning coordination are handled in some detail: the asynchrony between gesture and speech, and the broadcasting of gesture meaning across several dialogue contributions. This account can be generalized to other cases of multi-modal meaning.
Multi-modal meaning – An empirically-founded process algebra approach
PDF (Portable Document Format)
1558 KB
Created on 8/11/2020
Views: 1156
Additional Information
- Publication
- Semantics and Pragmatics 13(8), 1-55. https://doi.org/10.3765/sp.13.8
- Language: English
- Date: 2020
- Keywords
- multi-modal meaning, speech-gesture meaning coordination, process algebra, psi-calculus, typed lambda-calculus, psi-lambda-calculus