English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT

Released

Conference Paper

Studying time conceptualisation via speech, prosody, and hand gesture: Interweaving manual and computational methods of analysis

MPS-Authors
There are no MPG-Authors in the publication available
External Resource
No external resources are shared
Fulltext (restricted access)
There are currently no full texts shared for your IP range.
Fulltext (public)

GeSpIn_2023_paper_Uhrig_etal.pdf
(Publisher version), 248KB

Supplementary Material (public)
There is no public supplementary material available
Citation

Uhrig, P., Payne, E., Pavlova, I., Burenko, I., Dykes, N., Baltazani, M., et al. (2023). Studying time conceptualisation via speech, prosody, and hand gesture: Interweaving manual and computational methods of analysis. In W. Pouw, J. Trujillo, H. R. Bosker, L. Drijvers, M. Hoetjes, J. Holler, et al. (Eds.), Gesture and Speech in Interaction (GeSpIn) Conference. doi:10.17617/2.3527220.


Cite as: https://hdl.handle.net/21.11116/0000-000D-A250-1
Abstract
This paper presents a new interdisciplinary methodology for the
analysis of future conceptualisations in big messy media data.
More specifically, it focuses on the depictions of post-Covid
futures by RT during the pandemic, i.e. on data which are of
interest not just from the perspective of academic research but
also of policy engagement. The methodology has been
developed to support the scaling up of fine-grained data-driven
analysis of discourse utterances larger than individual lexical
units which are centred around ‘will’ + the infinitive. It relies
on the true integration of manual analytical and computational
methods and tools in researching three modalities – textual,
prosodic1, and gestural. The paper describes the process of
building a computational infrastructure for the collection and
processing of video data, which aims to empower the manual
analysis. It also shows how manual analysis can motivate the
development of computational tools. The paper presents
individual computational tools to demonstrate how the
combination of human and machine approaches to analysis can
reveal new manifestations of cohesion between gesture and
prosody. To illustrate the latter, the paper shows how the
boundaries of prosodic units can work to help determine the
boundaries of gestural units for future conceptualisations.