Go to page
 

Bibliographic Metadata

Title
An integrative platform to capture the orchestration of gesture and speech / Christelle Dodane, Dominique Boutet, Ivana Didirkova, Fabrice Hirsch, Slim Ouni and Aliyah Morgenstern
AuthorDodane, Christelle ; Boutet, Dominique ; Didirkova, Ivana ; Hirsch, Fabrice ; Ouni, Slim ; Morgenstern, Aliyah
Published in
Proceedings of the 6th Gesture and Speech in Interaction Conference, page 27-33
PublishedPaderborn : Universitätsbibliothek, 2019
Edition
Elektronische Ressource
Description1 Online-Ressource (8 Seiten) : Illustrationen
LanguageEnglish
Document TypesScientific Article (Published Electronically)
URNurn:nbn:de:hbz:466:2-35623 
DOI10.17619/UNIPB/1-804 
Files
An integrative platform to capture the orchestration of gesture and speech [3.64 mb]
Links
Reference
Classification
Abstract (English)

A number of studies have highlighted the coordination of gesture and intonation (Bolinger,1983; Darwin, 1872; Cruttenden, 1997; Balog & Brentari, 2008; Roustan & Dohen, 2010) butthe technological set-ups have been insufficient to couple the acoustic and gestural data withsufficient detail. In this paper, we present the MODALISA platform which enables languagespecialists to integrate gesture, intonation, speech production and content. The methods of dataacquisition, annotation and analysis are detailed. The preliminary results of our pilot studyillustrate strong correlations between gestures and intonation when they are simultaneouslyperformed by the speaker. The correlations are particularly strong for proximal segments. Ouraim is to expand those results and analyse typical and atypical populations across the lifespan.

License
CC-BY-License (4.0)Creative Commons Attribution 4.0 International License