Working with Multimodal Data: Speech, Gesture and Your Own Video Data
Learn how to use our multimodal pipeline for speech and gesture analysis
MULTIDATA (https://www.multi-data.eu) is an ERASMUS PLUS KA220 HED project involving the universities of Murcia, Radboud Nijmegen, and FAU Erlangen-Nürnberg as partners, with the MPI for Psycholinguistics and the Red Hen Lab as associated partners. The project offers an online platform for the study of multimodal communication, including AI-based tools to analyze speech and gesture data from videos, as well as resources for developing audiovisual collections and educational materials.
Join us for a hands-on MULTIDATA workshop at AELCO 2026. This practical session will introduce participants to the MULTIDATA platform and pipeline, with a focus on how to process video data for multimodal communication research. Participants will learn how to use the MULTIDATA tools for analyzing gesture together with co-occurring language and speech (prosody, pauses, vocal articulation).
The workshop will cover the main stages of the MULTIDATA workflow: platform access, aligned transcription and speech analysis, gesture extraction through pose estimation, and practical ways of working with participants’ own data. The session is designed for researchers, teachers and students interested in multimodal communication, cognitive linguistics, gesture studies, audiovisual data, and corpus-based approaches to language.
Workshop Information
Title: MULTIDATA Workshop: Working with Multimodal Data. Speech, Gesture and Your Own Video Data
Date, time, place: Tuesday 22 September, 17:00-20:00 CEST. Faculty of Arts (Facultad de Letras), University of Murcia, La Merced Campus (Calle Santo Cristo 1, Murcia, Spain). Co-located with AELCO 2026
Duration: 3 hours
Format: Hands-on workshop
Teams involved: University of Murcia and FAU Erlangen-Nürnberg
Structure: 1h45 workshop + 15 min coffee break + 1h practical session
Participants: Researchers, teachers, students, and anyone interested in multimodal communication, speech, gesture, audiovisual data, and corpus-based language research.
Reserve a spot here: https://www.eventbrite.com/e/multidata-workshop-at-aelco-2026-tickets-1991754808248
