MULTIDATA
Free online platform with an open-source multimodal processing pipeline to analyze speech and gesture data from videos
MULTIDATA
MULTIDATA is an online platform for the study of multimodal communication. We offer an AI-based pipeline to analyze speech and gesture data from videos, as well as other resources for developing audiovisual collections and exploiting them for education, research, and professional applications. The MULTIDATA team is constantly integrating the most relevant open-source tools, or developing tools of our own.
Our resources come with explanatory tutorials and guidelines, as well as with didactic materials for the use of multimodal data across disciplines. We also host a forum for exchanging ideas, resources, and feedback on all things multimodal. In this page, you can register for our webinars and stay tuned for our presentations at conferences and other events. Check out the news for our online and onsite activities!
Tutorials
Watch our video tutorials for a detailed and narrative instruction on how to use the platform
GUIDELINES
Stay tuned for our guidelines and didactic proposals for using the MULTIDATA tools in higher education
Coming soon
Coming soon
Coming soon
Coming soon
EVENTS
Our Events
ABOUT US
MULTIDATA's long name is Skills and resources for the multimodal turn: Unlocking audiovisual datasets for research and learning.
Our project is funded by an ERASMUS PLUS KA220-HED to the University of Murcia, with Radboud University Nijmegen and FAU Erlangen-Nürnberg as partners.
We also thank our associated partners the Red Hen Lab™, an international consortium for research into multimodal communication, and the Department of Multimodal Language at the Max Planck Institute for Psycholinguistics.
- Cristóbal Pagán Cánovas — Professor, English Philology (University of Murcia), MULTIDATA coordinator
- Peter Uhrig — Professor of Big Data Linguistics (FAU Erlangen-Nürnberg)
- Aslı Özyürek — Full Professor / Director of Multimodal Language Department (MPI for Psycholinguistics)
- Raúl Sánchez Sánchez — Computer Engineer / Doctoral researcher (University of Murcia)
- Mounika Kanakanti — Machine Learning Engineer (MPI for Psycholinguistics)
- Hafeez Ur Rehman — Java Software Developer (MPI for Psycholinguistics)
- Daniel Alcaraz Carrión — Post-doctoral researcher (University of Murcia)
- Armine Garibyan — Post-doctoral researcher (FAU Erlangen-Nürnberg)
- Esam Ghaleb — Post-doctoral researcher (MPI for Psycholinguistics)
- Irene Bolumar Martínez — Doctoral researcher (University of Murcia)
- Yassine Iabdounane — Doctoral researcher (FAU Erlangen-Nürnberg)
Resources
Menu
Funded by the European Union. Neither the European Union nor EACEA can be held responsible for views expressed.
Copyright © 2024 MULTIDATA Pipeline