STIC-South America is a scientific-technological cooperation programme integrated
by France, Argentine, Brazil, Chile, Paraguay, Peru and Uruguay.
The project aims to compile a multimodal
speech corpus containing synchronized audio-visual
data recorded from talking individuals. The corpus will incorporate several communication modes
which appear in the communication among humans, such as the acoustic signal, facial movements
and body gestures during speech.
In this project we combine the skills of four teams that are respectively specialized in cortexinspired
models of multimodal perception, multimodal communication, audio-visual information
integration and image synthesis, for the compilation of a multimodal speech corpus containing
synchronized audio-visual data recorded from talking individuals. The corpus will incorporate
several communication modes which appear in the communication among humans, such as the
acoustic signal, facial movements and body gestures during speech. The proposed corpus will be
recorded in at least 2 different languages (Spanish and French), using different data acquisition
setups (single camera, multiple cameras, 3D cameras, motion capture system,
electromagnetography system). The corpus will also contemplate different communication
situations such as isolated word, continuous speech and spontaneous speech. The proposed
characteristics of the corpus would allow its use in a wide range of applications and research areas.
The aim of the project is to promote and strengthen South America regional capacities
and their cooperation with France, towards the settlement of research and development
webs on Science, Information Technology and Communication field.
On this scope, the programme convokes to select and sponsor research and development
projects, which are able to transfer innovation proposals at a regional level.
These projects, which have a maximum extension of two years, include at least two
countries of the region and one or more French scientific team(s).
MCC: Multimodal Communication Corpus Project (15STIC-05)
Goals