Multimodality in language and speech systems
This book is based on contributions to the 7th European Summer School on Language and Speech Communication that was held in Stockholm, Sweden, in July 1999. It contains eight chapters dealing with various topics related to multi-modality in language and speech systems. The book starts from studies of human-to-human communication behavior involving bodily communication, as well as speech and gesture, and also covers issues of audio-visual speech perception. The section on multi-modality in alternative communication mediated by machine discusses different approaches to solving communication problems of people with sensory, physical or cognitive impairments which can be overcome by multi-modal systems. From the perspective of modality theory, the communication between humans and systems is structured in terms of a taxonomy and systematic analysis of input and output modalities, their representations and functions, and a discussion of practical problems of modality selection. This modality overview is followed by contributions in which various aspects of experimental language and speech systems are described and tested. The architecture of the Chameleon system is presented where input includes spoken language and pointing gestures and output comprises speech and a laser pointing system. A computational model of natural turn-taking in goaloriented face-to-face multi-modal dialogues (including speech, gestures and body language) is introduced, and visual and auditory conversational signals for 3D artificial talking heads as interactive interface agents are dealt with so that speech gestures and face and head movements are properly synchronized.
- Natural language and multimodal interfaces
- scientific article; zbMATH DE number 1893237
- A tool for interactive advice on the use of speech in multimodal systems
- Advances in natural multimodel dialogue systems. Papers based on the presentations at the international workshop on natural intelligent and effective interaction in multimodal dialogue systems, Copenhagen, Danmark, 2002.
- Multimodal Interface for Human-Machine Communication
- Advances in natural multimodel dialogue systems. Papers based on the presentations at the international workshop on natural intelligent and effective interaction in multimodal dialogue systems, Copenhagen, Danmark, 2002.
- Natural language and multimodal interfaces
- scientific article; zbMATH DE number 736680 (Why is no real title available?)
- scientific article; zbMATH DE number 736770 (Why is no real title available?)
- scientific article; zbMATH DE number 1943823 (Why is no real title available?)
- scientific article; zbMATH DE number 1958153 (Why is no real title available?)
- scientific article; zbMATH DE number 2033310 (Why is no real title available?)
- Multimodal Interface for Human-Machine Communication
- An agent-based architecture for multimodal interaction
- scientific article; zbMATH DE number 1893243 (Why is no real title available?)
- scientific article; zbMATH DE number 1893246 (Why is no real title available?)
- scientific article; zbMATH DE number 1414427 (Why is no real title available?)
- scientific article; zbMATH DE number 972604 (Why is no real title available?)
- A tool for interactive advice on the use of speech in multimodal systems
- Interactive multi-modal question-answering.
This page was built for publication: Multimodality in language and speech systems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1408491)
