Integration of Natural Language and Vision Processing

Although there has been much progress in developing theories, models and systems in the areas of Natural Language Processing (NLP) and Vision Processing (VP) there has heretofore been little progress on integrating these subareas of Artificial Intelligence (AI). This book contains a set of edited papers addressing computational models and systems for the integration of NLP and VP. The papers focus on site descriptions such as that of the large Japanese $500 million Real World Computing (RWC) project, on historical philosophical issues, on systems which have been built and which integrate the processing of visual scenes together with language about them, and on spatial relations which appear to be the key to integration. The U. S. A. , Japan and the EU are well reflected, showing up the fact that integration is a truly international issue. There is no doubt that all of this will be necessary for the InformationSuperHighways of the future.

The Real World Computing Program. - An Investigation into the Common Semantics of Language and Vision. - Hierarchical Labelling for Integrating Images and Words. - Quantitative Perceptual Representation of Prepositional Semantics. - From Vision to Multimodal Communication: Incremental Route Descriptions. - VIsual TRAnslator: Linking Perceptions and Natural Language Descriptions. - A Vision of `Vision and Language Comprises Action: An Example from Road Traffic. - What You Say is What You See Interactive Generation, Manipulation and Modification of 3-D Shapes Based on Verbal Description. - Towards an American Sign Language Interface. - Integrating Natural Language Understanding with Document Structure Analysis. - Computational Models for Integrating Linguistic and Visual Information: A Survey. - Grounding Language in Perception. - Connectionist Visualisation of Tonal Structure. - Use of Captions and Other Collateral Text in Understanding Photographs. - The DenK-architecture: A Fundamental Approach to User-Interfaces. - AI Meets Authoring: User Models for Intelligent Multimedia. - Book Reviews: The Search for Mind: A New Foundation for Cognitive Science (Nadine Lucas and Jean-Baptiste Berthelin). - Book Reviews: Computers and Creativity (Stuart A. Jackson). - Book Reviews: A Connectionist Language Generator (Amanda J. C. Sharkey).