Shape Understanding System – Communication in Natural Language

Z. Les and M. Les (Australia)

Keywords

natural language processing, shape understanding, theexplanatory expert, the naming expert

Abstract

The aim of this research is to provide the system of shape understanding (SUS) with abilities to understand the speech in order to be able to communicate with another system (robot) or to express the visual perceptual data in the form of the linguistic expressions. In the SUS speech understanding module converts speech signal into a stream of words and next into internal representation of the SUS. The perceived object is interpreted and this interpretation is translated into the sentence that describes the result of the perception, and next into the speech signal. All communication is performed in one of the natural languages e.g. Polish, English. Main novelty of this research is that the perceptual data is interpreted in the terms of the shape classes. This approach makes it possible to relate the linguistic expression to the visual concept and interpret the visual data in the terms of visual categories.

Important Links:



Go Back