Taking into Account Users’ (Dis-)Abilities within a Formal Theory of Rational Interaction

P. Clemente (France)


Rational agent, modality allocation, multimodal dialogue.


In this paper we introduce a formal framework for the modeling of rational multimodal dialoguing agents. Based on a rational theory of interaction, the framework enables agents to be conscious of several aspects of the communication : the characteristics of the user, the environment (noisy states, failing modes, etc.), the (un )available media and their modalities, the communicative goals and the types of information to produce. These agents are based on "traditional" rationality principles extended with multimodal rules. These principles and rules are defined as a set of generic axioms, which enable agents to plan communicative acts, that actually are multimodal acts. As the agents have a description of the entire communication process, they are not limited in the number or kinds of media and modalities. Moreover, the generic and task specific rules of multimodal behavior enable these agents to adapt to the applicative context and environment. In this paper, we will focus on the following aspects : the ability of the agents to take care of the users' preferences and explicit choices and physical handicaps, the dynamic management of self media (failures, additions to the current dialogue, etc.).

Important Links:

Go Back