Semantics-based intelligent Human-Computer Interaction

A recent trend in human-computer interaction is to ease the creation of content such as apps and games via intelligent systems, allowing nonskilled users to define a given system's behavior through visual programming or simplified metalanguages. However, when the number of elements to be controlled increases, the complexity could become comparable to that of traditional coding strategies. This article addresses this issue by proposing a framework for automatically configuring a system's behavior based on user input and context information. Framework effectiveness has been tested in a game-creation scenario and used for automatically mapping user commands on virtual character actions based on a natural language description of the game scene. The use of semantics-based mapping reduces the effort and complexity linked with the configuration of the interaction logic, thus decreasing the number of commands needed for controlling the characters. The Web extra includes the questionnaire and full catalogue of descriptions collected.