A voice device with an application-adapted protocol for Microsoft Windows

The interaction between the user and a graphical interface relies on a protocol that defines the semantics of the actions performed by the user an the input devices. This protocol binds each action to an effect on the graphical interface. We propose a system that adapts this protocol to the particular context on the graphical interface in order to speed-up many operations. This approach is particularly useful for helping people having physical handicaps to have a comfortable interaction with the most common software tools, like web browsers. In particular we show how the proposed scheme can improve the usability of an input voice device that can be used to control the pointer on the screen instead of a mechanical mouse.