Tangible Actions/Replaying Gestures

Once the novelty effect wears off for a direct multitouch interface, interaction can be very slow and inefficient compared to the high-gain mouse interactions most users are familiar with. We developed the concept of Tangible Actions based on the broad idea of making the user’s previous actions tangible and manipulable. Tangible Actions are continually-created interactive in-situ representations of the user’s interface actions that can be modified and re-used at a lower interaction cost than re-performing the original interactions. We have implemented Replaying Gestures on the Microsoft Surface platform, an attempt to make direct multitouch interaction more efficient by allowing the user to record, modify and replay their previous actions.