Toolkit for Expressive Interaction with a Surface through Fiduciary-Tagged Gloves
The hand has incredible potential as an expressive input device. Yet most touch technologies imprecisely recognize limited hand parts (if at all), usually by inferring the hand part from the touch shapes. Our fiduciary-tagged glove is a reliable and very expressive way to gather input about: (a) many parts of a hand (fingertips, knuckles, palms, sides, backs of the hand), and (b) to discriminate between one person’s or multiple peoples’ hands.
The project primarily supplies a toolkit / API to calibrate, identify, and track touch, postures and gestures by such gloves. We also explore interaction possibilities introduced by such capabilities.
Images and Videos
- Nicolai Marquardt, Johannes Kiemer, David Ledo, Sebastian Boring, and Saul Greenberg (2011) Designing User-, Hand-, and Handpart-Aware Tabletop Interactions with the TOUCHID Toolkit. In ACM International Conference on Interactive Tabletops and Surfaces-ITS’2011. (Kobe, Japan), ACM Press, 10 pages, November 13-16. Include video figure, duration 3:42 minutes.(click here for the Video File)
- Johannes Kiemer, The Fiduciary Glove Toolkit, Master’s Thesis, Dept Institut fur Informatik, Ludwig-Maximilians-Universitat Munchen, Munich, Germany, 2011. Supervisors: Nicolai Marquardt and Saul Greenberg, Professor in charge: Andreas Butz.
- Nicolai Marquardt, Johannes Kiemer, Saul Greenberg, What Caused That Touch? Expressive Interaction with a Surface through Fiduciary-Tagged Gloves. Proceedings of ACM Conference on Interactive Tabletops and Surfaces 2010, Saarbruecken, Germany, ACM Press, 2010.
- Nicolai Marquardt, Johannes Kiemer, Saul Greenberg, What Caused That Touch? The Video, Research Report 2010-965-14, Department of Computer Science, University of Calgary, Calgary, Alberta, Canada, 2010.
Demos & Software Components
NSERC – iCORE – SMART Technologies
- 1.1.3: Expanding the Interaction Design Palette
- 1.2.1: Input and Interaction with a Surface
- 3.2.1: Identifying Basic Services
- 3.2.2: Multi-User Gestures
- 3.4.2: Interface Toolkits for Surface Applications
- 3.4.4: Multi-User UI Components
- Saul Greenberg (Supervisor)
- Nic Marquardt (PhD Student)
- Joe Kiemer (Research Intern)