Combining Touchscreens with Passive Rich-ID Building Blocks to Support Context Construction in Touchscreen Interactions

CHI '21

Chin-Yuan Lu*, Han-Wei Hsieh*, Rong-Hao Liang*, Chi-Jung Lee, Ling-Chien Yang, Mengru Xue, Jr-Ling Guo, Meng-Ju Hsieh, Bing-Yu Chen (*contributed equally)

This research investigates the design space of combining touchscreens with passive rich-ID building block systems to support the physical construction of contexts in touchscreen interactions. With two proof-of-concept systems, RFIPillars and RFITiles, we explore various schemes for using tangible inputs for context enrichment in touchscreen interactions. Instead of incorporating an electronic touchscreen module that requires per-module maintenance, this work intentionally makes each tangible object passive. We explore rear-projection solutions to integrate touchscreen interactions into these passive building blocks with capacitive touch sensing techniques and deliberate physical forgiving to retain the merits of being both batteryless and wireless. The presented research artifacts embody the interaction designs and elucidate scalability challenges in integrating touchscreen interactions into this emerging tangible user interface.

[Paper] [Video] [Presentation] [Digital Library]