LipIO: Enabling Lips as both Input and Output Surface

Video figure for “LipIO: Enabling Lips as both Input and Output Surface.“ This work was presented at the ACM CHI 2023 conference in Hamburg, Germany by Arata Jingu. This work was done in collaboration with Yudai Tanaka and Pedro Lopes at the University of Chicago’s Human Computer Integration Lab. Abstract: We engineered LipIO, a novel device enabling the lips to be used simultaneously as an input and output surface. LipIO comprises two overlapping flexible electrode arrays: an outward-facing array for capacitive touch and a lip-facing array for electrotactile stimulation. While wearing LipIO, users feel the interface’s state via lip stimulation and respond by touching their lip with their tongue or opposing lip. More importantly, LipIO provides co-located tactile feedback that allows users to feel where in the lip they are touching—this is key to enabling eyes- and hands-free interactions. Our three studies verified participants perceived electrotactile output on their lips and subsequent