Presented at CHI 2012, Touché is a capacitive system for pervasive, continuous sensing. Among other amazing capabilities, it can accurately sense gestures a user makes on his own body. “It is conceivable that one day mobile devices could have no screens or buttons, and rely exclusively on the body as the input surface.” Touché.
Two types of gestures were considered for the study: pantomimes, which mimic objects or actions, such as unscrewing a jar or juggling balls, and emblems, which are commonly used in social interactions and which signify abstract, usually more emotionally charged concepts than pantomimes. Examples include a hand sweeping across the forehead to indicate “it’s hot in here!” or a finger to the lips to signify “be quiet.”
Current thinking in the study of language is that, like a smart search engine that pops up the most suitable Web site at the top of its search results, the posterior temporal region serves as a storehouse of words from which the inferior frontal gyrus selects the most appropriate match. The researchers suggest that, rather than being limited to deciphering words alone, these regions may be able to apply meaning to any incoming symbols, be they words, gestures, images, sounds, or objects.
It doesn’t surprise me that a widely held theory of language is based on our understanding of how search engines work, because we tend to conceptualize our world with metaphors based on technology. But this suggests that many of our abstract theories might be pinned to planned obsolescence schedules, which is kind of amusing.
A colleague just sent along a link to the Interactive Gestures wiki. It looks like a great resource, with information about gestural interfaces themselves but also a list of direct and indirect gestures that are currently incorporated into commercial products.