Research    Publications    Funding    Professor    People    Course

Myongchan Kim, Sungkil Lee, and Seungmoon Choi

IEEE Trans. Haptics, 7(3), 394–404, 2014.
Tactile feedback coordinated with visual stimuli has proven its worth in mediating immersive multimodal experiences, yet its authoring has relied on content artists. This article presents a fully automated framework of generating tactile cues from streaming images to provide synchronized visuotactile stimuli in real time. The spatiotemporal features of video images are analyzed on the basis of visual saliency and then mapped into the tactile cues that are rendered on tactors installed on a chair. We also conducted two user experiments for performance evaluation. The first experiment investigated the effects of visuotactile rendering against visual-only rendering, demonstrating that the visuotactile rendering improved the movie watching experience to be more interesting, immersive, and understandable. The second experiment was performed to compare the effectiveness of authoring methods and found that the automated authoring approach, used with care, can produce plausible tactile effects similar in quality to manual authoring.
Paper preprints, slides, supplementary materials, and Google Scholar entry
* Copyright Disclaimer: paper preprints in this page are provided only for personal academic uses, and not for redistribution.
@ARTICLE{kim14:hsalc, title={{Saliency-Driven Real-Time Video-to-Tactile Translation}}, author={Myongchan Kim and Sungkil Lee and Seungmoon Choi}, journal={{IEEE Trans. Haptics}}, volume={7}, number={3}, pages={394--404}, year={2014} }

27336, College of Software, Sungkyunkwan University, Tel. +82 31-299-4917, Seobu-ro 2066, Jangan-gu, Suwon, 16419, South Korea
Campus map (how to reach CGLab)