research-article

Detecting shape deformation of soft objects using directional photoreflectivity measurement

Authors:

Anusha Withana,

Daisuke Sakamoto,

Masahiko Inami,

Takeo IgarashiAuthors Info & Claims

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

Pages 509 - 516

https://doi.org/10.1145/2047196.2047263

Published: 16 October 2011 Publication History

Abstract

We present the FuwaFuwa sensor module, a round, hand-size, wireless device for measuring the shape deformations of soft objects such as cushions and plush toys. It can be embedded in typical soft objects in the household without complex installation procedures and without spoiling the softness of the object because it requires no physical connection. Six LEDs in the module emit IR light in six orthogonal directions, and six corresponding photosensors measure the reflected light energy. One can easily convert almost any soft object into a touch-input device that can detect both touch position and surface displacement by embedding multiple FuwaFuwa sensor modules in the object. A variety of example applications illustrate the utility of the FuwaFuwa sensor module. An evaluation of the proposed deformation measurement technique confirms its effectiveness.

Supplementary Material

JPG File (fp145.jpg)

Download
16.16 KB

MP4 File (fp145.mp4)

Download
36.16 MB

References

[1]

Baudisch, P., Sinclair, M. and Wilson, A. Soap: a pointing device that works in mid-air. In Proc. UIST '06, ACM (2006), pp. 43--46.

Digital Library

[2]

Chang, J., MacLean, K. and Yohanan, S. Gesture Recognition in the Haptic Creature. In Proc. EuroHaptics '10, pp. 385--391.

Digital Library

[3]

Choe, E. K., Kientz, J. A., Halko, S., Fonville, A., Sakaguchi, D. and Watson, N. F. Opportunities for computing to support healthy sleep behavior. In Ext. Abst. CHI '10, ACM (2010), pp. 3661--3666.

Digital Library

[4]

Furukawa, M., Uema, Y., Sugimoto, M. and Inami, M. Fur interface with bristling effect induced by vibration. In Proc. AH '10, ACM (2010), Article 17, 6 pages.

Digital Library

[5]

Harrison, C. and Hudson, S. E. Providing Dynamically Changeable Physical Buttons on a Visual Display. In Proc. CHI '09, ACM (2009), pp. 299--308.

Digital Library

[6]

Hiramatsu, R. Puyo-con. In ACM SIGGRAPH ASIA 2009 Art Gallery & Emerging Technologies, ACM (2009), pp. 81--81.

Digital Library

[7]

Inaba, M., Hoshino, Y., Nagasaka, K., Kagami, S. and Inoue, H. A full-body tactile sensor suit using electrically conductive fabric and strings. In Proc. IROS '96, IEEE (1996), pp. 450--457.

[8]

Johnson, M. P., Wilson, A., Blumberg, B., Kline, C. and Bobick, A. Sympathetic interfaces: using a plush toy to direct synthetic characters. In Proc. CHI '99, ACM (1999), pp. 152--158.

Digital Library

[9]

Kadowaki, A., Yoshikai, T., Hayashi, M., Inaba, M. Development of Soft Sensor Exterior Embedded with Multi-axis Deformable Tactile Sensor System. In Proc. RoMan '09, IEEE (2009), pp.1093--1098.

[10]

Marti, S. and Schmandt, C. Physical embodiments for mobile communication agents. In Proc. UIST '05, ACM (2005), pp. 231--240.

Digital Library

[11]

Miyashita, T., Tajika, T., Ishiguro, H., Kogure, K. and Hagita, N. Haptic communication between humans and robots. In Proc. ISRR '05, 2005.

[12]

Murakami, T. and Nakajima, N. Direct and intuitive input device for 3-D shape deformation. In Proc. CHI '94, ACM (1994), pp. 233--236.

Digital Library

[13]

Nakajima, K., Itoh, Y., Yoshida, A., Takashima, K., Kitamura, Y. and Kishino, F. FuSA2 touch display. In ACM SIGGRAPH 2010 Emerging Technologies, ACM (2010), Article 11, 1 pages.

Digital Library

[14]

Nintendo, Wii Fit, http://www.nintendo.co.jp/wii/rfnj.

[15]

Ramos, G., Boulos, M. and Balakrishnan, R. Pressure widgets. In Proc. CHI '04, ACM (2004), pp. 487--494.

Digital Library

[16]

Samani, H. A., et al. A Design Process for Lovotics. Human - Robot Personal Relationships. In Proc. HRPR '10, Springer LNICST series, Volume 59, pp. 118--125.

[17]

Sato, T., Mamiya, H., Koike, H. and Fukuchi, K. Photoelastictouch: transparent rubbery tangible interface using an lcd and photoelasticity. In Proc. UIST '09, ACM (2009), pp. 43--50.

Digital Library

[18]

Sekiguchi, D., Inami, M. and Tachi, S. RobotPHONE: RUI for Interpersonal Communication. In Ext. Abst. CHI '01, ACM (2001), pp. 277--278.

Digital Library

[19]

Slyper, R., Poupyrev, I. and Hodgins, J. Sensing through structure: designing soft silicone sensors. In Proc. TEI '11, ACM (2011), pp. 213--220.

Digital Library

[20]

Smith, R. T., Thomas, B. H. and Piekarski, W. Digital foam interaction techniques for 3D modeling. In Proc. VRST '08, ACM (2008), pp. 61--68.

Digital Library

[21]

Thubuthubu-shugei-wata, Arai Corporation, http://www.sofiapack.com/hobby.htm.

[22]

Ueki, A., Kamata, M. and Inakage, M. Tabby: designing of coexisting entertainment content in everyday life by expanding the design of furniture. In Proc. ACE '07, ACM (2007), pp. 72--78.

Digital Library

[23]

Wada, K. and Shibata, T. Social effects of robot therapy in a care house - change of social network of the residents for two months. In Proc. ICRA '07, IEEE (2007), pp. 1250--1255.

[24]

Weinberg, G. Orth, M. and Russo, P. The embroidered musical ball: a squeezable instrument for expressive performance. In Ext. Abst. CHI '00, ACM (2000), pp. 283--284.

Digital Library

[25]

Weiss, M., Wagner, J., Jansen, Y., Jennings, R., Khoshabeh, R., Hollan, J. D. and Borchers, J. 2009. SLAP widgets: bridging the gap between virtual and physical controls on tabletops. In Proc. CHI '09, ACM (2009), pp. 481--490.

Digital Library

[26]

Winnicott, D. (1953). Transitional objects and transitional phenomena, Int. J. Psychoanal, 34, pp. 89--97.

[27]

Yasumoto, M. Balance ball interface. In ACM SIGGRAPH ASIA 2008 Art Gallery & Emerging Technologies, ACM (2008), pp. 41--41.

Digital Library

[28]

Yonezawa, T., Clarkson, B., Yasumura, M. and Mase, K. Context-aware sensor-doll as a music expression device. In Ext. Abst. CHI '01, ACM (2001), pp. 307--308.

Digital Library

Cited By

Zhou NDevleminck SGeurts L(2024)Contact Resistance Sensing for Touch and Squeeze InteractionsMultimodal Technologies and Interaction10.3390/mti80200148:2(14)Online publication date: 17-Feb-2024
https://doi.org/10.3390/mti8020014
Min TXia CYamamoto TSugiura Y(2023)Seeing the Wind: An Interactive Mist Interface for Airflow InputProceedings of the ACM on Human-Computer Interaction10.1145/36264807:ISS(398-419)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626480
Kitamura RYamamoto TSugiura Y(2023)TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective SensorsProceedings of the 2023 ACM International Symposium on Wearable Computers10.1145/3594738.3611371(92-97)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1145/3594738.3611371
Show More Cited By

Index Terms

Detecting shape deformation of soft objects using directional photoreflectivity measurement
1. Human-centered computing

Recommendations

A thin stretchable interface for tangential force measurement
UIST '12: Proceedings of the 25th annual ACM symposium on User interface software and technology

We have developed a simple skin-like user interface that can be easily attached to curved as well as flat surfaces and used to measure tangential force generated by pinching and dragging interactions. The interface consists of several photoreflectors ...
SofTouch: Turning Soft Objects into Touch Interfaces Using Detachable Photo Sensor Modules
Entertainment Computing – ICEC 2017
Abstract
We propose a system that turns everyday soft objects, such as cushions, into touch interfaces in a non-intrusive manner. The belt type sensor modules developed in this study, which can be attached to the outside of soft objects, comprise several ...
Shape Measurement of Curved Objects Using Multiple Slit-Ray Projections

A method for the shape measurement of curved objects has been developed using multiple slit-ray projections and a turntable. The object is placed on a computer-controlled turntable and irradiated by two directed slit-ray projectors. An ITV camera takes ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

October 2011

654 pages

ISBN:9781450307161

DOI:10.1145/2047196

General Chair:
Jeff Pierce
IBM Research, USA
,
Program Chairs:
Maneesh Agrawala
University of California, Berkeley, USA
,
Scott Klemmer
Stanford University, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '11

Sponsor:

UIST '11: The 24th Annual ACM Symposium on User Interface Software and Technology

October 16 - 19, 2011

California, Santa Barbara, USA

Acceptance Rates

UIST '11 Paper Acceptance Rate 67 of 262 submissions, 26%;

Overall Acceptance Rate 842 of 3,967 submissions, 21%

Upcoming Conference

UIST '24

Sponsor:
sigchi
sigchi

The 37th Annual ACM Symposium on User Interface Software and Technology

October 13 - 16, 2024

Pittsburgh , PA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

80
Total Citations
View Citations
1,260
Total Downloads

Downloads (Last 12 months)49
Downloads (Last 6 weeks)5

Reflects downloads up to 12 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhou NDevleminck SGeurts L(2024)Contact Resistance Sensing for Touch and Squeeze InteractionsMultimodal Technologies and Interaction10.3390/mti80200148:2(14)Online publication date: 17-Feb-2024
https://doi.org/10.3390/mti8020014
Min TXia CYamamoto TSugiura Y(2023)Seeing the Wind: An Interactive Mist Interface for Airflow InputProceedings of the ACM on Human-Computer Interaction10.1145/36264807:ISS(398-419)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626480
Kitamura RYamamoto TSugiura Y(2023)TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective SensorsProceedings of the 2023 ACM International Symposium on Wearable Computers10.1145/3594738.3611371(92-97)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1145/3594738.3611371
Mizuho YKitamura RSugiura Y(2023)Estimation of Violin Bow Pressure Using Photo-Reflective SensorsProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614172(216-223)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614172
Niewiadomski RBeyan CSciutti A(2023)Affect Recognition in Hand-Object Interaction Using Object-Sensed Tactile and Kinematic DataIEEE Transactions on Haptics10.1109/TOH.2022.323064316:1(112-117)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TOH.2022.3230643
Sin ZChen PNg PLeong H(2022)Tracking Stuffed Toy for Naturally Mapped Interactive Play via a Soft-Pose EstimatorProceedings of the ACM on Human-Computer Interaction10.1145/35495186:CHI PLAY(1-25)Online publication date: 31-Oct-2022
https://dl.acm.org/doi/10.1145/3549518
Blontrock KBrijs LVan Dijk LGys JVan Peer JRenders VTang KGerling KGeurts LWauters J(2022)Escape from the Hamster Wheel: Exploring the Role of Joy of Movement in Movement-based GamesExtended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play10.1145/3505270.3558382(327-332)Online publication date: 2-Nov-2022
https://dl.acm.org/doi/10.1145/3505270.3558382
Schmitz MGünther SSchön DMüller F(2022)Squeezy-Feely: Investigating Lateral Thumb-Index Pinching as an Input ModalityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501981(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501981
Xia CSaito ASugiura Y(2022)Using the virtual data-driven measurement to support the prototyping of hand gesture recognition interface with distance sensorSensors and Actuators A: Physical10.1016/j.sna.2022.113463338(113463)Online publication date: May-2022
https://doi.org/10.1016/j.sna.2022.113463
Everitt AEady AGirouard A(2021)Enabling Multi-Material 3D Printing for Designing and Rapid Prototyping of Deformable and Interactive WearablesProceedings of the 20th International Conference on Mobile and Ubiquitous Multimedia10.1145/3490632.3490635(1-11)Online publication date: 5-Dec-2021
https://dl.acm.org/doi/10.1145/3490632.3490635
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents