research-article

Towards measuring the quality of interaction: communication through telepresence robots

Authors:

Katherine M. Tsui,

Holly A. YancoAuthors Info & Claims

PerMIS '12: Proceedings of the Workshop on Performance Metrics for Intelligent Systems

Pages 101 - 108

https://doi.org/10.1145/2393091.2393112

Published: 20 March 2012 Publication History

Abstract

Personal video conferencing is now a common occurrence in long distance interpersonal relationships. Telepresence robots additionally provide mobility to video conferencing, and people can converse without being restricted to a single vantage point. The metrics to explicitly quantify person to person interaction through a telepresence robot do not yet exist. In this paper, we discuss technical requirements needed to support such a communication. We also look at the fields of human-computer interaction (HCI), computer supported cooperative work (CSCW), communications, and psychology for quantitative and qualitative performance measures which are independent of interpersonal relationships and communication task.

References

[1]

Amer. Natl. Standards Institute. S3. 5-1997, Methods for the Calculation of the Speech Intelligibility Index, 1997.

[2]

Apple. Apple Introduces iChat AV and iSight. Press release, June 2003. http://www.apple.com/pr/library/2003/jun/23ichat.html.

[3]

J. Bailenson and N. Yee. A Longitudinal Study of Task Performance, Head Movements, Subjective Report, Simulator Sickness, and Transformed Social Interaction in Collaborative Virtual Environments. Presence: Teleoperators and Virtual Environments, 15(6): 699--716, 2006.

Digital Library

[4]

P. Barnett and R. Knight. The Common Intelligibility Scale. Inst. of Acoustics, 17(7): 201--206, 1996.

[5]

J. Beer and L. Takayama. Mobile Remote Presence Systems for Older Adults: Acceptance, Benefits, and Concerns. In Proc. of Intl. Conf. on Human-Robot Interaction, pp. 19--26. ACM, 2011.

Digital Library

[6]

M. Bekker, J. Olson, and G. Olson. Analysis of Gestures in Face-to-Face Design Teams Provides Guidance for How to Use Groupware in Design. In Proc. of 1st Conf. on Designing Interactive Systems: Processes, Practices, Methods, & Techniques, pp. 157--166. ACM, 1995.

Digital Library

[7]

L. Beranek. Airplane Quieting II: Specification of Acceptable Noise Levels. Trans. Amer. Soc. Mech. Engrs, 69: 97--100, 1947.

[8]

B. Cohen, J. Lanir, R. Stone, and P. Gurevich. Requirements and Design Considerations for a Fully Immersive Robotic Telepresence System. In Proc. of Human-Robot Interaction Wksp. on Social Robotic Telepresence, 2011.

[9]

S. Coradeschi, A. Loutfi, A. Kristoffersson, S. Von Rump, A. Cesta, and G. Cortellessa. Towards a Methodology for Longitudinal Evaluation of Social Robotic Telepresence for Elderly. In Proc. of Human-Robot Interaction Wksp. on Social Robotic Telepresence, 2011.

Digital Library

[10]

L. Cronbach. Coefficient Alpha and the Internal Structure of Tests. Psychometrika, 16(3): 297--334, 1951.

[11]

B. Deml. Human Factors Issues on the Design of Telepresence Systems. Presence: Teleoperators and Virtual Environments, 16(5): 471--487, 2007.

Digital Library

[12]

M. Desai, K. M. Tsui, H. A. Yanco, and C. Uhlik. Essential Features of Telepresence Robots. In Proc. of Intl. Conf. on Technologies for Practical Robot Applications. IEEE, 2011.

[13]

X. Ding, T. Erickson, W. Kellogg, S. Levy, J. Christensen, J. Sussman, T. Wolf, and W. Bennett. An Empirical Study of the Use of Visually Enhanced VoIP Audio Conferencing: The Case of IEAC. In Proc. of SIGCHI Conf. on Human Factors in Computing Systems, pp. 1019--1028. ACM, 2007.

Digital Library

[14]

D. Fels, J. Waalen, S. Zhai, and P. Weiss. Telepresence Under Exceptional Circumstances: Enriching the Connection to School for Sick Children. Proc. of IFIP INTERACT01: Human-Computer Interaction, pp. 617--624, 2001.

[15]

D. Fels, L. Williams, G. Smith, J. Treviranus, and R. Eagleson. Developing a Video-mediated Communication System for Hospitalized Children. Telemedicine J., 5(2): 193--208, 1999.

[16]

R. Fish, R. Kraut, R. Root, and R. Rice. Evaluating Video as a Technology for Informal Communication. In Proc. of SIGCHI Conf. on Human Factors in Computing Systems, pp. 37--48. ACM, 1992.

Digital Library

[17]

E. Geelhoed, A. Parker, D. Williams, and M. Groen. Effects of Latency on Telepresence. Technical Report HPL-2009-120, Hewlett-Packard Labs, 2009.

[18]

B. Glaser and A. Strauss. The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine Publ., 1977.

[19]

D. Grayson and L. Coventry. The Effects of Visual Proxemic Information in Video mediated Communication. ACM SIGCHI Bulletin, 30(3): 30--39, 1998.

Digital Library

[20]

H. Haas. The Influence of a Single Echo on the Audibility of Speech. J. Audio Eng. Soc., 20(2): 146--159, 1972.

[21]

M. Hassenzahl. Encyclopedia Chapter on User Experience and Experience Design. Webpage, 2011. http://www.interaction-design.org/encyclopedia/user_experience_and_experience_design.html, accessed April 2011.

[22]

W. IJsselsteijn, J. Baren, P. Markopoulos, N. Romero, and B. Ruyter. Measuring Affective Benefits and Costs of Mediated Awareness: Development and Validation of the ABC-Questionnaire. Awareness Systems, pp. 473--488, 2009.

[23]

Intl. Electrotechnical Commission. 60268-16. Objective Rating of Speech Intelligibility by the Speech Transmission Index, Mar. 1998.

[24]

Intl. Telecommunication Union. Rec. P. 910, Subjective Video Quality Assessment Methods for Multimedia Applications, Sep. 1999.

[25]

Intl. Telecommunication Union. Rec. P. 805, Perceptual Evaluation of Speech Quality (PESQ): An Objective Method for End-to-End Speech Quality Assessment of Narrow-Band Telephone Networks and Speech Codecs, Feb. 2001.

[26]

Intl. Telecommunication Union. Rec. BT. 500-11, Methodology for the Subjective Assessment of the Quality of Television Pictures, 2002.

[27]

Intl. Telecommunication Union. Rec. P. 805, Subjective Evaluation of Conversational Quality, Apr. 2007.

[28]

Intl. Telecommunication Union. Rec. J. 247, Objective Perceptual Multimedia Video Quality Measurement in the Presence of a Full Reference, Aug. 2008.

[29]

Intl. Telecommunication Union. G. 711: Pulse Code Modulation (PCM) of Voice Frequencies, Nov. 2009.

[30]

Intl. Telecommunication Union. G. 729: Coding of Speech at 8 kbit/s Using Conjugate-Structure Algebraic-Code-Excited Linear Prediction (CS-ACELP), Mar. 2011.

[31]

InTouch Health. FAQ, 2011. http://www.intouchhealth.com/ITHFAQs.pdf, accessed Nov. 2011.

[32]

E. Isaacs and J. Tang. What Video Can and Cannot Do for Collaboration: A Case Study. Multimedia Systems, 2(2): 63--73, 1994.

Digital Library

[33]

K. Jokinen, M. Nishida, and S. Yamamoto. Eye-gaze Experiments for Conversation Monitoring. In Proc. of 3rd Intl. Universal Communication Symp., pp. 303--308. ACM, 2009.

Digital Library

[34]

S. Kiesler, A. Powers, S. Fussell, and C. Torrey. Anthropomorphic Interactions with a Robot and Robot-like Agent. Social Cognition, 26(2): 169--181, 2008.

[35]

D. Kirk, A. Sellen, and X. Cao. Home Video Communication: Mediating "Closeness". In Proc. of Conf. on Computer Supported Cooperative Work, pp. 135--144. ACM, 2010.

Digital Library

[36]

A. Kristoffersson, S. Coradeschi, K. Severinson Eklundh, and A. Loutfi. Sense of Presence in a Robotic Telepresence Domain. Universal Access in Human-Computer Interaction. Users Diversity, pp. 479--487, 2011

Digital Library

[37]

M. Lee and L. Takayama. "Now, I Have a Body": Uses and Social Norms for Mobile Remote Presence in the Workplace. In Proc. of SIGCHI Conf. on Human Factors in Computing Systems, pp. 33--42. ACM, 2011.

Digital Library

[38]

M. Lombard and T. Weinstein. Measuring Presence: The Temple Presence Inventory. In Proc. of Intl. Wksp. on Presence, 2009.

[39]

M. Michalisin, S. Karau, and C. Tangpong. The Effects of Performance and Team Cohesion on Attribution: A Longitudinal Simulation. J. of Business Research, 57(10): 1108--1115, 2004.

[40]

F. Michaud, P. Boissy, D. Labonté, S. Brière, K. Perreault, H. Corriveau, A. Grant, M. Lauria, R. Cloutier, M. Roux, et al. Exploratory Design and Evaluation of a Homecare Teleassistive Mobile Robotic System. Mechatronics, 20(7): 751--766, 2010.

[41]

G. Miller and J. Licklider. The Intelligibility of Interrupted Speech. J. Acoustical Soc. of Amer., 1950.

[42]

A. Monk and C. Gale. A Look Is Worth a Thousand Words: Full Gaze Awareness in Video-mediated Conversation. Discourse Processes, 33(3): 257--278, 2002.

[43]

D. Nguyen and J. Canny. More than Face-to-Face: Empathy Effects of Video Framing. In Proc. of SIGCHI Conf. on Human Factors in Computing Systems, pp. 423--432. ACM, 2009.

Digital Library

[44]

J. Nunnaly. Psychometric Theory. McGraw-Hill, New York, 1978.

[45]

B. O'Conaill, S. Whittaker, and S. Wilbur. Conversations Over Video Confs.: An Evaluation of the Spoken Aspects of Video-Mediated Communication. Human-Computer Interaction, 8(4): 389--428, 1993.

Digital Library

[46]

L. O'Gorman. Latency in Speech Feature Analysis for Telepresence Event Coding. In Intl. Conf. on Pattern Recognition, pp. 4464--4467. IEEE, 2010.

Digital Library

[47]

B. Okdie, R. Guadagno, F. Bernieri, A. Geers, and A. Mclarney-Vesotski. Getting to Know You: Face-to-Face Versus Online Interactions. Computers in Human Behavior, 27(1): 153--159, 2011.

Digital Library

[48]

K. Otsuka, J. Yamato, Y. Takemae, and H. Murase. Quantifying Interpersonal Influence in Face-to-Face Conversations Based on Visual Attention Patterns. In Proc. of SIGCHI Conf. on Human Factors in Computing Systems, pp. 1175--1180. ACM, 2006.

Digital Library

[49]

E. Perse. Presence Questionnaire, pp. 276--283. Routledge, Taylor & Francis, 2009.

[50]

J. Rosenberg. Quality Matters, Aug. 2010. http://www.tmcnet.com/ucmag/columns/articles/99344-quality-matters.htm.

[51]

R. Rubin, A. Rubin, E. Graham, E. Perse, and D. Seibold. Communication Research Measures II: A Sourcebook. Routledge, Taylor & Francis, 2009.

[52]

A. Sellen. Remote Conversations: The Effects of Mediating Talk with Technology. Human-Computer Interaction, 10(4): 401--444, 1995.

Digital Library

[53]

K. Sheehy and A. Green. Beaming Children Where They Cannot Go: Telepresence Robots and Inclusive Education: An Exploratory Study. Ubiquitous Learning, 3(1): 135--146, 2011.

[54]

D. Sirkin, G. Venolia, J. Tang, G. Robertson, T. Kim, K. Inkpen, M. Sedlins, B. Lee, and M. Sinclair. Motion and Attention in a Kinetic Videoconferencing Proxy. Human-Computer Interaction, pp. 162--180, 2011.

Digital Library

[55]

Skype. Skype Introduces Video Calling for Macintosh Users. Press release, Sept. 2006. http://about.skype.com/2006/09/skype_introduces_video_calling.html.

[56]

Skype S. A. Amendment No. 2 to Form S-1 Registration Statement. Prospectus, Mar. 2011. http://www.sec.gov/Archives/edgar/data/1498209/000119312511056174/ds1a.htm#rom83085_3a.

[57]

H. Steeneken. Standardisation of Performance Criteria and Assessments Methods for Speech Communication. In European Conf. on Speech Communication and Technology, vol. 1, pp. 255--258, 2006.

[58]

L. Takayama, E. Marder-Eppstein, H. Harris, and J. Beer. Assisted Driving of a Mobile Remote Presence System: System Design and Controlled User Evaluation. In IEEE Intl. Conf. on Robotics and Automation, pp. 1883--1889, 2011.

[59]

T. Tsai, Y. Hsu, A. Ma, T. King, and C. Wu. Developing a Telepresence Robot for Interpersonal Communication with the Elderly in a Home Environment. Telemedicine and e-Health, 13(4): 407--424, 2007.

[60]

K. Tsui, M. Desai, H. Yanco, and C. Uhlik. Telepresence Robots Roam the Halls of My Office Building. In Proc. of Human-Robot Interaction Wksp. on Social Robotic Telepresence, 2011.

[61]

K. Tsui, A. Norton, D. Brooks, H. Yanco, and D. Kontak. Designing Telepresence Robot Systems for Use by People with Special Needs. In Proc. of Intl. Symp. on Quality of Life Technologies 2011: Intelligent Systems for Better Living, held in conjunction with RESNA 2011 as part of FICCDAT, 2011.

[62]

K. M. Tsui, M. Desai, H. A. Yanco, and C. Uhlik. Exploring Use Cases for Telepresence Robots. In Proc. of Intl. Conf. on Human-Robot Interaction. ACM, 2011.

Digital Library

[63]

J. Van Baren, W. IJsselsteijn, P. Markopoulos, N. Romero, and B. de Ruyter. Measuring Affective Benefits and Costs of Awareness Systems Supporting Intimate Social Networks. In CTIT Wksp. Proc. Series, vol. 2, pp. 13--19, 2004.

[64]

R. van der Kleij, J. Maarten Schraagen, P. Werkhoven, and C. De Dreu. How Conversations Change over Time in Face-to-Face and Video-mediated Communication. Small Group Research, 40(4): 355--381, 2009.

[65]

V. Venkatesh and S. Brown. A Longitudinal Investigation of Personal Computers in Homes: Adoption Determinants and Emerging Challenges. MIS Quarterly, pp. 71--102, 2001.

Digital Library

[66]

G. Venolia, J. Tang, R. Cervantes, S. Bly, G. Robertson, B. Lee, and K. Inkpen. Embodied Social Proxy: Mediating Interpersonal Connection in Hub-and-Satellite Teams. In Proc. of SIGCHI Conf. on Human Factors in Computing Systems, pp. 1049--1058. ACM, 2010.

Digital Library

[67]

R. Vertegaal, R. Slagter, G. van der Veer, and A. Nijholt. Eye Gaze Patterns in Conversations: There Is More to Conversational Agents than Meets the Eyes. In Proc. of SIGCHI Conf. on Human Factors in Computing Systems, pp. 301--308. ACM, 2001.

Digital Library

[68]

R. Vertegaal, G. van der Veer, and H. Vons. Effects of Gaze on Multiparty Mediated Communication. In Graphics Interface, pp. 95--102, 2000.

[69]

VGo Communications. VGo Communications. Webpage, 2010. http://vgocom.com, accessed Oct. 2010.

[70]

B. Witmer, C. Jerome, and M. Singer. The Factor Structure of the Presence Questionnaire. Presence: Teleoperators & Virtual Environments, 14(3): 298--312, 2005.

Digital Library

[71]

S. Yarosh and P. Markopoulos. Design of an Instrument for the Evaluation of Communication Technologies with Children. In Proc. of Intl. Conf. on Interaction Design and Children, pp. 266--269. ACM, 2010.

Digital Library

Cited By

Schuessler MHormann LDachselt RBlake ARother C(2024)Gazing Heads: Investigating Gaze Perception in Video-Mediated CommunicationACM Transactions on Computer-Human Interaction10.1145/366034331:3(1-31)Online publication date: 11-Jun-2024
https://dl.acm.org/doi/10.1145/3660343
Charteris JBerman JPage A(2022)Virtual inclusion through telepresence robots: an inclusivity model and heuristicInternational Journal of Inclusive Education10.1080/13603116.2022.211276928:11(2475-2489)Online publication date: 11-Sep-2022
https://doi.org/10.1080/13603116.2022.2112769
Gould HArnold MKohn TNansen BGibbs M(2021)Robot death care: A study of funerary practiceInternational Journal of Cultural Studies10.1177/136787792093909324:4(603-621)Online publication date: 14-Jun-2021
https://doi.org/10.1177/1367877920939093

Index Terms

Recommendations

Robots in the loop: telepresence robots in everyday life
HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction

This year's human-robot interaction (HRI) conference focuses on "robots in the loop" and how robots are capable of enhancing the experiences of human users in everyday life and work. Telepresence robots allow operators the ability to participate in ...
Multi-touch interaction for tasking robots
HRI '10: Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction

The objective is to develop a mobile human-robot interface that is optimized for multi-touch input. Our existing interface was designed for mouse and keyboard input and was later adopted for voice and touch interaction. A new multi-touch interface ...
ThrowIO: Actuated TUIs that Facilitate “Throwing and Catching” Spatial Interaction with Overhanging Mobile Wheeled Robots
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

We introduce ThrowIO, a novel style of actuated tangible user interface that facilitates throwing and catching spatial interaction powered by mobile wheeled robots on overhanging surfaces. In our approach, users throw and stick objects that are embedded ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

PerMIS '12: Proceedings of the Workshop on Performance Metrics for Intelligent Systems

March 2012

243 pages

ISBN:9781450311267

DOI:10.1145/2393091

General Chair:
Elena Messina
NIST
,
Program Chair:
Raj Madhavan
UMD-CP/NIST

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

University of Maryland: University of Maryland
NIST: National Institute of Standards & Technology

In-Cooperation

SIGAI: ACM Special Interest Group on Artificial Intelligence

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 March 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Division of Information and Intelligent Systems

Conference

PerMIS'12

Sponsor:

University of Maryland
NIST

PerMIS'12: Performance Metrics for Intelligent Systems

March 20 - 22, 2012

Maryland, College Park

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
625
Total Downloads

Downloads (Last 12 months)43
Downloads (Last 6 weeks)6

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Schuessler MHormann LDachselt RBlake ARother C(2024)Gazing Heads: Investigating Gaze Perception in Video-Mediated CommunicationACM Transactions on Computer-Human Interaction10.1145/366034331:3(1-31)Online publication date: 11-Jun-2024
https://dl.acm.org/doi/10.1145/3660343
Charteris JBerman JPage A(2022)Virtual inclusion through telepresence robots: an inclusivity model and heuristicInternational Journal of Inclusive Education10.1080/13603116.2022.211276928:11(2475-2489)Online publication date: 11-Sep-2022
https://doi.org/10.1080/13603116.2022.2112769
Gould HArnold MKohn TNansen BGibbs M(2021)Robot death care: A study of funerary practiceInternational Journal of Cultural Studies10.1177/136787792093909324:4(603-621)Online publication date: 14-Jun-2021
https://doi.org/10.1177/1367877920939093
Tsui KYanco H(2013)Design Challenges and Guidelines for Social Interaction Using Mobile Telepresence RobotsReviews of Human Factors and Ergonomics10.1177/1557234X135024629:1(227-301)Online publication date: 23-Dec-2013
https://doi.org/10.1177/1557234X13502462

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents