research-article

iRotate: automatic screen rotation based on face orientation

Authors:

Lung-Pan Cheng,

Mike Y. ChenAuthors Info & Claims

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2203 - 2210

https://doi.org/10.1145/2207676.2208374

Published: 05 May 2012 Publication History

Abstract

We present iRotate, an approach to automatically rotate screens on mobile devices to match users' face orientation. Current approaches to automatic screen rotation are based on gravity and device orientation. Our survey of 513 users shows that 42% currently experience auto-rotation that leads to incorrect viewing orientation several times a week or more, and 24% find the problem to be very serious to extremely serious. iRotate augments gravity-based approach, and uses front cameras on mobile devices to detect users' faces and rotates screens accordingly. It requires no explicit user input and supports different user postures and device orientations. We have implemented a iRotate that works in real-time on iPhone and iPad, and we assess the accuracy and limitations of iRotate through a 20- participant feasibility study.

Supplementary Material

MP4 File (paperfile1158-3.mp4)

Supplemental video for “iRotate: automatic screen rotation based on face orientation”

Download
26.77 MB

References

[1]

Balakrishnan, R., Baudel, T., Kurtenbach, G., and Fitzmaurice, G. The Rockin'Mouse: integral 3D manipulation on a plane. Proceedings of the SIGCHI conference on Human factors in computing systems, ACM (1997), 311--318.

Digital Library

[2]

Ballagas, R., Rohs, M., and Sheridan, J. G. Sweep and point and shoot: phonecam-based interactions for large public displays. CHI'05 extended abstracts on Human factors in computing systems, ACM (2005), 1200--1203.

Digital Library

[3]

Bartlett, J. F. Rock 'n' Scroll is Here to Stay. IEEE Computer Graphics and Applications, May (2000), 40--45.

Digital Library

[4]

Blaskó, G., Beaver, W., Kamvar, M., and Feiner, S. Workplane-orientation sensing techniques for tablet PCs. Proceedings of the 17th Annual ACM symposium on User Interface Software and Technology, (2004).

[5]

Bradski, G. R., Clara, S., and Corporation, I. Computer Vision Face Tracking For Use in a Perceptual User Interface. Intel Technology Journal 2, 2 (1998), 12--21.

[6]

Fitzmaurice, G. W., Balakrishnan, R., Kurtenbach, G., and Buxton, B. An exploration into supporting artwork orientation in the user interface. Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, ACM (1999), 167--174.

Digital Library

[7]

Forstall, S. and Blumenberg, C. Portrait-Landscape Rotation Heuristics for a Portable Multifunction Device. US Patent 7978176, 12 July, 2011.

[8]

Hannuksela, J., Sangi, P., Turtinen, M., and Heikkilä, J. Face tracking for spatially aware mobile user interfaces. Image and Signal Processing, (2008), 405--412.

Digital Library

[9]

Hannuksela, J., Sangi, P., and Heikkilä, J. Vision-based motion estimation for interaction with mobile devices. Computer Vision and Image Understanding 108, 1-2 (2007), 188--195.

Digital Library

[10]

Hansen, T. R., Eriksson, E., and Lykke-Olesen, A. Mixed interaction space: designing for camera based interaction with mobile devices. CHI'05 extended abstracts on Human factors in computing systems, ACM (2005), 1933--1936.

Digital Library

[11]

Hinckley, K. and Song, H. Sensor synaesthesia: touch in motion, and motion in touch. Proceedings of the 2011 annual conference on Human factors in computing systems, ACM (2011), 801--810.

Digital Library

[12]

Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. Sensing techniques for mobile interaction. Proceedings of the 13th annual ACM symposium on User interface software and technology, ACM (2000), 91--100.

Digital Library

[13]

Hinckley, K., Sinclair, M., Hanson, E., Szeliski, R., and Conway, M. The VideoMouse: a camera-based multi-degree-of-freedom input device. Proceedings of the 12th annual ACM symposium on User interface software and technology, ACM (1999), 103--112.

Digital Library

[14]

Ip, H. H. S., Hay, Y., and Tang, A. C. C. Body-Brush: a body-driven interface for visual aesthetics. Proceedings of the tenth ACM international conference on Multimedia, ACM (2002), 664--665.

Digital Library

[15]

Janicek, M. CAPTURING AN IMAGE WITH A CAMERA INTEGRATED IN AN ELECTRONIC DISPLAY. US Patent App. 20,090/009,628, 2007.

[16]

Lienhart, R., Kuranov, A., and Pisarevsky, V. Empirical analysis of detection cascades of boosted classifiers for rapid object detection. The German 25th Pattern Recognition Symposium (DAGM '03), (2003), 297--304.

[17]

Ording, B., Van Os, M., and Chaudhri, I. Screen Rotation Gestures on a Portable Multifunction Device. US Patent 7978182, 12 July, 2011.

[18]

Schmidt, A., Beigl, M., and Gellersen, H. W. There is more to context than location. Computers & Graphics 23, 6 (1999), 893--901.

[19]

Segen, J. and Kumar, S. Human-Computer Interaction using Gesture Recognition and 3D Hand Tracking. Image Processing, 1998. ICIP 98. Proceedings. 1998 International Conference on, IEEE (1998), 188--192.

[20]

Sohn, M. and Lee, G. ISeeU: camera-based user interface for a handheld computer. Proceedings of the 7th international conference on Human computer interaction with mobile devices & services, ACM (2005), 299--302.

Digital Library

[21]

Sparacino, F., Wren, C., Davenport, G., and Pentland, A. Augmented performance in dance and theater. International Dance and Technology 99, (1999), 25--28.

[22]

Sparacino, F. (Some) computer vision based interfaces for interactive art and entertainment installations. INTER_FACE Body Boundaries, ed. Emanuele Quinz, Anomalie, n.2, Paris, France, Anomos, Citeseer (2001).

[23]

Wang, J. and Canny, J. TinyMotion: camera phone based interaction methods. CHI'06 extended abstracts on Human factors in computing systems, ACM (2006), 339--344.

Digital Library

[24]

Zhang, L., Shi, Y., and Fan, M. UCam: direct manipulation using handheld camera for 3d gesture interaction. Proceeding of the 16th ACM international conference on Multimedia, ACM (2008), 801--804.

Digital Library

Cited By

Zieher TProbst K(2024)Usability Optimization for Mobile Menu Design: An Empirical Study of Hand Grips and User PreferencesProceedings of the ACM on Human-Computer Interaction10.1145/36765088:MHCI(1-19)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676508
Liu MBello HZhou BLukowicz PKarolus J(2024)iFace: Hand-Over-Face Gesture Recognition Leveraging Impedance SensingProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652923(131-137)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3652923
Toriumi KKamiyama TOguchi MYamaguchi S(2022)Quick Screen View Rotation based on Device Rotation Prediction by SVM2022 IEEE 11th Global Conference on Consumer Electronics (GCCE)10.1109/GCCE56475.2022.10014241(666-667)Online publication date: 18-Oct-2022
https://doi.org/10.1109/GCCE56475.2022.10014241
Show More Cited By

Index Terms

iRotate: automatic screen rotation based on face orientation
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

IrotateGrasp: automatic screen rotation based on grasp of mobile devices
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Automatic screen rotation improves viewing experience and usability of mobile devices, but current gravity-based approaches do not support postures such as lying on one side, and manual rotation switches require explicit user input. iRotateGrasp ...
iRotate grasp: automatic screen rotation based on grasp of mobile devices
UIST Adjunct Proceedings '12: Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology

Automatic screen rotation improves viewing experience and usability of mobile devices, but current gravity-based approaches do not support postures such as lying on one side, and manual rotation switches require explicit user input. iRotate Grasp ...
iRotateGrasp: automatic screen rotation based on grasp of mobile devices
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

Automatic screen rotation improves viewing experience and usability of mobile devices, but current gravity-based approaches do not support postures such as lying on one side, and manual rotation switches require explicit user input. iRotateGrasp ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2012

3276 pages

ISBN:9781450310154

DOI:10.1145/2207676

General Chair:
Joseph A. Konstan
University of Minnesota
,
Program Chairs:
Ed H. Chi
Google
,
Kristina Höök
Mobile Life at KTH

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '12

Sponsor:

SIGCHI

CHI '12: CHI Conference on Human Factors in Computing Systems

May 5 - 10, 2012

Texas, Austin, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
1,206
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)1

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zieher TProbst K(2024)Usability Optimization for Mobile Menu Design: An Empirical Study of Hand Grips and User PreferencesProceedings of the ACM on Human-Computer Interaction10.1145/36765088:MHCI(1-19)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676508
Liu MBello HZhou BLukowicz PKarolus J(2024)iFace: Hand-Over-Face Gesture Recognition Leveraging Impedance SensingProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652923(131-137)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3652923
Toriumi KKamiyama TOguchi MYamaguchi S(2022)Quick Screen View Rotation based on Device Rotation Prediction by SVM2022 IEEE 11th Global Conference on Consumer Electronics (GCCE)10.1109/GCCE56475.2022.10014241(666-667)Online publication date: 18-Oct-2022
https://doi.org/10.1109/GCCE56475.2022.10014241
Shin JSaakes D(2022)The Ergonomics of Couch Potatoes: A Study into Postures for Non-desk Working Scenarios[ ] With Design: Reinventing Design Modes10.1007/978-981-19-4472-7_135(2062-2081)Online publication date: 6-Nov-2022
https://doi.org/10.1007/978-981-19-4472-7_135
Shin JKim DSo CSaakes DBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Body Follows Eye: Unobtrusive Posture Manipulation Through a Dynamic Content Position in Virtual RealityProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376794(1-14)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376794
Loorak MZhou WTrinh HZhao JLi W(2019)Hand-Over-Face Input Sensing for Interaction with Smartphones through the Built-in CameraProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3338286.3340143(1-12)Online publication date: 1-Oct-2019
https://dl.acm.org/doi/10.1145/3338286.3340143
Wobbrock J(2019)Situationally-Induced Impairments and DisabilitiesWeb Accessibility10.1007/978-1-4471-7440-0_5(59-92)Online publication date: 4-Jun-2019
https://doi.org/10.1007/978-1-4471-7440-0_5
Eardley RRoudaut AGill SThompson SKoskinen ILim YCerratto-Pargman TChow KOdom W(2018)Designing for Multiple Hand Grips and Body Postures within the UX of a moving SmartphoneProceedings of the 2018 Designing Interactive Systems Conference10.1145/3196709.3196711(611-621)Online publication date: 8-Jun-2018
https://dl.acm.org/doi/10.1145/3196709.3196711
Khamis MBaier AHenze NAlt FBulling AMandryk RHancock MPerry MCox A(2018)Understanding Face and Eye Visibility in Front-Facing Cameras of Smartphones used in the WildProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173854(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173854
Eardley RRoudaut AGill SThompson SMandryk RHancock MPerry MCox A(2018)Investigating How Smartphone Movement is Affected by Body PostureProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173776(1-8)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173776
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents