Abstract
This paper proposes a study regarding smartphone-oriented mobile devices capable of simultaneous passive RGB imaging and active infrared imaging for both projection and image sensing. Using RGB and infrared wavelengths together enables foreground interactive projection and background vision-based analysis to be done without unwanted crosstalk between the two spectrums or visible interruption to audiences. Our proposal includes detachable and rotatable mobile configuration designs, general computing paradigm and multimodal interface strategy; all are presented in a smartphone-oriented manner. Experiments are conducted to clarify efficiency and limitation of our proposal using a proof-of-concept setup. Despite of internal optic and mechanism which requires cooperation from technologys owner to fully accomplish, we believe that our proposal is useful and sustainable, enabling easy compatibility and maintenance with future mobile devices.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Akasaka, K., Sagawa, R., Yagi, Y.: A sensor for simultaneously capturing texture and shape by projecting structured infrared light. In: Procs. of the 6th International Conference on 3-D Digital Imaging and Modeling, pp. 375–381 (2007)
Cotting, D., Gross, M.: Interactive environment-aware display bubbles. In: Procs. of the ACM Symposium on User Interface Software and Technology (UIST 2006), pp. 245–254 (2006)
Cotting, D., Naef, M., Gross, M., Fuchs, H.: Embedding imperceptible patterns into projected images for simultaneous acquisition and display. In: Procs. of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR 2004), pp. 100–109 (2004)
Follmer, S., Johnson, M., Adelson, E., Ishii, H.: deform: An interactive malleable surface for capturing 2.5d arbitrary objects, tools and touch. In: Procs. of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST 2011), pp. 527–536 (2011)
Lee, J., Hudson, S., Dietz, P.: Hybrid infrared and visible light projection for location tracking. In: Procs. of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST 2007), pp. 57–60 (2007)
Lochtefeld, M., Gehring, M., Schoning, J., Kruger, A.: Shelftorchlight: Augmenting a shelf using a camera projector unit. In: Internation Conference on Pervasive Computing, Workshop on Personal Projection (UbiProjection 2010), pp. 1–4 (2010)
Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Mistry, P., Maes, P., Chang, L.: Wuw - wear ur world: A wearable gestural interface. In: Procs. of the CHI Extended Abstracts on Human Factors in Computing Systems (CHI 2009), pp. 4111–4116 (2009)
Molyneaux, D., Izadi, S., Kim, D., Hilliges, O., Hodges, S., Cao, X., Butler, A., Gellersen, H.: Interactive environment-aware handheld projectors for pervasive computing spaces. In: Kay, J., Lukowicz, P., Tokuda, H., Olivier, P., Krüger, A. (eds.) Pervasive 2012. LNCS, vol. 7319, pp. 197–215. Springer, Heidelberg (2012)
Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., Fuchs, H.: The office of the future: A unified approach to image-based modeling and spatially immersive displays. In: Procs. of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 1998), pp. 179–188 (1998)
Siriborvornratanakul, T., Sugimoto, M.: Clutter-aware adaptive projection inside a dynamic environment. In: Procs. of the 15th ACM Symposium on Virtual Reality Software and Technology (VRST 2008), pp. 241–242 (2008)
Willis, K., Poupyrev, I., Hudson, S., Mahler, M.: Sidebyside: Ad-hoc multi-user interaction with handheld projectors. In: Procs. of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST 2011), pp. 431–440 (2011)
Wilson, A.: Playanywhere: A compact interactive tabletop projection-vision system. In: Procs. of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST 2005), pp. 83–92 (2005)
Yoshida, T., Hirobe, Y., Nii, H., Kawakami, N., Tachi, S.: Twinkle: Interacting with physical surfaces using handheld projector. In: Procs. of IEEE Virtual Reality Conference, VR 2010, pp. 87–90 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Siriborvornratanakul, T. (2014). Multimodal Interface Towards Smartphones: The Use of Pico Projector, Passive RGB Imaging and Active Infrared Imaging. In: Perales, F.J., Santos-Victor, J. (eds) Articulated Motion and Deformable Objects. AMDO 2014. Lecture Notes in Computer Science, vol 8563. Springer, Cham. https://doi.org/10.1007/978-3-319-08849-5_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-08849-5_5
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08848-8
Online ISBN: 978-3-319-08849-5
eBook Packages: Computer ScienceComputer Science (R0)