Abstract
Increasingly, cell phones are used to browse for information while location systems assist in gathering information that is most appropriate to the user’s current location. We seek to take this one step further and actually overlay information on to the physical world using the cell phone’s camera and thereby minimize a user’s cognitive effort. This “magic lens” approach has many applications of which we are exploring two: indoor building navigation and dynamic directory assistance. In essence, we match “landmarks” identified in the camera image with those stored in a building database. We use two different types of features – floor corners that can be matched against a floorplan and SIFT features that can be matched to a database constructed from other images. The camera’s pose can be determined exactly from a match and information can be properly aligned so that it can overlay directly onto the phone’s image display. In this paper, we present early results that demonstrate it is possible to realize this capability for a variety of indoor environments. Latency is shown to already be reasonable and likely to be improved by further optimizations. Our goal is to further explore the computational tradeoff between the server and phone client so as to achieve an acceptable latency of a few seconds.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Liu, A.L., Hile, H., Kautz, H., Borriello, G., Brown, P.A., Harniss, M., Johnson, K.: Indoor wayfinding: developing a functional interface for individuals with cognitive impairments. In: Assets 2006: Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility, pp. 95–102. ACM Press, New York, USA (2006)
Ekahau Wi-Fi positioning engine, a commercial location product, http://www.ekahau.com/
Ferris, B., Haehnel, D., Fox, D.: Gaussian processes for signal strength-based location estimation. In: Proceedings of Robotics: Science and Systems, Philadelphia, USA (August 2006)
Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: exploring photo collections in 3d. ACM Trans. Graph 25(3), 835–846 (2006)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60(2), 91–110 (2004)
Kosaka, A., Pan, J.: Purdue experiments in model-based vision for hallway navigation. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 1, 87–96 (1995)
Karlsson, N., di Bernardo, E., Ostrowski, J., Goncalves, L., Pirjanian, P., Munich, M.: The vslam algorithm for robust localization and mapping. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation, pp. 24–29 (April 2005)
Dellaert, F., Burgard, W., Fox, D., Thrun, S.: Using the condensation algorithm for robust, vision-based mobile robot localization. In: Proc. of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (1999)
Wolf, J., Burgard, W., Burkhardt, H.: Robust vision-based localization for mobile robots using an image retrieval system based on invariant features. In: Proceedings of the IEEE International Conference on Robotics and Automation (2002)
Fritz, G., Seifert, C., Paletta, L.: A mobile vision system for urban detection with informative local descriptors. In: ICVS 2006: Proceedings of the Fourth IEEE Intl Conference on Computer Vision Systems, IEEE Computer Society, Los Alamitos (2006)
Rekimoto, J., Ayatsuka, Y.: Cybercode: Designing augmented reality environments with visual tags. In: Proceedings of DARE (2000)
Hile, H., Kim, J., Borriello, G.: Microbiology tray and pipette tracking as a proactive tangible user interface. In: Ferscha, A., Mattern, F. (eds.) PERVASIVE 2004. LNCS, vol. 3001, pp. 323–339. Springer, Heidelberg (2004)
Caudell, T., Mizell, D.: Augmented reality: an application of heads-up display technology tomanual manufacturing processes. In: Proceedings of Hawaii International Conference on System Sciences, vol. 2, pp. 659–669 (1992)
Köhler, M., Patel, S., Summet, J., Stuntebeck, E., Abowd, G.: Tracksense: Infrastructure free precise indoor positioning using projected patterns. In: Pervasive Computing (2007)
Hecht, B., Rohs, M., Schöning, J., Krüger, A.: Wikeye - using magic lenses to explore georeferenced wikipedia content. In: 3rd International Workshop on Pervasive Mobile Interaction Devices (PERMID 2007) (2007)
Comaniciu, D., Meer, P.: Mean shift analysis and applications. In: ICCV 1999: Proceedings of the International Conference on Computer Vision, vol. 2, IEEE Computer Society, Los Alamitos (1999)
Guru, D., Dinesh, R., Nagabhushan, P.: Boundary based corner detection and localization using new ’cornerity’ index: A robust approach. In: CRV 2004: Proceedings of the 1st Canadian Conference on Computer and Robot Vision (CRV 2004), pp. 417–423. IEEE Computer Society, Los Alamitos (2004)
Rous, M., Lupschen, H., Kraiss, K.: Vision-based indoor scene analysis for natural landmark detection. In: IEEE International Conference on Robotics and Automation, pp. 4642–4647 (April 2005)
Nokia mobile augmented reality applications (MARA), http://research.nokia.com/research/projects/mara/index.html
Muller, H.J., Schoning, J., Kruger, A.: Mobile map interaction - evaluation in an indoor scenario. In: Workshop,Mobile and Embedded Interactive Systems (MEIS 2006), part of Informatik (October 2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hile, H., Borriello, G. (2007). Information Overlay for Camera Phones in Indoor Environments. In: Hightower, J., Schiele, B., Strang, T. (eds) Location- and Context-Awareness. LoCA 2007. Lecture Notes in Computer Science, vol 4718. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75160-1_5
Download citation
DOI: https://doi.org/10.1007/978-3-540-75160-1_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75159-5
Online ISBN: 978-3-540-75160-1
eBook Packages: Computer ScienceComputer Science (R0)