Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

MAIL: Multi-Scale Attention-Guided Indoor Localization Using Geomagnetic Sequences

Published: 15 June 2020 Publication History

Abstract

Knowing accurate indoor locations of pedestrians has great social and commercial values, such as pedestrian heatmapping and targeted advertising. Location estimation with sequential inputs (e.g., geomagnetic sequences) has received much attention lately, mainly because they enhance the localization accuracy with temporal correlations. Nevertheless, it is challenging to realize accurate localization with geomagnetic sequences due to environmental factors, such as non-uniform ferromagnetic disturbances. To address this, we propose MAIL, a multi-scale attention-guided indoor localization network, which turns these challenges into favorable advantages. Our key contributions are as follows. First, instead of extracting a single holistic feature from an input sequence directly, we design a scale-based feature extraction unit that takes variational anomalies at different scales into consideration. Second, we propose an attention generation scheme that identifies attention values for different scales. Rather than setting fixed numbers, MAIL learns them adaptively with the input sequence, thus increasing its adaptability and generality. Third, guided by attention values, we fuse multi-scale features by paying more attention to prominent ones and estimate current location with the fused feature. We evaluate the performance of MAIL in three different trial sites. Evaluation results show that MAIL reduces the mean localization error by more than 36% compared with the state-of-the-art competing schemes.

References

[1]
Heba Abdelnasser, Reham Mohamed, Ahmed Elgohary, Moustafa Farid Alzantot, He Wang, Souvik Sen, Romit Roy Choudhury, and Moustafa Youssef. 2016. SemanticSLAM: Using environment landmarks for unsupervised indoor localization. IEEE Transactions on Mobile Computing 15, 7 (July 2016), 1770--1782.
[2]
Yomna Abdelrahman, Anam Ahmad Khan, Joshua Newn, Eduardo Velloso, Sherine Ashraf Safwat, James Bailey, Andreas Bulling, Frank Vetere, and Albrecht Schmidt. 2019. Classifying attention types with thermal imaging and eye tracking. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3, Article 69 (Sept. 2019).
[3]
Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E. Hinton. 2016. Layer normalization. arXiv preprint arXiv.1607.06450 (2016), 1--14.
[4]
Donald J. Berndt and James Clifford. 1994. Using dynamic time warping to find patterns in time series. In Proceedings of the 3rd International Conference on Knowledge Discovery and Data Mining. AAAI Press, 359--370.
[5]
Giuseppe Caso, Luca De Nardis, Filip Lemic, Vlado Handziski, Adam Wolisz, and Maria-Gabriella Di Benedett. Online 2019. ViFi: Virtual fingerprinting WiFi-based indoor positioning via multi-wall multi-floor propagation model. IEEE Transactions on Mobile Computing (Online 2019).
[6]
Muhammad Aamir Cheema. 2018. Indoor location-based services: Challenges and opportunities. SIGSPATIAL Special 10, 2 (Nov. 2018), 10--17.
[7]
Huijie Chen, Fan Li, Xiaojun Hei, and Yu Wang. 2018. CrowdX: Enhancing automatic construction of indoor floorplan with opportunistic encounters. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 4, Article 159 (Dec. 2018), 21 pages.
[8]
Kyunghyun Cho, Bart van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 1724--1734.
[9]
Jaewoo Chung, Matt Donahoe, Chris Schmandt, Ig-Jae Kim, Pedram Razavai, and Micaela Wiseman. 2011. Indoor location sensing using geo-magnetism. In Proceedings of the 9th International Conference on Mobile Systems, Applications, and Services. ACM, 141--154.
[10]
Moustafa M. Elhamshary, Moustafa F. Alzantot, and Moustafa Youssef. 2019. JustWalk: A crowdsourcing approach for the automatic construction of indoor floorplans. IEEE Transactions on Mobile Computing 18, 10 (Oct 2019), 2358--2371.
[11]
Cole Gleason, Dragan Ahmetovic, Saiph Savage, Carlos Toxtli, Carl Posthuma, Chieko Asakawa, Kris M. Kitani, and Jeffrey P. Bigham. 2018. Crowdsourcing the installation and maintenance of indoor localization infrastructure to support blind navigation. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1, Article 9 (March 2018), 25 pages.
[12]
Klaus Greff, Rupesh K. Srivastava, Jan Koutník, Bas R. Steunebrink, and Jürgen Schmidhuber. 2017. LSTM: A search space odyssey. IEEE Transactions on Neural Networks and Learning Systems 28, 10 (Oct 2017), 2222--2232.
[13]
Simon Haykin. 1994. Neural Networks. Vol. 2. Prentice Hall New York.
[14]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification. In Proceedings of the 2015 International Conference on Computer Vision. IEEE, 1026--1034.
[15]
Suining He and Kang G. Shin. 2017. Geomagnetism for Smartphone-Based Indoor Localization: Challenges, Advances, and Comparisons. ACM Computing Surveys 50, 6, Article 97 (Dec. 2017), 37 pages.
[16]
Suining He and Kang G. Shin. 2019. Crowd-Flow Graph Construction and Identification with Spatio-Temporal Signal Feature Fusion. In IEEE Conference on Computer Communications. IEEE, 757--765.
[17]
Tao He, Qun Niu, Suining He, and Ning Liu. 2019. Indoor Localization with Spatial and Temporal Representations of Signal Sequences. In 2019 IEEE Global Communications Conference. IEEE, 1--7.
[18]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computing 9, 8 (Nov. 1997), 1735--1780.
[19]
Baoqi Huang, Zhendong Xu, Bing Jia, and Guoqiang Mao. 2019. An online radio map update scheme for WiFi fingerprint-based localization. IEEE Internet of Things Journal 6, 4 (Aug 2019), 6909--6918.
[20]
Ho Jun Jang, Jae Min Shin, and Lynn Choi. 2017. Geomagnetic field based indoor localization using recurrent neural networks. In Proceedings of the 2017 Global Communications Conference. IEEE, 1--6.
[21]
Dejiang Kong and Fei Wu. 2018. HST-LSTM: A hierarchical spatial-temporal long-short term memory network for location prediction. In Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence. International Joint Conferences on Artificial Intelligence Organization, 2341--2347.
[22]
Tarun Kulshrestha, Divya Saxena, Rajdeep Niyogi, and Jiannong Cao. 2020. Real-time crowd monitoring using seamless indoor-outdoor localization. IEEE Transactions on Mobile Computing 19, 3 (March 2020), 664--679.
[23]
Myeongcheol Kwak, Youngmong Park, Junyoung Kim, Jinyoung Han, and Taekyoung Kwon. 2018. An energy-efficient and lightweight indoor localization system for Internet-of-Things (IoT) environments. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1, Article 17 (March 2018), 28 pages.
[24]
Bing Li, Juan Pablo Muñoz, Xuejian Rong, Qingtian Chen, Jizhong Xiao, Yingli Tian, Aries Arditi, and Mohammed Yousuf. 2019. Vision-based mobile indoor assistive navigation aid for blind people. IEEE Transactions on Mobile Computing 18, 3 (March 2019), 702--714.
[25]
Mingkuan Li, Ning Liu, Qun Niu, Chang Liu, S.-H. Gary Chan, and Chengying Gao. 2018. SweepLoc: Automatic Video-Based Indoor Localization by Camera Sweeping. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3, Article 120 (Sept. 2018), 25 pages.
[26]
Wenping Liu, Hongbo Jiang, Guoyin Jiang, Jiangchuan Liu, Xiaoqiang Ma, Yufu Jia, and Fu Xiao. 2019. Indoor navigation with virtual graph representation: Exploiting peak intensities of unmodulated luminaries. IEEE/ACM Transactions on Networking 27, 1 (Feb 2019), 187--200.
[27]
Zhihong Luo, Qiping Zhang, Yunfei Ma, Manish Singh, and Fadel Adib. 2019. 3D backscatter localization for fine-grained robotics. In Proceedings of the 16th USENIX Conference on Networked Systems Design and Implementation. USENIX Association, 765--782.
[28]
Sylvie Nadeau, Martina Betschart, and Francois Bethoux. 2013. Gait analysis for poststroke rehabilitation: The relevance of biomechanical analysis and the impact of gait speed. Physical Medicine and Rehabilitation Clinics of North America 24, 2 (2013), 265--276.
[29]
Qun Niu, Mingkuan Li, Suining He, Chengying Gao, S.-H. Gary Chan, and Xiaonan Luo. 2019. Resource-Efficient and Automated Image-Based Indoor Localization. ACM Transactions on Sensor Networks 15, 2, Article 19 (Feb. 2019), 31 pages.
[30]
Qun Niu, Ning Liu, Jianjun Huang, Yangze Luo, Suining He, Tao He, S.-H. Gary Chan, and Xiaonan Luo. 2019. DeepNavi: A Deep Signal-Fusion Framework for Accurate and Applicable Indoor Navigation. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3, Article 99 (Sept. 2019), 24 pages.
[31]
Qun Niu, Ying Nie, Suining He, Ning Liu, and Xiaonan Luo. 2018. RecNet: A Convolutional Network for Efficient Radiomap Reconstruction. In 2018 IEEE International Conference on Communications. IEEE, 1--7.
[32]
Valter Pasku, Alessio De Angelis, Guido De Angelis, Darmindra D. Arumugam, Marco Dionigi, Paolo Carbone, Antonio Moschitta, and David S. Ricketts. 2017. Magnetic field-based positioning systems. IEEE Communications Surveys & Tutorials 19, 3 (thirdquarter 2017), 2003--2017.
[33]
Sihua Shao, Abdallah Khreishah, and Issa Khalil. 2020. Enabling real-time indoor tracking of IoT devices through visible light retroreflection. IEEE Transactions on Mobile Computing 19, 4 (2020), 836--851.
[34]
Yuanchao Shu, Cheng Bo, Guobin Shen, Chunshui Zhao, Liqun Li, and Feng Zhao. 2015. Magicol: Indoor localization using pervasive magnetic field and opportunistic WiFi sensing. IEEE Journal on Selected Areas in Communications 33, 7 (July 2015), 1443--1457.
[35]
Yuanchao Shu, Kang G. Shin, Tian He, and Jiming Chen. 2015. Last-mile navigation using smartphones. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. ACM, 512--524.
[36]
Michael Stocker, Bernhard Grosswindhager, Carlo Alberto Boano, and Kay Romer. 2019. SnapLoc: An ultra-fast UWB-based indoor localization system for an unlimited number of tags: Demo abstract. In Proceedings of the 18th International Conference on Information Processing in Sensor Networks. ACM, 348--349.
[37]
Kalyan Pathapati Subbu, Brandon Gozick, and Ram Dantu. 2013. LocateMe: Magnetic-fields-based indoor localization using smartphones. ACM Transactions on Intelligent Systems and Technology 4, 4 (Oct 2013), 73:1--73:27.
[38]
Xiaoqiang Teng, Deke Guo, Yulan Guo, Xiaolei Zhou, and Zhong Liu. 2019. CloudNavi: Toward ubiquitous indoor navigation service with 3D point clouds. ACM Transactions on Sensor Networks 15, 1, Article 1 (Jan. 2019), 28 pages.
[39]
Kenta Urano, Kei Hiroi, Takuro Yonezawa, and Nobuo Kawaguchi. 2019. Basic study of BLE indoor localization using LSTM-based neural network (Poster). In Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 558--559.
[40]
Ju Wang, Liqiong Chang, Omid Abari, and Srinivasan Keshav. 2019. Are RFID sensing systems ready for the real world?. In Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 366--377.
[41]
Zhongqin Wang, Min Xu, Ning Ye, Ruchuan Wang, and Haiping Huang. 2019. RF-Focus: Computer vision-assisted region-of-interest RFID tag recognition and localization in multipath-prevalent environments. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 1, Article 29 (March 2019), 30 pages.
[42]
Hang Wu, Suining He, and Gary S.-H. Chan. 2017. A Graphical Model Approach for Efficient Geomagnetism-Pedometer Indoor Localization. In 2017 IEEE 14th International Conference on Mobile Ad Hoc and Sensor Systems. IEEE, 371--379.
[43]
Hang Wu, Suining He, and S.-H. Gary Chan. 2017. Efficient Sequence Matching and Path Construction for Geomagnetic Indoor Localization. In Proceedings of the 2017 International Conference on Embedded Wireless Systems and Networks. Junction Publishing, 156--167.
[44]
Hang Wu, Ziliang Mo, Jiajie Tan, Suining He, and S.-H. Gary Chan. 2019. Efficient Indoor Localization Based on Geomagnetism. ACM Transactions on Sensor Networks 15, 4, Article 42 (Aug. 2019), 25 pages.
[45]
Tz-Ying Wu, Ting-An Chien, Cheng-Sheng Chan, Chan-Wei Hu, and Min Sun. 2017. Anticipating daily intention using on-wrist motion triggered sensing. In Proceedings of the 2017 International Conference on Computer Vision. IEEE, 48--56.
[46]
Hongwei Xie, Tao Gu, Xianping Tao, Haibo Ye, and Jian Lv. 2014. MaLoc: A practical magnetic fingerprinting approach to indoor localization using smartphones. In Proceedings of the 2014 International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 243--253.
[47]
Huatao Xu, Dong Wang, Run Zhao, and Qian Zhang. 2019. AdaRF: Adaptive RFID-based indoor localization using deep learning enhanced holography. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3, Article 113 (Sept. 2019), 22 pages.
[48]
Shiyang Yan, Jeremy S. Smith, Wenjin Lu, and Bailing Zhang. 2018. Hierarchical multi-scale attention networks for action recognition. Signal Processing: Image Communication 61 (2018), 73--84.
[49]
Xuehan Ye, Shuo Huang, Yongcai Wang, Wenping Chen, and Deying Li. 2019. Unsupervised localization by learning transition model. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 2, Article 65 (June 2019), 23 pages.
[50]
Xuehan Ye, Yongcai Wang, Yuhe Guo, Wei Hu, and Deying Li. 2018. Accurate and efficient indoor location by dynamic warping in sequence-type radio-map. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1, Article 50 (March 2018), 22 pages.
[51]
Faheem Zafari, Athanasios Gkelias, and Kin K. Leung. 2019. A survey of indoor localization systems and technologies. IEEE Communications Surveys & Tutorials 21, 3 (thirdquarter 2019), 2568--2599.
[52]
Chi Zhang, Kalyan P. Subbu, Jun Luo, and Jianxin Wu. 2015. GROPING: Geomagnetism and crowdsensing powered indoor navigation. IEEE Transactions on Mobile Computing 14, 2 (Feb 2015), 387--400.
[53]
Huanhuan Zhang, Anfu Zhou, Dongzhu Xu, Shaoqing Xu, Xinyu Zhang, and Huadong Ma. 2019. Learning to recognize unmodified lights with invisible features. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 2, Article 67 (June 2019), 23 pages.
[54]
Yuanqing Zheng, Guobin Shen, Liqun Li, Chunshui Zhao, Mo Li, and Feng Zhao. 2017. Travi-Navi: Self-deployable indoor navigation system. IEEE/ACM Transactions on Networking 25, 5 (Oct 2017), 2655--2669.

Cited By

View all
  • (2024)Multiscale Transformer and Attention Mechanism for Magnetic Spatiotemporal Sequence LocalizationIEEE Internet of Things Journal10.1109/JIOT.2024.336579311:11(19454-19469)Online publication date: 1-Jun-2024
  • (2024)DarLocExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.122921244:COnline publication date: 15-Jun-2024
  • (2023)Deep Neural Network-Based Fusion Localization Using SmartphonesSensors10.3390/s2321868023:21(8680)Online publication date: 24-Oct-2023
  • Show More Cited By

Index Terms

  1. MAIL: Multi-Scale Attention-Guided Indoor Localization Using Geomagnetic Sequences

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 4, Issue 2
    June 2020
    771 pages
    EISSN:2474-9567
    DOI:10.1145/3406789
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 June 2020
    Published in IMWUT Volume 4, Issue 2

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Attention
    2. Geomagnetic Indoor Localization
    3. Multi-Scale Features

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    • Guangxi Innovation Driven Development Special Fund Project
    • ndamental Research Funds for the Central Universities
    • National Natural Science Foundation of China

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)104
    • Downloads (Last 6 weeks)9
    Reflects downloads up to 30 Aug 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Multiscale Transformer and Attention Mechanism for Magnetic Spatiotemporal Sequence LocalizationIEEE Internet of Things Journal10.1109/JIOT.2024.336579311:11(19454-19469)Online publication date: 1-Jun-2024
    • (2024)DarLocExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.122921244:COnline publication date: 15-Jun-2024
    • (2023)Deep Neural Network-Based Fusion Localization Using SmartphonesSensors10.3390/s2321868023:21(8680)Online publication date: 24-Oct-2023
    • (2023)Deep Learning-Based Geomagnetic Navigation Method Integrated with Dead ReckoningRemote Sensing10.3390/rs1517416515:17(4165)Online publication date: 24-Aug-2023
    • (2023)Automatic Update for Wi-Fi Fingerprinting Indoor Localization via Multi-Target Domain AdaptationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35962397:2(1-27)Online publication date: 12-Jun-2023
    • (2023)GC-LocProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694956:4(1-27)Online publication date: 11-Jan-2023
    • (2023)Wi-Fi Fine Time Measurement: Is it a Viable Alternative to Ultrawideband for Ranging in Industrial Environments?IEEE Industrial Electronics Magazine10.1109/MIE.2022.320543117:3(33-41)Online publication date: Sep-2023
    • (2023)Indoor Geomagnetic Positioning Using Direction-Aware Multiscale Recurrent Neural NetworksIEEE Sensors Journal10.1109/JSEN.2022.322795223:3(3321-3333)Online publication date: 1-Feb-2023
    • (2023)Smartphone Invariant Indoor Localization Using Multi-head Attention Neural NetworkMachine Learning for Indoor Localization and Navigation10.1007/978-3-031-26712-3_14(337-355)Online publication date: 30-Jun-2023
    • (2022)WePosProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35345746:2(1-25)Online publication date: 7-Jul-2022
    • Show More Cited By

    View Options

    Get Access

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media