Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3131885.3131928acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicdscConference Proceedingsconference-collections
research-article

RAM: Role Representation and Identification from combined Appearance and Activity Maps

Published: 05 September 2017 Publication History

Abstract

This work introduces a multimodal multiview camera network for role identification and re-identification in an Intensive Care Unit (ICU) room, where identifying individuals is not permitted. The analysis challenges include imaging conditions such as medical isolation (where all visitors wear scrubs), poor and non-uniform illumination, or variable camera views. We propose a role representation, which combines static appearance features such as texture and color, together with a dynamic quantification of human locations and interactions that results in a semantic map. The proposed representation is easy to compute and robust to varying ICU conditions and network configurations, which make the methods suitable for low-power distributed sensor network deployment. Thorough evaluations and comparisons with competing methods are performed. The findings from this approach enable the compliant analysis of workflows in healthcare, while protecting the privacy of patients and medical staff.

References

[1]
Loris Bazzani, Marco Cristani, and Vittorio Murino. 2013. Symmetry-driven accumulation of local features for human characterization and re-identification. In Elsevier Computer Vision and Image Understanding (CVIU).
[2]
Lubomir Bourdev and Jitendra Malik. 2009. Poselets: Body part detectors trained using 3d human pose annotations. In Proc. of Int'l Conf. on Computer Vision (ICCV). IEEE.
[3]
Isabelle Brault, Kelley Kilpatrick, Danielle DfiAmour, Damien Contandriopoulos, Veronique Chouinard, Carl-Ardy Dubois, Melanie Perroux, and Marie-Dominique Beaulieu. 2014. Role clarification processes for better integration of nurse practitioners into primary healthcare teams: a multiple-case study. In Nursing research and practice. Hindawi Publishing Corporation.
[4]
Dong Seon Cheng, Marco Cristani, Michele Stoppa, Loris Bazzani, and Vittorio Murine 2011. Custom Pictorial Structures for Re-identification. In British Machine Vision Conf. (BMVC).
[5]
Navneet Dalai and Bill Triggs. 2005. Histograms of oriented gradients for human detection. In IEEE Proc. of Conf. on Computer Vision and Pattern Recognition (CVPR).
[6]
Ali Farhadi, Ian Endres, Derek Hoiem, and David Forsyth. 2009. Describing objects by their attributes. In IEEE Proc. of Conf. on Computer Vision and Pattern Recognition (CVPR).
[7]
Centers for Medicare & Medicaid Services and others. 1996. The health insurance portability and accountability act of 1996 (HIPAA). Online at http://www.cms.hhs.gov/hipaa (1996).
[8]
Jorge Garcia, Niki Martinel, Alfredo Gardel, Ignacio Bravo, Gian Luca Foresti, and Christian Micheloni. 2016. Modeling feature distances by orientation driven classifiers for person re-identification. Elsevier Journal of Visual Communication and Image Representation (2016).
[9]
Douglas Gray and Hai Tao. 2008. Viewpoint invariant pedestrian recognition with an ensemble of localized features. In Springer Proc. of European Conf. on Computer Vision (ECCV).
[10]
R. I. Hartley and A. Zisserman. 2004. Multiple View Geometry in Computer Vision. Cambridge University Press.
[11]
Srikrishna Karanam, Mengran Gou, Ziyan Wu, Angels Rates-Borras, Octavia Camps, and Richard J Radke. 2016. A Systematic Evaluation and Benchmark for Person Re-Identification: Features, Metrics, and Datasets. arXiv preprint arXiv:1605.09653 (2016).
[12]
Colin Lea, James Facker, Gregory Hager, Russell Taylor, and Suchi Saria. 2013. 3d sensing algorithms towards building an intelligent intensive care unit. In AMIA summits on translational science proceedings. American Medical Informatics Association.
[13]
Shengcai Liao, Yang Hu, Xiangyu Zhu, and Stan Z Li. 2015. Person re-identification by local maximal occurrence representation and metric learning. In IEEE Proc. of Conf. on Computer Vision and Pattern Recognition (CVPR).
[14]
Subhransu Maji, Lubomir Bourdev, and Jitendra Malik. 2011. Action recognition from a distributed representation of pose and appearance. In BiEEProc. of Conf. on Computer Vision and Pattern Recognition (CVPR).
[15]
Niki Martinel, Gian Luca Foresti, and Christian Micheloni. 2016. Person reidentification in a distributed camera network framework. IEEE Transactions on Cybernetics (2016).
[16]
David Nister and Henrik Stewenius. 2006. Scalable recognition with a vocabulary tree. In IEEE Proc. on Computer Vision and Pattern Recognition (CVPR).
[17]
Aude Oliva and Antonio Torralba. 2001. Modeling the shape of the scene: A holistic representation of the spatial envelope. In Springer Int'I Journal of Computer Vision (TJCV).
[18]
Nicolas Padoy, Diana Mateus, Daniel Weinland, Marie-Odile Berger, and Nassir Navab. 2009. Workflow monitoring based on 3d motion features. In IEEE Proc. of Int'l Conf. on Computer Vision Workshops (ICCV Workshops).
[19]
F. Pedregosa, G. Varoquaux, A. Gramfort, V Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research (2011).
[20]
Sricharan Ramagiri, Rahul Kavi, and Vinod Kulathumani. 2011. Real-time multi-view human action recognition using a wireless camera network. In ACM/IEEE Proc. of Int'l Conf. on Distributed Smart Cameras (ICDSC).
[21]
Michalis Raptis and Leonid Sigal. 2013. Poselet key-framing: A model for human activity recognition. In IEEE Proc. of Conf. on Computer Vision and Pattern Recognition (CVPR).
[22]
Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. 2016. You only look once: Unified, real-time object detection. In IEEE Proc. of Conf. on Computer Vision and Pattern Recognition (CVPR).
[23]
The Raspberry Pi Foundation. 2017 (accessed July 17th, 2017). Raspberry Pi 3 Model B. https://www.raspberrypi.org/products/raspberry-pi-3-model-b/.
[24]
Paul R Torrens. 2010. The health care team members: Who are they and what do they do. (2010).
[25]
Roberto Vezzani, Davide Baltieri, and Rita Cucchiara. 2013. People reidentification in surveillance and forensics: A survey. ACM Computing Surveys (CSUR) (2013).
[26]
Taiqing Wang, Shaogang Gong, Xiatian Zhu, and Shengjin Wang. 2014. Person re-identification by video ranking. In Proc. of European Conf. on Computer Vision (ECCV).
[27]
Hui Yu, Mingjing Li, Hong-Jiang Zhang, and Jufu Feng. 2002. Color texture moments for content-based image retrieval. In IEEE Proc. of Int'l Conf. on Image Processing (ICIP).
[28]
Rui Zhao, Wanli Ouyang, and Xiaogang Wang. 2013. Person re-identification by salience matching. In IEEE Proc. of Int'l Conf. on Computer Vision (ICCV).
[29]
Rui Zhao, Wanli Ouyang, and Xiaogang Wang. 2013. Unsupervised salience learning for person re-identification. In IEEE Proc. of Conf. on Computer Vision and Pattern Recognition (CVPR).
[30]
Rui Zhao, Wanli Ouyang, and Xiaogang Wang. 2014. Learning mid-level filters for person re-identification. In IEEE Proc. of Conf. on Computer Vision and Pattern Recognition (CVPR).

Cited By

View all
  • (2018)Healthcare Event and Activity LoggingIEEE Journal of Translational Engineering in Health and Medicine10.1109/JTEHM.2018.28633866(1-12)Online publication date: 2018

Index Terms

  1. RAM: Role Representation and Identification from combined Appearance and Activity Maps

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      ICDSC 2017: Proceedings of the 11th International Conference on Distributed Smart Cameras
      September 2017
      221 pages
      ISBN:9781450354875
      DOI:10.1145/3131885
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      In-Cooperation

      • Stanford University: Stanford University

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 05 September 2017

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Activity
      2. Appearance
      3. HIPAA
      4. Healthcare
      5. ICU
      6. Identification
      7. Monitoring
      8. Multimodal
      9. Representation
      10. Role
      11. Semantic Map
      12. Workflows

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Funding Sources

      Conference

      ICDSC 2017

      Acceptance Rates

      Overall Acceptance Rate 92 of 117 submissions, 79%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)0
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 25 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2018)Healthcare Event and Activity LoggingIEEE Journal of Translational Engineering in Health and Medicine10.1109/JTEHM.2018.28633866(1-12)Online publication date: 2018

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media