Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Advertisement

Springer Nature Link
Log in

An assistive environment for improving human safety utilizing advanced sound and motion data classification

  • Long Paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

    We’re sorry, something doesn't seem to be working properly.

    Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Abstract

This paper presents the concept and an initial implementation of an assistive awareness system that may be used for human activity interpretation and emergency recognition in cases such as elder or patient falls and distress speech expressions, thus improving their safety. Awareness is achieved through collecting, analyzing and classifying motion and sound data. The latter are collected through sensors equipped with accelerometers and microphones that are attached to the human body and transmit movement and sound data wirelessly to the monitoring unit. The detection of fall incidents has been proven to be feasible by applying Short Time Fourier Transform (STFT) and spectrogram analysis on sounds. The classification of the sound and movement data is performed using a variety of advanced classification techniques. Evaluation results provide a performance comparison between the evaluated classifiers and indicate the high accuracy and the effectiveness of the proposed implementation. The system architecture is open and can be easily enhanced to include patient awareness based on additional context (e.g., physiological data).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Lines, L., Hone, K.S.: Eliciting user requirements with older adults: lessons from the design of an interactive domestic alarm system. Univ. Access Inform. Soc. 3(2), 141–148 (2004)

    Google Scholar 

  2. Orpwood, R., Gibbs, C., Adlam, T., Faulkner, R., Meegahawatte, D.: The design of smart homes for people with dementia—user-interface aspects. Univ. Access Inform. Soc. 4(2), 156–164 (2005)

    Google Scholar 

  3. Neerincx, M. A., Cremers, A.H.M., Kessens, J.M., van Leeuwen, D.A., Truong, K.P.: Attuning speech-enabled interfaces to user and context for inclusive design: technology, methodology and practice. Univ. Access Inform. Soc. (2008). doi:10.1007/s10209-008-0136-x

  4. Holzinger, A., Errath, M.: Mobile computer Web-application design in medicine: some research based guidelines. Univ. Access Inform. Soc. 6(1), 31–41 (2006)

  5. Noury, N., Herve, T., Rialle, V., Virone, G., Mercier, E., Morey, G., Moro, A., Porcheron, T.: Monitoring behavior in home using a smart fall sensor and position sensors. In: Proceedings of 1st Annual International Conference on Microtechnologies in Medicine and Biology, pp. 607–610 (2000)

  6. Noury, N.: A smart sensor for the remote follow up of activity and fall detection of the elderly. In: Proceedings of 2nd Annual International Conference on Microtechnologies in Medicine and Biology, pp. 314–317 (2002)

  7. Prado, M., Reina-Tosina, J., Roa, L.: Distributed intelligent architecture for falling detection and physical activity analysis in the elderly. In: Proceedings of the 24th Annual IEEE EMBS Conference, pp. 1910–1911 (2002)

  8. Fukaya, K.: Fall detection sensor for fall protection airbag. In: Proceedings of the 41st SICE Annual Conference, pp. 419–420 (2002)

  9. Sixsmith, A., Johnson, N.: A smart sensor to detect the falls of the elderly. IEEE Pervas. Comput. 3(2), 42–47 (2004)

    Google Scholar 

  10. Nait-Charif, H., McKenna, S.J.: Activity summarisation and fall detection in a supportive home environment, In: Proceedings of the 17th International Conference on Pattern Recognition ICPR 2004, pp. 323–236 (2004)

  11. Hwang, J.Y., Kang, J.M., Jang, Y.W., Kim, H.C.: Development of novel algorithm and real-time monitoring ambulatory system using Bluetooth module for fall detection in the elderly. In: Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 2204–2207 (2004)

  12. Luo, S., Hu, Q.: A dynamic motion pattern analysis approach to fall detection, In: Proceedings of the 2004 IEEE International Workshop on Biomedical Circuits and Systems, pp. 1–8a (2004)

  13. Wang, S., Yang, J., Chen, N., Chen, X., Zhang, Q.: Human activity recognition with user-free accelerometers in the sensor networks, In: Proceedings of International Conference on Neural Networks and Brain, pp. 1212–1217 (2005)

  14. Miaou, S.-G., Sung, P.-H., Huang, C.-Y.: A customized human fall detection system using omni-camera images and personal information. In: Proceedings of 1st Transdisciplinary conference on Distributed Diagnosis and Home Healthcare, pp. 39–42 (2006)

  15. Alwan, M., Rajendran, P.J., Kell, S., Mack, D., Dalal, S., Wolfe, M., Felder, R.: A smart and passive floor-vibration based fall detector for elderly. In: Proceedings of 2nd Information and Communication Technologies Conference, ICTTA 06, pp. 1003–1007 (2006)

  16. Allen, F.R., Ambikairajah, E., Lovell, N.H., Celler, B.G.: An adapted gaussian mixture model approach to accelerometry-based movement classification using time-domain features. In: Proceedings of 28th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 3600–3603 (2006)

  17. Rougier, C., Meunier, J., St-Arnaud, A., Rousseau, J.: Monocular 3D head tracking to detect falls of elderly people. In: Proceedings of 28th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 6384–6387 (2006)

  18. Cao, X.B., Chen, D., Qiao, H., Xu, Y.W.: An evolutionary support vector machines classifier for pedestrian detection. In: Proceedings of 2006 IEEE International Conference on Intelligent Robots and Systems, pp. 4223–4227 (2006)

  19. Bart, J., Rudi, D.: Context aware inactivity recognition for visual fall detection. In: Proceedings of 2006 Pervasive Health Conference and Workshops, pp. 1–4 (2006)

  20. Gaura, E.I., Rider, R.J., Steele, N., Naguib, R.N.G.: Neural-network compensation methods for capacitive micromachined accelerometers for use in telecare medicine. IEEE Trans. Inform. Technol. Biomed. 5(3), 248–252 (2001)

    Google Scholar 

  21. Mukasa, K.S., Holzinger, A., Karshmer, A. (eds.): Proceedings International Workshop on Intelligent User Interfaces for Ambient Assisted Living (IUI4AAL 2008), Stuttgart: Fraunhofer IRB Verlag (ISBN 978-3-8167-7521-8) (2008)

  22. Virone, G., Istrate, D., Vacher, M., Noury, N., Serignat, J.F., Demongeot, J.: First steps in data fusion between a multichannel audio acquisition and an information system for home healthcare. In: Proceedings of the 25th Annual International Conference of the IEEE in Engineering in Medicine and Biology Society, vol 2, pp. 1364–1367 (2003)

  23. Istrate, D., Castelli, E., Vacher, M., Besacier, L., Serignat, J.-F.: Information extraction from sound for medical telemonitoring. IEEE Trans. Inform. Theory Biomed. 10(2), 264–274 (2006)

    Google Scholar 

  24. Vacher, M., Istrate, D., Serignat, J.F.: Sound detection and classification through transient models using wavelet coefficient trees, presented at 12th Eurasip European Signal Processing Conference (2004)

  25. Istrate, D., Vacher,M., Serignat, J.F.: Generic implementation of a distress sound extraction system for elder care. In: Proceedings of the 28th IEEE EMBS Annual International Conference New York City, USA (Aug 30–Sept 3), pp. 3309–3312 (2006)

  26. Laydrus, N.C., Ambikairajah, E., Celler, B.: Automated sound analysis system for home telemonitoring using shifted delta cepstral features. In: 15th International Conference on Digital Signal Processing, July 2007, pp. 135–138 (2007)

  27. Nguyen, C.P., Pham, T.N.Y., Eric, C.: Toward a sound analysis system for telemedicine, fuzzy systems and knowledge discovery. Springer 3614(2005), 352–361 (2005)

    Google Scholar 

  28. Alwan, M., Dalal, S., Mack, D., Kell, S.W., Turner, B., Leachtenauer, J., Felder, R.: Impact of monitoring technology in assisted living: outcome pilot. IEEE Trans. Inform. Technol. Biomed. 10(1), 192–198 (2000)

    Article  Google Scholar 

  29. Sonogram Speech and Sound processing tool, http://www.christoph-lauer.de/

  30. Doukas, C., Maglogiannis, I.: Advanced Patient or Elder Fall Detection based on Movement and Sound Data. Presented at 2nd International Conference on Pervasive Computing Technologies for Healthcare (2008)

  31. Doukas, C., Maglogiannis I.: Enabling human status awareness in assistive environments based on advanced sound and motion data classification. Presented at The 1st ACM International Conference on PErvasive Technologies Related to Assistive Environments (PETRAE), July 16–19 2008, Athens, Greece (2008)

  32. Doukas, C., Maglogiannis, I., Tragkas, P., Liapis, D., Yovanof, G.: Patient fall detection using support vector machines. In: Proceedings of the 4th IFIP Conference on Artificial Intelligence Applications & Innovations (AIAI), Sept. 19–21, Athens, Greece (2007)

  33. www.freescale.com

  34. Chang, C.-C., Lin, C.-J., LIBSVM: A library for support vector machines (2001). Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm

  35. Freund, Y., Schapire, R.E.: Experiments with a new boosting algorithm. In: Thirteenth International Conference on Machine Learning, San Francisco, pp. 148–156 (1996)

  36. Frank, E., Wang, Y., Inglis, S., Holmes, G., Witten, I.H.: Using model trees for classification. Mach. Learn. 32(1), 63–76 (1998)

    Article  MATH  Google Scholar 

  37. Kohavi, R.: Wrappers for Performance Enhancement and Oblivious Decision Graphs. Department of Computer Science, Stanford University (1995)

    Google Scholar 

  38. Ho, T.K.: The random subspace method for constructing decision forests. IEEE Trans. Pattern Anal. Mach. Intell. 20(8), 832–844 (1998)

    Article  Google Scholar 

  39. Dong, L., Frank, E., Kramer, S.: Ensembles of balanced nested dichotomies for multi-class problems. In: PKDD, pp. 84–95 (2005)

  40. Ting, K.M., Witten, I.H.: Stacking bagged and dagged models. In: Fourteenth international Conference on Machine Learning, San Francisco, CA, pp. 367–375 (1997)

  41. Carletta, J.: Assessing agreement on classification tasks: the kappa statistic. Comput. Linguistics 22(2), 249–254 (1996)

    Google Scholar 

  42. Megalooikonomou, V., Kontos, D.: Medical data fusion for telemedicine. IEEE Eng. Med. Biol. Magazine 26(5), 36–42 (2007)

    Google Scholar 

  43. Grewal, M.S., Andrews, A.P., Filterinf, K.: Second Edition. Wiley (2001)

  44. Holzinger, A.: Usability engineering for software developers. Commun. ACM 48(1), 71–74 (2005)

    Article  Google Scholar 

  45. Holzinger, A., Searle, G., Kleinberger, T., Seffah, A., Javahery, H.: Investigating usability metrics for the design and development of applications for the elderly In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) 11th International Conference on Computers Helping People with Special Needs (ICCHP 2008), Lecture Notes in Computer Science (LNCS 5105), Berlin, Heidelberg, New York: Springer, 98–105 (ISBN: 978-3-540-70539-0) (2008)

  46. Holzinger, A., Schaupp, K., Eder-Halbedl, W.: An investigation on acceptance of ubiquitous devices for the elderly in an geriatric hospital environment: using the example of person tracking. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) 11th International Conference on Computers Helping People with Special Needs, Lecture Notes in Computer Science (LNCS 5105), 22–29 (ISBN: 978-3-540-70539-0) (2008)

  47. Birkmire-Peters, D.P., Peters, L.J., Whitaker, L.A.: A usability evaluation for telemedicine medical equipment. Telemed. J. 5(2), 209–212 (1999). doi:10.1089/107830299312177

    Google Scholar 

  48. Soppera, A., Burbridge, T.: Maintaining privacy in pervasive computing—enabling acceptance of sensor-based services. BT Technol. J. 22(3), 106–118 (2010)

    Google Scholar 

  49. Blazic, A.J., Dolinar, K., Porekar, J.: Enabling privacy in pervasive computing using fusion of privacy negotiation, identity management and trust management techniques. In: Proceedings of 1st International Conference on Digital Society, 2007. ICDS ‘07, p. 30 (2007)

  50. Centers for Medicare & Medicaid Services. http://cms.hhs.gov/

  51. www.zigbee.org

  52. Sasiadek, J.Z., Khe, J.: Sensor fusion based on fuzzy Kalman filter, In: Proceedings of 2nd International IEEE Workshop on Robot Motion and Control, pp. 275–283 (2001)

  53. SensiNode. http://www.sensinode.com

  54. Witten, I.H., Frank, E.: Data mining: practical machine learning tools and techniques, 2nd edn. Morgan Kaufmann, San Francisco (2005)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Information and Communication Systems Engineering, University of the Aegean, Karlovasi, Samos, Greece

    Charalampos Doukas

  2. Department of Computer Science and Biomedical Informatics, University of Central Greece, Papasiopoulou 2-4, 35100, Lamia, Greece

    Ilias Maglogiannis

Authors
  1. Charalampos Doukas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ilias Maglogiannis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Charalampos Doukas.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Doukas, C., Maglogiannis, I. An assistive environment for improving human safety utilizing advanced sound and motion data classification. Univ Access Inf Soc 10, 217–228 (2011). https://doi.org/10.1007/s10209-010-0196-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-010-0196-6

Keywords

Search

Navigation