research-article

Noncontact automatic heart rate analysis in visible spectrum by specific face regions

Authors:

Stephan Lukosch,

Leon RothkrantzAuthors Info & Claims

CompSysTech '13: Proceedings of the 14th International Conference on Computer Systems and Technologies

Pages 120 - 127

https://doi.org/10.1145/2516775.2516805

Published: 28 June 2013 Publication History

Abstract

The current paper presents a comparative study on the influence of different face regions for contactless extraction of the heart rate by computer vision in visible spectrum. A second novelty of our research is the use of Active Appearance Models for computing the shape of the face and of the facial features. Following an experimental setup, we determine that forehead and cheek face regions are more relevant for computing the heart rate. This outcome leads to an optimized face scanning method, faster processing times and better pulse detection results. The findings were implemented in an automatic system prototype for noncontact face analysis. Our methods were tested and validated using video recordings of people in laboratory setup.

References

[1]

Allen, J. Photoplethysmography and its application in clinical physiological measurement. In Physiological Measurement, vol. 28, pp. R1--R39, 2007.

[2]

Boost::Thread, http://www.boost.org/doc/libs/1_52_0/doc/html/thread.html.

[3]

Cardoso, J.-F. and Souloumiac, A. Blind beamforming for non-gaussian signals. In IEE Proceedings-F, vol. 140, no. 6, 362--370, 1993.

[4]

Cardoso, J.-F. High-order contrasts for independent component analysis. In Neural Comput., vol. 11, pp. 157--192. 1999.

Digital Library

[5]

Cidota, M. A., D. Datcu, L. J. M. Rothkrantz. The influence of the sampling frequency of a video recording on a heart-rate detection algorithm - The International Conference on Pattern Recognition Applications and Methods - ICPRAM 2013, Barcelona, Spain, 15--18 February, 2013.

[6]

Cidota, M. A., D. Datcu, L. J. M. Rothkrantz. Learning AAM fitting with kernel methods, 11th International Conference on Artificial Intelligence and Soft Computing - ICAISC, Springer Lecture Notes in Artificial Intelligence, Zakopane, Poland, May, 2012.

Digital Library

[7]

Comon, P. Independent component analysis, a new concept? In Signal Processing, 36, 287--314, 1994.

Digital Library

[8]

Edwards, G. J., C. J. Taylor, T. F. Cootes. Interpreting face images using active appearance models. Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition. p. 300, 1998.

Digital Library

[9]

Fei, J., I. Pavlidis. Thermistor at a Distance: Unobtrusive Measurement of Breathing. IEEE Transactions on Biomedical Engineering, vol. 57, no. 4, 988--998, 2010.

[10]

Garbey, M., N. Sun, A. Merla, I. Pavlidis. Contact-free measurement of cardiac pulse based on the analysis of thermal imagery. In IEEE Trans. Biomed. Eng., vol. 54, no. 8, 1418--1426, 2007.

[11]

Greneker, E. Radar sensing of heartbeat and respiration at a distance with application of the technology. In RADAR, vol. 97, no 449, 150--154, 1997.

[12]

OpenCV computer vision library, http://opencv.willowgarage.com/wiki/.

[13]

Poh, M.-Z., D. J. McDuff, R. W. Picard. Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam, IEEE Transactions on Biomedical Engineering, vol. 58, no. 1, pp. 7--11, 2011.

[14]

Poh, M., D. McDuff, R. Picard. Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. In OPTICS EXPRESS, vol. 18, no. 10, 2010.

[15]

Tarvainen, M., P. Ranta-Aho, P. Karjalainen. An advanced detrending method with application to hrv analysis. In IEEE Trans. Biomed. Eng., vol. 49, no. 2, 172--175, 2002.

[16]

Viola, P., M. Jones. Robust Real-time Object Detection, International Journal of Computer Vision, 2001.

[17]

Wu, Hao-Yu, M. Rubinstein, E. Shih, J. Guttag, F. Durand, W. T. Freeman. Eulerian Video Magnification for Revealing Subtle Changes in the World ACM Transactions Graph. (Proceedings SIGGRAPH'12), vol. 31, no. 4, 2012.

Digital Library

Cited By

Gupta DEtemad A(2024)Remote Heart Rate Monitoring in Smart Environments From Videos With Self-Supervised PretrainingIEEE Internet of Things Journal10.1109/JIOT.2023.332762311:6(10279-10294)Online publication date: 15-Mar-2024
https://doi.org/10.1109/JIOT.2023.3327623
Morampudi KKancharla CTanniru LBhupal Naik D(2023)Exploring Cognitive and Affective Processing Based on Webcam-Based Heartrate Activity2023 International Conference on Quantum Technologies, Communications, Computing, Hardware and Embedded Systems Security (iQ-CCHESS)10.1109/iQ-CCHESS56596.2023.10391099(1-8)Online publication date: 15-Sep-2023
https://doi.org/10.1109/iQ-CCHESS56596.2023.10391099
Molinaro NZangarelli FSchena ESilvestri SMassaroni C(2023)Cardiorespiratory Parameters Monitoring Through a Single Digital Camera in Real Scenarios: ROI Tracking and Motion InfluenceIEEE Sensors Journal10.1109/JSEN.2023.328755523:17(20097-20106)Online publication date: 1-Sep-2023
https://doi.org/10.1109/JSEN.2023.3287555
Show More Cited By

Noncontact automatic heart rate analysis in visible spectrum by specific face regions
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks

Recommendations

Automatic face analysis system based on face recognition and facial physiognomy
ICHIT'06: Proceedings of the 1st international conference on Advances in hybrid information technology

An automatic face analysis system is proposed which uses face recognition and facial physiognomy. It first detects human's face, extracts its features, and classifies the shape of facial features. It will analyze the person's facial physiognomy and then ...
Non-contact Heart Rate Detection Based on Fusion Method of Visible Images and Infrared Images
Artificial Intelligence and Security
Abstract
Heart rate is one of the important physiological parameters of the human body, and the detection of heart rate can directly reflect the physiological health state of the human body. The existing non-contact heart rate detection methods are mainly ...
Motion-tolerant heart rate estimation from face videos using derivative filter
Abstract
Imaging photoplethysmography (IPPG) technique allows us to extract blood volume pulse (BVP) signals from face videos for measuring heart rate (HR), which is useful in applications such as neonatal monitoring, telemedicine and affective computing. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

CompSysTech '13: Proceedings of the 14th International Conference on Computer Systems and Technologies

June 2013

365 pages

ISBN:9781450320214

DOI:10.1145/2516775

Editors:
Boris Rachev
Technical University of Varna, Varna, Bulgaria
,
Angel Smrikarov
University of Ruse, Ruse, Bulgaria

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

TELECVB: TELECOMS - Varna, Bulgaria
MEYS: Bulgarian Ministry of Education, Youth and Science
ERSVB: EURORISC SYSTEMS - Varna, Bulgaria
FOSEUB: FEDERATION OF THE SCIENTIFIC ENGINEERING UNIONS - Bulgaria
UORB: University of Ruse, Bulgaria
CASTUVTB: CYRIL AND ST. METHODIUS UNIVERSITY of Veliko Tarnovo, Bulgaria
TECHUVB: Technical University of Varna, Bulgaria
IEEEBSB: IEEE Bulgaria Section, Bulgaria

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 June 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CompSysTech '13

Sponsor:

TELECVB
MEYS
ERSVB
FOSEUB
UORB
CASTUVTB
TECHUVB
IEEEBSB

CompSysTech '13: Computer Systems and Technologies

June 28 - 29, 2013

Ruse, Bulgaria

Acceptance Rates

CompSysTech '13 Paper Acceptance Rate 42 of 89 submissions, 47%;

Overall Acceptance Rate 241 of 492 submissions, 49%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
341
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gupta DEtemad A(2024)Remote Heart Rate Monitoring in Smart Environments From Videos With Self-Supervised PretrainingIEEE Internet of Things Journal10.1109/JIOT.2023.332762311:6(10279-10294)Online publication date: 15-Mar-2024
https://doi.org/10.1109/JIOT.2023.3327623
Morampudi KKancharla CTanniru LBhupal Naik D(2023)Exploring Cognitive and Affective Processing Based on Webcam-Based Heartrate Activity2023 International Conference on Quantum Technologies, Communications, Computing, Hardware and Embedded Systems Security (iQ-CCHESS)10.1109/iQ-CCHESS56596.2023.10391099(1-8)Online publication date: 15-Sep-2023
https://doi.org/10.1109/iQ-CCHESS56596.2023.10391099
Molinaro NZangarelli FSchena ESilvestri SMassaroni C(2023)Cardiorespiratory Parameters Monitoring Through a Single Digital Camera in Real Scenarios: ROI Tracking and Motion InfluenceIEEE Sensors Journal10.1109/JSEN.2023.328755523:17(20097-20106)Online publication date: 1-Sep-2023
https://doi.org/10.1109/JSEN.2023.3287555
Nabipour MNikan S(2023)A Deep Learning-Based Remote Plethysmography with the Application in Monitoring drivers’ Wellness2023 International Symposium on Signals, Circuits and Systems (ISSCS)10.1109/ISSCS58449.2023.10190888(1-4)Online publication date: 13-Jul-2023
https://doi.org/10.1109/ISSCS58449.2023.10190888
Ansari NYogarajah PMcGinnity TVance PPeace A(2023)ChPOS: A Contactless and Continuous Method for Estimation of Heart Rate from Face2023 34th Irish Signals and Systems Conference (ISSC)10.1109/ISSC59246.2023.10162125(1-6)Online publication date: 13-Jun-2023
https://doi.org/10.1109/ISSC59246.2023.10162125
Molinaro NSchena ESilvestri SMassaroni C(2022)Multi-ROI Spectral Approach for the Continuous Remote Cardio-Respiratory Monitoring from Mobile Device Built-In CamerasSensors10.3390/s2207253922:7(2539)Online publication date: 25-Mar-2022
https://doi.org/10.3390/s22072539
Malasinghe LKatsigiannis SDahal KRamzan N(2022)A comparative study of common steps in video-based remote heart rate detection methodsExpert Systems with Applications: An International Journal10.1016/j.eswa.2022.117867207:COnline publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1016/j.eswa.2022.117867
Ni AAzarang AKehtarnavaz N(2021)A Review of Deep Learning-Based Contactless Heart Rate Measurement MethodsSensors10.3390/s2111371921:11(3719)Online publication date: 27-May-2021
https://doi.org/10.3390/s21113719
Rothkrantz L(2021)Personalized Digital Fitness CoachProceedings of the 22nd International Conference on Computer Systems and Technologies10.1145/3472410.3472412(123-127)Online publication date: 18-Jun-2021
https://dl.acm.org/doi/10.1145/3472410.3472412
Pourbemany JEssa AZhu Y(2021)Real-Time Video-based Heart and Respiration Rate MonitoringNAECON 2021 - IEEE National Aerospace and Electronics Conference10.1109/NAECON49338.2021.9696378(332-336)Online publication date: 16-Aug-2021
https://doi.org/10.1109/NAECON49338.2021.9696378
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents