Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                

A Mechatronics Data Collection, Image Processing, and Deep Learning Platform For Clinical Posture Analysis

Download as pdf or txt
Download as pdf or txt
You are on page 1of 10

Physical and Engineering Sciences in Medicine (2021) 44:901–910

https://doi.org/10.1007/s13246-021-01035-w

SCIENTIFIC NOTE

A mechatronics data collection, image processing, and deep learning


platform for clinical posture analysis: a technical note
Zahra Salahzadeh1 · Peyman Rezaei‑Hachesu2 · Yousef Gheibi3 · Ali Aghamali2 · Hamed Pakzad4 ·
Saeideh Foladlou5 · Taha Samad‑Soltani2

Received: 24 October 2020 / Accepted: 13 July 2021 / Published online: 16 August 2021
© Australasian College of Physical Scientists and Engineers in Medicine 2021

Abstract
Static and dynamic posture analysis was a critical clinical examination in physiotherapy and rehabilitation. It was a time-
consuming task for clinicians, so a semi-automatic method can facilitate this process as well as provide well-documented
medical records and strong infrastructure for deep learning scenarios. The current research presents a mechatronics plat-
form for static and real-time dynamic posture analysis, which consisted of hybrid computational modules. Our study was
a developmental and applied research according to a system development life cycle. The designed modules are as follows:
(1) a mechanical structure includes patient place, 360-degree engine, mirror, laser, distance meter, and cams; (2) a software
module includes data collection, electronic medical record, semi-automatic image analysis, annotation, and reporting, and
(3) a network to exchange raw data with deep learning server. Patients were informed about the research by their healthcare
provider and all data were transformed into a Fourier format, in which the patients remained autonomous without a bit of
information. The results show acceptable reliability and validity of the instruments. Also, a telerehabilitation application was
designed to cover the patients after diagnosis. We suggest a longer time for data acquisition. It will lead to a more accurate
and fully automated dynamic posture analysis. The result of this study suggest that the designed mechatronics device used
in conjunction with smartphone application is a valid tool that can be used to obtain reliable measurements.

Keywords Posture · Image processing · Telerehabilitation · Decision support system

Introduction component will affect the functioning of other components;


hence, spinal deviations lead to changes in the lower and
Under physiological and pathophysiological conditions, the upper limbs. Therefore, in the evaluation and treatment of
human body usually acts as a comprehensive system and spinal disorders, the posture of the upper and lower limbs
an integrated membrane. Changes in the functioning of one should also be considered. In the field of therapy, attention

1
* Taha Samad‑Soltani Physiotherapy Department, Faculty of Rehabilitation, Tabriz
samadsoltani@tbzmed.ac.ir University of Medical Science, 29 Bahman St, Tabriz, Iran
2
Zahra Salahzadeh Department of Health Information Technology, School
salahzadeh@tbzmed.ac.ir of Management and Medical Informatics, Tabriz University
of Medical Sciences, Tabriz, Iran
Peyman Rezaei‑Hachesu
3
rezaeip@tbzmed.ac.ir Department of Artificial Intelligence, Faculty of Computer
Engineering, University of Tabriz, Tabriz, Iran
Yousef Gheibi
4
yousef.gheibi@gmail.com Department of Research and Development, SanamSahand
Health Promotion Industries, Tabriz, Iran
Ali Aghamali
5
seyedali1377525@gmail.com Department of Biomedical Engineering, Islamic Azad
University of Tabriz, Tabriz, Iran
Hamed Pakzad
Hamed.pakzad@yahoo.com
Saeideh Foladlou
saeideh_foladlou@yahoo.com

13
Vol.:(0123456789)
902 Physical and Engineering Sciences in Medicine (2021) 44:901–910

to the correction of other parts of the body in patients with processing and identifying the patient’s problems, extracting
spinal disorders has a significant effect on the successful knowledge from his or her images, and using that knowledge
treatment of this type of disorder [1, 2]. to make better decisions on the management of related ill-
Postural problems need to be evaluated in a timely and nesses as decision support systems, ultimately improving the
accurate manner because they may lead to greater problems quality of healthcare.
in the musculoskeletal system as they develop [3]. Two main
approaches for clinical posture analysis are observational [4,
5] and photogrammetry [6, 7] methods. Compared to other Methods
methods of postural analysis that may be invasive or harm-
ful to patients (e.g., X-ray) or costly (e.g., 3D models), the The majority of existing posture analysis systems have a
alternative is to use a better, modernized, and non-invasive static nature in terms of image acquisition, analysis, and
solution, i.e., computerized or digital photogrammetry that reporting. Line drawing and imaging analysis have been
uses a combination of digital cameras and image process- shown to be highly reliable. However, many arguments
ing techniques [8, 9]. Images constitute a significant set of affect the accuracy of computations, such as position chang-
important data records in medicine since they are of great ing due to rotation, inaccurate distancing between the patient
technical and computational importance in computer science and the camera, and the ineffective top view of the patient.
as the most accurate type of signal. By using, analyzing, and Our designed system overcomes these limitations using a
processing images, the quality of the data generated from a mechatronics approach embedded in traditional posture
diagnostic point of view will lead to a reduction in the cogni- analysis methods. To achieve our objectives, we have organ-
tive errors of physicians [10, 11]. A number of studies have ized the remainder of the paper in the following way. In the
been conducted with various objectives to detect, measure, next section, we provide a brief description of the hardware
and analyze posture using computerized methods. However, and software components. Then, the main outcomes of the
the majority of these studies have been limited to a small set system in early applications in rehabilitation centers are
of functions and measures. For example, Patel et al. used presented.
wireless and wearable technologies as a potential alternative
to clinical testing to assess the risk of falling in older adults. Components and capabilities of the posture analysis
They used a wearable inertial sensor which provided real- system
time kinematic data during routine activities by classifying
posture [12]. Afanasieva et al. state that the sensitivity and The designed system consisted of (1) a sturdy and strong
specificity of the computerized photo-geometric program structure in two parts, i.e., patient structure and special-
for posture analysis were in a satisfactory range, empha- ist panel, (2) two cameras installed for vertical and frontal
sizing the necessity of utilizing this program in healthcare imaging, and (3) a remote-controlled 360-degree patient
practice [13]. The available literature shows that informa- rotation engine. Each component has its sub-modules, which
tion technology provides the capability to objectively iden- are discussed in the next section.
tify postural risks among patients, even when clinical tests As shown in Fig. 1, three separate structures were
cannot. Other studies have shown that the results obtained designed to fix patient and clinician positions. The clini-
using traditional postural evaluation and postural biome- cian panel includes a computer to compute postural meas-
chanical evaluation methods are less satisfactory compared urements, a monitor to view the real-time software UI, a
to computerized biometrics. Therefore, a fast, semi-auto- button panel to control the hardware and the step motor,
matic, and digitized method for posture analysis can help and an optional printer to print reports. The patient structure
clinicians prevent human errors, while saving time and cost includes a station for the patient to settle in, a top camera,
[14, 15]. Moreover, these studies recommend using various a 360-degree step motor to rotate the patient, and a sloping
computational and technological tools to improve the results mirror on top of the patient. The third structure is a fixed
based on the differences among subjects in terms of gender base for the front camera, which is installed at a distance
or race [16]. Thus, we need a more intelligent approach for between the patient and the specialist. We used effective and
knowledge discovery and pattern recognition. The current affordable webcams instead of an expensive camera. Table 1
applied-developmental study aims to create a mechatronics presents a list of peripheral devices and their applications.
platform to provide easy access and to process medical pos- We developed a stepper motor for the 360-degree plat-
tural images in order to determine complications, problems, form by assembling the parts available in the market and
and the form of the spine. Consistent with this goal, a data- the exclusive design of a partner company. Figure 2 shows
base management system for the follow-up and for record- the designed platform.
ing patient information will also be developed. The main The computational and operational software of the system
objectives of the study include documenting patient data, consisted of (1) a preliminary intelligent processing module

13
Physical and Engineering Sciences in Medicine (2021) 44:901–910 903

based on image processing and machine learning (Mode1),


(2) a patient database, (3) a module for step motor and light
remote controlling, and (4) a communication module to
transfer the transformed images to a machine learning cloud
server to extend the capabilities of the software in the next
versions (Model 2). Each component has its sub-modules,
which are discussed in the next section. Figure 3 depicts the
diagram of the activity (UML 2.0) performed in the process-
ing module.
At first, the demographic data of the patients are collected
for the subsequent follow-ups. These data play the role of
metadata in the proposed big data and machine learning
platform. Then, the user selects various views, and after the
automatic rotation of the patient, the specific measures of
each view are displayed in the left panel of the software. By
selecting each measure, interactive help will be provided to
improve the user accuracy in terms of image land-marking
or measure computing. When the user saves his task, the
results are entered into the database, and further reporting
will be available for each visit of the patients. Figure 4 shows
some images of the software UI and its capabilities. When
the user selects a specific postural measure by checking the
Fig. 1  A prototype of the designed system (the marked numbers are related checkbox, two or three points are suggested by the
explained in Table 1) preliminary machine learning algorithm.

Table 1  Peripheral devices and objects and their features for posture analysis
No (Fig. 1) Device Features Application

1 Patient platform Width: 1 m The patient is placed on a fixed platform


Height: 2.45 m
Material: Metal and MDF
2 Front camera stand Width: 20 cm The cameras for the anterior and posterior views are
Height: 1.50 m embedded in this stand
Material: Metal
3 Clinician desk Width: 40 cm The computer, printer, and projector can be placed on this
Height: 65 cm desk
Material: Metal and MDF
4 Logitech webcam Resolution: Full-HD Top-view camera
Speed: 30 fps
5 Microsoft LifeCam Studio Resolution: Full-HD The cameras for anterior and posterior views
Speed: 30 fps
6 Laptop/PC Minimum requirements: Client software modules were installed on the computer
Ram: 4 GB
CPU: dual-core
HDD: 20 GB
OS: Windows
7 Stepper motor 360-degree platform Rotational speed: 1 rpm Patient is rotated in a fixed posture to capture 360-degree
Unidirectional images
Diameter: 60 cm
Height: 18 cm
Max tolerable weight: 150 kg
Weight: 20 kg
Power in: 24 V DC
8 Switch Two-mode switch Manual control of the stepper motor
9 Top mirror Unbreakable mirror To examine the patient’s condition with the naked eye

13
904 Physical and Engineering Sciences in Medicine (2021) 44:901–910

Fig. 2  The stepper motor of the 360-degree platform (without the top
cover)

As displayed in Fig. 3, when the person stands in the sta-


tion, the physiotherapist starts the procedure by rotating and
capturing the patient in triple views. Then he/she clicks on a
specific measure, and land-marking in each view is suggested
by the calculations of Model 1. Then, he can change the posi-
tion of the landmarks without any limitations. Finally, when
he accepts the landmarks and clicks, the calculations are per-
formed, and the angle or distance is added to the report. It is
the final product which is reported in the current study; how-
ever, this platform can use the collected dataset (i.e., images
in the triple view and the patient metadata) to train a deep
learning model (Model 2) to create a fully-automatic posture
analysis system without user intervention. Table 2 and Fig. 5
present the characteristics and features of both proposed mod-
els. As shown in Table 2, a simple convolutional neural net-
work (CNN) is used to generate Model 1 based on the dataset Fig. 3  A high-level activity diagram of the software
limitation. However, to obtain the fully-automatic software
in Model 2, we provide a secure cloud server to incremen-
tally store the dataset and train the future model. This model patient data are only accessed by authenticated users through a
can use deeper structures and more convolutions. Therefore, two- step verification process using the phone number. Images
to satisfy the dataset volume, a communication module was are anonymized and uploaded after the patient provides con-
designed to transfer the filtered images and metadata to a pre- sent for data reuse. Our method guarantees data integrity by
configured deep learning cloud server during the idle time making regular backups from the data. In addition, the event-
of the software. A number of necessary ethical and security logging module is activated for auditing. A cloud server was
considerations were followed to use and protect user informa- provided and our programmers made a foundation based on
tion against violations and misuse on the cloud. Three types of Python and TensorFlow, which reads images and landmarks
cloud platforms are usually employed for rendering e-health metadata from the clinician system. We used a GeForce RTX
services., i.e., private, public, and hybrid clouds. Moreover, 2080 GPU to train a predefined convolutional neural network
we tried to satisfy some security and privacy requirements as (CNN). Firstly, the algorithms classify the measures on new
recommended by HIPAA, including patient’s understanding, images, and they then predict the positions of the landmarks.
patient’s control, confidentiality, data integrity, consent excep- Finally, the automatic calculation of measures is performed
tion, non-repudiation, and auditing [17]. We used a private based on the predicted landmarks, and the results are reported.
cloud model since it is considered the most secure platform. Images are converted to vectors in the preprocessing stage,
There is some strict restrictions to the public internet. The which leads to faster computations and more secure data

13
Physical and Engineering Sciences in Medicine (2021) 44:901–910 905

Fig. 4  Various views of the software UI (a patient record search, b anterior view of patient imaging, c anterior measurement toolbox, and d a
sample of software reports)

analysis before feeding the CNN model. The architecture of


our proposed model (Model 2) for developing a fully-auto-
mated posture analysis is shown in Fig. 5.
Table 2  The deep neural network structure of Model 1 to predict esti- Finally, a sidelong telerehabilitation application, includ-
mated markers for each parameter ing about 500 specific exercises based on the Schroth method
Layer Values Output and guidelines [18], was designed to track patients at home.
This application covers more than ten types of spinal pos-
Input (160 × 160) (160 × 160 × 3)
tural disorders, including scoliosis in three stages of treat-
CONV1 [(3 × 3).Relu.S = 1] (160 × 160 × 32)
ment. Multimedia content can be downloaded by the patient
POOL1 [(2 × 2).S = 2] (80 × 80 × 32)
in the app after the clinician’s selection in a specialist app.
CONV2 [(3 × 3).Relu.S = 1] (80 × 80 × 64)
Every time the patient runs an exercise, a notification will
POOL2 [(2 × 2).S = 2] (40 × 40 × 64)
be sent to his/her clinician. Moreover, they can exchange
Drop out 1 [(0 ⋅ 1)] (40 × 40 × 64)
messages through a simple peer-to-peer chat plugin. In addi-
CONV3 [(3 × 3).Relu.S = 1] (40 × 40 × 128)
tion, HIPAA recommendations were satisfied with the help
POOL3 [(2 × 2).S = 2] (20 × 20 × 128)
of an information security expert. Figure 6 shows the UI of
Drop out 4 [(0 ⋅ 2)] (20 × 20 × 128)
the developed app.
CONV4 [(3 × 3).Relu.S = 1] (20 × 20 × 256)
POOL4 [(2 × 2).S = 2] (10 × 10 × 256)
Drop out 3 (10 × 10 × 256)
[(0 ⋅ 3)]
Results
CONV5 [(3 × 3).Relu.S = 1] (10 × 10 × 98)
FC [(64)] (1 × 1 × 64)
Evaluation of the platform’s reliability
FC [(128)] (1 × 1 × 128)
FC [(256)] (1 × 1 × 256)
The videos and photographs used to determine the intra and
Output [(44)] (1 × 1 × 98)
inter-rater reliability of the developed device were taken

13
906 Physical and Engineering Sciences in Medicine (2021) 44:901–910

Fig. 5  The architecture of the proposed deep learning platform (required to train Model 2)

Fig. 6  The Android telerehabilitation application

from a convenient sample of five males and five females, Then, a data extraction protocol was designed based on
assessed previously using traditional methods (average age: common therapies in the country. The raters became quite
28.5, average weight: 84.3 KG, average height: 173.5 cm). familiar with the calibration and usage of the device. They
The data were recorded based on the captured photos and acquired sufficient knowledge to identify relevant postural
related reports stored in paper-based medical records. Expert landmarks suggested by the software using an early-trained
physiotherapists, as the raters, performed various posture deep learning approach used as a semi-automated image pro-
measurements as the person was standing on the structure. cessing method. It should be noted that because of the lim-
For each sample, a 360-degree scan was performed to take ited number of images in this trained model, the freedom of
four images of the patient. Prior to data extraction, the raters the user for changing the suggested landmarks was not lim-
completed a session to learn how to operate the software. ited. To achieve a fully-automated software, a cloud-based

13
Physical and Engineering Sciences in Medicine (2021) 44:901–910 907

solution is proposed in the current study to collect data from suitable for ergonomic and personal style improvement, it
the client software and train a powerful model. All the data is limited to a non-clinical analysis of the subject. Our ulti-
were imported into the software’s database for further intra mate objective was to investigate the reliability of the pos-
and inter-rater reliability analysis. To calculate the reliabil- ture parameters extracted from the input data (the image
ity parameters, the change in the mean, the typical error of stream) using the proposed device. Our device analyzed
measurement (TEM), and the intra-class correlation coef- the posture in four different views (i.e., anterior, lateral,
ficient (ICC) were computed using the method proposed by posterior, and top) without the use of reference markers.
Smit and Hopkins [19]. All the measures examined here demonstrated good to
excellent intra-rater reliability with small to moderate typi-
• Intra-rater reliability: A summarized report of the pos- cal errors of measurement based on commonly-employed
tural parameters extracted during 2 days by the same rater thresholds. In a study conducted by Hebert-Losier and
is provided in Table 2 with the relevant ICC. Overall, Abd-Rahman, the reliability of a popular software, i.e.,
the intra-rater reliability was good and excellent for 80% Posture Pro 8, was evaluated. To do so, 40 badminton
(n = 35) of the computed parameters. players participated in the study, and 33 parameters were
• Inter-rater reliability: A summarized report of the pos- extracted and calculated for each person. The results
tural parameters extracted by the two pairs of raters is showed that the intra-rater reliability was considered good
provided in Table 3 with the relevant ICC. It should be to excellent for nearly all the parameters. However, the
noted that 72% (n = 32) of the parameters exhibit good inter-reliability provided poor results, i.e., only two of the
and excellent inter-rater reliability. measures were considered excellent [24]. Moreover, Hop-
kins et al. evaluated the reliability of a mobile application
designed to measure the standing posture. In their study,
Discussion PostureScreen mobile app for iOS was compared with a
3D scan software. The app had acceptable ICC, and it was
In this work, we proposed a method to analyze posture meas- able to promptly assess posture [25]. Ferreira et al. evalu-
ures based on a mechatronics platform. Using a physical ated and validated a postural assessment software (PAS/
structure and a software toolkit, we were able to accurately SAPO). The study’s sample consisted of 88 images from
measure and judge the patient’s posture. Physiotherapists 22 patients, assessed by five raters. Then, ICC was calcu-
commonly apply qualitative and quantitative visual assess- lated. In this study, the inter-rater reliability was excellent
ment methods for the evaluation of body alignment and pos- and good in 76% of the cases, while intra-reliability was
tural imbalances [20]. excellent and good in 68% of the cases. They concluded
Sardini et al. described a wearable platform for monitor- that PAS/SAPO was accurate as a reliable tool for measur-
ing posture during rehabilitation exercises for the spine in ing posture [26]. Furthermore, Furlanetto et al. validated a
patients with scoliosis. Through a sensor-equipped T-shirt, posture analysis method using a digital image-based pos-
the platform measured the posture of the person using an tural assessment software. They stated that image-based
inductive sensor [21]. The main drawbacks of wearable sen- methods were a valid, simple, low-cost, non-invasive,
sors are their additional weight on the patient, the rigidity of and practical approach that could provide acceptable reli-
the structures that support them, and the shape and size and ability [27]. In the current study, the device demonstrated
other properties that make them invasive for the patient [22]. generally acceptable reliability (more excellent and good
Therefore, applying a non-invasive and invisible platform results) with a good user interface, quick calculations, and
will protect the user’s freedom and improve user satisfaction. a non-invasive approach. Nonetheless, the evaluation of
Our proposed platform includes a non-contact collection of the validity and sensitivity, and the interpretation of these
devices. measures will be vital to confirm the clinical relevance of
Ding et al. presented a new photogrammetry method for the proposed system. A number of papers have focused on
the online assessment of upper-body postures of a person wearable devices for spinal posture analysis [28]. How-
sitting in front of a webcam. Unlike most existing vision- ever, there are some limitations in the measurement of
based methods, the proposed software directly analyzes posture due to the time-consuming process of attaching
single images captured by the webcam. They proposed sensors and the technical problems of sensors in real-
a classification method without explicitly measuring the ity, such as battery limitations and noise sensitivity [29].
variables required for calculating risk scores. The method Therefore, our image-based methodology makes it more
achieved an accuracy of 99.5% for binary classification feasible for the patient and clinicians to be free of limita-
(low vs. high-risk postures) and 88.2% for the classifica- tions by employing an integrated easy-to-use device with
tion of 19 risk levels [23]. While this software is highly the least amount of technical dependency.

13
908 Physical and Engineering Sciences in Medicine (2021) 44:901–910

Table 3  Intra-rater and inter-rater reliability data of the parameters (2 days)


View Parameter (n = 44) Range Intra-rater reli- Inter-rater reli-
ability ability
ICC Magnitude ICC Magnitude

Anterior Head lateral tilt angle 0–5 0.96 Excellent 0.82 Good
Head inclination angle 0–5 0.93 Excellent 0.66 Fair
Shoulder tilt angle 0–5 0.94 Excellent 0.88 Good
Umbilicus plumb line distance 0–5 mm 0.89 Good 0.55 Fair
Lateral pelvic tilt angle 0–2 0.95 Excellent 0.80 Good
Shoulder on pelvic tilt angle 0–2 0.95 Excellent 0.92 Excellent
Greater trochanter tilt angle 0–2 0.97 Excellent 0.94 Excellent
Tibial tubers sity tilt angle 0–5 0.89 Good 0.69 Fair
Lateral knee angle Not standard 0.92 Excellent 0.90 Excellent
Femor segment length Not standard 0.95 Excellent 0.90 Excellent
Tibia segment length Not standard 0.90 Excellent 0.90 Excellent
Bimalleular distance 0–5 0.88 Good 0.81 Good
Lateral malleolus tilt angle 0–5 0.91 Excellent 0.72 Fair
Asis to medial malleolus distance Not standard 0.86 Good 0.89 Good
Umbilicus to medial malleolus distance Should be similar for right and left sides 0.69 Fair 0.55 Fair
Posterior Scapula tilt angle Not standard range 0.89 Good 0.87 Good
Scapula upward rotation angle Not standard range 0.91 Excellent 0.94 Excellent
Inferior angle midline distance 5 cm 0.77 Good 0.68 Fair
Scapula T2 distance 4 cm 0.93 Excellent 0.92 Excellent
Pelvic tilt angle 0–5 degree 0.96 Excellent 0.91 Excellent
Ankle and feet Not standard range 0.88 Good 0.86 Good
Lateral Crani over tebral angle 38–54 0.97 Excellent 0.80 Good
Head tilt angle 0–5 0.93 Excellent 0.91 Excellent
Head position angle Not standard range: les angle, more FHP 0.68 Fair 0.64 Fair
Upper cervical angle Not standard range: greater angle, more extension 0.91 Excellent 0.93 Excellent
Lower cervical angle Not standard range: greater angle, more extension 0.93 Excellent 0.82 Good
Tragus plumb line distance 0–5 mm 0.91 Excellent 0.88 Excellent
Shoulder protraction angle Not standard range 0.94 Excellent 0.90 Excellent
Thoracic angle Not standard range 0.90 Excellent 0.89 Excellent
Acromion plumb line 0–5 mm 0.88 Good 0.65 Fair
Vertical body angle Not standard range 0.94 Excellent 0.68 Fair
Trunk sagital angle Not standard range 0.94 Excellent 0.90 Excellent
Body sagital angle Not standard range 0.99 Excellent 0.89 Excellent
Sway angle Not standard range 0.93 Excellent 0.90 Excellent
Trunk to lower line angle 0–5 degree 0.89 Good 0.66 Fair
Sagital pelvic tilt angle 0–5 degree 0.88 Good 0.82 Good
Lower limb angle Not standard range 0.94 Excellent 0.91 Excellent
Hip joint angle Not standard range 0.92 Excellent 0.95 Excellent
Greater trochanter plumb line 0–5 mm 0.89 Good 0.80 Good
Lateral knee angle Not standard range 0.91 Excellent 0.66 Fair
Knee to plumb line distance Not standard range 0.98 Excellent 0.91 Excellent
Lateral ankle tilt angle Not standard range 0.97 Excellent 0.89 Excellent
Top Head rotation angle Not standard range 0.89 Good 0.81 Good
Toe out angle Not standard range 0.93 Excellent 0.67 Fair

13
Physical and Engineering Sciences in Medicine (2021) 44:901–910 909

Conclusion idiopathic scoliosis: photogrammetry in scoliosis school screen-


ing. J Manip Physiol Ther 40(6):441–451
7. Navarro IJRL, Candotti CT, Furlanetto TS, Dutra VH, do Amaral
The present study aimed to design a 3D posture analy- MA, Loss JF (2019) Validation of a mathematical procedure for
sis device and determine the measurement reliability in a the cobb angle assessment based on photogrammetry. J Chiropr
standing position. The results of this study suggest that the Med 18(4):270–277
8. Gazziro M, Real EM, Fukuchi RK, Gois JP (2019) Multi-sensor
designed mechatronics device used in conjunction with the 3D scanner for postural analysis. In: Anais do XIX Simpósio Bra-
smartphone application is a valid tool for obtaining reliable sileiro de Computação Aplicada à Saúde. SBC, pp 10–21
measurements. Furthermore, the measurement performed by 9. Furlanetto TS, Sedrez JA, Candotti CT, Loss JF (2016) Photo-
the device is a simple, practical, and low-cost non-invasive grammetry as a tool for the postural evaluation of the spine: a
systematic review. World J Orthop 7(2):136
method for posture assessment with high stability. Future 10. McAuliffe MJ, Lalonde FM, McGarry D, Gandler W, Csaky K,
studies can be conducted to evaluate the error rate of the Trus BL (2001) Medical image processing, analysis and visualiza-
device, while a clinical trial can be performed to assess the tion in clinical research. In: Proceedings 14th IEEE symposium on
impact of the application on the rehabilitation of the patients. computer-based medical systems. CBMS 2001. IEEE, pp 381–386
11. Restrepo D, Armstrong KA, Metlay JP (2020) Annals clinical
In addition, we suggest a longer time for data acquisition decision making: avoiding cognitive errors in clinical decision
since it will lead to a more accurate and fully-automated making. Ann Intern Med 172(11):747–751
dynamic posture analysis. 12. Patel M, Pavic A, Goodwin VA (2020) Wearable inertial sen-
sors to measure gait and posture characteristic differences in
older adult fallers and non-fallers: a scoping review. Gait Posture
76:110–121. https://​doi.​org/​10.​1016/j.​gaitp​ost.​2019.​10.​039
Author contributions All authors contributed equally.
13. Afanasieva I, Khaitovych M, Potaskalova V, Andrushchenko
IV, Yevminov VV, Kudelia IA (2020) The prevalence of posture
Funding These experiments were supported by SanamSahand.com pathology in school-aged children (results of a population-based
Knowledge-Based company as a startup activity under the Iranian vice study with the use of the computerized photo-geometric program
presidency for science and technology license (Grant No: 35401456). Posture). Zaporozhye Med J 22(3):389–394
14. Barassi G, Di Simone E, Galasso P, Cristiani S, Supplizi M,
Availability of data and material The source code, demo, and early Kontochristos L, Colarusso S, Visciano CP, Marano P, Antonella
evaluation results can be provided as needed. DI, Giancola O (2021) Posture and health: are the biomechanical
postural evaluation and the postural evaluation questionnaire com-
parable to and predictive of the digitized biometrics examination?
Declarations Int J Environ Res Public Health 18(7):3507
15. Safdari R, Rezaei-Hachesu P, GhaziSaeedi M, Samad-Soltani
Conflict of interest There is no conflict of interest. T, Zolnoori M (2018) Evaluation of classification algorithms vs
knowledge-based methods for differential diagnosis of asthma in
Ethical Statements All procedures performed in the study were in iranian patients. Int J Inf Syst Service Sect 10(2):22–35
accordance with ethical and technical standards. The Iranian national 16. Macedo Ribeiro AF, Bergmann A, Lemos T, Pacheco AG, Mello
medical device directorate(IMED) checked and validated the structure Russo M, Santos de Oliveira LA, de Carvalho Rodrigues E (2017)
of the device. Also, it received a national patent certificate. Reference values for human posture measurements based on com-
puterized photogrammetry: a systematic review. J Manip Physiol
Code availability The source code, demo, and early evaluation results Ther 40(3):156–168. https://​doi.​org/​10.​1016/j.​jmpt.​2016.​12.​001
can be provided as needed. 17. Azeez NA, der Vyver CV (2019) Security and privacy issues in
e-health cloud-based system: a comprehensive content analysis.
Egypt Inform J 20(2):97–108. https://​doi.​org/​10.​1016/j.​eij.​2018.​
12.​001
References 18. Weiss H-RJS (2011) The method of Katharina Schroth-history,
principles and current development. Scoliosis 6(1):17
1. Diab AA, Moustafa IM (2012) The efficacy of forward head cor- 19. Smith TB, Hopkins WG (2011) Variability and predictability of
rection on nerve root function and pain in cervical spondylotic finals times of elite rowers. Med Sci Sports Exerc 43(11):2155
radiculopathy: a randomized trial. Clin Rehabil 26(4):351–361 20. Hough R, Nel R (2013) Intra-rater reliability of the posture analy-
2. Wickstrom BM, Oakley PA, Harrison DE (2017) Non-surgical sis tool kit. S Afr J Occup Ther 43(1):15–20
relief of cervical radiculopathy through reduction of forward head 21. Sardini E, Serpelloni M, Ometto M (2012) Smart vest for pos-
posture and restoration of cervical lordosis: a case report. J Phys ture monitoring in rehabilitation exercises. In: 2012 IEEE sensors
Ther Sci 29(8):1472–1474 applications symposium proceedings. IEEE, pp 1–5
3. Hazar Z, Karabicak GO, Tiftikci U (2015) Reliability of pho- 22. O’Sullivan K, Galeotti L, Dankaerts W, O’Sullivan L, O’Sullivan
tographic posture analysis of adolescents. J Phys Ther Sci PJE (2011) The between-day and inter-rater reliability of a novel
27(10):3123–3126 wireless system to analyse lumbar spine posture. Ergonomics
4. Coglianese D (2006) Muscles: testing and function with posture 54(1):82–90
and pain. Phys Ther 86(2):304–305‫‏‬ 23. Ding Z, Li W, Ogunbona P, Qin L (2019) A real-time webcam-
5. Bettany-Saltikov J, Kandasamy G, Turnbull D (eds) (2021) Spinal based method for assessing upper-body postures. Mach Vis Appl
deformities in adolescents, adults and older adults. BoD–Books 30(5):833–850
on demand‫‏‬ 24. Hébert-Losier K, Abd Rahman F (2018) Reliability of postural
6. Penha PJ, Penha NLJ, De Carvalho BKG, Andrade RM, Schmitt measures in elite badminton players using Posture Pro 8. Physi-
ACB, João SMA (2017) Posture alignment of adolescent other Theory Pract 34(6):483–494

13
910 Physical and Engineering Sciences in Medicine (2021) 44:901–910

25. Hopkins BB, Vehrs PR, Fellingham GW, George JD, Hager R, spinal posture. In: 2006 10th IEEE international symposium on
Ridge ST (2019) Validity and reliability of standing posture wearable computers. IEEE, pp 65–68
measurements using a mobile application. J Manip Physiol Ther 29. Simpson L, Maharaj MM, Mobbs RJ (2019) The role of wear-
42(2):132–140 ables in spinal posture analysis: a systematic review. BMC
26. Ferreira EAG, Duarte M, Maldonado EP, Burke TN, Marques Musculoskelet Disord 20(1):55. https:// ​ d oi. ​ o rg/ ​ 1 0. ​ 1 186/​
APJC (2010) Postural assessment software (PAS/SAPO): valida- s12891-​019-​2430-6
tion and reliabiliy. Clinics 65(7):675–681
27. Furlanetto TS, Candotti CT, Comerlato T, Loss JF (2012) Validat- Publisher's Note Springer Nature remains neutral with regard to
ing a postural evaluation method developed using a Digital Image- jurisdictional claims in published maps and institutional affiliations.
based Postural Assessment (DIPA) software. Comput Methods
Progr Biomed 108(1):203–212. https://​doi.​org/​10.​1016/j.​cmpb.​
2012.​03.​012
28. Dunne LE, Walsh P, Smyth B, Caulfield B (2006) Design and
evaluation of a wearable optical sensor for monitoring seated

13

You might also like