KINOVEA - Inter-Rater and Intra-Rater Reliability of Kinovea Software For Measurement of Shoulder Range of Motion
KINOVEA - Inter-Rater and Intra-Rater Reliability of Kinovea Software For Measurement of Shoulder Range of Motion
KINOVEA - Inter-Rater and Intra-Rater Reliability of Kinovea Software For Measurement of Shoulder Range of Motion
Keywords:
goniometry, movement, photography, reliability, upper limb
Bulletin of Faculty of Physical Therapy 21:80–87
© 2016 Bulletin of Faculty of Physical Therapy
1110-6611
© 2016 Bulletin of Faculty of Physical Therapy | Published by Wolters Kluwer - Medknow DOI: 10.4103/1110-6611.196778
Reliability of Open-source software Abd Elrahim et al. 81
joint. This is not easy in some situations, such as a flexion, abduction, and ERs and IRs were evaluated
shoulder internal rotation (IR) and external rotation with the patient in supine position by three raters.
(ER) at 90° of abduction in which the reference arm Intrarater reliability was examined by a single rater
does not refer to a bony landmark [12]. within the same day.
Participants were informed about the purpose and movements. Once positioned, the participant was asked
procedures of the study before their written consent to rotate the arm back into ER to their available end-range
was obtained. Randomization was carried out by asking without any discomfort. The participant was instructed
the participants to draw a folded paper that was labeled not to lift the lower back during this measurement.
with the tested movement from a box.
IR-AROM: IR-AROM was measured following the
Participants were asked to wear light clothing to allow same procedure used for ER, except that the parti-
for better identification of the bony landmarks and cipant was instructed to internally rotate the arm while
to avoid motion restrictions. Before recording any maintaining the 90° abducted position.
measurement, the tested movements were practiced
three times to familiarize the participants with the Instruments
procedure and the motions being measured. Images of each participant were captured using a digital
camera (Nikon Coolpix S3200, effective pixels 16 MB;
Before photographing the motion, a pen marker was Nikon Corp., Tokyo, Japan) to capture the sagittal and
used to draw cross marks on preselected anatomical the frontal plane profile of the dominant shoulder. The
landmarks on the tested dominant upper limb camera was placed 1.5 m away from the participants on
(acromion process, coracoid, olecranon process, and a tripod at a height of 80 cm. To maintain the same
the lateral epicondyle, midthoracic line, and midshaft distance between the camera and the participants; the
of the humerus). Using these marks, we quantified the tripod was placed on taped markers on the floor. All
following four movements that each participant images were imported into a laptop and analyzed
performed at a maximum (end-range) joint movement using Kinovea software, which is a free, open-source
at each participant’s own pace: software created for movement analysis (Kinovea,
0.8.15, http://www.kinovea.org/).
Flexion-AROM: a cross mark was placed on the lateral
aspect of the center of the humeral head approximately Raters were told to view each image only once so that
below the acromion process (fulcrum). One cross mark they would not change their assessment. Each rater
was placed along the midshaft of the humerus aligned took two measurements of every participant, and each
with the greater tuberosity and lateral epicondyle of the rater repeated the assessment 1 week later. On the
humerus; one additional cross mark was placed along the second day of the analysis, the order of appearance of
midline of the thorax [29]. Flexion-AROM was assessed the images on the computer screen was randomized by
with the participant in supine position on a standard an assistant to minimize any learning or order effects.
plinth. The arm was actively elevated in a strict sagittal All raters were blinded to the results of each other
plane with the thumb pointed up toward the ceiling. and to their own consecutive repeated results. The
intratester reliability phase of the study was conducted
Abduction-AROM: a cross mark was placed on the by one single rater (rater C) by measuring joint ROM of
coracoid process (fulcrum). One cross mark was placed the same participants twice within the same day (with a
along the shaft of the humerus, and an additional cross period of 3 h in between).
mark was placed along the midline of the thorax [29].
Abduction-AROM was measured with the participant Data analysis
in the supine position, as in flexion-AROM. The arm All movements were converted into angles using the
was actively elevated in the strict coronal plane with the virtual goniometer of the software.
thumb pointed up toward the ceiling. This allowed for
the required ER necessary to avoid impingement of the Flexion-AROM
greater tuberosity on the acromion process. To measure shoulder flexion angle, a line was drawn
from the fulcrum point to bisect the midthorax line
ER-AROM: a cross mark was placed at the olecranon (stationary arm). Another line was drawn bisecting the
process (fulcrum), and another cross mark was placed at point demarking the midshaft of the humerus (movable
the ulnar styloid process [29]. ER-AROM was tested arm). The angle of the intersection of the two lines was
with the participant in supine position. The tested arm measured in degrees (Fig. 1).
was supported on the table at 90° abduction, the elbow
was flexed to 90°, and the wrist was neutral. A towel roll Abduction-AROM
was placed under the humerus to ensure neutral horizontal To measure shoulder abduction angle, a line was drawn
positioning and to approximate the plane of the scapula, from the fulcrum point bisecting the point of the
and a weighted bag was used to prevent unwanted scapular midthorax line (stationary arm), and another line
Reliability of Open-source software Abd Elrahim et al. 83
bisected the point demarking the shaft of the humerus values were between 1.7° (ER) and 2.1° (abduction
(movable arm). The angle of the intersection of the two and IR) (Table 3). Overall, measurements taken
lines was measured in degrees (Fig. 2). in flexion and ER showed the potentially lowest
and highest meaningful reliability properties,
ER-AROM respectively.
The ER angle was formed by a line drawn from the
Figure 1
fulcrum point through the shaft of the ulna (movable
arm) and a line perpendicular to the plinth (stationary
arm) (Fig. 3).
IR-AROM
The same procedure was used to measure the ER of the
shoulder (Fig. 4).
Statistical analysis
Descriptive data analyses were calculated as well as
the relative reliabilities and 95% CIs were expressed
as the ICC3,1 and inter-rater correlation coefficients
(ICC2,2). All statistical analyses were carried out using Analysis of shoulder flexion.
the statistical package (SPSS for Windows, version 20;
SPSS Inc., Chicago, Illinois, USA). The reference Figure 2
ranking values for the ICC in the present study were
those described by Johnson and Gross [30]: small
reliability, 0.25; low reliability, 0.26–0.49; moderate
reliability, 0.50–0.69; high reliability, 0.70–0.89; and
very high reliability more than 0.90. Absolute reliability
was expressed as a standard error of measurement
(SEM). Further, the minimal detectable change
(MDC), which represents the magnitude of change
necessary to exceed the measurement error of two
repeated measurements at a specified CI, was
calculated for the 95% CI (MDC95).
active shoulder mobility measurements using a digital compared with smartphones, as it has SEMs less
inclinometer and goniometer. Intrarater analysis than 2°.
suggested excellent reliability for all measurements
with both instruments with ICC values ranging from As expected, intrarater reliability values were higher
0.94 to 0.98. In the aforementioned study, the SEM than inter-rater values, which had less variability when
was 2°, whereas in the current study the SEM was the same rater was used. In addition, the values of the
less than 1°, and the MDC95 was lower to 2°, SEM and the MDC95 for intrarater reliability were
indicating superior reliability of the Kinovea smaller than that for inter-rater reliability, which is in
software. accordance with less measurement variation that is
typical when the same rater is used. It is worth
In comparison with more advanced measurement tools, mentioning that measurement variation of any
Kinovea software showed higher intratester reliability measurements or measurement tools, in general, is
compared with smartphone applications. Mitchell et al. more likely to be detected than no variation because
[33] examined the reliability of inclinometry-based the nature of reality is such that measurements are
and photo-based smartphone applications in the rarely perfectly reliable. This is due to multifactorial
measurement of active shoulder ER as compared sources to variation existing within the total
with standard goniometry (SG). Intrarater reliability measurement system [35].
using novice raters ranged from ICC values of 0.79 to
0.81 for the two applications and 0.82 with an SG Measurement variations found in the present study
value. Inter-rater reliability (novice/expert) for the two could be attributed to the following factors. First, there
applications ranged from ICC values of 0.92 to 0.94 is the human factor; the inter-rater variation could be
with an SG value at 0.91. Both applications were found higher than the intrarater variation because the analyses
to be reliable and comparable to SG. A photo-based were made by three different raters with different
application potentially offers a superior method of personal characteristics and years of experience.
measurement, as visualizing the landmarks may be Second, there is the time factor, as the variability
simplified in this format. In addition, it provides a within same day measurements could be due to the
record of measurement that is in agreement with the fact that the measurements were taken on two different
advantages of Kinovea software. occasions. Although these potential sources of error
existed, Kinovea software shows excellent reliability
Furthermore, in a study by Werner et al. [34] the and is believed to be a valuable clinical tool.
average ICC for the SG was 0.69; the average ICC
for the smartphone clinometer was 0.80. These values Kinovea software for shoulder ROM presents several
are lower than the values recorded by Kinovea in the advantages over currently used methods, including
current study. In addition, abduction had the lowest visual estimation, classic double-armed goniometer,
ICC values across examiners, and ER at 0° and 90° had digital inclinometry, and high-speed cinematography.
the highest ICC values, which are in agreement with The free, open-access software is widely available
the current findings. In the aforementioned study, to users, giving it a distinct advantage over other
SEM calculations for each measurement modality digital inclinometers and more complex measurement
were used to determine absolute reliability. The tools.
average clinometer had the lowest (best) SEM at
3.6°. In general, ER and IR measurements had the Strengths of the present study are highlighted as
highest SEMs, whereas abduction and forward flexion follows. First, the three raters were trained with
typically had the lowest SEMs. Their findings Kinovea software before the study, which could have
highlighted that Kinovea yields better reliability enhanced consistency in the measurement process.
86 Bulletin of Faculty of Physical Therapy, Vol. 21 No. 2, July-December 2016
Second, standardization of the procedures also could range of motion in patients with shoulder pain using a digital inclinometer.
BMC Musculoskelet Disord 2004; 5:18.
have minimized random errors. Third, measurements
10 Terwee CB, de Winter AF, Scholten RJ, Jans MP, Devillé W,van Schaardenburg
were taken in a random order. Because of the numerous D, Bouter LM. Interobserver reproducibility of the visual estimation of range of
measurements taken with the Kinovea software, we motion of the shoulder. Arch Phys Med Rehabil 2005; 86:1356–1361.
11 Nadeau S, Kovacs S, Gravel D, Piotte F, Moffet H, Gagnon D, Hébert LJ.
have assumed that it would have been impossible for Active movement measurements of the shoulder girdle in healthy subjects
the raters to remember all of the results and influence with goniometer and tape measure techniques: a study on reliability and
validity. Physiother Theory Pract 2007; 23:179–187.
the readings. Therefore, we believe this helped in
12 Mullaney MJ, McHugh MP, Johnson CP, Tyler TF. Reliability of shoulder
minimizing information bias. Finally, the raters range of motion comparing a goniometer to a digital level. Physiother
made their measurements on videos previously taken Theory Pract 2010; 26:327–333.
13 Kolber MJ, Fuller C, Marshall J, Wright A, Hanney WJ. The reliability and
by a research assistant. Only one video was taken, and concurrent validity of scapular plane shoulder elevation measurements using a
all of the measurements were performed from that digital inclinometer and goniometer. Physiother Theory Pract 2012;
image. On the basis of the work of Ferriero et al. 28:161–168.
14 Nussbaumer S, Leunig M, Glatthorn JF, Stauffacher S, Gerber H, Maffiuletti
[36], if the picture was taken correctly, it did not NA. Validity and test-retest reliability of manual goniometers for measuring
significantly influence the inter-rater reliability. This passive hip range of motion in femoroacetabular impingement patients.
BMC Musculoskelet Disord 2010; 11:194.
study has the following limitations. The enrolled
15 Kurillo G, Han JJ, Abresch RT, Nicorici A, Yan P, Bajcsy R. Development and
participants were healthy; consequently, our findings application of stereo camera-based upper extremity workspace evaluation in
cannot be generalized to other patient population patients with neuromuscular diseases. PLoS One 2012; 7:e45341.
16 Schmidt R, Disselhorst-Klug C, Silny J, Rau G. A marker-based
with various musculoskeletal dysfunctions. A major measurement procedure for unconstrained wrist and elbow motions. J
limitation would be assessing participants while Biomech 1999; 32:615–621.
dressing light clothing; also, markers movement with 17 Roux E, Bouilland S, Bouttens D, Istas D, Godillon M, Lepoutre F. Evaluation
of the kinematics of the shoulder and of the upper limb. In: Newcastle upon
skin. Tyne, UK. Proceedings of the 3rd Conference of the International Shoulder
Group. Netherlands: Delft University Press; 2001. 66–71.
18 Klopcar N, Lenarcic J. Kinematic model for determination of human arm
reachable workspace. Meccanica 2005; 40:203–219.
Conclusion 19 Roy JS, Moffet H, McFadyen BJ, Macdermid JC. The kinematics of upper
Kinovea software is a reliable tool for measuring extremity reaching: a reliability study on people with and without shoulder
impingement syndrome. Sports Med Arthrosc Rehabil Ther Technol 2010;
shoulder flexion, abduction, and IR and ER-ROM 2:8.
in healthy individuals. Thus, it could be used as a 20 Penning LI, Guldemond NA, de Bie RA, Walenkamp GH. Reproducibility of
simple alternative to universal goniometry. a 3-dimensional gyroscope in measuring shoulder anteflexion and
abduction. BMC Musculoskelet Disord 2012; 13:135.
21 Guzmán-Valdivia CH, Blanco-Ortega A, Oliver-Salazar MA, Carrera-
Financial support and sponsorship Escobedo JL. Therapeutic motion analysis of lower limbs using Kinovea.
Int J Soft Comput Eng 2013; 3:359–365.
Nil.
22 www.kinovea.org/ [Cited: 10/01/2013].
23 Falco C, Landeo R, Menescardi C, Bermejo L, Estevan I. Match analysis
Conflicts of interest in a University Taekwondo Championship. Adv J Phys Educ 2012; 2:
There are no conflicts of interest. 28–35.
24 Richardson LR. Effect of step rate on foot strike pattern and running economy
in novice runners. Graduate Plan B and Reports: 287. Available at: http://
digitalcommons.usu.edu/gradreports/2870.2013. [Accessed 6 September
References 2015].
1 Gopura RARC, Kazuo K, Etsuo H. A study on human upper-limb muscles 25 Balsalobre-Fernández C, Tejero-González CM, del Campo-Vecino J,
activities during daily upper-limb motions. Int J Bioelectromagn 2010; 12:54–61. Bavaresco N. The concurrent validity and reliability of a low-cost, high-
2 Judith GH, Judith A, Karen G, Anne S. Handbook of physical speed camera-based method for measuring the flight time of vertical jumps.
measurements. 2nd ed. Oxford: Oxford University Press; 2007. J Strength Cond Res 2014; 28:528–533.
3 Tubiana R, Thomine JM, Mackin E. Examination of the hand and wrist. 2nd 26 Baude M, Hutin E, Gracies JM. A bidimensional system of facial movement
ed. London, UK: Martin Dunitz Ltd.; 1996. analysis conception and reliability in adults, Biomed Res Int 2015; 2015: 812961.
4 Awan R, Smith J, Boon AJ. Measuring shoulder internal rotation range of 27 Moral-Muñoz JA, Esteban-Moreno B, Arroyo-Morales M, Cobo MJ,
motion: a comparison of 3 techniques. Arch Phys Med Rehabil 2002; 83: Herrera-Viedma E. Agreement between face-to-face and free software
1229–1234. video analysis for assessing hamstring flexibility in adolescents. J
Strength Cond Res 2015; 29:2661–2665.
5 Muir SW, Corea CL, Beaupre L. Evaluating change in clinical status:
reliability and measures of agreement for the assessment of 28 Walter SD, Eliasziw M, Donner A. Sample size and optimal designs for
glenohumeral range of motion. N Am J Sports Phys Ther 2010; 5:98–110. reliability studies. Stat Med 1998; 17:101–110.
6 GajdosikRL,BohannonRW.Clinicalmeasurementofrangeofmotion.Reviewof 29 Narayanan S. Textbook of therapeutic exercises. New Delhi, India: Jaypee
goniometry emphasizing reliability and validity. Phys Ther 1987; 67:1867–1872. Brothers; 2005.
7 Karduna AR, McClure PW, Michener LA, Sennett B. Dynamic 30 Jonson SR, Gross MT. Intraexaminer reliability, interexaminer reliability,
measurements of three-dimensional scapular kinematics: a validation and mean values for nine lower extremity skeletal measures in healthy
study. J Biomech Eng 2001; 123:184–190. naval midshipmen. , J Orthop Sports Phys Ther 1997; 25:253–263.
8 Vermeulen HM, Stokdijk M, Eilers PH, Meskers CG, Rozing PM, Vliet 31 Damsted C, Nielsen RO, Larsen LH. Reliability of video-based
Vlieland TP. Measurement of three dimensional shoulder movement quantification of the knee- and hip angle at foot strike during running. Int
patterns with an electromagnetic tracking device in patients with a J Sports Phys Ther 2015; 10:147–154.
frozen shoulder. Ann Rheum Dis 2002; 61:115–120. 32 Kleban N, Mann D, Morrisoz J. Position analysis of tractor ingress and
9 De Winter AF, Heemskerk MA, Terwee CB, Jans MP, Devillé W, van egress. The Canadian Society for Bioengineering. Available at: http://www.
Schaardenburg DJ, et al. Inter-observer reproducibility of measurements of csbe-scgab.ca/docs/meetings/2013 [Accessed 30 June 2015]
Reliability of Open-source software Abd Elrahim et al. 87
33 Mitchell K, Gutierrez SB, Sutton S, Morton S, Morgenthaler A. Reliability 35 Portney LG, Watkins MP. Statistical measures of reliability in
and validity of goniometric iPhone applications for the assessment of active foundations of clinical research, applications to practice. 3rd ed.
shoulder external rotation. Physiother Theory Pract 2014; 30:521–525. USA: Prentice Hall; 2008.
34 Werner BC, Holzgrefe RE, Griffin JW, Lyons ML, Cosgrove CT, Hart JM. 36 Ferriero G, Sartorio F, Foti C, Primavera D, Brigatti E, Vercelli S.
Validation of an innovative method of shoulder range of motion Reliability of a new application for smartphones (Dr Goniometer)
measurement using a smartphone clinometers application. J Shoulder for elbow angle measurement. J Shoulder Elbow Surg 2011; 3:
Elbow Surg 2014; 23:275–282. 1153–1154.