Observer Variation

Relationships between early motor development and language and reading skills were studied in 154 children, of whom 75 had familial risk of dyslexia (37 females, 38 males; at-risk group) and 79 constituted a control group (32 females, 47 males). Motor development was assessed by a structured parental questionnaire during the child's first year of life. Vocabulary and inflectional morphology skills were used as early indicators of language skills at 3 years 6 months and 5 years or 5 years 6 months of age, and reading speed was used as a later indicator of reading skills at 7 years of age. The same subgroups as in our earlier study (in which the cluster analysis was described) were used in this study. The three subgroups of the control group were 'fast motor development', 'slow fine motor development', and 'slow gross motor development', and the two subgroups of the at-risk group were 'slow motor development' and 'fast motor development'. A significant difference was found between the development of expressive language skills. Children with familial risk of dyslexia and slow motor development had a smaller vocabulary with poorer inflectional skills than the other children. They were also slower in their reading speed at the end of the first grade at the age of 7 years. Two different associations are discussed, namely the connection between early motor development and language development, and the connection between early motor development and reading speed.

This work reports the validation of a simple CZE method to be used in quality control of recombinant human glycosylated interleukin-7 (rhIL-7) batches produced in Chinese Hamster Ovary (CHO) cells. The separation buffer was a 25mM sodium borate at pH 10 containing 12mM diaminobutane (DAB) used as a dynamic coating agent of the capillary. This method allowed the separation of seven peaks ranging from low to high sialylated glycoforms. An extensive study on conditioning methods of the capillary has been conducted to yield repeatable results. Excellent RSD of EOF mobility (less than 0.6%) was obtained when conditioning included capillary equilibration under virtual analyses and storage in 0.1M NaOH overnight. Method specificity has been demonstrated to be able to discriminate different rhIL-7 glycoforms produced in CHO from formulation matrix. Linearity was demonstrated between 0.5 and 4mg/mL. LOQ was 0.5mg/mL. Repeatability (RSD<1.4 and 3.3% for t(m) and A%, respectively), intermed...

Background and Purpose This study examined the interrater and intrarater reliability, concurrent validity, and criterion validity of the Tinetti Mobility Test (TMT) as a fall risk screening tool in individuals with Parkinson disease (PD). Subjects Thirty individuals with PD voluntarily participated in the study, and data from a retrospective review of 126 patient records were included. Methods Physical therapists and physical therapist students rated live and videotaped performances of the TMT. Tinetti Mobility Test scores were correlated with Unified Parkinson's Disease Rating Scale (UPDRS) motor scores and comfortable gait speed. The ability of the TMT to accurately assess fall risk was determined. Results Interrater and intrarater reliability was good to excellent (intraclass correlation coefficient of >.80). Tinetti Mobility Test scores correlated with UPDRS motor scores (rs=−.45) and gait speed (rs=.53). The sensitivity and specificity of the TMT to identify fallers were...

The aim of the present study is to compare the diagnostic performance of CT and MR imaging in detecting aldosterone-producing adenoma and to compare the interobserver variability in the detection of an aldosterone-producing adenoma on CT and MR. A retrospective study of 34 patients with primary hyperaldosteronism was performed. A total of 17 cases of aldosterone-producing adenoma and 17 cases of bilateral adrenal hyperplasia were included. The final diagnosis of an adenoma was made by surgery with histological confirmation, whereas that of bilateral adrenal hyperplasia was made on adrenal venous sampling or a good biochemical and clinical response following medical treatment alone and in the absence of a unilateral radiological abnormality. The CT (n=30) and MR (n=24) scans were reviewed independently by two radiologists experienced in adrenal imaging, who were unaware of the cause of the primary hyperaldosteronism. The diagnostic performances of both observers in detecting an aldosterone-producing adenoma on CT and MR imaging were compared. The 16 adenomatous nodules that were detected on imaging ranged from 1 to 4.75 cm in diameter. The calculated sensitivity and specificity for detecting aldosterone-producing adenoma were 87 and 93% for one observer and 85 and 82% for the other observer on CT, and 83 and 83% for one observer and 92 and 92% for the other observer on MR, respectively. Receptor operating characteristics curve analysis showed similar performances of both observers in detecting an aldosterone-producing adenoma on CT and MR imaging. There was good interobserver agreement on CT (k=0.71) and on MR (k=0.67). We have demonstrated comparable diagnostic performance and good interobserver agreement on CT and MR imaging for the detection of aldosterone-producing adenoma.

Assessment of bone marrow involvement by malignant plasma cells is an important element in the diagnosis and follow-up of patients with multiple myeloma and other plasma cell dyscrasias. Microscope-based differential counts of bone marrow aspirates are used as ...

To develop and test the reliability of a tool for rating websites that provide information on evidence-based medicine. For each site, 60% of the score was given for content (eight criteria) and 40% was given for organization and presentation (nine criteria). Five of 10 randomly selected sites met the inclusion criteria and were used by three observers to test the accuracy of the tool. Each site was rated twice by each observer, with a 3-week interval between ratings. Laval University, Quebec city. Three observers. The intraclass correlation coefficient (ICC) was used to rate the reliability of the tool. Average overall scores for the five sites were 40%, 79%, 83%, 88%, and 89%. All three observers rated the same two sites in fourth and fifth place and gave the top three ratings to the other three sites. The overall rating of the five sites by the three observers yielded an ICC of 0.93 to 0.97. An ICC of 0.87 was obtained for the two overall ratings conducted 3 weeks apart. This new ...

Results of reliability and agreement studies are intended to provide information about the amount of error inherent in any diagnosis, score, or measurement. The level of reliability and agreement among users of scales, instruments, or classifications is widely unknown. Therefore, there is a need for rigorously conducted interrater and intrarater reliability and agreement studies. Information about sample selection, study design, and statistical analysis is often incomplete. Because of inadequate reporting, interpretation and synthesis of study results are often difficult. Widely accepted criteria, standards, or guidelines for reporting reliability and agreement in the health care and medical field are lacking. The objective was to develop guidelines for reporting reliability and agreement studies. Eight experts in reliability and agreement investigation developed guidelines for reporting. Fifteen issues that should be addressed when reliability and agreement are reported are proposed. The issues correspond to the headings usually used in publications. The proposed guidelines intend to improve the quality of reporting.

This study evaluated the relative distribution and inter-rater reliability of revised DSM-5 criteria for eating disorders in a residential treatment program. Consecutive adolescent and young adult females (N=150) admitted to a residential eating disorder treatment facility were assigned both DSM-IV and DSM-5 diagnoses by a clinician (n=14) via routine clinical interview and a research assessor (n=4) via structured interview. We compared the frequency of diagnostic assignments under each taxonomy and by type of assessor. We evaluated concordance between clinician and researcher assignment through inter-rater reliability kappa and percent agreement. Significantly fewer patients received either clinician or researcher diagnoses of a residual eating disorder under DSM-5 (clinician-12.0%; researcher-31.3%) versus DSM-IV (clinician-28.7%; researcher-59.3%), with the majority of reassigned DSM-IV residual cases reclassified as DSM-5 anorexia nervosa. Researcher and clinician diagnoses show...

Precise and accurate field methods for body composition analyses in athletes are needed urgently. Standardisation of a novel ultrasound (US) technique for accurate and reliable measurement of subcutaneous adipose tissue (SAT). Three observers captured US images of uncompressed SAT in 12 athletes and applied a semiautomatic evaluation algorithm for multiple SAT measurements. Eight new sites are recommended: upper abdomen, lower abdomen, erector spinae, distal triceps, brachioradialis, lateral thigh, front thigh, medial calf. Obtainable accuracy was 0.2 mm (18 MHz probe; speed of sound: 1450 m/s). Reliability of SAT thickness sums (N=36): R(2)=0.998, SEE=0.55 mm, ICC (95% CI) 0.998 (0.994 to 0.999); observer differences from their mean: 95% of the SAT thickness sums were within ±1 mm (sums of SAT thicknesses ranged from 10 to 50 mm). Embedded fibrous tissues were also measured. A minimum of eight sites is suggested to accommodate inter-individual differences in SAT patterning. All sit...

To provide guidelines for the development of two types of closed-set speech-perception tests that can be applied and interpreted in the same way across languages. The guidelines cover the digit triplet and the matrix sentence tests that are most commonly used to test speech recognition in noise. They were developed by a working group on Multilingual Speech Tests of the International Collegium of Rehabilitative Audiology (ICRA). The recommendations are based on reviews of existing evaluations of the digit triplet and matrix tests as well as on the research experience of members of the ICRA Working Group. They represent the results of a consensus process. The resulting recommendations deal with: Test design and word selection; Talker characteristics; Audio recording and stimulus preparation; Masking noise; Test administration; and Test validation. By following these guidelines for the development of any new test of this kind, clinicians and researchers working in any language will be ...

Children with developmental disabilities often converse less frequently than their developmentally matched peers. This low conversational participation can cause problems for the children’s future language and discourse development. The purpose of this experimental study was to test the hypothesis that adult topic-continuing wh-questions would elicit topic continuations in children with relatively low language ability, but not in children with relatively high language ability. Twenty-three children with developmental delays interacted with an adult who conducted two play sessions. In each session, the adult used a different interaction style. The two styles differed in the adult’s use of topic-continuing wh-questions. Results indicate that adult use of topic-continuing wh-questions supported the use of child continuations in children at all language levels. The type of continuations (single word versus multiword) that were elicited depended on the language level of the children. Cli...

Objective The present study aimed to assess the reliability of intra and inter-examiner subacromial impingement index (SII) measures obtained from radiographs. Materials and methods Thirty-six individuals were enrolled and divided into two groups: control group, composed of 18 volunteers in good general health without shoulder problems, and a group of 18 patients with subacromial impingement syndrome (SIS). Radiographic images were taken with the dominant upper limb in neutral rotation, while the volunteers held their arm at 90° of abduction in the frontal plane. The beam of radiation at 30° craniocaudal inclination was used to provide an antero-posterior image view. Three blinded examiners each performed three measurements from the subacromial space (SS) and the anatomical neck of the humerus (NH). The SII was calculated as the ratio of the SS and the NH measures. The mean values of SII were compared using t-tests. The intra-class correlation coefficient (ICC) was used to assess intra- and inter-examiner reliability of the measures. Results The mean values of SII were greater for the control group (0.12) than for the SIS group (0.08; p = 0.0071). SII measurements showed excellent intra (0.96–0.99) and inter-examiner reliability (0.94) for both the control and SIS group. Conclusion The results of this study show the potential use of the SII; a greater mean value for the control group compared to the SIS group and excellent reliability for intra- and inter-examiner measurement. Validation studies of the index should be conducted to correlate the index with clinical findings from subacromial impingement syndrome.