Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
DEVELOPMENTAL MEDICINE & CHILD NEUROLOGY ORIGINAL ARTICLE Consensus research priorities for cerebral palsy: a Delphi survey of consumers, researchers, and clinicians SARAH MCINTYRE 1 | IONA NOVAK 1 | ANNE CUSICK 2 1 Cerebral Palsy Institute, Sydney, Australia. 2 University of Western Sydney, Office of the Academic Register, Sydney, Australia. Correspondence to Sarah McIntyre at Cerebral Palsy Institute, PO Box 184, Brookvale, Sydney, New South Wales 2100, Australia. E-mail: smcintyre@tscnsw.org.au PUBLICATION DATA Accepted for publication 5th March 2009. Published online. ACKNOWLEDGEMENTS This study was funded solely by in-kind contributions of staff salary time from the Cerebral Palsy Institute, which is supported by the Cerebral Palsy Foundation. We thank all the consumers, researchers, and clinicians who participated in this study. We particularly thank Shona Goldsmith from the Cerebral Palsy Institute for her editing and formatting, and Jessica Porter during data collection. AIM Research funds for cerebral palsy are scarce and competition for them is strong. This study aimed to identify questions for future research that were agreed to be a high priority. METHOD An expert panel of consumers, researchers, and clinicians was assembled (n=127) and surveyed using a Delphi survey comprising three rounds. In round I, participants identified three important research topics. Three parallel surveys were constructed: (1) consumers; (2) intervention researchers and clinicians; and (3) aetiology and prevention researchers. In rounds II and III, participants rated priorities using a seven-point Likert scale. Questions reaching consensus were itemized and those not reaching consensus were discarded. RESULTS Consumers identified questions in the themes of prevention ⁄ cure, quality of life ⁄ community participation, and service provision ⁄ intervention. Intervention researchers ⁄ clinicians identified questions in the themes of effective outcomes and effective research ⁄ services. Aetiology and prevention researchers identified questions in the themes of infection ⁄ inflammation, focus on timing, haematology, research tools, neuroregeneration, and genetics. Fifty per cent of the consumers’ priorities were also identified by professionals. INTERPRETATION Research priorities change as evidence is established. Phase II of this project is to develop a web portal with international collaboration. As evidence builds for one research question, it will be added to the web portal and unanswered questions will become the priority. Cerebral palsy (CP) is the most common physical disability in childhood. Despite clinical and research advances, its incidence remains stable.1 The condition is lifelong with no known cure. There is a need for research in aetiology, prevention, and effective intervention for maximizing potential and optimizing quality of life. No evidence exists of explicit published prioritization for CP research that is itself developed through a scientific process. Many individual research questions are identified at the conclusion of studies. However, no published study could be identified that provides guidance on the relative importance and ranking of the questions or where best to direct limited research funds to drive the field forward.2 The World Health Organization has identified that a collaborative, widely consulted, systematic approach to research priority setting is essential.3 Thus, establishing a unified research agenda for CP and consensus on essential and urgent research topics may provide the possibility of accelerating breakthroughs. Key stakeholder groups exist in CP with an interest in a priority-driven research agenda. Consumers (people with CP and their families) have the most vested interests in research, and must be included on an expert panel for developing research agendas.4 Additional groups include researchers ⁄ clinicians who provide intervention for people living with CP, those researching the aetiology ⁄ prevention of CP, and policy makers and administrators ⁄ senior management of key organizations (Table I). It is essential to involve as many legitimate stakeholders as possible in the identification and prioritization of research topics.3,5 Not only does this ensure the interests of all relevant people are considered, but it might also increase ownership of the ensuing research and the ª The Authors. Journal compilation ª Mac Keith Press 2009 DOI: 10.1111/j.1469-8749.2009.03358.x 1 Table I: High-priority questions for consumers and overlap with professionals Research questions Median (IQR) Rank (mean) Match Match aetiology ⁄ intervention prevention Theme 1: prevention and cure Aetiology How can CP be prevented? 7.00 (1.00) 1 (5.98) n⁄a a What are the causes of and casual 6.00 (1.00) 7 (5.80) n⁄a a 6.00 (1.00) 3 (5.85) d a 6.00 (1.00) 3 (5.85) d d 7.00 (1.00) 8 (5.78) c n⁄a 6.00 (1.00) 6 (5.83) b n⁄a 6.00 (1.00) 14 (5.60) c n⁄a 6.00 (1.00) 16 (5.44) b n⁄a 6.00 (1.00) 21 (5.08) d n⁄a 6.00 (1.00) 22 (4.85) d n⁄a 7.00 (1.00) 12 (5.68) d n⁄a 6.00 (1.00) 9 (5.75) a n⁄a 6.00 (1.00) 14 (5.60) d n⁄a 6.00 (1.00) 2 (5.95) a b 6.00 (1.00) 3 (5.85) a d pathways to CP? Neuroregeneration What potential does the brain have to repair injury? Can stem cells have a therapeutic effect for CP? Theme 2: quality of life and community participation Carers What policies are needed to improve quality of life for families caring for Australians with severe disabilities? Lifestyle What factors have the greatest impact on improving the lifestyle and quality of life of individuals with CP? Employment What are the barriers to employment that exist for people with CP? How can people with CP be better trained with the necessary skills to enter the workforce? Socioeconomics What is the relationship between CP and poverty? Access Can people with CP equitably access the community? Theme 3: service provision and intervention Service models What can be done to address the mismatch between what service parents and people with CP need and what they actually receive? What is the optimal intensity of therapy programs? What is the most efficient service model so that maximal services reach people with CP and their families? Effectiveness and outcomes What are the optimal treatments for CP? What are the long-term outcomes of treatments? 2 Developmental Medicine & Child Neurology 2009 Table I: Continued Research questions What is the effectiveness of Match Match aetiology ⁄ Median (IQR) Rank (mean) intervention prevention 6.00 (1.00) 11 (5.70) d n⁄a 6.00 (1.00) 13 (5.67) c c 6.00 (1.00) 18 (5.25) d n⁄a 6.00 (1.00) 19 (5.18) d n⁄a 6.00 (1.00) 23 (4.83) d n⁄a 6.00 (1.00) 9 (5.75) d n⁄a 6.00 (1.00) 17 (5.38) d d 6.00 (1.00) 20 (5.15) b n⁄a alternative therapies for the treatment of CP? What early intervention (dependent on CP type) will prevent and minimize structural impairments? Does physiotherapy benefit people with CP? What are the most effective methods of pain management so the secondary complications can be reduced? What is the effectiveness of hydrotherapy for people with CP? Role of families in intervention What are the most effective methods of educating parents to help improve their child’s independence and function? What is the impact of therapy type and duration on parents of a child with CP? Is hands-on treatment by therapists a more effective method than guided therapy by parents? a Close match; bsimilar intent; csimilar focus, different approach; dnothing similar; n ⁄ a, not applicable. IQR; Interquartile range. likelihood of the results influencing clinical practice and policy.3 The more groups and individuals who are involved, however, the greater the potential difficulty in reaching consensus.6 The aim of this study was to identify research questions for CP by conducting a three-part Delphi survey. The objectives of the study were as follows: (1) to assess the extent to which a cohort of consumers, intervention researchers ⁄ clinicians, and aetiology ⁄ prevention researchers could identify high-priority questions for CP research; (2) to determine if consensus for the priorities in CP research could be established by each group; and (3) to identify the extent to which consumers and professionals have similar consensus priorities for research. METHOD Design This study used the well-established Delphi survey, which involves asking experts a recurring progression of questions through a series of questionnaires.7–9 It is a way of structuring a group communication between experts, where individual participants give feedback that contributes to emerging consensus.10 Delphi surveys eliminate potential sources of conflict experienced in committees and panels9 because they are anonymous and they provide the opportunity to revise individual views in response to group trends.9 The Delphi method has been used to develop research priorities in many areas of health including midwifery, emergency and critical care nursing, and for general practitioners. We selected it because it is known to be effective when (1) consensus is sought in an area where none previously existed, (2) the research problem does not lend itself to precise analytical approaches but can be illuminated by subjective collective judgments, (3) the study participants have diverse backgrounds in their experience and expertize and therefore consensus cannot easily be reached, (4) more research participants are needed than can effectively interact face-to-face, and (5) frequent meetings of all participants are not feasible.2 All these indictors were true for CP, where input was sought from a wide variety of Cerebral Palsy Delphi Survey Sarah McIntyre et al. 3 disciplines across the world and from consumers. The consensus-building nature of the Delphi technique combines the rigor of traditional surveys and the collaborative effect of focus groups.8 In this study a three-round survey strategy was used, because additional rounds produce minimal change in opinion.11 The overarching process is summarized in Figure 1. The first step was systematically (literature Investigators conduct a comprehensive literature review to (a) identify literature generated research questions; and (b) identify experts to invite to participate Consumers Intervention Aetiology/ Prevention n=50 invited n=180 invited n=80 invited Round I surveys emailed/sent (and 1 reminder sent) to identified experts requesting: (a) participation; (b) demographic data; and (c) identification of 3 areas that need to be researched for cerebral palsy. n=20 replied 38% n=76 replied 42% n=31 replied 39% Research problems identified and returned by participants. Investigators review research problems submitted and synthesize these into researchable questions. Questions added to the literature generated questions (bar consumer survey). 140 problems became 50 questions 482 problems became 74 questions 200 problems became 166 questions n=20 replied 100% n=45 replied 60% n=19 replied 61% 22 questions high consensus 16 questions high consensus 3 questions high consensus n=19 replied 95% n=32 replied 71% n=18 replied 95% Additional 1 question high consensus Additional 7 questions high consensus Additional 7 questions high consensus 23 questions high consensus 23 questions high consensus 10 questions high consensus* Round II survey emailed/sent. Includes all questions proposed by participants and published literature. Participants asked to rate the questions by priority using the 7-point scale. 1 = very low priority and 7 = very high priority Median responses and inter-quartile ranges to round II questions calculated. All questions with median of 6 or more with an interquartile range of 1 or less were considered to have reached high priority and placed on priority list. Questions with consensus low and low median priority discarded. Round III survey emailed/sent. Included refined question list with only questions that were a priority but had not yet reached consensus. Participants asked to rate these nonconsensus questions using the same 7-point priority scale. All questions that reached high priority consensus (median of 6 or more with an inter-quartile range of 1 or less) were placed on final priority list. Questions with consenus low priority discarded. Research priorities listed in rank order by mean scores. * An extra 23 questions kept for aetiology that had median of 6 and interquartile 1-2 Figure 1: Delphi survey process and analysis 4 Developmental Medicine & Child Neurology 2009 review) and subjectively (round I survey with openended questions) to identify topic areas that were considered to be essential. All topic areas identified in both the literature review and the round I survey were included in round II. The second step involved testing consensus using a quasi-experimental design, to verify the topics agreed to be important. The third step was to devise three lists of agreed priorities for CP research and to identify themes from the perspectives of (1) consumers, (2) intervention researchers ⁄ clinicians, and (3) aetiology ⁄ prevention researchers.11 The final step was to analyse links between the consumers’ and professionals’ themes and lists of agreed priorities. Ethics Approval for this study was granted by The Spastic Centre of New South Wales Human Research Ethics Committee (HREC EC00402), which is a recognized committee of the National Health and Medical Research Council, Australia. Participants A sampling frame consisting of 310 potential participants was identified through purposive sampling. (1) Consumers who had attended research information sessions provided by the first author over the preceding year, or who had made an enquiry to the research team, were approached. This identified consumers who had a high research interest, to maximize participation and minimize drop out over the three surveys. Gross Motor Function Classification System (GMFCS) levels of adults with CP who participated were not all available. Children of parents who participated had GMFCS levels ranging from I to V. (2) Potential participants for the intervention survey were identified as those who had multiple publications in CP research or who were clinicians in positions of leadership throughout Australia. (3) Potential participants for the aetiology ⁄ prevention survey were identified as those who had multiple publications in CP aetiology ⁄ prevention research. Analysis In the analysis of round I, identified research areas were reviewed and developed into mutually exclusive research questions. Analysis of surveys in rounds II and III used descriptive statistics. Median scores and interquartile ranges (IQRs) were calculated for the groups’ responses to each question because the seven-point Likert scale data was ordinal.9 Responses where the median was 6.00 (high priority) with an IQR of 1.00 were considered important research ques- tions that had reached consensus. This cut-off point was chosen because more than 75% of the group rated the priority as higher than 5.00 (fairly high priority). Final rankings at the completion of round III were assigned using mean scores. Within this study, consensus was considered to have two key elements, stability and convergence. Stability was the consistency of responses across rounds II and III; convergence was the degree of agreement achieved reflected in descriptive statistics.8 At completion of quantitative analysis, the agreed high priorities were categorized into major and minor themes for each of the three surveys. Finally, each question in the consumer survey was compared and contrasted with each question in both the intervention and aetiology ⁄ prevention surveys, to identify their level of ‘match’. Four categories were developed: (1) close match – the chosen wording was exact or almost exact; (2) similar intent – the content was the same but worded differently; (3) similar focus, different approach – general outcome identified as the same but a different approach identified; (4) nothing similar found; and (5) not applicable – not expected that this group would identify this research question as a priority to them. RESULTS Round I (1) Consumers. Of 50 surveys sent, 20 participants replied, yielding an eligibility fraction for the study of 38%. All participants were from New South Wales, Australia (Table SI, supporting information published online). (2) Intervention researchers ⁄ clinicians. Of 180 surveys sent, 76 participants replied, yielding an eligibility fraction for the study of 42%. The participants were from a diverse range of medical and allied health backgrounds (Table SI). Participants were from Australasia (n=68, 89.5%), North America (n=4, 5.3%), and Europe (n=4, 5.3%). (3) Aetiology ⁄ prevention researchers. Of 80 surveys sent, 31 participants replied, yielding an eligibility fraction for the study of 39%. The participants were from a diverse range of professional backgrounds that commonly research the aetiology of CP (Table SI, supporting information published online). Participants were from Australasia (n=17, 55%), North America (n=5, 16%), and Europe (n=9, 29%). The round I questionnaire asked participants to list three problem areas associated with CP that might be addressed by research. In parallel, the investigators conducted a literature review of research priorities in CP. For the intervention and aetiology ⁄ prevention surveys, the participants’ data on research topics was combined with research questions identified from literature. Eight hundred and twenty-two research questions, topics, and ideas Cerebral Palsy Delphi Survey Sarah McIntyre et al. 5 were generated. Two investigators with expertize in CP research and content analysis reviewed each research question, topic, or idea using the grounded theory approach. Through a process of content analysis to the level of open coding, the items were categorized into themes.12 Reliability was excellent, with 97% agreement for assignment to topic themes.8 This process allowed the initial 822 responses to be reduced to 290 mutually exclusive research areas. The topics were reworded into the format of research questions for use in the round II surveys.2 The consumer survey contained 50 items, all generated by consumers, with no additional literature-based questions included. The intervention survey contained 74 questions and the aetiology ⁄ prevention survey contained 166 questions (Fig. 1). Round II The round II questionnaire was sent to all participants in round I. It was returned by 20 consumers, 45 intervention researchers ⁄ clinicians, and 19 aetiology ⁄ prevention researchers, yielding response rates of 100%, 60%, and 61% respectively. Participants rated the perceived priority of each of the research questions using a seven-point Likert scale (1, very low priority; 7, very high priority). (1) Consumers. (a) Twenty-two research questions reached a consensus high priority and these were added immediately to the final priority list. (b) No questions reached a consensus low priority and therefore none were discarded. (c) Twenty-eight questions were overall rated high (i.e. median greater than 5) but had not reached consensus (i.e. IQR greater than 1). (2) Intervention researchers ⁄ clinicians. (a) Sixteen research questions reached a consensus high priority. (b) Twenty-two questions reached a consensus low priority and were discarded. (c) Thirty-six questions were rated high overall. (3) Aetiology ⁄ prevention researchers. (a) Three research questions reached a consensus high priority. (b) Seventythree questions reached a consensus low priority and were discarded. (c) Ninety questions were rated high priority overall (Fig. 1). Round III The round III questionnaire was sent to all round II participants and returned by 19 consumers, 32 intervention researchers ⁄ clinicians, and 18 aetiology ⁄ prevention researchers, yielding response rates of 95%, 71%, and 95% respectively. Round III only included items that were considered a priority but had not yet reached consensus. The questionnaire also provided feedback on the round II group median 6 Developmental Medicine & Child Neurology 2009 response for these research questions.2 This enabled respondents to reflect on colleagues’ scores, as well as their own, to help develop consensus. (1) Consumers. One additional question reached consensus high priority. The final list included 23 high-priority research questions. Questions were ranked in order of mean scores, and categorized into three major themes: (a) prevention and cure; (b) quality of life and community participation; and (c) service provision and intervention, with minor themes in each (Table I). (2) Intervention researchers ⁄ clinicians. Seven additional research questions reached consensus high priority. The final list included 23 research questions. Questions were ranked and categorized into two major themes: (a) effective outcomes; and (b) effective research and services, with minor themes in each (Table SII, supporting information published online). (3) Aetiology ⁄ prevention researchers. Seven additional research questions reached consensus high priority. The final list included 10 research questions. Owing to the low numbers of high-priority consensus questions, it was decided to report on a further 23 questions that were agreed to be a high priority but did not reach the consensus definition of IQR=1 (Table SIII, supporting information published online). Research questions on the priority list were ranked and categorized into six major themes: (a) infection and inflammation; (b) gestation; (c) haematology; (d) neuroregeneration; (e) research tools; and (f) genetics. When comparing the consumer priority list with the professionals’ priority lists there was nothing similar for 11 of 23 questions (48%), a similar focus but different approach identified for 3 of 23 questions (13%), and a similar intent or close match for 9 of 23 questions (39%). DISCUSSION All of the study’s objectives were answered by the findings. The first objective was to assess the extent to which a population of consumers, intervention researchers ⁄ clinicians, and aetiology ⁄ prevention researchers could identify high-priority areas of concern about CP research needs. The results of this study demonstrate that each group identified a wide range and large number of research questions needing answers. The second objective was to establish if consensus for priorities in CP research could be established by each group. Although 23 research questions were agreed as high priorities for consumers and intervention researchers ⁄ clinicians, a significantly lower number of questions (n=10) reached consensus in the aetiology ⁄ prevention survey. This was not surprising given (1) there are multiple pathways to CP, (2) many specialties are needed to research each pathway, and (3) it is not expected that any one pathway will be the dominant cause. We therefore believed it was valid and imperative to include all aetiology ⁄ prevention questions that were agreed to be a high priority (n=33, IQR=2) but did not reach the consensus definition of IQR=1. The third objective was to identify the extent to which consumers and combined professionals (intervention researchers ⁄ clinicians plus aetiology ⁄ prevention researchers) have similar areas of concern and consensus priorities for research. When comparing the responses of the two groups, there was only one priority that overlapped: focusing on the need for CP registers. When comparing the consumers’ results with those of the combined professionals, 50% of the questions had overlap (Table I). There were four areas identified by consumers that did not appear in the results of either groups of professionals: the relationship between CP and poverty, access in the community, effectiveness of alternative therapies, and pain management. There were several significant findings when analysing the consumers’ results on their own and in comparison with the professionals’ results. Consensus was reached for 22 of the 23 questions in round II, suggesting a high level of stability between surveys for this group. The intervention and aetiology ⁄ prevention survey had a slightly lower degree of stability. Convergence was also highest for consumers as the range of scores for all questions was lowest in this group. The aetiology ⁄ prevention survey had several questions with the full range of possible answers, suggesting low convergence. Consumers ranked preventing CP as their highest priority for research and were the only group to identify exploring the therapeutic impact of stem cells. This particular group of consumers provided a balanced continuum of priorities, ranging from prevention to cure and effective interventions across the lifespan. No literature-based questions were used in the consumer survey, to keep ideas purely as consumers’ points of view. Yet, the only additional themes that appeared in the intervention survey that did not appear in the consumer survey were ‘measurement and methodologies’ and ‘relationships’ (Table SII). It was not expected that consumers would consider the research tools required to answer their questions. Relationships were ranked highly but did not reach consensus, so were not reported in the final consumers’ results. Half of the consumer-generated questions were reflected in the professionals’ priority questions. Important lessons can be learnt from close examination of consumers’ priorities that were not identified by professionals. Pain is an important focus for consumers; so too is the effectiveness of individual interventions including alternative therapies, physiotherapy, and parent education. The efficiency and effectiveness of service models, improving access, and understanding the complex relationship between CP and poverty were consensus high priorities. Consumers were interested in policies at a societal level that may improve their quality of life, whereas professionals were still focused on health interventions aimed at improvements in families’ quality of life. The potential limitations of this study are known weaknesses of the Delphi technique and include the subjective process used for defining expert panellists for the sampling frame, the representativeness of the panel assembled, and the panellists’ ability to remain impartial in light of others’ views when rating items on multiple rounds. Policy makers and administrators were included as participants, but not analysed as separate groups, and ‘society at large’ was not included at all. The Delphi technique is also limited by whether the anonymous nature influences accountability and response rates.2 The consumer survey was limited by a small sample size. However, those who participated were highly involved, and response rates were higher than the other surveys. Small numbers also meant that multivariate statistics could not be used to identify whether GMFCS levels predict type of research questions seen as a high priority by consumers. Consensus, however, was highest for consumers; this suggested that the consumers involved considered the full range of disability in CP when prioritizing research. The strengths of this study included acceptable response rates for rounds II and III, ranging from 60 to 100%,13 and the sample being both multidisciplinary and international, so increasing the likelihood that the findings were representative of those who research CP. The most important strength of the study was that the consumers in this study were equal members on the expert panel. The process of documenting research priorities in CP is critical to building the knowledge base for best-practice intervention. These findings provide direction for future CP research based on the consensus views of consumers and internationally renowned researchers and clinicians. The quest for answers to the research questions identified by Delphi panellists is both urgent and imperative.2 It is acknowledged that priorities for research change as evidence builds to answer the questions. Phase II of this project will be to develop a web portal. With international collaboration, outcomes of research will be added to it, and unanswered questions will become the next priorities. SOURCES OF SUPPORT This study was funded solely by in-kind contributions of staff salary time from the Cerebral Palsy Institute, which is supported by the Cerebral Palsy Foundation. Cerebral Palsy Delphi Survey Sarah McIntyre et al. 7 SUPPORTING INFORMATION Additional supporting information may be found in the online version of this article: Table SI: Participants (one person in this profession was predominantly working in policya or seniorb management ⁄ administration at the time of the study). Table SII: High-priority questions for intervention researchers and clinicians. Table SIII: High-priority questions for aetiology ⁄ prevention researchers. This material is available as part of the online article from http://dx.doi.org/10.1111/j.1469-8749.2009.03358.x (this will link you directly to the article). Please note: Wiley-Blackwell are not responsible for the content or functionality of any supporting materials supplied by the authors. Any queries (other than missing material) should be directed to the corresponding author for the article. REFERENCES 1. Blair E, Watson L. The epidemiology of cerebral palsy. Semin Fetal Neonatal Med 2006; 11: 117–25. 2. Bayley EW, MacLean SL, Desy P, McMahon M. ENA’s Delphi study on national research priorities for emergency nurses in the United States. J Emerg Nurs 2004; 30: 12–21. 3. Ham C. Priority setting for health. In: Janovsky K, editor. Health policy and systems development. an agenda for research. Geneva: World Health Organization, 1995, 25–42. 8 Developmental Medicine & Child Neurology 2009 4. Oliver S, Clarke-Jones L, Rees R, et al. Involving consumers in research and development agenda setting for the NHS: developing an evidence-based approach. Health Technol Assess 2004; 8: 15. 5. Vella K, Goldfrad C, Rowan K, Bion J, Black N. Use of consensus development to establish national research priorities in critical care. BMJ 2000; 320: 976–80. 6. Jones R, Lamont T, Haines A. Setting priorities for research and development in the NHS: a case study on the interface between primary and secondary care. BMJ 1995; 311: 1076–80. 7. Allen J, Dyas J, Jones M. Building consensus in health care: a guide to using the nominal group technique. Br J Community Nurs 2004; 9: 110–14. 8. O’Hara L, Souza LHD, Ide L. A Delphi study of self-care in a community population of people with multiple sclerosis. Clin Rehabil 2000; 14: 62–71. 9. Daly J, Chang EML, Bell PF. Clinical nursing research priorities: a pilot study. J Adv Nurs 1996; 23: 145–51. 10. Fenwick J, Butt J, Downie J, Moterosso L, Wood J. Priorities for midwifery research in Perth, Western Australia: a Delphi study. Int J Nurs Pract 2006; 12: 78–93. 11. Okoli C, Pawloswki SD. The Delphi method as a research tool: an example, design considerations and applications. Inf Manage 2004; 42: 15–29. 12. Strauss A, Corbin J. Basics of qualitative research. California: Sage, 1990. 13. Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs 2000; 32: 1008–15.