Blogs
New UK EQ-5D-5L valuation study blog
Data collection completed: Steering Group has signed off on the data quality
We are pleased to announce that data collection for the new UK EQ-5D-5L valuation study was completed on September 18, 2023. For this study, 1200 subjects were recruited in the UK, who were interviewed by videoconference or face-to-face. On November 14, 2023 a Steering Group meeting took place where reports on the complete data set were reviewed extensively. The Steering Group concluded that the data quality is acceptable for modelling the EQ-5D-5L value set for the UK. The Steering Group congratulated Professor Donna Rowen and the study team with achieving this milestone.
Data collection was in accordance with the published study protocol. During the study, data collection was paused three times for scheduled interim analyses and Steering Group meetings. These took place at 20%, 40% and 60% of the data collection, as specified in the Study Governance document. At these interim analysis meetings the Steering Group discussed interviewer performance, data quality and representativeness of the participants (according to age, sex, ethnicity, socioeconomic status, and proportional representation across England, Scotland, Wales and Northern Ireland). At all timepoints these were considered to be acceptable, so no changes were made to the study protocol.
The Steering Group met on November 14, 2023 to consider reports on the complete data set from the independent Quality Control Team, the EQ-VT Support team and the study team. The Steering Group reviewed and discussed detailed reports on interviewer compliance with the study protocol, sample characteristics and sample representativeness. Assessments of the preference data, elicited using the time trade-off technique, included the distribution of time trade-off responses, logical inconsistencies where a better health state is valued worse, proportions of the time trade-off responses at certain easy-to-achieve values, participant understanding and engagement, amongst others (please see the study protocol for further details).
The Steering Group unanimously concluded that the complete dataset was of acceptable quality and addressed the concerns raised during the quality assurance of the Devlin et al. (2017) value set for England (see the quality assurance report by Hernandez Alava et al. here and the rebuttal by van Hout et al. here). Therefore, the Steering Group signed off on the final dataset. The study team will now focus on modelling the study data, in order to estimate the UK EQ-5D-5L value set.
Data collection has successfully started
After successfully completing a pilot phase of interviewer training and data collection at the end of 2022, we are pleased to announce that the first participant in the new UK EQ-5D-5L valuation study was interviewed on 29 January 2023. Interviewer data will be collected online and face-to-face, to allow as many people to participate as possible.
To date approximately 125 interviews of the 1200 planned interviews have been collected in the valuation study and the expected end of data collection is end of summer 2023. The first interim analysis for in-depth checking of data quality and modelling results by the independent Quality Control team is pre-scheduled for Mid-March. This important study is being led by Professor Donna Rowen and is supported by the EuroQol Research Foundation.
Study team co-investigators updated
The research team for the UK EQ-5D-5L valuation study has been updated. The lead investigator is Donna Rowen (School of Health and Related Research, University of Sheffield) and co-investigators are:
- Nathan Bray (Centre for Health Economics and Medicines Evaluation, Bangor University)
- Jill Carlton (School of Health and Related Research, University of Sheffield)
- Louise Longworth (PHMR, London)
- David Meads (Academic Unit of Health Economics, Leeds Institute for Health Sciences, University of Leeds)
- Clara Mukuria (School of Health and Related Research, University of Sheffield)
- Ciaran O'Neill (Centre for Public Health, Queens University Belfast)
- Yaling Yang (Nuffield Department of Primary Care Health Sciences, University of Oxford)
This team has been carefully selected by the project’s Steering Group and will bring significant experience and expertise to the valuation study.
Methodological preparatory work for the UK EQ-5D-5L valuation study
Following the emergence of the COVID-19 pandemic, the Steering Group discussed the feasibility of undertaking the EQ-5D-5L valuation study for the United Kingdom during the COVID-19 pandemic. The question was whether the EQ-VTv2 TTO interviews could be conducted remotely using online videoconferencing software (such as Zoom or Microsoft Teams), and whether the results would be comparable with regular face-to-face interviews. Available evidence at the time suggested that experienced interviewers can do EQ-VT interviews face-to-face or remotely, with comparable results. However, none of these studies had a dedicated design to compare face-to-face versus videoconferencing in a controlled way. It was therefore decided to conduct a study to formally compare the feasibility, acceptability and equivalence of these two interviewing methods to collect TTO data (hereafter, ‘the equivalence study’), before starting the new UK valuation study. Following a delay to the start of the equivalence study, due to another lockdown in the UK, the Steering Group agreed to a proposal to run a parallel equivalence study in Australia or New Zealand, as the COVID-19 situation was different in that part of the world. Both studies were funded by EuroQol Research Foundation.
While the equivalence studies were starting, the study team and Steering Group focussed on ensuring that the protocol for the new study would address the concerns raised during the quality assurance of the Devlin et al. (2018) value set (these reviews are available on the NICE website, comprising an and reports from 4 independent experts). To this end the study team compiled a checklist summarizing the criticisms of the Devlin et al. value set and how the new study will address these criticisms - and provided rationale for any design elements that were previously criticised but that have not been changed in the new study. The statistical analysis plan was also informed by a review of published EQ-5D-5L value sets by Rowen et al. (2022).
In early 2022 Donna Rowen presented the results of the UK equivalence study. The results demonstrated that video and in-person TTO interviews are feasible and acceptable. Both interviewing modes generated good-quality data. A notable finding was that the characteristics of people preferring video interviews differed significantly from those preferring in-person interviews. Therefore, both modes will be used in the UK valuation study, with respondents being able to choose their preferred interviewing mode, to make the study more inclusive and maximise sample .
Finally, in line with Step 30 of the study governance document, the QC team has performed a
formal quality control (QC) of the study protocol and statistical analysis plan. QC findings were shared with the study team and the Steering Group, who provided their own feedback. Updates of these documents were discussed in the Steering Group. The study protocol and analysis plan were reviewed and approved for funding by EuroQol’s Executive Committee in June 2022. The Steering Group signed off on the study protocol and the statistical analysis plan in July 2022. The study protocol, including explanation of how the protocol has been designed to resolve quality assurance concerns with a previous English valuation, is being submitted for journal publication.
Quality Control team appointed
In line with the study governance document, the Steering Group has appointed the following four scientists as members of the Quality Control (QC) team:
- Michał Jakubczyk (Division of Decision Analysis and Support, Institute of Econometrics, SGH Warsaw School of Economics , Poland)
- John Mullahy (Univ. of Wisconsin-Madison, Dept. of Population Health Sciences, Madison, WI, USA)
- Mark Oppe, QC team Chair (Maths in Health)
- Juan Manuel Ramos-Goñi (Maths in Health)
The QC team will be independent from the study team, EuroQol’s EQ-VT support team and the Steering Group. This team is responsible for reviewing and critically assessing the work of the study team.
Data collection to start in October 2022
We are delighted to announce the start date of the new EQ-5D-5L valuation study for the United Kingdom. The study proposal and statistical analysis plan were approved for funding by EuroQol’s Executive Committee in June and have also now been signed off by the study’s Steering Group. The study team aim to start sample recruitment in October with the goal of undertaking 1,200 interviews in a representative sample of people living in England, Scotland, Northern Ireland and Wales. Data collection will be undertaken using the cTTO component from the latest version of the international standard valuation study protocol (EQ-VT).
Due to the global COVID-19 pandemic the launch of the new EQ-5D-5L valuation study for the United Kingdom, which had planned to use face-to-face interviews to collect time trade-off (TTO) data, was delayed. We are pleased to announce that the study protocol has now been adapted and tested to ensure that data can be collected safely and reliably in the light of COVID-19.
Below you find a series of updates on the study and the various teams involved.
Full Study Team Appointed
The research team for the new EQ-5D-5L valuation study for the United Kingdom has been finalised. This team will bring significant experience and expertise to the valuation study. They were carefully selected by the project’s Steering Group and come from across the United Kingdom, thereby helping to ensure regional coverage for the study. Donna Rowen from the University of Sheffield was appointed as Principal Investigator.
The lead investigators and their co-investigators are:
- Nathan Bray, Rhiannon Tudor Edwards, Dyfrig Hughes (Centre for Health Economics and Medicines Evaluation, Bangor University) and Deborah Fitzsimmons (Swansea Centre for Health Economics, Swansea University)
- David Meads, Edward Webb, Paul Kind, University of Leeds and John O’Dwyer (Academic Unit of Health Economics, Leeds Institute for Health Sciences, University of Leeds) and Peter Hall (University of Edinburgh)
- Ciaran O’Neill (Centre for Public Health, Queens University Belfast)
- Donna Rowen, Clara Mukuria and John Brazier (School of Health and Related Research, University of Sheffield)
- Koonal Shah and Louise Longworth (PHMR, London)
- Yaling Yang and Stavros Petrou (Nuffield Department of Primary Care Health Sciences, University of Oxford)
The newly appointed research team will start working on the study protocol, supported by the international valuation study protocol (EQ-VT) support team from the EuroQol Research Foundation. Independent Quality Control will be built in at every stage, with reviews taking place at every study milestone. Data collection is expected to begin in early 2021.
COVID-19 is likely to have an impact on the conduct of the study. Researchers of the EuroQol Group are investigating methods for collecting EQ-VT data safely, in close consultation with the Steering Group and the study team.
Full steering group appointed
Several expressions of interest were received for joining the Steering Group of the new UK EQ-5D-5L valuation study. At their meeting of 11MAR2020 the initial members of the Steering Group decided to appoint three academic experts to join the Steering Group:
- Charles Manski, Department of Economics, Northwestern University, Evanston, USA;
- Mark Sculpher, Centre for Health Economics, University of York;
- Anne Spencer, College of Health and Medicine, University of Exeter Medical School, University of Exeter.
The Steering Group now consists of nine members. Listed below you find the other six members:
- Kristina Secnik Boye, Eli Lilly and Company, Indianapolis, USA (EuroQol member);
- Jan Busschbach, Department of Psychiatry, Erasmus University Medical Center Rotterdam, The Netherlands (EuroQol member);
- Daniel Law, Department of Health and Social Care, London;
- Rosie Lovett, National Institute for Health and Care Excellence, Manchester;
- Danny Palnoch, NHS England and NHS Improvement, London;
- Bernhard Slaap, EuroQol Research Foundation, Rotterdam (Steering Group Chair).
The Steering Group is currently reviewing the expressions of interest for principle investigator and site investigator roles in the study team.
Full steering group appointed
Several expressions of interest were received for joining the Steering Group of the new UK EQ-5D-5L valuation study. At their meeting of 11MAR2020 the initial members of the Steering Group decided to appoint three academic experts to join the Steering Group:
- Charles Manski, Department of Economics, Northwestern University, Evanston, USA;
- Mark Sculpher, Centre for Health Economics, University of York;
- Anne Spencer, College of Health and Medicine, University of Exeter Medical School, University of Exeter.
The Steering Group now consists of nine members. Listed below you find the other six members:
- Kristina Secnik Boye, Eli Lilly and Company, Indianapolis, USA (EuroQol member);
- Jan Busschbach, Department of Psychiatry, Erasmus University Medical Center Rotterdam, The Netherlands (EuroQol member);
- Daniel Law, Department of Health and Social Care, London;
- Rosie Lovett, National Institute for Health and Care Excellence, Manchester;
- Danny Palnoch, NHS England and NHS Improvement, London;
- Bernhard Slaap, EuroQol Research Foundation, Rotterdam (Steering Group Chair).
The Steering Group is currently reviewing the expressions of interest for principle investigator and site investigator roles in the study team.
Call for expression of interest
February 12, 2020
On 24 October 2019 EuroQol and NICE announced that a new EQ-5D-5L valuation study will be undertaken in the UK, following NICE’s decision not to use the EQ-5D-5L value set for England (Devlin et al 2018). This new study will be funded and managed by EuroQol. NICE, the Department of Health and Social Care and NHS England will advise on the study. Researchers are hereby invited to express their interest in participating in this new EQ-5D-5L valuation study in the UK.
Features of the new study
The new study will be funded by the EuroQol Research Foundation. The study team will be responsible for writing the study protocol and analysis plan, obtaining ethical approval, collecting the data, modelling the data to produce a value set, and writing publications and communications material. This work will be overseen by a Steering Group, which currently includes representatives from EuroQol, NICE, the Department of Health and Social Care, and NHS England.
The arrangements for study governance are described in a separate document.
Regarding study personnel and funding:
- The study will be undertaken by a Research Consortium (the “study team”) led by a principal investigator (PI).
- Researchers interested in applying for the study should be knowledgeable regarding the EQ-5D and have significant experience in managing field-work data collection and modelling valuation data.
- Once the study team has been appointed the EuroQol EQ-VT support team will work with the study team to write the study protocol and analysis plan. They will also help the study team to come up with a realistic study budget and timeline estimates. The EuroQol budget guidelines will be used for the study. Funding decisions will be made by the Executive Committee of the EuroQol Group.
- Each participating institute in the Research Consortium is eligible to have at least one author contributing to the value set publication. Final decisions on authorship and authorship ordering will rest with the Steering Group, in consultation with the PI and will depend on contribution to the project. All other individual consortium members will be listed in the article by-line.
The data collection is expected to begin in late 2020 and the value set is expected to be created by late 2021.
Study design
The Steering Group has already agreed on several key aspects of the study design:
- The time trade-off (TTO) module of the latest version of the international standard valuation study protocol (EQ-VT v2.1) will be used. The latest protocol has been shown to be effective in controlling interviewer effects and has been used in at least seventeen countries.
- The fieldwork will be conducted by trained members of the study team. A small interview team will be used, in order to minimise the impact of interviewer effects.
- The EuroQol EQ-VT support team will provide support to the study team to monitor interview quality, as is standard in EQ-VT v2.1.
- Subject recruitment will occur in England, Wales, Scotland and Northern Ireland. Recruitment will not be determined by postcode, but by using quota sampling. The quotas will be set, for example, by age, gender, socioeconomic status, location and any other characteristics determined important by the study team.
- Only time trade-off (TTO) data will be collected. The rationale is that TTO-only models are more readily interpretable than hybrid models (which combine TTO and discrete-choice experiment data).
- Independent Quality Control (QC) will be built in at every stage, with a QC review of at least 4 study milestones: study protocol (including data modelling plan), interim analyses, the final data set, and the final value set.
The Steering Group has not yet agreed the sample size and coverage (that is, the selection of health states to be valued). These aspects of study design were commented on during quality assurance and expert review of the first English 5L valuation study. The study team may propose to use the standard EuroQol sample size and coverage, or to increase the sample size and coverage.
Call for expression of interest
We invite expressions of interest from researchers to participate in the new EQ-5D-5L valuation study for the UK. Broadly, there are three ways for researchers to participate:
- Become the principal investigator. Researchers in the UK can apply to become PI, who will lead a team within his/her institution and will oversee the work of collaborating centres in the Consortium.
- Become the site investigator of a collaborating centre. Ideally around 4 centres in the UK will participate; the site investigator of a collaborating centre will need to make scientific staff available for the fieldwork, and/or the analysis and reporting.
- Become a member of the Steering Group. The Steering Group has a formal decision-making role and will provide advice and guidance to the study team. Their involvement will encompass the study period and beyond, to include discussion around implementation of the value set with policy-makers in the UK. Currently, representatives from NICE, NHS England, the Department of Health and Social Care and EuroQol are on the Steering Group. We would like to add two members to the Steering Group who have a strong background in health-state valuation studies and/or valuation-data modelling. The Steering Group will meet in person several times over the course of the study, with further input via teleconferences and email. Membership of the Steering Group is open to researchers from the UK and abroad.
Please note that researchers do not have to be members of the EuroQol Group to participate in this study.
Selection process
If you are interested in participating in the new UK EQ-5D-5L valuation study please download the application form here. After completion you can send the form with attachments to SteeringGroup@euroqol.org.
All applications received before the deadline will be discussed by the existing Steering Group, which will first appoint the additional two Steering Group members. The full Steering Group will then appoint the PI and the collaborating centres. Thus, applicants need to choose either to apply to be on the Steering Group or to be PI/chief investigator of a collaborating centre – they cannot apply for both.
Timings
The deadline for applications is March 4th 2020.
Steering group members will need to be available for a short telephone call between 16 and 20 March and to have time to shortlist applications between 20 March and 3 April. Further meetings will be arranged in due course.
Contact details
If you have any comments or questions, or when you want to apply for a role in the study, please send an email to: SteeringGroup@euroqol.org
Last update: Dec 7, 2023