TY - JOUR

T1 - Appropriate design and reporting of superiority, equivalence and non-inferiority clinical trials incorporating a benefit risk assessment: the BRAINS study including expert workshop

AU - Totton, Nikki

AU - Julious, Steven

AU - Coates, Elizabeth

AU - Hughes, Dyfrig

AU - Cook, Jonathan

AU - Biggs, Katie

AU - Hewitt, Catherine

AU - Day, Simon

AU - Cooke, Andrew

N1 - The research reported in this issue of the journal was funded by the HTA programme as project number NIHR129832. The draft report began editorial review in March 2021 and was accepted for publication in November 2021.

PY - 2023/10

Y1 - 2023/10

N2 - Background Randomised controlled trials are designed to assess the superiority, equivalence or non-inferiority of a new health technology, but which trial design should be used is not always obvious in practice. In particular, when using equivalence or non-inferiority designs, multiple outcomes of interest may be important for the success of a trial, despite the fact that usually only a single primary outcome is used to design the trial. Benefit–risk methods are used in the regulatory clinical trial setting to assess multiple outcomes and consider the trade-off of the benefits against the risks, but are not regularly implemented in publicly funded trials.ObjectivesThe aim of the project is to aid the design of clinical trials with multiple outcomes of interest by defining when each trial design is appropriate to use and identifying when to use benefit–risk methods to assess outcome trade-offs (qualitatively or quantitatively) in a publicly funded trial setting.MethodsA range of methods was used to elicit expert opinion to answer the project objectives, including a web-based survey of relevant researchers, a rapid review of current literature and a 2-day consensus workshop of experts (in 2019).ResultsWe created a list of 19 factors to aid researchers in selecting the most appropriate trial design, containing the following overarching sections: population, intervention, comparator, outcomes, feasibility and perspectives. Six key reasons that indicate a benefit–risk method should be considered within a trial were identified: (1) when the success of the trial depends on more than one outcome; (2) when important outcomes within the trial are in competing directions (i.e. a health technology is better for one outcome, but worse for another); (3) to allow patient preferences to be included and directly influence trial results; (4) to provide transparency on subjective recommendations from a trial; (5) to provide consistency in the approach to presenting results from a trial; and (6) to synthesise multiple outcomes into a single metric. Further information was provided to support the use of benefit–risk methods in appropriate circumstances, including the following: methods identified from the review were collated into different groupings and described to aid the selection of a method; potential implementation of methods throughout the trial process were provided and discussed (with examples); and general considerations were described for those using benefit–risk methods. Finally, a checklist of five pieces of information that should be present when reporting benefit–risk methods was defined, with two additional items specifically for reporting the results.ConclusionsThese recommendations will assist research teams in selecting which trial design to use and deciding whether or not a benefit–risk method could be included to ensure research questions are answered appropriately. Additional information is provided to support consistent use and clear reporting of benefit–risk methods in the future. The recommendations can also be used by funding committees to confirm that appropriate considerations of the trial design have been made.LimitationsThis research was limited in scope and should be considered in conjunction with other trial design methodologies to assess appropriateness. In addition, further research is needed to provide concrete information about which benefit–risk methods are best to use in publicly funded trials, along with recommendations that are specific to each method.Study registrationThe rapid review is registered as PROSPERO CRD42019144882.

AB - Background Randomised controlled trials are designed to assess the superiority, equivalence or non-inferiority of a new health technology, but which trial design should be used is not always obvious in practice. In particular, when using equivalence or non-inferiority designs, multiple outcomes of interest may be important for the success of a trial, despite the fact that usually only a single primary outcome is used to design the trial. Benefit–risk methods are used in the regulatory clinical trial setting to assess multiple outcomes and consider the trade-off of the benefits against the risks, but are not regularly implemented in publicly funded trials.ObjectivesThe aim of the project is to aid the design of clinical trials with multiple outcomes of interest by defining when each trial design is appropriate to use and identifying when to use benefit–risk methods to assess outcome trade-offs (qualitatively or quantitatively) in a publicly funded trial setting.MethodsA range of methods was used to elicit expert opinion to answer the project objectives, including a web-based survey of relevant researchers, a rapid review of current literature and a 2-day consensus workshop of experts (in 2019).ResultsWe created a list of 19 factors to aid researchers in selecting the most appropriate trial design, containing the following overarching sections: population, intervention, comparator, outcomes, feasibility and perspectives. Six key reasons that indicate a benefit–risk method should be considered within a trial were identified: (1) when the success of the trial depends on more than one outcome; (2) when important outcomes within the trial are in competing directions (i.e. a health technology is better for one outcome, but worse for another); (3) to allow patient preferences to be included and directly influence trial results; (4) to provide transparency on subjective recommendations from a trial; (5) to provide consistency in the approach to presenting results from a trial; and (6) to synthesise multiple outcomes into a single metric. Further information was provided to support the use of benefit–risk methods in appropriate circumstances, including the following: methods identified from the review were collated into different groupings and described to aid the selection of a method; potential implementation of methods throughout the trial process were provided and discussed (with examples); and general considerations were described for those using benefit–risk methods. Finally, a checklist of five pieces of information that should be present when reporting benefit–risk methods was defined, with two additional items specifically for reporting the results.ConclusionsThese recommendations will assist research teams in selecting which trial design to use and deciding whether or not a benefit–risk method could be included to ensure research questions are answered appropriately. Additional information is provided to support consistent use and clear reporting of benefit–risk methods in the future. The recommendations can also be used by funding committees to confirm that appropriate considerations of the trial design have been made.LimitationsThis research was limited in scope and should be considered in conjunction with other trial design methodologies to assess appropriateness. In addition, further research is needed to provide concrete information about which benefit–risk methods are best to use in publicly funded trials, along with recommendations that are specific to each method.Study registrationThe rapid review is registered as PROSPERO CRD42019144882.

U2 - https://doi.org/10.3310/BHQZ7691

DO - https://doi.org/10.3310/BHQZ7691

M3 - Article

VL - 27

JO - Health Technology Assessment

JF - Health Technology Assessment

SN - 1366-5278

IS - 20

ER -