Parts of this chapter are reproduced from Frost et al.1 © The Author(s) 2019. This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made. The text below includes minor additions and formatting changes to the original text.
Parts of this chapter are also reproduced from the published statistical analysis plan by MacNeill and Drake.16 This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: https://creativecommons.org/licenses/by/4.0/. The text below includes minor additions and formatting changes to the original text.
Trial design
The TRIUMPH trial was a multicentre, pragmatic, two-arm cluster RCT of a care pathway based on a standardised and manualised care intervention (TRIUMPH intervention arm) and usual care (comparator arm) for men with LUTS. The trial was conducted in 30 general practice sites within nine Clinical Commissioning Groups (CCGs) across the West of England and Wessex Clinical Research Network (CRN) regions in the UK, recruiting patients from June 2018 to August 2019. Sites were randomised to the intervention or comparator arm, with men with bothersome LUTS consented from these sites. The main aim of the trial was to determine whether or not the TRIUMPH intervention arm achieves superior symptomatic outcome, compared with the usual-care arm, for male LUTS, with a primary outcome of overall IPSS measured 12 months after consent.
The trial design included an internal pilot recruitment phase of 4 months’ duration, primarily to verify that recruitment was possible before progression to the main phase of the trial. Targets for progression to the main phase of the trial were as follows:
- The number of practices agreeing to take part was at least 18 (75%) by the end of month 6.
- The number of patients recruited was at least 120 by the end of month 4 of the recruitment phase.
Ethics approval and research governance
Approval from the National Research Ethics Service Committee North West – Preston (reference number 18/NW/0135) was received on 11 April 2018 and applied to all NHS sites that took part in the trial.
The trial is registered at the International Standard Randomised Controlled Trial Number registry with the reference ISRCTN11669964.
All participants provided their written, informed consent to participation before entering the trial. Participants consented by post, following GP screening of their medical notes and a screening call by CRN nurses/clinical practitioners.
All serious adverse events (SAEs) were recorded; the sponsor and Research Ethics Committee were notified within 15 days of any SAEs categorised as unexpected and related. General practices were responsible for reporting SAEs for their trial participants during the course of the trial; however, participants were also asked to self-report any inpatient stays in their follow-up questionnaires, which prompted GP review. All other adverse events not deemed serious were collected from participant electronic medical records (EMRs) at the end of participants’ 12-month involvement in the trial, as part of the secondary outcomes.
A number of protocol changes were made during the course of the trial, as listed below:
- The Self-Assessment Goal Achievement questionnaire that was originally planned was replaced with the Brief Illness Perception Questionnaire (B-IPQ). The B-IPQ was more relevant to the trial, as the Self-Assessment Goal Achievement questionnaire mentions goals set with the healthcare providers, which was not applicable to the TRIUMPH intervention.
- Qualitative interviews with a small number of men who decided not to take part in the TRIUMPH trial (decliner interviews) were added.
- As well as practice nurses, HCAs were specified as able to deliver the intervention.
- Hypercalcaemia was removed from the exclusion criteria.
- A criterion about a competing primary care LUTS study was added to general practice eligibility requirements.
- ‘Date of LUTS diagnosis’ was removed from the baseline data to be collected, as this date is arbitrary and depends on when the patient chose to seek help regarding his symptoms, and therefore was not considered relevant.
- Specification of an exact figure for the number of eligible patients required by general practices to take part in the trial was removed, as determined by a pre-randomisation practice database search.
The protocol was also updated during the trial to make minor clarifications to trial procedures.
Participants remained in the trial unless they chose to withdraw, or if they were unable to continue. Participants could withdraw fully from the trial or from specific elements without giving a reason. Any data collected up until the point of withdrawal were retained. Participants were informed of this in the patient information leaflet prior to consent.
General practice recruitment and selection
The trial recruited from two centres: West of England and Wessex CRNs. The CRNs invited general practices to express an interest in taking part in the trial. The general practice inclusion and exclusion criteria were as follows:
- inclusion criterion – adequate number of eligible patients, determined by pre-randomisation practice database search (to achieve site target recruitment of 35 patients)
- exclusion criterion – unable to provide adequate treatment room space and availability for trial or practice nurse/HCA to complete HCP training and baseline visits.
However, to achieve a balanced range of practices, the following factors were also considered in practice selection:
- number of potentially eligible patients, on conduct of a preliminary database search
- patient list size
- deprivation score (calculated using the general practice postcode)
- preference for intervention delivery (practice staff or trial research nurses).
The sites selected to take part in the trial underwent site initiation training. An internal pilot phase was conducted with eight initial sites over a period of 4 months before the main phase of the trial, for which a further 22 sites were recruited. In total, 32 general practices were recruited within nine CCGs across the West of England and Wessex CRN regions in the UK. These constituted 30 sites, owing to a collaboration of three practices operating a hub-and-spoke model, sharing nurse resource, and therefore randomised as a single site for the trial.
Participants
Participant population
The TRIUMPH trial was a pragmatic trial, comprising adult men who considered themselves to have bothersome LUTS and who presented to primary care within the preceding 5 years with at least one symptom. Only men already known to have LUTS (prevalent cases) were screened for inclusion in the trial. Screening was undertaken once by each site before randomisation, so men newly presenting with LUTS (incident cases) after site randomisation were not included. Detailed inclusion and exclusion criteria are provided in Table 1.
| Inclusion criterion |
| Adult men above the age of 18 years old who have bothersome LUTS |
| Exclusion criteria |
| Lack of capacity to consentUnable to pass urine without a catheter (indwelling or intermittent catheterisation)Relevant neurological disease or referralUndergoing urological testing for LUTSCurrently being treated for prostate or bladder cancerPrevious prostate surgeryPoorly controlled diabetes mellitusRecently referred or currently under urology reviewVisible haematuriaUnable to complete assessments in English |
Patient screening and invitation
The process of patient invitation and screening is detailed below:
- General practices conducted a single database search to identify potentially eligible patients. The database search was developed specifically for the trial, based on the trial inclusion and exclusion criteria (see Appendix 1, Table 38), for both EMIS Web (EMIS Health, Leeds, UK) and SystmOne (The Phoenix Partnership, Leeds, UK) patient administration systems used in primary care sites in both CRN regions.
- The patient list identified by the search was manually screened by GPs at the site against patients’ EMRs using the eligibility criteria listed (see Appendix 1, Table 38), including criteria that could not be fully included in the search, such as lack of capacity to consent, and referral to or review by secondary care.
- A de-identified screening log populated with eligibility codes for all patients identified from the search was sent to the central trial team.
- Invitation letters, with patient information leaflets and expression of interest (EOI) forms, were mailed out to eligible patients by practices using an approved third party [Docmail® (Docmail Ltd, Radstock, UK), a secure service that automates sending invitation letters to potential participants]. A single mail-out was conducted by each site, before notification of their randomisation, to avoid any bias in patient selection.
- Interested patients completed their EOI forms online or returned paper copies by post. Participants could also decline to take part on their returned EOI form, and indicate whether or not they would be willing to take part in a decliner interview for the qualitative element of the trial.
- Clinical Research Network nurses or clinical practitioners trained by the trial team telephoned interested patients. These calls were conducted while masked to the allocation of the practice, and therefore the patient, to avoid any bias. Calls were conducted to confirm eligibility, particularly the subjective criterion of whether or not the patient’s LUTS were bothersome to him; to ensure patient understanding of the trial; to answer any questions; and to confirm willingness to participate.
Following a review of the pilot phase figures, the key changes that were made to the conduct of the trial for the main phase were an increase in the maximum number of patients invited by a single site from 150 to 220, and confirmation that 30 sites would be required to maintain the trial power calculation in the light of variation in the number of patients recruited per site. The decision was also taken to conduct only a single invitation mail-out from each site, rather than inviting additional patients in a second mail-out to achieve site targets as necessary, to avoid introducing any bias post randomisation. Although screening of all patients for both mail-outs would have been conducted before randomisation, rescreening would have been required to check patient status before a later second mail-out, when sites would have been aware of their allocation. Details of the processes for the two phases were as follows:
- Pilot phase. During the pilot phase of the trial, sites manually screened up to 325 potentially eligible patients identified from their database search, in order of NHS number. The maximum number of patients for an individual site to include in its invitation mail-out was 150; however, the screening allowed for the potential of a second mail-out. For sites with > 150 eligible patients, the central trial team randomly identified 150 patients for invitation.
- Main phase. During the main phase of the trial, sites with > 220 eligible patients screened up to this number, in order of NHS number. The maximum number of patients invited to participate in the trial from a single site was 220.
Patient consent
Patients deemed willing and eligible to participate in the trial following their telephone call with the CRN nurse or practitioner were posted a consent form and a questionnaire containing baseline measures specific to trial arm for completion (Table 2). All patients received the same consent forms and questionnaires, but those in the intervention arm also received a bladder diary to be completed before their face-to-face visit.
| Schedule | Screening (pre consent) | Trial period | ||||||
|---|---|---|---|---|---|---|---|---|
| Patient enrolment | Post enrolment | |||||||
| Baseline | Visit 1 | 1 week | 4 weeks | 12 weeks | 6 months | 12 months | ||
| Practice eligibility screen | ✗ | |||||||
| Practice allocation | ✗ | |||||||
| CRN eligibility screen | ✗ | |||||||
| Informed consent | ✗ | |||||||
| Interventions | ||||||||
| Usual care | •—————————————————————————————————————• | |||||||
| HCP-delivered booklet | ✗a | |||||||
| Follow-up nurse contacts | ✗a | ✗a | ✗a | |||||
| Assessments | ||||||||
| Case report form | ✗a | ✗a | ✗a | ✗a | ✗ | |||
| ICIQ bladder diary | ✗a | |||||||
| IPSS | ✗ | ✗ | ✗ | |||||
| ICIQ-UI-SF | ✗ | ✗ | ✗ | |||||
| B-IPQ | ✗ | ✗ | ✗ | |||||
| EQ-5D-5L | ✗ | ✗ | ✗ | |||||
| Interviews | •—————————————————————————————————————• | |||||||
| Resource use via GP EMRs | ✗ | |||||||
For patients in both arms, the return of the completed consent form by post demonstrated explicit consent to participate in the trial. Alongside providing explicit consent to take part in the trial, the men were also asked on the consent form if they were willing to consent to (1) being contacted by a qualitative researcher to undertake an interview and (2) being contacted about other research. Declining to consent to these did not disqualify a man from participating in the main trial.
All men who entered the trial were logged with the central trial office at the University of Bristol and given a unique study number. Each patient’s GP was informed by the central trial team by letter about the patient’s participation in the trial. Sites were encouraged to update their GP EMRs to record participation.
Interventions
The TRIUMPH trial intervention arm
Principle of the TRIUMPH trial intervention
Presentations of LUTS are typically a composite of different symptom combinations. The TRIUMPH trial intervention targeted component symptoms with specific educational information and active management. This was provided in a standardised way in the form of a booklet that patients could read in their own time to encourage take-up of the information. However, the intervention also provided manualised care, with a HCP using basic assessments and discussion with the patient to direct them to the most applicable information in the booklet. The discussion considered their personal circumstances, symptom needs, bothersomeness of these symptoms and impact on quality of life. The TRIUMPH trial intervention arm therefore offered standardised and manualised care according to the symptomatic presentation of the individual participants.
The TRIUMPH trial intervention aimed to address key limitations in the current provision of care to men with LUTS in primary care through the use of symptom scores and bladder diaries to effectively diagnose specific LUTS, the provision of effective written materials, the training of nurses/HCAs in the interpretation of symptom scores and the use of the theory of planned behaviour to support self-management.17
The TRIUMPH trial intervention booklet
The TRIUMPH trial intervention booklet was developed for the trial from the British Association of Urological Surgeons’ patient information sheets, and underwent sequential development in multiple iterations and consultations involving patients, HCPs and health psychologists. The booklet comprises written information and illustrations, and is titled Helping You to Take Control of Your Waterworks [the booklet is available on the project web page: www.journalslibrary.nihr.ac.uk/programmes/hta/169003/#/ (accessed March 2022)]. The sections included are as follows:
- advice on drinks and liquid intake
- advice on controlling an urgent need to urinate
- exercising the muscles between the legs (pelvic floor) to help stop bladder leakage
- advice on emptying the bladder as completely as possible
- advice on getting rid of the last drops
- reducing sleep disturbance caused by needing to urinate.
The booklet is water-resistant and able to lie flat when open, which is useful when potentially used in the bathroom. Pictorial representations were used for clarity and avoid the use of potentially embarrassing images. Sections are tabbed and colour-coded for specific symptoms and advice.
The TRIUMPH trial intervention procedure
The details of the TRIUMPH trial intervention procedure are as follows:
- The intervention was delivered by a trained HCP, either a general practice clinical nurse, a research nurse or a HCA, or a dedicated trial research nurse, depending on site preference.
- The HCP reviewed the patient’s baseline urinary symptoms using their completed IPSS, International Consultation on Incontinence Questionnaire-Urinary Incontinence-Short Form (ICIQ-UI-SF) and International Consultation on Incontinence Questionnaire (ICIQ) bladder diary. Any missing elements of questionnaires/bladder diaries were discussed with the patient to obtain approximate measures for the symptom assessment. Updated responses were used only for these purposes and baseline data remained as originally completed.
- The participant attended for a single intervention visit, during which the HCP discussed their individual symptoms and level of bother. The HCPs were provided with decision tools (see Report Supplementary Material 1) to assist them in tailoring the treatment for each participant at their intervention visit, based on their symptoms.
- The HCP provided the participant with the TRIUMPH trial booklet.
- The delivery of the booklet was individualised by the HCP, who directed the participant to the relevant sections of the booklet, and therefore steps to take personally. A maximum of three sections were recommended to each participant and tabbed with discreet stickers. If more than three sections were identified as relevant to a participant, the three most bothersome symptoms were chosen. The choice of a maximum of three sections was guided by patient and public involvement (PPI) consultation on what they considered to be a manageable level of advice to follow.
- To encourage and gauge adherence to the intervention, regular participant contact was provided following the initial face-to-face appointment. Follow-up contacts were conducted by telephone at 1 week, and then by telephone, e-mail or text at 4 and 12 weeks, according to participant preference. Participants retained the intervention booklet at the end of this period.
Participants in the intervention arm continued to receive usual care from their GP for their LUTS when necessary; details of this were collected at 12 months.
The TRIUMPH trial intervention training
The chief investigator developed the training and delivered this to the TRIUMPH trial research nurses. Materials were developed to support the training, as well as the intervention visits. The TRIUMPH trial nurses attended general practices randomised to the intervention arm to deliver training to practice nurses or HCAs for those sites opting to use their own staff. Training included examples of bladder diaries and how primary care staff should interpret them for the purpose of the trial. Nurses were trained on the responses to the questionnaires and which sections of the booklet they should direct the participant to. This was supported by a checklist developed specifically for the trial (see Report Supplementary Material 1). Ongoing support was available for practice nurses/HCAs in the form of regular teleconferences held by the trial team and trial research nurses.
Usual-care arm
Usual care (the comparator arm for the TRIUMPH trial) in this trial requested that sites continue to follow their standard local practice for trial participants. Usual care was chosen as the comparator for the trial to reflect the actual care provided by control arm general practices, rather than the NICE guidance, which may be variably implemented. The qualitative aspect of this trial explored what usual care looked like for a sample of comparator and intervention practices (see Chapter 5).
Post-trial care
Following the end of the trial, participants in the intervention arm retained the booklet provided, and participants in the control arm were provided with the booklet, alongside a summary of the results of the trial. Their LUTS care was the responsibility of their GP throughout the trial and after they had completed the TRIUMPH trial at 12 months.
Outcome measures
Primary outcome
The primary outcome measure was the participant-reported IPSS at 12 months after consent. The IPSS is validated, extensively tested in LUTS research and widely employed in urology services.18 It produces a score from 0 to 35, with higher scores indicating more severe symptoms. The end point of 12 months was chosen to measure whether or not any effect of the TRIUMPH trial intervention on LUTS was sustained after the initial 12-week intervention delivery period.
Secondary outcomes
The following secondary outcomes were collected by questionnaire at 6 and/or 12 months.
- International Prostate Symptom Score-Quality of Life Index (IPSS-QoL) – LUTS quality-of-life score measured at 6 and 12 months.
- IPSS – overall urinary symptom score at 6 months.
- ICIQ-UI-SF19 – measured at 6 and 12 months. This questionnaire supplements the IPSS with the measurement of incontinence.
- EuroQol-5 Dimensions, five-level version (EQ-5D-5L)20 – measure of health status.
- B-IPQ21 – patient perception of their LUTS. It was modified slightly, with permission, to ask participants about ‘urinary symptoms’ rather than ‘illness’.
The number of adverse events (specified as UTIs, catheterisations, urinary retention, prostatitis or death) and the number of referrals to secondary care (urology) were extracted from primary care EMRs at 12 months.
Sample size
This trial was powered to detect a mean between-group difference of 2 points on the primary outcome of IPSS at 12 months post consent. This target difference was chosen because, although the recognised minimum important difference in IPSS is 3.0 points,22 men may be bothered by just one symptom (e.g. nocturia). A change of 2 points might mean a small improvement in two symptoms or a bigger improvement in one symptom.
To inform the sample size calculation, a scoping search was conducted with local general practices within the NHS Bristol, North Somerset and South Gloucestershire CCG to gain a sense of the likely number of patients available on their lists based on our inclusion and exclusion criteria. This search suggested that an average-sized general practice might identify 100 patients. We originally assumed that 50% of these patients would be eligible and, of these, 70% would consent, so each practice would consent ≈35 eligible patients. Our estimates of eligibility rates, consent and loss to follow-up were conservative and based on our experience running pragmatic trials in primary care settings.
Based on this, we estimated that 840 patients were needed from at least 24 practices to detect a difference in IPSS of 2 [common standard deviation (SD) of 5: in line with the assumptions made in UPSTREAM (Urodynamics for Prostate Surgery Trial; Randomised Evaluation of Assessment Methods3)] with 90% power and a significance level of 5%. Our estimate incorporated a design effect to account for clustering of effects in practices, which assumed that practices would be able to recruit 35 patients each (i.e. mean cluster size of 35) and that the intracluster correlation coefficient (ICC) between practices would be 0.05, an estimate in line with results from other primary care studies.23 We allowed for up to 30% of men being lost to follow-up.
During the early stages of recruitment, however, it became apparent that practices were not consistently consenting 35 patients and that the variability in recruitment would necessitate more practices being recruited to achieve our objective of 90% power to detect a mean difference in IPSS of 2 points. Using information from the numbers and proportions of patients consenting from practices recruited early in the trial, and projections regarding practices soon to start recruiting patients, we revised our assumptions and assumed that the mean number of patients consented at each practice would be 26 and that the coefficient of variation for the mean cluster size between practices would be 0.26. Based on these revised assumptions, this increased the number of practices required for the study by six; the Trial Management Group agreed to recruit additional practices. This amendment was agreed with both the Trial Steering Committee and the funder.
Randomisation and implementation
General practices were the unit of allocation to the two trial arms. Practices were randomised on a 1 : 1 basis to either receive the intervention or continue care as usual [control group (CG)] by a statistician from the Bristol Trials Centre, who was outside the trial team and was masked to the identity of practices. This was done after the practice list searches had been conducted, lists were screened by GPs and the mail-out was uploaded (see Patient screening and invitation). As there were a relatively small number of general practices in the trial, minimisation was used to allocate practices to treatment arms to ensure balance. Allocation was minimised by centre (West of England and Wessex), practice size (numeric variable) and area-level deprivation [Index of multiple deprivation (IMD), a numeric variable] of the practice. A random element was incorporated in the minimisation procedure such that there was a 40% probability that allocation was random. When allocation was random, there was a 50 : 50 chance of practices being allocated to either arm.
Although it is common to use lower-layer super output area (LSOA) deprivation scores to estimate deprivation for individuals (using home postcodes to identify the LSOA), it has been shown that middle-layer super output area (MSOA) data better reflect the area-level deprivation of general practices.24 Therefore, general practice postcodes were mapped onto LSOAs first and then onto MSOAs. Population-averaged IMD scores (from 2015) were then calculated based on the scores of LSOAs within each MSOA.
Masking
Two statisticians and two health economists supported this trial. The senior statistician and senior health economist were masked throughout the trial. A junior statistician performed all disaggregated analyses according to the statistical analysis plan16 and the junior health economist conducted the economic analyses according to the health economics analysis plan. The junior statistician attended closed meetings of the independent Data Monitoring Committee as required. The CRN support team was masked to minimise selection and recruitment bias. The remaining members of the trial team were masked to aggregate data only. General practice staff, research nurses involved in delivering the intervention and participants were not masked.
The protocol was written before recruitment end and published in Trials.1 The statistical analysis plan16 was written and agreed by the trial team in July 2020, prior to completion of participant follow-up. The health economics analysis plan was written and agreed by the trial team in February 2021, prior to database lock.
Data collection
Participant-reported outcomes
The components and timing of follow-up measures are shown in Table 2. All participants were asked to complete self-reported outcome measures in the form of questionnaires (IPSS, ICIQ-UI-SF, EQ-5D-5L and B-IPQ) at baseline (postal), and 6 and 12 months (postal, online or telephone) post enrolment. Participants were sent one reminder to return their baseline materials, and up to three reminders to return their 6- and 12-month questionnaires.
All participants were provided with trial progress updates at 3 and 9 months via a newsletter to maintain engagement with the trial and encourage responses to follow-up questionnaires. The newsletter did not provide any detail on the TRIUMPH trial intervention.
Intervention delivery
Trial-designed case report forms were completed for the intervention arm only, at the intervention visit and during the 12-week treatment phase, to collect details of the booklet sections advised to the participant and feedback on the booklet.
Electronic medical record data extraction
Data extraction from GP EMRs was conducted by sites a minimum of 1 month after their final participant had completed follow-up. Database searches were developed specifically for the trial, for both EMIS Web and SystmOne patient administration systems used in primary care sites in both CRN regions. The EMR data extracted comprised baseline measures, clinical outcome measures and health economic outcome measures. The baseline and clinical data extracted are detailed in the following list; the health economic data are described in Chapter 4.
- Baseline comorbidities: any comorbidity coded on a participant’s record according to the Quality and Outcomes Framework.
- Baseline urinalysis: the most recent urinalysis results (normal/abnormal) in the 6 months pre consent.
- Baseline renal function: the most recent estimated glomerular filtration rate (eGFR) in the 6 months pre consent.
- Baseline medication: relevant prescriptions issued to patients in the 3 months pre consent.
- Baseline GP consultations: the number of consultations in the 12 months pre consent.
- Baseline referrals: referrals to urology in the 12 months pre consent.
- Adverse events: UTI, catheterisation, urinary retention, prostatitis, deaths in the 12 months post consent.
- Secondary care referrals: urology referrals in the 12 months post consent.
Patient and public involvement
We involved PPI representatives at all stages of the project. We had a patient representative on our Trial Management Group (also a co-applicant involved at the grant application stage) and a patient representative on our Trial Steering Committee. Both contributed to the management of the trial, providing an invaluable patient perspective to all aspects of trial conduct. In addition, we have held wider patient advisory group meetings throughout the trial; our two PPI representatives had a substantial role in planning, as well as chairing, these meetings.
One of the key roles of the PPI input was in the development of the TRIUMPH trial intervention booklet, which resulted in key changes to aid clarity and usability. We also undertook PPI review of the patient-facing trial materials, including the patient questionnaires, newsletters and website. Further PPI has included discussion of some of the initial qualitative findings relating to men’s experiences of the patient pathways for LUTS within the NHS, as well as routes for implementation and dissemination. Overall, PPI has played an invaluable part in the trial from conception to dissemination.
Statistical methods
Baseline data analyses
The baseline characteristics of patients and practice characteristics were compared between the two arms by reporting relevant summary statistics to determine whether or not any potentially influential imbalance occurred by chance. Baseline characteristics were summarised using means, SDs, medians [interquartile ranges (IQRs)] or number (%) depending on the nature of the data and their respective distributions.
Primary analysis
Analysis and reporting were in line with the Consolidated Standards of Reporting Trials (CONSORT) guidelines,25,26 with the primary analyses being conducted on an intention-to-treat (ITT) basis. The primary outcome was the IPSS collected at 12 months post consent. It was described in each treatment group using means and SDs. Comparisons between treatment arms were made using a mixed-effect multilevel linear model [individual patients (level 1) nested within general practices (level 2)] and adjusting for patient-level baseline IPSS and practice-level variables used in the randomisation. Results for a model adjusting only for baseline scores have also been presented. The results have been presented as the mean between-group difference with 95% confidence interval (CI), p-value and model ICC with corresponding 95% CI.
Secondary outcomes
The approach for the analysis of the secondary outcomes was on an ITT basis, defined as analysing all participants according to the group to which their practice was randomised. IPSS at 6 months were analysed in the same manner as the primary outcome using a linear mixed model [individual patients (level 1) nested within general practices (level 2)], adjusting for baseline scores and minimisation variables. A separate repeated measures analysis using a linear mixed model [6-monthly observations of IPSS (level 1), nested within participants (level 2) and nested within general practices (level 3)] was also conducted to incorporate all time points. The ICIQ-UI-SF, IPSS-QoL and B-IPQ at 6 and 12 months were studied in the same manner.
Whether or not a patient had a referral to secondary care was studied using a logistic mixed model with individual patients nested within general practices. The model adjusted for minimisation variables and whether or not the patient had a referral to urology pre baseline.
Sensitivity analyses
Predefined sensitivity analyses were conducted to assess the sensitivity of the primary analysis to various assumptions, and are described in this section. As these are exploratory in nature, 95% CIs and p-values are presented, but are interpreted with due caution.
- Imbalance of baseline characteristics. We planned to explore the sensitivity of the primary analysis to imbalance of baseline characteristics by running models adjusting for these variables. Imbalance is defined as a difference of 10%, or half a SD, between treatment groups.
- Clustering by HCA/nurse. To allow for clustering of outcomes within nurses/HCAs delivering the intervention, a model was run grouping the patient-level data into clusters based on the combination of the practice where the patient is registered and the nurse/HCA delivering the intervention (first visit). The primary analysis of the IPSS at 12 months was repeated using a single random effect for this level of clustering and the results were compared with those of the primary analysis.
- Per-protocol analyses. Five per-protocol analyses were conducted using different definitions of protocol compliance:
- excluding those in the intervention arm who received no intervention booklet by the time of the primary outcome measure at 12 months and had none of the follow-up contacts at 1, 4 and 12 weeks
- excluding those in the intervention arm who received the intervention booklet by the time of the primary outcome measure at 12 months, but had only two of the three follow-up contact visits (regardless of whether these were early or late)
- excluding those in the intervention arm who received the intervention booklet by the time of the primary outcome measure at 12 months and had only one follow-up contact (regardless of whether this was early or late)
- excluding those in the intervention arm who received the intervention booklet by the time of the primary outcome measure at 12 months but had no follow-up contact
- excluding those in the intervention arm who did not receive the follow-up contact in the protocolised format (i.e. by telephone, post or e-mail).
- Complier-average causal effect (CACE) analysis. Recognising the inherent bias in estimates derived from per-protocol analyses, we planned a CACE analysis of the primary outcome. Compliers were defined as those who received the intervention booklet by the time of the primary outcome follow-up. Non-compliers were defined as those who had not received the booklet at all or received it after the primary outcome time point. The CACE estimates were to be obtained using instrumental variable regression including the same variables used in the primary analysis, with randomised group as the instrumental variable and the indicator variable for compliance.
- Impact of COVID-19. By the time the COVID-19 outbreak was declared a pandemic by the World Health Organization on 11 March 2020, the trial had already reached its target recruitment and was no longer recruiting. Recognising that trial participation and symptom reporting may have been affected by the outbreak and subsequent lockdown, we used descriptive statistics to explore whether or not there were differences in the proportions of missing data for the primary outcome (IPSS at 12 months) before and after 11 March 2020. We also assessed whether or not IPSS at 12 months differed depending on whether data were collected before or during the COVID-19 pandemic. Scores before and after 11 March 2020 were described using descriptive statistics and the primary analysis model was refitted including a binary term to indicate whether the outcome was measured before 11 March 2020 (0) or from 11 March 2020 onwards (1).
- Excluding patients later found to be ineligible. A small number of patients participated in the trial who, after consenting and providing data, were found to be ineligible, but were included in the primary ITT analysis. A sensitivity analysis of the primary outcome excluding these individuals was conducted.
Subgroup analyses
Four prespecified subgroup analyses were performed to explore whether or not baseline characteristics modified the effectiveness of the intervention:
- Nature of LUTS at baseline. The ratio of the IPSS voiding subscore to the storage subscore has been used to describe the relative dominance of voiding to storage LUTS. This measure was used to explore whether or not the treatment effect differed by the nature of LUTS at baseline, as quantified using this ratio.
- Intervention delivery. We explored whether or not the effect of the intervention differed according to whether a practice nurse/HCA or TRIUMPH trial nurse delivered the intervention to the participant.
- Method of contact. Participants in the intervention arm specified how they preferred to be contacted by the research team for their intervention follow-up contacts. This might be by telephone or text, for example. The frequency of each preferred mode of contact, the model of contact used and how often this differed were reported. We explored whether or not the effect of the intervention differed by model of contact by including a ‘preferred method of contact’ and treatment group interaction term in the model.
- Intervention ‘dose’. To explore the possibility that the number of nurse/HCA contacts modified the effect of the intervention, we created a ‘dose’ variable equal to the number of nurse/HCA contacts that participants at the intervention practices received (0–3). The primary analysis was repeated using the ‘dose’ variable as the treatment variable.
In all cases, effect modification was assessed including an interaction term in the regression model, and formal tests of interaction were performed to test whether or not the treatment effect differed between these groups. As with all other analyses, a significance level of 5% was used and, as these analyses were not statistically powered, they are interpreted with due caution as exploratory. A post hoc subgroup analysis was also performed according to whether or not the primary outcome was collected before the start of the COVID-19 pandemic.
Multiple imputation
For our analysis of the primary outcome, we investigated the influence of missing data using sensitivity analyses that made different assumptions regarding missingness: ‘best’- and ‘worst’-case scenarios and multiple imputation by chained equations (MICE) to impute missing data.