Parts of this chapter have been reproduced with permission from Taylor et al.48 This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) licence, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: https://creativecommons.org/licenses/by/4.0/. The text below includes minor additions and formatting changes to the original text.
Participants
The final cohort consisted of 194 patients, median age 29, IQR 22–44 years (Figure 2). Ninety-three (48%) of the final cohort were male.
FIGURE 2 Participant flow through trial identifying participants by timing of first event during the follow-up period (> 90 days to 5 years). FU, follow-up; LFU, lost to follow-up. Reproduced with permission from Taylor et al.48 This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) licence, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: https://creativecommons.org/licenses/by/4.0/. The figure includes minor additions and formatting changes to the original text. (Figure not reproduced here; see the original article.)
All patients and patient events were followed up across the full 5-year period. Because it was possible to include non-contactable patients recruited to the METRIC trial in the retrospective group, it was not possible to define the exact split between the two cohorts (as no patient identifiable data could be sent to the clinical trial unit). Direct consent was obtained from 47 METRIC patients.
According to the modified Beaugerie criteria, 42% (81/194) of participants developed disabling disease between 90 days post diagnosis to 5 years from diagnosis (Table 5 and 6). An additional 25 patients were hospitalised within the first 90 days and although they also fulfilled the modified Beaugerie criteria for disabling disease, after discussion by the TMG, these were not treated as events as these patients were being treated immediately at diagnosis, taking priority over consideration of instigating top-down therapy; including events within 90 days of diagnosis would impact on the clinical utility of any prognostic model.
| Years from diagnosis to developing disabling disease | Modified Beaugerie criteria | Montreal B2 or B3 | Liège criteria |
|---|---|---|---|
| N = 81 | N = 12 | N = 39 | |
| 1 | 43 (52) | 2 (17) | 28 (72) |
| 2 | 13 (16) | 1 (8) | 3 (8) |
| 3 | 9 (11) | 5 (42) | 4 (10) |
| 4 | 11 (14) | 3 (25) | 3 (8) |
| 5 | 6 (7) | 1 (8) | 1 (3) |
| Demographic and clinical characteristics | MBDD negative | MBDD positive | Total | |
|---|---|---|---|---|
| N = 113 | N = 81 | N = 194 | ||
| Age (years) | 31 (22–49) | 27 (22–37) | 29 (22–44) | |
| Sex | Male | 54 (48) | 39 (48) | 93 (48) |
| Female | 59 (52) | 42 (52) | 101 (52) | |
| Recruitment site | Cambridge | 2 (2) | 7 (9) | 9 (5) |
| Leeds | 24 (21) | 18 (22) | 42 (22) | |
| Leicester | 5 (4) | 0 (0) | 5 (3) | |
| Ninewells | 2 (2) | 7 (9) | 9 (5) | |
| Oxford | 7 (6) | 10 (12) | 17 (9) | |
| Portsmouth | 19 (17) | 8 (10) | 27 (14) | |
| St George’s | 2 (2) | 3 (4) | 5 (3) | |
| St Marks | 4 (4) | 6 (7) | 10 (5) | |
| UCLH | 48 (42) | 22 (27) | 70 (36) | |
| Medication administered within 5 years from diagnosisa | Aminosalicylate | 52 | 37 | 89 |
| Biologic | 80 | 113 | 193 | |
| Immunomodulator | 143 | 117 | 260 | |
| Other | 11 | 27 | 38 | |
| Steroid | 104 | 156 | 260 | |
Only 20% (39/194) developed disabling disease according to the Liège criteria and 6% (12/194) developed B2 or B3 disease on the Montreal criteria (see Table 5).
The event rate using Liège and Montreal definitions of disabling disease was insufficient to perform survival analysis/predictive modelling and therefore all data were analysed using the primary outcome measure (modified Beaugerie criteria) (see Table 6).
Of those with an event that is, development of disabling disease according to the modified Beaugerie criteria, the median survival time prior to the event was 0.82 (IQR 0.42–2.75) years. A total of 81 events occurred in the 5-year follow-up period, 42 (52%) in year 1 and 6 (7%) in year 5 (Table 7). Most Beaugerie-defining events were hospitalisation due to a CD flare or complication (48 events; 59%) or due to use of corticosteroids (21 events; 26%; Table 7).
| Descriptors | Years from diagnosis to developing MBDD | Total | ||||
|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | ||
| Hospitalisation due to a CD flare or complication | 27 | 10 | 5 | 4 | 2 | 48 |
| ≥ 3 corticosteroid courses or dependence on corticosteroids | 11 | 4 | 3 | 4 | 1 | 23 |
| Intestinal resection > 50 cm or surgery for perianal diseasea | 1 | 0 | 0 | 0 | 0 | 1 |
| Diarrhoea with nocturnal stools | 0 | 0 | 0 | 1 | 0 | 1 |
| Urgency | 1 | 0 | 0 | 2 | 1 | 4 |
| Abdominal pain due to intestinal obstruction | 0 | 0 | 2 | 2 | 1 | 5 |
| Fever | 0 | 0 | 0 | 0 | 0 | 0 |
| Fatigue | 0 | 0 | 0 | 1 | 0 | 1 |
| Joint pain not caused by another factor | 1 | 1 | 0 | 0 | 1 | 3 |
| Uveitis | 2 | 0 | 0 | 0 | 0 | 2 |
| Pyoderma gangrenosum | 0 | 0 | 0 | 0 | 0 | 0 |
| Total | 43 | 15 | 10 | 14 | 6 | 88b |
Clinical predictors of disabling disease
The number of participants with the predefined candidate clinical predictors of disabling disease is shown in Tables 8–10.
| Prespecified clinical predictors | MBDD negative | MBDD positive | Total | |
|---|---|---|---|---|
| N = 113 | N = 81 | N = 194 | ||
| Age category (years) | < 40 | 76 (67) | 62 (77) | 138 (71) |
| ≥ 40 | 37 (33) | 19 (23) | 56 (29) | |
| Sex | Male | 54 (48) | 39 (48) | 93 (48) |
| Female | 59 (52) | 42 (52) | 101 (52) | |
| Smoking status | Non-smoker | 81 (72) | 49 (60) | 130 (67) |
| Smoker | 22 (19) | 25 (31) | 47 (24) | |
| Missing | 10 (9) | 7 (9) | 17 (9) | |
| Weight loss ≥ 5 kg prior to diagnosis | Absent | 71 (63) | 51 (63) | 122 (63) |
| Present | 28 (25) | 18 (22) | 46 (24) | |
| Missing | 14 (12) | 12 (15) | 26 (13) | |
| Initial need for steroid therapy | Absent | 84 (74) | 43 (53) | 127 (65) |
| Present | 29 (26) | 38 (47) | 67 (35) | |
| Developed MBDD ≤ 90 days from diagnosis | Absent | 100 (88) | 69 (85) | 169 (87) |
| Present | 13 (12) | 12 (15) | 25 (13) | |
| Perianal disease | Absent | 100 (88) | 70 (86) | 170 (88) |
| Present | 12 (11) | 11 (14) | 23 (12) | |
| Missing | 1 (1) | 0 (0) | 1 (0) | |
| Severe endoscopic disease | Absent | 74 (65) | 56 (69) | 130 (67) |
| Present | 27 (24) | 20 (25) | 47 (24) | |
| Missing | 12 (11) | 5 (6) | 17 (9) | |
| Disease behaviour | B1 | 80 (71) | 50 (62) | 130 (67) |
| B2 | 17 (15) | 17 (21) | 34 (18) | |
| B3 | 16 (14) | 14 (17) | 30 (15) | |
| Location of disease behaviour | Ileocolonic | 52 (46) | 42 (52) | 94 (48) |
| Ileal/upper tract | 41 (36) | 28 (35) | 69 (36) | |
| Colonic | 20 (18) | 11 (14) | 31 (16) | |
| Prespecified blood and stool predictors | MBDD negative | MBDD positive | Total | |
|---|---|---|---|---|
| N = 113 | N = 81 | N = 194 | ||
| CRP level (mg/l) | n (%) | 87 (77) | 75 (93) | 162 (84) |
| Median (IQR) | 12 (4–39) | 16 (6–56) | 14 (6–46) | |
| WBC count (109/l) | n (%) | 82 (73) | 70 (86) | 152 (78) |
| Median (IQR) | 9 (8–12) | 9 (7–12) | 9 (8–12) | |
| FC level (μg/g) | n (%) | 43 (38) | 30 (37) | 73 (38) |
| Median (IQR) | 527 (108–600) | 521 (196–600) | 527 (132–600) | |
| Haemoglobin level (g/l) | n (%) | 86 (76) | 70 (86) | 156 (80) |
| Mean (SD) | 126 (18) | 125 (18) | 126 (18) | |
| Platelet count (109/l) | n (%) | 78 (69) | 69 (85) | 147 (76) |
| Mean (SD) | 380 (127) | 380 (127) | 380 (127) | |
| Prespecified MRE score predictors | MBDD negative | MBDD positive | Total |
|---|---|---|---|
| N = 113 | N = 81 | N = 194 | |
| Global MEGS | 21 (8–34) | 24 (8–37) | 22 (8–35) |
| Normalised global MEGS (%) | 14 (5–23) | 17 (5–25) | 15 (5–24) |
| Global sMARIA | 5 (2–8) | 5 (2–6) | 5 (2–7) |
| Normalised global sMARIA (%) | 18 (7–29) | 18 (7–21) | 18 (7–25) |
| LI | 2 (1–4) | 2 (1–3) | 2 (1–3) |
| Normalised LI (%) | 10 (4–21) | 11 (6–19) | 11 (4–20) |
Prognostic models
A summary of the various models is shown in Figure 3.
FIGURE 3 Summary of the derivation of prognostic models for developing disabling disease according to the modified Beaugerie criteria. Reproduced with permission from Taylor et al.48 This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) licence, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: https://creativecommons.org/licenses/by/4.0/. The figure includes minor additions and formatting changes to the original text. (Figure not reproduced here; see the original article.)
Model B included the prespecified clinical predictors (excluding blood and stool markers). Models A1, A2 and A3 added the MEGS, sMARIA and LI scores, respectively. Model B1 added the blood and stool markers to the baseline clinical model (model B) (see Figure 3).
Years to events by predictors
Table 11 and Figure 4 show the median survival time to developing disabling disease according to the prespecified clinical predictors. The median MBDD free survival time of all participants was 0.82 (IQR 0.42–2.75) years.
| Prespecified clinical predictors | MBDD positive | MBDD event-free time (years) | |
|---|---|---|---|
| Age category (years) | < 40 | 62 | 0.77 (0.42–2.75) |
| ≥ 40 | 19 | 0.93 (0.39–2.82) | |
| Sex | Male | 39 | 1.25 (0.41–3.02) |
| Female | 42 | 0.68 (0.43–2.11) | |
| Smoking status | Non-smoker | 49 | 0.93 (0.39–2.69) |
| Smoker | 25 | 0.63 (0.49–3.41) | |
| Weight loss ≥ 5 kg prior to diagnosis | Absent | 51 | 0.62 (0.41–2.75) |
| Present | 18 | 1.75 (0.37–3.02) | |
| Initial need for steroid therapy | Absent | 43 | 1.25 (0.52–2.75) |
| Present | 38 | 0.50 (0.35–2.82) | |
| Developed MBDD ≤ 90 days from diagnosis | Absent | 69 | 1.24 (0.46–2.85) |
| Present | 12 | 0.51 (0.29–1.21) | |
| Perianal disease | Absent | 70 | 0.88 (0.39–2.55) |
| Present | 11 | 0.62 (0.46–3.92) | |
| Severe endoscopic disease | Absent | 56 | 0.73 (0.41–2.80) |
| Present | 20 | 0.88 (0.44–2.02) | |
| Disease behaviour | B1 | 50 | 1.03 (0.44–2.85) |
| B2 | 17 | 1.44 (0.47–2.69) | |
| B3 | 14 | 0.47 (0.36–1.77) | |
| Location of disease behaviour | Ileocolonic | 42 | 0.68 (0.43–2.92) |
| Ileal/upper tract | 28 | 1.51 (0.40–2.33) | |
| Colonic | 11 | 0.62 (0.39–3.18) | |
FIGURE 4 Scatter plots of years from diagnosis to developing MBDD, stratified by the prespecified clinical predictors. Markers represent patients who developed MBDD, and orange boxes represent median and IQR. (Figure not reproduced here; see the original article.)
Univariable hazard ratio by clinical predictors
The univariable hazard ratio (HR) for the prespecified clinical predictors and MRI scores is summarised in Table 12. Initial requirement for steroid therapy was associated with a higher risk of an event (development of disabling disease) in both original and imputed data.
| Prespecified predictors | Observed data | Imputed data | |||||
|---|---|---|---|---|---|---|---|
| N | HR (95% CI) | p-value | N | HR (95% CI) | p-value | ||
| ≥ 40 years of age | 194 | 0.71 (0.42 to 1.18) | 0.185 | ||||
| Female | 194 | 1.01 (0.65 to 1.57) | 0.954 | ||||
| Smoker | 181 | 1.51 (0.94 to 2.45) | 0.092 | 194 | 1.52 (0.95 to 2.44) | 0.082 | |
| Weight loss ≥ 5 kg prior to diagnosis | 171 | 0.89 (0.52 to 1.52) | 0.659 | 194 | 0.83 (0.48 to 1.43) | 0.509 | |
| Initial need for steroid therapy | 194 | 2.11 (1.36 to 3.26) | 0.001 | ||||
| Developed MBDD ≤ 90 days from diagnosis | 194 | 1.38 (0.75 to 2.54) | 0.305 | ||||
| Perianal disease | 193 | 1.15 (0.61 to 2.16) | 0.674 | 194 | 1.15 (0.61 to 2.18) | 0.664 | |
| Severe endoscopic disease | 181 | 1.00 (0.60 to 1.66) | 0.995 | 194 | 1.04 (0.62 to 1.75) | 0.869 | |
| Disease behaviour | B1 | 194 | – | – | |||
| B2 | 1.38 (0.80 to 2.40) | 0.247 | |||||
| B3 | 1.39 (0.77 to 2.51) | 0.281 | |||||
| Location of disease behaviour | Ileocolonic | 194 | – | – | |||
| Ileal/upper tract | 0.89 (0.55 to 1.43) | 0.619 | |||||
| Colonic | 0.75 (0.39 to 1.45) | 0.392 | |||||
| Normalised global MEGS (%) | 194 | 1.01 (0.99 to 1.02) | 0.366 | ||||
| Normalised global sMARIA (%) | 194 | 1.00 (0.98 to 1.01) | 0.544 | ||||
| Normalised LI (%) | 194 | 1.00 (0.99 to 1.01) | 0.888 | ||||
| CRP level (mg/l) | 166 | 1.00 (1.00 to 1.01) | 0.344 | 194 | 1.00 (1.00 to 1.01) | 0.348 | |
| WBC count (109/l) | 156 | – | – | 194 | 1.01 (0.94 to 1.07) | 0.877 | |
| FC level (μg/g) | 75 | 1.00 (1.00 to 1.00) | 0.892 | 194 | 1.00 (1.00 to 1.00) | 0.719 | |
| Haemoglobin level (g/l) | 160 | 1.00 (0.98 to 1.01) | 0.674 | 194 | 1.00 (0.98 to 1.01) | 0.680 | |
| Platelet count (109/l) | 151 | – | – | 194 | 1.00 (1.00 to 1.00) | 0.762 | |
The multivariable models (models B, A1, A2, A3 and B1) are shown in Appendix 1, Tables 21–25. The corresponding receiver operating characteristic (ROC) curves are shown in Appendix 2, Figure 8.
FIGURE 5 Kaplan–Meier plots of the percentage of MBDD negative participants in low-risk and high-risk groups over years from diagnosis, stratified by RD. (a) Model B and RD1; (b) Model B and RD2; (c) Model A1 and RD1; (d) Model A1 and RD2; (e) Model A2 and RD1; (f) Model A2 and RD2; (g) Model A3 and RD1; (h) Model A3 and RD2; (i) Model B1 and RD1; (j) Model B1 and RD2. Blue lines represent the low-risk group and red lines represent the high-risk group. Data are n. (Figure not reproduced here; see the original article.)
FIGURE 6 Net benefit of prognostic models to predict the development of MBDD within 5 years of diagnosis. a) RD1 (risk definition group 1-top 40% of participants with the greater risk of MBDD); b) RD2 (risk definition group 2-participants with an absolute risk of MBDD ≥10%). (Figure not reproduced here; see the original article.)
FIGURE 7 Net benefit of the various models according to the ratio of TP to FPs RD2 (patients with an absolute risk of developing disabling disease of ≥ 10%). (Figure not reproduced here; see the original article.)
Modified Beaugerie disabling disease event-free Kaplan–Meier for clinical risk groups
The predictive performance of all the models was assessed using the two a priori defined clinical risk groups and shown in Figure 5. For RD1, the high-risk group included the top 40% of participants with the greatest predicted risk from the model. For RD2, the high-risk group included participants with an absolute risk ≥ 10%.
Tables 13 and 14 show the sensitivity and specificity of each model for identifying patients in each of the two predefined risk groups.
| Prognostic model | RD | Risk group | Percentage MBDD negative (95% CI) | MBDD negative | MBDD positive | Sensitivity (95% CI) | Specificity (95% CI) |
|---|---|---|---|---|---|---|---|
| N = 113 | N = 81 | ||||||
| B | 1 | Low | 65 (55 to 73) | 75 | 41 | 49 (39 to 60) | 66 (57 to 74) |
| High | 49 (38 to 60) | 38 | 40 | ||||
| 2 | Low | 79 (65 to 88) | 40 | 11 | 86 (77 to 92) | 35 (27 to 45) | |
| High | 51 (43 to 59) | 73 | 70 | ||||
| A1 | 1 | Low | 66 (56 to 74) | 76 | 40 | 51 (40 to 61) | 67 (58 to 75) |
| High | 48 (36 to 58) | 37 | 41 | ||||
| 2 | Low | 83 (67 to 91) | 33 | 7 | 91 (83 to 96) | 29 (22 to 38) | |
| High | 52 (44 to 60) | 80 | 74 | ||||
| A2 | 1 | Low | 67 (57 to 74) | 77 | 39 | 52 (41 to 62) | 68 (59 to 76) |
| High | 47 (35 to 57) | 36 | 42 | ||||
| 2 | Low | 82 (66 to 91) | 31 | 7 | 91 (83 to 96) | 27 (20 to 36) | |
| High | 53 (45 to 60) | 82 | 74 | ||||
| A3 | 1 | Low | 66 (57 to 74) | 77 | 40 | 51 (40 to 61) | 68 (59 to 76) |
| High | 47 (36 to 58) | 36 | 41 | ||||
| 2 | Low | 83 (67 to 91) | 33 | 7 | 91 (83 to 96) | 29 (22 to 38) | |
| High | 52 (44 to 60) | 80 | 74 | ||||
| B1 | 1 | Low | 68 (58 to 75) | 79 | 38 | 53 (42 to 64) | 70 (61 to 78) |
| High | 45 (33 to 55) | 34 | 43 | ||||
| 2 | Low | 84 (69 to 92) | 36 | 7 | 91 (83 to 96) | 32 (24 to 41) | |
| High | 51 (43 to 59) | 77 | 74 |
| Prognostic model | RD | Sensitivity (95% CI) | Sensitivity difference (95% CI) | p-value | Specificity (95% CI) | Specificity difference (95% CI) | p-value |
|---|---|---|---|---|---|---|---|
| B | 1 | 49 (39 to 60) | – | – | 66 (57 to 74) | – | – |
| A1 | 51 (40 to 61) | −1.2 (−4.9 to 2.4) | > 0.999 | 67 (58 to 75) | 0.9 (−1.7 to 3.5) | > 0.999 | |
| A2 | 52 (41 to 62) | −2.5 (−9.6 to 4.7) | 0.688 | 68 (59 to 76) | 1.8 (−4.0 to 7.5) | 0.727 | |
| A3 | 51 (40 to 61) | −1.2 (−6.7 to 4.2) | > 0.999 | 68 (59 to 76) | 1.8 (−1.5 to 5.1) | 0.500 | |
| B1 | 53 (42 to 64) | −3.7 (−10.3 to 2.9) | 0.375 | 70 (61 to 78) | 3.5 (−2.2 to 9.3) | 0.289 | |
| B | 2 | 86 (77 to 92) | – | – | 35 (27 to 45) | – | – |
| A1 | 91 (83 to 96) | −4.9 (−10.9 to 1.0) | 0.125 | 29 (22 to 38) | −6.2 (−11.5 to −0.9) | 0.016 | |
| A2 | 91 (83 to 96) | −4.9 (−12.0 to 2.1) | 0.219 | 27 (20 to 36) | −8.0 (−16.3 to 0.3) | 0.064 | |
| A3 | 91 (83 to 96) | −4.9 (−10.9 to 1.0) | 0.125 | 29 (22 to 38) | −6.2 (−12.2 to −0.2) | 0.039 | |
| B1 | 91 (83 to 96) | −4.9 (−12.0 to 2.1) | 0.219 | 32 (24 to 41) | −3.5 (−9.3 to 2.2) | 0.289 |
Overall, there was no statistically significant difference in sensitivity or specificity between model B and each of the other models for patient risk group 1 (see Table 13). For patient risk group 2, models A1, A3 and B1 had significantly lower specificity than model B (see Table 14). There was no benefit identified by including the MRE scores (MEGS, sMARIA, LI) or blood or stool parameters, demonstrating that inclusion of these measurements does not improve the prediction of disabling disease.
Model performance in a hypothetical 1000 participants
The performance of the various models in a hypothetical cohort of 1000 patients for RD1 (top 40% of patients with the greatest predicted risk of developing disabling disease) is shown in Table 15. For example, for model B, we would predict 402 to have an event within 5 years of diagnosis, of whom we would correctly predict 217, and falsely predict 185.
| Prognostic model | RD | High-risk and MBDD positive (TP) | High-risk and MBDD negative (FP) | Low-risk and MBDD positive (false-negative) | Low-risk and MBDD negative (true-negative) |
|---|---|---|---|---|---|
| B | 1 | 206 | 212 | 196 | 386 |
| A1 | 212 | 206 | 191 | 391 | |
| A2 | 217 | 201 | 185 | 397 | |
| A3 | 212 | 206 | 185 | 397 | |
| B1 | 222 | 196 | 175 | 407 | |
| B | 2 | 361 | 57 | 376 | 206 |
| A1 | 382 | 36 | 412 | 170 | |
| A2 | 382 | 36 | 422 | 160 | |
| A3 | 382 | 36 | 412 | 170 | |
| B1 | 382 | 36 | 397 | 185 |
The performance of the various models in a hypothetical cohort of 1000 patients for RD2 (patients with an absolute risk of developing disabling disease of ≥ 10%) is shown in Table 15.
In Table 16, we present the participants who started biologic therapy within 180 days of their diagnosis of CD. There was no evidence that early biologics were preventative of MBDD.
| Maximum segmental sMARIA | Global sMARIA | Total | |||||
|---|---|---|---|---|---|---|---|
| < 1 | ≥ 1 | < 2 | ≥ 2 | < 6 | ≥ 6 | ||
| N = 19 | N = 139 | N = 31 | N = 127 | N = 98 | N = 60 | N = 158 | |
| Did not start biologic therapy and developed MBDD | 4 (21) | 19 (14) | 5 (16) | 18 (14) | 17 (17) | 6 (10) | 23 (15) |
| Did not start biologic therapy and did not develop MBDD | 12 (63) | 51 (37) | 22 (71) | 41 (32) | 40 (41) | 23 (38) | 63 (40) |
| Started biologic therapy < 180 days from diagnosis and developed MBDD ≥ 90 days later | 1 (5) | 15 (11) | 1 (3) | 15 (12) | 10 (10) | 6 (10) | 16 (10) |
| Started biologic therapy < 180 days from diagnosis and did not develop MBDD | 0 (0) | 23 (17) | 1 (3) | 22 (17) | 12 (12) | 11 (18) | 23 (15) |
| Started biologic therapy ≥ 180 days from diagnosis and developed MBDD ≥ 90 days later | 0 (0) | 6 (4) | 0 (0) | 6 (5) | 5 (5) | 1 (2) | 6 (4) |
| Started biologic therapy ≥ 180 days from diagnosis and did not develop MBDD | 2 (11) | 25 (18) | 2 (6) | 25 (20) | 14 (14) | 13 (22) | 27 (17) |
Net benefit
An illustration of the net benefit of each model is shown in Figures 6 and 7.
For example, permitting one true positive (TP) to five false positives (FPs) means that to correctly identify one participant developing disabling disease, no more than five participants should be identified incorrectly (i.e. risking unnecessary top-down therapy). For this ratio to be clinically acceptable, the harm of delaying top-down therapy for someone destined to develop disabling disease is five times greater than that of commencing unnecessary top-down therapy. In this example, the ‘weight’ of preventing one patient developing disabling disease is five times more important than administering top-down therapy to a patient who will not develop disabling disease.
A net benefit of 18% means that the model would lead to starting biologics in 180 participants per 1000 at risk, with all biologics truly preventing events (see Figures 6 and 7).
The net benefit of prognostic models for predicting development of MBDD within 5 years of diagnosis, using ratios of TP to FP predictions is provided in Appendix 3, Table 26.
For secondary outcome 2, we had planned to use PCA to determine the optimal combination of individual MRE features (see Appendix 4, Table 27). These features would be used in conjunction with predefined clinical variables (Model B) to predict disabling CD. The MRE features selected (n = 20) were those used in the calculation of the sMARIA, MEGS and LI.
We computed scores for principal components (PCs) and found that the first six PCs accounted for approximately 70% of the total variance. We intended to include these PCs along with the clinical variables in a flexible parametric survival model. However, upon incorporating the PCs, the model failed to converge due to significant collinearity issues with the clinical variables. Consequently, we were unable to explore the predictive ability of individual MRE features using this approach.
Additionally, we performed PCA on a prespecified list of MRE features (n = 11) selected as of clinical interest by the study radiologists, and computed four PCs that accounted for more than 70% of the total variance. We present the scree plot (see Appendix 5, Figure 9) and loading table (see Appendix 8, Table 31). As with the full list of MRE features, the inclusion of these four PCs to the clinical variables led to collinearity problems, hindering the convergence of the model (see Appendix 6, Figures 10 and 11, Tables 28 and 29, Appendix 7, Table 30, Appendix 8, Table 31, Appendix 9, Table 32).