Minimal clinically important differences (MCID) are used to understand clinical relevance. However, repeated observations produce biased analyses unless accounting for baseline observation, called Regression-to-the-Mean (RTM). Using an International Knee Documentation Committee survey data set, the effect of RTM on MCID is demonstrated by 1) MCID estimate dependence on baseline observation, and 2) MCID estimate bias being higher when post-pre data correlation is lower. Ten IKDC datasets were created with 5,000 patients and a specific correlation under both equal and unequal variances. For every 10 points increase in baseline IKDC, MCID decreased by 3.5, 2.7, 1.9, 1.2, and 0.7 points where post-pre correlations were 0.10, 0.25, 0.50, 0.75, and 0.90 under equal variances. Failing to account for RTM results in a static 20 point MCID. MCID estimates may be unreliable. MCID calculations should report the correlation and variances between post-pre data and consider a baseline covariate-adjusted ROC analysis to calculate MCID.
Minimal clinically important differences (MCID) are commonly used to differentiate between statistical and clinical significance
Current methods for MCID calculations do not control for regression-to-the-mean
Our statistical simulations demonstrate that current methods for calculating MCIDs are biased and potentially unreliable, and we suggest four remediation steps
The views expressed in this article are those of the author and do not reflect the official policy of the Department of Army/Navy/Air Force, Department of Defense, or U.S. Government