Evaluating the incremental value of new biomarkers with integrated discrimination improvement.
نویسندگان
چکیده
The integrated discrimination improvement (IDI) index is a popular tool for evaluating the capacity of a marker to predict a binary outcome of interest. Recent reports have proposed that the IDI is more sensitive than other metrics for identifying useful predictive markers. In this article, the authors use simulated data sets and theoretical analysis to investigate the statistical properties of the IDI. The authors consider the common situation in which a risk model is fitted to a data set with and without the new, candidate predictor(s). Results demonstrate that the published method of estimating the standard error of an IDI estimate tends to underestimate the error. The z test proposed in the literature for IDI-based testing of a new biomarker is not valid, because the null distribution of the test statistic is not standard normal, even in large samples. If a test for the incremental value of a marker is desired, the authors recommend the test based on the model. For investigators who find the IDI to be a useful measure, bootstrap methods may offer a reasonable option for inference when evaluating new predictors, as long as the added predictive capacity is large.
منابع مشابه
Practice of Epidemiology Evaluating the Incremental Value of New Biomarkers With Integrated Discrimination Improvement
The integrated discrimination improvement (IDI) index is a popular tool for evaluating the capacity of a marker to predict a binary outcome of interest. Recent reports have proposed that the IDI is more sensitive than other metrics for identifying useful predictive markers. In this article, the authors use simulated data sets and theoretical analysis to investigate the statistical properties of...
متن کاملNet reclassification improvement and integrated discrimination improvement: new standards for evaluating the incremental value of stress imaging for risk assessment.
متن کامل
Quantifying the value of biomarkers for predicting mortality.
PURPOSE In light of widespread interest in the prognostic value of biomarkers, we apply three discrimination measures to evaluate the incremental value of biomarkers--beyond self-reported measures--for predicting all-cause mortality. We assess whether all three measures--area under the receiver-operating characteristic curve, continuous net reclassification improvement, and integrated discrimin...
متن کاملPrognostic value of biomarkers in heart failure: application of novel methods in the community.
BACKGROUND Mortality among patients with heart failure is high. Though individual biomarkers have been investigated to determine their value in mortality risk prediction, the role of a multimarker strategy requires further evaluation. METHODS AND RESULTS Olmsted County residents presenting with heart failure from July 2004 to September 2007 were recruited to undergo biomarker measurement. We ...
متن کاملComparison of Bayesian and Frequentist Methods in Estimating the Net Reclassification and Integrated Discrimination Improvement Indices for Evaluation of Prediction Models: Tehran Lipid and Glucose Study
Introduction: The Frequency-based method is commonly used to estimate the Net Reclassification Improvement (NRI)- and Integrated Discrimination Improvement (IDI) indices. These indices measure the magnitude of the performance of statistical models when a new biomarker is added. This method has poor performance in some cases, especially in small samples. In this study, the performance of two Bay...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- American journal of epidemiology
دوره 174 3 شماره
صفحات -
تاریخ انتشار 2011