Comparison of Bayesian and Frequentist Methods in Estimating the Net Reclassification and Integrated Discrimination Improvement Indices for Evaluation of Prediction Models: Tehran Lipid and Glucose Study

Authors

  • Ahmadi, Farzane Department of Biostatistics, Faculty of Paramedical Science, Shahid Beheshti University of Medical Sciences, Tehran, Iran.
  • Baghestani, Ahmad Reza Department of Biostatistics, Faculty of Paramedical Science, Shahid Beheshti University of Medical Sciences, Tehran, Iran.
  • Khalili, Davood Prevention of Metabolic Disorders Research Center, Research Institute for Endocrine Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
  • Mahdavi, Maryam Obesity Research Center, Research Institute for Endocrine Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
  • Mehrabi, Yadollah Department of Epidemiology, School of Public Health and Safety, Shahid Beheshti University of Medical Sciences, Tehran, Iran
  • Nariman, Sedighe Department of Biostatistics, Faculty of Paramedical Science, Shahid Beheshti University of Medical Sciences, Tehran, Iran.
Abstract:

Introduction: The Frequency-based method is commonly used to estimate the Net Reclassification Improvement (NRI)- and Integrated Discrimination Improvement (IDI) indices. These indices measure the magnitude of the performance of statistical models when a new biomarker is added. This method has poor performance in some cases, especially in small samples. In this study, the performance of two Bayesian and Frequentist methods were evaluated and compared for the diabetes prediction model in pre-diabetic women. Materials and Methods: A total of 734 pre-diabetic women aged≥20 years, participated in the first and second phases of the Tehran Lipid and Glucose Study (TLGS) were enrolled in this research and the logistic regression model was used with variables of the Atherosclerosis Risk in Communities (ARIC) in order to estimate the probability of diabetes. Predictors of diabetes in the ARIC study were waist circumference, hypertension, height, weight, age, family history of diabetes, smoking and pulse rate. The Frequentist and Bayesian methods were used to estimate the NRI and IDI. In addition these methods were compared in a small sample size selected randomly from the primary sample. Statistical analyses were performed using R- software version 3.1.3. Results: Estimates of the NRI and IDI indices by the Bayesian and Frequentist methods provided almost similar results. Adding new markers of wrist size, history of macrosomia, and history of preeclampsia to the ARIC model did not show significant effect on the improvement indices. In the small sample size, IDI and NRI showed better performance in the Bayesian method compared to the frequentist method. Conclusion: The Bayesian method had a more reliable performance in comparison with the frequency-based method, especially in small samples.

Upgrade to premium to download articles

Sign up to access the full text

Already have an account?login

similar resources

the survey of the virtual higher education in iran and the ways of its development and improvement

این پژوهش با هدف "بررسی وضعیت موجود آموزش عالی مجازی در ایران و راههای توسعه و ارتقای آن " و با روش توصیفی-تحلیلی و پیمایشی صورت پذیرفته است. بررسی اسنادو مدارک موجود در زمینه آموزش مجازی نشان داد تعداد دانشجویان و مقاطع تحصیلی و رشته محل های دوره های الکترونیکی چندان مطلوب نبوده و از نظر کیفی نیز وضعیت شاخص خدمات آموزشی اساتید و وضعیت شبکه اینترنت در محیط آموزش مجازی نامطلوب است.

on the comparison of keyword and semantic-context methods of learning new vocabulary meaning

the rationale behind the present study is that particular learning strategies produce more effective results when applied together. the present study tried to investigate the efficiency of the semantic-context strategy alone with a technique called, keyword method. to clarify the point, the current study seeked to find answer to the following question: are the keyword and semantic-context metho...

15 صفحه اول

investigation of single-user and multi-user detection methods in mc-cdma systems and comparison of their performances

در این پایان نامه به بررسی روش های آشکارسازی در سیستم های mc-cdma می پردازیم. با توجه به ماهیت آشکارسازی در این سیستم ها، تکنیک های آشکارسازی را می توان به دو دسته ی اصلی تقسیم نمود: آشکارسازی سیگنال ارسالی یک کاربر مطلوب بدون در نظر گرفتن اطلاعاتی در مورد سایر کاربران تداخل کننده که از آن ها به عنوان آشکارساز های تک کاربره یاد می شود و همچنین آشکارسازی سیگنال ارسالی همه ی کاربران فعال موجود در...

the study of practical and theoretical foundation of credit risk and its coverage

پس از بررسی هر کدام از فاکتورهای نوع صنعت, نوع ضمانت نامه, نرخ بهره , نرخ تورم, ریسک اعتباری کشورها, کارمزد, ریکاوری, gdp, پوشش و وثیقه بر ریسک اعتباری صندوق ضمانت صادرات ایران مشخص گردید که همه فاکتورها به استثنای ریسک اعتباری کشورها و کارمزد بقیه فاکتورها رابطه معناداری با ریسک اعتباری دارند در ضمن نرخ بهره , نرخ تورم, ریکاوری, و نوع صنعت و ریسک کشورها اثر عکس روی ریسک اعتباری داردو پوشش, وثی...

15 صفحه اول

the evaluation and comparison of two esp textbooks available on the iranian market for teaching english to the students of medicine

abstract this study evaluated and compared medical terminology and english for the students of medicine (ii) as two representatives of the textbooks available on the iranian market for teaching english to the students of medicine. this research was performed on the basis of a teacher’s and a number of students’ attitudes and the students’ needs analysis for two reasons: first, to investigate...

15 صفحه اول

My Resources

Save resource for easier access later

Save to my library Already added to my library

{@ msg_add @}


Journal title

volume 21  issue 4

pages  195- 202

publication date 2019-12

By following a journal you will be notified via email when a new issue of this journal is published.

Keywords

No Keywords

Hosted on Doprax cloud platform doprax.com

copyright © 2015-2023