The validity and reliability of script concordance test in otolaryngology residency training

Introduction: The script concordance test (SCT) is one the besttools used to evaluate clinical reasoning in ill-defined clinicalsituations. The aim of this study was to demonstrate SCTapplication in otolaryngology residency training.Methods: A 20 item otolaryngology SCT containing 60 questionswas administered to 26 otolaryngology residents. The test wasprepared by two otolaryngologists familiar to medical education.These questions have been validated by otolaryngologyexperts. The panel consisted of 9 academic staff in the field ofotolaryngology. Pearson correlation test was used to assess thereliability of the test.Results: The obtained mean scores were 68.4±5.8 (out of 100)for residents and 78.2±6.4 (out of 100) for experts. There wasa significant difference between the two scores (p<0.005).Cronbach’s alpha value was 0.80.Conclusion: The SCT is a reliable tool to evaluate clinicalreasoning in otolaryngology residents. It should be included inotolaryngology residency training.Keywords: Training; Otolaryngology; Validity; Reliability