Multiple statistical tests: lessons from a d20

Multiple statistical tests: lessons from a d20

Statistical analyses are often conducted with α= .05. When multiple statistical tests are conducted, this procedure needs to be adjusted to compensate for the otherwise inflated Type I error. In some instances in tabletop gaming, sometimes it is desired to roll a 20-sided die (or 'd20') twice and take the greater outcome. Here I draw from probability theory and the case of a d20, where the prob...

Statistical Inference for Multiple Choice Tests

Finite sample inference procedures are considered for analyzing the observed scores on a multiple choice test with several items, where, for example, the items are dissimilar, or the item responses are correlated. A discrete p-parameter exponential family model leads to a generalized linear model framework and, in a special case, a convenient regression of true score upon observed score. Techni...

Genomics, prior probability, and statistical tests of multiple hypotheses.

Genomic methods have made statistical multiple-test methods important to geneticists and molecular biologists. These tests apply to identification of quantitative trait loci and measurement of changes in RNA or DNA abundance by microarray methods. Recently developed multiple-test methods provide more statistical power when many of the tested null hypotheses are false. At the same time, these me...

Statistical Issues on Multiple Choice Tests in Engineering Assessment

This work studies the psychometric properties of the multiple choice tests used to assess skills in Statistics in the Integrated Masters Degree in Engineering and Industrial Management of the University of Minho. The results show the importance of measuring the quality of the instruments to a fair assessment of the students. Moreover, in the Bologna Process context, multiple choice tests in com...

Statistical tests