The more statistical tests we perform, the more likely we are to reject the null hypothesis when it is true (i.e., a “false alarm,” also called a “Type 1” error). This is a consequence of the logic of hypothesis testing: We reject the null hypothesis for rare events, and the larger the number of tests, the easier it is to find rare events which are false alarms. This problem is called the infla...