behavior) and analysis of variance, including methods for detecting interactions among variables. A chapter on modeling covers the use of linear regression and related procedures in characterizing system behavior, and the final chapter presents tactics for generalizing from empirical results. One of Cohen’s most important points concerns the goals of empirical AI research. Repeatedly, he asks w...

An emerging empirical methodology bridges the gap between game theory and simulation for practical strategic reasoning. Game-Theoretic Analysis Game-theoretic analysis typically takes at its starting point, most naturally, a description of its subject—the game, a formal model of a multiagent interaction. The recent surge in interest among AI researchers in game theory has led to numerous advanc...

Empirical investigations in the area of AI planning have been focused on a comparatively small set of benchmark tasks. Trying to design larger scale experiments for wellfounded empirical reasoning in that area, one encounters a number of severe problems. While some of these problems are inherent to the field, others have plainly been ignored. In our own work, we have made some first steps towar...

Parallel translations of written texts have long been useful tools for human students of language, and have begun to serve as an intriguing source of data for corpus-based approaches to natural language processing. A source text and its translation can be viewed as a coarse map between the two languages, and an industrious student or clever computer program may wish to refine that mapping so th...

The results of botnet detection methods are usually presented without any comparison. Although it is generally accepted that more comparisons with third-party methods may help to improve the area, few papers could do it. Among the factors that prevent a comparison are the difficulties to share a dataset, the lack of a good dataset, the absence of a proper description of the methods and the lack...

Software engineering is not only about technical solutions. It is to a large extent also concerned with organizational issues, project management and human behaviour. For a discipline like software engineering, empirical methods are crucial, since they allow for incorporating human behaviour into the research approach taken. Empirical methods are common practice in many other disciplines. This ...