Occam’s Razor versus Saint’s Triad
نویسنده
چکیده
From the Department of Medicine (A.A.H.) and the Division of Pulmonary and Critical Care Medicine (D.E.M.), Mayo Clinic and Foundation, Rochester, Minn.; the Department of Medicine, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston (S.E.W.); the San Francisco Veterans Affairs Medical Center and the University of California, San Francisco School of Medicine, San Francisco (L.M.T.); and the Ann Arbor Veterans Affairs Health Services Research and Development Center of Excellence and the Department of Internal Medicine, University of Michigan — both in Ann Arbor (S.S.). Address reprint requests to Dr. Saint at Box 0429, 300 NIB, Room 7E08, Ann Arbor, MI 48109-0429, or at [email protected].
منابع مشابه
On the Bayesian “occam Factors” Argument for Occam’s Razor
This paper discusses some of the problematic aspects of the Bayesian first-principles “proof” of Occam’s razor which involves Occam factors. Although it is true that the posterior for a model is reduced due to Occam factors if that model is capable of expressing many functions, the phenomenon need not have anything to do with Occam’s razor. This paper shows this by i) performing reductio ad abs...
متن کاملSharpening Occam's Razor
We provide a new representation-independent formulation of Occam’s razor theorem, based on Kolmogorov complexity. This new formulation allows us to: (i) Obtain better sample complexity than both length-based [4] and VC-based [3] versions of Occam’s razor theorem, in many applications; and (ii) Achieve a sharper reverse of Occam’s razor theorem than that of [5]. Specifically, we weaken the assum...
متن کاملA Syntactic Justification for Occam’s razor
Informally, Occam’s razor states, “Given two hypotheses which equally agree with the observed data, choose the simpler”, and has become a central guiding heuristic in the empirical sciences and in particular machine learning. We criticize previous arguments for the validity of Occam’s razor. The nature of hypotheses spaces is explored and we observe a correlation between the complexity of a con...
متن کاملHow Occam's Razor Provides a Neat Definition of Direct Causation
In this paper we show that the application of Occam’s razor to the theory of causal Bayes nets gives us a neat definition of direct causation. In particular we show that Occam’s razor implies Woodward’s (2003) definition of direct causation, provided suitable intervention variables exist and the causal Markov condition (CMC) is satisfied. We also show how Occam’s razor can account for direct ca...
متن کاملOccam's Razor
The Bayesian paradigm apparently only sometimes gives rise to Occam’s Razor; at other times very large models perform well. We give simple examples of both kinds of behaviour. The two views are reconciled when measuring complexity of functions, rather than of the machinery used to implement them. We analyze the complexity of functions for some linear in the parameter models that are equivalent ...
متن کامل