Improper priors are used frequently, but often formally and without reference to a sound theoretical basis. The present paper demonstrates that Kolmogorov’s (1933) formulation of probability theory admits a minimal generalization which includes improper priors and a general Bayes theorem. The resulting theory is closely related to the theory of conditional probability spaces formulated by Renyi...