From Proper Scoring Rules to Max-Min Optimal Forecast Aggregation
نویسندگان
چکیده
There are many ways to elicit honest probabilistic forecasts from experts. Once those elicited, there aggregate them into a single forecast. Should the choice of elicitation method inform aggregation method? In “From Proper Scoring Rules Max-Min Optimal Forecast Aggregation,” Neyman and Roughgarden establish connection between these two problems. To every they associate that improves as much possible upon forecast randomly chosen expert, in worst case. This association maps most widely used methods (Brier logarithmic scoring) well-known (linear pooling). The authors show number interesting properties this connection, including natural axiomatization obtained through well an algorithm for efficient no-regret learning expert weights.
منابع مشابه
Local Proper Scoring Rules
Scoring rules assess the quality of probabilistic forecasts, by assigning a numerical score based on the predictive distribution and on the event or value that materializes. A scoring rule is proper if it encourages truthful reporting. It is local of order λ if the score depends on the predictive density only through its value and its derivatives of order up to λ at the observation. Previously,...
متن کاملProper Proxy Scoring Rules
Proper scoring rules can be used to incentivize a forecaster to truthfully report her private beliefs about the probabilities of future events and to evaluate the relative accuracy of forecasters. While standard scoring rules can score forecasts only once the associated events have been resolved, many applications would benefit from instant access to proper scores. In forecast aggregation, for ...
متن کاملProper Local Scoring Rules
We investigate proper scoring rules for continuous distributions on the real line. It is known that the log score is the only such rule that depends on the quoted density only through its value at the outcome that materializes. Here we allow further dependence on a finite number m of derivatives of the density at the outcome, and describe a large class of such m-local proper scoring rules: thes...
متن کاملScoring rules for judgment aggregation
This paper introduces a new class of judgment aggregation rules, to be called scoring rules after their famous counterparts in preference aggregation theory. A scoring rule generates the collective judgment set which reaches the highest total scoreacross the individuals, subject to the judgment set having to be rational. Depending on how we de ne scores, we obtain several (old and new) so...
متن کاملAcceptance, Aggregation and Scoring Rules
This article provides a novel perspective on the vexed issue of the relation between probability and rational acceptability, exploiting a recently-noted structural parallel with the problem of judgment aggregation. After offering a number of general desiderata on the relation between finite probability models and sets of accepted sentences in a Boolean sentential language, it is noted that a nu...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Operations Research
سال: 2023
ISSN: ['1526-5463', '0030-364X']
DOI: https://doi.org/10.1287/opre.2022.2414