Abstract
We consider constructing probability forecasts from a parametric binary choice model under a large family of loss functions (“scoring rules”). Scoring rules are weighted averages over the utilities that heterogeneous decision makers derive from a publicly announced forecast (Schervish, 1989). Using analytical and numerical examples, we illustrate howdifferent scoring rules yield asymptotically identical results if the model is correctly specified. Under misspecification, the choice of scoring rule may be inconsequential under restrictive symmetry conditions on the data-generating process. If these conditions are violated, typically the choice of a scoring rule favors some decision makers over others.
Issue Section:
Articles
External Supplements
© 2016 by The President and Fellows of Harvard College and the Massachusetts Institute of Technology. Published under a Creative Commons Attribution = NonCommercial 3.0 Unported (CC BY = NC 3.0) License.
2016
The President and Fellows of Harvard College and the Massachusetts Institute of Technology
This is an open-access article distributed under the terms of the Creative Commons Attribution NonCommercial 3.0 Unported License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. For a full description of the license, please visit https://creativecommons.org/licenses/by/3.0/legalcode