We consider constructing probability forecasts from a parametric binary choice model under a large family of loss functions (“scoring rules”). Scoring rules are weighted averages over the utilities that heterogeneous decision makers derive from a publicly announced forecast (Schervish, 1989). Using analytical and numerical examples, we illustrate howdifferent scoring rules yield asymptotically identical results if the model is correctly specified. Under misspecification, the choice of scoring rule may be inconsequential under restrictive symmetry conditions on the data-generating process. If these conditions are violated, typically the choice of a scoring rule favors some decision makers over others.

This is an open-access article distributed under the terms of the Creative Commons Attribution NonCommercial 3.0 Unported License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. For a full description of the license, please visit https://creativecommons.org/licenses/by/3.0/legalcode

Supplementary data