Aim The earth's land cover is often represented by discrete classes, and predicting shifts between these classes is a major goal in the field. One increasingly common approach is to build models that predict land cover classes with probabilities rather than discrete outcomes. Current assessment approaches have drawbacks when applied to these types of models. In this paper we present a new metric, which assesses agreement betwe...