Performance is not enough: a story of the Rashomon's quartet
From MaRDI portal
Publication:68943
DOI10.48550/ARXIV.2302.13356arXiv2302.13356MaRDI QIDQ68943FDOQ68943
Authors: Przemysław Biecek, Hubert Baniecki, Mateusz Krzyzinski, Dianne Cook 
Publication date: 26 February 2023
Abstract: Predictive modelling is often reduced to finding the best model that optimizes a selected performance measure. But what if the second-best model describes the data equally well but in a completely different way? What about the third? Is it possible that the most effective models learn completely different relationships in the data? Inspired by Anscombe's quartet, this paper introduces Rashomon's quartet, a synthetic dataset for which four models from different classes have practically identical predictive performance. However, their visualization reveals drastically distinct ways of understanding the correlation structure in data. The introduced simple illustrative example aims to further facilitate visualization as a mandatory tool to compare predictive models beyond their performance. We need to develop insightful techniques for the explanatory analysis of model sets.
Cited In (1)
This page was built for publication: Performance is not enough: a story of the Rashomon's quartet
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q68943)
