scoringutils (Q1350345): Difference between revisions
From MaRDI portal
Changed an Item |
Swh import (talk | contribs) SWHID from Software Heritage |
||||||||||||||
(22 intermediate revisions by 4 users not shown) | |||||||||||||||
Property / last update | |||||||||||||||
| |||||||||||||||
Property / last update: 30 January 2023 / rank | |||||||||||||||
Property / author | |||||||||||||||
Property / author: Nikos I. Bosse / rank | |||||||||||||||
Property / author | |||||||||||||||
Property / author: Sam Abbott / rank | |||||||||||||||
Property / author | |||||||||||||||
Property / author: Hugo Gruson / rank | |||||||||||||||
Property / copyright license | |||||||||||||||
Property / copyright license: MIT license / rank | |||||||||||||||
Property / copyright license | |||||||||||||||
Property / copyright license: File License / rank | |||||||||||||||
Property / copyright license: File License / qualifier | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: ggdist / rank | |||||||||||||||
Property / imports: ggdist / qualifier | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: ggplot2 / rank | |||||||||||||||
Property / imports: ggplot2 / qualifier | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: lifecycle / rank | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: methods / rank | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: stats / rank | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: data.table / rank | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: rlang / rank | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: scoringRules / rank | |||||||||||||||
Property / cites work | |||||||||||||||
Property / cites work: Strictly Proper Scoring Rules, Prediction, and Estimation / rank | |||||||||||||||
Property / cites work | |||||||||||||||
Property / cites work: Evaluating Probabilistic Forecasts with scoringRules / rank | |||||||||||||||
Property / cites work | |||||||||||||||
Property / cites work: Assessing the performance of real-time epidemic forecasts: A case study of Ebola in the Western Area region of Sierra Leone, 2014-15 / rank | |||||||||||||||
Property / depends on software | |||||||||||||||
Property / depends on software: R / rank | |||||||||||||||
Property / software version identifier | |||||||||||||||
0.1.0 | |||||||||||||||
Property / software version identifier: 0.1.0 / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / software version identifier: 0.1.0 / qualifier | |||||||||||||||
publication date: 14 June 2020
| |||||||||||||||
Property / software version identifier | |||||||||||||||
0.1.4 | |||||||||||||||
Property / software version identifier: 0.1.4 / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / software version identifier: 0.1.4 / qualifier | |||||||||||||||
publication date: 17 November 2020
| |||||||||||||||
Property / software version identifier | |||||||||||||||
0.1.7.2 | |||||||||||||||
Property / software version identifier: 0.1.7.2 / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / software version identifier: 0.1.7.2 / qualifier | |||||||||||||||
publication date: 21 July 2021
| |||||||||||||||
Property / software version identifier | |||||||||||||||
0.1.7 | |||||||||||||||
Property / software version identifier: 0.1.7 / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / software version identifier: 0.1.7 / qualifier | |||||||||||||||
publication date: 14 July 2021
| |||||||||||||||
Property / software version identifier | |||||||||||||||
1.0.0 | |||||||||||||||
Property / software version identifier: 1.0.0 / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / software version identifier: 1.0.0 / qualifier | |||||||||||||||
publication date: 13 May 2022
| |||||||||||||||
Property / software version identifier | |||||||||||||||
1.0.1 | |||||||||||||||
Property / software version identifier: 1.0.1 / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / software version identifier: 1.0.1 / qualifier | |||||||||||||||
publication date: 17 August 2022
| |||||||||||||||
Property / software version identifier | |||||||||||||||
1.2.2 | |||||||||||||||
Property / software version identifier: 1.2.2 / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / software version identifier: 1.2.2 / qualifier | |||||||||||||||
publication date: 29 November 2023
| |||||||||||||||
Property / last update | |||||||||||||||
29 November 2023
| |||||||||||||||
Property / last update: 29 November 2023 / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / description | |||||||||||||||
Provides a collection of metrics and proper scoring rules (Tilmann Gneiting & Adrian E Raftery (2007) <doi:10.1198/016214506000001437>, Jordan, A., Krüger, F., & Lerch, S. (2019) <doi:10.18637/jss.v090.i12>) within a consistent framework for evaluation, comparison and visualisation of forecasts. In addition to proper scoring rules, functions are provided to assess bias, sharpness and calibration (Sebastian Funk, Anton Camacho, Adam J. Kucharski, Rachel Lowe, Rosalind M. Eggo, W. John Edmunds (2019) <doi:10.1371/journal.pcbi.1006785>) of forecasts. Several types of predictions (e.g. binary, discrete, continuous) which may come in different formats (e.g. forecasts represented by predictive samples or by quantiles of the predictive distribution) can be evaluated. Scoring metrics can be used either through a convenient data.frame format, or can be applied as individual functions in a vector / matrix format. All functionality has been implemented with a focus on performance and is robustly tested. Find more information about the package in the accompanying paper (<doi:10.48550/arXiv.2205.07090>). | |||||||||||||||
Property / description: Provides a collection of metrics and proper scoring rules (Tilmann Gneiting & Adrian E Raftery (2007) <doi:10.1198/016214506000001437>, Jordan, A., Krüger, F., & Lerch, S. (2019) <doi:10.18637/jss.v090.i12>) within a consistent framework for evaluation, comparison and visualisation of forecasts. In addition to proper scoring rules, functions are provided to assess bias, sharpness and calibration (Sebastian Funk, Anton Camacho, Adam J. Kucharski, Rachel Lowe, Rosalind M. Eggo, W. John Edmunds (2019) <doi:10.1371/journal.pcbi.1006785>) of forecasts. Several types of predictions (e.g. binary, discrete, continuous) which may come in different formats (e.g. forecasts represented by predictive samples or by quantiles of the predictive distribution) can be evaluated. Scoring metrics can be used either through a convenient data.frame format, or can be applied as individual functions in a vector / matrix format. All functionality has been implemented with a focus on performance and is robustly tested. Find more information about the package in the accompanying paper (<doi:10.48550/arXiv.2205.07090>). / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / author | |||||||||||||||
Property / author: Nikos I. Bosse / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / author | |||||||||||||||
Property / author: Sam Abbott / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / author | |||||||||||||||
Property / author: Hugo Gruson / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / author | |||||||||||||||
Property / author: Sebastian Funk / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / copyright license | |||||||||||||||
Property / copyright license: MIT license / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / copyright license | |||||||||||||||
Property / copyright license: File License / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / copyright license: File License / qualifier | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: data.table / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: ggdist / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / imports: ggdist / qualifier | |||||||||||||||
software version identifier: ≥ 3.2.0 | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: ggplot2 / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / imports: ggplot2 / qualifier | |||||||||||||||
software version identifier: ≥ 3.4.0 | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: lifecycle / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: methods / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: rlang / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: scoringRules / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / imports | |||||||||||||||
Property / imports: stats / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / cites work | |||||||||||||||
Property / cites work: Strictly Proper Scoring Rules, Prediction, and Estimation / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / cites work | |||||||||||||||
Property / cites work: Evaluating Probabilistic Forecasts with scoringRules / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / cites work | |||||||||||||||
Property / cites work: Assessing the performance of real-time epidemic forecasts: A case study of Ebola in the Western Area region of Sierra Leone, 2014-15 / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / cites work | |||||||||||||||
Property / cites work: Evaluating Forecasts with scoringutils in R / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / MaRDI profile type | |||||||||||||||
Property / MaRDI profile type: MaRDI software profile / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / depends on software | |||||||||||||||
Property / depends on software: R / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / depends on software: R / qualifier | |||||||||||||||
software version identifier: ≥ 3.6 | |||||||||||||||
Property / Software Heritage ID | |||||||||||||||
Property / Software Heritage ID: swh:1:snp:dc1ba2571e25c433b52ed33019c75765c536508c / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / Software Heritage ID: swh:1:snp:dc1ba2571e25c433b52ed33019c75765c536508c / qualifier | |||||||||||||||
Property / Software Heritage ID: swh:1:snp:dc1ba2571e25c433b52ed33019c75765c536508c / qualifier | |||||||||||||||
point in time: 15 December 2023
| |||||||||||||||
links / mardi / name | links / mardi / name | ||||||||||||||
Latest revision as of 00:06, 14 March 2024
Utilities for Scoring and Assessing Predictions
Language | Label | Description | Also known as |
---|---|---|---|
English | scoringutils |
Utilities for Scoring and Assessing Predictions |
Statements
29 November 2023
0 references
Provides a collection of metrics and proper scoring rules (Tilmann Gneiting & Adrian E Raftery (2007) <doi:10.1198/016214506000001437>, Jordan, A., Krüger, F., & Lerch, S. (2019) <doi:10.18637/jss.v090.i12>) within a consistent framework for evaluation, comparison and visualisation of forecasts. In addition to proper scoring rules, functions are provided to assess bias, sharpness and calibration (Sebastian Funk, Anton Camacho, Adam J. Kucharski, Rachel Lowe, Rosalind M. Eggo, W. John Edmunds (2019) <doi:10.1371/journal.pcbi.1006785>) of forecasts. Several types of predictions (e.g. binary, discrete, continuous) which may come in different formats (e.g. forecasts represented by predictive samples or by quantiles of the predictive distribution) can be evaluated. Scoring metrics can be used either through a convenient data.frame format, or can be applied as individual functions in a vector / matrix format. All functionality has been implemented with a focus on performance and is robustly tested. Find more information about the package in the accompanying paper (<doi:10.48550/arXiv.2205.07090>).
0 references