ChatGPT Evaluation Dataset v.2.0

From MaRDI portal
(Redirected from Dataset:6696495)



DOI10.5281/zenodo.14019715Zenodo14019715MaRDI QIDQ6696495FDOQ6696495

Dataset published at Zenodo repository.

Jan Kocoń, Przemysław Kazienko

Copyright license: Creative Commons Attribution 4.0 International



We tested ChatGPT on 25 tasks focusing on solving common NLP problems and requiring analytical reasoning. These tasks include (1) a relatively simple binary classification of texts like spam, humor, sarcasm, aggression detection, or grammatical correctness of the text; (2) a more complex multiclass and multi-label classification of texts such as sentiment analysis, emotion recognition; (3) reasoning with the personal context, i.e., personalized versions of the problems that make use of additional information about text perception of a given user (users examples provided to ChatGPT); (4) semantic annotation and acceptance of the text going towards natural language understanding (NLU) like word sense disambiguation (WSD), and (5) answering questions based on the input text. More information in the paper: https://www.sciencedirect.com/science/article/pii/S156625352300177X







This page was built for dataset: ChatGPT Evaluation Dataset v.2.0