A Large-scale Dataset of (Open Source) License Text Variants
DOI10.5281/zenodo.6395957Zenodo6395957MaRDI QIDQ6716134FDOQ6716134
Dataset published at Zenodo repository.
Publication date: 23 March 2022
Copyright license: Creative Commons Attribution 4.0 International
We introduce a large-scale dataset of the complete texts of free/open source software (FOSS) license variants. To assemble it we have collected from the Software Heritage archivethe largest publicly available archive of FOSS source code with accompanying development historyall versions of files whose names are commonly used to convey licensing terms to software users and developers. The dataset consists of 6.5 million unique license files that can be used to conduct empirical studies on open source licensing, training of automated license classifiers, natural language processing (NLP) analyses of legal texts, as well as historical and phylogenetic studies on FOSS licensing. Additional metadata about shipped license files are also provided, making the dataset ready to use in various contexts; they include: file length measures, detected MIME type, detected SPDX license (using ScanCode), example origin (e.g., GitHub repository), oldest public commit in which the license appeared. The dataset is released as open data as an archive file containing all deduplicated license blobs, plus several portable CSV files for metadata, referencing blobs via cryptographic checksums. For more details see the includedREADME file and companion paper: Stefano Zacchiroli.A Large-scale Dataset of (Open Source) License Text Variants. In proceedings of the2022 Mining Software Repositories Conference (MSR 2022). 23-24 May 2022 Pittsburgh, Pennsylvania, United States. ACM 2022. If you use this dataset for research purposes, please acknowledge its use by citing the above paper.
This page was built for dataset: A Large-scale Dataset of (Open Source) License Text Variants
