Crowd4SDG - Crowdsourced image classification and damage assessment
DOI10.5281/zenodo.5535744Zenodo5535744MaRDI QIDQ6700572FDOQ6700572
Dataset published at Zenodo repository.
Barbara Pernici, Jose Luis Fernandez-Marquez, Jesús Cerquides, Amudha Ravi Shankar, Hafiz Budi Firmansyah, Mehmet Oğuz Mülâyim
Publication date: 29 September 2021
Copyright license: Creative Commons Attribution 4.0 International
This data set contains crowdsourced classification and damage assessment of images of an earthquake extracted from social media. A data set of 907 images posted on Twitter related to the 2019 Albanian Earthquake,that are filtered and pre-classified using an automated technique is cross-validated for accuracy by two different crowds. One, digital humanitarian volunteers using the crowdsourcing platform CROWD4EMSand another, paid micro-taskers ofthe Amazon Mechanical Turk. In order to compare and evaluate the efficiency and accuracy of the volunteers and the paid micro taskers, ground truth is established with the help of a team of experts, who validated the same set of data. Parameters considered for volunteer contributions: The dataset was imported to the Crowd4EMS platform for Crowd contribution. In the forum, each volunteer will see the image to be validated along with the tweet text and the link to the original tweet. The user has to validate whether the given image is relevant orirrelevant to the disaster. In case of doubt, the user can refer to the tutorial explaining the relevance or skip the task. Once the images relevance is validated, the user will be asked to label the severity of the impact, as seen in the image. The Automated algorithm has pre-classified the images as severeand minimal damage. The Crowd4EMS platform lets the volunteer label them as severe damage,moderate damage,minimal damage,andno damage.Each task has to be answered at least three times, and the final consensus is taken as per the inter-rater agreement. Parameters considered for micro-taskers contribution:The dataset was imported to the Amazon Mechanical Turk platform for Crowd contribution. In the platform, each worker will see only the image that is to be categorised as follows:The user has to validate whether the given image depictssevere damage, moderate damage, minimal damage, no damageorirrelevant to the disaster. Each task has to be answered at least ten times, and the final consensus is taken as per the inter-rater agreement. Acknowledgements: We want to thank Muhammad ImranofQatar Computing Research Institute for sharing their pre-filtered social media imagery dataset on the Albanian earthquake from the Artificial Intelligence for Disaster Response (AIDR) Platform.We would also like to extend our gratitude to the volunteers for their contribution on the Crowd4EMS Platform.
This page was built for dataset: Crowd4SDG - Crowdsourced image classification and damage assessment
