Constructing reference sets from unstructured, ungrammatical text

DOI10.1613/JAIR.2937zbMATH Open1210.68123arXiv1401.3832OpenAlexW3098451043WikidataQ129518037 ScholiaQ129518037MaRDI QIDQ3563100FDOQ3563100

Authors: Marie-Louise Michelson, Craig A. Knoblock 

Publication date: 31 May 2010

Published in: Journal of Artificial Intelligence Research (Search for Journal in Brave)

Abstract: Vast amounts of text on the Web are unstructured and ungrammatical, such as classified ads, auction listings, forum postings, etc. We call such text "posts." Despite their inconsistent structure and lack of grammar, posts are full of useful information. This paper presents work on semi-automatically building tables of relational information, called "reference sets," by analyzing such posts directly. Reference sets can be applied to a number of tasks such as ontology maintenance and information extraction. Our reference-set construction method starts with just a small amount of background knowledge, and constructs tuples representing the entities in the posts to form a reference set. We also describe an extension to this approach for the special case where even this small amount of background knowledge is impossible to discover and use. To evaluate the utility of the machine-constructed reference sets, we compare them to manually constructed reference sets in the context of reference-set-based information extraction. Our results show the reference sets constructed by our method outperform manually constructed reference sets. We also compare the reference-set-based extraction approach using the machine-constructed reference set to supervised extraction approaches using generic features. These results demonstrate that using machine-constructed reference sets outperforms the supervised methods, even though the supervised methods require training data.

Full work available at URL: https://arxiv.org/abs/1401.3832

Recommendations

• Creating relational data from unstructured and ungrammatical data sources
• AUTOMATIC PATTERN CONSTRUCTION FOR WEB INFORMATION EXTRACTION
• Conceptual-model-based data extraction from multiple-record Web pages
• scientific article; zbMATH DE number 1930115
• scientific article; zbMATH DE number 5855083

zbMATH Keywords

reference setsposts

Mathematics Subject Classification ID

Natural language processing (68T50)

Cited In (2)

• Creating relational data from unstructured and ungrammatical data sources
• Set expansion of contextual semantic relations: an alternative to full corpus annotation for supervised classification

This page was built for publication: Constructing reference sets from unstructured, ungrammatical text

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3563100)