bdpar

Big Data Preprocessing Architecture

David Ruano-Ordás, Miguel Ferreiro-Díaz, José Ramón Méndez Reboredo, Tomás R. Cotos-Yañez

Last update: 12 December 2023

Copyright license: GNU General Public License, version 3.0

Software version identifier: 3.0.3, 1.0.0, 1.0.1, 2.0.0, 3.0.0, 3.0.1, 3.0.2, 3.1.0

Description

Provide a tool to easily build customized data flows to pre-process large volumes of information from different sources. To this end, 'bdpar' allows to (i) easily use and create new functionalities and (ii) develop new data source extractors according to the user needs. Additionally, the package provides by default a predefined data flow to extract and pre-process the most relevant information (tokens, dates, ... ) from some textual sources (SMS, Email, YouTube comments).

This page was built for software: bdpar