Understanding data flow graph for improving big data stream computing environments

DOI10.1504/IJCSM.2014.066446MaRDI QIDQ2221573zbMATH OpenOpenAlexFDO

Authors Dawei Sun, Ge Fu, Xinran Liu, Dongfeng Ren

Publication date 2 February 2021

Published in International Journal of Computing Science and Mathematics (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1504/ijcsm.2014.066446

zbMATH Keywords

big datadata flow graphhigh real timehigh throughputstream computing

Mathematics Subject Classification ID

Network design and communication in computer systems (68M10) Modes of computation (nondeterministic, parallel, interactive, probabilistic, etc.) (68Q10) Graph theory (including graph drawing) in computer science (68R10)

Review text

Summary: High throughput issue is one of the major obstacles for opening up the new big data stream computing era. A high throughput big data stream computing system is need, optimising the data flow graph is an important way to offer a high throughput computing environment in big data stream computing system. In this paper, the definition of data flow graph in big data stream computing is given and the properties of data flow graph are systematically analysed by referring to the stream computing theories. A series of optimisation strategies for data flow graph in big data stream computing environments are put forward, all those strategies will greatly improve the structure of data flow graph, and provide a high throughput environment for big data stream computing.

Recommendations

• Building a fault tolerant framework with deadline guarantee in big data stream computing environments
• Optimizing end-to-end performance of data-intensive computing pipelines in heterogeneous network environments
• Formalizing compute-aggregate problems in cloud computing
• Distributed Resource Allocation in Stream Processing Systems
• Exploring complex and big data

Cites work

• Formalisation of the multigrid computations
• Mathematical modelling and computer simulation of steady state heat conduction in anisotropic multi-layered bodies
• MHD flow and heat transfer over a stretching porous sheet subject to power law heat flux in the presence of chemical reaction and viscous dissipation
• Study of convergence of homotopy perturbation method for two-dimensional linear Volterra integral equations of the first kind

This page was built for publication: Understanding data flow graph for improving big data stream computing environments

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2221573)