Storage Codes With Flexible Number of Nodes

DOI10.1109/TIT.2022.3222736MaRDI QIDQ6196121zbMATH OpenFDO

Authors Weiqi Li, Zhiying Wang, Hamid Jafarkhani

Publication date 14 March 2024

Published in IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2106.11336

zbMATH Keywords

flexible storage codesmaximum distance separable (MDS) codeminimum storage regenerating (MSR)Reed-Solomon code

Mathematics Subject Classification ID

Linear codes (general theory) (94B05) Other types of codes (94B60)

Abstract: This paper presents flexible storage codes, a class of error-correcting codes that can recover information from a flexible number of storage nodes. As a result, one can make a better use of the available storage nodes in the presence of unpredictable node failures and reduce the data access latency. Let us assume a storage system encodes $kell$ information symbols over a finite field $mathbbF$ into $n$ nodes, each of size $ell$ symbols. The code is parameterized by a set of tuples $(R_j,k_j,el{l}_j):1lejlea$, satisfying $k_{1}el{l}_1=k_{2}el{l}_2=\mathrm{...}=k_{a}el{l}_a$ and $k_1>k_2>\mathrm{...}>k_a=k,el{l}_a=ell$, such that the information symbols can be reconstructed from any $R_j$ nodes, each node accessing $el{l}_j$ symbols. In other words, the code allows a flexible number of nodes for decoding to accommodate the variance in the data access time of the nodes. Code constructions are presented for different storage scenarios, including LRC (locally recoverable) codes, PMDS (partial MDS) codes, and MSR (minimum storage regenerating) codes. We analyze the latency of accessing information and perform simulations on Amazon clusters to show the efficiency of presented codes.

This page was built for publication: Storage Codes With Flexible Number of Nodes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6196121)