CONFERENCE PROCEEDINGS
Advanced Search
Home > Proceedings > Volume 13395 > Article
Open Access Paper
12 November 2024 Research on the equivalence principle and module design of erasure code based on multitenants
Jing Sun
Author Affiliations +
Proceedings Volume 13395, International Conference on Optics, Electronics, and Communication Engineering (OECE 2024) ; 1339536 (2024) https://doi.org/10.1117/12.3049808
Event: International Conference on Optics, Electronics, and Communication Engineering, 2024, Wuhan, China
Abstract
Erasure coding technology can reduce costs, improve data reliability, and enhance the usefulness of the system. This technology has been widely designed and used in distributed storage systems. However, in the case of multi-tenancy, none of the popular distributed storage systems support user-level flexible and configurable encoding modules. To solve the problem that the cost and reliability cannot be controlled by custom encoding parameters, the proof of equivalence principle under different code construction schemes is provided, and then the erasure encoding module under multi-tenancy is designed. This module allows a flexible selection of stripe ratio parameters and code algorithms, and data conversion under different algorithms. Based on the generator polynomial, the code library is provided which is optimized by avx2 instruction sets. Compared with the open-source generator matrix-based code solution, the library can resist silent errors. Finally, the analysis and evaluation of the throughput performance of the three code libraries that support avx2 instruction sets is provided. The experiment results show that ISA-L library could maintain high encoding throughout with the growth of the size of the stripe. The design of the flexible erasure code module under multi-tenancy environment has filled the gap of the distributed storage system in the refined control of cost and reliability.
(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.
Citation Download Citation
Jing Sun "Research on the equivalence principle and module design of erasure code based on multitenants", Proc. SPIE 13395, International Conference on Optics, Electronics, and Communication Engineering (OECE 2024) , 1339536 (12 November 2024); https://doi.org/10.1117/12.3049808
PROCEEDINGS
 8 PAGES
DOWNLOAD PAPER SAVE TO MY LIBRARY
GET CITATION
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Matrices
Design
Distributed computing
Data conversion
Data storage
Reliability
Computer programming
RELATED CONTENT
Subscribe to Digital Library
Receive Erratum Email Alert
Back to Top