``On the Practical Use of LDPC Erasure Codes for Distributed Storage Applications''

James S. Plank and Michael G. Thomason.

Technical Report UT-CS-03-510, University of Tennessee, September, 2003.

Available via anonymous ftp to cs.utk.edu in pub/plank/papers/CS-03-510.pdf.

A slightly condensed and more focused version of this paper appears in DSN-2004: The International Conference on Dependable Systems and Networks, Florenct, Italy, June, 2004. Please see http://web.eecs.utk.edu/~jplank/plank/papers/DSN-2004.html for that paper.

Abstract

As peer-to-peer and widely distributed storage systems proliferate, the need to perform efficient erasure coding, instead of replication, is crucial to performance and efficiency. Low-Density Parity-Check (LDPC) codes have arisen as alternatives to standard erasure codes, such as Reed-Solomon codes, trading off vastly improved decoding performance for inefficiencies in the amount of data that must be acquired to perform decoding. The scores of papers written on LDPC codes typically analyze their collective and asymptotic behavior. Unfortunately, their practical application requires the generation and analysis of individual codes for finite systems.

This paper attempts to illuminate the practical considerations of LDPC codes for peer-to-peer and distributed storage systems. The three main types of LDPC codes are detailed, and a huge variety of codes are generated, then analyzed using simulation. This analysis focuses on the performance of individual codes for finite systems, and addresses several important heretofore unanswered questions about employing LDPC codes in real-world systems.

PDF of the paper

Postscript of the paper


Citation Information