References on Low Density Parity Check Codes

Robert Gallager's original work on low density parity check codes was published as the following book, based his doctoral dissertation, and a related paper:

Gallager, R. G. (1963) Low Density Parity Check Codes, Cambridge, MA: MIT Press.

Gallager, R. G. (1962) ``Low-density parity-check codes'', IRE Transactions on Information Theory, vol. IT-8, pp. 21-28.

More recent work on these codes by David MacKay and myself was published as follows:

MacKay, D. J. C. and Neal, R. M. (1996) ``Near Shannon limit performance of low density parity check codes'', Electronics Letters, vol. 32, pp. 1645-1646. Reprinted with printing errors corrected in vol. 33, pp. 457-458.

MacKay, D. J. C. (1999) ``Good error-correcting codes based on very sparse matrices'', IEEE Transactions on Information Theory, vol. 45, pp. 399-431.

The decoding algorithms described in the above references can visualized in terms of a ``factor graph'' representation of the code, as described in the following paper:

Kschischang, F. R., Frey, B. J., and Loeliger, H.-A. (1998) ``Factor graphs and the sum-product algorithm'', IEEE Transactions on Information Theory, vol. 47, pp. 498-519.

I presented the application of sparse matrix techniques to encoding of LDPC codes at the IMA workshop on Codes, Systems and Graphical Models, Minneapolis, 1999. You can view the slides of this talk here. Note: Due to a bug in the program I used then, the results shown for the minimal product heuristic in these slides are somewhat worse than the actual performance. For instance, the number of bit operations per check bit for for M=3200 with 3 checks per bit is actually around 12.7, not the value around 17 shown on one of the slides.

Text and references to many more recent and classical papers can be obtained via the IMA workshop's web page.

Back to index for LDPC software