TCSLib

9 Gilbert–Varshamov Bound

9.1 Overview

This chapter proves the Gilbert–Varshamov (GV) existence bound: for any block-length \(n\), dimension \(k\), and distance \(d\), if

\[ k \; \le \; n - \lceil \log _q \mathrm{Vol}(n,d-1)\rceil - 1, \]

then there exists an \(n\times k\) generator matrix whose associated linear code has minimum distance at least \(d\).

The proof is a probabilistic (union-bound) counting argument over random generator matrices.

9.2 Probabilistic bound on low-weight outputs

Theorem 9.1 Weight distribution of a random linear image is dominated by a Hamming ball
✓

Let \(\alpha \) be a finite field, let \(n\) and \(k \ge 1\) be natural numbers, and fix a nonzero codeword \(x \in \alpha ^{k}\) together with an integer \(d \gt 0\). Regard an \(n \times k\) matrix \(G\) over \(\alpha \) as chosen uniformly at random among all \(\left\lvert \alpha \right\rvert ^{nk}\) such matrices, so that the image \(Gx\) is a codeword of length \(n\). Then the probability that \(Gx\) has Hamming weight strictly less than \(d\) is at most the fraction of all codewords of length \(n\) that lie in the Hamming ball of radius \(d-1\) about the all-zero codeword:

\[ \frac{\left\lvert \{ \, G \in \alpha ^{n \times k} : \operatorname {wt}(Gx) \lt d \, \} \right\rvert }{\left\lvert \alpha \right\rvert ^{nk}} \; \le \; \frac{\left\lvert B_{d-1}(\mathbf{0})\right\rvert }{\left\lvert \alpha \right\rvert ^{n}}. \]

9.3 Union bound over bad matrices

Theorem 9.2 Existence bound via union bound
✓

Let \(\alpha \) be a finite nonempty field, let \(n\) and \(k\) be natural numbers with \(k \ge 1\), and let \(d\) be a positive integer. Regard an \(n \times k\) matrix \(G\) over \(\alpha \) as a map sending a message \(x \in \alpha ^{k}\) to the length-\(n\) codeword \(Gx\). Then the number of such matrices \(G\) for which some nonzero message \(x\) has \(\mathrm{wt}(Gx) \lt d\) is at most

\[ (\left\lvert \alpha \right\rvert ^{k} - 1)\cdot \left\lvert \alpha \right\rvert ^{\, nk - n}\cdot \left\lvert B_{d-1}(\mathbf0)\right\rvert , \]

where \(\mathrm{wt}\) denotes Hamming weight and \(B_{d-1}(\mathbf0)\) is the Hamming ball of radius \(d-1\) about the all-zero codeword of length \(n\).

9.4 Gilbert–Varshamov bound

Theorem 9.3 Gilbert–Varshamov bound for linear codes
✓
#

Let \(\alpha \) be a finite field with \(q = \left\lvert \alpha \right\rvert \) elements, and let \(n, k, d\) be natural numbers. Write \(B_{d-1}(\mathbf{0})\) for the Hamming ball of radius \(d-1\) about the all-zero codeword in \(\alpha ^n\), and suppose

\[ k \le n - \bigl\lceil \log _q \left\lvert B_{d-1}(\mathbf{0})\right\rvert \bigr\rceil - 1. \]

Then there exists an \(n \times k\) generator matrix \(G\) over \(\alpha \) such that for every nonzero message \(x \in \alpha ^k\), the codeword \(Gx \in \alpha ^n\) has Hamming weight at least \(d\).