TCSLib

3 Hamming Bound

3.1 Overview

This chapter establishes the Hamming (sphere-packing) bound: for a code \(C\) of block-length \(n\) and minimum distance \(d\) over a \(q\)-ary alphabet \(\alpha \),

\[ |C| \; \cdot \; \mathrm{Vol}(n,\lfloor (d-1)/2\rfloor ) \; \le \; q^n, \]

where \(\mathrm{Vol}(n,t) = \sum _{i=0}^{t}\binom {n}{i}(q-1)^i\).

3.2 Volume formula

Theorem 3.1 Cardinality of Hamming balls
#

For any center \(c\) and radius \(l\),

\[ |B_l(c)| \; =\; \sum _{i=0}^{l} \binom {n}{i}\, (|\alpha |-1)^i. \]

3.3 Disjointness of decoding balls

Lemma 3.2 Decoding balls around distinct codewords are disjoint

If \(C\) has minimum distance \(d\gt 0\), then for distinct \(c_1,c_2\in C\),

\[ B_{\lfloor (d-1)/2\rfloor }(c_1) \; \cap \; B_{\lfloor (d-1)/2\rfloor }(c_2) \; =\; \varnothing . \]
Lemma 3.3 formulation
#

Reformulation of the previous lemma as .

3.4 Hamming bound

Theorem 3.4 Hamming (sphere-packing) bound
#

Let \(q=|\alpha |\gt 1\). If \(C\subseteq \alpha ^n\) has minimum distance \(d\gt 0\), then

\[ |C| \; \le \; \frac{q^n}{\displaystyle \sum _{i=0}^{\lfloor (d-1)/2\rfloor }\binom {n}{i}(q-1)^i}. \]