TCSLib

149 Boolean Analysis — LMN Concentration

149.1 Overview

This module composes the two halves of the Linial–Mansour–Nisan argument: the multi-switching collapse of a bounded-depth circuit to a shallow decision tree under a Bernoulli-random restriction, and the transfer from likely shallowness under restriction to Fourier concentration. The result is that a circuit of depth \(d\), size \(s\), and fan-in \(w\) has its Fourier spectrum \(4\varepsilon \)-concentrated — up to Chernoff tail terms vanishing as \(n \to \infty \) — below degree \(O\! \left(w \log (s/\varepsilon )^{d-2} \log (1/\varepsilon )\right)\).

149.2 Declarations

Let \(C\) be a Boolean circuit on \(n \ge 1\) input bits with depth at most \(d\), size at most \(s\), and gate fan-in at most \(w\), where \(d \ge 2\) and \(s, w \ge 1\). Let \(l \ge 1\) and \(t\) be natural numbers, and let \(\varepsilon \gt 0\) be a real number such that the switching parameters satisfy \(s \cdot 2^{-l} \le \varepsilon /2\) and \(2^{-t} \le \varepsilon /2\). Write \(\delta = \frac{1}{40w}\bigl(\frac{1}{40l}\bigr)^{d-2}\) for the composed restriction rate, \(\sigma \) for the sign encoding of a bit (\(\sigma (\mathtt{false}) = 1\), \(\sigma (\mathtt{true}) = -1\)), and \(\widehat{\sigma \circ C}(U)\) for the Fourier–Walsh coefficient at \(U \subseteq [n]\) of the \(\pm 1\)-encoding of the function computed by \(C\). Then the Fourier weight above degree \(3(t+1)/\delta \) is small:

\[ \sum _{\substack {U \subseteq [n] \\ 3(t+1) \le \delta \, \left\lvert U\right\rvert }} \widehat{\sigma \circ C}(U)^2 \; \le \; 4\left(\varepsilon + s\, e^{-n/(120 w)} + s\, e^{-n/(120 l)}\right). \]
Lemma 149.2 The concentration threshold in explicit form
✓

Let \(w \ge 1\), \(l \ge 1\), and \(d\) be natural numbers, let \(a\) be a real number, and let \(m\) be a natural number. Writing \(\delta = \frac{1}{40w}\bigl(\frac{1}{40l}\bigr)^{d-2}\), where the exponent \(d-2\) is taken to be \(0\) when \(d \le 2\), the inequality \(a \le \delta m\) holds if and only if

\[ a \cdot 40 w \, (40 l)^{d-2} \; \le \; m. \]

(Taking \(a = 3(t+1)\) with \(t \approx \log _2(1/\varepsilon )\) and \(l \approx \log _2(s/\varepsilon )\), this exhibits the LMN degree threshold as \(O\! \left(w \log (s/\varepsilon )^{d-2} \log (1/\varepsilon )\right)\).)

Let \(C\) be a Boolean circuit on \(n \ge 1\) input bits with depth at most \(d\), size at most \(s\), and gate fan-in at most \(w\), where \(d \ge 2\) and \(s, w \ge 1\), and let \(\varepsilon \) be a real number with \(0 \lt \varepsilon \le 1\). Set \(l = \lceil \log _2(2s/\varepsilon ) \rceil \) and \(t = \lceil \log _2(2/\varepsilon ) \rceil \), and write \(\delta = \frac{1}{40w}\bigl(\frac{1}{40l}\bigr)^{d-2}\), \(\sigma \) for the sign encoding of a bit (\(\sigma (\mathtt{false}) = 1\), \(\sigma (\mathtt{true}) = -1\)), and \(\widehat{\sigma \circ C}(U)\) for the Fourier–Walsh coefficient at \(U \subseteq [n]\) of the \(\pm 1\)-encoding of the function computed by \(C\). Then

\[ \sum _{\substack {U \subseteq [n] \\ 3(t+1) \le \delta \, \left\lvert U\right\rvert }} \widehat{\sigma \circ C}(U)^2 \; \le \; 4\left(\varepsilon + s\, e^{-n/(120 w)} + s\, e^{-n/(120 l)}\right); \]

that is, the Fourier spectrum of \(\sigma \circ C\) is concentrated — up to Chernoff tail terms that vanish as \(n \to \infty \) — below degree \(3\bigl(\lceil \log _2(2/\varepsilon )\rceil + 1\bigr) \cdot 40 w \, \bigl(40\lceil \log _2(2s/\varepsilon )\rceil \bigr)^{d-2} = O\! \left(w \log (s/\varepsilon )^{d-2} \log (1/\varepsilon )\right)\).