TCSLib

20 Boolean Analysis — Circuit Layer Reduction

20.1 Overview

This module proves the core iterative reduction theorem of the LMN argument: under a composed Bernoulli random restriction, a function computed by a bounded-depth, bounded-fan-in circuit has small decision-tree depth with high probability. The proof proceeds by strong induction on the circuit depth \(d\), with a base case (\(d=2\)) handled by the switching lemma and an inductive step (\(d\ge 3\)) that factors the restriction parameter and applies a two-stage argument to the children of the root gate.

20.2 Declarations

Definition 20.1 Composed restriction parameter
✓
#

For a fan-in bound \(w\), a width parameter \(l\), and a depth \(d\), the composed Bernoulli restriction parameter is

\[ \mathrm{composedDelta}(w,l,d) = \frac{1}{40w}\cdot \left(\frac{1}{40l}\right)^{d-2}. \]
Lemma 20.2 Positivity of the composed restriction parameter
✓
#

Let \(w\) be a positive integer fan-in bound, let \(l \gt 0\) be a width parameter, and let \(d\) be any depth. Then the composed Bernoulli restriction parameter

\[ \delta (w,l,d) = \frac{1}{40w}\cdot \left(\frac{1}{40l}\right)^{d-2} \]

is strictly positive.

Lemma 20.3 The composed restriction parameter is at most one
✓
#

Let \(w \ge 1\) be a natural number, let \(l \ge 1\) be a real number, and let \(d \ge 2\) be a natural number. Then the composed Bernoulli restriction parameter satisfies

\[ \frac{1}{40w}\cdot \left(\frac{1}{40l}\right)^{d-2} \le 1. \]
Lemma 20.4 Recursive step for the composed restriction parameter
✓
#

Write \(\delta (w,l,d) = \dfrac {1}{40w}\left(\dfrac {1}{40l}\right)^{d-2}\) for the composed restriction parameter, with fan-in bound \(w\), width parameter \(l\), and depth \(d\). For natural numbers \(w\) and \(l\) and any depth \(d \ge 3\),

\[ \delta (w,l,d) = \frac{1}{40w}\, \delta (l,l,d-1). \]
Lemma 20.5 Recursive step for the composed restriction parameter
✓
#

Fix a fan-in bound \(w\), a width parameter \(l \gt 0\), and a depth \(d \ge 3\), and for these values write \(\delta (w,l,d)\) for the composed Bernoulli restriction parameter, namely \(\delta (w,l,d) = \frac{1}{40w}\left(\frac{1}{40l}\right)^{d-2}\). Then decreasing the depth by one removes a single factor of \(1/(40l)\):

\[ \delta (w,l,d) = \delta (w,l,d-1)\cdot \frac{1}{40l}. \]
Definition 20.6 Layer-2 data
✓
#

A bundle describing the second layer of a circuit over \(n\) variables: a number of gates, a family of DNF formulas indexed by the gates, a common width bound \(\mathrm{width}\gt 0\) such that every gate’s width is at most \(\mathrm{width}\), together with the hypothesis that within each term of each gate distinct literals have distinct variables.

Theorem 20.7 One-step switching bound for a layer-2 DNF circuit
✓

Fix layer-2 data over \(n \ge 1\) Boolean variables: a family of \(N\) gates, each computing a DNF formula, with a common width bound \(w \ge 1\) so that every gate has width at most \(w\). Let \(l \in \mathbb {N}\) and let \(p \in \mathbb {R}\) satisfy \(0 \lt p \le \tfrac {1}{40 w}\) and \(p \le 1\). Consider a Bernoulli(\(p\)) random restriction \(\rho \) on the \(n\) variables, in which each variable is independently left free with probability \(p\) and otherwise fixed to \(0\) or to \(1\), each with probability \(\tfrac {1-p}{2}\). Then the probability that some gate \(i\) has restricted function \(f_i\! \restriction _\rho \) (the gate’s DNF evaluated on the free coordinates, with the fixed coordinates set by \(\rho \)) of decision-tree depth greater than \(l\) satisfies

\[ \mathbb {P}\! \left[\, \exists \, i:\ \mathrm{depth}\big(f_i\! \restriction _\rho \big) \gt l\, \right] \; \le \; N\left(\left(\tfrac {1}{2}\right)^{l} + \exp \! \big(-np/3\big)\right), \]

where \(\mathrm{depth}(g)\) denotes the least depth of a decision tree computing \(g\).

Theorem 20.8 One-step CNF replaceability for a layer of DNF gates
✓

Fix layer-2 data over \(n \ge 1\) variables: a family of \(m\) DNF gates \(G_1, \dots , G_m\) together with a common width bound \(w \gt 0\) satisfying \(\mathrm{width}(G_i) \le w\) for every \(i\). Let \(l \in \mathbb {N}\) and let \(p \in \mathbb {R}\) satisfy \(0 \lt p \le \tfrac {1}{40\, w}\) and \(p \le 1\). Then, under a Bernoulli(\(p\)) random restriction \(\rho \) on the \(n\) variables, the probability that some gate fails the property — that is, the probability that it is *not* the case that for every \(i\) the restricted function \(x \mapsto G_i(\rho .\mathrm{extend}\, x)\) agrees, on all inputs, with some CNF formula of width at most \(l\) — is at most

\[ m\left(\left(\tfrac {1}{2}\right)^{l} + \exp \! \left(-\tfrac {n p}{3}\right)\right). \]
Theorem 20.9 Aggregating per-layer bounds into a total bound
✓
#

Fix a natural number \(m\) and layer sizes \(\ell _1, \dots , \ell _m \in \mathbb {N}\) whose total satisfies \(\sum _{i=1}^m \ell _i \le s\) for some \(s \in \mathbb {N}\). Let \(\alpha \ge 0\) and \(\beta \) be real numbers, and suppose \(a_1, \dots , a_m\) are real quantities with \(a_i \le \ell _i\, \alpha \) for each \(i\), together with a final real quantity \(b\) satisfying \(b \le \beta \). Then

\[ \sum _{i=1}^m a_i + b \; \le \; s\, \alpha + \beta . \]
Lemma 20.10 Restricting by a composed restriction in two stages
✓

Let \(f : (\mathrm{Fin}\, n \to \mathrm{Bool}) \to \mathrm{Bool}\) be a Boolean function on \(n\) variables, and let \(\rho _1, \rho _2\) be two restrictions on those variables, each fixing some coordinates to Boolean values and leaving the rest free. Write \(\rho _1 \circ \rho _2\) for their composition, the restriction that on each coordinate uses the value fixed by \(\rho _1\) when there is one and otherwise the value assigned by \(\rho _2\), and for a restriction \(\rho \) write \(f\! \restriction _\rho \) for the function obtained from \(f\) by fixing the coordinates set by \(\rho \) and evaluating on the remaining free coordinates. Then restricting \(f\) by the composition \(\rho _1 \circ \rho _2\) gives the same function as first restricting \(f\) by \(\rho _1\) and then restricting the function \(f\! \restriction _{\rho _1}\) by \(\rho _2\):

\[ f\! \restriction _{\rho _1 \circ \rho _2} \; =\; \bigl(f\! \restriction _{\rho _1}\bigr)\! \restriction _{\rho _2}. \]
Theorem 20.11 Two-stage bound for composed Bernoulli restrictions
✓

Let \(p_1, p_2 \in (0,1]\), let \(E\) and \(A\) be predicates on restrictions of \(n\) variables, and let \(\beta \ge 0\). For a parameter \(p\) write \(\mathbb {P}_p[\, \cdot \, ]\) for the Bernoulli event probability under a Bernoulli(\(p\)) random restriction, and for two restrictions \(\rho _1, \rho _2\) write \(\rho _1 \ast \rho _2\) for their composition (using the value \(\rho _1\) fixes on each coordinate, and otherwise the value from \(\rho _2\)). Suppose that for every restriction \(\rho _1\) with \(\neg A(\rho _1)\) one has \(\mathbb {P}_{p_2}\! \left[\, E(\rho _1 \ast \rho _2) \, \right] \le \beta \). Then

\[ \mathbb {P}_{p_1 p_2}[E] \; \le \; \mathbb {P}_{p_1}[A] + \beta . \]
Lemma 20.12 Monotonicity of the depth-threshold probability
✓

Fix a parameter \(p\) with \(0 \le p \le 1\), a Boolean function \(f : (\mathrm{Fin}\, n \to \mathrm{Bool}) \to \mathrm{Bool}\), and thresholds \(l_1 \le l_2\). Under a Bernoulli(\(p\)) random restriction \(\rho \) on the \(n\) variables, the probability that the restricted function \(x \mapsto f(\rho .\mathrm{extend}\, x)\) has decision-tree depth strictly greater than \(l_2\) is at most the probability that it has decision-tree depth strictly greater than \(l_1\).

Lemma 20.13 Congruence of the depth-exceedance probability for equal functions
✓

Fix a real parameter \(p\), a threshold \(t \in \mathbb {N}\), and two Boolean functions \(f, g : (\mathrm{Fin}\, n \to \mathrm{Bool}) \to \mathrm{Bool}\) that agree at every input, so \(f(x) = g(x)\) for all \(x\). Draw a Bernoulli(\(p\)) random restriction \(\rho \) of the \(n\) variables, write \(h_\rho \) for the restricted function obtained from a Boolean function \(h\) under \(\rho \), and let \(D(\cdot )\) denote decision-tree depth. Then

\[ \mathbb {P}_p\! \left[\, D(f_\rho ) \gt t\, \right] = \mathbb {P}_p\! \left[\, D(g_\rho ) \gt t\, \right], \]

i.e. the two functions assign the same probability to the event that the restricted function has decision-tree depth strictly greater than \(t\).

Let \(f\colon \{ 0,1\} ^n\to \{ 0,1\} \) be a Boolean function on \(n\ge 1\) variables that is computed by some Boolean circuit of depth at most \(2\), size at most \(s\), and fan-in at most \(w\), where \(w\ge 1\). Fix a real parameter \(p\) with \(0\lt p\le \tfrac {1}{40w}\) (so in particular \(p\le 1\)), and draw a random restriction \(\rho \) in which each of the \(n\) variables is, independently, left free with probability \(p\) and otherwise fixed to the value \(0\) or to the value \(1\), each with probability \(\tfrac {1-p}{2}\). Write \(f_\rho \) for the restriction of \(f\) by \(\rho \) (the function \(x\mapsto f\) evaluated at the assignment agreeing with \(\rho \) on its fixed coordinates and with \(x\) on the free ones), and let \(D(g)\) denote the least depth of a decision tree computing a function \(g\). Then for every \(t\in \mathbb {N}\),

\[ \Pr _{\rho }\! \left[\, D(f_\rho ) \gt t \, \right]\ \le \ \left(\tfrac 12\right)^{t} + \exp \! \left(-\tfrac {np}{3}\right). \]

Let \(f\colon \{ 0,1\} ^n\to \{ 0,1\} \) be a Boolean function on \(n\ge 1\) variables, let \(s,w,l\ge 1\) be positive integers, let \(t\ge 0\), and suppose \(f\) is computed by a Boolean circuit of depth at most \(2\), size at most \(s\), and fan-in at most \(w\). Draw a random restriction \(\rho \) that leaves each variable free independently with probability \(p=\tfrac {1}{40w}\) and otherwise fixes it to \(0\) or \(1\), each with probability \(\tfrac {1-p}{2}\). Writing \(D(g)\) for the least depth of a decision tree computing a Boolean function \(g\), and \(f\! \restriction _\rho \) for the function obtained from \(f\) by substituting the fixed values of \(\rho \) and keeping the free coordinates as inputs, the probability that the restricted function is hard to compute by a shallow decision tree satisfies

\[ \Pr _{\rho }\! \big[\, D(f\! \restriction _\rho ) \gt t\, \big] \le (s-1)\left(\tfrac 12\right)^{l} + \left(\tfrac 12\right)^{t} + (s-1)\exp \! \left(-\tfrac {n}{120w}\right) + s\, \exp \! \left(-\tfrac {n}{120l}\right). \]
Lemma 20.16 Union bound for a random restriction over a list of circuits
✓

Fix a parameter \(p\) with \(0 \le p \le 1\), and consider a Bernoulli\((p)\) random restriction on \(n\) variables, under which each variable is independently left free with probability \(p\) and fixed to each of the two Boolean values with probability \((1-p)/2\). Let \(c_1, \dots , c_m\) be a list of Boolean circuits on \(n\) variables, and for each circuit \(c\) let \(\mathrm{bad}(c, \cdot )\) be a predicate on restrictions. Then the probability that some circuit in the list is bad is at most the sum of the individual probabilities:

\[ \Pr _p\! \left[\exists \, i,\ \mathrm{bad}(c_i, \rho )\right] \; \le \; \sum _{i=1}^{m} \Pr _p\! \left[\mathrm{bad}(c_i, \rho )\right], \]

where each term is the probability, under the same random restriction, that the corresponding predicate holds.

Let \(f:\{ 0,1\} ^n \to \{ 0,1\} \) be a Boolean function on \(n \ge 1\) variables, and fix natural numbers \(d,s,w,l,t\) with \(d \ge 3\) and \(s,w,l \ge 1\). Suppose \(f\) is computed by a Boolean circuit of depth at most \(d\), size at most \(s\), and maximum fan-in at most \(w\). For parameters \(w,l\) and a depth \(e\), write \(\delta _e = \frac{1}{40w}\left(\frac{1}{40l}\right)^{e-2}\) for the composed restriction parameter; let \(D(g)\) denote the decision-tree depth of a Boolean function \(g\), and let \(g|_\rho \) denote its restriction by a restriction \(\rho \). Assume the following inductive hypothesis: for every Boolean function \(g\) on \(n\) variables and every integer \(s' \ge 1\), if \(g\) is computed by a circuit of depth at most \(d-1\), size at most \(s'\), and maximum fan-in at most \(w\), then under a Bernoulli random restriction \(\rho \) with parameter \(\delta _{d-1}\),

\[ \Pr _{\rho }\! \left[D(g|_\rho ) \gt l\right] \le (s'-1)(1/2)^{l} + (1/2)^{l} + (s'-1)\exp \! \left(-\tfrac {n}{120w}\right) + s'\exp \! \left(-\tfrac {n}{120l}\right). \]

Then under a Bernoulli random restriction \(\rho \) with parameter \(\delta _{d}\),

\[ \Pr _{\rho }\! \left[D(f|_\rho ) \gt t\right] \le (s-1)(1/2)^{l} + (1/2)^{t} + (s-1)\exp \! \left(-\tfrac {n}{120w}\right) + s\exp \! \left(-\tfrac {n}{120l}\right). \]

Let \(f\colon \{ 0,1\} ^n\to \{ 0,1\} \) be a Boolean function on \(n\ge 1\) variables, and let \(d\ge 2\), \(s\ge 1\), \(w\ge 1\), and \(l\ge 1\) be positive integers together with an integer threshold \(t\ge 0\). Suppose \(f\) is computed by some Boolean circuit of depth at most \(d\), size at most \(s\) (counting gates and literal leaves), and fan-in at most \(w\). Let \(\rho \) be a Bernoulli random restriction on the \(n\) variables with survival parameter

\[ p = \frac{1}{40w}\left(\frac{1}{40l}\right)^{d-2}, \]

so that each variable is independently left free with probability \(p\) and otherwise fixed to \(0\) or to \(1\), each with probability \((1-p)/2\). Write \(f\restriction _\rho \) for the function obtained from \(f\) by substituting the values \(\rho \) assigns and keeping the free coordinates as inputs, and let \(D(g)\) denote the least depth of a decision tree computing a Boolean function \(g\). Then

\[ \mathbb {P}\! \left[D(f\restriction _\rho ) \gt t\right] \; \le \; (s-1)\left(\tfrac {1}{2}\right)^{l} + \left(\tfrac {1}{2}\right)^{t} + (s-1)\exp \! \left(-\tfrac {n}{120\, w}\right) + s\, \exp \! \left(-\tfrac {n}{120\, l}\right). \]
Theorem 20.19 Random-restriction bound on the decision-tree depth of a small circuit
✓

Let \(f\colon \{ 0,1\} ^n \to \{ 0,1\} \) be a Boolean function on \(n \ge 1\) variables, and let \(d,s,w,l,t \in \mathbb {N}\) satisfy \(d \ge 2\) and \(s,w,l \ge 1\). Suppose \(f\) is computed by some Boolean circuit of depth at most \(d\), size at most \(s\), and maximum fan-in at most \(w\). Write \(f\! \restriction _\rho \) for the restriction of \(f\) by a restriction \(\rho \), and let \(D(g)\) denote the decision-tree depth of a Boolean function \(g\), that is, the least depth of a decision tree computing it. Then, under a Bernoulli random restriction \(\rho \) with parameter \(\delta = \dfrac {1}{40w}\left(\dfrac {1}{40l}\right)^{d-2}\),

\[ \mathbb {P}\bigl[\, D(f\! \restriction _\rho ) \gt t \, \bigr] \; \le \; s\left(\tfrac {1}{2}\right)^{l} + \left(\tfrac {1}{2}\right)^{t} + s\, \exp \! \left(-\tfrac {n}{120w}\right) + s\, \exp \! \left(-\tfrac {n}{120l}\right). \]
Theorem 20.20 Switching-lemma bound on decision-tree depth after a random restriction
✓

Let \(f:\{ 0,1\} ^n\to \{ 0,1\} \) be a Boolean function on \(n\ge 1\) variables, and let \(d,s,w,l,t\) be natural numbers with \(d\ge 2\) and \(s,w,l\ge 1\). Suppose \(f\) is computed by some Boolean circuit of depth at most \(d\), size at most \(s\), and fan-in at most \(w\). Draw a random restriction \(\rho \) on the \(n\) variables in which each variable is independently left free with probability

\[ p \; =\; \frac{1}{40w}\left(\frac{1}{40l}\right)^{d-2}, \]

and is otherwise fixed to \(0\) or to \(1\), each with probability \((1-p)/2\); let \(f\restriction _\rho \) denote the function of the free variables obtained by substituting the fixed values into \(f\). Then the probability that \(f\restriction _\rho \) cannot be computed by any decision tree of depth at most \(t\) satisfies

\[ \mathbb {P}\! \left[\, \text{decision-tree depth of } f\restriction _\rho \gt t\, \right] \; \le \; s\left(\tfrac 12\right)^{l} + \left(\tfrac 12\right)^{t} + s\, \exp \! \left(-\frac{n}{120w}\right) + s\, \exp \! \left(-\frac{n}{120l}\right). \]