TCSLib

326 Boolean Analysis — Threshold Functions — Linear Threshold Influence

326.1 Overview

Discrete differentiation identifies the influence of a unate sign function with its singleton Fourier coefficient. Affine threshold representations then give a square-root bound on total influence.

326.2 Declarations

Lemma 326.1 A coordinate update leaves or flips a bit
✓

Let \(n\ge 0\), \(x\in \{ 0,1\} ^n\), \(i\in [n]\), and \(b\in \{ 0,1\} \). Replacing \(x_i\) by \(b\) leaves \(x\) unchanged if \(x_i=b\) and otherwise gives the vector obtained by flipping bit \(i\).

Lemma 326.2 Discrete derivative through a bit flip
✓

Let \(n\ge 0\) and give \(\{ 0,1\} ^n\) uniform probability; write \(\mathbb E\) for expectation. For a real cube function \(h\), write \(D_i h(x)=\tfrac 12(h(x_{i\leftarrow 0})-h(x_{i\leftarrow 1}))\), where \(x_{i\leftarrow b}\) replaces bit \(i\) by \(b\). For every coordinate \(i\) and point \(x\), \(D_i h(x)=\tfrac 12(h(x)-h(x^{\{ i\} }))(-1)^{x_i}\), where \(x^{\{ i\} }\) flips bit \(i\).

Lemma 326.3 Influence is the derivative second moment
✓

Let \(n\ge 0\) and give \(\{ 0,1\} ^n\) uniform probability; write \(\mathbb E\) for expectation. For a real cube function \(h\), write \(D_i h(x)=\tfrac 12(h(x_{i\leftarrow 0})-h(x_{i\leftarrow 1}))\), where \(x_{i\leftarrow b}\) replaces bit \(i\) by \(b\). Set \(I_i(h)=\tfrac 14\mathbb E[(h(x)-h(x^{\{ i\} }))^2]\) and \(I(h)=\sum _i I_i(h)\), where \(x^{\{ i\} }\) flips bit \(i\). For every real cube function \(h\) and \(i\in [n]\), \(I_i(h)=\mathbb E[(D_i h)^2]\).

Lemma 326.4 Coordinate averaging preserves the mean
✓

Let \(n\ge 0\) and give \(\{ 0,1\} ^n\) uniform probability; write \(\mathbb E\) for expectation. Let \(g\) be a real cube function and \(i\in [n]\), and define \(E_i g(x)=\tfrac 12(g(x_{i\leftarrow 0})+g(x_{i\leftarrow 1}))\), where the indicated update replaces bit \(i\). Then \(\mathbb E[E_i g]=\mathbb E g\).

Let \(n\ge 0\) and give \(\{ 0,1\} ^n\) uniform probability; write \(\mathbb E\) for expectation. Put \(\chi _S(x)=\prod _{i\in S}(-1)^{x_i}\) and \(\widehat h(S)=\mathbb E[h\chi _S]\) for \(S\subseteq [n]\) and real cube functions \(h\). For a real cube function \(h\), write \(D_i h(x)=\tfrac 12(h(x_{i\leftarrow 0})-h(x_{i\leftarrow 1}))\), where \(x_{i\leftarrow b}\) replaces bit \(i\) by \(b\). For every real cube function \(h\) and coordinate \(i\), \(\widehat h(\{ i\} )=\mathbb E[D_i h]\).

Lemma 326.6 Square and absolute value of a sign derivative
✓

Let \(n\ge 0\) and give \(\{ 0,1\} ^n\) uniform probability; write \(\mathbb E\) for expectation. For a real cube function \(h\), write \(D_i h(x)=\tfrac 12(h(x_{i\leftarrow 0})-h(x_{i\leftarrow 1}))\), where \(x_{i\leftarrow b}\) replaces bit \(i\) by \(b\). For any \(h\colon \{ 0,1\} ^n\to \{ -1,1\} \), coordinate \(i\), and cube point \(x\), \((D_i h(x))^2=|D_i h(x)|\).

Let \(n\ge 0\) and give \(\{ 0,1\} ^n\) uniform probability; write \(\mathbb E\) for expectation. Put \(\chi _S(x)=\prod _{i\in S}(-1)^{x_i}\) and \(\widehat h(S)=\mathbb E[h\chi _S]\) for \(S\subseteq [n]\) and real cube functions \(h\). For a real cube function \(h\), write \(D_i h(x)=\tfrac 12(h(x_{i\leftarrow 0})-h(x_{i\leftarrow 1}))\), where \(x_{i\leftarrow b}\) replaces bit \(i\) by \(b\). Set \(I_i(h)=\tfrac 14\mathbb E[(h(x)-h(x^{\{ i\} }))^2]\) and \(I(h)=\sum _i I_i(h)\), where \(x^{\{ i\} }\) flips bit \(i\). If \(h\) is sign-valued and either \(D_i h(x)\ge 0\) for all \(x\) or \(D_i h(x)\le 0\) for all \(x\), then \(I_i(h)=|\widehat h(\{ i\} )|\).

Definition 326.8 Walsh coefficients of an affine form
✓

For \(n\ge 0\), \(c\in \mathbb R\), and \(a\in \mathbb R^n\), the affine coefficient family \(A_{c,a}\) has coefficient \(c\) at \(\varnothing \), coefficient \(a_i\) at \(\{ i\} \), and zero at every set of size greater than one.

Lemma 326.9 Constant coefficient of the affine family
✓

Let \(n\ge 0\). Let \(c\in \mathbb R\), \(a\in \mathbb R^n\), and let \(A_{c,a}(S)\) equal \(c\) for \(S=\varnothing \), \(a_i\) for \(S=\{ i\} \), and zero for all larger \(S\). Then \(A_{c,a}(\varnothing )=c\).

Lemma 326.10 Singleton coefficient of the affine family
✓

Let \(n\ge 0\). Let \(c\in \mathbb R\), \(a\in \mathbb R^n\), and let \(A_{c,a}(S)\) equal \(c\) for \(S=\varnothing \), \(a_i\) for \(S=\{ i\} \), and zero for all larger \(S\). For every \(i\in [n]\), \(A_{c,a}(\{ i\} )=a_i\).

Lemma 326.11 Degree bound for the affine coefficient family
✓

Let \(n\ge 0\). Let \(c\in \mathbb R\), \(a\in \mathbb R^n\), and let \(A_{c,a}(S)\) equal \(c\) for \(S=\varnothing \), \(a_i\) for \(S=\{ i\} \), and zero for all larger \(S\). This coefficient family has degree at most one: \(A_{c,a}(S)=0\) whenever \(|S|\gt 1\).

Lemma 326.12 Affine representation of a linear threshold function
✓

Let \(n\ge 0\) and give \(\{ 0,1\} ^n\) uniform probability; write \(\mathbb E\) for expectation. Put \(\chi _S(x)=\prod _{i\in S}(-1)^{x_i}\) and \(\widehat h(S)=\mathbb E[h\chi _S]\) for \(S\subseteq [n]\) and real cube functions \(h\). Write \(\operatorname {sgn}_+(t)=1\) for \(t\ge 0\) and \(-1\) for \(t\lt 0\). If \(f\) is the sign \(\operatorname {sgn}_+(P)\) of a Walsh polynomial \(P\) whose coefficients vanish on sets larger than one, then there exist real \(c\) and \(a_1,\ldots ,a_n\) such that \(f(x)=\operatorname {sgn}_+(c+\sum _i a_i(-1)^{x_i})\) for every \(x\).

Lemma 326.13 An affine sign is a linear threshold function
✓

Let \(n\ge 0\) and give \(\{ 0,1\} ^n\) uniform probability; write \(\mathbb E\) for expectation. Write \(\operatorname {sgn}_+(t)=1\) for \(t\ge 0\) and \(-1\) for \(t\lt 0\). For every real \(c\) and \(a\in \mathbb R^n\), the function \(x\mapsto \operatorname {sgn}_+(c+\sum _i a_i(-1)^{x_i})\) is a linear threshold function, meaning the sign of a Walsh polynomial with no coefficient above degree one.

Lemma 326.14 Separating a fixed coordinate of an affine form
✓

Let \(n\ge 0\), \(c\in \mathbb R\), \(a\in \mathbb R^n\), \(i\in [n]\), \(x\in \{ 0,1\} ^n\), and \(b\in \{ 0,1\} \). If \(x_{i\leftarrow b}\) replaces bit \(i\) by \(b\), then \(c+\sum _j a_j(-1)^{(x_{i\leftarrow b})_j}=(c+\sum _{j\ne i}a_j(-1)^{x_j})+a_i(-1)^b\).

Lemma 326.15 Every affine threshold derivative has a constant sign
✓

Let \(n\ge 0\) and give \(\{ 0,1\} ^n\) uniform probability; write \(\mathbb E\) for expectation. Write \(\operatorname {sgn}_+(t)=1\) for \(t\ge 0\) and \(-1\) for \(t\lt 0\). For a real cube function \(h\), write \(D_i h(x)=\tfrac 12(h(x_{i\leftarrow 0})-h(x_{i\leftarrow 1}))\), where \(x_{i\leftarrow b}\) replaces bit \(i\) by \(b\). For any real \(c\), \(a\in \mathbb R^n\), and \(i\in [n]\), put \(f(x)=\operatorname {sgn}_+(c+\sum _j a_j(-1)^{x_j})\). Either \(D_i f(x)\ge 0\) for every \(x\), or \(D_i f(x)\le 0\) for every \(x\).

Lemma 326.16 Singleton Fourier energy of a sign function
✓

Let \(n\ge 0\) and give \(\{ 0,1\} ^n\) uniform probability; write \(\mathbb E\) for expectation. Put \(\chi _S(x)=\prod _{i\in S}(-1)^{x_i}\) and \(\widehat h(S)=\mathbb E[h\chi _S]\) for \(S\subseteq [n]\) and real cube functions \(h\). Every \(f\colon \{ 0,1\} ^n\to \{ -1,1\} \) satisfies \(\sum _{i=1}^n\widehat f(\{ i\} )^2\le 1\).

Theorem 326.17 Total influence bound for linear thresholds
✓

Let \(n\ge 0\) and give \(\{ 0,1\} ^n\) uniform probability; write \(\mathbb E\) for expectation. Write \(\operatorname {sgn}_+(t)=1\) for \(t\ge 0\) and \(-1\) for \(t\lt 0\). Set \(I_i(h)=\tfrac 14\mathbb E[(h(x)-h(x^{\{ i\} }))^2]\) and \(I(h)=\sum _i I_i(h)\), where \(x^{\{ i\} }\) flips bit \(i\). If \(f(x)=\operatorname {sgn}_+(c+\sum _i a_i(-1)^{x_i})\) for some real \(c,a_i\), then \(I(f)\le \sqrt n\).