TCSLib

319 Boolean Analysis — Threshold Functions: Basic

319.1 Overview

This chapter introduces multilinear polynomial threshold representations, signed parity majorities, and Fourier, distance, and noise quantities on the Boolean cube. It also records elementary properties of uniform expectation and the threshold sign convention that assigns \(1\) to zero.

319.2 Declarations

Definition 319.1 Walsh coefficient representation
✓

For a natural number \(n\), let \(I=\{ 0,\ldots ,n-1\} \) be the coordinate set. A multilinear polynomial on the \(n\)-dimensional Boolean cube is represented by an arbitrary coefficient family \(p:\mathcal P(I)\to \mathbb R\), assigning a real coefficient \(p(S)\) to each subset \(S\subseteq I\).

Definition 319.2 Evaluation in the Walsh basis
✓

Let \(n\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), and let \(p:\mathcal P(I)\to \mathbb R\) be a coefficient family. For \(x\in \{ 0,1\} ^I\), its polynomial value is

\[ P_p(x)=\sum _{S\subseteq I}p(S)\chi _S(x),\qquad \chi _S(x)=\prod _{i\in S}(-1)^{x_i}, \]

where the product over the empty set is \(1\).

Definition 319.3 Bounded multilinear degree
✓

Let \(n,k\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), and \(p:\mathcal P(I)\to \mathbb R\). The coefficient family \(p\) has degree at most \(k\) precisely when \(p(S)=0\) for every \(S\subseteq I\) with \(|S|\gt k\).

Definition 319.4 Sign with positive tie breaking
✓

For every real number \(r\), the threshold sign is the real number

\[ \sigma (r)=\begin{cases} 1,& r\ge 0,\\ -1,& r\lt 0.\end{cases} \]

In particular, zero has threshold sign \(1\).

Definition 319.5 Thresholding a multilinear polynomial
✓

Let \(n\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), and \(p:\mathcal P(I)\to \mathbb R\). The threshold function associated with \(p\) assigns to each \(x\in \{ 0,1\} ^I\) the value \(1\) when \(\sum _{S\subseteq I}p(S)\prod _{i\in S}(-1)^{x_i}\ge 0\), and \(-1\) otherwise. In particular, a zero polynomial value is assigned \(1\).

Definition 319.6 Polynomial sign representation
✓

Let \(n\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), \(f:\{ 0,1\} ^I\to \mathbb R\), and \(p:\mathcal P(I)\to \mathbb R\). The family \(p\) is a polynomial threshold representation of \(f\) precisely when, for every \(x\in \{ 0,1\} ^I\), \(f(x)=\sigma (\sum _{S\subseteq I}p(S)\prod _{i\in S}(-1)^{x_i})\), where \(\sigma (r)=1\) for \(r\ge 0\) and \(\sigma (r)=-1\) for \(r\lt 0\).

Definition 319.7 Degree bounded polynomial threshold functions
✓

Let \(n,k\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), and \(f:\{ 0,1\} ^I\to \mathbb R\). The function \(f\) is a polynomial threshold function of degree at most \(k\) precisely when there exists \(p:\mathcal P(I)\to \mathbb R\) such that \(p(S)=0\) whenever \(|S|\gt k\) and

\[ f(x)=\sigma \! \left(\sum _{S\subseteq I}p(S)\prod _{i\in S}(-1)^{x_i}\right) \quad \text{for every }x\in \{ 0,1\} ^I, \]

where \(\sigma (r)=1\) for \(r\ge 0\) and \(-1\) for \(r\lt 0\).

Definition 319.8 Linear threshold functions
✓

Let \(n\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), and \(f:\{ 0,1\} ^I\to \mathbb R\). The function \(f\) is a linear threshold function precisely when it has a polynomial threshold representation of degree at most one: there exists \(p:\mathcal P(I)\to \mathbb R\) with \(p(S)=0\) for \(|S|\gt 1\) and \(f(x)=\sigma (\sum _{S\subseteq I}p(S)\prod _{i\in S}(-1)^{x_i})\) for every \(x\), where \(\sigma (r)=1\) for \(r\ge 0\) and \(-1\) for \(r\lt 0\).

Definition 319.9 Nonvanishing homogeneous linear representation
✓

Let \(n\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), \(f:\{ 0,1\} ^I\to \mathbb R\), and \(a:I\to \mathbb R\). The weights \(a\) give a homogeneous linear threshold representation of \(f\) precisely when, for every \(x\in \{ 0,1\} ^I\), the sum \(L_a(x)=\sum _{i\in I}a_i(-1)^{x_i}\) is nonzero and \(f(x)=\sigma (L_a(x))\), where \(\sigma (r)=1\) for \(r\ge 0\) and \(-1\) for \(r\lt 0\).

Definition 319.10 Majorities of signed Walsh characters
✓

Let \(n,s\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), and \(f:\{ 0,1\} ^I\to \mathbb R\). The function \(f\) is a majority of \(s\) signed parities precisely when there are subsets \(S_0,\ldots ,S_{s-1}\subseteq I\) and signs \(\varepsilon _j\in \{ -1,1\} \) such that

\[ f(x)=\sigma \! \left(\sum _{j=0}^{s-1}\varepsilon _j\prod _{i\in S_j}(-1)^{x_i}\right) \quad \text{for every }x\in \{ 0,1\} ^I, \]

where repetitions of the subsets are allowed and \(\sigma (r)=1\) for \(r\ge 0\), \(-1\) for \(r\lt 0\); thus ties, including the empty sum when \(s=0\), give the value \(1\).

Definition 319.11 Nonzero coefficient support
✓

Let \(n\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), and \(p:\mathcal P(I)\to \mathbb R\). The support of \(p\) is the finite set \(\operatorname {supp}(p)=\{ S\subseteq I:p(S)\ne 0\} \).

Definition 319.12 Number of nonzero coefficients
✓

Let \(n\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), and \(p:\mathcal P(I)\to \mathbb R\). The sparsity of \(p\) is \(|\{ S\subseteq I:p(S)\ne 0\} |\), the number of its nonzero coefficients.

Definition 319.13 Fourier mass through a level
✓

Let \(n,k\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), and \(f:\{ 0,1\} ^I\to \mathbb R\). Its Fourier weight on levels at most \(k\) is

\[ W^{\le k}(f)=\sum _{\substack {S\subseteq I\\ |S|\le k}}\widehat f(S)^2, \qquad \widehat f(S)=2^{-n}\sum _{x\in \{ 0,1\} ^I}f(x)\prod _{i\in S}(-1)^{x_i}. \]
Definition 319.14 Fourier mass beyond a level
✓

Let \(n,k\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), and \(f:\{ 0,1\} ^I\to \mathbb R\). Its Fourier weight on levels strictly above \(k\) is

\[ W^{\gt k}(f)=\sum _{\substack {S\subseteq I\\ k\lt |S|}}\widehat f(S)^2, \qquad \widehat f(S)=2^{-n}\sum _{x\in \{ 0,1\} ^I}f(x)\prod _{i\in S}(-1)^{x_i}. \]
Definition 319.15 Sum of absolute Fourier coefficients
✓

Let \(n\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), and \(f:\{ 0,1\} ^I\to \mathbb R\). Its spectral one-norm is

\[ \| \widehat f\| _1=\sum _{S\subseteq I}|\widehat f(S)|, \qquad \widehat f(S)=2^{-n}\sum _{x\in \{ 0,1\} ^I}f(x)\prod _{i\in S}(-1)^{x_i}. \]
Definition 319.16 Linear part of the Fourier expansion
✓

Let \(n\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), and \(f:\{ 0,1\} ^I\to \mathbb R\). The degree-one part of \(f\) is the function

\[ f^{=1}(x)=\sum _{i\in I}\widehat f(\{ i\} )(-1)^{x_i}, \qquad \widehat f(\{ i\} )=2^{-n}\sum _{y\in \{ 0,1\} ^I}f(y)(-1)^{y_i}. \]

The constant Fourier coefficient is excluded.

Definition 319.17 Largest absolute coordinate influence
✓

Let \(n\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), and \(f:\{ 0,1\} ^I\to \mathbb R\). The maximum influence is

\[ M(f)=\sup _{i\in I}|\operatorname {Inf}_i(f)|, \qquad \operatorname {Inf}_i(f)=2^{-n}\sum _{x\in \{ 0,1\} ^I} \frac{(f(x)-f(x^{\oplus i}))^2}{4}, \]

where \(x^{\oplus i}\) is obtained by flipping coordinate \(i\), and the supremum over the empty coordinate set is assigned \(0\) when \(n=0\).

Definition 319.18 Uniform probability of disagreement
✓

Let \(n\in \mathbb N\) and let \(f,g:\{ 0,1\} ^n\to \mathbb R\) be arbitrary real-valued functions. Their disagreement probability is \(d(f,g)=2^{-n}|\{ x\in \{ 0,1\} ^n:f(x)\ne g(x)\} |\), using the uniform distribution on the cube.

Definition 319.19 Closeness in disagreement probability
✓

Let \(n\in \mathbb N\), \(f,g:\{ 0,1\} ^n\to \mathbb R\), and \(\varepsilon \in \mathbb R\). The functions \(f\) and \(g\) are \(\varepsilon \)-close precisely when \(2^{-n}|\{ x\in \{ 0,1\} ^n:f(x)\ne g(x)\} |\le \varepsilon \).

Definition 319.20 Maximum absolute function value
✓

Let \(n\in \mathbb N\) and \(f:\{ 0,1\} ^n\to \mathbb R\). The supremum norm of \(f\) is \(\| f\| _\infty =\sup _{x\in \{ 0,1\} ^n}|f(x)|\), equivalently the maximum of \(|f|\) on this finite nonempty cube.

Definition 319.21 Stability under Fourier noise
✓

Let \(n\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), \(f:\{ 0,1\} ^I\to \mathbb R\), and \(\rho \in \mathbb R\). The noise stability at \(\rho \) is

\[ \operatorname {Stab}_\rho (f)=2^{-n}\sum _{x\in \{ 0,1\} ^I} f(x)(T_\rho f)(x), \qquad (T_\rho f)(x)=\sum _{S\subseteq I}\rho ^{|S|}\widehat f(S)\chi _S(x), \]

where \(\chi _S(x)=\prod _{i\in S}(-1)^{x_i}\) and \(\widehat f(S)=2^{-n}\sum _{x\in \{ 0,1\} ^I}f(x)\chi _S(x)\); this quantity is defined for every real \(\rho \).

Definition 319.22 Sensitivity at a real noise parameter
✓

Let \(n\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), \(f:\{ 0,1\} ^I\to \mathbb R\), and \(\delta \in \mathbb R\). The noise sensitivity is the real number

\[ \operatorname {NS}_\delta (f)=\frac{1-2^{-n}\sum _{x\in \{ 0,1\} ^I} f(x)\sum _{S\subseteq I}(1-2\delta )^{|S|}\widehat f(S)\chi _S(x)}{2}, \]

where \(\chi _S(x)=\prod _{i\in S}(-1)^{x_i}\) and \(\widehat f(S)=2^{-n}\sum _{x\in \{ 0,1\} ^I}f(x)\chi _S(x)\); neither \(\delta \in [0,1]\) nor \(f(x)\in \{ -1,1\} \) is required.

Definition 319.23 Parity of a binary inner product
✓

For \(n\in \mathbb N\), a point of \(\{ 0,1\} ^{n+n}\) is written as two blocks \((u,v)\) with \(u,v\in \{ 0,1\} ^n\). The inner-product-mod-two function is \(\operatorname {IP}_n(u,v)=\prod _{i=0}^{n-1}(-1)^{u_i v_i}=(-1)^{\sum _{i=0}^{n-1}u_i v_i}\), so it is \(-1\) exactly when the number of coordinates where both bits are \(1\) is odd; the empty product for \(n=0\) is \(1\).

Definition 319.24 Indicator of prescribed coordinates
✓

Let \(n\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), \(J\subseteq I\), and \(b\in \{ 0,1\} ^I\). The subcube indicator associated with \(J\) and \(b\) is the function taking value \(1\) at \(x\in \{ 0,1\} ^I\) if \(x_i=b_i\) for every \(i\in J\), and value \(0\) otherwise.

Definition 319.25 Indicator of a normalized Hamming halfspace
✓

Let \(n\in \mathbb N\) and \(t\in \mathbb R\). The normalized Hamming-ball indicator takes value \(1\) at \(x\in \{ 0,1\} ^n\) precisely when \(t\le (\sum _{i=0}^{n-1}(-1)^{x_i})/\sqrt n\), and value \(0\) otherwise, including the boundary in the value-\(1\) region. When \(n=0\), the quotient is assigned \(0\), so the function takes value \(1\) exactly when \(t\le 0\).

Lemma 319.26 Monotonicity of uniform averaging
✓

Let \(n\in \mathbb N\) and \(f,g:\{ 0,1\} ^n\to \mathbb R\) satisfy \(f(x)\le g(x)\) for every \(x\). Then \(\mathbb E[f]\le \mathbb E[g]\), where \(\mathbb E[h]=2^{-n}\sum _{x\in \{ 0,1\} ^n}h(x)\) is uniform expectation.

Lemma 319.27 Nonnegative uniform averages
✓

Let \(n\in \mathbb N\) and \(f:\{ 0,1\} ^n\to \mathbb R\) satisfy \(f(x)\ge 0\) for every \(x\). Then \(\mathbb E[f]\ge 0\), where \(\mathbb E[f]=2^{-n}\sum _{x\in \{ 0,1\} ^n}f(x)\).

Lemma 319.28 Average of a constant
✓

For every \(n\in \mathbb N\) and \(c\in \mathbb R\), the uniform expectation of the constant function \(x\mapsto c\) on \(\{ 0,1\} ^n\) equals \(c\): \(2^{-n}\sum _{x\in \{ 0,1\} ^n}c=c\).

Lemma 319.29 Additivity of uniform averaging
✓

Let \(n\in \mathbb N\) and \(f,g:\{ 0,1\} ^n\to \mathbb R\). Then \(\mathbb E[f+g]=\mathbb E[f]+\mathbb E[g]\), where addition of functions is pointwise and \(\mathbb E[h]=2^{-n}\sum _{x\in \{ 0,1\} ^n}h(x)\).

Lemma 319.30 Scalars commute with uniform averaging
✓

Let \(n\in \mathbb N\), \(c\in \mathbb R\), and \(f:\{ 0,1\} ^n\to \mathbb R\). Then \(\mathbb E[cf]=c\mathbb E[f]\), where \((cf)(x)=cf(x)\) and \(\mathbb E[h]=2^{-n}\sum _{x\in \{ 0,1\} ^n}h(x)\).

Lemma 319.31 Negation commutes with uniform averaging
✓

Let \(n\in \mathbb N\) and \(f:\{ 0,1\} ^n\to \mathbb R\). Then \(\mathbb E[-f]=-\mathbb E[f]\), where \((-f)(x)=-f(x)\) and \(\mathbb E[h]=2^{-n}\sum _{x\in \{ 0,1\} ^n}h(x)\).

Lemma 319.32 Subtraction commutes with uniform averaging
✓

Let \(n\in \mathbb N\) and \(f,g:\{ 0,1\} ^n\to \mathbb R\). Then \(\mathbb E[f-g]=\mathbb E[f]-\mathbb E[g]\), where \((f-g)(x)=f(x)-g(x)\) and \(\mathbb E[h]=2^{-n}\sum _{x\in \{ 0,1\} ^n}h(x)\).

Lemma 319.33 Zero average forces pointwise vanishing
✓

Let \(n\in \mathbb N\) and \(f:\{ 0,1\} ^n\to \mathbb R\) satisfy \(f(x)\ge 0\) for every \(x\). If its uniform expectation \(2^{-n}\sum _{x\in \{ 0,1\} ^n}f(x)\) is zero, then \(f(x)=0\) for every \(x\in \{ 0,1\} ^n\).

Lemma 319.34 Sign on the nonnegative half line
✓

Let \(r\in \mathbb R\) satisfy \(r\ge 0\), and define \(\sigma (t)=1\) for \(t\ge 0\) and \(\sigma (t)=-1\) for \(t\lt 0\). Then \(\sigma (r)=1\), including when \(r=0\).

Lemma 319.35 Sign on the negative half line
✓

Let \(r\in \mathbb R\) satisfy \(r\lt 0\), and define \(\sigma (t)=1\) for \(t\ge 0\) and \(\sigma (t)=-1\) for \(t\lt 0\). Then \(\sigma (r)=-1\).

Lemma 319.36 Threshold signs are unit signs
✓

For every \(r\in \mathbb R\), let \(\sigma (r)=1\) when \(r\ge 0\) and \(\sigma (r)=-1\) when \(r\lt 0\). Then \(\sigma (r)=1\) or \(\sigma (r)=-1\).

Lemma 319.37 Absolute size of a threshold sign
✓

For every \(r\in \mathbb R\), define \(\sigma (r)=1\) when \(r\ge 0\) and \(\sigma (r)=-1\) when \(r\lt 0\). Then \(|\sigma (r)|=1\).

Lemma 319.38 Multiplication by sign gives absolute value
✓

For every \(r\in \mathbb R\), define \(\sigma (r)=1\) when \(r\ge 0\) and \(\sigma (r)=-1\) when \(r\lt 0\). Then \(r\sigma (r)=|r|\).

Lemma 319.39 Recovering a number from magnitude and sign
✓

For every \(r\in \mathbb R\), define \(\sigma (r)=1\) when \(r\ge 0\) and \(\sigma (r)=-1\) when \(r\lt 0\). Then \(|r|\sigma (r)=r\).

Lemma 319.40 Order preservation by threshold signs
✓

Let \(r,s\in \mathbb R\) satisfy \(r\le s\), and define \(\sigma (t)=1\) when \(t\ge 0\) and \(\sigma (t)=-1\) when \(t\lt 0\). Then \(\sigma (r)\le \sigma (s)\).

Lemma 319.41 Positive scaling preserves threshold signs
✓

Let \(c,r\in \mathbb R\) with \(c\gt 0\), and define \(\sigma (t)=1\) when \(t\ge 0\) and \(\sigma (t)=-1\) when \(t\lt 0\). Then \(\sigma (cr)=\sigma (r)\).

Lemma 319.42 A nearby number has the prescribed sign
✓

Let \(y,r\in \mathbb R\) with \(y\in \{ -1,1\} \) and \(|y-r|\lt 1\). For \(\sigma (t)=1\) when \(t\ge 0\) and \(\sigma (t)=-1\) when \(t\lt 0\), one has \(\sigma (r)=y\).

Lemma 319.43 Pointwise thresholds take unit sign values
✓

Let \(n\in \mathbb N\) and \(g:\{ 0,1\} ^n\to \mathbb R\), and define \(\sigma (t)=1\) when \(t\ge 0\) and \(\sigma (t)=-1\) when \(t\lt 0\). Then the function \(x\mapsto \sigma (g(x))\) takes values in \(\{ -1,1\} \) at every point of the cube.

Lemma 319.44 Nonnegativity of spectral absolute mass
✓

Let \(n\in \mathbb N\), \(I=\{ 0,\ldots ,n-1\} \), and \(f:\{ 0,1\} ^I\to \mathbb R\). Then its spectral one-norm is nonnegative:

\[ \sum _{S\subseteq I}|\widehat f(S)|\ge 0, \qquad \widehat f(S)=2^{-n}\sum _{x\in \{ 0,1\} ^I}f(x)\prod _{i\in S}(-1)^{x_i}. \]