TCSLib

1 Boolean Analysis — Core Definitions

1.1 Overview

This chapter develops the Fourier–Walsh theory of Boolean functions \(f : \{ 0,1\} ^n \to \mathbb {R}\). The uniform probability measure on \(\{ 0,1\} ^n\) endows the space of Boolean functions with an \(L^2\) inner product \(\langle f, g\rangle = \mathbb {E}[fg]\). The Walsh characters \(\chi _S(x) = \prod _{i\in S}(-1)^{x_i}\), indexed by subsets \(S\subseteq [n]\), form an orthonormal basis for this space, yielding the Walsh–Fourier expansion \(f = \sum _S \hat f(S)\, \chi _S\).

The main results are:

  • Walsh expansion (Fourier inversion).

  • Parseval’s identity: \(\| f\| ^2 = \sum _S \hat f(S)^2\).

  • Influence via Fourier: \(\mathrm{Inf}_i[f] = \sum _{S\ni i}\hat f(S)^2\).

  • Total influence: \(I[f] = \sum _S |S|\, \hat f(S)^2\).

  • Noise operator in the Fourier domain: \(\widehat{T_\rho f}(S) = \rho ^{|S|}\hat f(S)\).

Reference: Ryan O’Donnell, Analysis of Boolean Functions, Cambridge University Press, 2014.

1.2 The Boolean hypercube and functions

Definition 1.1 Boolean hypercube
#

The Boolean hypercube of dimension \(n\) is \(\{ 0,1\} ^n\), represented as the function type \(\mathrm{Fin}\, n \to \mathrm{Bool}\).

Definition 1.2 Boolean function
#

A Boolean function of arity \(n\) is a function \(f : \{ 0,1\} ^n \to \mathbb {R}\).

1.3 Uniform measure and expectation

Definition 1.3 Uniform weight
#

The uniform probability measure on \(\{ 0,1\} ^n\) assigns weight \(2^{-n}\) to each point.

Definition 1.4 Expectation
#

The expectation of \(f\) under the uniform measure:

\[ \mathbb {E}[f] \; =\; 2^{-n}\sum _{x\in \{ 0,1\} ^n} f(x). \]
Definition 1.5 \(L^2\) inner product
#

The \(L^2\) inner product of two Boolean functions with respect to the uniform measure:

\[ \langle f, g\rangle \; =\; \mathbb {E}[f\cdot g] \; =\; 2^{-n}\sum _{x\in \{ 0,1\} ^n} f(x)\, g(x). \]
Definition 1.6 \(L^2\) norm
#

The \(L^2\) norm of \(f\): \(\| f\| = \sqrt{\langle f,f\rangle }\).

Lemma 1.7 Inner product is symmetric
#

\(\langle f, g\rangle = \langle g, f\rangle \).

Lemma 1.8 Inner product is nonneg on the diagonal
#

\(\langle f, f\rangle \ge 0\).

Lemma 1.9 Inner product is linear in the first argument
#

\(\langle f + g, h\rangle = \langle f, h\rangle + \langle g, h\rangle \).

1.4 Walsh–Fourier characters

Definition 1.10 Sign encoding
#

The sign encoding maps \(\mathrm{Bool}\) to \(\{ -1,1\} \subset \mathbb {R}\):

\[ \sigma (b) \; =\; \begin{cases} 1 & b = \texttt{false},\\ -1 & b = \texttt{true}. \end{cases} \]
Lemma 1.11 Basic sign identities
#

\(\sigma (\texttt{false}) = 1\), \(\sigma (\texttt{true}) = -1\), \(\sigma (b)^2 = 1\), and \(\sigma (\lnot b) = -\sigma (b)\).

Definition 1.12 Walsh character
#

The Walsh–Fourier character associated to \(S\subseteq [n]\) is

\[ \chi _S(x) \; =\; \prod _{i\in S}(-1)^{x_i} \; =\; \prod _{i\in S}\sigma (x_i). \]

The family \(\{ \chi _S\} _{S\subseteq [n]}\) forms an orthonormal basis for \(L^2(\{ 0,1\} ^n,\mathrm{uniform})\).

Lemma 1.13 Character of the empty set
#

\(\chi _\varnothing \equiv 1\).

Lemma 1.14 Character of a singleton
#

\(\chi _{\{ i\} }(x) = \sigma (x_i)\).

Lemma 1.15 Characters take values in \(\{ -1,1\} \)
#

\(\chi _S(x)^2 = 1\) for all \(S\) and \(x\).

Lemma 1.16 Characters are multiplicative on disjoint sets
#

If \(S\) and \(T\) are disjoint then \(\chi _{S\cup T}(x) = \chi _S(x)\cdot \chi _T(x)\).

Lemma 1.17 Product of two characters
#

\(\chi _S(x)\cdot \chi _T(x) = \chi _{S\mathbin {\triangle } T}(x)\), where \(\triangle \) denotes symmetric difference.

Lemma 1.18 Character under global bit flip
#

Flipping all bits multiplies the character by \((-1)^{|S|}\):

\[ \chi _S(\lnot x) \; =\; (-1)^{|S|}\, \chi _S(x). \]
Lemma 1.19 Count of Walsh characters
#

There are exactly \(2^n\) Walsh characters, matching the dimension of \(L^2(\{ 0,1\} ^n)\).

1.5 Fourier coefficients

Definition 1.20 Fourier coefficient
#

The Fourier–Walsh coefficient of \(f\) at frequency \(S\) is

\[ \hat f(S) \; =\; \langle f, \chi _S\rangle \; =\; 2^{-n}\sum _{x\in \{ 0,1\} ^n} f(x)\, \chi _S(x). \]
Lemma 1.21 Fourier coefficient at \(\varnothing \) equals expectation
#

\(\hat f(\varnothing ) = \mathbb {E}[f]\).

1.6 Walsh expansion

Theorem 1.22 Walsh expansion
#

Every Boolean function \(f:\{ 0,1\} ^n\to \mathbb {R}\) has the unique representation

\[ f(x) \; =\; \sum _{S\subseteq [n]} \hat f(S)\, \chi _S(x). \]

This is the Fourier inversion formula for the uniform measure on \(\{ 0,1\} ^n\).

1.7 Orthonormality and Parseval’s identity

Theorem 1.23 Orthonormality of Walsh characters
#

The Walsh characters form an orthonormal system:

\[ \langle \chi _S, \chi _T\rangle \; =\; [S = T]. \]
Lemma 1.24 Self inner product of a character is 1
#

\(\langle \chi _S, \chi _S\rangle = 1\).

Theorem 1.25 Parseval’s identity
#

The squared \(L^2\) norm of \(f\) equals the sum of squared Fourier coefficients:

\[ \| f\| ^2 \; =\; \langle f, f\rangle \; =\; \sum _{S\subseteq [n]} \hat f(S)^2. \]

1.8 Coordinate influence

Definition 1.26 Bit flip
#

The point \(x^i\in \{ 0,1\} ^n\) obtained from \(x\) by flipping the \(i\)-th coordinate.

Definition 1.27 Influence
#

The influence of coordinate \(i\) on \(f\) measures how often flipping bit \(i\) changes the output:

\[ \mathrm{Inf}_i[f] \; =\; \mathbb {E}\! \left[\frac{(f(x)-f(x^i))^2}{4}\right]. \]

For \(\pm 1\)-valued \(f\) this equals \(\Pr [f(x)\ne f(x^i)]\).

Definition 1.28 Total influence
#

\(I[f] = \sum _{i=1}^n \mathrm{Inf}_i[f]\).

Lemma 1.29 Influence of a Walsh character
#

\(\mathrm{Inf}_i[\chi _S] = [i\in S]\).

Theorem 1.30 Influence via Fourier coefficients
#
\[ \mathrm{Inf}_i[f] \; =\; \sum _{\substack {S\subseteq [n]\\ i\in S}} \hat f(S)^2. \]
Theorem 1.31 Total influence via Fourier coefficients
#
\[ I[f] \; =\; \sum _{S\subseteq [n]} |S|\, \hat f(S)^2. \]
Lemma 1.32 Influence is at most 1
#

For any \(\pm 1\)-valued function and any coordinate \(i\), \(\mathrm{Inf}_i[f] \le 1\).

Lemma 1.33 Average influence lower bound
#

There exists a coordinate \(i\) with \(\mathrm{Inf}_i[f] \ge I[f]/n\).

1.9 Noise operator

Definition 1.34 Noise operator
#

The noise operator \(T_\rho \) with parameter \(\rho \in [-1,1]\), defined via the Fourier domain by

\[ T_\rho f(x) \; =\; \sum _{S\subseteq [n]} \rho ^{|S|}\, \hat f(S)\, \chi _S(x). \]

Probabilistically, \(T_\rho f(x) = \mathbb {E}_y[f(y)]\) where each bit of \(y\) agrees with \(x_i\) with probability \(\tfrac {1+\rho }{2}\) and is flipped with probability \(\tfrac {1-\rho }{2}\), independently.

Theorem 1.35 Noise operator in the Fourier domain
#
\[ \widehat{T_\rho f}(S) \; =\; \rho ^{|S|}\, \hat f(S). \]
Theorem 1.36 Stability formula
#
\[ \langle f, T_\rho f\rangle \; =\; \sum _{S\subseteq [n]} \rho ^{|S|}\, \hat f(S)^2. \]

1.10 Notable Boolean functions

Definition 1.37 Dictator
#

The dictator function for coordinate \(i\) outputs the sign of the \(i\)-th bit: \(\mathrm{dict}_i(x) = (-1)^{x_i}\). Its unique nonzero Fourier coefficient is \(\widehat{\mathrm{dict}_i}(\{ i\} ) = 1\).

Lemma 1.38 Dictator equals singleton character
#

\(\mathrm{dict}_i = \chi _{\{ i\} }\).

Definition 1.39 Parity
#

The parity function \(f(x) = (-1)^{x_1+\cdots +x_n}\) satisfies \(\hat f([n]) = 1\) and \(\hat f(S) = 0\) for \(S\ne [n]\).

Lemma 1.40 Parity equals full character
#

\(\mathrm{parity}_n = \chi _{[n]}\).

Definition 1.41 Majority
#

The majority function on \(\{ 0,1\} ^{2k+1}\) outputs \(1\) if more than half the inputs are \(\texttt{false}\), and \(-1\) otherwise.

1.11 Sensitivity

Definition 1.42 Sensitivity at a point
#

The sensitivity of \(f\) at \(x\) is the number of coordinates \(i\) such that flipping bit \(i\) changes \(f(x)\).

Definition 1.43 Maximum sensitivity
#

The maximum sensitivity of \(f\) over all inputs.

1.12 Properties for Arrow’s theorem

Definition 1.44 Odd function
#

A Boolean function \(f\) is odd if \(f(\lnot x) = -f(x)\) for all \(x\). This models antisymmetry of pairwise preferences in social choice.

Definition 1.45 \(\pm 1\)-valued function
#

\(f\) is \(\pm 1\)-valued if \(f(x)\in \{ -1,1\} \) for all \(x\).

Lemma 1.46 Odd functions have zero even-level Fourier coefficients
#

If \(f\) is odd and \(|S|\) is even, then \(\hat f(S) = 0\).

Lemma 1.47 Self inner product of a \(\pm 1\) function
#

If \(f\) is \(\pm 1\)-valued then \(\langle f, f\rangle = 1\).

Lemma 1.48 Parseval for \(\pm 1\)-valued functions
#

If \(f\) is \(\pm 1\)-valued then \(\sum _{S\subseteq [n]}\hat f(S)^2 = 1\).

Definition 1.49 Fourier weight at level \(k\)
#

The Fourier weight at level \(k\) is

\[ W_k[f] \; =\; \sum _{\substack {S\subseteq [n]\\ |S|=k}} \hat f(S)^2. \]