TCSLib

55 Communication Complexity — Finite Probability Space

55.1 Overview

This module develops the foundational infrastructure for finite probability spaces used in the proof of Newman’s theorem. It introduces the typeclasses CommunicationComplexity.FiniteMeasureSpace and CommunicationComplexity.FiniteProbabilitySpace, and establishes a library of measure-real and integral lemmas (singleton decompositions, Cauchy–Schwarz, Markov’s inequality, product-space factorisation) that are used throughout the complexity-theoretic arguments.

55.2 Declarations

Definition 55.1 Finite measurable space
✓
#

A typeclass for a measurable space \(\Omega \) that is simultaneously finite (carries a Fintype instance) and discrete (every subset is measurable). It deliberately does not bundle a measure, so that a single type can be equipped with many different measures.

Definition 55.2 Constructor for FiniteMeasureSpace
✓

Given a type \(\Omega \) that already carries Fintype and DiscreteMeasurableSpace instances, CommunicationComplexity.FiniteMeasureSpace.of bundles them into a FiniteMeasureSpace record without requiring any additional data.

Definition 55.3 Finite probability space
✓

A typeclass bundling a MeasureSpace structure on \(\Omega \) together with a CommunicationComplexity.FiniteMeasureSpace witness and an IsProbabilityMeasure instance for the canonical volume measure. This makes \(\Omega \) simultaneously a finite discrete measurable space and a probability space.

Definition 55.4 Constructor from existing instances
✓

Given a type \(\Omega \) already equipped with a MeasureSpace, Fintype, DiscreteMeasurableSpace, and IsProbabilityMeasure instance for volume, this helper packages all of those into a CommunicationComplexity.FiniteProbabilitySpace record.

Definition 55.5 Constructor from an explicit measure
✓

Given a finite measurable space \(\Omega \) and an unbundled probability measure \(\mu \) on it, FiniteProbabilitySpace.ofMeasure promotes \(\mu \) to the canonical volume and returns a FiniteProbabilitySpace instance.

Theorem 55.6 Singleton decomposition of a finite measure
✓

Let \(\Omega \) be a finite measurable space — finite and discrete, so that every subset is measurable — and let \(\mu \) be a finite measure on \(\Omega \), writing \(\mu ^{\mathbb {R}}\) for its real-valued mass function. Then for every subset \(S \subseteq \Omega \),

\[ \mu ^{\mathbb {R}}(S) \; =\; \sum _{\omega \in \Omega } \begin{cases} \mu ^{\mathbb {R}}(\{ \omega \} ) & \text{if } \omega \in S, \\ 0 & \text{otherwise.} \end{cases} \]

That is, the measure of \(S\) is the sum of the masses of its individual points.

Theorem 55.7 Measure of a preimage as a sum over fibers
✓

Let \(\Omega \) be a finite discrete measurable space, \(\alpha \) a finite type, \(\mu \) a finite measure on \(\Omega \), \(Z : \Omega \to \alpha \) a function, and \(P\) a predicate on \(\alpha \). Writing \(\mu ^{\mathbb {R}}\) for the real-valued measure obtained from \(\mu \), the measure of the set of points whose image under \(Z\) satisfies \(P\) decomposes as a sum over the fibers of \(Z\):

\[ \mu ^{\mathbb {R}}\{ \omega \mid P(Z(\omega ))\} \; =\; \sum _{z \in \alpha } \begin{cases} \mu ^{\mathbb {R}}\bigl(Z^{-1}\{ z\} \bigr) & \text{if } P(z), \\ 0 & \text{otherwise.} \end{cases} \]
Theorem 55.8 Absolute continuity via singletons
✓

Let \(\Omega \) be a finite measurable space, and let \(\mu \) and \(\nu \) be two measures on \(\Omega \). Then \(\mu \) is absolutely continuous with respect to \(\nu \), written \(\mu \ll \nu \), if and only if for every point \(\omega \in \Omega \) with \(\nu (\{ \omega \} ) = 0\) one also has \(\mu (\{ \omega \} ) = 0\).

Theorem 55.9 Square of the expectation is at most the expectation of the square
✓

Let \(\Omega \) be a finite measurable space, let \(\mu \) be a probability measure on \(\Omega \), and let \(f : \Omega \to \mathbb {R}\) be any real-valued function. Then

\[ \Bigl(\int _\Omega f\, d\mu \Bigr)^{2} \; \le \; \int _\Omega f^{2}\, d\mu . \]
Theorem 55.10 Integral of a discrete-valued function as a sum over fibers
✓

Let \(\Omega \) be a finite measurable space, \(\alpha \) a finite type on which every subset is measurable, \(\mu \) a finite measure on \(\Omega \), and \(Z : \Omega \to \alpha \) and \(f : \alpha \to \mathbb {R}\) any functions. Then

\[ \int _\Omega f(Z(\omega ))\, d\mu (\omega ) \; =\; \sum _{z \in \alpha } \mu \bigl(Z^{-1}(\{ z\} )\bigr)\, f(z), \]

where \(\mu (Z^{-1}(\{ z\} ))\) denotes the real number giving the measure of the fiber \(Z^{-1}(\{ z\} ) = \{ \omega \in \Omega : Z(\omega ) = z\} \).

Theorem 55.11 Law of total probability over the fibers of a random variable
✓

Let \(\Omega \) be a finite measurable space equipped with a finite measure \(\mu \), let \(\alpha \) be a finite set, let \(Z : \Omega \to \alpha \) be a measurable (\(\alpha \)-valued) map, and let \(S \subseteq \Omega \). Writing \(\mu ^{\mathbb {R}}\) for the real-valued measure and \(\mu [\, \cdot \mid A\, ]\) for the measure conditioned on an event \(A\), we have

\[ \mu ^{\mathbb {R}}(S) \; =\; \sum _{z \in \alpha } \mu ^{\mathbb {R}}\bigl(Z^{-1}(\{ z\} )\bigr)\, \cdot \, \mu \bigl[\, \cdot \mid Z^{-1}(\{ z\} )\, \bigr]^{\mathbb {R}}(S), \]

so the total mass of \(S\) is recovered by summing, over the values \(z\) of \(Z\), the mass of the fiber \(Z^{-1}(\{ z\} )\) times the conditional mass of \(S\) given that fiber.

Theorem 55.12 Uniform measure of a set equals its relative cardinality
✓

Let \(\Omega \) be a nonempty finite set, equipped with the uniform probability measure that assigns each point mass \(1/\left\lvert \Omega \right\rvert \), and let \(S \subseteq \Omega \). Then the measure of \(S\), as a real number, is

\[ \frac{\left\lvert \{ \omega \in \Omega \mid \omega \in S\} \right\rvert }{\left\lvert \Omega \right\rvert }, \]

the number of elements of \(\Omega \) lying in \(S\) divided by the total number of elements of \(\Omega \).

Theorem 55.13 Uniform measure of a set as a cardinality ratio
✓

Let \(\Omega \) be a nonempty finite set, equipped with its discrete measurable structure, and let \(S \subseteq \Omega \). Under the uniform probability measure on \(\Omega \), the measure of \(S\), regarded as a real number, equals

\[ \frac{\left\lvert S\right\rvert }{\left\lvert \Omega \right\rvert }, \]

where \(\left\lvert S\right\rvert \) is the number of elements of \(\Omega \) lying in \(S\) and \(\left\lvert \Omega \right\rvert \) is the total number of elements of \(\Omega \).

Theorem 55.14 Nonemptiness of a finite probability space
✓

If a type \(\Omega \) carries the structure of a finite probability space — that is, it is finite and discrete, and is equipped with a probability measure — then \(\Omega \) is nonempty.

Definition 55.15 Probability mass function of a finite probability space
✓

For a finite probability space \(\Omega \), toPMF converts the canonical volume measure to a probability mass function \(\mathrm{PMF}\, \Omega \), assigning to each \(\omega \) the real weight \(\mu (\{ \omega \} )\).

Theorem 55.16 Measure of a set as a sum of point masses
✓

Let \(\Omega \) be a finite probability space, write \(\mu \) for its canonical probability measure, and let \(p(\omega ) = \mu (\{ \omega \} )\) denote the associated probability mass function. Then for every subset \(S \subseteq \Omega \),

\[ \mu (S) = \sum _{\omega \in S} p(\omega ). \]
Theorem 55.17 Singleton masses of a finite probability space sum to one
✓

Let \(\Omega \) be a finite probability space, so that \(\Omega \) is finite and discrete and its canonical volume measure \(\mathbb {P}\) is a probability measure, and let \(\alpha \) be a finite type equipped with a bijection \(e : \Omega \xrightarrow {\sim } \alpha \). Then the family of singleton masses \(\bigl(\mathbb {P}(\{ e^{-1}(a)\} )\bigr)_{a \in \alpha }\) is summable with sum \(1\).

Theorem 55.18 Probability mass function of a product factors
✓

Let \(\Omega _1\) and \(\Omega _2\) be finite probability spaces, and give the product \(\Omega _1 \times \Omega _2\) its induced finite probability space structure. Then for every \(x \in \Omega _1\) and \(y \in \Omega _2\), the probability mass function of the product assigns to the pair \((x, y)\) the product of the individual masses; that is, its value at \((x, y)\) equals the value of the mass function of \(\Omega _1\) at \(x\) times the value of the mass function of \(\Omega _2\) at \(y\).

Theorem 55.19 Product measure of a rectangle
✓

Let \(\Omega _1\) and \(\Omega _2\) be finite probability spaces, with respective probability measures \(\mathbb {P}_1\) and \(\mathbb {P}_2\), and let \(A \subseteq \Omega _1\) and \(B \subseteq \Omega _2\) be any subsets. Then, under the product probability measure \(\mathbb {P}\) on \(\Omega _1 \times \Omega _2\), the measure of the rectangle \(A \times B\) factors as

\[ \mathbb {P}(A \times B) \; =\; \mathbb {P}_1(A) \cdot \mathbb {P}_2(B), \]

where each quantity is taken as a real number.

Theorem 55.20 Finite additivity of the probability measure
✓

Let \(\Omega \) be a finite probability space and let \(\iota \) be a finite index set. If \((A_i)_{i \in \iota }\) is a pairwise disjoint family of subsets of \(\Omega \), then the probability of their union is the sum of their probabilities:

\[ \mathbb {P}\! \Bigl(\bigcup _{i \in \iota } A_i\Bigr) \; =\; \sum _{i \in \iota } \mathbb {P}(A_i), \]

where \(\mathbb {P}(\, \cdot \, ) \in \mathbb {R}\) denotes the real-valued probability measure of \(\Omega \).

Theorem 55.21 Measure of a preimage of a finite set
✓

Let \(\Xi \) be a finite probability space and let \(\Omega \) be a measurable space in which every subset is measurable. For any map \(\varphi \colon \Xi \to \Omega \) and any finite set \(T \subseteq \Omega \), the probability that \(\varphi \) lands in \(T\) decomposes as a sum over the points of \(T\):

\[ \mathrm{volume}^{\mathbb {R}}\bigl(\varphi ^{-1}(T)\bigr) \; =\; \sum _{a \in T} \mathrm{volume}^{\mathbb {R}}\bigl(\varphi ^{-1}(\{ a\} )\bigr), \]

where \(\mathrm{volume}^{\mathbb {R}}\) denotes the real-valued measure of the underlying probability measure on \(\Xi \).

Theorem 55.22 Additivity of the measure over a finite set
✓

Let \(\Omega \) be a finite probability space, and let \(T\) be a finite subset of \(\Omega \). Writing \(\mathbb {P}\) for the real-valued probability measure on \(\Omega \), the measure of \(T\) is the sum of the measures of its singletons:

\[ \mathbb {P}(T) \; =\; \sum _{a \in T} \mathbb {P}(\{ a\} ). \]
Theorem 55.23 Integral as a probability-weighted sum on a finite probability space
✓

Let \(\Omega \) be a finite probability space, and let \(p(\omega )\) denote the probability mass it assigns to each point \(\omega \in \Omega \). Then for every function \(f \colon \Omega \to \mathbb {R}\),

\[ \int _\Omega f(\omega )\, d\omega \; =\; \sum _{\omega \in \Omega } p(\omega )\, f(\omega ), \]

so that the expectation of \(f\) under the canonical probability measure equals the finite \(p\)-weighted sum of its values.

Theorem 55.24 Squared mean at most mean of square on a finite probability space
✓

Let \(\Omega \) be a finite probability space, and let \(f\colon \Omega \to \mathbb {R}\) be any real-valued function. Then the square of the expectation of \(f\) is at most the expectation of its square:

\[ \Bigl(\int _\Omega f\, \Bigr)^2 \; \le \; \int _\Omega f^2, \]

where both integrals are taken with respect to the underlying probability measure.

Theorem 55.25 Marginal of a coordinate integral over a product space
✓

Let \(\iota \) be a finite index type and let \(\Omega \) be a finite probability space, so that the product \(\Omega ^{\iota }\) of copies of \(\Omega \) indexed by \(\iota \) carries the corresponding product probability measure. Fix an index \(i \in \iota \) and a function \(f : \Omega \to \mathbb {R}\). Then integrating the map \(\omega _{\bullet } \mapsto f(\omega _i)\) against the product measure on \(\Omega ^{\iota }\) gives the same value as integrating \(f\) against the measure on \(\Omega \):

\[ \int _{\Omega ^{\iota }} f(\omega _i) \, d\omega _{\bullet } \; =\; \int _{\Omega } f(\omega )\, d\omega . \]
Theorem 55.26 Product measure of a box factorises
✓

Let \(\iota \) be a finite index set, and for each \(i \in \iota \) let \(\Omega _i\) be a finite probability space carrying its canonical probability measure. For any choice of subsets \(s_i \subseteq \Omega _i\), the product measure on the finite product \(\prod _{i \in \iota } \Omega _i\) assigns to the box \(\prod _{i \in \iota } s_i\) the value

\[ \mathbb {P}\! \Bigl(\prod _{i \in \iota } s_i\Bigr) \; =\; \prod _{i \in \iota } \mathbb {P}(s_i), \]

where both sides are read as real numbers.

Theorem 55.27 Measure of a set as the integral of its indicator
✓

Let \(\Omega \) be a finite probability space and let \(S \subseteq \Omega \). Then the (real-valued) probability of \(S\) equals the integral over \(\Omega \) of the indicator function of \(S\), taken with value \(1\) on \(S\) and \(0\) elsewhere:

\[ \mathbb {P}(S) \; =\; \int _{\Omega } \mathbf{1}_S(\omega )\, d\omega , \]

where \(\mathbf{1}_S \colon \Omega \to \mathbb {R}\) is the function equal to \(1\) at points of \(S\) and \(0\) at points outside \(S\).

Theorem 55.28 Probability as the integral of an indicator
✓

Let \(\Omega \) be a finite probability space and let \(S \subseteq \Omega \) be any subset. Then the probability of \(S\) equals the integral of the indicator function of \(S\) against the probability measure:

\[ \mathbb {P}(S) \; =\; \int _\Omega \bigl(\text{if } \omega \in S \text{ then } 1 \text{ else } 0\bigr)\, d\omega , \]

where the left-hand side is the real number obtained from the measure of \(S\).

Theorem 55.29 Probability mass function sums to one
✓

Let \(\Omega \) be a finite probability space, and for each \(\omega \in \Omega \) let \(p(\omega )\) denote the weight that the associated probability mass function assigns to \(\omega \), viewed as a real number. Then these weights sum to one:

\[ \sum _{\omega \in \Omega } p(\omega ) = 1. \]
Theorem 55.30 Nonnegativity of probability mass weights
✓

Let \(\Omega \) be a finite probability space, and let \(\mu (\{ \omega \} )\) denote the probability mass that its associated probability mass function assigns to a point \(\omega \in \Omega \). Then this weight, taken as a real number, is nonnegative:

\[ 0 \le \mu (\{ \omega \} ). \]
Theorem 55.31 Existence of a point of positive mass
✓

Let \(\Omega \) be a finite probability space, and let \(\mu \) denote its associated probability mass function, assigning to each point \(\omega \in \Omega \) the real weight \(\mu (\{ \omega \} ) \ge 0\). Then there exists a point \(\omega \in \Omega \) with \(\mu (\{ \omega \} ) \gt 0\).

Theorem 55.32 Pointwise upper bound descends to the integral
✓

Let \(\Omega \) be a finite probability space, and let \(f : \Omega \to \mathbb {R}\) be a function satisfying \(f(\omega ) \le c\) for every \(\omega \in \Omega \), where \(c \in \mathbb {R}\) is a constant. Then the integral of \(f\) with respect to the probability measure on \(\Omega \) satisfies \(\int _\Omega f \le c\).

Theorem 55.33 Markov’s inequality on a finite probability space
✓

Let \(\Omega \) be a finite probability space and let \(f : \Omega \to \mathbb {R}\) be a nonnegative function, so that \(f(\omega ) \ge 0\) for every \(\omega \in \Omega \). Then for every real \(\varepsilon \gt 0\), the probability that \(f\) attains at least \(\varepsilon \) is bounded by the mean of \(f\) divided by \(\varepsilon \):

\[ \mathbb {E}\! \left[\, \{ \omega \mid \varepsilon \le f(\omega )\} \, \right] \; \le \; \frac{\int _\Omega f(\omega )\, d\omega }{\varepsilon }. \]

Let \(\Omega \) be a finite probability space and let \(f : \Omega \to \mathbb {R}\) be a function. If there is a constant \(c \in \mathbb {R}\) with \(c \lt f(\omega )\) for every \(\omega \in \Omega \), then \(c \lt \int _\Omega f\), where the integral is taken with respect to the probability measure on \(\Omega \).