TCSLib

106 Learning Theory — Convex Minimax Core

106.1 Overview

This module develops the core ingredients for the convex-compact minimax theorem, following Cesa-Bianchi and Lugosi Theorem 7.1 specialized to subsets of \(\mathbb {R}\). It provides the exact minimax value for finite matrix games (derived from the Hedge approximate saddle-point theorem), Jensen-type inequalities for mixed-strategy convex combinations, a sampled-game construction that bridges finite and continuous settings, and the compactness machinery (sublevel sets, finite-intersection property) needed for the infinite-dimensional direction.

106.2 Declarations

Definition 106.1 Arbitrary mixed strategy
✓
#

Given \(n \geq 1\), OnlineLearning.arbitraryMixedStrategy is a concrete element of \(\mathrm{MixedStrategy}(n)\) that places all probability mass on a single arbitrarily chosen action. It is used solely to witness that the type of mixed strategies is nonempty.

Definition 106.2 Lower value of a finite game
✓

For a finite zero-sum game \(G\) with \(M\) row actions and \(N\) column actions, the lower value is

\[ v^- (G) \; =\; \sup _{p \in \Delta _M}\; \inf _{j \in [N]}\; \mathrm{payoffVsPure}(G,p,j), \]

where the row player maximises over mixed strategies and the column player minimises over pure responses.

Definition 106.3 Upper value of a finite game
✓

The upper value of \(G\) is

\[ v^+(G) \; =\; \inf _{q \in \Delta _N}\; \sup _{i \in [M]}\; \mathrm{pureVsPayoff}(G,i,q), \]

where the column player minimises over mixed strategies and the row player maximises over pure responses.

Lemma 106.4 Nonnegativity of the mixed payoff against a pure column
✓

Let \(G\) be a finite two-player zero-sum game with \(M\) row actions and \(N\) column actions, let \(p\) be a mixed row strategy over the \(M\) rows, and let \(j\) be a pure column action. Then the expected payoff of \(p\) against column \(j\) is non-negative:

\[ \sum _{i} p_i \cdot A_{ij} \; \ge \; 0. \]
Lemma 106.5 Expected payoff against a pure column is at most one
✓

Let \(G\) be a finite two-player zero-sum game whose payoff matrix \(A\) has every entry in \([0,1]\), let \(p\) be a mixed row strategy with weights \(p_i\), and let \(j\) be a fixed pure column action. Then the row player’s expected payoff against column \(j\) satisfies

\[ \sum _i p_i \cdot A_{ij} \; \le \; 1. \]
Lemma 106.6 Nonnegativity of a pure row’s expected payoff
✓

Let \(G\) be a finite two-player zero-sum game with \(M\) row actions and \(N\) column actions, whose payoff matrix \(A\) has entries satisfying \(0 \le A_{ij} \le 1\). Fix a pure row action \(i\) and a mixed column strategy \(q\), so its weights \(q_j\) are non-negative and sum to \(1\). Then the expected payoff of row \(i\) against \(q\) is non-negative:

\[ \sum _{j} A_{ij}\, q_j \; \ge \; 0. \]
Lemma 106.7 Pure row payoff against a mixed column is at most one
✓

Let \(G\) be a finite two-player zero-sum game with \(M\) row actions and \(N\) column actions, whose payoff matrix \(A\) satisfies \(0 \le A_{ij} \le 1\) for all entries, and let \(q\) be a mixed column strategy, that is, a probability distribution \(q_1, \dots , q_N\) over the columns. Then for every pure row action \(i\), the expected payoff of row \(i\) against \(q\) satisfies

\[ \sum _{j} A_{ij}\, q_j \; \le \; 1. \]
Lemma 106.8 Row player’s guaranteed payoffs are bounded above
✓

Let \(G\) be a finite two-player zero-sum game with \(M\) row actions and \(N \ge 1\) column actions, whose payoff matrix \((A_{ij})\) satisfies \(0 \le A_{ij} \le 1\) for all \(i,j\). For a mixed row strategy \(p = (p_i)\) over the \(M\) rows, let \(L(p) = \inf _{j} \sum _i p_i A_{ij}\) be the least expected payoff against a pure column, taken over all \(N\) columns. Then the set \(\{ \, L(p) : p \text{ is a mixed strategy over the rows} \, \} \) is bounded above.

Lemma 106.9 Lower boundedness of the row-supremum values
✓

Let \(G\) be a finite two-player zero-sum game with \(M \ge 1\) row actions and \(N\) column actions, whose payoff matrix \(A\) satisfies \(A_{ij} \in [0,1]\) for all \(i,j\). For a mixed column strategy \(q\) (a probability distribution on the \(N\) columns), let

\[ v(q) \; =\; \sup _{i}\, \sum _{j} A_{ij}\, q_j \]

be the best expected payoff that a single pure row can achieve against \(q\). Then the set \(\{ \, v(q) : q \text{ a mixed column strategy}\, \} \) is bounded below.

Lemma 106.10 Weak duality for finite zero-sum games
✓

Let \(G\) be a finite two-player zero-sum game with \(M \geq 1\) row actions and \(N \geq 1\) column actions, given by a payoff matrix \(A_{ij} \in [0,1]\) that the row player seeks to maximise and the column player to minimise. Then the lower value never exceeds the upper value:

\[ \sup _{p \in \Delta _M}\; \min _{j}\; \sum _{i} p_i A_{ij} \; \; \leq \; \; \inf _{q \in \Delta _N}\; \max _{i}\; \sum _{j} A_{ij} q_j, \]

where \(\Delta _M\) and \(\Delta _N\) denote the sets of mixed strategies (probability distributions) over the row and column actions, respectively.

Let \(G\) be a finite two-player zero-sum game with \(M\) row actions and \(N\) column actions, whose payoff matrix \(A = (A_{ij})\) satisfies \(0 \le A_{ij} \le 1\) for all \(i,j\). Suppose \(M \gt 1\) and \(N \ge 1\). Then the lower and upper values of \(G\) coincide:

\[ \sup _{p \in \Delta _M}\; \inf _{j \in [N]}\; \sum _{i} p_i\, A_{ij} \; =\; \inf _{q \in \Delta _N}\; \sup _{i \in [M]}\; \sum _{j} A_{ij}\, q_j, \]

where \(\Delta _M\) and \(\Delta _N\) denote the sets of mixed strategies (probability distributions) over the row and column actions respectively.

Definition 106.12 Convex-compact minimax statement
✓
#

For sets \(X, Y \subseteq \mathbb {R}\) and a payoff function \(f : \mathbb {R}\to \mathbb {R}\to \mathbb {R}\), OnlineLearning.ConvexCompactMinimaxStatement is the proposition

\[ \inf _{x \in X}\, \sup _{y \in Y}\, f(x,y) \; =\; \sup _{y \in Y}\, \inf _{x \in X}\, f(x,y). \]

It is packaged as a named Prop so that intermediate lemmas can refer to it while the proof is built up incrementally.

Definition 106.13 Convex-compact minimax hypotheses
✓

A structure bundling the assumptions of Cesa-Bianchi–Lugosi Theorem 7.1 for \(f : \mathbb {R}\to \mathbb {R}\to \mathbb {R}\) on sets \(X, Y \subseteq \mathbb {R}\): both sets are nonempty, \(X\) is compact and convex, \(Y\) is convex, \(f(\cdot ,y)\) is continuous and convex on \(X\) for every \(y \in Y\), \(f(x,\cdot )\) is concave on \(Y\) for every \(x \in X\), and \(f\) is bounded above and below on \(X \times Y\).

Lemma 106.14 Convex sets are closed under mixed-strategy averages
✓
#

Let \(S \subseteq \mathbb {R}\) be a convex set, let \(p\) be a mixed strategy over \(n\) actions with weights \(p_1, \dots , p_n \ge 0\) satisfying \(\sum _{i=1}^{n} p_i = 1\), and let \(x_1, \dots , x_n \in S\). Then the weighted average \(\sum _{i=1}^{n} p_i\, x_i\) again lies in \(S\).

Lemma 106.15 Jensen’s inequality for a mixed strategy
✓
#

Let \(S \subseteq \mathbb {R}\) be a convex set and let \(g : \mathbb {R}\to \mathbb {R}\) be convex on \(S\). Let \(p\) be a mixed strategy over \(n\) actions, that is, a family of weights \(p_1, \dots , p_n \ge 0\) with \(\sum _{i=1}^{n} p_i = 1\), and let \(x_1, \dots , x_n\) be points of \(S\). Then

\[ g\! \left(\sum _{i=1}^{n} p_i\, x_i\right) \; \le \; \sum _{i=1}^{n} p_i\, g(x_i). \]
Lemma 106.16 Jensen’s inequality for a concave function
✓
#

Let \(S \subseteq \mathbb {R}\) and let \(g : \mathbb {R}\to \mathbb {R}\) be concave on \(S\). Let \(p = (p_1, \dots , p_n)\) be a mixed strategy over \(n\) actions, that is, a tuple of weights \(p_j \ge 0\) with \(\sum _{j=1}^{n} p_j = 1\), and let \(y_1, \dots , y_n\) be points of \(S\). Then

\[ \sum _{j=1}^{n} p_j\, g(y_j) \; \le \; g\! \left(\sum _{j=1}^{n} p_j\, y_j\right). \]
Definition 106.17 Sampled finite game
✓
#

Given a payoff function \(f : \mathbb {R}\to \mathbb {R}\to \mathbb {R}\) with values in \([0,1]\), finite families of row points \(x : [M] \to \mathbb {R}\) and column points \(y : [N] \to \mathbb {R}\), the sampled game is the \(M\times N\) matrix game whose \((i,j)\) entry is \(f(x_i, y_j)\).

Theorem 106.18 Minimax theorem for a sampled finite game
✓

Let \(f : \mathbb {R}\to \mathbb {R}\to \mathbb {R}\) be a payoff function, and let \(x : [M] \to \mathbb {R}\) and \(y : [N] \to \mathbb {R}\) be finite families of row and column points such that \(0 \le f(x_i, y_j) \le 1\) for all \(i\) and \(j\). Suppose the column action set is nonempty (\(N \ge 1\)) and there are at least two row actions (\(M \ge 2\)). Then the sampled game — the \(M \times N\) matrix game with entries \(f(x_i, y_j)\) — has equal lower and upper values,

\[ \sup _{p \in \Delta _M}\; \inf _{j \in [N]}\; \sum _{i} p_i\, f(x_i, y_j) \; =\; \inf _{q \in \Delta _N}\; \sup _{i \in [M]}\; \sum _{j} f(x_i, y_j)\, q_j, \]

where \(\Delta _M\) and \(\Delta _N\) denote the sets of mixed strategies over the row and column actions.

Lemma 106.19 Jensen bound for the sampled payoff against a pure column
✓

Let \(f : \mathbb {R}\to \mathbb {R}\to \mathbb {R}\) take values in \([0,1]\), and let \(x : [M] \to \mathbb {R}\) and \(y : [N] \to \mathbb {R}\) be finite families of row and column points, giving rise to the sampled game whose \((i,j)\) entry is \(f(x_i, y_j)\). Fix a column index \(j\), and suppose the section \(x' \mapsto f(x', y_j)\) is convex on a set \(X \subseteq \mathbb {R}\) with \(x_i \in X\) for every \(i\). Then for any mixed row strategy \(p\) over the \(M\) rows,

\[ f\! \left(\sum _{i} p_i\, x_i,\; y_j\right) \; \le \; \sum _{i} p_i\, f(x_i, y_j), \]

where the right-hand side is the expected payoff of the sampled game against column \(j\) under \(p\).

Lemma 106.20 Concavity bound on sampled payoff against a mixed column
✓

Let \(f:\mathbb {R}\times \mathbb {R}\to \mathbb {R}\) be a payoff function taking values in \([0,1]\), and let \(x:[M]\to \mathbb {R}\) and \(y:[N]\to \mathbb {R}\) be finite families of row and column points. Fix a row index \(i\) and a mixed column strategy \(q\), whose weights \(q_j\ge 0\) sum to \(1\). Suppose \(Y\subseteq \mathbb {R}\) contains every \(y_j\) and the section \(y'\mapsto f(x_i,y')\) is concave on \(Y\). Then the expected payoff of pure row \(i\) against \(q\) in the sampled game is at most the value of \(f\) at the \(q\)-averaged column point:

\[ \sum _{j} f(x_i,y_j)\, q_j \; \le \; f\! \left(x_i,\; \sum _{j} q_j\, y_j\right). \]
Lemma 106.21 Weak minimax inequality for convex-compact games
✓

Let \(X, Y \subseteq \mathbb {R}\) be nonempty convex sets with \(X\) also compact, and let \(f : X \times Y \to \mathbb {R}\) be a payoff that is bounded above and below on \(X \times Y\), such that for every \(y \in Y\) the map \(x \mapsto f(x,y)\) is continuous and convex on \(X\), and for every \(x \in X\) the map \(y \mapsto f(x,y)\) is concave on \(Y\). Then

\[ \sup _{y \in Y}\, \inf _{x \in X}\, f(x,y) \; \leq \; \inf _{x \in X}\, \sup _{y \in Y}\, f(x,y). \]
Definition 106.22 Minimax sublevel set
✓
#

For a set \(X \subseteq \mathbb {R}\), a payoff function \(f\), a column point \(y\), and a threshold \(c \in \mathbb {R}\), the minimax sublevel set is

\[ \mathrm{sublevel}(X,f,y,c) \; =\; X \cap \{ x \in \mathbb {R}: f(x,y) \leq c\} . \]
Lemma 106.23 Minimax sublevel set is contained in the row set
✓

Let \(X \subseteq \mathbb {R}\) be a set, let \(f \colon \mathbb {R}\times \mathbb {R}\to \mathbb {R}\) be a payoff function, and let \(y, c \in \mathbb {R}\). Then the minimax sublevel set \(\mathrm{sublevel}(X,f,y,c) = X \cap \{ x \in \mathbb {R}: f(x,y) \leq c\} \) is contained in \(X\).

Lemma 106.24 Closedness of the minimax sublevel set
✓

Let \(X \subseteq \mathbb {R}\) be a closed set, let \(f\colon \mathbb {R}\times \mathbb {R}\to \mathbb {R}\) be a payoff function, and fix a column point \(y \in \mathbb {R}\) and a threshold \(c \in \mathbb {R}\). If the map \(x \mapsto f(x,y)\) is continuous on \(X\), then the minimax sublevel set \(\mathrm{sublevel}(X,f,y,c) = X \cap \{ x \in \mathbb {R}: f(x,y) \le c\} \) is closed.

Lemma 106.25 Compactness of a minimax sublevel set
✓

Let \(X \subseteq \mathbb {R}\) be compact, fix a payoff function \(f : \mathbb {R}\times \mathbb {R}\to \mathbb {R}\), a column point \(y \in \mathbb {R}\), and a threshold \(c \in \mathbb {R}\), and suppose the map \(x \mapsto f(x,y)\) is continuous on \(X\). Then the minimax sublevel set \(\mathrm{sublevel}(X,f,y,c) = X \cap \{ x \in \mathbb {R}: f(x,y) \le c\} \) is compact.

Lemma 106.26 From finite feasibility to a uniform row point
✓

Let \(X, Y \subseteq \mathbb {R}\) together with a payoff function \(f : \mathbb {R}\to \mathbb {R}\to \mathbb {R}\) satisfy the convex-compact minimax hypotheses, and let \(c \in \mathbb {R}\). Suppose that for every finite subset \(u \subseteq Y\) the set \(X \cap \bigcap _{y \in u} \mathrm{sublevel}(X,f,y,c)\) is nonempty, where \(\mathrm{sublevel}(X,f,y,c) = X \cap \{ x \in \mathbb {R}: f(x,y) \le c\} \); that is, there is a common row point \(x \in X\) with \(f(x,y) \le c\) for all \(y\) in that finite set. Then there exists a single \(x \in X\) with \(f(x,y) \le c\) for every \(y \in Y\).