Definition. Let \(X\) be a set and let \(\mathcal U \subseteq \mathcal{P}(X)\) be such that \(\varnothing\in \mathcal U\). Let \(\nu:\mathcal U \to [0,\infty]\) be a function such that \(\nu(\varnothing)=0\). We say that the set function
\(\nu\) is finitely additive on \(\mathcal U\) if for any disjoint finite collection of sets \(A_1,\ldots,A_n\in \mathcal U\) such that \(\bigcup_{j=1}^{n}A_j \in \mathcal U\) we have \[\nu\bigg(\bigcup_{j=1}^{n}A_j\bigg)=\sum_{j=1}^{n}\nu(A_j).\]
\(\nu\) is countably additive on \(\mathcal U\) if for any disjoint countable collection of sets \((A_n)_{n\in \mathbb N}\subseteq \mathcal U\) such that \(\bigcup_{j=1}^{\infty}A_j \in \mathcal U\) we have \[\nu\bigg(\bigcup_{j=1}^{\infty}A_j\bigg)=\sum_{j=1}^{\infty}\nu(A_j).\]
\(\nu\) is finitely subadditive on \(\mathcal U\) if for any finite collection of sets \(A_1,\ldots,A_n\in \mathcal U\) such that \(\bigcup_{j=1}^{n}A_j \in \mathcal U\) we have \[\nu\bigg(\bigcup_{j=1}^{n}A_j\bigg)\le\sum_{j=1}^{n}\nu(A_j).\]
\(\nu\) is countably subadditive on \(\mathcal U\) if for any countable collection of sets \((A_n)_{n\in \mathbb N}\subseteq \mathcal U\) such that \(\bigcup_{j=1}^{\infty}A_j \in \mathcal U\) we have \[\nu\bigg(\bigcup_{j=1}^{\infty}A_j\bigg)\le\sum_{j=1}^{\infty}\nu(A_j).\]
Let \(X\) be a set and let \(\mathcal U \subseteq \mathcal{P}(X)\) be such that \(\varnothing\in \mathcal U\). Let \(\nu:\mathcal U \to [0,\infty]\) be a function such that \(\nu(\varnothing)=0\).
Then it is easy to see that countable additivity implies finite additivity.
Indeed, if \(A_1,\ldots,A_n\in \mathcal U\) are disjoint such that \(\bigcup_{j=1}^{n}A_j \in \mathcal U\) then one can take \(A_j=\varnothing\) for all \(j>n\) and note that \[\nu\left(\bigcup_{j=1}^{n}A_j\right)=\nu\left(\bigcup_{j=1}^{\infty}A_j\right)=\sum_{j=1}^{\infty}\nu(A_j)=\sum_{j=1}^{n}\nu(A_j),\] since \(\nu(A_j)=\nu(\varnothing)=0\) for all \(j>n\).
Similar argument shows that countable subadditivity implies finite subadditivity.
\(\mu(\varnothing)=0\),
if \((A_n)_{n\in \mathbb N}\subseteq \mathcal A\) is a sequence of disjoint sets in \(\mathcal A\), then \[\mu\bigg(\bigcup_{j=1}^{\infty}A_j\bigg)=\sum_{j=1}^{\infty}\mu(A_j).\]
In other words, a measure \(\mu:\mathcal A \to [0,\infty]\) on a \(\sigma\)-algebra \(\mathcal A\) is a countably additive set function such that \(\mu(\varnothing)=0\).
Terminology. Let \((X,\mathcal A,\mu)\) be a measure space.
If \(\mu(X)<\infty\), \(\mu\) is called finite. This immediately implies that \(\mu(E)<\infty\) for all \(E \in \mathcal A\), since \(\mu(X)=\mu(E)+\mu(E^c)\), .
If \(\mu(X)=1\), \(\mu\) is called probability measure.
If \(X=\bigcup_{j\in\mathbb N} E_j\), where \(E_j \in \mathcal A\) and \(\mu(E_j)<\infty\) for all \(j\in\mathbb N\), \(\mu\) is called \(\sigma\)-finite.
If for each \(E \in \mathcal A\) with \(\mu(E)=\infty\) there exists \(F \in \mathcal A\) with \(F \subseteq E\) and \(0<\mu(F)<\infty\), \(\mu\) is called semifinite.
Let \(X\neq\varnothing\) and fix \(x_0 \in X\). The Dirac delta measure on \((X, \mathcal{P}(X))\) is defined by \[\delta_{x_0}(E)=\begin{cases} 0 &\text{ if }x_0 \not\in E,\\ 1 &\text{ if }x_0 \in E, \end{cases} \qquad E\subseteq X.\]
Let \(X\neq\varnothing\) be countable. The counting measure on \((X, \mathcal{P}(X))\) is defined by \[\mu(E)=\sum_{x \in X}\delta_{x}(E), \qquad E\subseteq X.\]
Let \(X\) be an infinite set, and define a set function on \((X, \mathcal{P}(X))\) by \[\mu(E)=\begin{cases} \infty &\text{ if }E\text{ is infinite, }\\ 0 &\text{ if }E\text{ is finite, } \end{cases} \qquad E\subseteq X.\] Then \(\mu\) is a finitely additive set function, which is not a measure.
Let \(X\neq\varnothing\) be a finite set. The normalized counting measure on \((X, \mathcal{P}(X))\) is defined by \[\mu(E)=\frac{1}{\#X}\sum_{x \in X}\delta_{x}(E), \qquad E\subseteq X.\] Then \(\mu(X)=1\), which means that \(\mu\) is a probability measure on \(X\).
Let \(X\) be uncountable set, and let \[\mathcal A=\{E \subseteq X: E \text{ is countable or } E^c \text{ is countable}\}\] be the algebra of countable or co-countable sets. Define \[\mu(E)=\begin{cases} 1 &\text{ if }E \text{ is uncountable,}\\ 0 &\text{ otherwise}, \end{cases} \quad E\in \mathcal A.\] Then \(\mu\) is the measure on \((X, \mathcal A)\).
Theorem. Let \((X,\mathcal A,\mu)\) be a measure space.
(Monotonicity) If \(E,F \in \mathcal A\) and \(E \subseteq F\), then \(\mu(E) \leq \mu(F)\).
(Subadditivity) If \((E_j)_{j\in\mathbb N} \subseteq \mathcal A\), then \(\mu\big(\bigcup_{j=1}^{\infty}E_j\big) \leq \sum_{j=1}^{\infty}\mu(E_j)\).
(Continuity from below) If \((E_j)_{j\in\mathbb N} \subseteq \mathcal A\) and \(E_1 \subseteq E_2 \subseteq \ldots\), then \[\mu\bigg(\bigcup_{n=1}^{\infty}E_n\bigg)=\lim_{n \to \infty}\mu(E_n).\]
(Continuity from above) If \((E_j)_{j\in\mathbb N} \subseteq \mathcal A\) and \(E_1 \supseteq E_2 \supseteq \ldots\) and \(\mu(E_1)<\infty\), then \[\mu\bigg(\bigcap_{n=1}^{\infty}E_n\bigg)=\lim_{n \to \infty}\mu(E_n).\]
Proof of (a). If \(E \subseteq F\), then \[\qquad\qquad \mu(F)=\mu(E)+\mu(F \setminus E) \geq \mu(E). \qquad \qquad\tag*{$\blacksquare$}\] Proof of (b). Let \(F_1=E_1\) and \(F_{k+1}=E_{k+1} \setminus \bigcup_{j=1}^{k}E_j\) for \(k\in\mathbb N\). Then \(F_k\)’s are disjoint and \(\bigcup_{j=1}^{n}F_j=\bigcup_{j=1}^{n}E_j\) for all \(n\in\mathbb N\). By (a) we have \[\qquad\mu\bigg(\bigcup_{n=1}^{\infty}E_n\bigg)= \mu\bigg(\bigcup_{n=1}^{\infty}F_n\bigg)=\sum_{n=1}^{\infty}\mu(F_n) \leq \sum_{n=1}^{\infty}\mu(E_n).\qquad \tag*{$\blacksquare$}\] Proof of (c). Setting \(E_0=\varnothing\) we obtain \[\mu \bigg(\bigcup_{n=0}^{\infty}E_n\bigg)=\sum_{n=1}^{\infty}\mu(E_n \setminus E_{n-1})=\lim_{n \to \infty}\sum_{j=1}^{n}\mu(E_j \setminus E_{j-1})=\lim_{n \to \infty}\mu(E_n).\tag*{$\blacksquare$}\]
Proof of (d). Let \(F_j=E_1 \setminus E_j\) for \(j\in\mathbb N\). Then \(F_1 \subseteq F_2 \subseteq \ldots\) and \(\mu(E_1)=\mu(E_j)+\mu(F_j)\), and \[\bigcup_{j=1}^{\infty}F_j=E_1 \setminus \bigcap_{j=1}^{\infty}E_j.\] Then by (c) we conclude \[\begin{aligned} \mu(E_1)-\mu\bigg(\bigcap_{j=1}^{\infty}E_j\bigg)&=\mu\bigg(E_1 \setminus \bigcap_{j=1}^{\infty}E_j\bigg) =\mu\bigg(\bigcup_{j=1}^{\infty}F_j\bigg) =\lim_{n \to \infty}\mu(F_n)\\ &=\lim_{n \to \infty}(\mu(E_1)-\mu(E_n)). \end{aligned}\] Since \(\mu(E_1)<\infty\) we may subtract it from both sides and we are done. $$\tag*{$\blacksquare$}$$
Remark. The assumptions \(\mu(E_1)<\infty\) in (d) cannot be dropped.
Definition. If \((X, \mathcal A, \mu)\) is a measure space, a set \(E\in \mathcal A\) such that \(\mu(E)=0\) is called a null set. By subadditivity any countable union of null sets is a null set.
Definition. If a statement about points \(x \in X\) is true except for \(x\) in some null set, we say that it is true \(\mu\)-almost everywhere (abbreviated \(\mu\)-a.e.), or for \(\mu\)-almost every \(x\).
Remark. If \(E\in \mathcal A\) and \(\mu(E)=0\) and \(F \subseteq E\), then \(\mu(F)=0\) by monotonicity of \(\mu\) provided that \(F\in \mathcal A\). In general, it need not to be true that \(F \in \mathcal A\).
Definition. A measure whose domain includes all subsets of null sets is called complete.
Theorem. Suppose that \((X,\mathcal A, \mu)\) is a measure space. Let \[\mathcal{N}=\{N \in \mathcal{A} : \mu(N)=0\},\] and \[\overline{\mathcal{A}}=\{E \cup F : E \in \mathcal A \text{ and } F \subseteq N \text{ for some } N \in \mathcal{N}\}.\] Then
\(\overline{\mathcal{A}}\) is a \(\sigma\)-algebra.
There is a unique extension \(\bar{\mu}\) of \(\mu\) to a complete measure on \(\overline{\mathcal{A}}\).
Proof of (a): Since \(\mathcal A\) and \(\mathcal N\) are closed under countable unions, so is \(\overline{\mathcal{A}}\). We show that \((E \cup F) ^c\in \overline{\mathcal{A}}\), if \(E \cup F \in \overline{\mathcal{A}}\), where \(E \in \mathcal{A}\) and \(F\subseteq N \in \mathcal{N}\). This will show that \(\overline{\mathcal{A}}\) is a \(\sigma\)-algebra and the proof of (a) will be completed.
We can assume that \(E \cap N=\varnothing\) (otherwise we replace \(F\) and \(N\) by \(F \setminus E\) and \(N \setminus E\)). Then \(E \cup F = (E \cup N) \cap (N^c \cup F),\) so \[(E \cup F)^c = (E \cup N)^c \cup (N \setminus F).\] But \((E \cup N)^c \in \mathcal A\) and \(N \setminus F \subseteq N\), so that \((E \cup F)^c \in \overline{\mathcal{A}}\). So \(\overline{\mathcal{A}}\) is a \(\sigma\)-algebra as desired. $$\tag*{$\blacksquare$}$$
Proof of (b): (Construction of \(\bar{\mu}\)). For \(E \cup F \in \overline{\mathcal{A}}\), we set \[\bar{\mu}(E \cup F)=\mu(E).\] This new measure \(\bar{\mu}\) is well defined. Indeed, if \(E_1 \cup F_1=E_2 \cup F_2\), where \(F_j \subseteq N_j \in \mathcal{N}\) for \(i=1, 2\), then \(E_1 \subseteq E_2 \cup N_2\) and so \[\mu(E_1) \leq \mu(E_2) +\mu(N_2)=\mu(E_2),\] and likewise \(\mu(E_2) \leq \mu(E_1)\). Thus \(\bar{\mu}(E_1 \cup F_1)=\bar{\mu}(E_2 \cup F_2)\) as claimed. $$\tag*{$\blacksquare$}$$
Proof of (b): (Completeness of \(\bar{\mu}\)). If \(E \in \overline{\mathcal{A}}\) and \(\bar{\mu}(E)=0\) then we show that for any \(E_0 \subseteq E\) we have \(\bar{\mu}(E_0)=0\) and \(E_0 \in \overline{\mathcal{A}}\). Let \(E=A \cup C\), where \(A \in {\mathcal{A}}\) and \(C \subseteq N\in \mathcal{N}\) and \(\mu(N)=0\). Note that \[0=\bar{\mu}(E)={\mu}(A).\] Thus \(A \in \mathcal{N}\) and consequently \(E_0 \subseteq E=A \cup C \subseteq A \cup N\in \mathcal{N}\), which yields that \(E_0 \in \overline{\mathcal{A}}\) and \(\bar{\mu}(E_0)=\mu(\varnothing)=0\). $$\tag*{$\blacksquare$}$$
Proof of (b): (Uniqueness of \(\bar{\mu}\)). Let \((X, \mathcal M,\nu)\) be a complete measure space such that \(\mathcal M\supseteq\overline{\mathcal{A}}\) and \(\nu(E)=\mu(E)\) for all \(E \in \mathcal A\), then we show that \(\nu=\bar{\mu}\) on \(\overline{\mathcal{A}}\). Indeed, suppose that \(E \in \overline{\mathcal{A}}\), where \(E=A \cup F\) and \(F \subseteq N \in \mathcal{N}\) and \(\mu(N)=0\). We may write \(E=A \cup F=A \cup (F \setminus A)\), and \(F \setminus A \subseteq F \subseteq N \in \mathcal{N}\). Hence \[\bar{\mu}(E)=\bar{\mu}(A \cup (F \setminus A))=\mu(A)=\nu(A)=\nu(A)+\nu(F \setminus A)=\nu(E),\] since \(F \setminus A\in\mathcal M\) and \(\nu(F \setminus A)=0\). Thus \(\nu=\bar{\mu}\) on \(\overline{\mathcal{A}}\).$$\tag*{$\blacksquare$}$$
Definition. A premeasure on an algebra \(\mathcal A \subseteq \mathcal{P}(X)\) of sets on \(X\) is a function \(\mu_0:\mathcal A \to [0,\infty]\) satisfying
\(\mu_0(\varnothing)=0\),
if \((A_n)_{n\in \mathbb N}\) is a sequence of disjoint sets in \(\mathcal A\) such that \(\bigcup_{n=1}^{\infty}A_n \in \mathcal A\), then \[\mu_0\bigg(\bigcup_{n=1}^{\infty}A_n\bigg)=\sum_{n=1}^{\infty}\mu_0(A_n).\]
Remark.
In other words, a premeasure \(\mu_0:\mathcal A \to [0,\infty]\) on an algebra \(\mathcal A\) is a countably additive set function such that \(\mu_0(\varnothing)=0\).
A premeasure is always finitely additive, (see the discussion above).
The notions of finite and \(\sigma\)-finite premeasures are defined just as for measures, (see above).
Theorem. (From countably subadditive set functions to premeasures) Let \(\rho:\mathcal{E} \to [0,\infty]\) be a set function on a semi-algebra \(\mathcal{E}\) of subsets of a set \(X\) and \(\rho(\varnothing)=0\). Suppose that \(\rho\) is finitely additive on \(\mathcal{E}\) and let \(\mathcal{A}\) be the algebra that consists of all finite disjoint unions of members of \(\mathcal{E}\). Define a set function \(\mu_0\) on \(\mathcal{A}\) by setting \[\mu_0(A)=\sum_{i=1}^{n}\rho(E_i)\] for \(A=\bigcup_{j=1}^{n}E_j \in \mathcal{A}\), where \(E_1,\ldots,E_n \in \mathcal{E}\) and \(E_i \cap E_j = \varnothing\) if \(i \neq j\).
Then \(\mu_0\) is a well-defined additive set function on \(\mathcal{A}\) such that \(\mu_0(\varnothing)=0\) and \(\mu_0=\rho\) on \(\mathcal{E}\).
If additionally \(\rho\) is countably subadditive on \(\mathcal{E}\) then \(\mu_0\) is a premeasure on \(\mathcal{A}\).