Basic Concepts

The foundations of probability theory rest on three basic rules known as Kolmogorov’s axioms:

  1. For any event \( A \), the probability satisfies \( 0 \leq P(A) \leq 1 \), meaning it is a real number between $0$ and $1$.
  2. We previously stated that: \( P(\Omega) = 1 \), which reflects that the total probability over the entire sample space must equal $1$.
  3. If two events \( A \) and \( B \) are mutually exclusive (i.e., \( A \cap B = \emptyset \)), then $P(A \cup B)\;=$$\;P(A) + P(B)$. Otherwise, if they aren't mutually exclusive, then $P(A \cup B)\;=$$\;P(A) + P(B)\;-$$\;P(A \cap B)$.

These axioms allow us to use familiar set operations such as unions, intersections, and complements to reason about events.

For example, the event “not rolling a 6” ($E_{\text{Not}\ 6} = \{1, 2, 3, 4, 5\}$) is the complement of rolling a $6$ ($E_{6} = \{6\}$). According to axioms $2$ and $3$ above, this means that $P(E_{6}) + P(E_{\text{Not}\ 6}) = 1$, so $P(E_{\text{Not}\ 6})\;=$$\;1 - P(E_{6})\;=$$\;1 - \frac{1}{6}\;=$$\;\frac{5}{6}$.