Brief notes on Probability and Martingales

These are brief lecture notes for a course on Probability and Martingales developed when I (Gautam Iyer) taught it at Carnegie Mellon University. These notes intentionally only list definitions, and statements of results, and problems, and occasionally brief sketches of proofs. I do motivation, intuition, and complete proofs in class. There are also several comprehensive references for this material so I don’t plan to include them in these notes.

Contents

  1. Probability spaces and Random Variables
    1. Paradoxes without rigor
    2. Sample spaces
    3. Random variables
    4. Discrete Random Variables
    5. A few standard distributions
  2. Conditional Probability and Independence
    1. Conditional Probability
    2. Independent events
    3. Independent Random Variables
  3. Expectations of Random Variables
    1. Expectations
    2. Variance
    3. Conditional Expectation
  4. Law of Large Numbers
    1. Empirical averages
    2. Products of independent random variables
    3. Mean square convergence
    4. Convergence in probability
    5. Borel Cantelli Lemmas
    6. Almost sure convergence
    7. Normal numbers
    8. Random series
  5. Continuous Random Variables
    1. Density functions
    2. Standard distributions
    3. Expectations
    4. Multivariate distributions
    5. Independence
  6. Central limit theorem
    1. Normal distribution
    2. Convergence in distribution
    3. Lindeberg's proof of the central limit theorem
  7. Moment generating and characteristic functions
    1. Moment generating functions
    2. Concentration inequalities
    3. Characteristic functions
    4. Proof of the central limit theorem using Lévy's theorem
    5. The multivariate normal
  8. Martingales
    1. Conditional Expectation
    2. Discrete time martingales
    3. Optional Sampling
    4. Gamblers ruin
    5. Sequence waiting time
  9. Optimal stopping
    1. Sub and Super Martingales
    2. Super-martingale envelopes and optimal stopping

Source Code

The source code is available on Codeberg.

The notes are written in Markdown, and converted to HTML5 using the Python script md-to-html. It should be viewable on most modern browsers, but I only test it on Firefox.

Licence

Brief notes on Probability and Martingales © 2026 by Gautam Iyer is licensed under Creative Commons Attribution-NonCommercial 4.0 International .

You may adapt and share this work for non-commercial purposes, provided you cite it appropriately. The full terms are in the licence deed.