The videos in Part II describe the laws of large numbers and introduce the main tools of Bayesian inference methods.
The textbook for this subject is Bertsekas, Dimitri, and John Tsitsiklis. Introduction to Probability. 2nd ed. Athena Scientific, 2008. ISBN: 9781886529236.
The authors have made this Selected Summary Material (PDF) available for OCW users.
L = Lecture Content
S = Supplemental Content
SES # & TOPICS | SLIDES |
---|---|
Lecture 14: Introduction to Bayesian Inference | |
› View Lecture Videos L14.1 Lecture OverviewFlash and JavaScript are required for this feature. Lecture Overview > Download from Internet Archive (MP4 - 5MB) L14.2 Overview of some Application DomainsFlash and JavaScript are required for this feature. Overview of some Application Domains > Download from Internet Archive (MP4 - 10MB) L14.3 Types of Inference ProblemsFlash and JavaScript are required for this feature. Types of Inference Problems > Download from Internet Archive (MP4 - 5MB) L14.4 The Bayesian Inference FrameworkFlash and JavaScript are required for this feature. The Bayesian Inference Framework > Download from Internet Archive (MP4 - 11MB) L14.5 Discrete Parameter, Discrete ObservationFlash and JavaScript are required for this feature. Discrete Parameter, Discrete Observation > Download from Internet Archive (MP4 - 10MB) L14.6 Discrete Parameter, Continuous ObservationFlash and JavaScript are required for this feature. Discrete Parameter, Continuous Observation > Download from Internet Archive (MP4 - 6MB) L14.7 Continuous Parameter, Continuous ObservationFlash and JavaScript are required for this feature. Continuous Parameter, Continuous Observation > Download from Internet Archive (MP4 - 4MB) L14.8 Inferring the Unknown Bias of a Coin and the Beta DistributionFlash and JavaScript are required for this feature. Inferring the Unknown Bias of a Coin and the Beta Distribution > Download from Internet Archive (MP4 - 13MB) L14.9 Inferring the Unknown Bias of a Coin—Point EstimatesFlash and JavaScript are required for this feature. Inferring the Unknown Bias of a Coin—Point Estimates > Download from Internet Archive (MP4 - 17MB) L14.10 SummaryFlash and JavaScript are required for this feature. Summary > Download from Internet Archive (MP4 - 7MB) S14.1 The Beta FormulaFlash and JavaScript are required for this feature. The Beta Formula > Download from Internet Archive (MP4 - 15MB) | |
Lecture 15: Linear Models With Normal Noise | |
› View Lecture Videos L15.1 Lecture OverviewFlash and JavaScript are required for this feature. Lecture Overview > Download from Internet Archive (MP4 - 5MB) L15.2 Recognizing Normal PDFsFlash and JavaScript are required for this feature. Recognizing Normal PDFs > Download from Internet Archive (MP4 - 11MB) L15.3 Estimating a Normal Random Variable in the Presence of Additive NoiseFlash and JavaScript are required for this feature. Estimating a Normal Random Variable in the Presence of Additive Noise > Download from Internet Archive (MP4 - 11MB) L15.4 The Case of Multiple ObservationsFlash and JavaScript are required for this feature. The Case of Multiple Observations > Download from Internet Archive (MP4 - 21MB) L15.5 The Mean Squared ErrorFlash and JavaScript are required for this feature. The Mean Squared Error > Download from Internet Archive (MP4 - 21MB) L15.6 Multiple Parameters; Trajectory EstimationFlash and JavaScript are required for this feature. Multiple Parameters; Trajectory Estimation > Download from Internet Archive (MP4 - 13MB) L15.7 Linear Normal ModelsFlash and JavaScript are required for this feature. Linear Normal Models > Download from Internet Archive (MP4 - 7MB) L15.8 Trajectory Estimation IllustrationFlash and JavaScript are required for this feature. Trajectory Estimation Illustration > Download from Internet Archive (MP4 - 14MB) | |
Lecture 16: Least Mean Squares (LMS) Estimation | |
› View Lecture Videos L16.1 Lecture OverviewFlash and JavaScript are required for this feature. Lecture Overview > Download from Internet Archive (MP4 - 3MB) L16.2 LMS Estimation in the Absence of ObservationsFlash and JavaScript are required for this feature. LMS Estimation in the Absence of Observations > Download from Internet Archive (MP4 - 8MB) L16.3 LMS Estimation of One Random Variable Based on AnotherFlash and JavaScript are required for this feature. LMS Estimation of One Random Variable Based on Another > Download from Internet Archive (MP4 - 16MB) L16.4 LMS Performance EvaluationFlash and JavaScript are required for this feature. LMS Performance Evaluation > Download from Internet Archive (MP4 - 5MB) L16.5 Example: The LMS EstimateFlash and JavaScript are required for this feature. Example: The LMS Estimate > Download from Internet Archive (MP4 - 8MB) L16.6 Example Continued: LMS Performance EvaluationFlash and JavaScript are required for this feature. Example Continued: LMS Performance Evaluation > Download from Internet Archive (MP4 - 8MB) L16.7 LMS Estimation with Multiple Observations or UnknownsFlash and JavaScript are required for this feature. LMS Estimation with Multiple Observations or Unknowns > Download from Internet Archive (MP4 - 7MB) L16.8 Properties of the LMS Estimation ErrorFlash and JavaScript are required for this feature. Properties of the LMS Estimation Error > Download from Internet Archive (MP4 - 9MB) | |
Lecture 17: Linear Least Mean Squares (LLMS) Estimation | |
› View Lecture Videos L17.1 Lecture OverviewFlash and JavaScript are required for this feature. Lecture Overview > Download from Internet Archive (MP4 - 4MB) L17.2 LLMS FormulationFlash and JavaScript are required for this feature. LLMS Formulation > Download from Internet Archive (MP4 - 7MB) L17.3 Solution to the LLMS ProblemFlash and JavaScript are required for this feature. Solution to the LLMS Problem > Download from Internet Archive (MP4 - 8MB) L17.4 Remarks on the LLMS Solution and on the Error VarianceFlash and JavaScript are required for this feature. Remarks on the LLMS Solution and on the Error Variance > Download from Internet Archive (MP4 - 14MB) L17.5 LLMS ExampleFlash and JavaScript are required for this feature. LLMS Example > Download from Internet Archive (MP4 - 12MB) L17.6 LLMS for Inferring the Parameter of a CoinFlash and JavaScript are required for this feature. LLMS for Inferring the Parameter of a Coin > Download from Internet Archive (MP4 - 18MB) L17.7 LLMS with Multiple ObservationsFlash and JavaScript are required for this feature. LLMS with Multiple Observations > Download from Internet Archive (MP4 - 9MB) L17.8 The Simplest LLMS Example with Multiple ObservationsFlash and JavaScript are required for this feature. The Simplest LLMS Example with Multiple Observations > Download from Internet Archive (MP4 - 6MB) L17.9 The Representation of the Data Matters in LLMSFlash and JavaScript are required for this feature. The Representation of the Data Matters in LLMS > Download from Internet Archive (MP4 - 9MB) | |
Lecture 18: Inequalities, Convergence, and the Weak Law of Large Numbers | |
› View Lecture Videos L18.1 Lecture OverviewFlash and JavaScript are required for this feature. Lecture Overview > Download from Internet Archive (MP4 - 5MB) L18.2 The Markov InequalityFlash and JavaScript are required for this feature. The Markov Inequality > Download from Internet Archive (MP4 - 12MB) L18.3 The Chebyshev InequalityFlash and JavaScript are required for this feature. The Chebyshev Inequality > Download from Internet Archive (MP4 - 7MB) L18.4 The Weak Law of Large NumbersFlash and JavaScript are required for this feature. The Weak Law of Large Numbers > Download from Internet Archive (MP4 - 10MB) L18.5 PollingFlash and JavaScript are required for this feature. Polling > Download from Internet Archive (MP4 - 10MB) L18.6 Convergence in ProbabilityFlash and JavaScript are required for this feature. Convergence in Probability > Download from Internet Archive (MP4 - 11MB) L18.7 Convergence in Probability ExamplesFlash and JavaScript are required for this feature. Convergence in Probability Examples > Download from Internet Archive (MP4 - 9MB) L18.8 Related TopicsFlash and JavaScript are required for this feature. Related Topics > Download from Internet Archive (MP4 - 9MB) S18.1 Convergence in Probability of the Sum of Two Random VariablesFlash and JavaScript are required for this feature. Convergence in Probability of the Sum of Two Random Variables > Download from Internet Archive (MP4 - 14MB) S18.2 Jensen's InequalityFlash and JavaScript are required for this feature. Jensen's Inequality > Download from Internet Archive (MP4 - 17MB) S18.3 Hoeffding's InequalityFlash and JavaScript are required for this feature. Hoeffding's Inequality > Download from Internet Archive (MP4 - 27MB) | |
Lecture 19: The Central Limit Theorem (CLT) | |
› View Lecture Videos L19.1 Lecture OverviewFlash and JavaScript are required for this feature. Lecture Overview > Download from Internet Archive (MP4 - 4MB) L19.2 The Central Limit TheoremFlash and JavaScript are required for this feature. The Central Limit Theorem > Download from Internet Archive (MP4 - 10MB) L19.3 Discussion of the CLTFlash and JavaScript are required for this feature. Discussion of the CLT > Download from Internet Archive (MP4 - 11MB) L19.4 Illustration of the CLTFlash and JavaScript are required for this feature. Illustration of the CLT > Download from Internet Archive (MP4 - 3MB) L19.5 CLT ExamplesFlash and JavaScript are required for this feature. CLT Examples > Download from Internet Archive (MP4 - 21MB) L19.6 Normal Approximation to the BinomialFlash and JavaScript are required for this feature. Normal Approximation to the Binomial > Download from Internet Archive (MP4 - 17MB) L19.7 Polling RevisitedFlash and JavaScript are required for this feature. Polling Revisited > Download from Internet Archive (MP4 - 21MB) | |
Lecture 20: An Introduction to Classical Statistics | |
› View Lecture Videos L20.1 Lecture OverviewFlash and JavaScript are required for this feature. Lecture Overview > Download from Internet Archive (MP4 - 7MB) L20.2 Overview of the Classical Statistical FrameworkFlash and JavaScript are required for this feature. Overview of the Classical Statistical Framework > Download from Internet Archive (MP4 - 12MB) L20.3 The Sample Mean and Some TerminologyFlash and JavaScript are required for this feature. The Sample Mean and Some Terminology > Download from Internet Archive (MP4 - 6MB) L20.4 On the Mean Squared Error of an EstimatorFlash and JavaScript are required for this feature. On the Mean Squared Error of an Estimator > Download from Internet Archive (MP4 - 8MB) L20.5 Confidence IntervalsFlash and JavaScript are required for this feature. Confidence Intervals > Download from Internet Archive (MP4 - 6MB) L20.6 Confidence Intervals for the Estimation of the MeanFlash and JavaScript are required for this feature. Confidence Intervals for the Estimation of the Mean > Download from Internet Archive (MP4 - 5MB) L20.7 Confidence Intervals for the Mean, When the Variance is UnknownFlash and JavaScript are required for this feature. Confidence Intervals for the Mean, When the Variance is Unknown > Download from Internet Archive (MP4 - 7MB) L20.8 Other Natural EstimatorsFlash and JavaScript are required for this feature. Other Natural Estimators > Download from Internet Archive (MP4 - 5MB) L20.9 Maximum Likelihood EstimationFlash and JavaScript are required for this feature. Maximum Likelihood Estimation > Download from Internet Archive (MP4 - 7MB) L20.10 Maximum Likelihood Estimation ExamplesFlash and JavaScript are required for this feature. Maximum Likelihood Estimation Examples > Download from Internet Archive (MP4 - 11MB) |