Nonparametric Statistics
This course will mostly cover All of Nonparametric Statistics by Wasserman, with additional details from other sources. Confidence sets will be an important focus of the course throughout.

Lecturer
Max Menzies
Date
10th September ~ 12th December, 2024
Location
Weekday | Time | Venue | Online | ID | Password |
---|---|---|---|---|---|
Tuesday,Thursday | 17:55 - 20:05 | Online | ZOOM 05 | 293 812 9202 | BIMSA |
Prerequisite
This course will assume you attended my previous two courses, which covered the book All of Statistics by Wasserman. In particular, I'll assume you have a broad theoretical basis in statistics and probability, understanding concepts such as random variables, CDFs, pdfs, convergence in probability/distribution, parametric and nonparametric models, the bootstrap, and maximum likelihood estimation. In addition, make sure you are familiar with the practical and theoretical details of linear and logistic regression (e.g. Chapter 13 of Wasserman). More specifically, this course will build upon the nonparametric methods introduced in Chapter 20-21 of Wasserman, so please read or revise those.
Syllabus
1. Review of random variables, convergence, confidence sets
2. Statistical functionals, the empirical CDF, the nonparametric delta method
3. Concentration inequalities (Chernoff bound, sub-Gaussian random variables, Bernstein and McDiarmid inequalities)
4. Empirical probability and processes, uniform Glivenko-Cantelli bounds, Vapnik-Chervonenkis theory
5. Bootstrap confidence intervals of first and second order accuracy
6. Density estimation and bandwidth selection methods
7. Nonparametric regression, variance estimation and confidence bands
8. The normal means problem, adaptive estimation and random radius confidence balls
2. Statistical functionals, the empirical CDF, the nonparametric delta method
3. Concentration inequalities (Chernoff bound, sub-Gaussian random variables, Bernstein and McDiarmid inequalities)
4. Empirical probability and processes, uniform Glivenko-Cantelli bounds, Vapnik-Chervonenkis theory
5. Bootstrap confidence intervals of first and second order accuracy
6. Density estimation and bandwidth selection methods
7. Nonparametric regression, variance estimation and confidence bands
8. The normal means problem, adaptive estimation and random radius confidence balls
Reference
Wasserman, All of Nonparametric Statistics
Wasserman, 36-705 Intermediate Statistics
Efron and Tibshirani, An Introduction to the Bootstrap
James et al, Introduction to Statistical Learning
Hastie et al, Elements of Statistical Learning
Wasserman, 36-705 Intermediate Statistics
Efron and Tibshirani, An Introduction to the Bootstrap
James et al, Introduction to Statistical Learning
Hastie et al, Elements of Statistical Learning
Audience
Graduate
, Postdoc
, Researcher
Video Public
Yes
Notes Public
Yes