Statistical analysis of experimental data
Faculty of Physics, University of Warsaw
winter semester 2022/2023
Lecturer:
prof. dr hab. Aleksander Filip Żarnecki
Institute of Experimental Physics
e-mail:
zarnecki@fuw.edu.pl
Tel:
+48 22 5532801
Office:
Room 4.01, Pasteura 5
Full description can be found on
USOS
Lecture slides and homework tasks are also available on
Kampus platform
Exam
Exam problems
Problem description
Archive with data for problems 4 and 5 Plik
Solutions to be uploaded by February 12, 2023. More information and upload links:
on
Kampus platform
Lecture slides
Concept of probability
lecture 13.10.2022:
PDF
Probability distributions and their properties
lecture 20.10.2022:
PDF
Instructions
on how to install and run docker container
example
Jupyter script
Measurements and their uncertainties
lecture 27.10.2022:
PDF
Bessel's correction
script
Central Limit Theorem
script
Direct generation method
script
von Neuman generation method
script
General generation method
Monte Carlo methods
lecture 03.11.2022:
PDF
numerical integration
example script
Monte Carlo integration
example script
Parameter Inference
lecture 10.11.2022:
PDF
log-likelihood contours
script
probability density contours
script
probability density Monte-Carlo contours
Gauss probability intervals
script
Poisson probability intervals
script
Gamma probability intervals
script
Parameter Inference (2)
lecture 17.11.2022:
PDF
Frequentist central interval construction
for Gaussian variable
Comparison of Bayesian and Frequentist limits
for Gaussian variable with bound
Unified interval construction
for Gaussian variable with bound
Frequentist central interval construction
for Poisson variable with background
Unified interval construction
for Poisson variable with background
Least-squares method
lecture 01.12.2022:
PDF
χ
2
distribution
modelling
t distribution
modelling
Critical χ
2
values
plot
Example of linear least-squares fit
of Fourier series
Data for homework exercise
Least-squares method (2)
lecture 08.12.2022:
PDF
General fit
example
F-test distribution
Critical F-test values
plot
General fit
example for model testing
Linear fit with constraints using
variable elimination method
Linear fit with constraints using
Lagrange multipliers method
Systematic uncertainties
lecture 15.12.2022:
PDF
Background fit
example
Fit with systematic uncertainties
(from example above)
Eigenvector calculation example
Variable distributions
lecture 22.12.2022:
PDF
Binned likelihood fit
example
Binned likelihood shape fit
example
Unbinned likelihood fit
example
Example data
for the above scripts
Data for homework exercise
Classification
lecture 12.01.2023:
PDF
Fisher linear discriminant
example (comparison of three approaches)
Naive Bayes classifier
example
k Nearest Neighbors classifier
with Mahalanobis distance measure
Machine learning
lecture 19.01.2023:
PDF
Percepton classifier with hidden layer
Artificial Neural Networks
example with sklearn
Decision Tree
example with sklearn
Classifier boosting
example
Boosted Decision Tree
example based on sklearn
Data for homework exercise:
Training background sample
Training signal sample
Test sample
for actual analysis
Markov Chains
lecture 26.01.2023:
PDF
Atom excitation:
example of Markov Chain
Atom excitation:
evolution of probabilities
Markov Chain Monte Carlo:
uniform distribution
Markov Chain Monte Carlo:
with probability distribution
Markov Chain Monte Carlo:
application to parameter fit
All materials are dedicated to the students of the University of Warsaw only
