Probability Theory - Medical Biotechnology 24

Welcome to our course on Probability Theory for first-year students of Master’s program “Medical Biotechnology” at MIPT.

This is the first part of the course. This semester will be devoted to the study of discrete probability theory, incluiding introductory notions of random variables and the way of computing their expected value, variance and correlation coefficient. In addition, the Markov and Tchebyshev inequalities will be introduced and we will prove the Tchebyshev's form of the weak law of large numbers.

Next semester, we will generalize the concept of a random variable as a measurable function. We will extensively use the CDF and the PDF of random variables to compute all their interesting numerical characteristics. As a whole, we will completely construct the concept of a propability space. We will conclude our course with the proof of one of the main results in probability theory - the central limit theorem.

Prerequisities

Basic set theory, basic measure theory, calculus, mathematical analysis, combinatorics. Basically, all material from pages 1- 57 of the book "Introduction to probability theory for data science" by Stanley H. Chan.

At the end of this course, you will get a grade from 0 to 10 (you need at least 3 to pass) according to the following parameters:

• A:= Max of 1 point for class attendance (1 if you missed no more than 1 class. And o,5 if you missed no more than 2)
• P:= Max of 2 points for participation in class by solving homework on the board.
• T:= Max of 6 points for Test 1 + Test 2
• E:= Max of 4 points for final exam (зачет) on theory

Final grade = A+P+T+E-2

IMPORTANT: You must get at least 1.5 points in the final exam on theory in order to pass the course.

The theoretical exam and tests 1 and 2 are closed-book, that is, you are not allowed to use any material.

The number of points you get for each activity, is either an integer x or x+0.5.

If your final grade (after the final exam) is not an integer (z+0,5), you can solve an extra problem to raise your grade to z+1. Otherwise you get just z.

If you have <= 2 points for A+T, then you have a solve problems in the exam. You need a minimum number of points of the solution of these problems to get your theoretical questions and continue with the exam.

On the other hand, in the retake you have to solve problems independently from the number of points you have for T.

1. Basics of combinatorics. Rule of sum and rule of product. Pigeon-hole principle. Permutations and combinations. Binomial and Multinomial theorem. Combinatorial identities (7 formulas).
2. Inclusion-exclusion principle. Random experiments and notion of probability. Probability in nature. Probability triple. Discrete sample space. Classical probability model.
3. Bernoulli scheme. k successes in n trials. Sum of all outcomes gives 1. Geometric probability. Probability of two people meeting.
4. Probability of getting success in first trial. Definition and examples of sigma-algebras. Algebra which is not a sigma-algebra. Measurable space. Probability measure-definition and properties.
5. Continuity of the probability measure. Probability of union of intersecting events and upper bound. Conditional probability. Theorem of multiplication. Independence of events (pairwise and mutually). Example of pairwise but not necessarily mutually independent events. Example on the neccesary conditions for mutually independence.
6. Partition of Omega. Total Probability Formula. Bayes Theorem. Monty-Hall problem. Problem on choosing an easy ticket. Notion of random variables. Number of successes in Bernoulli scheme as a random variable. Measurable function. Borel sigma-algebra. Probability Mass Function (PMF).
7. Independence of discrete random variables. Examples of discrete distributions (Bern(p), Bin(n,p), Geom(p), Pois(λ)). Expected value of a random variable. Problem on choosing an easy question at the exam.
8. Properties of the Expected value with proofs (5). Variance. Properties with proofs (3). Covariance. Example of dependent random variables with zero covariance.
9. Expected value and variance of random variables with distribution Ber(p), U({1,...,n}), Bin(n,p), Pois(λ). Properties of covariance (5). Variance of sum of n random variables. Correlation coefficient, definition and meaning. |corr(x,y)|<=1. Proof 1.
10. Notion of random graphs. Markov's inequality. Сhebyshev inequality. Cauchy–Bunyakovsky inequality. Application in the proof of the value of the correlation coefficient.
11. Weak Law of large numbers. General form of WLLN. Joint distribution of two random variables. Properties. Random walk.
12. De Moivre-Laplace Local limit Theorem. De Moivre-Laplace Local limit Theorem.

• Probability (Graduate Texts in Mathematics) 2nd Edition - Albert N. Shiryaev.
• Introduction to probability for Data Science - Stanley H. Shan. [download]
• Probability and Statistics for Data Science - Carlos Fernandez-Granda.
• Introduction To Probability - Joseph K. Blitzstein, Jessica Hwang.
• Мера и интеграл, Дьяченко М.И.
• Курс теории вероятностей и математической статистики, Севастьянов Б.A.
• Курс теории вероятностей, Чистяков В.П.

• Short lectures on measure theory: [playlist]
• Short lectures on Probability Theory [playlist]
• Probability theory course IMPA [playlist]
• Probability theory course Harvard University [playlist]
• Interactive videos on probability from 3Blue1Brown [video]
• Lectures in introduction to probability (in russian) [playlist]