Dr Yining Chen COL 5.08

This course is available on the MSc in Data Science, MSc in Statistics, MSc in Statistics (Financial Statistics), MSc in Statistics (Financial Statistics) (LSE and Fudan), MSc in Statistics (Financial Statistics) (Research), MSc in Statistics (Research), MSc in Statistics (Social Statistics) and MSc in Statistics (Social Statistics) (Research). This course is available with permission as an outside option to students on other programmes where regulations permit.

Basic knowledge in calculus and linear algebra, as well as a first course in probability and statistics.

An introduction to the use of popular algorithms in statistics and data science, including (but not limit to) numerical linear algebra, optimisation, graph data and massive data processing, as well as their applications. Examples include least squares, maximum likelihood, principle component analysis, LASSO and graphical LASSO, PageRank, etc. Throughout the course, students will gain practical experience of implementing these computational methods in a programming language. Learning support will be provided for at least one programming language, such as R, Python or C++, but the choice of language supported may vary between years, depending on judged benefits to students, whether in terms of pedagogy or resulting skills. This year, the default choice is Python.

This course will be delivered through a combination of classes/computer workshops and lectures totalling a minimum of 30 hours across Michaelmas Term. This year, some or all of this teaching may be delivered through a combination of virtual classes and flipped-lectures delivered as short online videos. This course includes a reading week in Week 6 of Michaelmas Term.

Lectures will cover:

(1) Introduction: overview of the topics to be discussed, how numbers are presented in memory, floating point arithmetic, stability of numerical algorithms

(2) Basic algorithms: overview of different types of algorithms, Big-O notation, elementary complexity analysis, and their applications in data science

(3) Tools in optimisation: bi-section, steepest descent, Newton’s method, Quasi-Newton methods, stochastic search, stochastic gradient; convex optimization (coordinate descent, ADMM, etc).

(4) Tools in numerical linear algebra: Gaussian elimination, Cholesky decomposition, LU decomposition, matrix inversion and condition, computing eigenvalues and eigenvectors, and their applications

(5) Other topics: graph data processing and massive data processing

Students will be expected to produce 4 problem sets in the MT.

Bi-weekly exercises, involving computer programming and some theory.

Computational Statistics by Givens and Hoeting

Statistical computing in C++ and R by Eubank and Kupresanin

Foundations of Data Science by Blum, Hopcoft and Kannan

Introduction to Algorithms by Cormen, Leiserson, Rivest and Stein

The Art of R Programming: A Tour of Statistical Software Design by Matloff

Think Python: How to Think Like a Computer Scientist by Downey

Exam (70%, duration: 2 hours) in the summer exam period.
Coursework (30%) in the MT.