Machine learning algorithms for inverse problems.

This page contains the program of the course: lectures, exercise sessions and computer labs. Other information, such as learning outcomes, teachers, literature and examination, are in a separate course PM.

Program

All lectures in January - February 2021 will be given in Zoom via the link

Link for lectures in 2021

Passcode: 881091

The first lecture in 2021:  12 January, Time: 13:15-14:00.

Course literature:

Approximate Global Convergence and Adaptivity for Coefficient Inverse Problems
Authors: L. Beilina,  M. V.  Klibanov

Registration

The course gives 7.5 Hp. 

Registration for PhD students and  for students at  Master program at Chalmers : sent mail to larisa@chalmers.se

Registration for Master program students at GU: the course code is MMF900

 

Lectures

Lecture 1

Introduction. Physical formulations leading to ill- and well-posed problems.  Compact set and compact operator. Definitions of well and ill-posed problems. Classical and conditional correctness. Concept of Tikhonov and Tikhonov's theorem.   Quasi-solution.  Examples of ill-posed problems.  Model inverse problems: elliptic inverse Cauchy problem. 

Lecture 1

Lecture 2.

Physical formulations leading to ill- and well-posed problems.

Model inverse problems: elliptic inverse problems (Cauchy problem, Inverse source problem, Inverse spectral problem); Hyperbolic and Parabolic CIPs.

Lecture 2

Lecture 3.

Methods for image reconstruction and image deblurring.  Solution of a Fredholm integral equation of the first kind as  an ill-posed problem.  Bayesian approach.  Adaptive finite element method.

Lecture 3, part 1

Microwave Imaging in monitoring of hyperthermia

Lecture 3, part 2

 

Lecture 4.

Lagrangian approach for solution of time-harmonic  CIP.   Presentation and discussion of the course project  “Solution of time-harmonic  acoustic coefficient inverse problem”.

 

Lecture 4

Lecture 5.

Methods of regularization of inverse problems. The Tikhonov regularization functional.  The accuracy of the regularized solution.  The local strong convexity of the Tikhonov  functional.

Methods of regularization of inverse problems: Morozov's discrepancy,  balancing principle.

Lecture 5

Lecture 6.

Linear and non-linear least squares problems. Gauss-Newton and  Levenberg-Marquardt  iterative methods for solution of nonlinear least squares problems.

Lecture 6

Lecture 7.

QR and SVD. Solution of rank-deficient problems.  Principal Component Analysis (PCA) for image compression  and image recognition. Presentation of the course project "Principal Component Analysis for   recognition of handwritten  digits". 

Lecture 7

Lecture 8.

Classification algorithms: linear and polynomial classifiers, linear and quadratic perceptron  learning algorithm, WINNOW. Neural networks for classification. 

Lecture 8

Lecture 9.

Linear models   for regression. Regularized and non-regularized neural networks. Kernel methods. Support Vector Machines. Kernel perceptron for classificaton.

Lecture 9 - SVM

Presentation of the course project "Regularized Least squares and machine learning algorithms for classification problem".

Lecture 9

Lecture 10.

Lagrangian approach and adaptive FEM for solution of parameter identification problem for system of ODE. Application of adaptive FEM for determination of drug efficacy in the model of HIV infection.

Lecture 10

Back to the top

Computer  Projects

1. Project "Regularized least squares and machine learning algorithms for classification"

Paper "Numerical analysis of least squares and perceptron learning for classification problems"

Dataset  iris.csv

Matlab program for classification of data from dataset iris.csv

Test dataset mnist_test_10.csv with handwritten digits

Train dataset mnist_train_10.csv with handwritten digits

Matlab program for reading datasets mnist*.csv

Matlab function used by the   above program

2.  Project "Principal component analysis for image recognition"

Matlab program with an example of using PCA

3. Project “Solution of time-harmonic  acoustic coefficient inverse problem”

Link to the Matlab code for solution of Poisson's equation  with homogeneous boundary conditions  in 2D

4. Project "Regularized adaptive algorithms for detection of tumours in microwave medical imaging"

Matlab code together with data used in algorithm for microwave medical imaging

Reference literature:

  1. Learning MATLAB, Tobin A. Driscoll. Provides a brief introduction to Matlab to the one who already knows computer programming. Available as e-book from Chalmers library.
  2. Physical Modeling in MATLAB 3/E, Allen B. Downey
    The book is free to download from the web. The book gives an introduction for those who have not programmed before. It covers basic MATLAB programming with a focus on modeling and simulation of physical systems.
  3. Matlab and C++ programs for examples in the book  Numerical Linear Algebra: Theory and Applications, Authors: Beilina, L., Karchevskii, E., Karchevskii, M.  are available for download from the GitHub Page

 

Back to the top

Course summary:

Date Details Due