Machine learning algorithms for inverse problems.
This page contains the program of the course: lectures, exercise sessions and computer labs. Other information, such as learning outcomes, teachers, literature and examination, are in a separate course PM.
Program
All lectures in January - February 2021 will be given in Zoom via the link
Passcode: 881091
The first lecture in 2021: 12 January, Time: 13:15-14:00.
Course literature:
Approximate Global Convergence and Adaptivity for Coefficient Inverse Problems
Authors: L. Beilina, M. V. Klibanov
Registration
The course gives 7.5 Hp.
Registration for PhD students and for students at Master program at Chalmers : sent mail to larisa@chalmers.se
Registration for Master program students at GU: the course code is MMF900
Lectures
Lecture 1
Introduction. Physical formulations leading to ill- and well-posed problems. Compact set and compact operator. Definitions of well and ill-posed problems. Classical and conditional correctness. Concept of Tikhonov and Tikhonov's theorem. Quasi-solution. Examples of ill-posed problems. Model inverse problems: elliptic inverse Cauchy problem.
Lecture 2.
Physical formulations leading to ill- and well-posed problems.
Model inverse problems: elliptic inverse problems (Cauchy problem, Inverse source problem, Inverse spectral problem); Hyperbolic and Parabolic CIPs.
Lecture 3.
Methods for image reconstruction and image deblurring. Solution of a Fredholm integral equation of the first kind as an ill-posed problem. Bayesian approach. Adaptive finite element method.
Microwave Imaging in monitoring of hyperthermia
Lecture 4.
Lagrangian approach for solution of time-harmonic CIP. Presentation and discussion of the course project “Solution of time-harmonic acoustic coefficient inverse problem”.
Lecture 5.
Methods of regularization of inverse problems. The Tikhonov regularization functional. The accuracy of the regularized solution. The local strong convexity of the Tikhonov functional.
Methods of regularization of inverse problems: Morozov's discrepancy, balancing principle.
Lecture 6.
Linear and non-linear least squares problems. Gauss-Newton and Levenberg-Marquardt iterative methods for solution of nonlinear least squares problems.
Lecture 7.
QR and SVD. Solution of rank-deficient problems. Principal Component Analysis (PCA) for image compression and image recognition. Presentation of the course project "Principal Component Analysis for recognition of handwritten digits".
Lecture 8.
Classification algorithms: linear and polynomial classifiers, linear and quadratic perceptron learning algorithm, WINNOW. Neural networks for classification.
Lecture 9.
Linear models for regression. Regularized and non-regularized neural networks. Kernel methods. Support Vector Machines. Kernel perceptron for classificaton.
Presentation of the course project "Regularized Least squares and machine learning algorithms for classification problem".
Lecture 10.
Lagrangian approach and adaptive FEM for solution of parameter identification problem for system of ODE. Application of adaptive FEM for determination of drug efficacy in the model of HIV infection.
Computer Projects
1. Project "Regularized least squares and machine learning algorithms for classification"
Paper "Numerical analysis of least squares and perceptron learning for classification problems"
Matlab program for classification of data from dataset iris.csv
Test dataset mnist_test_10.csv with handwritten digits
Train dataset mnist_train_10.csv with handwritten digits
Matlab program for reading datasets mnist*.csv
Matlab function used by the above program
2. Project "Principal component analysis for image recognition"
Matlab program with an example of using PCA
3. Project “Solution of time-harmonic acoustic coefficient inverse problem”
4. Project "Regularized adaptive algorithms for detection of tumours in microwave medical imaging"
Matlab code together with data used in algorithm for microwave medical imaging
Reference literature:
- Learning MATLAB, Tobin A. Driscoll. Provides a brief introduction to Matlab to the one who already knows computer programming. Available as e-book from Chalmers library.
-
Physical Modeling in MATLAB 3/E, Allen B. Downey
The book is free to download from the web. The book gives an introduction for those who have not programmed before. It covers basic MATLAB programming with a focus on modeling and simulation of physical systems. -
Matlab and C++ programs for examples in the book Numerical Linear Algebra: Theory and Applications, Authors: Beilina, L., Karchevskii, E., Karchevskii, M. are available for download from the GitHub Page
Course summary:
Date | Details | Due |
---|---|---|