Optimizationf for Machine Learning
Optimizationf for Machine Learning
- Introductions and background week1: [pdf Slides]
Main teaching duties
From 2016 to 2022: Professor of Applied Mathematics, teaching at the maths and computer science departement of Caen University:
Responsible and teacher of the following courses from 2016 to 2022 (more than 275 hours in mean of teaching, a year) :
- Director of the Master 2 degree in Statistics and Decision Analytics (SAD), from 2017 - 2019
- Member of the council of the department of Mathematics and Computer Science
- Director of the Bachelor degree in Engineering sciences from 2012 to 2015
- Responsible of the second year of the Bachelor degree in Engineering sciences
- Responsible of the tutoring in computer science at the faculty of science at Toulon university
Responsible and teacher of the following courses from 2016 to 2022 (more than 275 hours in mean of teaching, a year) :
- Probabilities, Statistics 3 (Bsc in Maths & Applied Maths)
- Data Analysis 1 (Bsc in Maths & Applied Maths)
- Data Analysis and Classification (Master 1 Statistics & Master 1 Computer Science)
- Statistical Learning (Master 2 Statistics & Master 2 Computer Science)
- Time series Analysis (Master 2 Statistics)
- Programming (Language C and Python) (Bsc Computer Science)
- Probabilities (Bsc Computer Science)
- Inferential Statistics (Master 1 Computer Science)
- Statistical Learning and Data Analysis (Master 2 Computer Science)
Master SAAD
Master 2 Statistics & Decision Analytics / Master 2 Computer Science : Probabilistic Learning and Data Analysis (CM/TP)
-
[Slides (all)]
- Review of probability and statistics (in french)[ pdf]
- Review of parameter estimation - Maximum Likelihood, OLS, Regression... (in french) [pdf]
- Introductionary concepts, Pattern recognition, Machine Learning [pdf]
- Supervised Learning: Classification (KNN, Gaussian Discriminant Analyses, Logistic/Softmax regression) [pdf]
- Unsupervised learning: Clustering, Kmeans, Mixtures, Model Selection [pdf]
- Unsupervised learning: Topographic Learning (SOM, GTM, GTM through time)[pdf]
- Unsupervised learning: Sequential Data Modeling, Markov Chains, HMMs, Baum-Welch (EM), Viterbi[pdf]
- Unsupervised learning: Dimensionality reduction (PCA, Probabilistic PCA, Factor Analysis, EM)[pdf]
Slides per topic:
-
Practical work:
- Gaussian Discriminant Analysis and Logistic regression (supervised learning)[pdf] [solution]
- KNN (tp)[pdf]
- Supervised learning, Tp (LDA-QDA)[pdf] [pdf]
- Unsupervised learning: Kmeans and xEM clustering[pdf]
- Kmeans (TP)[pdf]
- EM-GMM (TP)[pdf]
- Sequential Data Modeling (HMMs)[pdf] [solution]
- Principal Component Analysis and Classification (TP, ACP- faces images)[pdf]
- Regression Mixtures and EM (TP) [pdf]
-
Exams:
- Examen Terminal 2020[pdf]
- Examen TP 2020[pdf]
- Examen Terminal 2018[pdf] [correction]
- Examen TP 2018[pdf] [correction]
- Examen Terminal 2017[pdf] [Solution]
- Examen TP1 2017[pdf] [correction]
- Examen TP2 2017[pdf] [correction]
Master 2 Statistics & Decision Analytics : Time series clustering and segmentation (CM/TD/TP)
Licence 3 Mathematics and applied Mathematics (MIASHS) / Master 1 Stat/CS: Data Analysis (CM/TD/TP)
-
Polycopié : [pdf]
- Partiel L3: [pdf] Solution [pdf]
- Examen Terminal M1: [pdf] Solution [pdf]
- Examen Terminal L3: [pdf] Solution [pdf]
- TDs partie n°1: [pdf] [pdf] Solution [pdf]
- TDs partie n°2: [pdf] Solution [pdf]
- TDs partie n°3: [pdf] Solution [pdf]
- TDs partie n°4: [pdf] Solution [pdf] Practical Works (TPs)
- TP n°1: [pdf]
- TP n°2: [pdf]
- TP n°3: [pdf]
- TP n°4: [pdf]
- TP n°5: [pdf]
- TP n°6: [pdf]
Practical Works (TDs)
Licence 3 Mathematics and Applied Mathematics (MIASHS): Probabilités et statistique (CM/TD)
- Contrôle Terminal 2020: [pdf] Correction [pdf]
- Partiel 2020: [pdf] Correction [pdf]
- Partiel 2017: [pdf] Correction [pdf]
- Partiel 2018: [pdf] Correction [pdf]
- Examaen TP 2018 (R): [pdf] Solution R [pdf]
- Examaen TP 2017 (R): [pdf] Solution R [pdf]
- Examen Terminal'17: [pdf] Solution [pdf]
- Examen Terminal'18: [pdf] Solution [pdf] Practical Works (TDs, TPs):
- Partie 1 (TDs): [pdf] Solution [pdf]
- Partie 2 (TDs): [pdf] Solution [pdf]
- Partie 3 (TD): [pdf] Solution [pdf]
- Practical work n°1 (TD): [pdf] Solution [pdf]
- Practical work n°2 (TP): [pdf] Solution [script-tp1.m] [script-LGN.m] [draw_ellipse.m] [normdenhist.m]
- Practical work n°3 (TD): [pdf] Solution [pdf]
- Practical work n°4 (TD): [pdf] Solution [pdf]
- Practical work n°5 (TP): [pdf]
Slides: [pdf] . Polys: [pdf] [pdf]
Practical Works (TDs, TPs)
Licence 2 Mathematics : Probabilités et statistique (TD)
Past: at Toulon University
[2011/2012] [2012/2013] [2013/2014] [2014/2015][2015]- Master 2 Informatique : Probabilistic Learning and Data Analysis (D33) [PDF] Slides
- Review of probability and statistics [PDF]
- Parameter estimation - Maximum Likelihood method, ... [PDF]
- Pattern recognition an machine learning concepts; Classification (discrimination), ... [PDF]
- Mixture models, GMM and EM - KmeansClustering - Model-Based Clustering, ... [PDF]
- SOM, GTM, GTM Through Time [PDF]
- Markov Chains, HMMs, Baum-Welch (EM), Viterbi [PDF]
- PCA, PPCA, FA [PDF]
- Practical work n°1 (TD): [pdf] Solution [pdf]
- Practical work (TP) n°2: [pdf]
- Practical work n°3 (TD): [pdf] Solution [pdf]
- Practical work n°4 (TP): [pdf]
- Practical work n°5 (TD): [pdf] Solution [pdf]
- Practical work n°6 (TP): [pdf]
- Master 2 Informatique : Initiation à la recherche (Initiation to research)
- Studied Paper: Miin-Shen Yang, Chien-Yo Lai, Chih-Ying Lin. "A robust EM clustering algorithm for Gaussian mixture models", Pattern Recognition , Volume 45, Issue 11, November 2012, Pages 3950–3961 [pdf] Solution: was provided by e-mail (please see your email box)
- Master 1 Informatique : Eléments de statistique Inférentielle (Elements of inferential statistics) (d13) [slides pdf]    [Polycopié]
- review of probability and stat, Random vectors, Gaussian vectors, Central Limit thm, etc [PDF]
- Estimation theory, Estimators properties, Cramér-Rao Lower Bound, estimation methods [PDF]
- Maximum Likelihood Estimator (MLE) [PDF]
- Least Squares Estimators (LSE), Linear regression [PDF]
- Interval estimation, Confidence intervals [PDF]
- Hypothesis Testing [PDF]
- Practical work n°1 (TD): [pdf] Solution [pdf]
- Practical work n°2 (TP): [pdf] Solution [script-tp1.m] [script-LGN.m] [draw_ellipse.m] [normdenhist.m]
- Practical work n°3 (TD): [pdf] Solution [pdf]
- Practical work n°4 (TD): [pdf] Solution [pdf]
- Practical work n°5 (TP): [pdf]
- Licence 2 Sciences pour l'Ingénieur : Programmation II – Langage C (C programming ) (I41) Polycopié : [pdf]
- TD n°1: [pdf]
- TD n°2: [pdf]
- TD n°3: [pdf]
- TD n°4: [pdf] Practical Works (TPs) (in French)
- TP n°1: [pdf]
- TP n°2: [pdf]
- TP n°3: [pdf]
- TP n°4: [pdf]
- TP n°5: [pdf]
- Projects
- Projet n°1: [pdf]
- Projet n°2: [pdf]
- Projet n°3: [pdf]
- Projet n°4: [pdf]
- Projet n°5: [pdf]
- Licence 2 Sciences pour l'Ingénieur : Probabilités discètres (Discrete Probability) (MI48) Polycopié : [pdf]
- Licence 1 Sciences pour l'Ingénieur : Algorithmique + programmation Python (Algorithmics + Python programming ) (I11 ; I21)
-
Slides
-
Practical Works (TDs, TPs)
-
Slides (in French) :
-
Practical Works (TDs, TPs) (in French)
-
Practical Works (TDs) (in French)
Past at Paris 13 University :
[2007-2011]- Temporary Research and Teaching Assistant (ATER) (march 2010 - July 2011)
- Mathématiques et informatique
- Introduction Structures de Données Linéaires
- Algorithmique des Structures de Données Linéaires
- Programmation Impérative
- Programmation Orientée Objet (Java)
- Algorithmique et Arbres
- Teaching Assistant (Moniteur) (2007-2010)
- C Programming Langage (64h/year)
- XHTML (32h/year), Introduction to GTK (32h/year)