| (47 intermediate revisions by 14 users not shown) | |||
| Line 8: | Line 8: | ||
<div style="border-bottom: rgb(68,68,136) 1px solid; border-left: rgb(51,51,136) 4px solid; padding-bottom: 2em; margin: auto; padding-left: 2em; width: 30em; padding-right: 2em; background: rgb(238,238,255); border-top: rgb(68,68,136) 1px solid; border-right: rgb(68,68,136) 1px solid; padding-top: 2em"> | <div style="border-bottom: rgb(68,68,136) 1px solid; border-left: rgb(51,51,136) 4px solid; padding-bottom: 2em; margin: auto; padding-left: 2em; width: 30em; padding-right: 2em; background: rgb(238,238,255); border-top: rgb(68,68,136) 1px solid; border-right: rgb(68,68,136) 1px solid; padding-top: 2em"> | ||
== '''Welcome to ECE662!''' == | == '''Welcome to ECE662!''' == | ||
| − | + | * The cleaned up version of the slectures is [[2014_Spring_ECE_662_Boutin_Statistical_Pattern_recognition_slectures|here]]. | |
| − | + | ||
| − | + | ||
| − | + | ||
</div> | </div> | ||
---- | ---- | ||
| Line 33: | Line 30: | ||
== [https://www.projectrhea.org/learning/slectures.php Slectures] == | == [https://www.projectrhea.org/learning/slectures.php Slectures] == | ||
| + | The cleaned up version of these slectures is [[2014_Spring_ECE_662_Boutin_Statistical_Pattern_recognition_slectures|HERE]] | ||
Please use this [[Slecture template ECE662S14|template for text slectures]] or this [[Slecture template video ECE662S14|template for video slectures]] | Please use this [[Slecture template ECE662S14|template for text slectures]] or this [[Slecture template video ECE662S14|template for video slectures]] | ||
| Line 39: | Line 37: | ||
**[[ECE662 Whitening and Coloring Transforms S14 MH|Whitening and Coloring Transforms]], by [[User:Mhossain|Maliha Hossain]] <span style="color:GREEN">OK</span> | **[[ECE662 Whitening and Coloring Transforms S14 MH|Whitening and Coloring Transforms]], by [[User:Mhossain|Maliha Hossain]] <span style="color:GREEN">OK</span> | ||
**How to generate random n dimensional data from two categories with different priors | **How to generate random n dimensional data from two categories with different priors | ||
| + | ***[[Generating random data with controlled prior probabilities slecture ECE662S14 Gheith|Video slecture in English]] by Alex Gheith <span style="color:GREEN">OK</span> | ||
***[[How to generate random n dimensional data from two categories with different priors slecture Minwoong Kim ECE662 Spring 2014|Video slecture in Korean ]], by Minwoong Kim <span style="color:GREEN">OK</span> | ***[[How to generate random n dimensional data from two categories with different priors slecture Minwoong Kim ECE662 Spring 2014|Video slecture in Korean ]], by Minwoong Kim <span style="color:GREEN">OK</span> | ||
***[[How to generate random n dimensional data from two categories with different priors slecture Minwoong Cho ECE662 Spring 2014|Video slecture in Korean ]], by Hyun Dok Cho <span style="color:GREEN">OK</span> | ***[[How to generate random n dimensional data from two categories with different priors slecture Minwoong Cho ECE662 Spring 2014|Video slecture in Korean ]], by Hyun Dok Cho <span style="color:GREEN">OK</span> | ||
| − | ***[[The principles for how to generate random samples from a Gaussian distribution|Text slecture in English]] by Joonsoo Kim | + | ***[[The principles for how to generate random samples from a Gaussian distribution|Text slecture in English]] by Joonsoo Kim <span style="color:GREEN">OK</span> |
***[[Generation of N-dimensional normally distributed random numbers from two categories with different priors|Text slecture in English]] by Jonghoon Jin <span style="color:GREEN">OK</span> | ***[[Generation of N-dimensional normally distributed random numbers from two categories with different priors|Text slecture in English]] by Jonghoon Jin <span style="color:GREEN">OK</span> | ||
**Principal Component Analysis (PCA) | **Principal Component Analysis (PCA) | ||
| − | ***[[PCA|Text slecture in English]], by [http://web.ics.purdue.edu/~zhou338/ Tian Zhou] <span style="color:GREEN"> | + | ***[[PCA|Text slecture in English]], by [http://web.ics.purdue.edu/~zhou338/ Tian Zhou] <span style="color:GREEN">OK</span> |
***[[PCA Theory Examples|Text slecture in English]], by Sujin Jang <span style="color:GREEN">OK</span> | ***[[PCA Theory Examples|Text slecture in English]], by Sujin Jang <span style="color:GREEN">OK</span> | ||
***[[Kernel PCA|Video slecture in English, and Chinese]], by Tsung Tai Yeh <span style="color:GREEN">OK</span> | ***[[Kernel PCA|Video slecture in English, and Chinese]], by Tsung Tai Yeh <span style="color:GREEN">OK</span> | ||
| + | ***[[Pca khalid|Video slecture in English]], by Khalid Tahboub <span style="color:GREEN" /> | ||
*Slectures on Curse of Dimensionality | *Slectures on Curse of Dimensionality | ||
**[[Curse of Dimensionality|Text slecture in English]], and [[Curse of Dimensionality Chinese|in Chinese]] by Haonan Yu USE SAME COMMENT PAGE FOR BOTH ENGLISH AND CHINESE VERSION | **[[Curse of Dimensionality|Text slecture in English]], and [[Curse of Dimensionality Chinese|in Chinese]] by Haonan Yu USE SAME COMMENT PAGE FOR BOTH ENGLISH AND CHINESE VERSION | ||
*Slectures on Bayes Rule | *Slectures on Bayes Rule | ||
**Bayes Rule in Layman's Terms | **Bayes Rule in Layman's Terms | ||
| − | ***[[Introduction to Bayes' Rule|Video slecture in Spanish]] by Francis Phillip <span style="color:GREEN">OK</span> | + | ***[[Introduction to Bayes' Rule|Video slecture in Spanish]] by Francis Phillip <span style="color:GREEN">OK</span> |
**Derivation of Bayes Rule | **Derivation of Bayes Rule | ||
| − | ***[[Derivation of Bayes rule Anonymous7|Text slecture in English]] By Anonymous7 <span style="color:GREEN">OK</span> | + | ***[[Derivation of Bayes rule Anonymous7|Text slecture in English]] By Anonymous7 <span style="color:GREEN">OK</span> |
***[[From Bayes Theorem to Pattern Recognition via Bayes Rule|Text slecture in English]] by [http://varunvasudevan.com/ Varun Vasudevan] <span style="color:GREEN">OK</span> | ***[[From Bayes Theorem to Pattern Recognition via Bayes Rule|Text slecture in English]] by [http://varunvasudevan.com/ Varun Vasudevan] <span style="color:GREEN">OK</span> | ||
***[[Derivation of Bayes' Rule from Bayes' Theorem|Video slecture in English]] by Nadra Guizani <span style="color:GREEN">OK</span> | ***[[Derivation of Bayes' Rule from Bayes' Theorem|Video slecture in English]] by Nadra Guizani <span style="color:GREEN">OK</span> | ||
| Line 61: | Line 61: | ||
**Optimality of Bayes Rule | **Optimality of Bayes Rule | ||
***[[Slecture optimality bayes decision rule michaux ECE662S14|Video slecture in English]] by Aaron Michaux <span style="color:GREEN">OK</span> | ***[[Slecture optimality bayes decision rule michaux ECE662S14|Video slecture in English]] by Aaron Michaux <span style="color:GREEN">OK</span> | ||
| − | ***[[Kjw810313|Video slecture in Korean]] by Jeong-wan Kim <span style="color:GREEN">OK</span> | + | ***[[Kjw810313|Video slecture in Korean]] by Jeong-wan Kim <span style="color:GREEN">OK</span> |
**Upper Bounds for Bayes Error | **Upper Bounds for Bayes Error | ||
| − | ***[[Upper Bounds for Bayes Error|Text slecture in English]] by G. M. Dilshan Godaliyadda | + | ***[[Upper Bounds for Bayes Error|Text slecture in English]] by G. M. Dilshan Godaliyadda |
| − | + | ||
***[[Test|Text slecture in English (includes the derivation of Chernoff Distance)]] by Jeehyun Choe <span style="color:GREEN">OK</span> | ***[[Test|Text slecture in English (includes the derivation of Chernoff Distance)]] by Jeehyun Choe <span style="color:GREEN">OK</span> | ||
**Bayes Rule to Minimize Risk | **Bayes Rule to Minimize Risk | ||
| − | ***[[Slecture Bayes rule to minimize risk Andy Park ECE662 Spring 2014|Video slectures in English]], by Andy Park <span style="color:GREEN">OK</span> | + | ***[[Slecture Bayes rule to minimize risk Andy Park ECE662 Spring 2014|Video slectures in English]], by Andy Park <span style="color:GREEN">OK</span> |
| − | ***[[ | + | ***[[Ness slecture 2014|Text slecture in Chinese]] by Robert Ness <span style="color:GREEN">OK</span> |
***[[Bayes Rule Minimize Risk Dennis Lee|Text slecture in English]] by Dennis Lee <span style="color:GREEN">OK</span> | ***[[Bayes Rule Minimize Risk Dennis Lee|Text slecture in English]] by Dennis Lee <span style="color:GREEN">OK</span> | ||
**Bayes Rule for Normally Distributed Features | **Bayes Rule for Normally Distributed Features | ||
| − | ***[[Discussion about Discriminant Functions for the Multivariate Normal Density|Text slecture in English]] by Yanzhe Cui | + | ***[[Discussion about Discriminant Functions for the Multivariate Normal Density|Text slecture in English]] by Yanzhe Cui |
***[[Bayes Rule for 1-dimensional and N-dimensional feature spaces|Text slecture in English]] by Jihwan Lee <span style="color:GREEN">OK</span> | ***[[Bayes Rule for 1-dimensional and N-dimensional feature spaces|Text slecture in English]] by Jihwan Lee <span style="color:GREEN">OK</span> | ||
**Bayes rule in practice | **Bayes rule in practice | ||
| Line 79: | Line 78: | ||
**[[Neyman-Pearson Lemma and Receiver Operating Characteristic Curve|Text slecture in English]] by [https://engineering.purdue.edu/~lee714/ Soonam Lee] <span style="color:GREEN">OK</span> | **[[Neyman-Pearson Lemma and Receiver Operating Characteristic Curve|Text slecture in English]] by [https://engineering.purdue.edu/~lee714/ Soonam Lee] <span style="color:GREEN">OK</span> | ||
**[[ROC curve analysis slecture ECE662 Spring0214 Sun|Video slecture in English]] by Jianxin Sun <span style="color:GREEN">OK</span> | **[[ROC curve analysis slecture ECE662 Spring0214 Sun|Video slecture in English]] by Jianxin Sun <span style="color:GREEN">OK</span> | ||
| − | |||
*Slectures on Density Estimation | *Slectures on Density Estimation | ||
**Maximum Likelihood Estimation (MLE) | **Maximum Likelihood Estimation (MLE) | ||
| Line 85: | Line 83: | ||
***[[Maximum Likelihood Estimation Analysis for various Probability Distributions|Text slecture in English]] by Hariharan Seshadri <span style="color:GREEN">OK</span> | ***[[Maximum Likelihood Estimation Analysis for various Probability Distributions|Text slecture in English]] by Hariharan Seshadri <span style="color:GREEN">OK</span> | ||
***[[Video slecture in English: Introduction to Maximum Likelihood Estimation|Video slecture in English]] by Anantha Raghuraman <span style="color:GREEN">OK</span> | ***[[Video slecture in English: Introduction to Maximum Likelihood Estimation|Video slecture in English]] by Anantha Raghuraman <span style="color:GREEN">OK</span> | ||
| − | ***[[Convergence of the Maximum Likelihood Estimator over Multiple Trials|Video slecture in English]] by [http://web.ics.purdue.edu/~scarver/ Spencer Carver] <span style="color:GREEN">OK</span> | + | ***[[Convergence of the Maximum Likelihood Estimator over Multiple Trials|Video slecture in English]] by [http://web.ics.purdue.edu/~scarver/ Spencer Carver] <span style="color:GREEN">OK</span> |
***[[Maximum Likelihood Estimators and Examples|Text slecture in English]] by Lu Zhang <span style="color:GREEN">OK</span> | ***[[Maximum Likelihood Estimators and Examples|Text slecture in English]] by Lu Zhang <span style="color:GREEN">OK</span> | ||
***[[SlectureKeehwanECE662Spring14|Video slecture in English]] by Keehwan Park <span style="color:GREEN">OK</span> | ***[[SlectureKeehwanECE662Spring14|Video slecture in English]] by Keehwan Park <span style="color:GREEN">OK</span> | ||
| − | ***[[MLEforGMM| Text slecture in English]] by Wen Yi | + | ***[[MLEforGMM|Text slecture in English]] by Wen Yi |
| − | ***[[ | + | ***[[ECE662Selecture zhenpengMLE|Text slecture in English]] by Zhenpeng Zhao |
**Bayesian Estimation (BPE) | **Bayesian Estimation (BPE) | ||
| − | ***[[Bayes Parameter Estimation|Text slecture in English]] by Haiguang Wen <span style="color:GREEN">OK</span> | + | ***[[Bayes Parameter Estimation|Text slecture in English]] by Haiguang Wen <span style="color:GREEN">OK</span> |
| − | ***[[Bayersian Parameter Estimation: Gaussian Case|Text slecture in English]], by Shaobo Fang | + | ***[[Bayersian Parameter Estimation: Gaussian Case|Text slecture in English]], by Shaobo Fang |
| − | ***[[Bayes Parameter Estimation with examples|Text slecture in English]] by Yu Wang | + | ***[[Bayes Parameter Estimation with examples|Text slecture in English]] by Yu Wang |
**Introduction to Local density Estimation Techniques (so-called "non-parametric") | **Introduction to Local density Estimation Techniques (so-called "non-parametric") | ||
| − | ***[[Introduction to local density estimation methods|Text slecture in English]] by Yu Liu <span style="color:GREEN">OK</span> | + | ***[[Introduction to local density estimation methods|Text slecture in English]] by Yu Liu <span style="color:GREEN">OK</span> |
| − | ***[[Slecture Introduction local density estimation methods ECE662 Spring2014 Aziza|Video slecture in Russian]] by Aziza Satkhozhina | + | ***[[Slecture Introduction local density estimation methods ECE662 Spring2014 Aziza|Video slecture in Russian]] by Aziza Satkhozhina |
***[[Introduction to local density estimation methods ECE662 Spring2014 Nusaybah|Video slecture in English]] by Nusaybah Abu-Mulaweh | ***[[Introduction to local density estimation methods ECE662 Spring2014 Nusaybah|Video slecture in English]] by Nusaybah Abu-Mulaweh | ||
| − | ***[[Intro local non parametric density estimation methods ECE662 Spring2014 Yuan|Video slecture in English]] by Chenxi Yuan <span style="color:GREEN">OK</span> | + | ***[[Intro local non parametric density estimation methods ECE662 Spring2014 Yuan|Video slecture in English]] by Chenxi Yuan <span style="color:GREEN">OK</span> |
**Density Estimation with Parzen Windows | **Density Estimation with Parzen Windows | ||
| − | ***[[ParzenWindow|Text slecture in English]] by Chiho Choi <span style="color:GREEN">OK</span> | + | ***[[ParzenWindow|Text slecture in English]] by Chiho Choi <span style="color:GREEN">OK</span> |
| − | ***[[Parzen Window Density Estimation|Text slecture in English]] by Ben Foster <span style="color:GREEN">OK</span> | + | ***[[Parzen Window Density Estimation|Text slecture in English]] by Ben Foster <span style="color:GREEN">OK</span> |
| − | ***[[Parzen Windows|Text slecture in English]] by Abdullah Alshaibani <span style="color:GREEN">OK</span> | + | ***[[Parzen Windows|Text slecture in English]] by Abdullah Alshaibani <span style="color:GREEN">OK</span> |
| − | + | ||
**Density Estimation with K-Nearest Neighbors (KNN) | **Density Estimation with K-Nearest Neighbors (KNN) | ||
| − | ***[[KnnDensityEstimation|Text slecture in English]] by Raj Praveen Selvaraj <span style="color:GREEN">OK</span> | + | ***[[KnnDensityEstimation|Text slecture in English]] by Raj Praveen Selvaraj <span style="color:GREEN">OK</span> |
| − | ***[[Knearestneighbors|Text slecture in English]] by Dan Barrett | + | ***[[Knearestneighbors|Text slecture in English]] by Dan Barrett QUESTION PAGE |
| − | ***[[K-Nearest Neighbors Density Estimation|Video slecture in English]] by Qi Wang <span style="color:GREEN">OK</span> | + | ***[[K-Nearest Neighbors Density Estimation|Video slecture in English]] by Qi Wang <span style="color:GREEN">OK</span> |
**The Nearest Neighbor Decision Rule | **The Nearest Neighbor Decision Rule | ||
| − | ***[[Estimation Using Nearest Neighbor|Text slecture in English]] by Sang Ho Yoon | + | ***[[Estimation Using Nearest Neighbor|Text slecture in English]] by Sang Ho Yoon |
| − | ***[[Slecture from KNN to nearest neighbor|Text slecture in English]] by Jonathan Manring <span style="color:GREEN">OK</span> | + | ***[[Slecture from KNN to nearest neighbor|Text slecture in English]] by Jonathan Manring <span style="color:GREEN">OK</span> |
| − | + | ||
*Slectures on Linear Classifiers | *Slectures on Linear Classifiers | ||
| − | ** | + | **[[JMSLinearClassifierSlecture|Text slecture in English]] by John Mulcahy-Stanislawczyk |
| + | **[[CBR_logistic_regression|Text slecture in English]] by Borui Chen | ||
*Slectures on Support Vector Machines (SVM) | *Slectures on Support Vector Machines (SVM) | ||
| − | **[ | + | **[https://kiwi.ecn.purdue.edu/rhea/index.php/Least_Squares_Support_Vector_Machine_and_its_Applications_in_Solving_Linear_Regression_Problems Text slecture in English] by Xing Liu |
| − | **[[Support Vector Machine|Video slecture in English]] by Tao Jiang | + | **[[Support Vector Machine|Video slecture in English]] by Tao Jiang |
| + | *Slectures on Clustering Algorithms (supplemental material) | ||
| + | **[[SlectureDavidRunyanCS662Spring14|text slecture in English]] by David Runyan | ||
---- | ---- | ||
Latest revision as of 20:50, 2 May 2016
Contents
ECE662: Statistical Pattern Recognition and Decision Making Processes, Spring 2014 (cross-listed with CS662)
Welcome to ECE662!
- The cleaned up version of the slectures is here.
Course Information
Instructor:
- Office: MSEE342
- Office hours
- Assignment Drop Box
Lecture:
- When? TuTh, 10:30 - 11:45
- Where? EE117 (subject to change)
Slectures
The cleaned up version of these slectures is HERE
Please use this template for text slectures or this template for video slectures
- Slectures on Probability and Statistics
- Whitening and Coloring Transforms, by Maliha Hossain OK
- How to generate random n dimensional data from two categories with different priors
- Video slecture in English by Alex Gheith OK
- Video slecture in Korean , by Minwoong Kim OK
- Video slecture in Korean , by Hyun Dok Cho OK
- Text slecture in English by Joonsoo Kim OK
- Text slecture in English by Jonghoon Jin OK
- Principal Component Analysis (PCA)
- Text slecture in English, by Tian Zhou OK
- Text slecture in English, by Sujin Jang OK
- Video slecture in English, and Chinese, by Tsung Tai Yeh OK
- Video slecture in English, by Khalid Tahboub <span style="color:GREEN" />
- Slectures on Curse of Dimensionality
- Text slecture in English, and in Chinese by Haonan Yu USE SAME COMMENT PAGE FOR BOTH ENGLISH AND CHINESE VERSION
- Slectures on Bayes Rule
- Bayes Rule in Layman's Terms
- Video slecture in Spanish by Francis Phillip OK
- Derivation of Bayes Rule
- Text slecture in English By Anonymous7 OK
- Text slecture in English by Varun Vasudevan OK
- Video slecture in English by Nadra Guizani OK
- Video slecture in English by Jieun Kim OK
- Text slecture in Greek by Stylianos Chatzidakis OK
- Text slecture in Chinese by Weibao Wang OK
- Optimality of Bayes Rule
- Video slecture in English by Aaron Michaux OK
- Video slecture in Korean by Jeong-wan Kim OK
- Upper Bounds for Bayes Error
- Text slecture in English by G. M. Dilshan Godaliyadda
- Text slecture in English (includes the derivation of Chernoff Distance) by Jeehyun Choe OK
- Bayes Rule to Minimize Risk
- Video slectures in English, by Andy Park OK
- Text slecture in Chinese by Robert Ness OK
- Text slecture in English by Dennis Lee OK
- Bayes Rule for Normally Distributed Features
- Text slecture in English by Yanzhe Cui
- Text slecture in English by Jihwan Lee OK
- Bayes rule in practice
- Text slecture in English by Lu Wang OK
- Text slecture in English by Chuohao Tang OK
- Bayes Rule in Layman's Terms
- Slectures on Neyman-Pearson test and ROC curves
- Text slecture in English by Soonam Lee OK
- Video slecture in English by Jianxin Sun OK
- Slectures on Density Estimation
- Maximum Likelihood Estimation (MLE)
- Text slecture in English by Sudhir Kylasa OK
- Text slecture in English by Hariharan Seshadri OK
- Video slecture in English by Anantha Raghuraman OK
- Video slecture in English by Spencer Carver OK
- Text slecture in English by Lu Zhang OK
- Video slecture in English by Keehwan Park OK
- Text slecture in English by Wen Yi
- Text slecture in English by Zhenpeng Zhao
- Bayesian Estimation (BPE)
- Text slecture in English by Haiguang Wen OK
- Text slecture in English, by Shaobo Fang
- Text slecture in English by Yu Wang
- Introduction to Local density Estimation Techniques (so-called "non-parametric")
- Text slecture in English by Yu Liu OK
- Video slecture in Russian by Aziza Satkhozhina
- Video slecture in English by Nusaybah Abu-Mulaweh
- Video slecture in English by Chenxi Yuan OK
- Density Estimation with Parzen Windows
- Text slecture in English by Chiho Choi OK
- Text slecture in English by Ben Foster OK
- Text slecture in English by Abdullah Alshaibani OK
- Density Estimation with K-Nearest Neighbors (KNN)
- Text slecture in English by Raj Praveen Selvaraj OK
- Text slecture in English by Dan Barrett QUESTION PAGE
- Video slecture in English by Qi Wang OK
- The Nearest Neighbor Decision Rule
- Text slecture in English by Sang Ho Yoon
- Text slecture in English by Jonathan Manring OK
- Maximum Likelihood Estimation (MLE)
- Slectures on Linear Classifiers
- Text slecture in English by John Mulcahy-Stanislawczyk
- Text slecture in English by Borui Chen
- Slectures on Support Vector Machines (SVM)
- Text slecture in English by Xing Liu
- Video slecture in English by Tao Jiang
- Slectures on Clustering Algorithms (supplemental material)
- text slecture in English by David Runyan
Peer Reviews
- Instruction for peer reviewing HW1
- Instruction for peer reviewing HW2 (due before class on April 29)
Discussion
Feel free to use the space below for discussion, or create a page for discussion and link it below.
- Where to find data for HW1
- Possible Real-world data to use for class
- Programming help!
- New Discussion
