| Line 9: | Line 9: | ||
== '''Welcome to ECE662!''' == | == '''Welcome to ECE662!''' == | ||
| − | PLEASE FILL OUT THE COURSE EVALUATION AT WWW.PURDUE.EDU/EVAL | + | PLEASE FILL OUT THE COURSE EVALUATION AT WWW.PURDUE.EDU/EVAL |
| − | YOUR FEEDBACK IS TRULY APPRECIATED. THANKS FOR YOUR TIME. -PROF MIMI | + | YOUR FEEDBACK IS TRULY APPRECIATED. THANKS FOR YOUR TIME. -PROF MIMI |
</div> | </div> | ||
---- | ---- | ||
| Line 40: | Line 40: | ||
**How to generate random n dimensional data from two categories with different priors | **How to generate random n dimensional data from two categories with different priors | ||
***[[How to generate random n dimensional data from two categories with different priors slecture Minwoong Kim ECE662 Spring 2014|Video slecture in Korean ]], by Minwoong Kim <span style="color:GREEN">OK</span> | ***[[How to generate random n dimensional data from two categories with different priors slecture Minwoong Kim ECE662 Spring 2014|Video slecture in Korean ]], by Minwoong Kim <span style="color:GREEN">OK</span> | ||
| − | ***[[How to generate random n dimensional data from two categories with different priors slecture Minwoong Cho ECE662 Spring 2014|Video slecture in Korean ]], by Hyun Dok Cho <span style="color:GREEN">OK</span> | + | ***[[How to generate random n dimensional data from two categories with different priors slecture Minwoong Cho ECE662 Spring 2014|Video slecture in Korean ]], by Hyun Dok Cho <span style="color:GREEN">OK</span> |
| − | ***[[The principles for how to generate random samples from a Gaussian distribution|Text slecture in English]] by Joonsoo Kim QUESTION PAGE NEEDS FORMATTING TO LOOK LIKE THE OTHER ONES | + | ***[[The principles for how to generate random samples from a Gaussian distribution|Text slecture in English]] by Joonsoo Kim QUESTION PAGE NEEDS FORMATTING TO LOOK LIKE THE OTHER ONES |
***[[Generation of N-dimensional normally distributed random numbers from two categories with different priors|Text slecture in English]] by Jonghoon Jin <span style="color:GREEN">OK</span> | ***[[Generation of N-dimensional normally distributed random numbers from two categories with different priors|Text slecture in English]] by Jonghoon Jin <span style="color:GREEN">OK</span> | ||
**Principal Component Analysis (PCA) | **Principal Component Analysis (PCA) | ||
***[[PCA|Text slecture in English]], by [http://web.ics.purdue.edu/~zhou338/ Tian Zhou] <span style="color:GREEN">OK</span> | ***[[PCA|Text slecture in English]], by [http://web.ics.purdue.edu/~zhou338/ Tian Zhou] <span style="color:GREEN">OK</span> | ||
***[[PCA Theory Examples|Text slecture in English]], by Sujin Jang <span style="color:GREEN">OK</span> | ***[[PCA Theory Examples|Text slecture in English]], by Sujin Jang <span style="color:GREEN">OK</span> | ||
| − | ***[[Kernel PCA|Video slecture in English, and Chinese]], by Tsung Tai Yeh | + | ***[[Kernel PCA|Video slecture in English, and Chinese]], by Tsung Tai Yeh <span style="color:GREEN">OK</span> |
*Slectures on Curse of Dimensionality | *Slectures on Curse of Dimensionality | ||
**[[Curse of Dimensionality|Text slecture in English]], and [[Curse of Dimensionality Chinese|in Chinese]] by Haonan Yu USE SAME COMMENT PAGE FOR BOTH ENGLISH AND CHINESE VERSION | **[[Curse of Dimensionality|Text slecture in English]], and [[Curse of Dimensionality Chinese|in Chinese]] by Haonan Yu USE SAME COMMENT PAGE FOR BOTH ENGLISH AND CHINESE VERSION | ||
*Slectures on Bayes Rule | *Slectures on Bayes Rule | ||
**Bayes Rule in Layman's Terms | **Bayes Rule in Layman's Terms | ||
| − | ***[[Introduction to Bayes' Rule|Video slecture in Spanish]] by | + | ***[[Introduction to Bayes' Rule|Video slecture in Spanish]] by Francis Phillip |
**Derivation of Bayes Rule | **Derivation of Bayes Rule | ||
| − | ***[[ | + | ***[[Derivation of Bayes rule Anonymous7|Text slecture in English]] By Anonymous7 |
***[[From Bayes Theorem to Pattern Recognition via Bayes Rule|Text slecture in English]] by [http://varunvasudevan.com/ Varun Vasudevan] <span style="color:GREEN">OK</span> | ***[[From Bayes Theorem to Pattern Recognition via Bayes Rule|Text slecture in English]] by [http://varunvasudevan.com/ Varun Vasudevan] <span style="color:GREEN">OK</span> | ||
| − | ***[[Derivation of Bayes' Rule from Bayes' Theorem|Video slecture in English]] by Nadra Guizani | + | ***[[Derivation of Bayes' Rule from Bayes' Theorem|Video slecture in English]] by Nadra Guizani <span style="color:GREEN">OK</span> |
| − | ***[[Derivation Bayes Rule slecture ECE662 Spring2014 Kim|Video slecture in English]] by Jieun Kim <span style="color:GREEN">OK</span> | + | ***[[Derivation Bayes Rule slecture ECE662 Spring2014 Kim|Video slecture in English]] by Jieun Kim <span style="color:GREEN">OK</span> |
| − | ***[[Derivation of Bayes rule In Greek|Text slecture in Greek]] by Stylianos Chatzidakis <span style="color:GREEN">OK</span> | + | ***[[Derivation of Bayes rule In Greek|Text slecture in Greek]] by Stylianos Chatzidakis <span style="color:GREEN">OK</span> |
| − | ***[[Derivation of Bayes rule In Chinese|Text slecture in Chinese]] by Weibao Wang <span style="color:GREEN">OK</span> | + | ***[[Derivation of Bayes rule In Chinese|Text slecture in Chinese]] by Weibao Wang <span style="color:GREEN">OK</span> |
**Optimality of Bayes Rule | **Optimality of Bayes Rule | ||
| − | ***[[Slecture optimality bayes decision rule michaux ECE662S14|Video slecture in English]] by Aaron Michaux | + | ***[[Slecture optimality bayes decision rule michaux ECE662S14|Video slecture in English]] by Aaron Michaux <span style="color:GREEN">OK</span> |
| − | ***[[ | + | ***[[Kjw810313|Video slecture in Korean]] by Jeong-wan Kim SLIGHT EDITS NEEDED; PROF MIMI NEEDS TO UPLOAD VIDEO ON YOUTUBE AND EMBED |
**Upper Bounds for Bayes Error | **Upper Bounds for Bayes Error | ||
***[[Upper Bounds for Bayes Error|Text slecture in English]] by G. M. Dilshan Godaliyadda QUESTION PAGE NEEDS SLIGHT EDITING TO FOLLOW FORMAT OF OTHERS | ***[[Upper Bounds for Bayes Error|Text slecture in English]] by G. M. Dilshan Godaliyadda QUESTION PAGE NEEDS SLIGHT EDITING TO FOLLOW FORMAT OF OTHERS | ||
| − | ***[[Upper Bound for Bayes error|Text slecture in English]] by Yihan Ding <span style="color:GREEN">OK</span> | + | ***[[Upper Bound for Bayes error|Text slecture in English]] by Yihan Ding <span style="color:GREEN">OK</span> |
| − | ***[[Test|Text slecture in English (includes the derivation of Chernoff Distance)]] by Jeehyun Choe <span style="color:GREEN">OK</span> | + | ***[[Test|Text slecture in English (includes the derivation of Chernoff Distance)]] by Jeehyun Choe <span style="color:GREEN">OK</span><span style="color:GREEN" /><br> |
| + | **Neyman-Pearson Formulation of Bayes Rule | ||
| + | ***[https://www.projectrhea.org/rhea/index.php/NeymanPearson%E4%B8%AD%E6%96%87Spring2014 Text slecture in Chinese] by Robert Ness | ||
**Bayes Rule to Minimize Risk | **Bayes Rule to Minimize Risk | ||
| − | ***[[Slecture Bayes rule to minimize risk Andy Park ECE662 Spring 2014|Video slectures in English]], by Andy Park <span style="color:GREEN">OK</span> | + | ***[[Slecture Bayes rule to minimize risk Andy Park ECE662 Spring 2014|Video slectures in English]], by Andy Park <span style="color:GREEN">OK</span> |
***[[Bayes Rule Minimize Risk Dennis Lee|Text slecture in English]] by Dennis Lee <span style="color:GREEN">OK</span> | ***[[Bayes Rule Minimize Risk Dennis Lee|Text slecture in English]] by Dennis Lee <span style="color:GREEN">OK</span> | ||
**Bayes Rule for Normally Distributed Features | **Bayes Rule for Normally Distributed Features | ||
| − | ***[[Discussion about Discriminant Functions for the Multivariate Normal Density|Text slecture in English]] by Yanzhe Cui QUESTION PAGE NEEDS TO BE FORMATTED TO LOOK LIKE THE OTHERS | + | ***[[Discussion about Discriminant Functions for the Multivariate Normal Density|Text slecture in English]] by Yanzhe Cui QUESTION PAGE NEEDS TO BE FORMATTED TO LOOK LIKE THE OTHERS |
| − | ***[[Bayes Rule for 1-dimensional and N-dimensional feature spaces|Text slecture in English]] by Jihwan Lee <span style="color:GREEN">OK</span> | + | ***[[Bayes Rule for 1-dimensional and N-dimensional feature spaces|Text slecture in English]] by Jihwan Lee <span style="color:GREEN">OK</span> |
**Bayes rule in practice | **Bayes rule in practice | ||
| − | ***[[Bayes rule in practice|Text slecture in English]] by Lu Wang <span style="color:GREEN">OK</span> | + | ***[[Bayes rule in practice|Text slecture in English]] by Lu Wang <span style="color:GREEN">OK</span> |
| − | ***[[662slecture tang|Text slecture in English]] by Chuohao Tang <span style="color:GREEN">OK</span> | + | ***[[662slecture tang|Text slecture in English]] by Chuohao Tang <span style="color:GREEN">OK</span> |
*Slectures on Neyman-Pearson test and ROC curves | *Slectures on Neyman-Pearson test and ROC curves | ||
| − | **[[Neyman-Pearson Lemma and Receiver Operating Characteristic Curve|Text slecture in English]] by [https://engineering.purdue.edu/~lee714/ Soonam Lee] <span style="color:GREEN">OK</span> | + | **[[Neyman-Pearson Lemma and Receiver Operating Characteristic Curve|Text slecture in English]] by [https://engineering.purdue.edu/~lee714/ Soonam Lee] <span style="color:GREEN">OK</span> |
| − | **[[ROC curve analysis slecture ECE662 Spring0214 Sun|Video slecture in English]] by Jianxin Sun <span style="color:GREEN">OK</span> | + | **[[ROC curve analysis slecture ECE662 Spring0214 Sun|Video slecture in English]] by Jianxin Sun <span style="color:GREEN">OK</span> |
**[[ECE662 roc|Text slecture in English]] by Hao Lin <span style="color:GREEN">OK</span> | **[[ECE662 roc|Text slecture in English]] by Hao Lin <span style="color:GREEN">OK</span> | ||
*Slectures on Density Estimation | *Slectures on Density Estimation | ||
**Maximum Likelihood Estimation (MLE) | **Maximum Likelihood Estimation (MLE) | ||
| − | ***[[Mle tutorial|Text slecture in English]] by Sudhir Kylasa | + | ***[[Mle tutorial|Text slecture in English]] by Sudhir Kylasa <span style="color:GREEN">OK</span> |
| − | ***[[Maximum Likelihood Estimation Analysis for various Probability Distributions|Text slecture in English]] by Hariharan Seshadri QUESTION PAGE NEEDS TO BE EDITED TO LOOK LIKE THE OTHERS | + | ***[[Maximum Likelihood Estimation Analysis for various Probability Distributions|Text slecture in English]] by Hariharan Seshadri QUESTION PAGE NEEDS TO BE EDITED TO LOOK LIKE THE OTHERS |
| − | ***[[Video slecture in English: Introduction to Maximum Likelihood Estimation|Video slecture in English]] by Anantha Raghuraman <span style="color:GREEN">OK</span> | + | ***[[Video slecture in English: Introduction to Maximum Likelihood Estimation|Video slecture in English]] by Anantha Raghuraman <span style="color:GREEN">OK</span> |
***[[Convergence of the Maximum Likelihood Estimator over Multiple Trials|Video slecture in English]] by [http://web.ics.purdue.edu/~scarver/ Spencer Carver] | ***[[Convergence of the Maximum Likelihood Estimator over Multiple Trials|Video slecture in English]] by [http://web.ics.purdue.edu/~scarver/ Spencer Carver] | ||
***[[Maximum Likelihood Estimators and Examples|Text slecture in English]] by Lu Zhang | ***[[Maximum Likelihood Estimators and Examples|Text slecture in English]] by Lu Zhang | ||
***[[SlectureKeehwanECE662Spring14|Video slecture in English]] by Keehwan Park | ***[[SlectureKeehwanECE662Spring14|Video slecture in English]] by Keehwan Park | ||
***[https://kiwi.ecn.purdue.edu/rhea/index.php/MLEforGMM Text slecture in English] by Wen Yi | ***[https://kiwi.ecn.purdue.edu/rhea/index.php/MLEforGMM Text slecture in English] by Wen Yi | ||
| − | ***[https://kiwi.ecn.purdue.edu/rhea/index.php/ECE662Selecture_zhenpengMLE Text slecture in English] by Zhenpeng Zhao | + | ***[https://kiwi.ecn.purdue.edu/rhea/index.php/ECE662Selecture_zhenpengMLE Text slecture in English] by Zhenpeng Zhao |
**Bayesian Estimation (BPE) | **Bayesian Estimation (BPE) | ||
***[[Bayes Parameter Estimation|Text slecture in English]] by Haiguang Wen | ***[[Bayes Parameter Estimation|Text slecture in English]] by Haiguang Wen | ||
| Line 96: | Line 98: | ||
***[[Introduction to local density estimation methods|Text slecture in English]] by Yu Liu | ***[[Introduction to local density estimation methods|Text slecture in English]] by Yu Liu | ||
***[[Slecture Introduction local density estimation methods ECE662 Spring2014 Aziza|Video slecture in Russian]] by Aziza Satkhozhina | ***[[Slecture Introduction local density estimation methods ECE662 Spring2014 Aziza|Video slecture in Russian]] by Aziza Satkhozhina | ||
| − | ***[[Introduction to local density estimation methods ECE662 Spring2014 Aziza|Video slecture in English]] by Nusaybah Abu-Mulaweh | + | ***[[Introduction to local density estimation methods ECE662 Spring2014 Aziza|Video slecture in English]] by Nusaybah Abu-Mulaweh |
| − | ***[[ | + | ***[[Intro local non parametric density estimation methods ECE662 Spring2014 Yuan|Video slecture in English]] by Chenxi Yuan EMPTY QUESTION PAGE |
**Density Estimation with Parzen Windows | **Density Estimation with Parzen Windows | ||
***[[ParzenWindow|Text slecture in English]] by Chiho Choi | ***[[ParzenWindow|Text slecture in English]] by Chiho Choi | ||
***[[Parzen Window Density Estimation|Text slecture in English]] by Ben Foster | ***[[Parzen Window Density Estimation|Text slecture in English]] by Ben Foster | ||
| − | ***[[Parzen Windows|Text slecture in English]] by Abdullah Alshaibani <span style="color:GREEN">OK</span> | + | ***[[Parzen Windows|Text slecture in English]] by Abdullah Alshaibani <span style="color:GREEN">OK</span> |
| − | + | ||
**Density Estimation with K-Nearest Neighbors (KNN) | **Density Estimation with K-Nearest Neighbors (KNN) | ||
***[[KnnDensityEstimation|Text slecture in English]] by Raj Praveen Selvaraj | ***[[KnnDensityEstimation|Text slecture in English]] by Raj Praveen Selvaraj | ||
***[[Knearestneighbors|Text slecture in English]] by Dan Barrett | ***[[Knearestneighbors|Text slecture in English]] by Dan Barrett | ||
| − | ***[[K- | + | ***[[K-Nearest Neighbors Density Estimation|Video slecture in English]] by Qi Wang QUESTION PAGE NEEDS TO BE EDITED TO FOLLOW SAME FORMAT AS OTHERS |
**The Nearest Neighbor Decision Rule | **The Nearest Neighbor Decision Rule | ||
***[[Estimation Using Nearest Neighbor|Text slecture in English]] by Sang Ho Yoon | ***[[Estimation Using Nearest Neighbor|Text slecture in English]] by Sang Ho Yoon | ||
| − | ***[[Slecture from KNN to nearest neighbor|Text slecture in English]] by Jonathan Manring <span style="color:GREEN">OK</span> | + | ***[[Slecture from KNN to nearest neighbor|Text slecture in English]] by Jonathan Manring <span style="color:GREEN">OK</span> |
*Slectures on Linear Classifiers | *Slectures on Linear Classifiers | ||
**Link here | **Link here | ||
*Slectures on Support Vector Machines (SVM) | *Slectures on Support Vector Machines (SVM) | ||
| − | **[[Least Squares Support Vector Machine and its Applications in Solving Linear Regression Problems]] by Xing Liu | + | **[[Least Squares Support Vector Machine and its Applications in Solving Linear Regression Problems]] by Xing Liu |
**[[Support Vector Machine]] by Tao Jiang | **[[Support Vector Machine]] by Tao Jiang | ||
Revision as of 19:23, 2 May 2014
Contents
ECE662: Statistical Pattern Recognition and Decision Making Processes, Spring 2014 (cross-listed with CS662)
Welcome to ECE662!
PLEASE FILL OUT THE COURSE EVALUATION AT WWW.PURDUE.EDU/EVAL
YOUR FEEDBACK IS TRULY APPRECIATED. THANKS FOR YOUR TIME. -PROF MIMI
Course Information
Instructor:
- Office: MSEE342
- Office hours
- Assignment Drop Box
Lecture:
- When? TuTh, 10:30 - 11:45
- Where? EE117 (subject to change)
Slectures
Please use this template for text slectures or this template for video slectures
- Slectures on Probability and Statistics
- Whitening and Coloring Transforms, by Maliha Hossain OK
- How to generate random n dimensional data from two categories with different priors
- Video slecture in Korean , by Minwoong Kim OK
- Video slecture in Korean , by Hyun Dok Cho OK
- Text slecture in English by Joonsoo Kim QUESTION PAGE NEEDS FORMATTING TO LOOK LIKE THE OTHER ONES
- Text slecture in English by Jonghoon Jin OK
- Principal Component Analysis (PCA)
- Text slecture in English, by Tian Zhou OK
- Text slecture in English, by Sujin Jang OK
- Video slecture in English, and Chinese, by Tsung Tai Yeh OK
- Slectures on Curse of Dimensionality
- Text slecture in English, and in Chinese by Haonan Yu USE SAME COMMENT PAGE FOR BOTH ENGLISH AND CHINESE VERSION
- Slectures on Bayes Rule
- Bayes Rule in Layman's Terms
- Video slecture in Spanish by Francis Phillip
- Derivation of Bayes Rule
- Text slecture in English By Anonymous7
- Text slecture in English by Varun Vasudevan OK
- Video slecture in English by Nadra Guizani OK
- Video slecture in English by Jieun Kim OK
- Text slecture in Greek by Stylianos Chatzidakis OK
- Text slecture in Chinese by Weibao Wang OK
- Optimality of Bayes Rule
- Video slecture in English by Aaron Michaux OK
- Video slecture in Korean by Jeong-wan Kim SLIGHT EDITS NEEDED; PROF MIMI NEEDS TO UPLOAD VIDEO ON YOUTUBE AND EMBED
- Upper Bounds for Bayes Error
- Text slecture in English by G. M. Dilshan Godaliyadda QUESTION PAGE NEEDS SLIGHT EDITING TO FOLLOW FORMAT OF OTHERS
- Text slecture in English by Yihan Ding OK
- Text slecture in English (includes the derivation of Chernoff Distance) by Jeehyun Choe OK<span style="color:GREEN" />
- Neyman-Pearson Formulation of Bayes Rule
- Text slecture in Chinese by Robert Ness
- Bayes Rule to Minimize Risk
- Video slectures in English, by Andy Park OK
- Text slecture in English by Dennis Lee OK
- Bayes Rule for Normally Distributed Features
- Text slecture in English by Yanzhe Cui QUESTION PAGE NEEDS TO BE FORMATTED TO LOOK LIKE THE OTHERS
- Text slecture in English by Jihwan Lee OK
- Bayes rule in practice
- Text slecture in English by Lu Wang OK
- Text slecture in English by Chuohao Tang OK
- Bayes Rule in Layman's Terms
- Slectures on Neyman-Pearson test and ROC curves
- Text slecture in English by Soonam Lee OK
- Video slecture in English by Jianxin Sun OK
- Text slecture in English by Hao Lin OK
- Slectures on Density Estimation
- Maximum Likelihood Estimation (MLE)
- Text slecture in English by Sudhir Kylasa OK
- Text slecture in English by Hariharan Seshadri QUESTION PAGE NEEDS TO BE EDITED TO LOOK LIKE THE OTHERS
- Video slecture in English by Anantha Raghuraman OK
- Video slecture in English by Spencer Carver
- Text slecture in English by Lu Zhang
- Video slecture in English by Keehwan Park
- Text slecture in English by Wen Yi
- Text slecture in English by Zhenpeng Zhao
- Bayesian Estimation (BPE)
- Text slecture in English by Haiguang Wen
- Text slecture in English, by Shaobo Fang
- Text slecture in English by Yu Wang
- Introduction to Local density Estimation Techniques (so-called "non-parametric")
- Text slecture in English by Yu Liu
- Video slecture in Russian by Aziza Satkhozhina
- Video slecture in English by Nusaybah Abu-Mulaweh
- Video slecture in English by Chenxi Yuan EMPTY QUESTION PAGE
- Density Estimation with Parzen Windows
- Text slecture in English by Chiho Choi
- Text slecture in English by Ben Foster
- Text slecture in English by Abdullah Alshaibani OK
- Maximum Likelihood Estimation (MLE)
- Density Estimation with K-Nearest Neighbors (KNN)
- Text slecture in English by Raj Praveen Selvaraj
- Text slecture in English by Dan Barrett
- Video slecture in English by Qi Wang QUESTION PAGE NEEDS TO BE EDITED TO FOLLOW SAME FORMAT AS OTHERS
- The Nearest Neighbor Decision Rule
- Text slecture in English by Sang Ho Yoon
- Text slecture in English by Jonathan Manring OK
- Density Estimation with K-Nearest Neighbors (KNN)
- Slectures on Linear Classifiers
- Link here
- Slectures on Support Vector Machines (SVM)
Peer Reviews
- Instruction for peer reviewing HW1
- Instruction for peer reviewing HW2 (due before class on April 29)
Discussion
Feel free to use the space below for discussion, or create a page for discussion and link it below.
- Where to find data for HW1
- Possible Real-world data to use for class
- Programming help!
- New Discussion
