Line 9: Line 9:
 
----
 
----
  
== '''&nbsp;1. Introduction and outline of the slecture'''<br>  ==
+
== '''&nbsp;1. Outline of the slecture'''<br>  ==
  
Receiver Operating Characteristic (ROC) curve is often used as an important tool to visualize the performance of a binary classifier.  
+
Receiver Operating Characteristic (ROC) curve is often used as an important tool to visualize the performance of a binary classifier. The use of ROC curves can be originated from signal detection theory that developed during World War II for radar analysis [2]. What will be covered in the slecture is listed as:
  
*Basic knowledge of Bayes parameter estimation
+
*A quick example about ROC in binary classification
*An example to illustrate the concept and properties of BPE
+
*Some statistics behind ROC curves
*The effect of sample size on the posterior
+
*Neyman-Pearson Criterion<br>
*The effect of prior on the posterior
+
  
 
<br>  
 
<br>  
Line 26: Line 25:
 
== '''Reference'''  ==
 
== '''Reference'''  ==
  
[1] Mireille Boutin, "ECE662: Statistical Pattern Recognition and Decision Making Processes," Purdue University, Spring 2014.<br>
+
[1] Mireille Boutin, "ECE662: Statistical Pattern Recognition and Decision Making Processes," Purdue University, Spring 2014.<br> [2] Jiawei Han. 2005. Data Mining: Concepts and Techniques. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.<br> [3] Richard O. Duda, Peter E. Hart, and David G. Stork. 2000. Pattern Classification. Wiley-Interscience.<br> [4] Detection Theory. http://www.ece.iastate.edu/~namrata/EE527_Spring08/l5c_2.pdf. <br> [5] The Neyman-Pearson Criterion. http://cnx.org/content/m11548/1.2/.  
[2] Jiawei Han. 2005. Data Mining: Concepts and Techniques. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.<br>
+
[3] Richard O. Duda, Peter E. Hart, and David G. Stork. 2000. Pattern Classification. Wiley-Interscience.<br>
+
[4] Detection Theory. http://www.ece.iastate.edu/~namrata/EE527_Spring08/l5c_2.pdf. <br>
+
[5] The Neyman-Pearson Criterion. http://cnx.org/content/m11548/1.2/.  
+
  
 
<br>  
 
<br>  
 +
 
----
 
----
  

Revision as of 18:16, 29 April 2014


ROC curve and Neyman Pearsom Criterion

A slecture by ECE student

Partly based on the ECE662 Spring 2014 lecture material of Prof. Mireille Boutin.


 1. Outline of the slecture

Receiver Operating Characteristic (ROC) curve is often used as an important tool to visualize the performance of a binary classifier. The use of ROC curves can be originated from signal detection theory that developed during World War II for radar analysis [2]. What will be covered in the slecture is listed as:

  • A quick example about ROC in binary classification
  • Some statistics behind ROC curves
  • Neyman-Pearson Criterion




Reference

[1] Mireille Boutin, "ECE662: Statistical Pattern Recognition and Decision Making Processes," Purdue University, Spring 2014.
[2] Jiawei Han. 2005. Data Mining: Concepts and Techniques. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
[3] Richard O. Duda, Peter E. Hart, and David G. Stork. 2000. Pattern Classification. Wiley-Interscience.
[4] Detection Theory. http://www.ece.iastate.edu/~namrata/EE527_Spring08/l5c_2.pdf.
[5] The Neyman-Pearson Criterion. http://cnx.org/content/m11548/1.2/.



Questions and comments

If you have any questions, comments, etc. please post them on this page.


Back to ECE662, Spring 2014

Alumni Liaison

Ph.D. on Applied Mathematics in Aug 2007. Involved on applications of image super-resolution to electron microscopy

Francisco Blanco-Silva