Third Homework, ECE662 Spring 2012

• Drop test set output, predicted accuracy, and proposed nickname into Daniel's drop box before 11:59pm, Friday April 27, 2012.
• Report due before 11:59pm, Monday April 30, in your instructor's Rhea dropbox. Make sure to drop it in the correct homework folder!!!!. It is the one at the very bottom of the page.

Automatic Pattern Recognition Contest!

An anonymous company has agreed to share real data with us, so we are going to have a little contest using this data! The data comes from a five-class classification problem using 13 features. We are looking for the student who will design the most accurate classifier using this data.

The training data consists of 550 data points (i.e. 550 points in a 13 dimensional space) along with the correct label for each point. Use this data, along with any method of your choice, to design what you think is an accurate classifier.

Part I

When you are done designing your classifier, write down what accuracy the classifier has, according to the training data. (This is what we call the "predicted accuracy".) Then use your classifier to classify the following test set vectors. Your colleague Daniel has kindly volunteered to collect all the answers and summarize their accuracy in the table below. In order for Daniel to do that, we ask that you send him

• The nickname you want him to use to identify your work in the table below;
• Your predicted accuracy;
• The labels you obtain for each test set vector.

Hand in everything in Daniel's drop box in a single file following this syntax:

Joe Blo
77%
1
0
1
2
3
4
2
3
1
2
0
2
1

Part II

After the deadline for the homework has passed, I will release the ground truth labels for the test set vectors here. (If you are done designing your classifier before 8pm on Thursday April 26, you may obtain the ground truth labels by emailing your instructor.) Compare the labels obtained using your classifier with the ground truth labels: the number of correctly classified vectors is the "test" accuracy. Summarize your method and results in a report. Make sure your report includes all your code, your predicted accuracy, and the confusion matrix of your classifier on the test data. Drop a pdf of your report in the HW3 assignment box in your instructor's dropbox before 11:59pm, Monday April 30.

Part III (optional)

If you feel like sharing your results and methods publicly, feel free to post a summary of your method and replace your nickname by your true name in the table below. But please only do this after April 30. If you do not wish to be identified but still would like a summary of your method to appear in the table below, send it to Daniel (by email) and he will post it for you.

The discussion page for this homework is here.

Result Summary (will be kindly complied by your colleague Daniel)

This results will be computed from the submissions in drugeles dropbox. Refer to HW3 discussion for details or questions.