Outline of the slecture

• Linear discriminant functions
• Summary
• References

Linear classification Problem Statement

In a linear classification problem, the feature space can be divided into different regions by hyperplanes. In this lecture, we will take a two-catagory case to illustrate. Given training samples $ \vec{y}_1,\vec{y}_2,...\vec{y}_n \in \mathbb{R}^p $, each $ \vec{y}_i $ is a p-dimensional vector and belongs to either class $ w_1 $ or $ w_2 $. The goal is to find the maximum-margin hyperplane that separate the points belonging to class $ w_1 $ from the points belonging to class$ w_2 $

. The separation hyperplane can be written as $ c\cdot y=b $ where $ \cdot $ denotes the dot product, c determines the orientation of the hyperplane and