In a nutshell
A support vector machine separates two classes by carving the widest possible empty street between them, rather than just any dividing line. The line down the middle is the boundary, and only the handful of points touching the edges of the street — the support vectors — actually decide where it goes. A wider street tends to generalize better to new data.