A support vector machines (SVM) classifier was used to assess the severity of idiopathic scoliosis (IS) based on surface topographic images of human backs. Scoliosis is a condition that involves abnormal lateral curvature and rotation of the spine that usually causes noticeable trunk deformities. Based on the hypothesis that combining surface topography and clinical data using a SVM would produce better assessment results, we conducted a study using a dataset of 111 IS patients. Twelve surface and clinical indicators were obtained for each patient. The result of testing on the dataset showed that the system achieved 69–85% accuracy in testing. It outperformed a linear discriminant function classifier and a decision tree classifier on the dataset.