Transductive Support Vector Machines (TSVM)
Another approach to the same problem is offered by Transductive Support Vector Machines (TSVM), proposed by T. Joachims (in Joachims T., Transductive Inference for Text Classification using Support Vector Machines, ICML Vol. 99/1999). TSVM are particularly suited when the unlabeled sample isn't very noisy, and the overall structure of the dataset is trustworthy. A common application of TSVM is classification on a dataset containing data points drawn from the same data-generating process (for example, medical photos collected using the same instrument) but only partially labeled due to, for example, economic reasons. Since all the images can be trusted, TSVM can exploit the structure of the dataset to achieve an accuracy larger than the one reachable by a supervised classifier.
TSVM Theory
The idea is to keep the original objective with two sets of slack variables – the first for the labeled samples and the other...