H. Papadopoulos (Cyprus), A. Gammerman, and V. Vovk (UK)
Machine Learning, Conformal Prediction, Regression, Nearest Neighbours, Nonconformity Measure.
In this paper we apply Conformal Prediction (CP) to the k-Nearest Neighbours Regression (k-NNR) algorithm and propose a way of extending the typical nonconformity mea sure used for regression so far. Unlike traditional regression methods which produce point predictions, Conformal Pre dictors output predictive regions that satisfy a given con fidence level. When the regular regression nonconformity measure is used the resulting predictive regions have more or less the same width for all examples in the test set. How ever, it would be more natural for the size of the regions to vary according to how difficult to predict each example is. We define two new nonconformity measures, which pro duce predictive regions of variable width depending on the expected accuracy of the algorithm on each example. As a consequence, the resulting predictive regions are in most cases much tighter than those produced by the simple re gression measure.
Important Links:
Go Back
