Examining Locally Varying Weights for Nearest Neighbor Algorithms
Proceedings of the Second International Conference on Case-Based Reasoning
Previous work on feature weighting for case-based learning algorithms has tended to use either global weights or weights that vary over extremely local regions of the case space. This paper examines the use of coarsely local weighting schemes, where feature weights are allowed to vary but are identical for groups or clusters of cases. We present a new technique, called class distribution weighting (CDW), that allows weights to vary at the class level. We further extend CDW into a family of related techniques that exhibit varying degrees of locality, from global to local. The class distribution techniques are then applied to a set of eleven concept learning tasks. We find that one or more of the CDW variants significantly improves classification accuracy for nine of the eleven tasks. In addition, we find that the relative importance of classes, features, and feature values in a particular domain determines which variant is most successful.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
© the authors
Howe, Nicholas and Cardie, Claire, "Examining Locally Varying Weights for Nearest Neighbor Algorithms" (1997). Computer Science: Faculty Publications, Smith College, Northampton, MA.