Home            Contact us            FAQs
    
      Journal Home      |      Aim & Scope     |     Author(s) Information      |      Editorial Board      |      MSP Download Statistics

     Research Journal of Applied Sciences, Engineering and Technology


Extensions of k-Nearest Neighbor Algorithm

Rashmi Agrawal
Faculty of Computer Applications, Manav Rachna International University, Faridabad, Haryana 121004, India
Research Journal of Applied Sciences, Engineering and Technology  2016  1:24-29
http://dx.doi.org/10.19026/rjaset.13.2886  |  © The Author(s) 2016
Received: November ‎17, ‎2015  |  Accepted: February ‎10, ‎2016  |  Published: July 05, 2016

Abstract

The aim of this study is to review various extensions of the nearest neighbor algorithm and discuss their approach along with limitations of the method. In nonparametric classification, no prior information is required for predicting the class label. k-Nearest Neighbor is the simplest and well known algorithm used in data mining The various extensions of k-nearest neighbor algorithm which have been studied are weighted nearest neighbor, feature selection methods, fuzzy nearest neighbor, genetic algorithm based classifiers and nearest neighbor algorithm using ensembling techniques.

Keywords:

Ensembling, feature selection, fuzzy set, genetic algorithm , nonparametric classification , weighted nearest neighbor,


References

  1. Aci, M., C. Inan and M. Avci, 2010. A hybrid classification method of k nearest neighbor, Bayesian methods and genetic algorithm. Expert Syst. Appl., 37(7): 5061-5067.
    CrossRef    
  2. Agrawal, R., 2014. K-nearest neighbor for uncertain data. Int. J. Comput. Appl., 105(11): 13-16.
  3. Agrawal, R. and B. Ram, 2015a. A modified K-nearest neighbor algorithm to handle uncertain data. Proceeding of the 5th International Conference on IT Convergence and Security (ICITCS, 2015), pp: 1-4.
  4. Agrawal, R. and B. Ram, 2015b. A survey of uncertain data mining techniques. Int. J. Adv. Res. Educ. Technol. Manage., 3(1): 252-256.
  5. Amores, J., N. Sebe, and P. Radeva, 2006. Boosting the distance estimation: Application to the k-nearest neighbor classifier. Pattern Recogn. Lett., 27(3): 201-209.
    CrossRef    
  6. Athitsos, V. and S. Sclaroff, 2005. Boosting nearest neighbor classifiers for multiclass recognition. Proceeding of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, pp: 45.
  7. Bian, H. and L. Mazlack, 2003. Fuzzy-rough nearest-neighbor classification approach. Proceeding of the 22nd IEEE International Conference of the North American on Fuzzy Information Processing Society (NAFIPS, 2003), pp: 500-505.
    CrossRef    
  8. Breiman, L., 1996. Bagging predictors. Mach. Learn., 24: 123-140.
    CrossRef    
  9. Büchlmann, P. and B. Yu, 2002. Analyzing bagging. Ann. Stat., 30(4): 927-961.
    CrossRef    
  10. Dudani, S.A., 1976. The distance-weighted k-nearest-neighbor rule. IEEE T. Syst. Man Cyb., SMC-6(4): 325-327.
    CrossRef    
  11. Fix, E. and J.L. Hodges, 1951. Discriminatory analysis, nonparametric discrimination: Consistency properties. Technical Report 4, U.S. Air Force, School of Aviation Medicine, Randolph Field, TX.
  12. Freund, Y. and R.E. Schapire, 1996. Experiments with a new boosting algorithm. Proceeding of the 13th International Conference on Machine Learning, pp: 1-9.
  13. Goldberg, D.E. and J.H. Holland, 1988. Genetic algorithms and machine learning. Mach. Learn., 3(2): 95-99.
    CrossRef    
  14. Gou, J., L. Du, Y. Zhang and T. Xiong, 2012. A new distance-weighted k -nearest neighbor classifier. J. Inform. Comput. Sci., 9(6): 1429-1436.
  15. Haykin, S.S., 1998. Neural Networks: A Comprehensive Foundation. 2nd Edn., Prentice Hall, Englewood Cliffs, NJ, pp: 696.
    PMid:9697135    
  16. Hechenbichler, K. and K.P. Schliep, 2004. Weighted k-nearest-neighbor Techniques and Ordinal Classification. Discussion Paper 399, SFB 386, Ludwig-Maximilians University, Munich.
  17. Ho, S.Y., C.C. Liu, S. Liu and J.W. Jou, 2002. Design of an optimal nearest neighbor classifier using an intelligent genetic algorithm. Proceeding of the Congress on Evolutionary Computation (CEC '02). Honolulu, HI, 1: 594-599.
    CrossRef    
  18. Keller, J.M., M.R. Gray and J.A. Givens, 1985. A fuzzy k-nearest neighbor algorithm. IEEE T. Syst. Man Cyb., SMC-15(4): 580-585.
    CrossRef    
  19. Kelly, J.D. and L. Davis, 1991. A hybrid genetic algorithm for classification. Proceeding of the 12th International Joint Conference on Artificial Intelligence (IJCAI'91), 2: 645-650.
  20. Langley, P., 1994. Selection of relevant features in machine learning. Proceeding of the AAAI Fall Symposium on Relevance. New Orleans, LA, pp: 140-144.
    CrossRef    
  21. Liu, B., Y. Ma and C.K. Wong, 2000. Improving an association rule based classifier. Proceeding of the 4th European Conference on Principles of Data Mining and Knowledge Discovery (PKDD '00), pp: 504-509.
    CrossRef    
  22. Marchiori, E., 2013. Class dependent feature weighting and k-nearest neighbor classification. Proceeding of the 8th IAPR international conference on Pattern Recognition in Bioinformatics (PRIB'13), pp: 69-78.
    CrossRef    
  23. Pawlak, Z., 1998. Rough set theory and its applications to data analysis. Cybernet. Syst. Int. J., 29(7): 661-688.
    CrossRef    
  24. Rish, I., 2001. An empirical study of the naive Bayes classifier. Proceeding of IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence, IBM, New York, 3(22): 41-46.
  25. Safavian, S.R. and D. Landgrebe, 1991. A survey of decision tree classifier methodology. IEEE T. Syst. Man Cyb., 21(3): 660-674.
    CrossRef    
  26. Sarkar, M., 2007. Fuzzy-rough nearest neighbor algorithms in classification. Fuzzy Set. Syst., 158(19): 2134-2152.
    CrossRef    
  27. Shepard, R.N., 1987. Toward a universal law of generalization for psychological science. Science, 237(4820): 1317-1323.
    CrossRef    PMid:3629243    
  28. Zadeh, L.A., 1965. Fuzzy sets. Inform. Control, 8(3): 338-353.
    CrossRef    
  29. Zuo, W., D. Zhang and K. Wang, 2008. On kernel difference-weighted k-nearest neighbor classification. Pattern Anal. Appl., 11(3): 247-257.
    CrossRef    

Competing interests

The authors have no competing interests.

Open Access Policy

This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Copyright

The authors have no competing interests.

ISSN (Online):  2040-7467
ISSN (Print):   2040-7459
Submit Manuscript
   Information
   Sales & Services
Home   |  Contact us   |  About us   |  Privacy Policy
Copyright © 2024. MAXWELL Scientific Publication Corp., All rights reserved