Fuzzy nonparametric regression based on K-nearest neighbors and the R-neighborhood radius

Document Type : Research Paper

Authors

Department of Statistics, Faculty of Mathematical Sciences and Statistics, University of Birjand, Birjand, Iran.

Abstract

In this paper, we present four nonparametric methods to fit some fuzzy regression models, when both the explanatory and response variables are fuzzy quantities. In this approach, we first introduced a distance between triangular fuzzy numbers. Then, two fuzzy nonparametric regression models are presented based on the extended version of K-nearest neighbors (KNN) method on fuzzy data (with the same/modified weights). In addition, a new method is investigated to fit two fuzzy nonparametric regression models based on the R-neighborhood radius (RNR) method on fuzzy data (with the same/modified weights). Among these methods, the two methods of KNN and RNR with the modified weights have the better performances than the methods with the same weights. To evaluate the proposed fuzzy nonparametric regression models, two measures of goodness of fit are presented. The application of the proposed methods are studied in modelling some data sets.

Keywords

Main Subjects


[1] Akbari, M. G. & Hesamian, G. (2018). Linear model with exact inputs and interval-valued fuzzy outputs. IEEE Transactions on Fuzzy Systems, 26, 518-530. https://doi.org/10.1109/TFUZZ.2017.2686356
[2] Akbari, M. G. & Hesamian, G. (2019). A partial-robust-ridge-based regression model with fuzzy predictors-responses. Journal of Computational and Applied Mathematics, 351, 290-301. https://doi.org/10.1016/j.cam.2018.11.006
[3] Arabpour, A. & Amini, M. (2014). Weighted Linear Regression Model For Imprecise Response. Journal of Mahani Mathematical Research, 3, 1-17. DOI:10.22103/jmmrc.2014.1399
[4] Are , M. (2016). Clustering regression based on interval-valued fuzzy outputs and interval-valued fuzzy parameters. Journal of Intelligent and Fuzzy Systems, 30, 1339-1351. https://doi.org/10.3233/IFS-152048
[5] Are , M. (2020). Quantile fuzzy regression based on fuzzy outputs and fuzzy parameters. Soft Computing, 24, 311-320. https://doi.org/10.1007/s00500-019-04424-2
[6] Are , M. (2025). Geometric clustering fuzzy regression based on c-means clustering. Iranian Journal of Fuzzy Systems, 22(3), 87-101. DOI: 10.22111/ijfs.2025.51386.9078
[7] Are , M. & Khammar, A. H. (2024). Nonlinear prediction of fuzzy regression model based on quantile loss function. Soft Computing, 28(6), 4861-4871. https://doi.org/10.1007/s00500-023-09190-w
[8] Are , M. & Taheri, S. M. (2015). Least squares regression based on Atanassov's intuitionistic fuzzy inputs-outputs and Atanassov's intuitionistic fuzzy parameters. IEEE Transactions on Fuzzy Systems, 23, 1142-1154. https://doi.org/10.1109/TFUZZ.2014.2346246
[9] Asadolahi, M., Akbari, M. Gh., Hesamian, G., & Are , M. (2021). A robust support vector regression with exact predictors and fuzzy responses. International Journal of Approximate Reasoning, 132, 206-225. https://doi.org/10.1016/j.ijar.2021.02.006
[10] Bas, E. & Egrioglu, E. (2022). A fuzzy regression functions approach based on Gustafson-Kessel clustering algorithm. Information Sciences, 592, 206-214. https://doi.org/10.1016/j.ins.2022.01.057
[11] Chachi, J. (2019). A weighted least-squares fuzzy regression for crisp input fuzzy output data. IEEE Transactions on Fuzzy Systems, 27, 739-748. https://doi.org/10.1109/TFUZZ.2018.2868554
[12] Chachi, J. & Jalalvand, M. (2025). Fuzzy Modeling Using The Similarity-based Approximate Reasoning System. Journal of Mahani Mathematical Research, 14, 165-187. DOI:10.22103/jmmr.2024.22970.1587
[13] Chachi, J., Kazemifard, A., & Jalalvand, M. (2021). A multi-attribute assessment of fuzzy regression models. Iranian Journal of Fuzzy Systems, 18, 131-148. https://doi.org/10.22111/ijfs.2021.6181
[14] Chachi, J. & Roozbeh, M. (2017). A fuzzy robust regression approach applied to bedload transport data. Communications in Statistics - Simulation and Computation, 46, 1703-1714. https://doi.org/10.1080/03610918.2015.1010002
[15] Chachi, J. & Taheri, S. M. (2016). Multiple fuzzy regression model for fuzzy input-output data. Iranian Journal of Fuzzy Systems, 13, 63-78. https://doi.org/10.22111/ijfs.2016.2596
[16] Chachi, J., Taheri, S. M., Fattahi, S., & Ravandi, A. H. (2016). Two robust fuzzy regression models and their applications in predicting imperfections of cotton yarn. Journal of Textiles and Polymers, 4(2), 60-68. https://www.academia.edu/download/115503970/article45940acece29211ec3d99f9913182697ba712.pdf 
[17] Cheng, C. B. & Lee, E. S. (1999). Nonparametric fuzzy regression k-NN and kernel smoothing techniques. Computers and Mathematics with Applications, 38, 239-251. https://doi.org/10.1016/S0898-1221(99)00198-4
[18] Danesh, M., Danesh, S., Razzaghnia, T., & Maleki, A. (2021). Prediction of Fuzzy Nonparametric Regression Function: A Comparative Study of a New Hybrid Method and Smoothing Methods. Global Analysis and Discrete Mathematics, 6(1), 143{178. DOI: 10.22128/gadm.2021.387.1038
[19] Dotto, F., Farcomeni, A., Garcia-Escudero, L. A., & Mayo-Iscar, A. (2017). A fuzzy approach to robust regression clustering. Advances in Data Analysis and Classication, 11, 691-710. https://doi.org/10.1007/s11634-016-0271-9
[20] D'Urso, P. (2003). Linear regression analysis for fuzzy/crisp input and fuzzy/crisp output data. Computational Statistics and Data Analysis, 42, 47-72. https://doi.org/10.1016/S0167-9473(02)00117-2
[21] D'Urso, P. & Gastaldi, T. (2000). A least-squares approach to fuzzy linear regression analysis. Computational Statistics and Data Analysis, 34, 427-440. https://doi.org/10.1016/S0167-9473(99)00109-7
[22] Hesamian, G. & Akbari, M. Gh. (2021). A robust multiple regression model based on fuzzy random variables. Journal of Computational and Applied Mathematics, 338, Article No.: 113270. DOI:10.1016/j.cam.2020.113270
[23] Hesamian, G. & Akbari, M. Gh. (2020). A fuzzy additive regression model with exact predictors and fuzzy responses. Applied Soft Computing, 95, Article No.: 106507. https://doi.org/10.1016/j.asoc.2020.106507
[24] Hesamian, G., Torkian, F., Johannssen, A., & Chukhrova, N. (2024). A fuzzy nonparametric regression model based on an extended center and range method. Journal of Computational and Applied Mathematics, 436, Article No.: 115377.
https://doi.org/10.1016/j.cam.2023.115377
[25] Hosseinzadeh, E., Hassanpour, H., & Are , M. (2015). A weighted goal programming approach to fuzzy linear regression with crisp inputs and type-2 fuzzy outputs. Soft Computing, 19, 1143-1151. https://doi.org/10.1007/s00500-014-1328-3
[26] Kelkinnama, M. & Taheri, S. M. (2012). Fuzzy least-absolutes regression using shape preserving operations. Information Sciences, 214, 105-120. https://doi.org/10.1016/j.ins.2012.04.017
[27] Khammar, A. H., Are , M., & Akbari, M.Gh. (2020). A robust least squares fuzzy regression model based on kernel function. Iranian Journal of Fuzzy Systems, 17(4), 105-119. https://doi.org/10.22111/ijfs.2020.5409
[28] Khammar, A. H., Are , M., & Akbari, M. Gh. (2021). A general approach to fuzzy regression models based on di erent loss functions. Soft Computing, 25, 835-849. https://doi.org/10.1007/s00500-020-05441-2
[29] Khammar, A. H., Are , M., & Akbari, M.Gh. (2021). Quantile fuzzy varying coecient regression based on kernel function. Applied Soft Computing, 107, Article No.: 107313. https://doi.org/10.1016/j.asoc.2021.107313
[30] Kong, L., Song, X., & Wang, X. (2022). Nonparametric regression for intervalvalued data based on local linear smoothing approach. Neurocomputing, 501, 834-843. https://doi.org/10.1016/j.neucom.2022.06.073
[31] Lu, J. & Wang, R. (2009). An enhanced fuzzy linear regression model with more exible spreads. Fuzzy Sets and Systems, 160, 2505-2523. https://doi.org/10.1016/j.fss.2009.02.023
[32] Pappis, C. P. & Karacapilidis, N. I. (1993). A comparative assessment of measure of similarity of fuzzy values. Fuzzy Sets and Systems, 56, 171-174. https://doi.org/10.1016/0165-0114(93)90141-4
[33] Zadeh, L. A. (1965). Fuzzy sets. Information and Control, 8(3), 338-353. DOI:10.2307/2272014
[34] Zeng, W., Feng, Q., & Lia, J. (2016). Fuzzy least absolute linear regression. Applied Soft Computing, 52, 1009-1019. https://doi.org/10.1016/j.asoc.2016.09.029
[35] Zimmermann, H. J. (2001). Fuzzy Set Theory and Its Applications, fourth ed., Kluwer Niho , Boston. DOI: 10.1007/978-94-010-0646-0