Rule weights in a neuro-fuzzy system with a hierarchical domain partition

Krzysztof Simiński

doi:10.2478/v10006-010-0025-3

.blurhash-client-img { display: none !important; }

Rule weights in a neuro-fuzzy system with a hierarchical domain partition

International Journal of Applied Mathematics and Computer Science

Volume 20 (2010): Issue 2 (June 2010)

By: Krzysztof Simiński

Open Access

|Jul 2010

Abstract

The paper discusses the problem of rule weight tuning in neuro-fuzzy systems with parameterized consequences in which rule weights and the activation of the rules are not interchangeable. Some heuristic methods of rule weight computation in neuro-fuzzy systems with a hierarchical input domain partition and parameterized consequences are proposed. Several heuristics with experimental results showing the advantage of their usage are presented.

References

Abonyi, J., Babuška, R. and Szeifert, F. (2002). Modified Gath-Geva fuzzy clustering for identification of Takagi-Sugeno fuzzy models, IEEE Transactions on Systems, Man, and Cybernetics, Part B 32(5): 612-621.10.1109/TSMCB.2002.1033180
Search in Google Scholar
Almeida, M. R. A. (2004). Hybrid Neuro-Fuzzy-Genetic System for Automatic Data Mining, Pontifical Catholic University of Rio de Janeiro, (in Portugese).
Search in Google Scholar
Berg, J. V. D., Kaymak, U. and van den Bergh, W.-M. (2002). Fuzzy classification using probability-based rule weighting, FUZZ-IEEE'02. Proceedings of the 2002 IEEE International Conference on Fuzzy Systems, Honolulu, HI, USA, Vol. 2, pp. 991-996.
Search in Google Scholar
Box, G. E. P. and Jenkins, G. (1970). Time Series Analysis, Forecasting and Control, Holden-Day, Oakland, CA.
Search in Google Scholar
Byun, Y. B., Takama, Y. and Hirota, K. (2001). Design of a modified T-S fuzzy model by adding compensation-rules, Journal of Japan Society for Fuzzy Theory and Systems 13(3): 98-109.10.3156/jfuzzy.13.3_98
Search in Google Scholar
Chen, J.-Q., Xi, Y.-G. and Zhang, Z.-J. (1998). A clustering algorithm for fuzzy model identification, Fuzzy Sets and Systems 98(3): 319-329.10.1016/S0165-0114(96)00384-3
Search in Google Scholar
Chiu, S. L. (1994). Fuzzy model identification based on cluster estimation, Journal of Intelligent and Fuzzy Systems 2(3): 267-278.10.3233/IFS-1994-2306
Search in Google Scholar
Cordón, O., del Jesus, M. and Herrera, F. (1999). A proposal on reasoning methods in fuzzy rule-based classification systems, International Journal of Approximate Reasoning 20(1): 21-45.10.1016/S0888-613X(00)88942-2
Search in Google Scholar
Czekalski, P. (2006). Evolution-fuzzy rule based system with parameterized consequences, International Journal of Applied Mathematics and Computer Science 16(3): 373-385.
Search in Google Scholar
Czogała, E. and Łęski, J. (2000). Fuzzy and Neuro-Fuzzy Intelligent Systems, Series in Fuzziness and Soft Computing, Physica-Verlag, Heidelberg/New York, NY.10.1007/978-3-7908-1853-6
Search in Google Scholar
Dunn, J. C. (1973). A fuzzy relative of the ISODATA process and its use in detecting compact, well separated clusters, Journal of Cybernetics 3(3): 32-57.10.1080/01969727308546046
Search in Google Scholar
Ferguson, D. E. (1960). Fibonaccian searching, Communications ACM 3(12): 648.10.1145/367487.367496
Search in Google Scholar
Gath, I. and Geva, A. B. (1989). Unsupervised optimal fuzzy clustering, IEEE Transactions on Pattern Analysis and Machine Intelligence 11(7): 773-780.10.1109/34.192473
Search in Google Scholar
Glass, L. and Mackey, M. C. (1988). From Clocks to Chaos, the Rhythms of Life, Princeton University Press, Princeton, NJ.10.1515/9780691221793
Search in Google Scholar
Gómez-Skarmeta, A. F., Delgado, M. and Vila, M. A. (1999). About the use of fuzzy clustering techniques for fuzzy model identification, Fuzzy Sets and Systems 106(2): 179-188.10.1016/S0165-0114(97)00276-5
Search in Google Scholar
Ishibuchi, H. and Nakashima, T. (2001). Effect of rule weights in fuzzy rule-based classification systems, IEEE Transactions on Fuzzy Systems 9(4): 506-515.10.1109/91.940964
Search in Google Scholar
Ishibuchi, H. and Yamamoto, T. (2005). Rule weight specification in fuzzy rule-based classification systems, IEEE Transactions on Fuzzy Systems 13(4): 428-435.10.1109/TFUZZ.2004.841738
Search in Google Scholar
Ishibuchi, H., Yamamoto, T. and Nakashima, T. (2001). Determination of rule weights of fuzzy association rules, 10th IEEE International Conference on Fuzzy Systems, Melbourne, Australia, Vol. 3, pp. 1555-1558.
Search in Google Scholar
Jahromi, M. Z. and Taheri, M. (2008). A proposed method for learning rule weights in fuzzy rule-based classification systems, Fuzzy Sets and Systems 159(4): 449-459.10.1016/j.fss.2007.08.007
Search in Google Scholar
Jang, J.-S. R. (1993). ANFIS: Adaptive-network-based fuzzy inference system, IEEE Transactions on Systems, Man, and Cybernetics 23(3): 665-684.10.1109/21.256541
Search in Google Scholar
Joo, Y. H., Hwang, H. S., Kim, K. B. and Woo, K. B. (1997). Fuzzy system modeling by fuzzy partition and GA hybrid schemes, Fuzzy Sets and Systems 86(3): 279-288.10.1016/S0165-0114(95)00414-9
Search in Google Scholar
Kim, E., Park, M., Ji, S. and Park, M. (1997). A new approach to fuzzy modeling, IEEE Transactions on Fuzzy Systems 5(3): 328-337.10.1109/91.618271
Search in Google Scholar
Kim, E., Park, M., Kim, S. and Park, M. (1998). A transformed input-domain approach to fuzzy modeling, IEEE Transactions on Fuzzy Systems 6(4): 596-604.10.1109/91.728458
Search in Google Scholar
Knuth, D. E. (1998). Art of Computer Programming, Volume 3: Sorting and Searching, 2nd Edition, Addison-Wesley Professional, Reading, MA.
Search in Google Scholar
Larminat, P. and Thomas, Y. (1983). Control Engineering—Linear Systems, Wydawnictwa Naukowo-Techniczne, Warsaw, (in Polish).
Search in Google Scholar
Lee, Y.-C., Hwang, E. and Shih, Y.-P. (1994). A combined approach to fuzzy model identification, IEEE Transactions on Systems, Man and Cybernetics 24(5): 736-744.10.1109/21.293487
Search in Google Scholar
Lin, Y. and Cunningham, G. A., I. (1995). A new approach to fuzzy-neural system modeling, IEEE Transactions on Fuzzy Systems 3(2): 190-198.10.1109/91.388173
Search in Google Scholar
Łęski, J. (2008). Neuro-Fuzzy Systems, Wydawnictwa Naukowo-Techniczne, Warsaw, (in Polish).
Search in Google Scholar
Łęski, J. and Czogała, E. (1997). A new artificial neural network based fuzzy inference system with moving consequents in if-then rules and selected applications, BUSEFAL 71: 72-81.
Search in Google Scholar
Łęski, J. and Czogała, E. (1999). A new artificial neural network based fuzzy inference system with moving consequents in if-then rules and selected applications, Fuzzy Sets and Systems 108(3): 289-297.10.1016/S0165-0114(97)00314-X
Search in Google Scholar
Makridakis, S. G., Wheelwright, S. C. and Hyndman, R. J. (1998). Forecasting: Methods and Applications, 3rd Edn., Wiley, New York, USA.
Search in Google Scholar
Mamdani, E. H. and Assilian, S. (1975). An experiment in linguistic synthesis with a fuzzy logic controller, International Journal of Man-Machine Studies 7(1): 1-13.10.1016/S0020-7373(75)80002-2
Search in Google Scholar
Nauck, D. (2000). Adaptive rule weights in neuro-fuzzy systems, Neural Computing and Applications 9(1): 60-70.10.1007/s005210070036
Search in Google Scholar
Nauck, D. and Kruse, R. (1998). How the learning of rule weights affects the interpretability of fuzzy systems, Proceedings of the 1998 IEEE International Conference on Fuzzy Systems, Anchorage, AK, USA, Vol. 2, pp. 1235-1240.
Search in Google Scholar
Nelles, O., Fink, A., Babuška, R. and Setnes, M. (2000). Comparison of two construction algorithms for Takagi-Sugeno fuzzy models, International Journal of Applied Mathematics and Computer Science 10(4): 835-855.
Search in Google Scholar
Nelles, O. and Isermann, R. (1996). Basis function networks for interpolation of local linear models, Proceedings of the 35th IEEE Conference on Decision and Control, Cobe, Japan, Vol. 1, pp. 470-475.
Search in Google Scholar
Nie, J. (1995). Constructing fuzzy model by self-organizing co-unterpropagation network, IEEE Transactions on Systems, Man and Cybernetics 25(6): 963-970.10.1109/21.384258
Search in Google Scholar
Nowicki, R. (2006). Rough-neuro-fuzzy system with MICOG defuzzification, 2006 IEEE International Conference on Fuzzy Systems, Vancouver, Canada, pp. 1958-1965.
Search in Google Scholar
Nozaki, K., Ishibuchi, H. and Tanaka, H. (1996). Adaptive fuzzy rule-based classification systems, IEEE Transactions on Fuzzy Systems 4(3): 238-250.10.1109/91.531768
Search in Google Scholar
Oh, S. and Pedrycz, W. (2000). Identification of fuzzy systems by means of an auto-tuning algorithm and its application to nonlinear systems, Fuzzy Sets and Systems 115(2): 205-230.10.1016/S0165-0114(98)00174-2
Search in Google Scholar
Pedrycz, W. (1984). An identification algorithm in fuzzy relational system, Fuzzy Sets and Systems 13(2): 153-167.10.1016/0165-0114(84)90015-0
Search in Google Scholar
Pedrycz, W., Lam, P. and Rocha, A. F. (1995). Distributed fuzzy system modelling, IEEE Transactions on System, Man and Cybernetics 25(5): 769-780.10.1109/21.376490
Search in Google Scholar
Priyono, A., Ridwan, M., Alias, A. J., Atiq, R., Rahmat, K., Hassan, A. and Mohd. Ali, M. A. (2005). Generation of fuzzy rules with subtractive clustering, Jurnal Teknologi, Series D 43: 143-153.10.11113/jt.v43.782
Search in Google Scholar
Rantala, J. and Koivisto, H. (2002). Optimised subtractive clustering for neuro-fuzzy models, 3rd WSEAS International Conference on Fuzzy Sets and Fuzzy Systems, Interlaken, Switzerland.
Search in Google Scholar
Simiński, K. (2008a). Neuro-fuzzy system with hierarchical domain partition, Proceedings of the International Conference on Computational Intelligence for Modelling, Control and Automation (CIMCA 2008), Vienna, Austria, pp. 392-397.10.1109/CIMCA.2008.67
Search in Google Scholar
Simiński, K. (2008b). Two ways of domain partition in fuzzy inference system with parametrized consequences: Clustering and hierarchical split, OWD'2008: 10th International Ph.D. Workshop, Wisła, Poland, pp. 103-108.
Search in Google Scholar
Simiński, K. (2009a). Patchwork neuro-fuzzy system with hierarchical domain partition, in M. Kurzyński and M. Woźniak (Eds.), Computer Recognition Systems 3, Advances in Intelligent and Soft Computing, Vol. 57, Springer-Verlag, Berlin/Heidelberg, pp. 11-18.10.1007/978-3-540-93905-4_2
Search in Google Scholar
Simiński, K. (2009b). Remark on membership functions in neuro-fuzzy systems, in K. A. Cyran, S. Kozielski, J. F. Peters, U. Stańczyk and A. Wakulicz-Deja (Eds.), Proceedings of the International Conference on Man-Machine Interactions ICMMI 2009, Springer-Verlag, Berlin/Heidelberg, pp. 291-297.10.1007/978-3-642-00563-3_30
Search in Google Scholar
Souza, F. J. D., Vellasco, M. B. R. and Pacheco, M. A. C. (2002a). Load forecasting with the hierarchical neuro-fuzzy binary space partitioning model, International Journal of Computers, Systems and Signals 3(2): 118-132.
Search in Google Scholar
Souza, F. J. D., Vellasco, M. M. R. and Pacheco, M. A. C. (2002b). Hierarchical neuro-fuzzy quadtree models, Fuzzy Sets and Systems 130(2): 189-205.10.1016/S0165-0114(01)00145-2
Search in Google Scholar
Sugeno, M. and Kang, G. T. (1988). Structure identification of fuzzy model, Fuzzy Sets and Systems 28(1): 15-33.10.1016/0165-0114(88)90113-3
Search in Google Scholar
Sugeno, M. and Yasukawa, T. (1993). A fuzzy-logic-based approach to qualitative modeling, IEEE Transactions on Fuzzy Systems 1(1): 7-31.10.1109/TFUZZ.1993.390281
Search in Google Scholar
Surmann, H., Kanstein, A. and Goser, K. (1993). Self-organizing and genetic algorithms for an automatic design of fuzzy control and decision systems, Proceedings of the European Symposium on Intelligent Technology and Soft Computing EUFIT'93, Aachen, Germany, pp. 1097-1104.
Search in Google Scholar
Takagi, T. and Sugeno, M. (1985). Fuzzy identification of systems and its application to modeling and control, IEEE Transactions on Systems, Man and Cybernetics 15(1): 116-132.10.1109/TSMC.1985.6313399
Search in Google Scholar
Tong, R. M. (1980). The evaluation of fuzzy models derived from experimental data, Fuzzy Sets and Systems 4(1): 1-12.10.1016/0165-0114(80)90059-7
Search in Google Scholar
Wang, J.-S. and Lee, C. S. G. (2002). Self-adaptive neuro-fuzzy inference systems for classification applications, IEEE Transactions on Fuzzy Systems 10(6): 790-802.10.1109/TFUZZ.2002.805880
Search in Google Scholar
Wang, L.-X. and Mendel, J. (1992). Generating fuzzy rules by learning from examples, IEEE Transactions on Systems, Man and Cybernetics 22(6): 1414-1427.10.1109/21.199466
Search in Google Scholar
Xu, C. W. and Lu, Y. Z. (1987). Fuzzy model identification self-learning for dynamic system, IEEE Transactions on Systems, Man and Cybernetics 17(9): 683-689.10.1109/TSMC.1987.289361
Search in Google Scholar
Yoshinari, Y., Pedrycz, W. and Hirota, K. (1993). Construction of fuzzy models through clustering techniques, Fuzzy Sets and Systems 54(2): 157-165.10.1016/0165-0114(93)90273-K
Search in Google Scholar