Multi-Objective PSO-fuzzy Optimization Approach to Improve Interpretability and Accuracy in Medical Data

  • Abstract
  • Keywords
  • References
  • PDF
  • Abstract

    Today, Decision Support Systems (DSS) plays a significant role in a medical and healthcare domain. Designing an Automatic Fuzzy
    Rule-based Classification Systems (FRBCSs) is considered as optimization problem associated to a result of high interpretability and
    accuracy. Interpretability and accuracy are the two main objectives to be improved in the optimization measurement of FRBCSs. However, improving these objectives is found to be difficult in most of the existing systems due to the conflicting issues between accuracy
    and interpretability. In this work, we proposed an approach that can effectively handle accuracy- interpretability trade-off in constructing
    FRBCSs. We designed automated FRBCSs in the form of Multi-objective Particle Swarm Optimization with Crowding Distance. In the
    approach, there will be a collection of solutions to FRBCSs that deem best global minimum or global maximum with respect to interpretability and accuracy. Our method is evaluated on a popular benchmark data sets being used in a medical domain for evaluations. These
    datasets are Liver Disorders (BUPA), Pima Indians Diabetes and Thyroid Disease (New Thyroid). The result obtained shows that the
    proposed method yields an optimum solution in minimizing the trade-off between accuracy and interpretability. Moreover, the result of
    the comparison shows that our approach outperforms the alternate techniques in terms of accuracy of FRBCSs and also exhibits good
    result in terms of interpretability objective.

  • Keywords

    Fuzzy Rule-based Classification, Multi-objective PSO, Particle Swarm Optimization (PSO), Rule-based Systems, Single-objective PSO

  • References

      [1] N. Esfandiari, M. R. Babavalian, A. M. E. Moghadam, and V. K.
      Tabar, “Knowledge discovery in medicine: Current issue and future
      Expert Syst. Appl., vol. 41, no. 9, pp. 4434–4463, 2014.
      [2] M. Fazzolari, R. Alcalá, and F. Herrera, “A multi-objective
      evolutionary method for learning granularities based on fuzzy
      discretization to improve the accuracy-complexity trade-off of
      fuzzy rule-based classification systems: D-MOFARC algorithm,”
      Appl. Soft Comput. J., vol. 24, pp. 470–481, 2014.
      [3] M. B. Gorzałczany and F. Rudziński, “Interpretable and accurate
      medical data classification – a multi-objective genetic-fuzzy
      optimization approach,”
      Expert Syst. Appl., vol. 71, pp. 26–39,
      [4] K. Deb, S. Pratab, S. Agarwal, and T. Meyarivan, “A Fast and
      Elitist Multiobjective Genetic Algorithm: NGSA-II,”
      IEEE Trans.
      Evol. Comput.
      , vol. 6, no. 2, pp. 182–197, 2002.
      [5] M. J. Gacto, R. Alcalá, and F. Herrera, “An improved multiobjective genetic algorithm for tuning linguistic fuzzy systems,”
      Proc. IPMU, vol. 8, pp. 1121–1128, 2008.
      [6] R. Alcalá, J. Alcalá-Fdez, M. J. Gacto, and F. Herrera, “A multiobjective evolutionary algorithm for rule selection and tuning on
      fuzzy rule-based systems,”
      IEEE Int. Conf. Fuzzy Syst., pp. 1367–
      1372, 2007.
      [7] F. Jiménez, G. Sánchez, and J. M. Juárez, “Multi-objective
      evolutionary algorithms for fuzzy classification in survival
      Artif. Intell. Med., vol. 60, no. 3, pp. 197–219, 2014.
      [8] M. B. Gorzalczany and F. Rudzi, “Genetic Fuzzy Rule-Based
      Modelling of Dynamic Systems Using Time Series,” In Swarm and
      Evolutionary Computation (pp. 231-239). Springer, Berlin,
      [9] K. Sindhya, K. Deb, and K. Miettinen, “Improving convergence of
      evolutionary multi-objective optimization with local search: A
      concurrent-hybrid algorithm,”
      Nat. Comput., vol. 10, no. 4, pp.
      1407–1430, 2011.
      [10] D. Phong Pham, C. Ho Nguyen, and T. Thuy Nguyen, “Multiobjective particle swarm optimization algorithm and its application
      to the fuzzy rule based classifier design problem with the order
      based semantics of linguistic terms,”
      Comput. Commun. Technol.
      Res. Innov. Vis. Futur. (RIVF), 2013 IEEE RIVF Int. Conf.
      , no.
      January 2015, pp. 12–17, 2013.
      [11] P. D. Pham, T. T. Nguyen, and T. X. Tran, “A Hybrid Multiobjective PSO-SA Algorithm for the Fuzzy Rule Based Classifier
      Design Problem with the Order Based Semantics of Linguistic
      VNU J. Sci. Comput. Sci. Commun. Eng., vol. 30, no. 4, pp.
      44–56, 2015.
      [12] J. Kennedy, R. C. Eberhart, and Y. Shi, “Swarm Intelligence,”
      , vol. 78, no. 2, p. 512, 2001.
      [13] M. J. Gacto, R. Alcalá, and F. Herrera, “Interpretability of linguistic
      fuzzy rule-based systems: An overview of interpretability measures,”
      Inf. Sci. (Ny)., vol. 181, no. 20, pp. 4340–4360, 2011.
      [14] H. Ishibuchi and Y. Nojima, “Analysis of interpretability-accuracy
      tradeoff of fuzzy systems by multiobjective fuzzy genetics-based
      machine learning,”
      Int. J. Approx. Reason., vol. 44, no. 1, pp. 4–31,
      [15] M. Galende, G. Sainz, and M. J. Fuente, “Accuracy-Interpretability
      Balancing Fuzzy Models based Based on Balancing in in Fuzzy
      Models on Multiobjective Genetic Algorithm Multiobjective
      Genetic Algorithm,” pp. 3915–3920, 2009.
      [16] J. Alcalá-Fdez, R. Alcalá, and F. Herrera, “A fuzzy association
      rule-based classification model for high-dimensional problems with
      genetic rule selection and lateral tuning,”
      IEEE Trans. Fuzzy Syst.,
      vol. 19, no. 5, pp. 857–872, 2011.
      [17] M. Galende-Hernández, G. I. Sainz-Palmero, and M. J. FuenteAparicio, “Complexity reduction and interpretability improvement
      for fuzzy rule systems based on simple interpretability measures
      and indices by bi-objective evolutionary rule selection,”
      , vol. 16, no. 3, pp. 451–470, 2012.
      [18] M. Antonelli, P. Ducange, F. Marcelloni, and A. Segatori, “A novel
      associative classification model based on a fuzzy frequent pattern
      mining algorithm,”
      Expert Syst. Appl., vol. 42, no. 4, pp. 2086–
      2097, 2015.
      [19] A. S. Koshiyama, M. M. B. R. Vellasco, and R. Tanscheit, “GPFISCLASS: A Genetic Fuzzy System based on Genetic Programming
      for classification problems,”
      Appl. Soft Comput., vol. 37, pp. 561–
      571, 2015.
      [20] P. C. Shill, M. A. H. Akhand, M. Asaduzzaman, and K. Murase,
      “Optimization of Fuzzy Logic Controllers with Rule Base Size
      Reduction using Genetic Algorithms,”
      Int. J. Inf. Technol. Decis.
      , vol. 14, no. 5, 2015.
      [21] D. P. Rini, S. M. Shamsuddin, and S. S. Yuhaniz, “Particle swarm
      optimization for ANFIS interpretability and accuracy,”
      , vol. 20, no. 1, pp. 251–262, 2016.
      [22] M. Antonelli, P. Ducange, B. Lazzerini, and F. Marcelloni, “Multiobjective evolutionary design of granular rule-based classifiers,”
      Granul. Comput., vol. 1, no. 1, pp. 37–58, 2016.
      [23] H. Ishibuchi and T. Nakashima, “Effect of Rule Weights in Fuzzy
      Rule-Based Classification Systems Effect of Rule Weights in Fuzzy
      Rule-Based Classification Systems,” IEEE Transactions on Fuzzy
      Systems, 9(4), 506-515, pp. 506–515, 2000.
      [24] O. Cordón, “A historical review of evolutionary learning methods
      for Mamdani-type fuzzy rule-based systems: Designing
      interpretable genetic fuzzy systems,”
      Int. J. Approx. Reason., vol.
      52, no. 6, pp. 894–913, 2011.
      [25] F. Herrera, “Genetic fuzzy systems: Taxonomy, current research
      trends and prospects,”
      Evol. Intell., vol. 1, no. 1, pp. 27–46, 2008.
      [26] Y. Jarraya, S. Bouaziz, A. M. Alimi, and A. Abraham,
      “Evolutionary multi-objective optimization for evolving
      hierarchical fuzzy system,”
      2015 IEEE Congr. Evol. Comput., no.
      May, pp. 3163–3170, 2015.
      [27] M. R. Sierra and C. A. Coello Coello, “Improving PSO-Based
      Multi-objective Optimization Using Crowding, Mutation and
      Dominance,” In International Conference on Evolutionary MultiCriterion Optimization (pp. 505-519). Springer, Berlin, Heidelberg.,




Article ID: 29943
DOI: 10.14419/ijet.v7i4.31.29943

Copyright © 2012-2015 Science Publishing Corporation Inc. All rights reserved.