Abstract
Medical data exhibit certain features that make their classification stand out as a distinct field of research. Several medical classification tasks exist, among which medical diagnosis and prognosis are most common. Deriving a medical classification is a complex task. In particular, the rule–discovery problem is NP-hard. Identifying the most suitable strategy for a particular medical classification problem along with its optimal parameters is no less difficult. Heuristics and meta-heuristics are normally applied to approximate its solution. This chapter reviews hybrid meta-heuristics for medical data classification task, particularly diagnosis and prognosis, and their application to model selection, including parameter optimization and feature subset selection.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
References
Abbas, H.A.: Speeding up Back-Propagation using Multiobjective Evolutionary Algorithms. Neural Computation 15(11), 2705–2726 (2003)
Aguilar-Ruiz, J., Riquelme, J., Toro, M.: Evolutionary Learning of Hierarchical Decision Rules. IEEE Transactions on Systems, Man, and Cybernetics, Part B 33(2), 324–331 (2003)
Aci, M., Inan, C., Avci, M.: A Hybrid Classification Method of K-Nearest Neighbor, Bayesian Methods and Genetic Algorithm. Expert Systems with Applications 30, 5061–5067 (2010)
Bacardit, J.: Pittsburgh Genetics-Based Machine Learning in the Data Mining era: Representations, generalization, and run-time. Dissertation, Ramon Llull University, Barcelona (2004)
Bacardit, J., Butz, M.V.: Data Mining in Learning Classifier Systems: Comparing XCS with GAssist. In: Kovacs, T., Llorà, X., Takadama, K., Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 2003. LNCS (LNAI), vol. 4399, pp. 282–290. Springer, Heidelberg (2007)
Bacardit, J., Bernadó-Mansilla, E., Butz, M.V.: Learning Classifier Systems: Looking Back and Glimpsing Ahead. In: Bacardit, J., Bernadó-Mansilla, E., Butz, M.V., Kovacs, T., Llorà, X., Takadama, K. (eds.) IWLCS 2006 and IWLCS 2007. LNCS (LNAI), vol. 4998, pp. 1–21. Springer, Heidelberg (2008)
Back, T., Fogel, D., Michalewicz, Z.: Handbook of Evolutionary Computation. Oxford University Press, London (1997)
Bernadó-Mansilla, E., Garrell-Guiu, J.M.: Accuracy based learning classifier systems: models, analysis and applications to classification tasks. Evolutionary Computation 11(3), 209–238 (2003)
Bhattacharyya, D., Pal, A.J., Kim, T.: Cell-graph coloring for cancerous tissue modeling and classification. Multimedia Tools and Applications (2011), doi:10.1007/s11042-011-0797-y
Bojarczuk, C., Lopes, H., Freitas, A.: Genetic Programming for Knowledge Discovery in Chest Pain Diagnosis. IEEE Engineering in Medicine and Biology Magazine 19(4), 38–44 (2000)
Bojarczuk, C., Lopes, H., Freitas, A., Michaliewicz, E.: A Constrained-syntax Genetic Programming System for Discovering Classification Rules: Application to Medical Data Sets. Artificial Intelligence in Medicine 30(1), 27–48 (2004)
Bradley, A.P.: The Use of the Area under the ROC Curve in the Evaluation of Machine Learning Algorithms. Pattern Recognition 30, 1145–1159 (1997)
Bull, L., Hurst, J.: ZCS Redux. Evolutionary Computation 10(2), 185–205 (2002)
Bull, L., Bernadó-Mansilla, E., Holmes, J.: Learning Classifier Systems in Data Mining: An Introduction. In: Bull, L., Bernadó-Mansilla, E., Holmes, J. (eds.) Learning Classifier Systems in Data Mining: Studies in Computational Intelligence, pp. 1–16. Springer (2008)
Candelieri, A.: A hyper-solution framework for classification problems via metaheuristic approaches. 4OR-Q J. Oper. Res. (2010), doi:10.1007/s10288-011-0166-8
Castillo, P.A., Arenas, M., Merelo, J.J., Rivas, V.M., Romero, G.: Multiobjective Optimization of Ensembles of Multilayer Perceptrons for Pattern Classification. In: Runarsson, T.P., Beyer, H.-G., Burke, E.K., Merelo-Guervós, J.J., Whitley, L.D., Yao, X. (eds.) PPSN IX 2006. LNCS, vol. 4193, pp. 453–462. Springer, Heidelberg (2006)
Chen, S., Lin, S., Chou, S.: Enhancing the Classification Accuracy by Scatter Search-Based ensemble Approach. Applied Soft Computing 11, 1021–1028 (2011)
Chorbev, I., Mihajlov, D., Jolevski, I.: Web Based Medical Expert System with Self Training Heuristic Rule Induction Algorithm. In: Proceedings of the First International Conference on Advances in Databases, Knowledge, and Data Application (DBKDA 2009), pp. 143–148. IEEE Computer Society, Washington, DC (2009), doi:10.1109/DBKDA.2009.21
Cruz, J., Wishart, D.: Applications of Machine Learning in Cancer Prediction and Prognosis. Cancer Informatics 2, 59–77 (2006)
de Toro, F., Ortega, J., Fernandez, J., Diaz, A.: Parallel genetic algorithm for multiobjective optimization. In: Proceedings of the 10th Euromicro Workshop on Parallel, Distributed and Network-based Processing, pp. 384–391. IEEE Computer Society (2002)
Dennis, J., Torczon, V.: Derivative-free pattern search methods for multidisciplinary design problems. In: Proceedings of the 5th AIAA/ USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Panama City, FL, pp. 922–932 (1994)
Dorigo, M.: Optimization, Learning and Natural Algorithms, Dissertation, Politecnico di Milano, Italie (1992)
Dybowski, R., Weller, P., Chang, R., Gant, V.: Prediction of outcome in critically ill patients using artificial neural network synthesized by genetic algorithm. Lancet 347(9009), 1146–1150 (1996)
Escalante, H., Montes, M., Sucar, L.: Particle Swarm Model Selection. J. Mach. Learn. Res. 10, 405–440 (2009)
Fan, C., Chang, P., Hsieh, J.L.: A Hybrid Model Combining Case-based Reasoning and Fuzzy Decision Tree for Medical Data Classification. Applied Soft Computing 11, 632–644 (2011)
Fogel, L.: Evolutionary Programming in Perspective: the Top-Down View. In: Zurada, J., Marks II, R., Robinson, C. (eds.) Computational Intelligence: Imitating Life, pp. 135–146. IEEE Press (1994)
Fogel, L., Owens, A., Walsh, M.: Artificial Intelligence through a Simulation of Evolution. In: Callahan, A., Maxfield, M., Fogel, L.J. (eds.) Biophysics and Cybernetic Systems, Spartan, Washington DC, pp. 131–155 (1965)
Gao, Y., Huang, J., Rong, H.: Learning Classifier System Ensemble for Data Mining. In: Proceedings of the 2005 Genetic and Evolutionary Computation Conference IWLCS, pp. 63–66 (2005)
Glover, F.: Tabu Search - Part I. ORSA Journal on Computing 1(3), 190–206 (1989)
Glover, F.: Tabu Search - Part II. ORSA Journal on Computing 2(1), 4–32 (1990)
Glover, F.: A Template for Scatter Search and Path Relinking. In: Hao, J.-K., Lutton, E., Ronald, E., Schoenauer, M., Snyers, D. (eds.) AE 1997. LNCS, vol. 1363, p. 13. Springer, Heidelberg (1998)
Hagan, M.T., Menhaj, M.B.: Training Feedforward Networks with the Marquardt Algorithm. IEEE Transactions on Neural Networks 5, 989–999 (1994)
Han, J., Kamber, M.: Data Mining: Concepts and Techniques, 2nd edn., The Morgan Kaufmann Series in Data Management Systems. Series Editor Morgan Kaufmann Publishers (2006) Gray, J. (series ed.) ISBN 1-55860-901-6
Hanson, C.W.: Marshall BEArtificial intelligence applications in the intensive care unit. Crit. Care Med. 29(2), 427–435 (2001)
Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd edn. Springer (2009) ISBN: 9780387848570
Holland, J.H.: Adaptation in Natural and Artificial Systems, 1st edn. The University of Michigan Press, Ann Arbor (1975); MIT Press, Cambridge, MA (1992)
Holland, J., Reitman, J.: Cognetive Systems based on Adaptive Agents. In: Waterman, D.A., Inand, F. (eds.) Pattern-Directed Inference Systems, Hayes-Roth (1978)
Holmes, J.: Discovering Risk of Disease with a Learning Classifier System. In: Proceedings of the 7th International Conference on Genetic Algorithms (ICGA 1997), pp. 426–433 (1997)
Holmes, J., Sager, J.: Rule Discovery in Epidemiologic Surveillance Data Using EpiXCS: An Evolutionary Computation Approach. In: Miksch, S., Hunter, J., Keravnou, E.T. (eds.) AIME 2005. LNCS (LNAI), vol. 3581, pp. 444–452. Springer, Heidelberg (2005)
Holmes, J., Durbin, D., Winston, F.: Discovery of Predictive Models in an Injury Surveillance Database: An Application of Data Mining in Clinical Research. In: Proceedings of AMIA Symposium, pp. 359–363 (2000a)
Holmes, J., Durbin, D., Winston, F.: The learning classifier system: an evolutionary computation approach to knowledge discovery in epidemiologic surveillance. Artificial Intelligence in Medicine 19, 53–74 (2000b)
Holmes, J., Lanzi, P., Stolzmann, W., Wilson, S.: Learning Classifier Systems: New Models, Successful Applications. Information Processing Letters archive 82(1), 23–30 (2002)
Ince, T., Kiranyaz, S., Pulkkinen, J., Gabbouj, M.: Evaluation of global and local training techniques over feed-forward neural network architecture spaces for computer-aided medical diagnosis. Expert Systems with Applications 37, 8450–8461 (2010)
Jain, R., Mazumdar, J., Moran, W.: Application of fuzzy-classifier system to coronary artery disease and breast cancer. Australas Phys. Eng. Sci. Med. 21(3), 141–147 (1998)
Jiang, Y., Metz, C.E., Nishikawa, R.M.: A Receiver Operating Characteristic Partial Area Index for Highly Sensitive Diagnostic Tests. Radiology 201, 745–750 (1996)
Kennedy, J., Eberhart, R.C.: Particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Networks, Piscataway, NJ, vol. 4, pp. 1942–1948 (1995)
Kharbat, F., Bull, L., Odeh, M.: Mining breast cancer data with XCS. In: Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation, pp. 2066–2073 (2007)
Kirkpatrick, S., Gelatt, C.D., Vecchi, M.P.: Optimization by Simulated Annealing. Science. New Series 220(4598), 671–680 (1983)
Kotsiantis, S.B.: Supervised Machine Learning: A Review of Classification. Informatica Journal 31, 249–268 (2007)
Kotsiantis, S.B.: Feature selection for machine learning classification problems: a recent overview. Artif. Intell. Rev (2011), doi:10.1007/s10462-011-9230-1
Koza, J.R.: Genetic Programming. MIT Press, Cambridge (1992)
Lanzi, P.: Extending the Representations of Classifier Conditions. Part II: From Messy coding to S-expression. In: Banzhaf, W., et al. (eds.) Proceedings of the Genetic and Proceedings of the Genetic and Evolutionary Computation Conference, vol. 1, pp. 345–352 (1999)
Lanzi, P.: Mining interesting knowledge from data with the XCS classifier system. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2001), pp. 958–965. Morgan Kaufmann, San Francisco (2001)
Larrañaga, P., Calvo, B., Santana, R., et al.: Machine Learnig in Bioinformatics. Brief Bioinform. 7(1), 86–112 (2006)
Lavrac, N.: Selected Techniques for Data Mining in Medicine. Artificial Intelligence in Medicine 16(1), 3–23 (1999)
Lisboa, P.J.: Taktak AFG The use of artificial neural networks in decision support in cancer: A systematic review. Neural Networks 19(4), 408–415 (2006)
Lo, H.-Y., Chang, C.-M., Chiang, T.-H., et al.: Learning to Improve Area-Under-FROC for Imbalanced Medical Data Classification Using an Ensemble Method. In: ACM SIGKDD Explorations Newsletter, vol. 10(2), ACM, New York (2008), doi:10.1145/1540276.1540290
Lucas, F.: Analysis of Notions of Diagnosis. Artificial Intelligence 105(12), 295–343 (1998)
Lucas, F., Abu-Hanna, A.: Prognosis Methods in Medicine. Artificial Intelligence in Medicine 15(2), 105–119 (1998)
Luukka, P., Lampinen, J.: Differential Evolutionary Classifier in Noisy Settings with Interactive Variables. Applied Soft Computing 1, 891–899 (2011)
Madera, J., Dorronsoro, B.: Estimation of Distribution Algorithms. In: Metaheuristic Procedures for Training Neutral Networks Operations Research/Computer Science Interfaces Series, Part III, vol. 36, pp. 87–108 (2006)
Moscato, P.: On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts: Towards Memetic Algorithms - Caltech Concurrent Computation Program, C3P Report (1989)
Narayanan, M.N., Lucas, S.B.: A genetic algorithm to improve a neural network to predict a patient’s response to warfarin. Methods Inf. Med. 32(1), 55–58 (1993)
Penã-Reyes, C., Sipper, M.: A fuzzy-genetic approach to breast cancer diagnosis. Artif. Intell. Med. 17(2), 131–135 (1999)
Penã-Reyes, C., Sipper, M.: Evolutionary Computation in Medicine: an Overview. Artif. Intell. Med. 19(1), 1–23 (2000)
Peroumalnaik, M., Enee, G.: Prediction using Pittsburgh Learning Classifier Systems: APCS use case. In: Proceedings of the 12th Annual Conference Companion on Genetic and Evolutionary Computation GECCO 2010, pp. 1901–1907 (2010)
Pham, H.N.A., Triantaphyllou, E.: The impact of overfitting and overgeneralization on the classification accuracy in data mining. In: Maimon, O., Rokach, L. (eds.) Soft Computing for Knowledge Discovery and Data Mining, Part 4, pp. 391–431. Springer, New York (2007)
Pham, H.N., Triantaphyllou, E.: An application of a new meta-heuristic for optimizing the classification accuracy when analyzing some medical datasets. Expert Systems with Applications 36, 9240–9249 (2009)
Price, K., Storn, R., Lampinen, J.: Differential Evolution - A Practical Approach to Global Optimization. Springer (2005)
Provost, F., Kolluri, V.: A Survey of Methods for Scaling up inductive Algorithms. Datamining and Knowledge Discovery 3(2), 131–169 (1999)
Ranawana, R., Palade, V.: Optimized Precision, A New Measure for Classifier Performance Evaluation. In: Proceedings of the IEEE Congress on Evolutionary Computation, Vancouver, Canada, pp. 2254–2261 (2006)
Rao, R.B., Bi, J., Fung, G., et al.: LungCAD: A Clinically Approved, Machine Learning System for Lung Cancer Detection. In: Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, New York (2008), doi:10.1145/1281192.1281306
Rojanavasu, P., Dam, H., Abbass, H., Lokan, C., Pinngern, O.: A Self-Organized, Distributed, and Adaptive Rule-Based Induction System. IEEE Transctions on Neural Networks 20(3), 446–495 (2009)
Rumelhart, D., Hinton, G., Williams, R.: Learning Representations by Backpropagation Errors. Nature 323, 533–536 (1986)
Sarkar, B.K., Sana, S.S.: A Hybrid Approach to Design Efficient Learning Classifiers. Computers and Mathematics with Applications 58, 65–73 (2009)
Shortliffe, E., Cimino, J.: Biomedical Informatics: Computer Applications in Health Care and Biomedicine. Springer, New York (2006)
Skinner, B., Nguyen, H., Liu, D.: Classification of EEG Signals Using a Genetic-Based Machine Learning Classifier. In: Proceedings of the 29th Annual International Conference of the IEEE EMBS, Lyon, France, pp. 3120–3123 (2007a)
Skinner, B., Nguyen, H., Liu, D.: Distributed Classifier Migration in XCS for Classification of Electroencephalographic Signals. In: Proceedings of the IEEE Congress on Evolutionary Computation CEC 2007, Singapore, pp. 2829–2836 (2007b)
Smith, S.: A learning system based on genetic adaptive algorithms. Dissertation, University of Pittsburgh, Pittsburgh (1980)
Smithies, R.G., Salhi, S., Queen, N.M.: Predicting colorectal cancer recurrence: A hybrid neural networks-based approach. In: Ibaraki, T., Nonobe, K., Yagiura, M. (eds.) Metaheuristics: Progress as Real Problem Solvers. Series: Operations Research/Computer Science Interfaces Series, vol. 32, pp. 259–285 (2005)
Socha, K., Blum, C.: Ant Colony Optimization. In: Metaheuristic Procedures for Training Neutral Networks, Part IV. Operations Research/Computer Science Interfaces Series, vol. 36, pp. 153–180 (2006)
Stolzmann, W.: Anticipatory Classifier Systems. In: Proceedings of the 3rd Annual Genetic Programming Conference, pp. 658–664 (1998)
Stone, M.: Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society Series B 36, 111–147 (1974)
Tan, K., Yu, Q., Heng, C., Lee, T.: Evolutionary Computing for Knowledge Discovery in Medical Diagnosis. Artificial Intelligence in Medicine 27(2), 129–154 (2003)
Tanwani, A., Farooq, M.: Performance Evaluation of Evolutionary Algorithms in Classification of Biomedical Datasets. In: Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation: Late Breaking Papers, GECCO 2009, Canada, pp. 2617–2624 (2009a)
Tanwani, A., Farooq, M.: The Role of Biomedical Dataset in Classification. In: Combi, C., Shahar, Y., Abu-Hanna, A. (eds.) AIME 2009. Lecture Notes in Computer Science (LNAI), vol. 5651, pp. 370–374. Springer, Heidelberg (2009b)
Tanwani, A.K., Farooq, M.: Classification Potential vs. Classification Accuracy: A Comprehensive Study of Evolutionary Algorithms with Biomedical Datasets. In: Bacardit, J., Browne, W., Drugowitsch, J., Bernadó-Mansilla, E., Butz, M.V. (eds.) IWLCS 2008/2009. Lecture Notes in Computer Science (LNAI), vol. 6471, pp. 127–144. Springer, Heidelberg (2010)
Tanwani, A., Afridi, J., Shafiq, M., Farooq, M.: Guidelines to Select Machine Learning Scheme for Classification of Biomedical Datasets. In: Pizzuti, C., Ritchie, M.D., Giacobini, M. (eds.) EvoBIO 2009. LNCS, vol. 5483, pp. 128–139. Springer, Heidelberg (2009)
Tzima, F., Mitkas, P.: ZCS Revisited: Zeroth-level Classifier Systems for Data Mining. In: Proceedings of the 2008 IEEE International Conference on Data Mining Workshops, pp. 700–709 (2008)
Unler, A., Murat, A.: Discrete Optimization: A discrete particle swarm optimization method for feature selection in binary classification problems. European Journal of Operational Research 206(3), 528–539 (2010)
Unold, O., Tuszynski, K.: Mining Knowledge from Data using Anticipatory Classifier Systems. Knowledge-Based Systems 21(5), 363–370 (2008)
Urbanowicz, R., Moore, J.: Review Article: Learning Classifier Systems: A Complete Introduction, Review and Roadmap. Journal of Artificial Evolution and Applications, 1–25 (2009)
Vieira, S.M., Sousa, J., Runkler, T.A.: Multi-Criteria Ant Feature Selection Using Fuzzy Classifiers. In: Swarm Intelligence for Multi-objective Problems in Data Mining: Studies in Computational Intelligence, vol. 242, pp. 19–36 (2009)
Walter, D., Mohan, C.: ClaDia: A Fuzzy Classifier System for Disease Diagnosis. In: Proceedings of the 2000 Congress on Evolutionary Computation, CA, USA, vol. 2, pp. 1429–1435 (2000)
Wilson, S.W.: ZCS: A Zeroth-Level Learning Classifier System. Evolutionary Computation 2(1), 1–18 (1994)
Wilson, S.W.: Classifier Fitness Based on Accuracy. Evolutionary Computation 3(2), 149–175 (1995)
Wilson, S.W.: Mining Oblique Data with XCS. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 2000. LNCS (LNAI), vol. 1996, pp. 158–290. Springer, Heidelberg (2001)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Al-Muhaideb, S., El Bachir Menai, M. (2013). Hybrid Metaheuristics for Medical Data Classification. In: Talbi, EG. (eds) Hybrid Metaheuristics. Studies in Computational Intelligence, vol 434. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30671-6_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-30671-6_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-30670-9
Online ISBN: 978-3-642-30671-6
eBook Packages: EngineeringEngineering (R0)