Abstract
Rough set theory (RS-Theory) is a fundamental model of granular computing (GrC) for uncertainty information processing, and information entropy theory provides an effective approach for its uncertainty representation and attribute reduction. Thus, this paper hierarchically constructs three-way weighted entropies (i.e., the likelihood, prior, and posterior weighted entropies) by adopting a GrC strategy from the concept level to classification level, and it further explores three-way attribute reduction (i.e., the likelihood, prior, and posterior attribute reduction) by resorting to a novel approach of Bayesian inference. From two new perspectives of GrC and Bayesian inference, this study provides some new insights into the uncertainty measurement and attribute reduction of information theory-based RS-Theory.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
References
Pawlak, Z.: Rough sets. International Journal of Information and Computer Science 11(5), 341–356 (1982)
Shannon, C.E.: The mathematical theory of communication. The Bell System Technical Journal 27(3–4), 373–423 (1948)
Miao, D.Q.: Rough set theory and its application in machine learning (Ph. D. Thesis). Beijing, Institute of Automation, The Chinese Academy of Sciences (1997)
Beaubouef, T., Petry, F.E., Arora, G.: Information-theoretic measures of uncertainty for rough sets and rough relational databases. Information Sciences 109(1-4), 185–195 (1998)
Slezak, D.: Approximate entropy reducts. Fundamenta Informaticae 53, 365–390 (2002)
Miao, D.Q., Hu, G.R.: A heuristic algorithm for reduction of knowledge. Chinese Journal of Computer Research & Development 36, 681–684 (1999)
Miao, D.Q., Wang, J.: An information representation of the concepts and operations in rough set theory. Journal of Software 10(2), 113–116 (1999)
Liang, J.Y., Qian, Y.H., Chu, D.Y., Li, D.Y., Wang, J.H.: The algorithm on knowledge reduction in incomplete information systems. Fuzziness and Knowledge-Based Systems 10, 95–103 (2002)
Liang, J., Shi, Z., Li, D., Wierman, M.: Information entropy, rough entropy and knowledge granularity in incomplete information systems. International Journal of General Systems 35(6), 641–654 (2006)
Wang, G.Y., Yu, H., Yang, D.C.: Decision table reduction based on conditional information entropy. Chinese Journal of Computers 25, 759–766 (2002)
Wang, G.Y., Zhao, J., An, J.J., Wu, Y.: A comparative study of algebra viewpoint and information viewpoint in attribute reduction. Fundamenta Informaticae 68(3), 289–301 (2005)
Bishop, C.M.: Pattern Recognition and Machine Learning. Springer (2006)
Zadeh, L.A.: Towards a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets and Systems 90, 111–127 (1997)
Lin, T.Y.: Granular computing: from rough sets and neighborhood systems to information granulation and computing with words. In: European Congress on Intelligent Techniques and Soft Computing, pp. 1602–1606 (1997)
Yao, Y.: An outline of a theory of three-way decisions. In: Yao, J., Yang, Y., Słowiński, R., Greco, S., Li, H., Mitra, S., Polkowski, L. (eds.) RSCTC 2012. LNCS, vol. 7413, pp. 1–17. Springer, Heidelberg (2012)
Yao, Y.Y.: Three-way decisions with probabilistic rough sets. Information Sciences 180, 341–353 (2010)
Miao, D.Q., Zhang, X.Y.: Change uncertainty of three-way regions in knowledge-granulation. In: Liu, D., Li, T.R., Miao, D.Q., Wang, G.Y., Liang, J.Y. (eds.) Three-Way Decisions and Granular Computing, pp. 116–144. Science Press, Beijing (2013)
Zhang, X.Y., Miao, D.Q.: Quantitative information architecture, granular computing and rough set models in the double-quantitative approximation space on precision and grade. Information Sciences 268, 147–168 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Zhang, X., Miao, D. (2014). Three-Way Weighted Entropies and Three-Way Attribute Reduction. In: Miao, D., Pedrycz, W., Ślȩzak, D., Peters, G., Hu, Q., Wang, R. (eds) Rough Sets and Knowledge Technology. RSKT 2014. Lecture Notes in Computer Science(), vol 8818. Springer, Cham. https://doi.org/10.1007/978-3-319-11740-9_65
Download citation
DOI: https://doi.org/10.1007/978-3-319-11740-9_65
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-11739-3
Online ISBN: 978-3-319-11740-9
eBook Packages: Computer ScienceComputer Science (R0)