Skip to main content

An Ensemble Classification Algorithm for Imbalanced Data Streams with Unlabeled Data

  • Conference paper
  • First Online:
Advances in Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD 2020)

Abstract

In practical applications, many data in imbalanced data streams are unlabeled. For this reason, this paper presents an ensemble classification algorithm for imbalanced data streams with unlabeled data . The algorithm uses the K-means clustering algorithm to label unlabeled instances, uses the re-sampling technique of dividing negative instances to establish some balanced data subsets, uses the Hoeffding Bounds inequality to detect concept drifts, and uses the ensemble technique to build an ensemble classifier. Experimental results show that the algorithm has good classification accuracy and adaptability, and it is an effective classification algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Pramod, S., Vyas, O.P.: Data stream mining: a review. In: Das, V. (eds.) Proceedings of the Third International Conference on Trends in Information, Telecommunication and Computing. LNEE, vol. 150, pp. 621–627. Springer, New York (2013). https://doi.org/10.1007/978-1-4614-3363-7_75

  2. Pan, S., Zhang, Y., Li, X.: Dynamic classifier ensemble for positive unlabeled text stream classification. Knowl. Inf. Syst. 33(2), 267–287 (2012). https://doi.org/10.1007/s10115-011-0469-2

    Article  Google Scholar 

  3. Miller, D.-J., Uyar, H.-S.: A mixture of experts classifier with learning based on both labeled and unlabelled data. In: Advances in Neural Information Processing Systems, pp. 571–577 (1997)

    Google Scholar 

  4. Ouyang, Z., et al.: An ensemble classifier framework for mining imbalanced data streams. Acta Electron. Sin. 38(1), 184–189 (2010)

    Google Scholar 

  5. Wang, Y., Zhang, Y., Wang, Y.: Mining data streams with skewed distribution by static classifier ensemble. In: 22nd International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, pp. 685–694 (2009)

    Google Scholar 

  6. Qun, S., Jun, Z., Zhenghong, D.: A better intrusion detection algorithm based on classification of skewed-data streams. J. Northwest. Polytech. Univ. 27(6), 859–862 (2019)

    Google Scholar 

  7. Lichtenwalter, R., Chawla, N.V.: Learning to classify data streams with imbalanced class distributions. In: PAKDD Conference, pp. 758–769 (2019)

    Google Scholar 

  8. Li, X.-L., Yu, P.-S., Liu, B., Ng, S.-K.: Positive unlabeled learning for data stream classification. In: Proceedings of SDM, pp. 259–270 (2009)

    Google Scholar 

  9. Lindstrom, P., Delany, S.-J., Namee, B.-M.: Handling concept drift in a text data stream constrained by high labelling cost. In: Proceedings of the 23rd International Florida Artificial Intelligence Research Society Conference, pp. 32–37 (2010)

    Google Scholar 

  10. Xu, W.H., Qin, Z., Chang, Y.: Semi-supervised learning based ensemble classifier for stream data. Pattern Recogn. Artif. Intell. 25(2), 292–299 (2018)

    Google Scholar 

  11. Hu, X.G., He, J.H., Li, P.P.: Data streams classification approach based on distance and sampling. App. Res. Comput. 35(4), 992–995 (2018)

    Google Scholar 

  12. Gang, S., Zhou, H., Sun, K.: Coal mine safety evaluation method based on incomplete labeled data stream classification. Open Cybern. Systemics J. 8(1), 918–923 (2014)

    Article  Google Scholar 

  13. Chawla, N.V., Japkowicz, N., Kotcz, A.: Editorial: special issue on learning from imbalanced data sets. ACM SIGKDD Explor. Newsl. 6(1), 1–6 (2014)

    Article  Google Scholar 

  14. Li, P.P.: Concept Drifting Detection and Classification on Data Stream. Hefei University of Technology, Hefei (2012)

    Google Scholar 

Download references

Acknowledgment

The work was supported by the National Natural Science Foundation of China (61906044), and supported by Fuyang Government and Fuyang Normal University Cooperation Research Project (XDHX2016024), and supported by Big Data and Intelligent Computing Innovation Team of Fuyang Normal University (XDHXTD201703), and supported by Fuyang Humanities and Social Science Research Special Project (FYSK2019QD10), and supported by the Natural Science Foundation of the Anhui Higher Education Institutions of China (KJ2018A0328, KJ2019A0532 and KJ2019A0542).

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, Z., Sun, G., Zhao, J., Wang, H., Ding, Z. (2021). An Ensemble Classification Algorithm for Imbalanced Data Streams with Unlabeled Data. In: Meng, H., Lei, T., Li, M., Li, K., Xiong, N., Wang, L. (eds) Advances in Natural Computation, Fuzzy Systems and Knowledge Discovery. ICNC-FSKD 2020. Lecture Notes on Data Engineering and Communications Technologies, vol 88. Springer, Cham. https://doi.org/10.1007/978-3-030-70665-4_130

Download citation

Publish with us

Policies and ethics