Skip to main content

Big Data Analytics for Smart Grid: A Review on State-of-Art Techniques and Future Directions

  • Chapter
  • First Online:
Data Analytics for Smart Grids Applications—A Key to Smart City Development

Abstract

Due to rapid growth of smart grid technologies, massive amount of information is generated from different sources such as sensors, intelligent meters and other devices for monitoring. Big data analytics has emerged as a key technology for analyzing and visualizing this data, enabling utilities to enhance performance and sustainability of electrical systems. This chapter provides detailed review on state-of-art techniques for big data analytics with smart grids including data pre-processing, data mining and visualization. It also highlights the major challenges associated with big data analytics which includes data quality, security and discusses potential solutions to these challenges. Finally, future directions are identified for the same with aid of artificial intelligence and block chain technology.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Yu, H., Wang, Z., Wei, W., Zhang, J.: A review of block chain technology for smart grid: State-of-the-art, challenges and future directions. J. Clean. Prod. 290, 125932–125940 (2021)

    Google Scholar 

  2. Zhang, Z., et al.: Demand response optimization in smart grid: A survey. IEEE Access 9, 105062–105076 (2021)

    Google Scholar 

  3. Kandil, A., Elsaid, M., Abdallah, H., Kim, H.: Machine learning-based demand response optimization techniques in smart grids: A comprehensive review. Energies 14(10), 3064–3070 (2021)

    Google Scholar 

  4. Liu, X., Chen, X., Chen, Y.: A survey of integration of big data analytics with smart grid. IEEE Access 9, 14310–14326 (2021)

    Google Scholar 

  5. Ma, J and Zhang, X, “A survey of artificial intelligence in smart grid”, Renewable and Sustainable Energy Reviews, 2021, Volume 145, pp.111031–111–37.

    Google Scholar 

  6. Kavousi-Fard, A., Salehi, M.: Demand response management in smart grids: A comprehensive review of literature. Energy 221, 119807–119814 (2021)

    Google Scholar 

  7. Wang, H., Chen, S., Sun, H., Li, Z.: Smart grid big data analytics based on convolutional neural networks. IEEE Access 9, 48337–148346 (2021)

    Google Scholar 

  8. Li, Y., Li, X., Liang, X., Chen, H., Li, L.: Blockchain-based secure and privacy-preserving energy data sharing in smart grid. IEEE Trans. Industr. Inf. 16(6), 3916–3925 (2020)

    Google Scholar 

  9. Nguyen, L.T., Nguyen, T.V., Dao, T.H., Kim, D.H.: Big data analytics for energy management in smart grid: A survey. IEEE Access 8, 165710–165732 (2020)

    Google Scholar 

  10. Zarei, M., Gandoman, F.H., Ramezani, M.: A review of big data analytics for energy management in smart grid. J. Clean. Prod. 248, 119267–119272 (2020)

    Google Scholar 

  11. Zhang, S., Chen, H.: Big data analytics for intelligent energy management in smart grid: A review. Energy Procedia 180, 431–436 (2020)

    Google Scholar 

  12. Li, K., Li, H., Chen, X., Li, Y.: A survey of data-driven methods for fault diagnosis in smart grids. IEEE Access 8, 159437–159453 (2020)

    Google Scholar 

  13. Zhang, L., Huang, Y., Wang, L., Wang, X.: A review of artificial intelligence in smart grid. CSEE Journal of Power and Energy Systems 6(2), 244–254 (2020)

    Google Scholar 

  14. Zeng, Q., Wen, F., Gao, J., Zhang, Y., Wang, Y.: A survey on big data analytics for cybersecurity in smart grids. IEEE Trans. Industr. Inf. 16(7), 4507–4521 (2020)

    Google Scholar 

  15. Zhang, Y., Zheng, K., Chen, X., Li, Z., Zhu, M.: Big data analytics for distributed energy systems: A survey. IEEE Trans. Industr. Inf. 16(7), 4541–4553 (2020)

    Google Scholar 

  16. Liu, H., Wang, Y., Chen, J., Zhang, X.: Big data analytics for power grid operation and planning. Energies 12(8), 1449 (2019)

    Google Scholar 

  17. Yoon, Y.J., Kim, K.H.: A review of demand response optimization techniques for smart grid. Renew. Sustain. Energy Rev. 102, 143–151 (2019)

    Google Scholar 

  18. Chen, Y., Lv, W., Lin, B.: Energy consumption prediction using machine learning algorithms in smart grid. Energies 12(11), 2079 (2019)

    Google Scholar 

  19. Wang, X., Qi, H., Li, Z., Gao, F.: Research on data mining technology for smart grid operation and maintenance. J. Ambient. Intell. Humaniz. Comput. 10(2), 599–608 (2019)

    Google Scholar 

  20. Shen, H., Fu, Y., Xiao, J.: A survey on energy consumption prediction and optimization in smart grid. J. Clean. Prod. 234, 1189–1206 (2019)

    Google Scholar 

  21. Wang, L., Cai, W., Zhu, X.: A survey on demand response optimization in smart grid. Int. J. Electr. Power Energy Syst. 107, 152–165 (2019)

    Google Scholar 

  22. Zhou, Y., Zhang, X., Wang, L., Sun, Y.: Big data analytics in energy internet. Renew. Sustain. Energy Rev. 109, 68–82 (2019)

    Google Scholar 

  23. Gupta, V., Sharma, A.: An overview of big data analytics in smart grid. Journal of Information Systems Engineering & Management 4(4), 40 (2019)

    Google Scholar 

  24. Ahmad, A., & Habib, S. “A comprehensive review of big data analytics for smart grids” Energies, 2019, Vol.12, Issue 14, pp.2765.

    Google Scholar 

  25. Ma, Y., Zhang, H., Wang, Z., Wen, J.: Big data-driven energy management in smart grids: A review. Appl. Energy 251, 113383 (2019)

    Google Scholar 

  26. Zhao, H., Li, F., Xu, Y.: A survey on deep learning in smart grid. Journal of Modern Power Systems and Clean Energy 7(3), 409–418 (2019)

    Google Scholar 

  27. Mishra, A., Kuppannagari, S.S., Khamparia, A., Singh, M.: Big data analytics in smart grid: A review of trends, architectures, and frameworks. Sustain. Cities Soc. 47, 101478–101482 (2019)

    Google Scholar 

  28. Niyato, D., Luong, N.C., Wang, P.: Machine learning for big data analytics in the power and energy sector. IEEE Trans. Industr. Inf. 14(10), 4315–4324 (2018)

    Google Scholar 

  29. Chakraborty, S., Mukhopadhyay, S.: Big data analytics in smart grids: A review of trends, tools and challenges. Renew. Sustain. Energy Rev. 82, 2993–3008 (2018)

    Google Scholar 

  30. Alizadeh, M., Vahidinasab, V., Basiri, M.E.: Real-time big data analytics for smart grid: A survey. Sustain. Cities Soc. 39, 682–694 (2018)

    Google Scholar 

  31. Vo, M.T., Vo, A.H., Nguyen, T., Sharma, R., Le, T.: Dealing with the class imbalance problem in the detection of fake job descriptions. Computers, Materials & Continua 68(1), 521–535 (2021)

    Article  Google Scholar 

  32. Smriti Sachan, Rohit Sharma, Amit Sehgal,Energy efficient scheme for better connectivity in sustainable mobile wireless sensor networks,Sustainable Computing: Informatics and Systems,Volume 30,2021,100504.

    Google Scholar 

  33. Ghanem, S., Kanungo, P., Panda, G., et al.: Lane detection under artificial colored light in tunnels and on highways: an IoT-based framework for smart city infrastructure. Complex Intell. Syst. (2021). https://doi.org/10.1007/s40747-021-00381-2

    Article  Google Scholar 

  34. Sachan, S., Sharma, R., Sehgal, A.: SINR Based Energy Optimization Schemes for 5G Vehicular Sensor Networks. Wireless Pers. Commun. (2021). https://doi.org/10.1007/s11277-021-08561-6

    Article  Google Scholar 

  35. Priyadarshini, I., Mohanty, P., Kumar, R., et al.: A study on the sentiments and psychology of twitter users during COVID-19 lockdown period. Multimed Tools Appl (2021). https://doi.org/10.1007/s11042-021-11004-w

    Article  Google Scholar 

  36. Azad, C., Bhushan, B., Sharma, R., et al.: Prediction model using SMOTE, genetic algorithm and decision tree (PMSGD) for classification of diabetes mellitus. Multimedia Syst. (2021). https://doi.org/10.1007/s00530-021-00817-2

    Article  Google Scholar 

  37. Priyadarshini, I., Kumar, R., Tuan, L.M. et al. A new enhanced cyber security framework for medical cyber physical systems. SICS Softw.-Inensiv. Cyber-Phys. Syst. (2021). https://doi.org/10.1007/s00450-021-00427-3

  38. Priyadarshini, I., Kumar, R., Sharma, R.: Pradeep Kumar Singh, Suresh Chandra Satapathy, Identifying cyber insecurities in trustworthy space and energy sector for smart grids. Comput. Electr. Eng. 93, 107204 (2021)

    Article  Google Scholar 

  39. Rajesh Singh, Rohit Sharma, Shaik Vaseem Akram, Anita Gehlot, Dharam Buddhi, Praveen Kumar Malik, Rajeev Arya,Highway 4.0: Digitalization of highways for vulnerable road safety development with intelligent IoT sensors and machine learning,Safety Science,Volume 143, 2021,105407,ISSN 0925–7535,

    Google Scholar 

  40. Sahu, L., Sharma, R., Sahu, I., Das, M., Sahu, B., & Kumar, R. (2021). Efficient detection of Parkinson's disease using deep learning techniques over medical data. Expert Systems, e12787. https://doi.org/10.1111/exsy.12787.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to K. Umapathy .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Umapathy, K. et al. (2023). Big Data Analytics for Smart Grid: A Review on State-of-Art Techniques and Future Directions. In: Kumar Sharma, D., Sharma, R., Jeon, G., Kumar, R. (eds) Data Analytics for Smart Grids Applications—A Key to Smart City Development. Intelligent Systems Reference Library, vol 247. Springer, Cham. https://doi.org/10.1007/978-3-031-46092-0_3

Download citation

Publish with us

Policies and ethics