Skip to main content
SpringerLink
Log in

A Feasibility Study of Log-Based Monitoring for Multi-cloud Storage Systems

  • Conference paper
  • First Online:
Advanced Information Networking and Applications (AINA 2021)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 226))

  • 923 Accesses

Abstract

With more cloud customers are storing their data in multiple Cloud Service Providers (CSPs), they are responsible for managing the data in the multi-cloud storage environment, including monitoring the events on the cloud. They could monitor various cloud storage services by collecting, processing, and analyzing the cloud storage log files generated by multiple CSPs. In this paper, we investigate the feasibility of log-based monitoring for multi-cloud storage systems. We evaluate the current state of cloud object storage services and their logging functionality by analyzing cloud storage log files generated by a proof-of-concept cloud storage broker system using the three largest public CSPs: Amazon Web Services, Google Cloud Platform, and Microsoft Azure. We discover the logging functionality of cloud storage services could create severe security and reliability issues for cloud customers monitoring the multi-cloud storage systems due to cloud storage log files might not record unauthenticated and unauthorized requests with unpredictable delivery time.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://aws.amazon.com.

  2. 2.

    https://cloud.google.com.

  3. 3.

    https://azure.microsoft.com.

  4. 4.

    https://aws.amazon.com/cloudwatch/.

  5. 5.

    https://cloud.google.com/logging.

  6. 6.

    https://aws.amazon.com/s3/.

  7. 7.

    https://docs.aws.amazon.com/AmazonS3/latest/dev/ShareObjectPreSignedURL.html.

  8. 8.

    https://aws.amazon.com/cloudtrail/.

  9. 9.

    https://cloud.google.com/storage.

  10. 10.

    https://cloud.google.com/storage/docs/access-control/signed-urls.

  11. 11.

    https://cloud.google.com/pubsub/.

  12. 12.

    https://cloud.google.com/bigquery/.

  13. 13.

    https://azure.microsoft.com/en-us/services/storage/.

  14. 14.

    https://docs.microsoft.com/en-us/azure/storage/common/storage-sas-overview.

  15. 15.

    https://azure.microsoft.com/en-us/services/monitor/.

  16. 16.

    https://azure.microsoft.com/en-us/services/event-hubs/.

  17. 17.

    https://aws.amazon.com/config/.

References

  1. De Marco, L., Ferrucci, F., Kechadi, T.: Slafm: A service level agreements formal model for cloud computing. In: The 5th International Conference on Cloud Computing and Service Science (CLOSER 2015), Lisbon, Portugal, 20–22 May 2015 (2015)

    Google Scholar 

  2. Devarajan, A.A., SudalaiMuthu, T.: Cloud storage monitoring system analyzing through file access pattern. In: 2019 International Conference on Computational Intelligence in Data Science (ICCIDS), pp. 1–6. IEEE (2019)

    Google Scholar 

  3. Garion, S., Kolodner, H., Adir, A., Aharoni, E., Greenberg, L.: Big data analysis of cloud storage logs using spark. In: Proceedings of the 10th ACM International Systems and Storage Conference, p. 1 (2017)

    Google Scholar 

  4. Huang, W., Ganjali, A., Kim, B.H., Oh, S., Lie, D.: The state of public infrastructure-as-a-service cloud security. ACM Comput. Surv. (CSUR) 47(4), 1–31 (2015)

    Article  Google Scholar 

  5. Khan, S., Gani, A., Wahab, A.W.A., Bagiwa, M.A., Shiraz, M., Khan, S.U., Buyya, R., Zomaya, A.Y.: Cloud log forensics: foundations, state of the art, and future directions. ACM Comput. Surv. (CSUR) 49(1), 1–42 (2016)

    Article  Google Scholar 

  6. Nachiappan, R., Javadi, B., Calheiros, R.N., Matawie, K.M.: Cloud storage reliability for big data applications: a state of the art survey. J. Netw. Comput. Appl. 97, 35–47 (2017)

    Article  Google Scholar 

  7. Pichan, A., Lazarescu, M., Soh, S.T.: Cloud forensics: technical challenges, solutions and comparative analysis. Digit. Invest. 13, 38–57 (2015)

    Article  Google Scholar 

  8. Rafique, A., Van Landuyt, D., Reniers, V., Joosen, W.: Towards an adaptive middleware for efficient multi-cloud data storage. In: Proceedings of the 4th Workshop on CrossCloud Infrastructures & Platforms, pp. 1–6 (2017)

    Google Scholar 

  9. Amazon Web Services: Amazon s3 server access logging (2020). https://docs.aws.amazon.com/AmazonS3/latest/dev/ServerLogs.html. Accessed 09 Jun 2020

  10. Amazon Web Services: logging amazon s3 API calls using aws cloudtrail (2020). https://docs.aws.amazon.com/AmazonS3/latest/dev/cloudtrail-logging.html. Accessed 18 Jun 2020

  11. Amazon Web Services: shared responsibility model (2020). https://aws.amazon.com/compliance/shared-responsibility-model/. Accessed 19 Nov 2020

  12. Google Cloud Platform: access logs & storage logs (2020). https://cloud.google.com/storage/docs/access-logs. Accessed 05 Jun 2020

  13. Google Cloud Platform: cloud audit logs with cloud storage (2020). https://cloud.google.com/storage/docs/audit-logs. Accessed 23 Jun 2020

  14. Microsoft Azure: Azure storage analytics logging|microsoft docs (2020). https://docs.microsoft.com/en-us/azure/storage/common/storage-analytics-logging?tabs=dotnet. Accessed 09 Jun 2020

  15. Microsoft Azure: create diagnostic settings to send platform logs and metrics to different destinations (2020). https://docs.microsoft.com/en-us/azure/azure-monitor/platform/diagnostic-settings. Accessed 18 Sep 2020

  16. Sukmana, M.I., Torkura, K.A., Graupner, H., Cheng, F., Meinel, C.: Unified cloud access control model for cloud storage broker. In: 2019 International Conference on Information Networking (ICOIN), pp. 60–65. IEEE (2019)

    Google Scholar 

  17. Sukmana, M.I., Torkura, K.A., Prasetyo, S.D., Cheng, F., Meinel, C.: A brokerage approach for secure multi-cloud storage resource management. In: 16th EAI International Conference on Security and Privacy in Communication Networks (SecureComm) 2020. Springer (2020)

    Google Scholar 

  18. Syed, H.J., Gani, A., Ahmad, R.W., Khan, M.K., Ahmed, A.I.A.: Cloud monitoring: a review, taxonomy, and open research issues. J. Netw. Comput. Appl. 98, 11–26 (2017)

    Article  Google Scholar 

  19. Thales: 2019 global cloud security study (2019). https://cpl.thalesgroup.com/cloud-security-research. Accessed 19 Oct 2020

  20. Torkura, K.A., Sukmana, M.I.H., Cheng, F., Meinel, C.: Slingshot - automated threat detection and incident response in multi cloud storage systems. In: 2019 IEEE 18th International Symposium on Network Computing and Applications (NCA), pp. 1–5 (2019). https://doi.org/10.1109/NCA.2019.8935040

  21. Torkura, K.A., Sukmana, M.I.H., Meinig, M., Kayem, A.V.D.M., Cheng, F., Graupner, H., Meinel, C.: Securing cloud storage brokerage systems through threat models. In: 2018 IEEE 32nd International Conference on Advanced Information Networking and Applications (AINA), pp. 759–768 (2018). https://doi.org/10.1109/AINA.2018.00114

  22. Wang, C., Ren, K., Lou, W., Li, J.: Toward publicly auditable secure cloud data storage services. IEEE Netw. 24(4), 19–24 (2010)

    Article  Google Scholar 

  23. Yu, X., Joshi, P., Xu, J., Jin, G., Zhang, H., Jiang, G.: Cloudseer: workflow monitoring of cloud infrastructures via interleaved logs. ACM SIGARCH Comput. Archit. News 44(2), 489–502 (2016)

    Article  Google Scholar 

Download references

Acknowledgment

We would like to thank Bundesdruckerei GmbH for the support for this paper.

Author information

Authors and Affiliations

  1. Hasso Plattner Institute, University of Potsdam, Potsdam, Germany

    Muhammad I. H. Sukmana, Justus Cöster, Wenzel Puenter, Kennedy A. Torkura, Feng Cheng & Christoph Meinel

Authors
  1. Muhammad I. H. Sukmana
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Justus Cöster
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wenzel Puenter
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kennedy A. Torkura
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Feng Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Christoph Meinel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Muhammad I. H. Sukmana .

Editor information

Editors and Affiliations

  1. Department of Information and Communication Engineering, Fukuoka Institute of Technology, Fukuoka, Japan

    Leonard Barolli

  2. Department of Computer Science, Ryerson University, Toronto, ON, Canada

    Isaac Woungang

  3. Faculty of Business Administration, Rissho University, Tokyo, Japan

    Tomoya Enokido

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sukmana, M.I.H., Cöster, J., Puenter, W., Torkura, K.A., Cheng, F., Meinel, C. (2021). A Feasibility Study of Log-Based Monitoring for Multi-cloud Storage Systems. In: Barolli, L., Woungang, I., Enokido, T. (eds) Advanced Information Networking and Applications. AINA 2021. Lecture Notes in Networks and Systems, vol 226. Springer, Cham. https://doi.org/10.1007/978-3-030-75075-6_37

Download citation

Publish with us

Policies and ethics

Search

Navigation