Abstract
With dramatically increase of emerging applications such as social media, sensors, videos and digital pictures data is become generating from everywhere. Due to characteristic of big data it becomes very difficult to manage, analysis, store, transport, and process the data using the existing traditional techniques. This paper introduces several Big Data, technologies and methods. First, we introduce the Big Data and its problem, important of Big Data, technologies and methods of Big Data management, and analyzed includes the Distributed File System, NOSQL Database, Hadoop/MapReduce. Next, we present the Big Data model; and discuss the Big Data security challenges. Finally, we present the future work and the conclusion.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ji, C., Li, Y., Qiu, W., Awada, U., Li, K.: BigData processing in cloud computing environments. In: International Symposium on Pervasive Systems, Algorithms and Networks (2012)
Patel, A.B., Birla, M., Nair, U.: Addressing big data problem using hadoop and map reduce. In: NIRMA University International Conference on Engineering (2012)
Kaisler, S., Armour, F., Espinosa, J.A., Money, W.: Big data: issues and challenges moving forward. In: Hawaii International Conference on System Sciences. https://doi.org/10.1109/hicss.2013.645 (2012)
Ji, C., Li, Y., Qiu, W., Awada, U., Li, K.: Big data processing in cloud computing environments. In: International Symposium on Pervasive Systems, Algorithms and Networks (2012)
UzZaman, N.: Survey on google file system. In: Survey Paper for CSC 456 (Operating Systems), University of Roch (2007)
Ghemawat, S., Gobioff, H., Leung, S.-T.: The google file system, ACM 1-58113-757-5/03/0010. Bolton Landing, New York, USA (2003)
Gudivada, V.N., Rao, D., Raghavan, V.V.: NoSQL systems for big data management. In: IEEE 10th World Congress on Services, 978-1-4799-5069-0/14 (2014)
Zhang, Q., Chen, Z., Lv, A., Zhao, L., Liu, F., Zou, J.: A universal storage architecture for big data in cloud environment. In: IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, 978-0-7695-5046-6/13 (2013)
Nandimath, J., Patil, A., Banerjee, E., Kakade, P., Vaidya, S.: Big data analysis using apache hadoop. In: IEEE San Francisco, California, USA, 978-1-4799-1050-2/13(2013)
Dean, J., Ghemawat, S.: MapReduce: Simplified Data Processing on Large Clusters, Google, Inc
Pal, A., Agrawal, P., Jain, K., Agrawal, S.: A performance analysis of mapreduce task with large number of files datasetin big data using hadoop. In: Fourth International Conference on Communication Systems and Network Technologies, 978-1-4799-3070-8/14 (2014)
Kong, W.c., Wu, Q., Li, L., Qiao, F.: Intelligent data analysis and its challenges in big data environment. In: IEEE International Conference on System Science and Engineering (ICSSE), 978-1-4799-4367-8/14 (2014)
Kim, S.-H., Kim, N.-U., Chung, T.-M.: Attribute Relationship Evaluation Methodology for Big Data Security, 978-1-4799-2845-3/13/$31.00, IEEE (2013)
Acknowledgements
Appreciation conveyed to Ministry of Higher Education Malaysia for project financing under Exploratory Research Grant Scheme RDU120608; and University Malaysia Pahang under UMP Short Term Grant RDU1403163.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Adam, K., Fakharaldien, M.A.I., Zain, J.M., Majid, M.A., Noraziah, A. (2019). BigData: Issues, Challenges, Technologies and Methods. In: Abawajy, J., Othman, M., Ghazali, R., Deris, M., Mahdin, H., Herawan, T. (eds) Proceedings of the International Conference on Data Engineering 2015 (DaEng-2015) . Lecture Notes in Electrical Engineering, vol 520. Springer, Singapore. https://doi.org/10.1007/978-981-13-1799-6_56
Download citation
DOI: https://doi.org/10.1007/978-981-13-1799-6_56
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-1797-2
Online ISBN: 978-981-13-1799-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)