Abstract
In today’s world, companies not only compete on products or services but also on how they can analyze and mine data in order to gain insights for competitive advantages and long term growth. With the exponential growth of data, companies now face unprecedented challenges, however are also presented with numerous opportunities for competitive growth. Advancement in data capturing devices and the existence of multi-generation systems in organizations have increased the number of data sources. Typically, data generated from different devices may not be compatible with each other, which calls for data integration. Although, ETL market offers a wide variety of tools for data integration, it is still common for companies to use SQL to manually produce in-house ETL tools. There are technological and managerial challenges to deal with data integration. During data integration, data quality must be embedded in it.
Big data analytics delivers insights which can be used for effective business decisions. However, some of these insights may invade consumer privacy. With more and more data related to consumer behavior being collected and the advancement in big data analytics, privacy has become an increasing concern. Therefore, it is necessary to address issues related to privacy laws, consumer protections and best practices to safeguard privacy. In this chapter, we will discuss topics related to big data in the area of big data integration, big data quality, big data privacy, and big data analytics.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
Birk, S.: Protecting patient medical data. Healthcare Executive 28(5), 20–28 (2013)
Brands, K.: Big Data and Business Intelligence for Management Accountants. Strategic Finance 96(6), 64–65 (2014)
Brand, H.: Big data: adapt or die (2014), https://www.accountancylive.com/big-data-adapt-or-die (accessed June 15, 2014)
Carr, D.F.: Hackers outsmart pacemakers, fitbits: worried yet? InformationWeek (2013), http://www.informationweek.com/healthcare/security-and-privacy/hackers-outsmart-pacemakers-fitbits-worried-yet/d/d-id/1113000?image_number=3 (accessed June 14, 2014)
English, L.P.: Information quality applied: best practices for improving business information, Processes and Systems. Wiley (2009)
Forrester, Is your big data solution production-ready? (2013), http://www.itworld.com/data-center/417766/your-big-data-solution-production-ready (accessed June 15, 2014)
Fulgoni, G.: Big data: friend or foe of digital advertising? Five ways marketers should use digital big data to their advantage. Journal of Advertising Research 53(4), 372–376 (2013)
Gartner report, Magic quadrant for data quality tools (2013), http://www.gartner.com/technology/reprints.do?id=1-1LE6U4H&ct=131008&st=sg (accessed February 26, 2014)
Kim, G.-H., Trimi, S., Chung, J.-H.: Big-data applications in the government sector. Communications of the ACM 57(3), 78–85 (2014)
George, G., Haas, M.R., Pentland, A.: Big data and management. Academy of Management Journal 57(2), 321–326 (2014)
Research Moz, Global data quality tools market is expected to reach a CAGR of 16.78% in 2016 (2013), http://www.prweb.com/releases/2013/11/prweb11352256.htm (accessed February 25, 2014)
Green, C.: Organizations will rapidly ramp up their data services in 2014 (2014), http://blogs.forrester.com/charles_green/14-02-06-organizations_will_rapidly_ramp_up_data_services_spend_in_2014 (accessed February 25, 2014)
Grimes, R.: 5 signs you’ve been hit with an advanced persistent threat (2012), http://www.infoworld.com/d/security/5-signs-youve-been-hit-advanced-persistent-threat-20494 (accessed March 24, 2014)
Hurst, S.: Top 10 security challenges for 2013. SC Magazine (2013)
IBM Corporation. Three guiding principles to improve data security and compliance: A holistic approach to data protection for a complex threat landscape (2012)
Kar, S.: Gartner report: big data will revolutionalize cybersecurity in the next two years. CloudTimes (2014)
Lawson, L.: Eight questions to ask before investing in data quality tools (2014), http://www.itbusinessedge.com/blogs/integration/eight-questions-to-ask-before-investing-in-data-quality-tools.html (accessed February 26, 2014)
McAffee, Needle in a datastack: the rise of big security data (2013), http://www.mcafee.com/us/about/news/2013/q2/20130617-01.aspx (accessed January 15, 2014)
Lev-ram, M.: What’s the next big thing in big data? Bigger data. Fortune 169(8), 233–238 (2014)
Mcknight, W.: Seven sources of poor data quality. Information Management 19(2), 32–33 (2009)
McKinsey Global Institute, Big data: next frontier for innovation, competition, and productivity (2011)
McMillan, M., Cerrato, P.: Healthcare data breaches cost more than you think. InformationWeek Reports (2014)
Nunan, D., Di Domenico, M.: Market research and the ethics of big data. International Journal of Market Research 55(4), 2–13 (2013)
Petter, S., DeLone, W., McLean, E.R.: Information systems success: the quest for the independent variables. Journal of Management Information Systems 29(4), 7–62 (2013)
Russom, P.: Integrating hadoop into business intelligence and datawarehousing. TWDI Research (2013), http://www.cloudera.com/content/dam/cloudera/Resources/PDF/TDWI%20Best%20Practices%20report%20-%20Hadoop%20foro%20BI%20and%20DW%20-%20April%202013.pdf (accessed February 15, 2014)
Schwartz, M.J.: 7 Top Information security trends for 2013. InformationWeek (2012), http://www.darkreading.com/risk-management/7-top-information-security-trends-for-2013/d/d-id/1107955? (accessed January 23, 2014)
Setia, P., Venkatesh, V., Joglekar, S.: Leveraging digital technologies: how informa-tion quality leads to localized capabilities and customer service performance. MIS Quarterly 37(2), 565-A4 (2013)
Smith, R.F., Watson, B.: 3 Big data security analytics techniques you can apply now to catch advanced persistent threats. HP Enterprise Security (2013)
Society of Actuaries, Healthcare decision makers perspectives on big data (2013)
TDWI’s Data Quality Report, http://tdwi.org/research/2002/02/tdwis-data-quality-report.aspx (accessed March 2, 2014)
Verizon. 2013 Data Breach Investigations Report, http://www.verizonenterprise.com/resources/reports/rp_data-breach-investigations-report-2013_en_xg.pdf (accessed March 2, 2014)
Woods, D.: Why data quality matters (2009), http://www.forbes.com/2009/08/31/software-engineers-enterprise-technology-cio-network-data.html (accessed February 25, 2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Zhang, X., Xiang, S. (2015). Data Quality, Analytics, and Privacy in Big Data. In: Hassanien, A., Azar, A., Snasael, V., Kacprzyk, J., Abawajy, J. (eds) Big Data in Complex Systems. Studies in Big Data, vol 9. Springer, Cham. https://doi.org/10.1007/978-3-319-11056-1_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-11056-1_14
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-11055-4
Online ISBN: 978-3-319-11056-1
eBook Packages: EngineeringEngineering (R0)