Abstract
One of the most critical stages of big data analysis is data preparation, the result of which is a processed and structured dataset in tabular form. This paper discusses the first stage of forming a dataset to be analyzed—the design of the database. For this purpose, we analyzed modern database management systems (Oracle Database, Microsoft SQL Server, PostgreSQL) and chose one of them to solve a specific problem—creating a database of offenses in the field of illegal passenger transportation recorded in Moscow by volunteers of the Center for Prevention of Crime and Delinquency. Additionally, the paper indicates the main stages of database design and identifies the main areas of further work: (1) creating and scoping the designed database in PostgreSQL, (2) development of data processing scripts, and (3) their further analysis using big data technologies.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bartunov O (2019) Professional Postgres. Proceedings of PG conference on Russia-2019: international conference for PostgreSQL developers and users, Lomonosov Moscow State University, Moscow, Russia. Retrieved from https://pgconf.ru/en/2019/248739. Accessed 5 Dec 2020
Government of Moscow and ANO CPCD (2016) Agreement on the organization of interaction between the Government of Moscow and the Autonomous Non-Profit Organization “Center for Prevention of Crimes and Offenses” in the field of transport (June 8, 2016). Bull Mayor Govern Moscow 34:29–31. Retrieved from http://www.vestnik.mos.ru/files/pdf/2016/06june/34.pdf
Novikov BA, Gorshkova EA (2019) Fundamentals of database technology. In: Rogova EV (ed). DMK Press, Moscow, Russia
Perlin VA (2015) PostgreSQL: I. SQL basics. Computer Training Center “Specialist” at Bauman Moscow State Technical University, Moscow, Russia. Retrieved from https://www.specialist.ru/course/pgsql1?src=anons. Accessed 5 Dec 2020
Zymbler ML (2014) What methods and technologies are used to process big data. Supercomputers 1(17):20–23
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zhilyaeva, I.A., Suvorov, S.V., Tsarkova, N.I., Perekatova, A.D. (2022). Application of Big Data to Analyze Illegal Passenger Transportation Offenses. In: Bogoviz, A.V., Suglobov, A.E., Maloletko, A.N., Kaurova, O.V. (eds) Сooperation and Sustainable Development. Lecture Notes in Networks and Systems, vol 245. Springer, Cham. https://doi.org/10.1007/978-3-030-77000-6_1
Download citation
DOI: https://doi.org/10.1007/978-3-030-77000-6_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-76999-4
Online ISBN: 978-3-030-77000-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)