Secure and Modular Data Portal: Database System to Manage Broadly Classified and Large Scale Data

Atnafu Abrham Lencha; Addisalem Bitew Mitiku; Abel Tadesse Woldemichael

doi:10.5334/dsj-2024-020

Abstract

Using various types of broadly classified and large-scale datasets, Ethiopian Construction Design and Supervision Works Corporation (ECDSWC) provides professional services such as engineering studies and design. Storing, managing and sharing dataset within the workgroups and research teams is not an easy task because ECDSWC has not yet implemented database system. To resolve the issues related to data management, this study implements Secured and modular data portal using REST API principle. The data portal is used to manage a wide variety of datasets such as spatial data and its attributes, metadata and other serialized documents that support the business operations of ECDSWC. On the top of data management strategies, the Security in Depth (SiD) mechanism is developed by implementing Unified Identity Authentication Service, which provides multilayered security. The applicability of data portal is demonstrated using datasets obtained from ECDSWC. Furthermore, the accuracy, integrity and privacy of data is evaluated, and system performance is tested through the experiment.

References

Afsari, K, Eastman, CM, and Lacouture, CD 2017. JavaScript Object Notation (JSON) data serialization for IFC schema in web-based BIM data exchange. Automation in Construction International Journal, 77: 24–51. DOI: 10.1016/j.autcon.2017.01.011
Open DOI Search in Google Scholar Back to article
Albaraka, M and Bahasoon, R 2018. Prioritizing technical debt in database normalization using portfolio theory and data quality metrics. In: Int. Conference on Technical Debt (TechDebt ‘18), Association for Computing Machinery (ACM). pp. 31–40. DOI: 10.1145/3194164.3194170
Open DOI Search in Google Scholar Back to article
Amugongo, L, et al. 2016. Open data portal – A technical enabler to drive innovation in Namibia. In: 2nd Int. Conf. on Open and Big Data (OBD), Vienna, Austria. pp. 80–86. DOI: 10.1109/OBD.2016.19
Open DOI Search in Google Scholar Back to article
Asrese, AS, et al. 2016 A tool for automated web performance measurement. IEEE Globecom Workshops (GC Wkshps), Washington, USA. pp. 1–6. DOI: 10.1109/GLOCOMW.2016.7849082
Open DOI Search in Google Scholar Back to article
Batra, D and Davis, JG 1992. Conceptual data modelling in database design: Similarities and differences between expert and novice designers. Int. Journal of Man-Machine Studies, 37(1): 83–101. DOI: 10.1016/0020-7373(92)90092-Y
Open DOI Search in Google Scholar Back to article
Bauermeister, S, et al. 2020. The Dementias Platform UK (DPUK) Data Portal. European Journal of Epidemiology, 35: 601–611.
Search in Google Scholar Back to article
Breunig, M, et al. 2020. Geospatial data management research: Progress and future directions. ISPRS International Journal of Geo-Information, 9(2): 95. DOI: 10.3390/ijgi9020095
Open DOI Search in Google Scholar Back to article
Colley, D and Stanier, C 2017. Identifying new directions in database performance tuning. Procedia Computer Science, 121: 260–265. DOI: 10.1016/j.procs.2017.11.036
Open DOI Search in Google Scholar Back to article
Daquino, M, et al. 2022. Creating RESTful APIs over SPARQL endpoints using RAMOSE. Semantic Web, 13(2): 195–213. DOI: 10.3233/SW-210439
Open DOI Search in Google Scholar Back to article
Divac, D, et al. 2009. Hydro-information systems and management of hydropower resources in Serbia. Journal of the Serbian Society for Computational Mechanics, 3(1): 1–37.
Search in Google Scholar Back to article
Fong, JS and Yan, KW T 2021 Data normalization. Information systems reengineering, integration and normalization. Springer. pp. 343–376. DOI: 10.1007/978-3-030-79584-9_8
Open DOI Search in Google Scholar Back to article
Halili, F and Ramadani, E 2018. Web services: A comparison of soap and rest services. Modern Applied Science, 12(3): 175. DOI: 10.5539/mas.v12n3p175
Open DOI Search in Google Scholar Back to article
Islam, M, et al. 2020. Coding practices and recommendations of spring security for enterprise applications. In: 2020 Conference of IEEE Secure Development. pp. 49–57. DOI: 10.1109/SecDev45635.2020.00024
Open DOI Search in Google Scholar Back to article
Ji, Y, et al. 2019. Multi-thread concurrent compression algorithm for genomic big data. In: Int. Conf. on Parallel & Distributed Compute. pp. 475–478. DOI: 10.1109/PDCAT46702.2019.00093
Open DOI Search in Google Scholar Back to article
Kamatkar, SJ, Kamble, A, et al. 2018. Database performance Tuning and query optimization. Data Mining and Big Data, Lecture Notes in Computer Science, 10943: 3–11. DOI: 10.1007/978-3-319-93803-5_1
Open DOI Search in Google Scholar Back to article
Kumari, S and Rath, SK 2015. Performance comparison of SOAP and REST based web services for enterprise application integration. In: Int. Conference on Advances in Computing, Communications and Informatics (ICACCI), India. pp. 1656–1660. DOI: 10.1109/ICACCI.2015.7275851
Open DOI Search in Google Scholar Back to article
Lawi, A, et al. 2021. Evaluating GraphQL and REST API services performance in a massive and intensive accessible information system. Computers, 10(11): 138. DOI: 10.3390/computers10110138
Open DOI Search in Google Scholar Back to article
Li, L, Chou, W, Zhou, W, and Luo, M 2016. Design patterns and extensibility of REST API for networking applications. IEEE Transactions on Network and Service Management, 13(1): 154–167. DOI: 10.1109/TNSM.2016.2516946
Open DOI Search in Google Scholar Back to article
Li, M and Luo, N 2009. Data sharing between web applications based on the request of user. In: 2009 ISECS Int. Colloquium on Computing, Communication, Control, and Management, Sanya, China. pp. 280–282, DOI: 10.1109/CCCM.2009.5268058
Open DOI Search in Google Scholar Back to article
Lnenicka, M and Nikiforova, A 2021. Transparency-by-design: What is the role of open data portals. Telematics and Informatics, 61(101605): 0736–5853. DOI: 10.1016/j.tele.2021.101605
Open DOI Search in Google Scholar Back to article
Mancini, R, et al. 2022. Efficient massively parallel join optimization for large queries. In: SIGMOD 22 Proceedings of the 2022 Int. Conference on Management of Data, ACM. pp. 122–135. DOI: 10.1145/3514221.3517871
Open DOI Search in Google Scholar Back to article
McGovern, J, Tyagi, S, Stevens, M, and Matthew, S 2003 Java web services architecture. 1st Edition. Morgan Kaufmann. DOI: 10.1016/B978-155860900-6/50003-8
Open DOI Search in Google Scholar Back to article
Mitiku AB, et al. 2020. The need for integrated flood management approach from social, economic and environmental perspectives: The case of Upper Awash River Basin. International Journal of Water Resources and Environmental Engineering, Academic Journals, 12(3): 57–70.
Search in Google Scholar Back to article
Myalapalli, VK, et al. 2015. Augmenting database performance via SQL tuning. In: 2015 Int. Conference on Energy Systems and Applications, Pune, India. pp. 13–18. DOI: 10.1109/ICESA.2015.7503305
Open DOI Search in Google Scholar Back to article
Nguyen, Q and Baker, O 2019. Applying spring security framework and OAuth2 to protect micro service architecture API. Journal of Software, 14(6): 257–264. DOI: 10.17706/jsw.14.6.257-264
Open DOI Search in Google Scholar Back to article
Pandey, AK, et al. 2020. Key issues in healthcare data integrity: Analysis and recommendations. IEEE Access, 8: 40612–40628. DOI: 10.1109/ACCESS.2020.2976687
Open DOI Search in Google Scholar Back to article
Pereira, J, et al. 2022. A platform for integrating heterogeneous data and developing smart city applications. Future Generation Computer Systems, 128: 552–566. DOI: 10.1016/j.future.2021.10.030
Open DOI Search in Google Scholar Back to article
Qu, W, et al. 2019. Hybrid indexes by exploring traditional B-tree and linear regression. In: Int. Conference on Web Information Systems and Applications. pp. 601–613. DOI: 10.1007/978-3-030-30952-7_61
Open DOI Search in Google Scholar Back to article
Ramachandran, GS, et al. 2018. Towards a decentralized data marketplace for smart cities. In: IEEE Int. Smart Cities Conference (ISC2), Kansas City, MO, USA. pp. 1–8. DOI: 10.1109/ISC2.2018.8656952
Open DOI Search in Google Scholar Back to article
Schönherr, M, et al. 2011. Multi-thread implementations of the lattice Boltzmann method on non-uniform grids for CPUs and GPUs. Computers and Mathematics with Applications, 61: 3730–3743. DOI: 10.1016/j.camwa.2011.04.012
Open DOI Search in Google Scholar Back to article
Schönig, H-J 2019 Mastering PostgreSQL 12. 3rd Edition. Packt.
Search in Google Scholar Back to article
Sherman, R 2015 Foundational data modelling. Business intelligence guidebook, Morgan Kaufmann. pp. 173–195. DOI: 10.1016/B978-0-12-411461-6.00008-3
Open DOI Search in Google Scholar Back to article
Sobol, G, Kagan, A, and Shimura, H 1996. Performance criteria for relational databases in different normal forms. Journal of Systems and Software, 34: 31–42. DOI: 10.1016/0164-1212(95)00062-3
Open DOI Search in Google Scholar Back to article
Sultana, S and Dixit, S 2017. Indexes in PostgreSQL. In: Int. Conf. on Innovative Mechanisms for Industry Applications (ICIMIA), Bengaluru, India. pp. 512–515. DOI: 10.1109/ICIMIA.2017.7975511
Open DOI Search in Google Scholar Back to article
Wang, H and Gong, C 2016. Design and implementation of unified identity authentication service based on AD. In: 2016 8th Int. Conference on Computational Intelligence and Communication Networks (CICN), Tehri, India. pp. 394–398. DOI: 10.1109/CICN.2016.84
Open DOI Search in Google Scholar Back to article
West, M 2011 Some types and uses of data models. Developing high quality data models, R. Adams and D. Bevans, (eds.), USA: Morgan Kaufmann. Available: ScienceDirect. DOI: 10.1016/C2009-0-30508-5
Open DOI Search in Google Scholar Back to article
Wu, J, Orlandi, F, et al. 2022. Link climate: An interoperable knowledge graph platform for climate data. Computers & Geosciences, 169(105215). DOI: 10.1016/j.cageo.2022.105215
Open DOI Search in Google Scholar Back to article
Wu, Z, Huang, W and Yu, L 2014. Design and implementation of unified identity authentication system Based on LDAP in Digital Campus. Advanced Materials Research. pp. 1213–1217, DOI: 10.4028/www.scientific.net/AMR.912-914.1213
Open DOI Search in Google Scholar Back to article
Wu, Z, et al. 2020. An ontology-based framework for heterogeneous data management and its application for urban flood disasters. Earth Sci Informatics, 13: 377–390. DOI: 10.1007/s12145-019-00439-3
Open DOI Search in Google Scholar Back to article
Yahui, Y 2012. Impact data-exchange based on XML. In: 7th Int. Conference on Computer Science & Education (ICCSE), Melbourne, Australia. pp. 1147–1149, DOI: 10.1109/ICCSE.2012.6295268
Open DOI Search in Google Scholar Back to article
Zioti, F, et al. 2022. A platform for land use and land cover data integration and trajectory analysis. International Journal of Applied Earth Observations and Geo Information, 106(102655): 1569–8432. DOI: 10.1016/j.jag.2021.102655
Open DOI Search in Google Scholar Back to article
Züfle, A, et al. 2020. Managing uncertainty in evolving geo-spatial data. In: 21st IEEE Int. Conference on Mobile Data Management (MDM). pp. 5–8. DOI: 10.1109/MDM48529.2020.00021
Open DOI Search in Google Scholar Back to article

Secure and Modular Data Portal: Database System to Manage Broadly Classified and Large Scale Data

Abstract

Paradigm

My account