A review on data transformation approaches for data migration processes from relational database to NoSQL database

  • Authors

    • Norwini Zaidi
    • Iskandar Ishak
    • Fatimah Sidi
    • Lilly Suriani Affendey
    https://doi.org/10.14419/ijet.v7i4.21598

  • Abstract

    In recent years, data migration has become an important exercise in data management due to the demand of scalable database management systems. Data transformation is an important part of data migration and researchers have put a lot of effort to produce better data transformation approaches. Based on the literatures, there are multiple ways of conducting data transformation between relation databases to NoSQL databases. However, among the issues in data transformation between the two databases are slow processing time and no definitive guideline for database administrator to guide them to conduct the transformation. This paper highlights the data transformation approaches that have been proposed by researchers in recent years as well as its strengths and limitations.

  • References

    1. [1] J. R. Lourenço, B. Cabral, P. Carreiro, M. Vieira, and J. Bernardino, “Choosing the right NoSQL database for the job: a quality attribute evaluation,†J. Big Data, vol. 2, no. 1, p. 18, 2015. https://doi.org/10.1186/s40537-015-0025-0.

      [2] L. Rocha, F. Vale, E. Cirilo, D. Barbosa, and F. Mourão, “AFramework for Migrating Relational Datasets to NoSQL1,†Procedia Comput. Sci., vol. 51, pp. 2593–2602, 2015. https://doi.org/10.1016/j.procs.2015.05.367.

      [3] N. Ntarmos, I. Patlakas, and P. Triantafillou, “Rank join queries in NoSQL databases,†Proc. VLDB Endow., vol. 7, no. March, pp. 493–504, 2014.

      [4] G. Zhao, Q. Lin, L. Li, and Z. Li, “Schema conversion model of SQL database to NoSQL,†in Proceedings - 2014 9th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 3PGCIC 2014, 2014, pp. 355–362.

      [5] S. Ataky, T. Mpinda, L. G. Maschietto, and P. A. Bungama, “From Relational Database to Column-Oriented NoSQL Database : Migration Process,†Int. J. Eng. Res. Technol., vol. 4, no. 5, pp. 399–403, 2015.

      [6] A. K. Zaki, “NoSQL Databases: New Millennium Database for Big Data, Big Users, Cloud Computing and its Security Challenges,†IJRET Int. J. Res. Eng. Technol., pp. 403–409, 2014.

      [7] T. Jia, X. Zhao, Z. Wang, D. Gong, and G. Ding, “Model transformation and data migration from relational database to MongoDB,†Proc. - 2016 IEEE Int. Congr. Big Data, BigData Congr.2016, pp. 60–67, 2016.

      [8] A. Abdullah and Q. Zhuge, “From Relational Databases to NoSQL Databases : Performance Evaluation,†Res. J. Appl. Sci. Eng. Technol., vol. 11, no. 4, pp. 434–439, 2015. https://doi.org/10.19026/rjaset.11.1799.

      [9] S. Sharma, U. S. Tim, J. Wong, S. Gadia, and S. Sharma, “A brief review on leading big data models,†Data Sci. J., vol. 13, no. December, pp. 138–157, 2014. https://doi.org/10.2481/dsj.14-041.

      [10] R. Arora and R. R. Aggarwal, “An Algorithm for Transformation of Data from MySQL to NoSQL (MongoDB),†Int. J. Adv. Stud. Comput. Sci. Eng., vol. 2, no. 1, pp. 6–12, 2013.

      [11] J. Ahmed and R. Gulmeher, “NOSQL Databases: New Trend of Databases, Emerging Reasons, Classification and Security Issues,†Int. J. Eng. Sci. Res. Technol., vol. 9655, no. 6, p. 1, 2015.

      [12] O. Hajoui, R. Dehbi, M. Talea, and Z. I. Batouta, “An advanced comparative study of the most promising NoSQL and NewSQL databases with a multi-criteria analysis method,†J. Theor. Appl. Inf. Technol., vol. 81, no. 3, pp. 579–588, 2015.

      [13] V. Abramova, J. Bernardino, and P. Furtado, “Experimental Evaluation of Nosql Databases,†Int. J. Database Manag. Syst. Vol.6, No.3, June 2014, vol. 6, no. 3, pp. 1–16, 2014.

      [14] A. P. R. Sharma and A. P. Y. Kashyap, “A study of nosql databases and working overviews,†Int. J. Recent Trens Eng. Res., pp. 43–50, 2016.

      [15] S. S. Pore and S. B. Pawar, “Comparative Study of SQL & NoSQL Databases,†Int. J. Adv. Res. Comput. Eng. Technol., vol. 4, no. 5, pp. 1747–1753, 2015.

      [16] M. V, “Comparative Study of Nosql Document, Column Store Databases and Evaluation of Cassandra,†Int. J. Database Manag. Syst. (IJDMS) Vol.6, No.4, August 2014, vol. 3, no. 5, pp. 29–39, 2013.

      [17] O. B. Mohamad Hanine, Andesadik Bendarag, “Data Migration Methodology from Relational to NoSQL Databases,†Int. J. Comput. Electr. Autom. Control Inf. Eng., vol. 9, no. 12, pp. 2511–2515, 2015.

      [18] T. Odia, S. Misra, and A. Adewumi, “Evaluation of hadoop/mapreduce framework migration tools,†Asia-Pacific World Congr. Comput. Sci. Eng. APWC CSE 2014, pp. 1–8, 2014.

      [19] P. Badlani, “NoSQL in Action-A New Pathway to Database,†Int. J. Sci. Res., vol. 5, no. 6, pp. 872–877, 2016.

      [20] S. H. A. El-Sappagh, A. M. A. Hendawi, and A. H. ElBastawissy, “A proposed model for data warehouse ETL processes,†J. King Saud Univ. - Comput. Inf. Sci., vol. 23, no. 2, pp. 91–104, 2011.

      [21] A. B. M. Moniruzzaman and S. A. Hossain, “Nosql database: New era of databases for big data analytics-classification, characteristics and comparison,†arXiv Prepr. arXiv1307.0191, vol. 6, no. 4, pp. 1–14, 2013.

      [22] G. Karnitis and G. Arnicans, “Migration of Relational Database to Document-Oriented Database: Structure Denormalization and Data Transformation,†Proc. - 7th Int. Conf. Comput. IntellCommun. Syst. Networks, CICSyN 2015, pp. 113–118, 2015.

      [23] C. H. Lee and Y. L. Zheng, “SQL-To-NoSQL Schema Denormalization and Migration: A Study on Content Management Systems,†Proc. - 2015 IEEE Int. Conf. Syst. Man, Cybern. SMC 2015, pp. 2022–2026, 2015.

      [24] N. Kuderu and V. Kumari, “Relational Database to NoSQL Conversion by Schema Migration and Mapping,†Int. J. Comput. Eng. Res. Trends, vol. 3, no. 9, pp. 506–513, 2016.

      [25] G. A. Schreiner, D. Duarte, and R. dos Santos Mello, “SQLtoKeyNoSQL: A Layer for Relational to Key-based NoSQL Database Mapping,†Proc. 17th Int. Conf. Inf. Integr. Web-based Appl. Serv., p. 74:1--74:9, 2015.

      [26] P. Nikam, T. Patil, G. Hungund, A. Pagar, A. Talegaonkar, and M. S. Pawar, “Migrate and Map : A Framework to Access Data from Mysql Mongodb or Hbase Using Mysql Queries,†IOSR J. Comput. Eng., vol. 18, no. 3, pp. 13–17, 2016.

      [27] C. H. Lee and Y. L. Zheng, “Automatic SQL-to-NoSQL schema transformation over the MySQL and HBase databases,†2015 IEEE Int. Conf. Consum. Electron. - Taiwan, ICCE-TW 2015, pp. 426–427, 2015.

      [28] C. Li, “Transforming Relational Database into HBase : A Case Study,†IEEE Int. Conf. Softw. Eng. Serv. Sci. ICSESS 2010, pp. 683–687, 2010.

      [29] K. Ma and F. Dong, “Live data migration approach from relational tables to schema-free collections with MapReduce,†Int. J. Serv. Technol. Manag., vol. 21, no. 4–6, pp. 318–335, 2015 https://doi.org/10.1504/IJSTM.2015.073942.

      [30] K. Ma and B. Yang, “Live Data Replication Approach from Relational Tables to Schema-Free Collections Using Stream Processing Framework,†Proc. - 2015 10th Int. Conf. P2P, Parallel, Grid, Cloud Internet Comput. 3PGCIC 2015, pp. 26–31, 2015.

  • Downloads

  • How to Cite

    Zaidi, N., Ishak, I., Sidi, F., & Affendey, L. S. (2018). A review on data transformation approaches for data migration processes from relational database to NoSQL database. International Journal of Engineering & Technology, 7(4), 3335-3339. https://doi.org/10.14419/ijet.v7i4.21598

    Received date: 2018-11-25

    Accepted date: 2018-11-25