Developing a System for Big Data Discovery

  • Authors

    • Sakhr Saleh
    • Fathy Eassa
    • Kamal Jambi
    2019-03-01
    https://doi.org/10.14419/ijet.v8i1.11.28087
  • Big Data, Metadata, Knowledge Discovery, Mobile agent.

  • Abstract

    In this research, we developed a system for collecting metadata of existing Big Data in an enterprise or organization. All collected metadata are stored in metadata storage. The collected Meta Data help in managing the existing Big Data. Also, in this research, we developed a technique for discovering simple knowledge from existing Big Data (Twitter & websites) and extracted the correlation between different Big Data. Since Big Data are distributed across a large number of remote machines, we used a mobile agent technology to build our system for reducing the discovery time. The mobile agent migrate to the remote machine for discovering the required data and in consequence reduce the transportation time.

     

  • References

    1. [1] Press, "A Very Short History of Big Data," [Online]. Available: http://www.forbes.com/sites/gilpress/2013/05/09/a-very-short-history-of-big-data

      [2] M. Cox and D. Ellsworth, "Managing Big Data for Scientific Visualization," ACM, October 1997

      [3] H. Umar, F. Eassa, K. Jambi and M. Abulkhair, “Big Data Knowledge Miningâ€, International Journal of Advanced Computer Science and Applications 7(11), November 2016.

      [4] H. Umar, Big Data Knowledge Mining, Thesis for a Master Degree of Computer Science, FCIT, KAU, Jeddah, Saudi Arabia, Dec. 2016.

      [5] G. Vemuganti, "Metadata Management in Big Data," Infosys labs Briefings, VOL 11 NO 1, 2013

      [6] S. L. Pallickara, S. Pallickara, M. Zupanski and S. Sullivan, "Efficient Metadata Generation to Enable Interactive Data Discovery over Large-scale Scientific Data Collections," 2nd IEEE International Conference on Cloud Computing Technology and Science, 2009.

      [7] Oracle, "Big Data and Natural Language: Extracting Insight From Text," September 2012. [Online]. Available: http://www.oracle.com/ocom/groups/public/@otn/documents/webconte nt/1863164.pdf. [Accessed 22 04 2015].

      [8] S. Tedmori, T. W. Jackson and D. Bouchlagem, "Optimising the Email Knowledge Extraction System to Support Knowledge Work," ECIS, pp. 681-691. University of St. Gallen, 2007.

      [9] B. Klein, X. Laiseca, D. Casado-Mansilla, D. Lopez-de-Ipina and A. P. Nespral, "Detection and Extracting of Emergency Knowledge from Twitter Streams," UCAmI 2012, LNCS 7656, p. 462–469, 2012.

      [10] F. E. Eassa, H. Al-Barhamtoshy, A. Almenbri, O. H. Younis and K. Jambi, "An Architecture for Metadata Extractor of Big Data in Cloud Systems," International Journal of Scientific & Engineering Research, Volume 5, Issue 1, January 2014.

      [11] H. M. Al-Barhamtoshy and F. E. Eassa, "A Data Analytic Framework for Unstructured Text," Life Science Journal, pp. 339-350, 2014;11(10).

      [12] Karandikar, Clustering short status messages: A topic model based approach, University of Maryland, 2010.

  • Downloads

  • How to Cite

    Saleh, S., Eassa, F., & Jambi, K. (2019). Developing a System for Big Data Discovery. International Journal of Engineering & Technology, 8(1.11), 40-46. https://doi.org/10.14419/ijet.v8i1.11.28087

    Received date: 2019-03-01

    Accepted date: 2019-03-01

    Published date: 2019-03-01