An Evaluation Instrument (Q-U) for Measuring the usability of Business Intelligence Application

  • Authors

    • Ayad Hameed Mousa
    • Heba Adnan Raheem
    • Nibras Talib Mohammed
    2018-11-27
    https://doi.org/10.14419/ijet.v7i4.19.28008
  • BI Application, Usability, Software Usability, BI Usability, Pilot Study.

  • The main purpose of Business Intelligence (BI) applications is to focus on supporting organizations' strategic, operational and tactical decisions by providing comprehensive, accurate and vivid data to the decision makers. Usability testing is an important part of software development. It focuses on how well users can understand and utilize a product/software in fulfilling their intended goals. In the software development, most software tends to be complex. Hence, the way to ensure that such software will satisfy users will be done by measuring the usability of such software. Due to using many data integration techniques in developing BI application, thus, the different software have different instruments to measure the usability of BI software. In this paper, the new instrument (Q-U) for measuring BI software was developed. A systematic approach was adopted which suggested by many researchers in developing the intended Q-U instrument.The literature has been reviewed in a systematic manner to elicitation Q-U instrument attributes. Multi-methods were used in validating Q-U instrument such as face validity, a pilot study for testing the goodness of   Q-U consistency, and factor analysis. Multi-methods were used in validating Q-U instrument such as face validity, a pilot study for testing the goodness of   Q-U consistency, and factor analysis as well as Bartlett’s test for measuring the reliability of Q_U. The finding obtained indicates the workability of Q_U in measuring the usability OF BI applications. Ultimately, Q_U was used in measuring BI application in two different sectors.

     

     

  • References

    1. [1] W. F. Cody, J. T. Kreulen, V. Krishna, and W. S. Spangler, "The integration of business intelligence and knowledge management," IBM systems journal, vol. 41, pp. 697-713, 2002.

      [2] M. Castellanos, A. Simitsis, K. Wilkinson, and U. Dayal, "Automating the loading of business process data warehouses," in Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology, 2009, pp. 612-623.

      [3] R. Kimball, M. Ross, W. Thorthwaite, B. Becker, and J. Mundy, The data warehouse lifecycle toolkit: John Wiley & Sons, 2008.

      [4] R. Kimball and M. Ross, The data warehouse toolkit: the complete guide to dimensional modeling: John Wiley & Sons, 2011.

      [5] A. H. Mousa, N. Shiratuddin, and M. S. A. Bakar, "RGMDV: An approach to requirements gathering and the management of data virtualization projects," in INNOVATION AND ANALYTICS CONFERENCE AND EXHIBITION (IACE 2015): Proceedings of the 2nd Innovation and Analytics Conference & Exhibition, 2015, p. 030024.

      [6] A. H. Mousa, N. Shiratuddin, and M. S. A. Bakar, "Process Oriented Data Virtualization Design Model for Business Processes Evaluation (PODVDM) Research in Progress," Jurnal Teknologi, vol. 72, 2015.

      [7] A. H. Mousa, N. Shiratuddin, and M. S. A. Bakar, "Evaluation Framework for Business Process Evaluation Approaches," evaluation, vol. 18, p. 29, 2014.

      [8] A. H. Mousa, N. Shiratuddin, and M. S. A. Bakar, "Virtual Data Mart for Measuring Organizational Achievement Using Data Virtualization Technique (KPIVDM)," Jurnal Teknologi, vol. 68, 2014.

      [9] A. H. Mousa and N. Shiratuddin, "Data Warehouse and Data Virtualization Comparative Study," in Developments of E-Systems Engineering (DeSE), 2015 International Conference on, 2015, pp. 369-372.

      [10] H. N. Khraibet, A. H. Mousa, A. Bakar, and M. Shahbani, "Intelligent Iraqi Health System (IIHS) using Online Analytical Process (OLAP) model," 2013.

      [11] T. Clemmensen, M. Hertzum, K. Hornbæk, Q. Shi, and P. Yammiyavar, "Cultural cognition in usability evaluation," Interacting with computers, vol. 21, pp. 212-220, 2009.

      [12] [12] O. Frandsen-Thorlacius, K. Hornbæk, M. Hertzum, and T. Clemmensen, "Non-universal usability?: a survey of how usability is understood by Chinese and Danish users," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2009, pp. 41-50.

      [13] R. Benbunan-Fich, "Using protocol analysis to evaluate the usability of a commercial web site," Information & management, vol. 39, pp. 151-163, 2001.

      [14] J. Nielsen, "Guerrilla HCI: Using discount usability engineering to penetrate the intimidation barrier," Cost-justifying usability, pp. 245-272, 1994.

      [15] N. Bevan and M. Macleod, "Usability measurement in context," Behaviour & information technology, vol. 13, pp. 132-145, 1994.

      [16] M. Z. Elbashir, P. A. Collier, and M. J. Davern, "Measuring the effects of business intelligence systems: The relationship between business process and organizational performance," International Journal of Accounting Information Systems, vol. 9, pp. 135-153, 2008.

      [17] A. Lönnqvist and V. Pirttimäki, "The measurement of business intelligence," Information Systems Management, vol. 23, p. 32, 2006.

      [18] G. Ellis and A. Dix, "An explorative analysis of user evaluation studies in information visualisation," in Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization, 2006, pp. 1-7.

      [19] R. Van der Lans, Data Virtualization for Business Intelligence Systems: Revolutionizing Data Integration for Data Warehouses, 2012.

      [20] A. H. Mousa, "DATA VIRTUALIZATION DESIGN MODEL FOR NEAR REA TIME DECISION MAKING IN BUSINESS INTELLIGENCE ENVIRONMENT," PhD PhD Thesis, Computer Science Department, Universiti Utara Malaysia, Malaysia, 2017.

      [21] C. M. Barnum and S. Dragga, Usability testing and research: Allyn & Bacon, Inc., 2001.

      [22] A. M. Ariffin, "Conceptual design of reality learning media (RLM) model based on entertaining and fun constructs," Universiti Utara Malaysia, 2009.

      [23] S. Siti Mahfuzah, "Conceptual Design Model of Computerized Personal-Decision AID (ComPDA)," Universiti Utara Malaysia, 2011.

      [24] U. Sekaran and R. Bougie, Research methods for business: A skill building approach: John Wiley & Sons, 2016.

      [25] P.-Y. Yen and S. Bakken, "Review of health information technology usability study methodologies," Journal of the American Medical Informatics Association, vol. 19, pp. 413-422, 2012.

      [26] S. Ssemugabi and R. De Villiers, "A comparative study of two usability evaluation methods using a web-based e-learning application," in Proceedings of the 2007 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countries, 2007, pp. 132-142.

      [27] J. Nielsen, "How many test users in a usability study," Nielsen Norman Group, vol. 4, 2012.

      [28] A. F. Newell, A. Carmichael, M. Morgan, and A. Dickinson, "The use of theatre in requirements gathering and usability studies," Interacting with computers, vol. 18, pp. 996-1011, 2006.

      [29] M. Mantel, "A basic framework for cost-justifying usability engineering," Cost-justifying usability, p. 9, 1994.

      [30] H. X. Lin, Y.-Y. Choong, and G. Salvendy, "A proposed index of usability: a method for comparing the relative usability of different software systems," Behaviour & information technology, vol. 16, pp. 267-277, 1997.

      [31] J. D. Gould and C. Lewis, "Designing for usability: key principles and what designers think," Communications of the ACM, vol. 28, pp. 300-311, 1985.

      [32] W. Albert and T. Tullis, Measuring the user experience: collecting, analyzing, and presenting usability metrics: Newnes, 2013.

      [33] W. Maneesriwongul and J. K. Dixon, "Instrument translation process: a methods review," Journal of advanced nursing, vol. 48, pp. 175-186, 2004.

      [34] D. V. Cicchetti, D. Shoinralter, and P. J. Tyrer, "The effect of number of rating scale categories on levels of interrater reliability: A Monte Carlo investigation," Applied Psychological Measurement, vol. 9, pp. 31-36, 1985.

      [35] K. H. Esbensen, D. Guyot, F. Westad, and L. P. Houmoller, Multivariate data analysis: in practice: an introduction to multivariate data analysis and experimental design: Multivariate Data Analysis, 2002.

      [36] J. F. Hair, W. C. Black, B. J. Babin, R. E. Anderson, and R. L. Tatham, Multivariate data analysis vol. 5: Prentice hall Upper Saddle River, NJ, 1998.

      [37] R. A. Cummins and E. Gullone, "Why we should not use 5-point Likert scales: The case for subjective quality of life measurement," in Proceedings, second international conference on quality of life in cities, 2000, pp. 74-93.


      [38]

  • Downloads

  • How to Cite

    Hameed Mousa, A., Adnan Raheem, H., & Talib Mohammed, N. (2018). An Evaluation Instrument (Q-U) for Measuring the usability of Business Intelligence Application. International Journal of Engineering & Technology, 7(4.19), 849-852. https://doi.org/10.14419/ijet.v7i4.19.28008