Analyzing Validity and Reliability of Malaysian Building Surveyor Graduates Competency - Model Survey Instrument using the Rasch Measurement Model

  • Authors

    • Siti Hamidah Husain
    • Haryanti Mohd Affandi
    • Adi Irfan Che-Ani
    • Nurfaradilla Mohamad Nasri
    2018-11-26
    https://doi.org/10.14419/ijet.v7i4.21.21608
  • Non-technical competence, technical competence, building surveyor graduates, Malaysian building surveyor, Rasch measurement model.

  • Abstract

    The competency assessment instrument is a newly developed standard guideline for Malaysian building surveyor graduates in assessing their competency. In developing this competency assessment, researchers used a form of instrument survey in identifying the required competency domains for Malaysian building surveyor graduates. This study was conducted to examine the validity and reliability of the item contained in this competency assessment instrument. The instrument was designed using a 4 Likert scale was employed for data collection process which consists of 48 items with seven constructs representing non-technical competency domains.  Meanwhile, 155 items with 14 constructs representing technical competency domains. A total of 56 building surveyor practitioners participated in this study. The results obtained were analyzed using the Rasch measurement model with a WinSteps version 3.73 to examine the item and person reliability. Additionally, the item measure quality was assessed by analyzing the PTMea Corr, infit and outfit MNSQ and ZSTD values to examine the construct validity. The results showed that the reliability of instrument items was 0.76 and the person reliability index was 0.93 which show that this instrument is reliable and acceptable with a high level of consistency for measuring the competence domains required from building surveyor graduates. While all the PTMEA Corr is in positive values which show that the item can differentiate the ability of the respondent. The final result relieved that out of 203 items, 13 items suggested being eliminated and revealed 190 items that are suitable to measure the 21 constructs in this competency assessment instrument.     

     

  • References

    1. [1] Royal Institution of Chartered Surveyors (RICS), “The Chartered Building Surveyor’s portfolio.†Royal Institution of Chartered Surveyors, United Kingdom, pp. 1–2, 2008.

      [2] A. S. Ali and C. J. Woon, “Training and Development of Building Surveyors in Malaysia,†RICS COBRA, pp. 777–785, 2012.

      [3] A. I. Che-Ani, “The roles and involvement of building surveyors in the Malaysian building industry.†Royal Institution of Surveyors Malaysia (RISM), Malaysia, pp. 1–23, 2013.

      [4] N. Ahzahar, N. A. Kayat, I. B. Zakaria, and S. Z. Hashim, “Women in Building Survey,†Int. Acad. Res. J. Soc. Sci., vol. 1, no. 2, pp. 95–100, 2015.

      [5] R. Heale and A. Twycross, “Validity and reliability in quantitative studies,†Evid Based Nurs, vol. 18, no. 3, pp. 66–67, 2015.

      [6] B. Taylor, G. Sinha, and T. Ghoshal, Research methodology: A guide for researchers in management & social sciences. New Delhi: PHI Learning Private Limited, 2009.

      [7] D. Muijs, Doing Quantitative Research in Education with SPSS, 2nd ed. SAGE, 2011.

      [8] J. W. Creswell, Research Design: Qualitative, Quantitative and Mixed Approaches (3rd Edition). 2009.

      [9] W. J. Boone, “Rasch Analysis for Instrument Development: Why, When, and How?,†Cell Biol. Educ., vol. 15, no. 4, p. rm4-rm4, 2016.

      [10] J. M. Linacre, “Optimizing Rating Scale Category Effectiveness,†J. Appl. Meas., vol. 3, no. 1, pp. 85–106, 2002.

      [11] T. Pelton, “Where Are the Limits To the Rasch Advantage?,†2002.

      [12] Ministry of Education Malaysia (MoE), “Malaysia Education Blueprint 2015-2025 (Higher Education),†Malaysia, 2015.

      [13] Malaysian Qualifications Agency (MQA), “Malaysian Qualifications Framework: Point of reference and joint understanding of higher education qualifications in Malaysia,†Malaysia, 2009.

      [14] B. S. D. RISM, “Draft Cadangan Pindaan Akta Pendaftaran Jurutera 1967,†no. 6. pp. 2012–2013, 2013.

      [15] B. S. D. RISM, “Permohonan Rang Undang-Undang/Akta Juruukur Bangunan (BS).†unpublished, Malaysia, 2011.

      [16] B. S. D. RISM, “Perkembangan Dan Pengiktirafan Jawatan Juruukur Bangunan Di JKR Dan Kepentingan Peranan Juruukur Bangunan.†unpublished, Malaysia, pp. 1–8, 2016.

      [17] Royal Institution of Chartered Surveyors RICS, “Assessment of Professional Competence: Building Surveying,†United Kingdom, 2015.

      [18] Royal Institution of Surveyor Malaysia RISM, “Rules and guide to the test of professional competence for building surveyors.†Royal Institution of Surveyor Malaysia, Malaysia, p. 28, 1995.

      [19] K. K. Tsang, “The use of midpoint on Likert Scale: The implications for educational research,†Hong Kong Teach. Cent. J., vol. 11, pp. 121–130, 2012.

      [20] R. Garland, “The Mid-Point on a Rating Scale: Is it desirable?,†Mark. Bull., vol. 2, no. 3, pp. 66–70, 1991.

      [21] C. Chen, S. Y. Lee, and H. W. Stevenson, “Response style and cross-cultural comparisons of rating scales among East Asian and North American students,†Psychol. Sci., vol. 6, no. 3, pp. 170–175, 1995.

      [22] J. W. Lee, P. S. Jones, Y. Mineyama, and X. E. Zhang, “Cultural Differences in Responses to a Likert Scale,†pp. 295–306, 2002.

      [23] N. K. Malhotra, J. Hall, M. Shaw, and P. Oppenheim, Essentials of Marketing Research: An Applied Orientation, 2nd ed. Pearson Education Australia, 2008.

      [24] R. Ferber and P. J. Verdoorn, Research Methods in Economics and Business, 1st ed. Collier Macmillan Ltd, 1962.

      [25] S. Isaac and W. B. Michael, Handbook in Research and Evaluation: A Collection of Principles, Methods, and Strategies Useful in the Planning, Design, and Evaluation of Studies in Education and the Behavioral Sciences, 3rd ed. EdITS, 1995.

      [26] R. Hill, “What sample size is ‘enough’ in internet survey research?,†An Electron. J. 21st Century, vol. 6, no. 3–4, pp. 1–10, 1998.

      [27] W. P. J. Fisher, “Rating Scale Instrument Quality Criteria,†Trans. Rasch Meas. SIG Am. Educ. Res. Assoc., vol. 21, no. 1, p. 1095, 2007.

      [28] B. D. Wright and M. H. Stone, Measurement Essentials, 2nd ed. Wide Range Inc, 1999.

      [29] G. LoBiondo-Wood and J. Haber, Nursing Research - E-Book: Methods and Critical Appraisal for Evidence-Based Practice, 9th ed. Elsevier Health Sciences, 2017.

      [30] Mohd Rafi Yaacob, PASW (SPSS) Statistics 18: For Business and Social Science Students, 1st ed. Malaysia: Eduserve Resources, 2011.

      [31] M. Miyata, “A Rasch analysis of the ELI listening placement test.,†2007.

      [32] J. M. Linacre, A User’s Guide to WINSTEPS/MINISTEP Rasch-Model Computer Programs (3.91.0). 2006.

      [33] A. A. Aziz, Rasch Model Fundamentals: Scale Construct and Measurement Structure, 1st ed. Advance Planning Sdn Bhd, 2010.

      [34] T. G. Bond and C. M. Fox, Applying the Rasch Model: Fundamental Measurement in the Human Sciences. New Jersey, London: Lawrence Erlbaum Associates, 2007.

      [35] A. A. Aziz, M. S. Masodi, and A. Zaharim, Asas Model Pengukuran Rasch: Pembentukan Skala & Struktur Pengukuran, Cetakan Pe. Malaysia: Universiti Kebangsaan Malaysia, 2013.

  • Downloads

  • How to Cite

    Hamidah Husain, S., Mohd Affandi, H., Irfan Che-Ani, A., & Mohamad Nasri, N. (2018). Analyzing Validity and Reliability of Malaysian Building Surveyor Graduates Competency - Model Survey Instrument using the Rasch Measurement Model. International Journal of Engineering & Technology, 7(4.21), 15-19. https://doi.org/10.14419/ijet.v7i4.21.21608

    Received date: 2018-11-26

    Accepted date: 2018-11-26

    Published date: 2018-11-26