On remedying the presence of heteroscedasticity in a multiple linear regression modelling

  • Authors

    2024-11-07
    https://doi.org/10.14419/6a5aqn19
  • Multiple Linear Regression Analysis; Correlation Analysis; Heteroscedasticity; Autocorrelation; Multicollinearity; Remedying.

  • Abstract

    This study demonstrated the very essence of remedying the presence of heteroscedasticity, where it existed, in regression modelling. Two different hypothetical data, Data A (the Original) and Data B (the Original), were used in this study for the purpose of illustration. The normality, multicollinearity and autocorrelation assumptions were satisfied, but the Breusch-Pagan test and the White test established the existence of heteroscedasticity in the two datasets. The estimated multiple linear regression model for Data A (the Original) was statistically significant with an R-square value of 0.976, an AIC value of 332.5929, and an SBC value of 347.2533; and the one for Data B (the Original) was also statistically significant with an R-square value of 0.553, an AIC value of 69.89669, and an SBC value of 82.15499. The Log-transformation was applied on the variables in Data A (the Original) and Data B (the Original) to give rise to new sets of data, Data A (Now with Heteroscedasticity Remedied) and Data B (Now with Heteroscedasticity Remedied); which equally satisfied the normality, multicollinearity and autocorrelation assumptions, and also satisfied that there were no existence of heteroscedasticity in the two datasets. Now, the estimated multiple linear regression model for Data A (Now with Heteroscedasticity Remedied) was statistically significant with an R-square value of 0.986, an AIC value of -135.021, and an SBC value of -120.361; and the estimated model for Data B (Now with Heteroscedasticity Remedied) was statistically significant with an R-square value of 0.624, an AIC value of -32.0801, and an SBC value of -19.8218. From the points of view of the values of the R-square (0.986>0.976 and 0.624>0.553), AIC (-135.021<332.5929 and -32.0801<69.89669) and SBC (-120.361<347.2533 and -19.8218<82.15499), it was evident that the estimated regression models for Data A (Now with Heteroscedasticity Remedied) and Data B (Now with Heteroscedasticity Remedied) were, respectively, better models when compared to the regression models for Data A (the Original) and Data B (the Original).

  • References

    1. A. Adepoju and P. O. Tayo. Regression Methods in the Presence of Heteroscedasticity and Outliers. Academia Journal of Scientific Re-search, 5(12): (2017); 776-783.
    2. O. L. O. Astivia and B. D. Zumbo. Heteroskedasticity in Multiple Regression Analysis: What it is, How to Detect it and How to Solve it with Applications in R and SPSS. Practical Assessment, Research and Evaluation, 24(1) (2019). Available online: http://pareonline.net/getvn.asp?v=24&n=1
    3. Cohen, P., West, S. G. and Aiken, L. S. (2007). Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences. Mahwah, NJ: Erlbaum.
    4. A. Field. Discovering Statistics Using SPSS (3rd ed.). Sage, London, UK, (2009).
    5. J. Fox. Applied Regression Analysis, Linear Models and Related Methods. Sage, London, UK, (1997).
    6. M.O. Gidigbi and M. Donga. Domestic, Foreign Direct Investment and Economic Growth Nexus in Selected African Countries. AU-DOE, 17(5): (2021); 142-157.
    7. D. Gujarati. Basic Econometrics (4th ed.). Mcgraw-Hill, New York, U.S.A, (2004).
    8. J. F. Hair, R. E. Anderson, R. L. Tatham and W. C. Black. Multivariate Data Analysis, (3rd ed.). Macmillian, New York, U.S.A, (1995).
    9. A. F. Hayes and L. Cai. Using Heteroskedasticity-Consistent Standard Error Estimators in OLS Regression: An Introduction and Soft-ware Implementation. Behaviour Research Methods, 39: (2007); 709-722. https://doi.org/10.3758/BF03192961.
    10. K. Jablońska. Dealing with Heteroskedasticity within the Modelling of the Quality of Life of Older People. Statistics in Transition New Series, 19(3): (2018); 433-452. https://doi.org/10.21307/stattrans-2018-024.
    11. A. Koutsoyiannis. Theory of Econometrics (7th ed.). Macmillian, London, United Kingdom, (1977). https://doi.org/10.1007/978-1-349-09546-9.
    12. M. H. Kutner, C. J. Nacthtsheim, J. Neter and Li Williams. Applied Linear Statistical Models (5th ed.). Mcgraw-Hill/Irwin, New York, U.S.A, (2005).
    13. M. T. Nwakuya and J. C. Nwabueze. Application of Box-Cox Transformation as a Corrective Measure to Heteroscedaticity Using an Economic Data. African Journal of Mathematics and Statistics, 8(1): (2018); 8-12.
    14. S. C. Nwankwo. Econometrics: A Practical Approach. Eldemak, Enugu, Nigeria, (2011).
    15. E. U. Ohaegbulem and V. C. Iheaka. The Impact of Macroeconomic Factors on Nigerian-Naira Exchange Rate Fluctuations (1981-2021). Asian Journal of Probability and Statistics (AJPAS), 26(2): (2024); 18-36. https://doi.org/10.9734/ajpas/2024/v26i2589.
    16. J. O. Rawlings, S. G. Pantula and A. D. Dickey. Applied Regression Analysis: A Research Tool (2nd ed.). Springer-Verlag, New York, U.S.A, (1998). https://doi.org/10.1007/b98890.
    17. M. A. Stephens. The Anderson-Darling Statistic. (1979). https://www.google.com.ng/url?sa=source=web&rct=j&url=http://www.dtic.mil/dtic/tr/fulltext/u2/a079807.pdf&ved=2ahUKEwih5nKt9HeAhXKMewKHeavA_MQFJAAegQLABAB&usg=AOvVaw3S-jPcRbLcJ9_Ovd7H8ONG
    18. F. Williams. Heteroskedasticity. https://www3.nd.edu/~rwilliam/ (2020)
    19. W. Yoo, M. Robert, B. Sejong, S. Karan, P. H. Qinghua and W. L. J. James. A Study of Effects of Multicollinearity in the Multivariable Analysis. International Journal Applied Science Technology (IJAST), 4(5): (2014) 9-19.
    20. Q. M. Zhou, P. Z. K. Song and M. E. Thompson. Profiling Heteroscedasticity in Linear Regression Models. The Canadian Journal of Statistics, 43(3): (2017); 358-377. https://doi.org/10.1002/cjs.11252.

  • Downloads