Multiple Regression: Methodology and Applications

Authors

  • Yiming Sun
  • Xinyuan Wang
  • Chi Zhang
  • Mingkai Zuo

DOI:

https://doi.org/10.54097/hset.v49i.8611

Keywords:

Multiple linear regression, Multivariate multiple linear regression, Multinomial logistic regression, Multivariate non-linear regression.

Abstract

Multiple regression is one of the most significant forms of regression and has a wide range of applications. The study of the implementation of multiple regression analysis in different settings contributes to the development of relevant theories and the improvement of models. In this paper, four different kinds of regressions are discussed individually by referring to different articles. The four kinds of regressions discussed are multivariable/multiple linear regression, multivariate multiple linear regression, multinomial logistic regression, and multivariate non-linear regression. As for multivariable/multiple linear regression, examples in the manufacturing industry and medical field show that it can be applied in more fields. Multivariate multiple linear regression is more accurate than multivariable/multiple linear regression and can be used with more than a variable. Multinomial logistic regression is relatively mature and accurate, and can help people well solve the problem with non-linearity and multiple independent variables. It does not require the variables to obey a multivariate normal distribution, and is more widely used as well. Multivariate non-linear regression, however, cannot be used properly without powerful professional knowledge. This paper investigates the theoretical development and model applications of multiple regression to demonstrate the flexibility and broadness of the adoption of multiple regression analysis.

Downloads

Download data is not yet available.

References

A. Bakst, A modification of the computation of the multiple correlation and regression coefficients by the Tolley and Ezekiel method, in: Journal of Educational Psychology - J EDUC PSYCHOL, vol. 22, ResearchGate, 1931, pp. 629 – 35. DOI: https://doi.org/10.1037/h0075404.

M. S. Bartlett, Further aspects of the theory of multiple regression, in: Mathematical Proceedings of the Cambridge Philosophical Society, vol. 34, 1938, pp. 33 – 40. DOI: https://doi.org/10.1017/S0305004100019897.

J. D. Elashoff, F. N. Kerlinger, E. J. Pedhazur, Multiple Regression in Behavioral Research, in: Journal of the American Statistical Association, vol. 70, 1975, p. 959. DOI: https://doi.org/10.2307/2285468.

R. Mac Nally, Multiple regression and inference in ecology and conservation biology: further comments on identifying important predictor variables, in: Biodiversity & Conservation, vol. 11, Springer Link, 2002, pp. 1397 – 401. DOI: https://doi.org/10.1023/A:1016250716679.

A. E. Maxwell, Limitations on the use of the multiple linear regression model, in: British Journal of Mathematical and Statistical Psychology, vol. 28, 1975, pp. 51 – 62. DOI: https://doi.org/10.1111/j.2044-8317.1975.tb00547.x.

D. W. Hosmer, S. Lemesbow, Goodness of fit tests for the multiple logistic regression model, in: Communications in Statistics - Theory and Methods, vol. 9, 1980, pp. 1043 – 69. DOI: https://doi.org/10.1080/03610928008827941.

V. D. Tsou alas, N. G. Fragiadakis, Prediction of Occupational Risk in the Shipbuilding Industry Using Multivariable Linear Regression and Genetic Algorithm Analysis, in: Safety Science, vol. 83, ScienceDirect, 2016, pp. 12 – 22. DOI: https://doi.org/10.1016/j.ssci.2015.11.010.

S. Iqbal, S. Gupta, E. Venkatarao, Stress, anxiety & depression among medical undergraduate students & their socio-demographic correlates, in: The Indian Journal of Medical Research, vol. 141, 2015, pp. 354 – 57.

N. M. Punjabi, J. D. Sorkin, L. I. Katzel, A. P. Goldberg, A. R. Schwartz, P. L. Smith, Sleep-disordered Breathing and Insulin Resistance in Middle-aged and Overweight Men, in: American Journal of Respiratory and Critical Care Medicine, vol. 165, 2002, pp. 677 – 82. DOI: https://doi.org/10.1164/ajrccm.165.5.2104087.

L. Breiman, J. H. Friedman, Predicting Multivariate Responses in Multiple Linear Regression, in: Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol. 59, Wiley Online Library, 1997, pp. 3–54. https://doi.org/10.1111/1467 - 9868.00054.

B. P. Tabaei, W. H. Herman, A Multivariate Logistic Regression Equation to Screen for Diabetes, in: DIABETES CARE, vol. 25, 2002, p. 5.

A. R. Mokhtari, Hydrothermal alteration mapping through multivariate logistic regression analysis of lithogeochemical data, in: Journal of Geochemical Exploration, vol. 145, ScienceDirect, 2014, pp. 207–12. DOI: https://doi.org/10.1016/j.gexplo.2014.06.008.

A. M. El-Habil, An Application on Multinomial Logistic Regression Model, in: Pakistan Journal of Statistics and Operation Research, vol. 8, 2012, pp. 271 – 91. DOI: https://doi.org/10.18187/pjsor.v8i2.234.

D. Hedeker, Multilevel Models for Ordinal and Nominal Variables, in: Handbook of Multilevel Analysis, edited by Jan de Leeuw and Erik Meijer, Springer, 2008, pp. 237 – 74. DOI: https://doi.org/10.1007/978-0-387-73186-5_6.

O. Ovaskainen, J. Hottola, J. Siitonen, Modeling species co-occurrence by multivariate logistic regression generates new hypotheses on fungal interactions, in: Ecology, vol. 91, Wiley Online Library, 2010, pp. 2514 – 21. DOI: https://doi.org/10.1890/10 - 0173.1.

C. C. Frangos, C. C. Frangos, L. Sotiropoulos, Problematic Internet Use among Greek University Students: An Ordinal Logistic Regression with Risk Factors of Negative Psychological Beliefs, Pornographic Sites, and Online Games, in: Cyberpsychology Behavior & Social Networking, vol. 14, Baidu Scholar, 2011, p. 51. DOI: https://doi.org/10.1089/cyber.2009.0306.

V. R. M. Lo Verso, A. Pellegrino, and F. Pellerey, A multivariate non-linear regression model to predict the energy demand for lighting in rooms with different architectural features and lighting control systems, in: Energy and Buildings, vol. 76, 2014, pp. 151 – 63. DOI: https://doi.org/10.1016/j.enbuild.2014.02.063.

Downloads

Published

21-05-2023

How to Cite

Sun, Y., Wang, X., Zhang, C., & Zuo, M. (2023). Multiple Regression: Methodology and Applications. Highlights in Science, Engineering and Technology, 49, 542-548. https://doi.org/10.54097/hset.v49i.8611