Abstract
We propose a multivariate multiple orthogonal linear regression (MMOLR) model. The MMOLR model expresses the relationship between two sets of dependent variables and independent variables. It is possible to use the MMOLR as a step to be followed by multivariate linear regression to compare and investigate the relationships between dependent variables, which are still limited in the multivariate linear regression model. The MMOLR takes into account the advantages of the errors-in-variables model, that is, total least squares, and thereby, examines the errors of all independent and dependent variables. Consequently, the assumptions of the model are easy to satisfy in practice. Moreover, in the context of total least squares, we reveal the relationship between the MMOLR and the canonical regression model.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
McArdle, B.H., Anderson, M.J.: Fitting multivariate models to community data: a comment on distance based redundancy analysis. Ecology 82, 290–297 (2001)
Elo, S., Kyng, H.: The qualitative content analysis process. J. Adv. Nurs. 62, 107–115 (2008)
Bartlett, M.S.: An inverse matrix adjustment arising in discriminant analysis. Ann. Math. Stat. 22, 107–111 (1951)
Tatsuoka, M.M., Lohnes, P.R.: Multivariate Analysis: Techniques for Educational and Psychological Research. Macmillan Publishing Co, Inc., New York (1988)
Lutz, J.G., Eckert, T.L.: The relationship between canonical correlation analysis and multivariate multiple regression. Educ. Psychol. Meas. 54, 666–675 (1994)
Dattalo, P.: Analysis of Multiple Dependent Variables. Oxford University Press, New York (2013)
Wold, H.: Path models with latent variables: the NIPALS approach. In: Quantitative Sociology, pp 307–357. Elsevier (1975)
Rohlf, F.J., Corti, M.: Use of two-block partial least-squares to study covariation in shape. Syst. Biol. 49, 740–753 (2000)
Wold, S., Ruhe, A., Wold, H., Dunn III, W.J.: The collinearity problem in linear regression. The partial least squares (PLS) approach to generalized inverses. SIAM J. Sci. Stat. Comput. 5, 735–743 (1984)
Breiman, L., Friedman, J.H.: Predicting multivariate responses in multiple linear regression. J. Roy. Stat. Soc. Ser. B (Stat. Methodol.) 59, 3–54 (1997)
Yuan, M., Ekici, A., Lu, Z., Monteiro, R.: Dimension reduction and coefficient estimation in multivariate linear regression. J. Roy. Stat. Soc. Ser. B (Stat. Methodol.) 69, 329–346 (2007)
Reinsel, G.C., Velu, R.P.: Multivariate linear regression. In: Multivariate Reduced-Rank Regression, pp 1–14. Springer (1998)
Harrell Jr., F.E.: Regression Modeling Strategies: With Applications to Linear Models, Logistic and Ordinal Regression, and Survival Analysis. Springer, Cham (2015)
Everitt, B.S., Dunn, G.: Applied Multivariate Data Analysis, vol. 2. Wiley Online Library, Chichester (2001)
Velu, R., Reinsel, G.C.: Multivariate Reduced-Rank Regression: Theory and Applications, vol. 136. Springer Science and Business Media, Heidelberg (2013)
Berkson, J.: Are there two regressions? J. Am. Stat. Assoc. 45, 164–180 (1950)
Durbin, J.: Errors in variables. Revue de l’institut International de Statistique 22, 23–32 (1954)
Zamar, R.H.: Robust estimation in the errors-in-variables model. Biometrika 76, 149–160 (1989)
Maronna, R.: Principal components and orthogonal regression based on robust scales. Technometrics 47, 264–273 (2005)
Golub, G.H., Reinsch, C.: Singular value decomposition and least squares solutions. Numerische Mathematik 14, 403–420 (1970)
Brown, M.L.: Robust line estimation with errors in both variables. J. Am. Stat. Assoc. 77, 71–79 (1982)
Golub, G.H., Van Loan, C.F.: An analysis of the total least squares problem. SIAM J. Numer. Anal. 17, 883–893 (1980)
Wang, J., et al.: Package “robust” (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
An Duong, T.B., Tsuchida, J., Yadohisa, H. (2019). Multivariate Multiple Orthogonal Linear Regression. In: Czarnowski, I., Howlett, R., Jain, L., Vlacic, L. (eds) Intelligent Decision Technologies 2018. KES-IDT 2018 2018. Smart Innovation, Systems and Technologies, vol 97. Springer, Cham. https://doi.org/10.1007/978-3-319-92028-3_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-92028-3_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-92027-6
Online ISBN: 978-3-319-92028-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)