Abstract
Partial least square (pls) methods (also sometimes called projection to latent structures) relate the information present in two data tables that collect measurements on the same set of observations. pls methods proceed by deriving latent variables which are (optimal) linear combinations of the variables of a data table. When the goal is to find the shared information between two tables, the approach is equivalent to a correlation problem and the technique is then called partial least square correlation (PLSC) (also sometimes called pls-SVD). In this case there are two sets of latent variables (one set per table), and these latent variables are required to have maximal covariance. When the goal is to predict one data table the other one, the technique is then called partial least square regression. In this case there is one set of latent variables (derived from the predictor table) and these latent variables are required to give the best possible prediction. In this paper we present and illustrate PLSC and PLSR and show how these descriptive multivariate analysis techniques can be extended to deal with inferential questions by using cross-validation techniques such as the bootstrap and permutation tests.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Abdi H (2001) Linear algebra for neural networks. In: Smelser N, Baltes P (eds) International encyclopedia of the social and behavioral sciences. Elsevier, Oxford UK
Abdi H (2007a) Eigen-decomposition: eigenvalues and eigenvectors. In: Salkind N (ed) Encyclopedia of measurement and statistics. Sage, Thousand Oaks, CA
Abdi H (2007) Singular value decomposition (SVD) and generalized singular value decomposition (GSVD). In: Salkind N (ed) Encyclopedia of measurement and statistics. Sage, Thousand Oaks, CA
Abdi H (2010) Partial least square regression, projection on latent structure regression, pls-regression. Wiley Interdiscipl Rev Comput Stat 2:97–106
Abdi H, Dunlop JP, Williams LJ (2009) How to compute reliability estimates and display confidence and tolerance intervals for pattern classifiers using the Bootstrap and 3-way multidimensional scaling (DISTATIS). NeuroImage 45:89–95
Abdi H, Edelman B, Valentin D, Dowling WJ (2009b) Experimental design and analysis for psychology. Oxford University Press, Oxford
Abdi H, Valentin D (2007a) Multiple factor analysis (MFA). In: Salkind N (ed) Encyclopedia of measurement and statistics. Sage, Thousand Oaks, CA
Abdi H, Valentin D (2007b) STATIS. In: Salkind N (ed) Encyclopedia of measurement and statistics. Sage, Thousand Oaks, CA
Abdi H, Valentin D, O’Toole AJ, Edelman B (2005) DISTATIS: the analysis of multiple distance matrices. In: Proceedings of the IEEE computer society: international conference on computer vision and pattern recognition pp 42–47
Abdi H, Williams LJ (2010a) Barycentric discriminant analysis. In: Salkind N (ed) Encyclopedia of research design. Sage, Thousand Oaks, CA
Abdi H, Williams LJ (2010b) The jackknife. In: Salkind N (ed) Encyclopedia of research design. Sage, Thousand Oaks, CA
Abdi H, Williams LJ (2010c) Matrix algebra. In: Salkind N (ed) Encyclopedia of research design. Sage, Thousand Oaks, CA
Abdi H, Williams LJ (2010d) Principal components analysis. Wiley Interdiscipl Rev Comput Stat 2:433–459
Bookstein F (1982) The geometric meaning of soft modeling with some generalizations. In: Jöreskog K, Wold H (eds) System under indirect observation, vol 2. North-Holland, Amsterdam.
Bookstein FL (1994) Partial least squares: a dose-response model for measurement in the behavioral and brain sciences. Psycoloquy 5
Boulesteix AL, Strimmer K (2006) Partial least squares: a versatile tool for the analysis of high-dimensional genomic data. Briefing in Bioinformatics 8:32–44
Burnham A, Viveros R, MacGregor J (1996) Frameworks for latent variable multivariate regression. J Chemometr 10:31–45
Chessel D, Hanafi M (1996) Analyse de la co-inertie de k nuages de points. Revue de Statistique Appliquée 44:35–60
de Jong S (1993) SIMPLS: an alternative approach to partial least squares regression. Chemometr Intell Lab Syst 18:251–263
de Jong S, Phatak A (1997) Partial least squares regression. In: Proceedings of the second international workshop on recent advances in total least squares techniques and error-in-variables modeling. Society for Industrial and Applied Mathematics
de Leeuw J (2007) Derivatives of generalized eigen-systems with applications. Department of Statistics Papers, 1–28
Dray S, Chessel D, Thioulouse J (2003) Co-inertia analysis and the linking of ecological data tables. Ecology 84:3078–3089
Efron B, Tibshirani RJ (1986) Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Stat Sci 1:54–77
Efron B, Tibshirani RJ (1993) An introduction to the bootstrap. Chapman & Hall, New York
Escofier B, Pagès J (1990) Multiple factor analysis. Comput Stat Data Anal 18:120–140
Esposito-Vinzi V, Chin WW, Henseler J, Wang H (eds) (2010) Handbook of partial least squares: concepts, methods and applications. Springer, New York.
Gidskehaug L, Stødkilde-Jørgensen H, Martens M, Martens H (2004) Bridge-pls regression: two-block bilinear regression without deflation. J Chemometr 18:208–215
Gittins R (1985) Canonical analysis. Springer, New York
Good P (2005) Permutation, parametric and bootstrap tests of hypotheses. Springer, New York
Greenacre M (1984) Theory and applications of correspondence analysis. Academic, London
Krishnan A, Williams LJ, McIntosh AR, Abdi H (2011) Partial least squares (pls) methods for neuroimaging: a tutorial and review. NeuroImage 56:455–475
Lebart L, Piron M, Morineau A (2007) Statistiques exploratoires multidimensionelle. Dunod, Paris
Mardia KV, Kent JT, Bibby JM (1979) Multivariate analysis. Academic, London
Martens H, Martens M (2001) Multivariate analysis of quality: an introduction. Wiley, London
Martens H, Naes T (1989) Multivariate calibration. Wiley, London
Mazerolles G, Hanafi M, Dufour E, Bertrand D, Qannari ME (2006) Common components and specific weights analysis: a chemometric method for dealing with complexity of food products. Chemometr Intell Lab Syst 81:41–49
McCloskey DN, Ziliak J (2008) The cult of statistical significance: how the standard error costs us jobs, justice, and lives. University of Michigan Press, Michigan
McIntosh AR, Gonzalez-Lima F (1991) Structural modeling of functional neural pathways mapped with 2-deoxyglucose: effects of acoustic startle habituation on the auditory system. Brain Res 547:295–302
McIntosh AR, Lobaugh NJ (2004) Partial least squares analysis of neuroimaging data: applications and advances. NeuroImage 23:S250–S263
McIntosh AR, Chau W, Protzner A (2004) Spatiotemporal analysis of event-related fMRI data using partial least squares. NeuroImage 23:764–775
McIntosh AR, Bookstein F, Haxby J, Grady C (1996) Spatial pattern analysis of functional brain images using partial least squares. NeuroImage 3:143–157
McIntosh AR, Nyberg L, Bookstein FL, Tulving E (1997) Differential functional connectivity of prefrontal and medial temporal cortices during episodic memory retrieval. Hum Brain Mapp 5:323–327
Mevik B-H, Wehrens R (2007) The pls package: principal component and partial least squares regression in R. J Stat Software 18:1–24
Rao C (1964) The use and interpretation of principal component analysis in applied research. Sankhya 26:329–359
Stone M, Brooks RJ (1990) Continuum regression: cross-validated sequentially constructed prediction embracing ordinary least squares, partial least squares and principal components regression. J Roy Stat Soc B 52:237–269
Streissguth A, Bookstein F, Sampson P, Barr H (1993) Methods of latent variable modeling by partial least squares. In: The enduring effects of prenatal alcohol exposure on child development. University of Michigan Press
Takane Y (2002) Relationships among various kinds of eigenvalue and singular value decompositions. In: Yanai H, Okada A, Shigemasu K, Kano Y, Meulman J (eds) New developments in psychometrics. Springer, Tokyo
Tenenhaus M (1998) La regression pls. Technip, Paris
Tenenhaus M, Tenenhaus A (in press) Regularized generalized canonical correlation analysis. Psychometrika
Thioulouse J, Simier M, Chessel D (2003) Simultaneous analysis of a sequence of paired ecological tables. Ecology 20:2197–2208
Tucker L (1958) An inter-battery method of factor analysis. Psychometrika 23:111–136
Tyler DE (1982) On the optimality of the simultaneous redundancy transformations. Psychometrika 47:77–86
van den Wollenberg A (1977) Redundancy analysis: an alternative to canonical correlation. Psychometrika 42:207–219
Williams LJ, Abdi H, French R, Orange JB (2010) A tutorial on Multi-Block Discriminant Correspondence Analysis (MUDICA): a new method for analyzing discourse data from clinical populations. J Speech Lang Hear Res 53:1372–1393
Wold H (1966) Estimation of principal component and related methods by iterative least squares. In: Krishnaiah PR (ed) Multivariate analysis. Academic Press, New York
Wold H (1973) Nonlinear Iterative Partial Least Squares (NIPALS) modeling: some current developments. In: Krishnaiah PR (ed) Multivariate analysis. Academic Press, New York
Wold H (1982) Soft modelling, the basic design and some extensions. In: Wold H, Jöreskog K-G (eds) Systems under indirect observation: causality-structure-prediction, Part II. North-Holland, Amsterdam
Wold S (1995) pls for multivariate linear modelling. In: van de Waterbeenl H (ed) QSAR: chemometric methods in molecular design, methods and principles in medicinal chemistry, vol 2. Verla Chemie, Weinheim Germany
Wold S, Sjöström M, Eriksson L (2001) pls-regression: a basic tool of chemometrics. Chemometr Intell Lab Syst 58:109–130
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media, LLC
About this protocol
Cite this protocol
Abdi, H., Williams, L.J. (2013). Partial Least Squares Methods: Partial Least Squares Correlation and Partial Least Square Regression. In: Reisfeld, B., Mayeno, A. (eds) Computational Toxicology. Methods in Molecular Biology, vol 930. Humana Press, Totowa, NJ. https://doi.org/10.1007/978-1-62703-059-5_23
Download citation
DOI: https://doi.org/10.1007/978-1-62703-059-5_23
Published:
Publisher Name: Humana Press, Totowa, NJ
Print ISBN: 978-1-62703-058-8
Online ISBN: 978-1-62703-059-5
eBook Packages: Springer Protocols