Abstract
In this paper, a new estimation procedure based on composite quantile regression and functional principal component analysis (PCA) method is proposed for the partially functional linear regression models (PFLRMs). The proposed estimation method can simultaneously estimate both the parametric regression coefficients and functional coefficient components without specification of the error distributions. The proposed estimation method is shown to be more efficient empirically for non-normal random error, especially for Cauchy error, and almost as efficient for normal random errors. Furthermore, based on the proposed estimation procedure, we use the penalized composite quantile regression method to study variable selection for parametric part in the PFLRMs. Under certain regularity conditions, consistency, asymptotic normality, and Oracle property of the resulting estimators are derived. Simulation studies and a real data analysis are conducted to assess the finite sample performance of the proposed methods.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Aneiros, G., Ferraty, F., & Vieu, P. (2015). Variable selection in partial linear regression with functional covariate. Statistics, 49(6), 1322–1347.
Brown, P. J., Fearn, T., & Vannucci, M. (2001). Bayesian wavelet regression on curves with application to a spectroscopic calibration problem. Journal of the American Statistical Association, 96(5), 398–408.
Cai, T., & Hall, P. (2006). Prediction in functional linear regression. The Annals of Statistics, 34(5), 2159–2179.
Fan, J., & Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association, 96, 1348–1360.
Gertheiss, J., Maity, A., & Staicu, A.-M. (2014). Variable selection in generalized functional linear models. Stat, 2, 86–101.
Greven, S., & Scheipl, F. (2017). A general framework for functional regression modelling. Statistical Modelling, 17, 1–35.
Hall, P., & Horowitz, J. (2007). Methodology and convergence rates for functional linear regression. The Annals of Statistics, 35, 70–91.
He, X., Zhu, Z. Y., & Fung, W. K. (2002). Estimation in a semiparametric model for longitudinal data with unspecified dependence structure. Biometrika, 90, 579–590.
Horváth, L., & Kokoszka, P. (2012). Inference for functional data with applications. New York: Springer.
Huang, L., Zhao, J., Wang, H., & Wang, S. (2016). Robust shrinkage estimation and selection for functional multiple linear model through LAD loss. Computational Statistics & Data Analysis, 103, 384–400.
Kai, B., Li, R., & Zou, H. (2010). Local composite quantile regression smoothing: an efficient and safe alternative to local polynomial regression. Journal of the Royal Statistical Society. Series B., 72, 49–69.
Kai, B., Li, R., & Zou, H. (2011). New efficient estimation and variable selection methods for semiparametric varying-coefficient partially linear models. The Annals of Statistics, 39, 305–332.
Knight, K. (1998). Limiting distributions for l1 regression estimators under general conditions. The Annals of Statistics, 26(5), 755–770.
Koenker, R. (2005). Quantile regression. Cambridge: Cambridge University Press.
Koenker, R., & Bassett, G. S. (1978). Regression quantiles. Econometrica, 46, 33–50.
Kong, D., Xue, K., Yao, F., & Zhang, H. H. (2016). Partially functional linear regression in high dimensions. Biometrika, 103, 147–159.
Lian, H. (2013). Shrinkage estimation and selection for multiple functional regression. Statistica Sinica, 23, 51–74.
Lu, Y., Du, J., & Sun, Z. (2014). Functional partially linear quantile regression model. Metrika, 77(5), 317–332.
Mas, A., & Pumo, B. (2009). Linear processes for functional data. (pp. 47–71). Oxford Univ Press.
Matsui, H., & Konishi, S. (2011). Variable selection for functional regression models via the L1 regularization. Computational Statistics & Data Analysis, 55, 3304–3310.
Morris, J. S. (2015). Functional regression. Annual Review of Statistics and Its Application, 2, 321–359.
Müller, H., & Stadtmüller, U. (2005). Generalized functional linear models. The Annals of Statistics, 33, 774–805.
Pannu, J., & Billor, N. (2017). Robust group-Lasso for functional regression model. Communications in Statistics. Simulation and Computation, 46, 3356–3374.
Ramsay, J. O., & Silverman, B. W. (2002). Applied functional data analysis: Methods and case studies. New York: Springer.
Ramsay, J. O., & Silverman, B. W. (2005). Functional data analysis (2nd ed.). New York: Springer.
Reiss, P. T., Goldsmith, J., Shang, H. L., & Ogden, R. T. (2017). Methods for scalar-on-function regression. International Statistical Review, 85, 228–249.
Sentürk, D., & Müller, H. (2010). Functional varying coefficient models for longitudinal data. Journal of the American Statistical Association, 105, 1256–1264.
Shin, H. (2009). Partial functional linear regression. Journal of Statistical Planning and Inference, 139, 3405–3418.
Tibshirani, R. (1996). Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society. Series B., 58, 267–288.
Wang, J. L., Chiou, J. M., & Müller, H. G. (2016). Functional data analysis. Annual Review of Statistics and Its Application, 3, 257–295.
Wang, L., Kai, B., & Li, R. (2009). Local rank inference for varying coefficient models. Journal of the American Statistical Association, 104(5), 1631–1645.
Wei, Y., & He, X. (2006). Conditional growth charts. The Annals of Statistics, 34(5), 2069–2097.
Yao, F., Müller, H., & Wang, J. (2005). Functional linear regression analysis for longitudinal data. The Annals of Statistics, 33, 2873–2903.
Yao, F., Sue-Chee, S., & Wang, F. (2017). Regularized partially functional quantile regression. Journal of Multivariate Analysis, 156, 39–56.
Zhang, C. H. (2010). Nearly unbiased variable selection under minimax concave penalty. The Annals of Statistics, 38, 894–942.
Zou, H. (2006). The adaptive lasso and its oracle properties. Journal of the American Statistical Association, 101, 1418–1429.
Zou, H., & Yuan, M. (2008). Composite quantile regression and the oracle model selection theory. The Annals of Statistics, 36, 1108–1126.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Du, J., Xu, D. & Cao, R. Estimation and variable selection for partially functional linear models. J. Korean Stat. Soc. 47, 436–439 (2018). https://doi.org/10.1016/j.jkss.2018.05.002
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1016/j.jkss.2018.05.002