Orthogonal Regression for Nonparametric Estimation of Errors-in-Variables Models

Authors: Anastasiia Yu. Timofeeva

Abstract:

Two new algorithms for nonparametric estimation of errors-in-variables models are proposed. The first algorithm is based on penalized regression spline. The spline is represented as a piecewise-linear function and for each linear portion orthogonal regression is estimated. This algorithm is iterative. The second algorithm involves locally weighted regression estimation. When the independent variable is measured with error such estimation is a complex nonlinear optimization problem. The simulation results have shown the advantage of the second algorithm under the assumption that true smoothing parameters values are known. Nevertheless the use of some indexes of fit to smoothing parameters selection gives the similar results and has an oversmoothing effect.

Keywords: Grade point average, orthogonal regression, penalized regression spline, locally weighted regression.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1094102

References:

[1] J. L. Kobrin, B. F, Patterson, E. J. Shaw, K. D. Mattern, and S. M. Barbuti, "Validity of the SAT for predicting first-year college grade point average” (College Board Research Report No. 2008-5). New York: The College Board, 2008.
[2] J. J. Arneson, P. R. Sackett, and A. S. Beatty, "Ability-performance relationships in education and employment settings: critical tests of the more-is-better and the good-enough hypotheses,” Psychological Science, vol. 22, no. 10, pp. 1336-1342, 2011.
[3] J. P. Marini, K. D. Mattern, and E. J. Shaw, "Examining the linearity of the PSAT/NMSQT®–FYGPA relationship” (College Board Research Report No. 2011-7). New York: The College Board, 2011.
[4] D. Ruppert, M. P. Wand, and R. J. Carroll, Semiparametric Regression. New York: Cambridge university press, 2003.
[5] R. Blundell, X. Chen, and D. Kristensen, "Semi-nonparametric IV estimation of shape-invariant engel curves,” Econometrica, vol. 75, no. 6, pp. 1613–1669, 2007.
[6] S. Van Huffel and J. Vandewalle, The Total Least Squares Problem: Computational Aspects and Analysis. SIAM, 1991.
[7] J. P. Buonaccorsi, Measurement error: models, methods, and applications. Boca Raton, London, New York: Chapman & Hall/CRC interdisciplinary statistics series, 2010.
[8] S. M. Berry, R. J. Carroll, and D. Ruppert "Bayesian smoothing and regression splines for measurement error problems,” Journal of the American Statistical Association, vol. 97, no. 457, pp. 160-169, 2002.
[9] P. Pinson, H.A. Nielsen, H. Madsen, and T.S. Nielsen, "Local linear regression with adaptive orthogonal fitting for the wind power application,” Statistics and Computing, vol. 18, no. 1, pp. 59-71, 2008.
[10] R. J. Carroll and D. Ruppert, "The use and misuse of orthogonal regression in linear errors-in-variables models,” The American Statistician, vol. 50, no. 1, pp. 1-6, 1996.
[11] V. I. Denisov, A. Yu. Timofeeva, E. A. Khailenko, and O. I. Buzmakova "Robust estimation of nonlinear structural models,” Journal of Applied and Industrial Mathematics, vol. 8, no. 1, pp. 28-39, 2014.
[12] W.S. Cleveland and S.J. Devlin, "Locally weighted regression: an approach to regression analysis by local fitting,” Journal of the American Statistical Association, vol. 83, no. 403, pp. 596-610, 1988.
[13] R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria, 2013. URL http://www.R-project.org/.
[14] W. Härdle, Applied nonparametric regression. New York: Cambridge University Press, 1992.