Accurate And Efficient Global Approximation using Adaptive Polynomial RSM for Complex Mechanical and Vehicular Performance Models

Authors: Y. Z. Wu, Z. Dong, S. K. You

Abstract:

Global approximation using metamodel for complex mathematical function or computer model over a large variable domain is often needed in sensibility analysis, computer simulation, optimal control, and global design optimization of complex, multiphysics systems. To overcome the limitations of the existing response surface (RS), surrogate or metamodel modeling methods for complex models over large variable domain, a new adaptive and regressive RS modeling method using quadratic functions and local area model improvement schemes is introduced. The method applies an iterative and Latin hypercube sampling based RS update process, divides the entire domain of design variables into multiple cells, identifies rougher cells with large modeling error, and further divides these cells along the roughest dimension direction. A small number of additional sampling points from the original, expensive model are added over the small and isolated rough cells to improve the RS model locally until the model accuracy criteria are satisfied. The method then combines local RS cells to regenerate the global RS model with satisfactory accuracy. An effective RS cells sorting algorithm is also introduced to improve the efficiency of model evaluation. Benchmark tests are presented and use of the new metamodeling method to replace complex hybrid electrical vehicle powertrain performance model in vehicle design optimization and optimal control are discussed.

Keywords: Global approximation, polynomial response surface, domain decomposition, domain combination, multiphysics modeling, hybrid powertrain optimization

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1080326

References:

[1] Surrogates Toolbox, http://fchegury.googlepages.com
[2] G. Matheron, "Principles of Geostatistics," Economic Geology, vol. 58, pp. 1246-1266, 1963.
[3] Sacks, J., Welch, W. J., Mitchell, T.J., and Wynn, H. P., "Design and Analysis of Computer Experiments," Statistical Science, vol. 4, no. 4, pp. 409-423, 1989.
[4] Cresssie, N., "Spatial Prediction and Ordinary Kriging," Math. Geol., vol. 20, no. 4, pp. 405-421, 1988.
[5] S. N. Lophaven, H. B. Nielsen, and J. S├©ndergaard, "DACE - A MATLAB Kriging Toolbox," Technical Report IMM-TR-2002-12, Informatics and Mathematical Modelling, Technical University of Denmark, 2002.
[6] Hardy, R. L., "Multiquadratic Equations of Topography and Other Irregular Surfaces," J.Geophus. Res., vol.76, pp.1905-1915, 1971.
[7] M. D. Buhmann, Radial Basis Functions, Cambridge University Press, Cambridge, UK, 2003.
[8] Martin, J. D., and Simpson, T. W., "A Study on the Use of Kriging Models to Approximate Deterministic Computer Models," Proceedings of 2003 ASME Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Chicago, Illinois USA, 2003.
[9] Smith, M., "Neural Networks for Statistical Modeling," Von Nostrand Reinhold, 1993.
[10] Box, G. E. P., and Wilson, K. B., "On the Experimental Attainment of Optimum Conditions," Journal of the Royal Statistical Society. Series B Methodological, vol. 13, no. 1, pp.1-45, 1951.
[11] G. E. P. Box, W. G. Hunter, and J. S. Hunter, Statistics for Experimenters, John Wiley & Sons, New York, 1978.
[12] Myers, R. H., and Montgomery, D. C., Response Surface Methodology: Process and Product Optimization Using Designed Experiments, John Wiley& Sons, INC., Toronto, 2002.
[13] S. R. Gunn, "Support Vector Machines for Classification and Regression," Technical Report, Image Speech and Intelligent Systems Research Group, University of Southampton, UK, 1997.
[14] Vapnik, V., Golowich, S., and Smola, A., "Support Vector Method for Function Approximation, Regression Estimation, and Signal Processing," Advance in Neural Information Processing Systems, MIT Press, Cambridge, MA, pp. 281-287, 1997.
[15] Prakasvudhisarn, C., Trafalis, T. B., and Raman, S., "Support Vector Regression for Determination of Minimum Zone," ASME J. Manuf. Sci. Eng., vol. 125, no. 4, pp. 736-739, 2003.
[16] S. M. Clarke, J. H. Griebsch, and T. W. Simpson, "Analysis of Support Vector Regression for Approximation of Complex Engineering Analyses," Journal of Mechanical Design, vol. 127, pp. 1077-1087, 2005.
[17] Friedman, J. H., "Multivariate Adaptive Regression Splines," The Annals of Statistics, vol. 19, no. 1, pp.1-67, 1991.
[18] Chen, V. C. P., Ruppert, D., and Shoemaker, C. A., "Applying Experimental Design and Regression Splines to High-Dimensional Continuous-State Stochastic Dynamic Programming," Oper. Res., vol. 47, pp. 38-53, 1999.
[19] Scott Crino, Donald E. Brown, "Global Optimization With Multivariate Adaptive Regression Splines," IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, vol. 37, no. 2, pp. 333-340, April 2007.
[20] Steven Richardson, Song Wang, Les S. Jennings. A Multivariate Adaptive Regression B-Spline Algorithm (BMARS) for Solving a Class of Nonlinear Optimal Feedback Control Problems. Automatica, vol. 44, pp. 1149 - 1155, 2008.
[21] Gu, J., Li, G. Y., and Dong, Z., "Hybrid and Adaptive Metamodel Based Global Optimization," Proc. Proceedings of the ASME 2009 International Design Engineering Technical Conferences &Computers and Information in Engineering Conference, IDETC/CIE 2009, DETC2009-87121, San Diego, California, USA, Aug 30 - Sep 2, 2009.
[22] S.N. Lophaven, H.B. Nielsen, J. Sindergaard, Aspects of the Matlab Toolbox DACE. Report IMM-REP-2002-13, Informatics and Mathematical Modelling, DTU. (2002), 44 pages, available at http://www.imm.dtu.dk/»hbn/publ/TR0213.ps
[23] Younis, A., Gu, J., Dong, Z., and Li, G., "Trends, Features, and Tests of Common and Recently Introduced Global Optimization Methods," Proceedings of the 12th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, Victoria, British Columbia Canada, Paper No. AIAA-2008-5853, 2008.
[24] James R. Simpson , Drew Landman, Rupert Giroux et al, Adapting Second-order Response Surface Designs to Specific Need. Quality and Reliability Engineering International. Qual. Reliab. Engng. Int., vol. 24, pp. 331-349, 2007.
[25] Xuan Son Nguyen, Alain Sellier and Frédéric Duprat. "Adaptive Response Surface Method Based on a Double Weighted Regression Technique," Probabilistic Engineering Mechanics, vol. 24, pp. 135-143, 2009.
[26] Armin Iske and Jeremy Levesley. "Multilevel Scattered Data Approximation by Adaptive Domain Decomposition," Numerical Algorithms, vol. 39, pp. 187-198, 2005.
[27] Tobin A. Driscoll_, Alfa R.H. Heryudono. "Adaptive Residual Subsampling Methods for Radial Basis Function Interpolation and Collocation Problems," Computers and Mathematics with Applications vol. 53, pp. 927-939, 2007.
[28] Hongbing Fang and Mark F. Horstemeyer. "Global Response Approximation with Radial Basis Functions," Engineering Optimization. vol. 38, no. 4, pp. 407-424, June 2006.
[29] Daniel Busby, Chris L. Farmer, and Armin Iske. "Hierarchical Nonlinear Approximation for Experimental Design and Statistical Data Fitting," SIAM J. Sci. Comput. Vol. 29, No. 1, pp. 49-69.
[30] Jay D. Martin. "Computational Improvements to Estimating Kriging Metamodel Parameters," Journal of Mechanical Design. vol. 131 / 084501-1, August 2009.
[31] Jack P.C. Kleijnen. "Kriging Metamodeling in Simulation: A Review," European Journal of Operational Research, Vol. 192, pp. 707-716, 2009.
[32] D. Shahsavani a, and A. Grimvall. "An Adaptive Design and Interpolation Technique for Extracting Highly Nonlinear Response Surfaces from Deterministic Models," Reliability Engineering and System Safety, vol. 94, pp. 1173-1182, 2009.