Abstract
Determining appropriate process parameters in large-scale laser powder bed fusion (LPBF) additive manufacturing pose formidable challenges that necessitate advanced approaches to minimize trial-and-error during experimentation. This work proposed a data-driven approach based on stacking ensemble learning to predict the mechanical properties of Ti6Al4V alloy fabricated by large-scale LPBF for the first time. This method can adapt to the complexity of large-scale LPBF data distribution and exhibits a more generalized predictive capability compared to base models. Specifically, the stacking model utilized artificial neural network (ANN), gradient boosting regressor, kernel ridge regression, and elastic net as base models, with the Lasso model serving as the meta-model. Bayesian optimization and cross-validation were utilized for model optimization and training based on a limited data set, resulting in higher predictive accuracy compared to traditional artificial neural network model. The statistical analysis of the ANN and stacking models indicates that the stacking model exhibits superior performance on the test set, with a coefficient of determination value of 0.944, mean absolute percentage error of 2.51%, and root mean squared error of 27.64, surpassing that of the ANN model. All statistical metrics demonstrate superiority over those obtained from the ANN model. These results confirm that by integrating the base models, the stacking model exhibits superior predictive stability compared to individual base models alone, thereby providing a reliable assessment approach for predicting the mechanical properties of metal parts fabricated by the LPBF process.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Abbreviations
- ANN:
-
Artificial neural network
- BP:
-
Backpropagation
- CR:
-
Critical range
- ENet:
-
Elastic Net
- GBR:
-
Gradient boosting regressor
- IA:
-
Index of agreement
- KRR:
-
Kernel ridge regression
- LPBF:
-
Laser powder bed fusion
- LR:
-
Linear regression
- MAE:
-
Mean absolute error
- MAPE:
-
Mean absolute percentage error
- ML:
-
Machine learning
- MSE:
-
Mean squared error
- ReLU:
-
Linear rectification function
- RMSE:
-
Root mean squared error
- STD:
-
Standard deviation
- SVR-GS:
-
Support vector regression algorithm optimized by grid search
- a :
-
Constant between 1 and 10
- D :
-
Dataset
- H :
-
Hatch spacing
- k :
-
Number of models
- L :
-
Layer thickness
- m :
-
Number of output nodes
- \(\hat{m}_{t}\) :
-
The first moment
- n :
-
Number of input nodes
- N :
-
Number of data sets
- P :
-
Laser power
- R 2 :
-
Coefficient of determination
- T s(X):
-
The output of the stacking model
- \(\hat{v}_{t}\) :
-
The second moment
- V :
-
Scanning speed
- W :
-
Connection matrix
- X :
-
Input vector
- Y :
-
Output
- \(\bar{y}\) :
-
Mean value of the true values
- \(\hat{y}_{i}\) :
-
Predicted value for sample i
- α :
-
Significance level
- β i(X):
-
The output of the base model at index i
- γ :
-
The second layer model of the stacking model
- ε :
-
Small constant
- η :
-
Total number of samples
- θ :
-
Hyperparameter
- θ t :
-
Parameter vector
- Θ:
-
Search space
- σ b :
-
Tensile strength
- φ(X):
-
Prediction output of the meta-model
- Ψ:
-
Hyperparameter response function
References
Herzog D, Seyda V, Wycisk E, Emmelmann C. Additive manufacturing of metals. Acta Materialia, 2016, 117: 371–392
Zhou K, Han C J. Metal Powder-Based Additive Manufacturing. Hoboken: Wiley, 2023, 75–159
Ma D, Zhu S D, Zhang K, Zhu L J, Zhou Y. Application and research of titanium alloy oil drill pipes. Journal of Physics: Conference Series, 2023, 2639(1): 012059
Perticarini L, Zanon G, Rossi S M P, Benazzo F M. Clinical and radiographic outcomes of a trabecular titanium™ acetabular component in hip arthroplasty: results at minimum 5 years follow-up. BMC Musculoskeletal Disorders, 2015, 16(1): 375
Nguyen H D, Pramanik A, Basak A K, Dong Y, Prakash C, Debnath S, Shankar S, Jawahir I S, Dixit S, Buddhi D. A critical review on additive manufacturing of Ti-6Al-4V alloy: microstructure and mechanical properties. Journal of Materials Research and Technology, 2022, 18: 4641–4661
Sui S, Chew Y X, Weng F, Tan C L, Du Z L, Bi G J. Study of the intrinsic mechanisms of nickel additive for grain refinement and strength enhancement of laser aided additively manufactured Ti-6Al-4V. International Journal of Extreme Manufacturing, 2022, 4(3): 035102
Wang S Q, Ma T J, Li W Y, Wen G D, Chen D L. Microstructure and fatigue properties of linear friction welded TC4 titanium alloy joints. Science and Technology of Welding and Joining, 2017, 22(3): 177–181
Lei C J, Ren S, Yin C H, Liu X X, Chen M F, Wu J Z, Han C J. Manipulating melt pool thermofluidic transport in directed energy deposition driven by a laser intensity spatial shaping strategy. Virtual and Physical Prototyping, 2024, 19(1): e2308513
Chen W, Gu D D, Yang J K, Yang Q, Chen J, Shen X F. Compressive mechanical properties and shape memory effect of NiTi gradient lattice structures fabricated by laser powder bed fusion. International Journal of Extreme Manufacturing, 2022, 4(4): 045002
Sufiiarov V S, Popovich A A, Borisov E V, Polozov I A, Masaylo D V, Orlov A V. The effect of layer thickness at selective laser melting. Procedia Engineering, 2017, 174: 126–134
Sheng H S, Xu J H, Zhang S Y, Tan J R, Wang K. Build orientation determination of multi-feature mechanical parts in selective laser melting via multi-objective decision making. Frontiers of Mechanical Engineering, 2023, 18(2): 21
Wang T, Knap J. Stochastic gradient descent for semilinear elliptic equations with uncertainties. Journal of Computational Physics, 2021, 426: 109945
Exterkate P. Model selection in kernel ridge regression. Computational Statistics & Data Analysis, 2013, 68: 1–16
Gao W P, Wang J S, Zhou L, Luo Q Q, Lao Y H, Lyu H J, Guo S W. Prediction of acute kidney injury in ICU with gradient boosting decision tree algorithms. Computers in Biology and Medicine, 2022, 140: 105097
Zhao Y L, Feng Y L. Learning performance of elastic-net regularization. Mathematical and Computer Modelling, 2013, 57(5–6): 1395–1407
Wu J J, Huang Z, Qiao H C, Wei B X, Zhao Y J, Li J F, Zhao J B. Prediction about residual stress and microhardness of material subjected to multiple overlap laser shock processing using artificial neural network. Journal of Central South University, 2022, 29(10): 3346–3360
Tyagi R, Kumar S, Raza M S, Tripathi A, Das A K. Experimental study of laser cladding process and prediction of process parameters by artificial neural network (ANN). Journal of Central South University, 2022, 29(10): 3489–3502
Tibshirani R. Regression shrinkage and selection via the lasso: a retrospective. Journal of the Royal Statistical Society Series B: Statistical Methodology, 2011, 73(3): 273–282
Schmidt J, Marques M R G, Botti S, Marques M A L. Recent advances and applications of machine learning in solid-state materials science. npj Computational Materials, 2019, 5(1): 83
Johnson N S, Vulimiri P S, To A C, Zhang X, Brice C A, Kappes B B, Stebner A P. Invited review: machine learning for materials developments in metals additive manufacturing. Additive Manufacturing, 2020, 36: 101641
Wang C, Tan X P, Tor S B, Lim C S. Machine learning in additive manufacturing: state-of-the-art and perspectives. Additive Manufacturing, 2020, 36: 101538
Nguyen D S, Park H S, Lee C M. Optimization of selective laser melting process parameters for Ti-6Al-4V alloy manufacturing using deep learning. Journal of Manufacturing Processes, 2020, 55: 230–235
Rankouhi B, Jahani S, Pfefferkorn F E, Thoma D J. Compositional grading of a 316L-Cu multi-material part using machine learning for the determination of selective laser melting process parameters. Additive Manufacturing, 2021, 38: 101836
Luo Y W, Zhang B, Feng X, Song Z M, Qi X B, Li C P, Chen G F, Zhang G P. Pore-affected fatigue life scattering and prediction of additively manufactured inconel 718: an investigation based on miniature specimen testing and machine learning approach. Materials Science and Engineering: A, 2021, 802: 140693
Wolpert D H. Stacked generalization. Neural Networks, 1992, 5(2): 241–259
Zhang H C, Zhu T T. Stacking model for photovoltaic-power-generation prediction. Sustainability, 2022, 14(9): 5669
Kim Y T, Kim B J, Kim S W. Multi-level stacked regression for predicting electricity consumption of hot rolling mill. Expert Systems with Applications, 2022, 201: 117040
Djarum D H, Ahmad Z, Zhang J. Reduced bayesian optimized stacked regressor (RBOSR): a highly efficient stacked approach for improved air pollution prediction. Applied Soft Computing, 2023, 144: 110466
Ribeiro M H D M, da Silva R G, Moreno S R, Mariani V C, Coelho L D S. Efficient bootstrap stacking ensemble learning model applied to wind power generation forecasting. International Journal of Electrical Power & Energy Systems, 2022, 136: 107712
da Silva R G, Moreno S R, Ribeiro M H D M, Larcher J H K, Mariani V C, Coelho L D S. Multi-step short-term wind speed forecasting based on multi-stage decomposition coupled with stacking-ensemble learning approach. International Journal of Electrical Power & Energy Systems, 2022, 143: 108504
Gadgil K, Gill S S, Abdelmoniem A M. A meta-learning based stacked regression approach for customer lifetime value prediction. Journal of Economy and Technology, 2023, 1: 197–207
Shafighfard T, Bagherzadeh F, Rizi R A, Yoo D Y. Data-driven compressive strength prediction of steel fiber reinforced concrete (SFRC) subjected to elevated temperatures using stacked machine learning algorithms. Journal of Materials Research and Technology, 2022, 21: 3777–3794
Zhang Z W, Zhang Y Y, Wen Y T, Ren Y X, Liang X, Cheng J X, Kang M Q. An improved stacking ensemble learning model for predicting the effect of lattice structure defects on yield stress. Computers in Industry, 2023, 151: 103986
Bzdok D, Krzywinski M, Altman N. Machine learning: supervised methods. Nature Methods, 2018, 15(1): 5–6
Janiesch C, Zschech P, Heinrich K. Machine learning and deep learning. Electronic Markets, 2021, 31(3): 685–695
Lu C Y, Shi J. Relative density prediction of additively manufactured inconel 718: a study on genetic algorithm optimized neural network models. Rapid Prototyping Journal, 2022, 28(8): 1425–1436
Otchere D A, Arbi Ganat T O, Gholami R, Ridha S. Application of supervised machine learning paradigms in the prediction of petroleum reservoir properties: comparative analysis of ANN and SVM models. Journal of Petroleum Science Engineering, 2021, 200: 108182
Fernández A, Clavería I, Pina C, Elduque D. Predictive methodology for quality assessment in injection molding comparing linear regression and neural networks. Polymers, 2023, 15(19): 3915
Jeong S S, Park W K, Joh Y D. Construction of full-view data from limited-view data using artificial neural network in the inverse scattering problem. Applied Sciences, 2022, 12(19): 9801
Maalouf M, Homouz D. Kernel ridge regression using truncated newton method. Knowledge-Based Systems, 2014, 71: 339–344
Otchere D A, Ganat T O A, Ojero J O, Tackie-Otoo B N, Taki M Y. Application of gradient boosting regression model for the evaluation of feature selection techniques in improving reservoir characterisation predictions. Journal of Petroleum Science Engineering, 2022, 208: 109244
Zou H, Hastie T. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society Series B: Statistical Methodology, 2005, 67(2): 301–320
Zhao Z B, Wu S M, Qiao B J, Wang S B, Chen X F. Enhanced sparse period-group lasso for bearing fault diagnosis. IEEE Transactions on Industrial Electronics, 2019, 66(3): 2143–2153
Ogunsanya M, Isichei J, Desai S. Grid search hyperparameter tuning in additive manufacturing processes. Manufacturing Letters, 2023, 35: 1031–1042
Bergstra J, Bengio Y. Random search for hyper-parameter optimization. The Journal of Machine Learning Research, 2012, 13: 281–305
Friedman M. The use of ranks to avoid the assumption normality implicit in the analysis of variance. Journal of the American Statistical Association, 1937, 32(200): 675–701
Acknowledgements
This study was supported by the National Natural Science Foundation of China (Grant No. 52305358), the Fundamental Research Funds for the Central Universities, China (Grant No. 2023ZYGXZR061), the Guangdong Basic and Applied Basic Research Foundation, China (Grant No. 2022A1515010304), the Young Elite Scientists Sponsorship Program by China Association for Science and Technology, China (Grant No. 2023QNRC001), and the Young Talent Support Project of Guangzhou, China (Grant No. QT-2023-001).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest The authors declare that they have no conflict of interest.
Rights and permissions
About this article
Cite this article
Han, C., Yan, F., Yuan, D. et al. Machine learning enabling prediction in mechanical performance of Ti6Al4V fabricated by large-scale laser powder bed fusion via a stacking model. Front. Mech. Eng. 19, 25 (2024). https://doi.org/10.1007/s11465-024-0796-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11465-024-0796-0