Functional data regression model based on functional mean variance estimation and mutual information weighted ensemble learning
DOI:
https://doi.org/10.54097/hset.v60i.10334Keywords:
Functional data regression, Basis function expansion and sufficient dimension reduction, model averaging.Abstract
Functional data regression model holds significant application value in various fields such as medicine, economics, finance, and industrial manufacturing. This paper introduces a novel functional regression method that incorporates functional mean variance estimation and mutual information weighted ensemble learning. The proposed method employs functional mean variance estimation to reduce dimension while maintaining the effective information of the predictor related to the response variable. Specifically, this method projects the random function into the function space spanned by finite dimensional basis functions to extract the underlying functional information of the original data. Additionally, considering that the number of sufficient dimension reduction sub-directions is unknown, this paper proposes a model averaging approach based on mutual information weighting to determine the importance of each sub-model. The proposed method can adaptively address the over-fitting and under-fitting problems of the prediction model. The empirical data analysis indicates that the proposed method outperforms other comparison methods in terms of smaller mean square error and absolute error, and it exhibits a certain level of robustness.
Downloads
References
Liu Zhuang. Functional data classification method and its application [D]. Hefei University of Technology, 2020.
DING Hui, XU Wenchao, et al. Review of Regression Analysis for Function Data [J]. School of Statistics, East China Normal University, College of Economics, et al., 2018,34(06):630-654.
Li Xingxing. Comparisons of generalized linear models [D]. Yangzhou University, 2017.
CHEN X, CUI Y. Quasi-likelihood adaptive Lasso estimators for high-dimensional generalized linear models [J]. Journal of Shaanxi Normal University (Natural Science Edition),2019,47(2):1-9.
Chanjuan Li. A Research of Key Technology of dimension Reduction of High Dimensional Data [D]. School of Information and Software Engineering, 2017.
Marukatat, S. Tutorial on PCA and approximate PCA and approximate kernel PCA [J]. Artificial Intelligence Review,2022.
Shigemoto, H; Morimoto, T. Forecasting High-Dimensional Covariance Matrices Using High-Dimensional Principal Component Analysis [J]. Axioms, 2022,11(12):692.
Min Cai. Statistical computation and theory research of sufficient dimension [D]. East China Normal University, 2022.
YUAN Xiao-hui, CAO Ru-ya, JIN Wan-lin. Parameter estimation and variable selection for function partially linear models [J]. Journal of Jilin University (Natural Science Edition), 2022,43(02):48-57.
Tianli Xiao. The Significance Test and Effect Analysis of Functional Parameters [D]. Zhengzhou University, 2018.
Guochang Wang, Nan Lin, Baoxue Zhang. Dimension reduction in functional regression using mixed data canonical correlation analysis [J]. Statistics And Its Interface, 2013, 6(2): 187-196.
Banner KM, Higgs MD. Considerations for assessing model averaging of regression coefficients [J]. Ecological Applications, 2017,27(1):79-93.
Guochang Wang, Yan Zhou, Xiang-Nan Feng, Baoxue Zhang. The hybrid method of FSIR and FSAVE for functional effective dimension reduction [J]. Computational Statistics and Data Analysis, 2015,91(1): 64-77.
Li Yaqin, Yang Huizhong. Ensemble modeling method based on Bagging algorithm and Gaussian process [J]. Journal of Southeast University (Natural Science Edition), 2011,41(05):93-96.
HU Jian, SU Yongdong, et.al. Intrusion detection method based on ensemble transfer learning via weighted mutual information [J]. Journal of Computer Application, 2019, 39(11): 3310-3315.
Downloads
Published
Issue
Section
License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.







