数学理论与应用 ›› 2022, Vol. 42 ›› Issue (2): 108-119.doi: 10.3969/j.issn.1006­-8074.2022.02.010

• • 上一篇    下一篇

Logistic 回归模型的一种改进弹性网估计

蒋仕旗, 戴家佳*
  

  1. 贵州大学数学与统计学院, 贵阳 550025
  • 出版日期:2022-06-28 发布日期:2022-06-30
  • 通讯作者: 戴家佳 (1976−), 教授, 博士, 从事概率论与数理统计研究; E−mail: jjdai@gzu.edu.cn
  • 基金资助:
    贵州省数据驱动建模学习与优化创新团队 (黔科合平台人才 [2020]5016) 项目资助

An Improved Elastic Net Estimate for Logistic Regression Models

  1. School of Mathematics and Statistics, Guizhou University, Guiyang 550025, China
  • Online:2022-06-28 Published:2022-06-30

摘要:

为提升Logistic回归模型在分类问题上的应用表现,本文将自适应Lasso 和自适应Ridge结合,建立双重自适应弹性网. 双重自适应弹性网同时具有oracle 性质和自适应分组效应,这确保了它在一定的假设前提下,能有效估计参数和准确选取重要变量,进而使所建立的Logistic回归模型变得简而精.模拟和实例分析表明,双重自适应弹性网适用于具有自适应分组效应的中度或高度相关情形,其提升Logistic 回归的表现等同于或高于弹性网及其部分改进法.


关键词:

Abstract:

For improving the application performance of Logistic regression models on classification problems, this paper develops a double adaptive elastic net by combining the adaptive Lasso and adaptive Ridge. The double adaptive elastic net has both the oracle property and the adaptive grouping effect, which ensures that it can effectively estimate parameters and accurately select important variables under certain assumed premises and consequently, makes the established Logistic regression model simple and precise. Simulation and case analysis show that the double adaptive elastic net is suitable for medium or high correlation cases with adaptive grouping effect, and its performance of improving Logistic regression is equal to or better than that of the elastic net and other partial improvement methods.

Key words: