数学理论与应用 ›› 2024, Vol. 44 ›› Issue (4): 100-115.doi: 10.3969/j.issn.1006-8074.2024.04.007

• • 上一篇    下一篇

基于依附惩罚的稀疏最优评分模型

侯丹丹,刘勇进*   

  1. 福州大学数学与统计学院, 福州, 350108
  • 出版日期:2024-12-28 发布日期:2025-01-21

A Sparse Optimal Scoring Model with Adherent Penalty

Hou Dandan, Liu Yongjin*   

  1. School of Mathematics and Statistics, Fuzhou University, Fuzhou 350108, China
  • Online:2024-12-28 Published:2025-01-21
  • Contact: Liu Yongjin
  • Supported by:
    This work is supported by the National Natural Science Foundation of China (No. 12271097), the Key Program of National Science Foundation of Fujian Province of China (No. 2023J02007), the Central Guidance on Local Science and Technology Development Fund of Fujian Province (No. 2023L3003), and the Fujian Alliance of Mathematics (No. 2023SXLMMS01)

摘要: 我们考虑在高维环境下的二分类问题, 其中给定数据的特征数大于观测数.为此, 我们提出一种基于依附惩罚的最优评分(APOS)模型, 用于同时进行判别分析和特征选择. 在本文中, 我们设计一种基于块坐标下降(BCD)方法和SSNAL算法的高效算法来近似求解APOS模型, 并给出该方法的收敛性结果.对模拟和真实数据集的数值实验结果表明, 所提模型在性能上优于五种经典的稀疏判别方法.

关键词: 稀疏判别分析, 最优评分, 特征选择, BCD方法, SSNAL算法

Abstract: We consider the task of binary classification in the high-dimensional setting where the number of features of the given data is larger than the number of observations. To accomplish this task, we propose an adherently penalized optimal scoring (APOS) model for simultaneously performing discriminant analysis and feature selection. In this paper, an efficient algorithm based on the block coordinate descent (BCD) method and the SSNAL algorithm is developed to solve the APOS approximately. The convergence results of our method are also established. Numerical experiments conducted on simulated and real datasets demonstrate that the proposed model is more efficient than several sparse discriminant analysis methods.

Key words: Sparse discriminant analysis, Optimal scoring, Feature selection, BCD method, SSNAL algorithm