面向贯序不均衡数据的混合采样极限学习机.docVIP

面向贯序不均衡数据的混合采样极限学习机 　　摘要：针对现有机器学习算法难以有效提高贯序不均衡数据分类问题中少类样本分类精度的问题，提出一种基于混合采样策略的在线贯序极限学习机。该算法可在提高少类样本分类精度的前提下，减少多类样本的分类精度损失，主要包括离线和在线两个阶段：离线阶段采用均衡采样策略，利用主曲线分别构建多类和少类样本的可信区域，在不改变样本分布特性的前提下，利用可信区域扩充少类样本和削减多类样本，进而得到均衡的离线样本集，建立初始模型；在线阶段仅对贯序到达的多类数据进行欠采样，根据样本重要度挑选最具价值的多类样本，进而动态更新网络权值。通过理论分析证明所提算法在理论上存在损失信息上界。采用UCI标准数据集和实际的澳门空气污染预报数据进行仿真实验，结果表明，与现有在线贯序极限学习机（OSELM）、极限学习机（ELM）和元认知在线贯序极限学习机（MCOSELM）算法相比，所提算法对少类样本的预测精度更高，且数值稳定性良好。 　　关键词：极限学习机；在线贯序数据；不均衡分类；主曲线 　　中图分类号： TP181 　　文献标志码：A 　　Hybrid sampling extreme learning machine for sequential imbalanced data 　　MAO Wentao1，2*， WANG Jinwan1， HE Ling1， YUAN Peiyan1，2 　　1.College of Computer and Information Engineering， Henan Normal University， Xinxiang Henan 453007， China 　　； 　　2.Engineering Laboratory of Intellectual Business and Internet of Things Technologies， Henan Province， Xinxiang Henan 453007， China 　　Abstract： 　　Many traditional machine learning methods tend to get biased classifier which leads to lower classification precision for minor class in sequential imbalanced data. To improve the classification accuracy of minor class， a new hybrid sampling online extreme learning machine on sequential imbalanced data was proposed. This algorithm could improve the classification accuracy of minor class as well as reduce the loss of classification accuracy of major class， which contained two stages. In offline stage， the principal curve was introduced to model the confidence regions of minor class and major class respectively based on the strategy of balanced samples. Oversampling of minority and undersampling of majority was achieved based on confidence region. Then the initial model was established. In online stage， only the most valuable samples of major class were chosen according to the sample importance， and then the network weight was updated dynamically. The proposed algorithm had upper bound of the information loss through the theoretical proof. The experiment was taken on two UCI datasets and the realworld ai