系统仿真学报 ›› 2024, Vol. 36 ›› Issue (7): 1546-1558.doi: 10.16182/j.issn1004731x.joss.23-0430

• 研究论文 • 上一篇    

基于特征传递与重构的深度模糊分类器

尹瑞(), 卢伟(), 杨建华   

  1. 大连理工大学 控制科学与工程学院,辽宁 大连 116023
  • 收稿日期:2023-04-12 修回日期:2023-06-05 出版日期:2024-07-15 发布日期:2024-07-12
  • 通讯作者: 卢伟 E-mail:yinrui@mail.dlut.edu.cn;luwei@dlut.edu.cn
  • 第一作者简介:尹瑞(1991-),男,博士生,研究方向为模糊模型及其应用。E-mail: yinrui@mail.dlut.edu.cn
  • 基金资助:
    国家自然科学基金(62073056);辽宁省应用基础研究计划(2023JH2/101300207);大连市重点领域创新团队项目(2021RT14)

A Deep Fuzzy Classifier Based on Feature Transform and Reconstruction

Yin Rui(), Lu Wei(), Yang Jianhua   

  1. School of Control Science and Engineering, Dalian University of Technology, Dalian 116023, China
  • Received:2023-04-12 Revised:2023-06-05 Online:2024-07-15 Published:2024-07-12
  • Contact: Lu Wei E-mail:yinrui@mail.dlut.edu.cn;luwei@dlut.edu.cn

摘要:

为了获得具有良好的分类准确性同时兼具可解释性的模型,提出了一种基于特征传递与重构的深度模糊分类器(deep fuzzy classifier based on feature transform and reconstruction, FR-DFC)。 基于深度学习的层次堆叠思想,数个用于特征传递的模糊系统(fuzzy systems for feature transform, FT_FS)和一个多原型模糊分类系统(multi-prototype fuzzy classification system, MPRFD_FS)堆叠在一起实现了模型的分类过程。其中,数个堆叠的FT_FS将数据从原始数据空间传递到高层特征空间中来探索数据中隐含的特征信息。MPRFD_FS则依据多个描述高层特征空间中类的分布特征的原型来实现分类。另一方面,利用多个用于特征重构的模糊系统(fuzzy systems for feature reconstruction, RE_FS)建立高层特征空间与原始数据空间的映射关系,并在原始数据空间中建立了一个便于理解的近似模糊分类器来保证FR-DFC具有可解释性。采用基于梯度下降和端到端的学习方式来优化模型的参数。优化的目标函数包含了分类损失函数和重构损失函数,能够同时保证模型的分类准确性和可解释性。实验结果表明:该分类器在提升分类准确性的同时兼具可解释性。

关键词: 模糊系统, 特征传递, 分类, 可解释性, 重构

Abstract:

To obtain a classifier with good classification accuracy and interpretability, a deep fuzzy classifier based on feature transform and reconstruction (FR-DFC) is proposed. In FR-DFC, several fuzzy systems (FT_FS) for feature transform and a multi-prototype fuzzy classification system (MPRFD_FS) are stacked together to realize the classification process of the model, based on the hierarchically stacked thought originated from deep learning. Specifically, the stacked FT_FSs explore the hidden features in the data by transferring data from the original data space to the high-level feature space. MPRFD_FS, on the other hand, implements classification based on multiple prototypes that characterize the distribution of classifications in the high-level feature space. In addition, the proposed FR-DFC uses several fuzzy systems (RE_FS) for feature reconstruction to establish the mapping relationship between the high-level feature space and the original data space and establishes an understandably approximate fuzzy classifier in the original data space to ensure the interpretability of FR-DFC. Besides, FR-DFC utilizes gradient descent-based and end-to-end learning patterns to optimize the parameters of the model. The optimized objective function contains a classification loss function and a reconstruction loss function, which ensures both classification accuracy and interpretability of the model. Experimental results demonstrate that FR-DFC not only improves the classification accuracy but also possesses interpretability.

Key words: fuzzy system, feature transform, classification, interpretability, reconstruction

中图分类号: