Data Transformation-driven Fuzzy Clustering Neural Network with Layer-Wise and End-to-End Training
  • You, Yuntao
  • Wang, Zhen
  • Fu, Zunwei
  • Kim, Eun-Hu
  • Huang, Hao
  • 외 1명
Citations

WEB OF SCIENCE

2
Citations

SCOPUS

4

초록

In this study, we propose a novel data transformation-driven fuzzy clustering neural network (DTFCNN) to enhance the dimensionality reduction function and end-to-end refinment learning ability of the entire structure. Unlike conventional fuzzy clustering-based neural networks (FCNNs), which rely on fuzzy c-means clustering in the hidden layer and least squares error-based learning for connection weights, the DTFCNN utilizes backpropagation (BP) learning as a refinement algorithm. This refinement process enables iterative fine-tuning of the model's parameters, allowing it to adapt more effectively to complex patterns. By using BP, DTFCNN enhances its ability to learn intricate feature interactions and extract relevant features from high-dimensional spaces, thereby significantly improving the model's flexibility and performance. The proposed DTFCNN consists of four layers: First, a preprocessing layer employs Principal Component Analysis (PCA) for feature extraction and dimensionality reduction, where eigenvectors are used as connection weights for the preprocessing layer. Second, a hidden layer utilizes fuzzy c-means (FCM) clustering for generating fuzzy membership degrees, and centers serve as connection weights for hidden layers. The entries of the partition matrix also are regarded as membership degrees. In the output layer, a lineardriven affine transform is used for fitting connection weights, and a SoftMax function is employed to express the outputs as probabilities. Finally, all parameters, such as eigenvectors, centers, and coefficients, from the preprocessing layer to the output layer are refined through BP-based learning. To validate the effectiveness of the DTFCNN, we conducted a collection of comparison experiments: (i) publicly benchmark datasets with statistical analysis, (ii) facial recognition datasets for applicationspecific testing, and (iii) three large-scale datasets. The results demonstrate that the DTFCNN outperforms classical classifiers, state-of-the-art (SOTA) fuzzy classifiers, and deep learning baselines in terms of accuracy and generalization capability. The DTFCNN model uses fewer parameters than deep learning baselines, resulting in faster training times without compromising performance. Overall, the DTFCNN achieves higher accuracy while maintaining model adaptability. © 1993-2012 IEEE.

키워드

Affine Transform LayerBackpropagation LearningEnd-to-End Refinement LearningPre-training MethodPreprocessing LayerINFERENCE SYSTEMSIDENTIFICATIONDESIGNAID
제목
Data Transformation-driven Fuzzy Clustering Neural Network with Layer-Wise and End-to-End Training
저자
You, YuntaoWang, ZhenFu, ZunweiKim, Eun-HuHuang, HaoPedrycz, Witold
DOI
10.1109/TFUZZ.2025.3596790
발행일
2025-10
유형
Article
저널명
IEEE Transactions on Fuzzy Systems
33
10
페이지
1 ~ 16