Quantum neural networks for multimodal sentiment, emotion, and sarcasm analysis
  • Singh, Jaiteg
  • Bhangu, Kamalpreet Singh
  • Alkhanifer, Abdulrhman
  • Alzubi, Ahmad Ali
  • Ali, Farman
Citations

WEB OF SCIENCE

4
Citations

SCOPUS

4

초록

Sentiment, emotion, and sarcasm analysis in multimodal dialogues is crucial for understanding the underlying intentions and attitudes expressed by individuals. Traditional methods often struggle to capture the full intensity of these polarities, leading to less accurate results. To address this limitation, we propose a quantum-inspired approach leveraging Quantum Neural Networks (QNNs) for enhanced classification and intensity analysis. A key component of our method is the Variational Quantum Eigensolver (VQE), a hybrid quantum-classical algorithm that optimizes the parameters of the QNN by minimizing the eigenvalues of a Hamiltonian system. This optimization enables the network to learn complex relationships in multimodal data more effectively. Our approach surpasses state-of-the-art methods, achieving up to 7.5 % higher accuracy and 6.8 % greater precision. Experiments on benchmark datasets such as MUStARD, Memotion, CMU-MOSEI, and MELD demonstrate its effectiveness, with an F1-score of 87.3 % on CMU-MOSEI. This method is particularly beneficial in domains like social media, customer support, and entertainment, where both verbal and non-verbal cues play a critical role in accurate sentiment analysis.

키워드

Multimodal dialogueEmotion quantificationQuantum cognitionVariational Quantum Eigensolver (VQE)Quantum Neural Networks (QNN)FUSION
제목
Quantum neural networks for multimodal sentiment, emotion, and sarcasm analysis
저자
Singh, JaitegBhangu, Kamalpreet SinghAlkhanifer, AbdulrhmanAlzubi, Ahmad AliAli, Farman
DOI
10.1016/j.aej.2025.03.023
발행일
2025-06
유형
Article
저널명
AEJ - Alexandria Engineering Journal
124
페이지
170 ~ 187