The paper suggests a hybrid multimodal sentiment analysis (MSA) model that would enhance the accuracy of sentiment prediction through the combination of textual, auditory, and visual information. In most cases, the traditional sentiment analysis models have been challenged because of numerous overlapping features and poor fusion methods when using multimodal data. To overcome these problems, propose a supervised contrastive learning-based methodology that will improve data representation and exploit multimodal feature fusion. The technique includes pre-processing Twitter information by tokenization, stemming, and feature extraction, and classifying it with the help of a Particle Swarm Optimization-Deep Learning Modified Neural Network (PSO-DLBMNN). The experimental findings, assessed based on the measures of accuracy, precision, recall, and F1-score, demonstrate that the suggested model is superior to the traditional approaches to deep learning, such as Bi-LSTM and Bi-GRU. In particular, the PSO-DLBMNN model had an accuracy of 95.48, a precision of 96.57, a recall of 94.87, and an F1-score of 93.45, which is a substantial increase over the baseline models. These results indicate that the model is capable of completing multiple tasks of integrating multimodal data alongside solving the problem of redundancy and data noise. The suggested method gives a fresh outlook on improving sentiment analysis through enhancing multimodal feature fusion. To sum up, the model has the potential to be applied to real-time analysis in social media and human-computer interaction systems, and it provides information about how multimodal data can be used to enhance sentiment prediction and emotional perception.
Ain QT, Ali M, Riaz A, Noureen A, Kamran M, Hayat B, Rehman AU. Sentiment analysis using deep learning techniques: a review. International Journal of Advanced Computer Science and Applications. 2017;8(6). 424-433.
2.
Prasad KR, Karanam SR, Ganesh D, Liyakat KK, Talasila V, Purushotham P. AI in public-private partnership for IT infrastructure development. The Journal of High Technology Management Research. 2024 May 1;35(1):100496.
3.
Rahman F. Scalable Safety-Constrained Learning Pipelines for Distributed Digital-Twin-Based Energy Optimization in Large-Scale Electric Mobility Systems. SECITS Journal of Scalable Distributed Computing and Pipeline Automation. 2026 Jan 10:1-8.
4.
Balakrishna N, Krishnan MB, Ganesh D. Hybrid Machine Learning Approaches for Predicting and Diagnosing Major Depressive Disorder. International Journal of Advanced Computer Science & Applications. 2024 Mar 1;15(3).
5.
Turukmane AV, Tangudu N, Sreedhar B, Ganesh D, Reddy PS, Batta U. An effective routing algorithm for load balancing in unstructured peer-to-peer networks. International Journal of Intelligent Systems and Applications in Engineering. 2023;12(7s):87-97.
6.
Ganesh D, Pavan Kumar T. A survey on advances in security threats and its counter measures in cognitive radio networks. Int J Eng Technol. 2018;7(2.8):372-8.
7.
Davanam G, Pavan Kumar T, Sunil Kumar M. Novel defense framework for cross-layer attacks in cognitive radio networks. InInternational Conference on Intelligent and Smart Computing in Data Analytics: ISCDA 2020 2021 Mar 13 (pp. 23-33). Singapore: Springer Singapore.
8.
Qin Z, Zhao P, Zhuang T, Deng F, Ding Y, Chen D. A survey of identity recognition via data fusion and feature learning. Information Fusion. 2023 Mar 1;91:694-712.
9.
Reginald PJ. Context-Driven Cooperative Intelligent Control for Distributed Cyber-Physical Actuation Platforms Using CTDE Multi-Agent Reinforcement Learning. Recent Advances in Next-Generation Wireless Communication Systems. 2025 Sep 10:43-50.
10.
Tu G, Liang B, Jiang D, Xu R. Sentiment-emotion-and context-guided knowledge selection framework for emotion recognition in conversations. IEEE Transactions on Affective Computing. 2022 Nov 21;14(3):1803-16.
11.
Zou H, Tang X, Xie B, Liu B. Sentiment classification using machine learning techniques with syntax features. In2015 international conference on computational science and computational intelligence (CSCI) 2015 Dec 7 (pp. 175-179). IEEE.
12.
Yue W, Li L. Sentiment analysis using word2vec-cnn-bilstm classification. In2020 seventh international conference on social networks analysis, management and security (SNAMS) 2020 Dec 14 (pp. 1-5). IEEE.
13.
Atrey PK, Hossain MA, El Saddik A, Kankanhalli MS. Multimodal fusion for multimedia analysis: a survey. Multimedia systems. 2010 Nov;16(6):345-79.
14.
Kumar PS. Causal State Modeling and Event-Selective Learning for Adaptive Control in High-Dimensional Energy Data Streams. Journal of Scalable Data Engineering and Intelligent Computing. 2026 Jan 10:34-42.
15.
Mazloom M, Rietveld R, Rudinac S, Worring M, Van Dolen W. Multimodal popularity prediction of brandrelated social media posts. In Proceedings of the 24th ACM international conference on Multimedia 2016 Oct 1 (pp. 197-201).
16.
Poria S, Cambria E, Howard N, Huang GB, Hussain A. Fusing audio, visual and textual clues for sentiment analysis from multimodal content. Neurocomputing. 2016 Jan 22;174:50-9.
17.
Kumar MS, Prakash KJ. Internet of things: IETF protocols, algorithms and applications. Int. J. Innov. Technol. Explor. Eng. 2019 Sep;8(11):2853-7.
18.
Rani KS, Jayadurga R, Raja VL, Kumar MS, Swathi RS, Kumar P. Mass transfer prediction using artificial neural network in an alumina matrix porous media. European Chemical Bulletin. 2022;11(11):113-20.
19.
Godala S, Kumar MS. Retracted Article: A weight optimized deep learning model for cluster-based intrusion detection system. Optical and Quantum Electronics. 2023 Dec;55(14):1224.
20.
Subbaiah B, Murugesan K, Saravanan P, Marudhamuthu K. An efficient multimodal sentiment analysis in social media using hybrid optimal multi-scale residual attention network. Artificial Intelligence Review. 2024 Feb 5;57(2):34.
The statements, opinions and data contained in the journal are solely those of the individual authors and contributors and not of the publisher and the editor(s). We stay neutral with regard to jurisdictional claims in published maps and institutional affiliations.
,
