DHF-Net: Multimodal fake news detection via dual-path hierarchical feature fusion

Abstract

The rapid expansion of social media platforms has fueled the widespread dissemination of multimodal fake news, where misleading content is strategically conveyed through the combination of textual and visual elements. Existing multimodal fake news detection approaches still face two major challenges: inadequate exploitation of cross-modal complementary information owing to simplistic fusion strategies, and limited capacity to capture fine-grained interactions between textual semantics and visual representations. To address these issues, we propose DHF-Net, a Dual-path Hierarchical Fusion Network for multimodal fake news detection. Specifically, DHF-Net employs a BERT-BiLSTM framework to extract rich contextual semantic and temporal representations from textual content, while VGG19 is adopted to learn discriminative visual features from images. To better model the complementary relationships across modalities, two dedicated fusion mechanisms are designed: the feature-level fusion module leverages a self-attention mechanism to adaptively assign importance weights to multimodal features, suppressing noise while highlighting discriminative signals; the sentence-level fusion module integrates textual and visual representations through direct concatenation, capturing holistic cross-modal semantic associations. The outputs of the two fusion pathways are subsequently processed by independent classifiers, and the final prediction is obtained via weighted aggregation. Extensive experiments on the Twitter and Weibo benchmark datasets demonstrate that DHF-Net achieves accuracies of 92.8% and 91.7%, respectively, outperforming several competitive baseline models. These results validate the effectiveness of the proposed dual-path fusion strategy in exploiting cross-modal complementarity for multimodal fake news detection.