arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Zejun Li

60 papers · 2000–2026

2000: 12001: 02002: 22003: 02004: 02005: 02006: 02007: 02008: 02009: 22010: 12011: 12012: 12013: 12014: 02015: 42016: 12017: 22018: 42019: 12020: 02021: 52022: 32023: 72024: 102025: 102026: 4
2000peak 10 in 20242026

Frequent co-authors

Papers

showing 1–25 of 60 RSS

Predicting Drug–Target Interactions With Multi-Information Fusion

Lihong Peng, Bo Liao, Wen Zhu +2 more

Computational Theory and Mathematics · IEEE Journal of Biomedical and Health Informatics · · cited 95× · DOI ↗ · more like this ·

Identifying potential associations between drugs and targets is a critical prerequisite for modern drug discovery and repurposing. However, predicting these associations is difficult because of the limitations of existing computational methods. Most models only consider chemical structures and protein sequences, and other models are oversimplified. Moreover, datasets used for analysis contain only true-positive interactions, and experimentally validated negative samples are unavailable. To overcome these limitations, we developed a semi-supervised based learning framework called NormMulInf through collaborative filtering theory by using labeled and unlabeled interaction information. The proposed method initially determines similarity measures, such as similarities among samples and local correlations among the labels of the samples, by integrating biological information. The similarity…

TCIC: Theme Concepts Learning Cross Language and Vision for Image Captioning

Zhihao Fan, Zhongyu Wei, Siyuan Wang +4 more

cs.CV · · cited 30× · arXiv ↗ · more like this ·

Existing research for image captioning usually represents an image using a scene graph with low-level facts (objects and relations) and fails to capture the high-level semantics. In this paper, we propose a Theme Concepts extended Image Captioning (TCIC) framework that incorporates theme concepts to represent high-level cross-modality semantics. In practice, we model theme concepts as memory vectors and propose Transformer with Theme Nodes (TTN) to incorporate those vectors for image captioning. Considering that theme concepts can be learned from both images and captions, we propose two settings for their representations learning based on TTN. On the vision side, TTN is configured to take both scene graph based features and theme concepts as input for visual representation learning. On the language side, TTN is configured to take both captions and theme concepts as input for text…

Drug Repositioning via Multi-View Representation Learning With Heterogeneous Graph Neural Network

Peng Li, Cheng Yang, Jiahuai Yang +5 more

Computational Theory and Mathematics · IEEE Journal of Biomedical and Health Informatics · · cited 22× · DOI ↗ · more like this ·

Exploring simple and efficient computational methods for drug repositioning has emerged as a popular and compelling topic in the realm of comprehensive drug development. The crux of this technology lies in identifying potential drug-disease associations, which can effectively mitigate the burdens caused by the exorbitant costs and lengthy periods of conventional drugs development. However, existing computational drug repositioning methods continue to encounter challenges in accurately predicting associations between drugs and diseases. In this paper, we propose a Multi-view Representation Learning method (MRLHGNN) with Heterogeneous Graph Neural Network for drug repositioning. This method is based on a collection of data from multiple biological entities associated with drugs or diseases. It consists of a view-specific feature aggregation module with meta-paths and auto multi-view…

Matching Game for Multi-Task Federated Learning in Internet of Vehicles

Zejun Li, Hao Wu, Yunlong Lu +3 more

Artificial Intelligence · IEEE Transactions on Vehicular Technology · · cited 19× · DOI ↗ · more like this ·

To overcome the inherent defects of massive data uploading and processing in traditional machine learning, federated learning is emerged as a promising tool given that it enables to implement privacy-preserved distributed machine learning in Internet of Vehicles (IoV). However, the performance of federated learning suffers from several challenges, especially ineffective execution of delay-sensitive tasks triggered simultaneously by moving vehicles. To minimize the total execution delay of multiple tasks, we propose a multi-task federated learning framework which improves task completion rate and enables each task to be completed in time. Moreover, we also aim to improve the network utility of the IoV. The algorithm of joint optimization algorithm is proposed to achieve a stable partition of vehicle coalitions based on the block coordinate descent (BCD) method, the matching game-based…

A novel information diffusion method based on network consistency for identifying disease related microRNAs

Min Chen, Peng Yan, Ang Li +5 more

Artificial Intelligence · RSC Advances · · cited 19× · DOI ↗ · more like this ·

The abnormal expression of miRNAs is directly related to the development of human diseases. Predicting the potential candidate miRNAs associated with diseases can contribute to the detection, diagnosis, treatment and prevention of human complex diseases. The effective inference of the calculation method of the relationship between miRNAs and diseases is an effective supplement to biological experiments. It is of great help in the prevention, treatment and prognosis of complex diseases. This paper proposes a novel information diffusion method based on network consistency (IDNC) for identifying disease related microRNAs. The model first synthesizes the miRNA family information and the miRNA function similarity to reconstruct the miRNA network, and reconstruct the disease network by using the known disease and miRNA-related information and the semantic score between diseases. Then the…

Unifying Local and Global Knowledge: Empowering Large Language Models as Political Experts with Knowledge Graphs

Xinyi Mou, Zejun Li, Hanjia Lyu +2 more

Artificial Intelligence · · cited 15× · DOI ↗ · more like this ·

Large Language Models (LLMs) have revolutionized solutions for general natural language processing (NLP) tasks. However, deploying these models in specific domains still faces challenges like hallucination. While existing knowledge graph retrieval-based approaches offer partial solutions, they cannot be well adapted to the political domain. On one hand, existing generic knowledge graphs lack vital political context, hindering deductions for practical tasks. On the other hand, the nature of political questions often renders the direct facts elusive, necessitating deeper aggregation and comprehension of retrieved evidence. To address these challenges, we propose a Political Experts through Knowledge Graph Integration (PEG) framework. PEG entails the creation and utilization of a multi-view political knowledge graph (MVPKG), which integrates U.S. legislative, election, and diplomatic data…

MVPTR

Zejun Li, Zhihao Fan, Huaixiao Tou +3 more

Computer Vision and Pattern Recognition · Proceedings of the 30th ACM International Conference on Multimedia · · cited 15× · DOI ↗ · more like this ·

Previous vision-language pre-training models mainly construct multi-modal inputs with tokens and objects (pixels) followed by performing cross-modality interaction between them. We argue that the input of only tokens and object features limits high-level semantic alignment like phrase-to-region grounding. Meanwhile, multi-level alignments are inherently consistent and able to facilitate the representation learning synergistically. Therefore, in this paper, we propose to learn Multi-level semantic alignment for Vision-language Pre-TRaining (MVPTR). In MVPTR, we follow the nested structure of both modalities to introduce concepts as high-level semantics. To ease the learning from multi-modal multi-level inputs, our framework is split into two stages, the first stage focuses on intra-modality multi-level representation learning, the second enforces interactions across modalities via both…

Constructing Phrase-level Semantic Labels to Form Multi-Grained Supervision for Image-Text Retrieval

Zhihao Fan, Zhongyu Wei, Zejun Li +4 more

cs.CV · · cited 14× · arXiv ↗ · more like this ·

Existing research for image text retrieval mainly relies on sentence-level supervision to distinguish matched and mismatched sentences for a query image. However, semantic mismatch between an image and sentences usually happens in finer grain, i.e., phrase level. In this paper, we explore to introduce additional phrase-level supervision for the better identification of mismatched units in the text. In practice, multi-grained semantic labels are automatically constructed for a query image in both sentence-level and phrase-level. We construct text scene graphs for the matched sentences and extract entities and triples as the phrase-level labels. In order to integrate both supervision of sentence-level and phrase-level, we propose Semantic Structure Aware Multimodal Transformer (SSAMT) for multi-modal representation learning. Inside the SSAMT, we utilize different kinds of attention…

Unifying Cross-Lingual and Cross-Modal Modeling Towards Weakly Supervised Multilingual Vision-Language Pre-training

Zejun Li, Zhihao Fan, Jingjing Chen +3 more

Computer Vision and Pattern Recognition · · cited 12× · DOI ↗ · more like this ·

Multilingual Vision-Language Pre-training (VLP) is a promising but challenging topic due to the lack of large-scale multilingual image-text pairs. Existing works address the problem by translating English data into other languages, which is intuitive and the generated data is usually limited in form and scale. In this paper, we explore a more practical and scalable setting: weakly supervised multilingual VLP with only English image-text pairs and multilingual text corpora. We argue that the universal multilingual representation learned from texts allows the cross-modal interaction learned in English to be transferable to other languages. To this end, we propose a framework to effectively unify cross-lingual and cross-modal pre-training. For unified modeling on different data, we design an architecture with flexible modules to learn different interactions. Moreover, two unified tasks are…

Identifying potential drug-target interactions based on ensemble deep learning

Liqian Zhou, Yuzhuang Wang, Lihong Peng +2 more

Computational Theory and Mathematics · Frontiers in Aging Neuroscience · · cited 11× · DOI ↗ · more like this ·

Introduction: Drug-target interaction prediction is one important step in drug research and development. Experimental methods are time consuming and laborious. Methods: In this study, we developed a novel DTI prediction method called EnGDD by combining initial feature acquisition, dimensional reduction, and DTI classification based on Gradient boosting neural network, Deep neural network, and Deep Forest. Results: EnGDD was compared with seven stat-of-the-art DTI prediction methods (BLM-NII, NRLMF, WNNGIP, NEDTP, DTi2Vec, RoFDT, and MolTrans) on the nuclear receptor, GPCR, ion channel, and enzyme datasets under cross validations on drugs, targets, and drug-target pairs, respectively. EnGDD computed the best recall, accuracy, F1-score, AUC, and AUPR under the majority of conditions, demonstrating its powerful DTI identification performance. EnGDD predicted that D00182 and hsa2099, D07871…

A path planning method for unmanned aerial vehicle based on improved wolf pack algorithm

Hao Jiang, Qizhou Yu, Dan Han +2 more

Computer Vision and Pattern Recognition · Concurrency and Computation Practice and Experience · · cited 10× · DOI ↗ · more like this ·

Summary In the rapidly developing field of unmanned aerial vehicle (UVA) technology, solving local optimal problems and achieving efficient smooth planning are crucial for improving the operational efficiency and safety of UVA systems. To address these needs, our study introduces a novel optimization algorithm, called IWPA‐APF, which aims to improve path planning efficiency. This algorithm is a fusion of the artificial potential field (APF) method and the improved wolf‐pack algorithm (IWPA) to solve common problems such as local optima and inefficient planning in the path planning process. The IWPA‐APF algorithm improves search efficiency and accuracy by incorporating an adaptive step size that significantly refines the key behaviors of the traditional IWPA, which is based on the wolf pack algorithm (WPA). In addition, the algorithm incorporates specific planning constraints, such as…

AdaDNNs: Adaptive Ensemble of Deep Neural Networks for Scene Text Recognition

Chun Yang, Xu-Cheng Yin, Zejun Li +4 more

cs.CV · · cited 7× · arXiv ↗ · more like this ·

Recognizing text in the wild is a really challenging task because of complex backgrounds, various illuminations and diverse distortions, even with deep neural networks (convolutional neural networks and recurrent neural networks). In the end-to-end training procedure for scene text recognition, the outputs of deep neural networks at different iterations are always demonstrated with diversity and complementarity for the target object (text). Here, a simple but effective deep learning method, an adaptive ensemble of deep neural networks (AdaDNNs), is proposed to simply select and adaptively combine classifier components at different iterations from the whole learning system. Furthermore, the ensemble is formulated as a Bayesian framework for classifier weighting and combination. A variety of experiments on several typical acknowledged benchmarks, i.e., ICDAR Robust Reading Competition…

THGB: predicting ligand-receptor interactions by combining tree boosting and histogram-based gradient boosting

Liqian Zhou, Jiao Song, Zejun Li +2 more

Computational Theory and Mathematics · Scientific Reports · · cited 4× · DOI ↗ · more like this ·

Ligand-receptor interaction (LRI) prediction has great significance in biological and medical research and facilitates to infer and analyze cell-to-cell communication. However, wet experiments for new LRI discovery are costly and time-consuming. Here, we propose a computational model called THGB to uncover new LRIs. THGB first extracts feature information of Ligand-Receptor (LR) pairs using iFeature. Next, it adopts a tree boosting model to obtain representative LR features. Finally, it devises the histogram-based gradient boosting model to capture high-quality LRIs. To assess the THGB performance, we compared it with three new LRI prediction models (i.e., CellEnBoost, CellGiQ, and CellComNet) and one classical protein-protein interaction inference model PIPR. The results demonstrated that THGB achieved the best overall predictions in terms of six evaluation indictors (i.e., precision…

EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Models

Mengfei Du, Binhao Wu, Zejun Li +2 more

cs.AI · · cited 4× · arXiv ↗ · more like this ·

The recent rapid development of Large Vision-Language Models (LVLMs) has indicated their potential for embodied tasks.However, the critical skill of spatial understanding in embodied environments has not been thoroughly evaluated, leaving the gap between current LVLMs and qualified embodied intelligence unknown. Therefore, we construct EmbSpatial-Bench, a benchmark for evaluating embodied spatial understanding of LVLMs.The benchmark is automatically derived from embodied scenes and covers 6 spatial relationships from an egocentric perspective.Experiments expose the insufficient capacity of current LVLMs (even GPT-4V). We further present EmbSpatial-SFT, an instruction-tuning dataset designed to improve LVLMs' embodied spatial understanding.

MVPTR: Multi-Level Semantic Alignment for Vision-Language Pre-Training via Multi-Stage Learning

Zejun Li, Zhihao Fan, Huaixiao Tou +3 more

cs.CV · · cited 4× · arXiv ↗ · more like this ·

Previous vision-language pre-training models mainly construct multi-modal inputs with tokens and objects (pixels) followed by performing cross-modality interaction between them. We argue that the input of only tokens and object features limits high-level semantic alignment like phrase-to-region grounding. Meanwhile, multi-level alignments are inherently consistent and able to facilitate the representation learning synergistically. Therefore, in this paper, we propose to learn Multi-level semantic alignment for Vision-language Pre-TRaining (MVPTR). In MVPTR, we follow the nested structure of both modalities to introduce concepts as high-level semantics. To ease the learning from multi-modal multi-level inputs, our framework is split into two stages, the first stage focuses on intra-modality multi-level representation learning, the second enforces interactions across modalities via both…

Negative Sample is Negative in Its Own Way: Tailoring Negative Sentences for Image-Text Retrieval

Zhihao Fan, Zhongyu Wei, Zejun Li +2 more

cs.CV · · cited 4× · arXiv ↗ · more like this ·

Matching model is essential for Image-Text Retrieval framework. Existing research usually train the model with a triplet loss and explore various strategy to retrieve hard negative sentences in the dataset. We argue that current retrieval-based negative sample construction approach is limited in the scale of the dataset thus fail to identify negative sample of high difficulty for every image. We propose our TAiloring neGative Sentences with Discrimination and Correction (TAGS-DC) to generate synthetic sentences automatically as negative samples. TAGS-DC is composed of masking and refilling to generate synthetic negative sentences with higher difficulty. To keep the difficulty during training, we mutually improve the retrieval and generation through parameter sharing. To further utilize fine-grained semantic of mismatch in the negative sentence, we propose two auxiliary tasks, namely…

An Unsupervised Sampling Approach for Image-Sentence Matching Using Document-Level Structural Information

Zejun Li, Zhongyu Wei, Zhihao Fan +2 more

cs.CV · · cited 4× · arXiv ↗ · more like this ·

In this paper, we focus on the problem of unsupervised image-sentence matching. Existing research explores to utilize document-level structural information to sample positive and negative instances for model training. Although the approach achieves positive results, it introduces a sampling bias and fails to distinguish instances with high semantic similarity. To alleviate the bias, we propose a new sampling strategy to select additional intra-document image-sentence pairs as positive or negative samples. Furthermore, to recognize the complex pattern in intra-document samples, we propose a Transformer based model to capture fine-grained features and implicitly construct a graph for each document, where concepts in a document are introduced to bridge the representation learning of images and sentences in the context of a document. Experimental results show the effectiveness of our…

SGcCA: Deciphering Drug–Target Interactions through an End-to-End Model with Spatial and Channel Reconstruction Convolution and Cross-Efficient-Additive Attention

Lihong Peng, Wen Liao, Zejun Li +3 more

Computational Theory and Mathematics · Journal of Chemical Information and Modeling · · cited 3× · DOI ↗ · more like this ·

Drug–Target Interaction (DTI) prediction is an indispensable process in drug repositioning. Wet-lab experiments for potential DTI identification are reliable but expensive, labor-intensive, and time-consuming. Deep learning demonstrates the superior representation learning capability in the DTI prediction. However, there is still debate about how to accurately learn drug and protein features and further effectively fuse these features. To address the above issues, this work introduces SGcCA, an end-to-end DTI prediction framework by incorporating S patial and Channel reconstruction Convolution (SCConv), G raph c onvolutional Network (GCN), and C ross-efficient-additive A ttention (CEAA). First, an SCConv module is proposed to encode drug features from their SMILES strings and protein features from their amino acid sequences by reducing spatial and channel redundancies. Next, GCN is…

Mitigating straggler effect in federated learning based on reconfigurable intelligent surface over Internet of Vehicles

Zejun Li, Hao Wu, Yunlong Lu +2 more

Artificial Intelligence · China Communications · · cited 3× · DOI ↗ · more like this ·

To protect vehicular privacy and speed up the execution of tasks, federated learning is introduced in the Internet of Vehicles (IoV) where users execute model training locally and upload local models to the base station without massive raw data exchange. However, heterogeneous computing and communication resources of vehicles cause straggler effect which weakens the reliability of federated learning. Dropping out vehicles with limited resources confines the training data. As a result, the accuracy and applicability of federated learning models will be reduced. To mitigate the straggler effect and improve performance of federated learning, we propose a reconfigurable intelligent surface (RIS)-assisted federated learning framework to enhance the communication reliability for parameter transmission in the IoV. Furthermore, we optimize the phase shift of RIS to achieve a more reliable…

VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models

Zejun Li, Ruipu Luo, Jiwen Zhang +3 more

cs.CV · · cited 2× · arXiv ↗ · more like this ·

While large multi-modal models (LMMs) have exhibited impressive capabilities across diverse tasks, their effectiveness in handling complex tasks has been limited by the prevailing single-step reasoning paradigm. To this end, this paper proposes VoCoT, a multi-step Visually grounded object-centric Chain-of-Thought reasoning framework tailored for inference with LMMs. VoCoT is characterized by two key features: (1) object-centric reasoning paths that revolve around cross-modal shared object-level information, and (2) visually grounded representation of object concepts in a multi-modal interleaved and aligned manner, which effectively bridges the modality gap within LMMs during long-term generation. To adapt LMMs in reasoning with VoCoT, we further construct an instruction-tuning dataset. By combining VoCoT with the prevalent open-source LMM architectures, we develop a VoCoT-based model…

PAFL: Parameter-Authentication Federated Learning for Internet of Vehicles

Zejun Li, Hao Wu, Yueyue Dai +1 more

Artificial Intelligence · · cited 2× · DOI ↗ · more like this ·

Federated learning is an emerging distributed learning paradigm which brings an efficient and privacy-preserving intelligent model for the Internet of Vehicles (IoV). Unfortunately, federated learning is vulnerable to abnormal model attacks as it is hard to authenticate model parameters. Abnormal local models may slow down the convergence rate, reduce the accuracy of global models, and even deliberately control the global model in the attackers' chosen way. Furthermore, an abnormal global model may deduce sensitive information about vehicles and hinder the execution of genuine tasks. Therefore, in this paper, we propose a parameter-authentication federated learning (PAFL) scheme that can protect privacy of vehicles, such as driving habits, and defend against abnormal model attacks simultane-ously. Concretely, we equip the federated learning framework with the zero knowledge proof and…

A Unified Continuous Learning Framework for Multi-modal Knowledge Discovery and Pre-training

Zhihao Fan, Zhongyu Wei, Jingjing Chen +4 more

cs.CL · · cited 2× · arXiv ↗ · more like this ·

Multi-modal pre-training and knowledge discovery are two important research topics in multi-modal machine learning. Nevertheless, none of existing works make attempts to link knowledge discovery with knowledge guided multi-modal pre-training. In this paper, we propose to unify them into a continuous learning framework for mutual improvement. Taking the open-domain uni-modal datasets of images and texts as input, we maintain a knowledge graph as the foundation to support these two tasks. For knowledge discovery, a pre-trained model is used to identify cross-modal links on the graph. For model pre-training, the knowledge graph is used as the external knowledge to guide the model updating. These two steps are iteratively performed in our framework for continuous learning. The experimental results on MS-COCO and Flickr30K with respect to both knowledge discovery and the pre-trained model…

Relieve the congestion by shuttle bus in rush hours using aggregation clustering algorithm on group travel pattern

Zejun Li, Jingjing Wang, Zhongheng Shi +1 more

Transportation · Concurrency and Computation Practice and Experience · · cited 2× · DOI ↗ · more like this ·

Summary The travel demand is of vital importance for transport planning. Especially in rush hours, the commuters aggregate in certain areas, resulting in traffic jams, which hinder the normal operation of the urban traffic. The key issue to solve the problem is to find out the demand of the passengers and accordingly arrange the transit resource more reasonably. This paper proposes a framework that provides a shuttle bus solution to satisfy the travel demand of the gathered passengers in rush hours according to their travel history obtained by smartcard data. Firstly, an aggregation algorithm basing on Clustering by fast search and find of density peaks (CFSFDP) is presented to highlight the area, which consists of adjacent bus stations with high passenger flow, addressed as spark region. Secondly, group travel pattern (GTP) is put forward to describe the travel trend on a city‐wide…

DMAGCL: A dual-masked adaptive graph contrastive learning framework for predicting circRNA-drug sensitivity

Peng Wang, Yuqi Guo, Zejun Li +4 more

Computational Theory and Mathematics · Frontiers in Genetics · · cited 1× · DOI ↗ · more like this ·

Circular RNAs (circRNAs) are a unique class of non-coding RNAs with stable covalently closed structures that play key regulatory roles in gene expression and drug response. However, experimental identification of circRNA-drug sensitivity remains labor-intensive. To overcome these limitations, we introduce DMAGCL, a Dual-Masked Graph Contrastive Learning framework, whose core innovations include: (1) a synergistic dual-masking strategy (path- and edge-level) that forces the model to learn robust representations against both macro-level path disruptions and micro-level edge noise; (2) an adaptive contrastive loss with a scheduled temperature parameter (t) to dynamically balance exploration and exploitation during training; and (3) an attention-based fusion classifier (AFC) that explicitly models complex cross-modal interactions between circRNA sequences and drug molecular graphs for…

ReForm-Eval: Evaluating Large Vision Language Models via Unified Re-Formulation of Task-Oriented Benchmarks

Zejun Li, Ye Wang, Mengfei Du +9 more

cs.CV · · cited 1× · arXiv ↗ · more like this ·

Recent years have witnessed remarkable progress in the development of large vision-language models (LVLMs). Benefiting from the strong language backbones and efficient cross-modal alignment strategies, LVLMs exhibit surprising capabilities to perceive visual signals and perform visually grounded reasoning. However, the capabilities of LVLMs have not been comprehensively and quantitatively evaluate. Most existing multi-modal benchmarks require task-oriented input-output formats, posing great challenges to automatically assess the free-form text output of LVLMs. To effectively leverage the annotations available in existing benchmarks and reduce the manual effort required for constructing new benchmarks, we propose to re-formulate existing benchmarks into unified LVLM-compatible formats. Through systematic data collection and reformulation, we present the ReForm-Eval benchmark, offering…