arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Kebin Wu

14 papers · 1999–2025

1999: 12000: 02001: 02002: 12003: 02004: 02005: 12006: 02007: 02008: 02009: 02010: 02011: 02012: 02013: 02014: 12015: 02016: 02017: 02018: 02019: 02020: 02021: 12022: 02023: 32024: 32025: 3
1999peak 3 in 20232025

Frequent co-authors

Papers

showing 1–14 of 14 RSS

SDTP: Semantic-aware Decoupled Transformer Pyramid for Dense Image Prediction

Zekun Li, Yufan Liu, Bing Li +3 more

cs.CV · · cited 25× · arXiv ↗ · more like this ·

Although transformer has achieved great progress on computer vision tasks, the scale variation in dense image prediction is still the key challenge. Few effective multi-scale techniques are applied in transformer and there are two main limitations in the current methods. On one hand, self-attention module in vanilla transformer fails to sufficiently exploit the diversity of semantic information because of its rigid mechanism. On the other hand, it is hard to build attention and interaction among different levels due to the heavy computational burden. To alleviate this problem, we first revisit multi-scale problem in dense prediction, verifying the significance of diverse semantic representation and multi-scale interaction, and exploring the adaptation of transformer to pyramidal structure. Inspired by these findings, we propose a novel Semantic-aware Decoupled Transformer Pyramid (SDTP)…

How social security keeps older persons out of poverty across developed countries

Kebin Wu

Demography · Econstor (Econstor) · · cited 11× · OpenAlex ↗ · more like this ·

Social Security is a major retirement income source for older persons in the United States and other developed countries. Without Social Security income, a large portion of the older population would live in poverty in all developed countries. This report analyzes how or to what extent Social Security keeps older persons out of poverty across developed countries by examining changes in poverty rates of older persons with and without Social Security income.

Using generalized Choquet integral in projection pursuit based classification

Kebin Wu, Zhenyuan Wang, Pheng‐Ann Heng +1 more

Statistics and Probability · · cited 7× · DOI ↗ · more like this ·

A generalized Choquet integral with respect to a nonadditive sign measure is proposed, and serves as an aggregation tool to project the points of feature space onto a real axis to reduce an n-dimensional classification problem into a one-dimensional classification problem. The learning procedure of this new classification algorithm, GCIPP (Generalized Choquet Integral based Projection Pursuit), is just pursuing an appropriate projection direction optimally according to a criterion of minimizing the global misclassification rate. Such a nonlinear projection is characterized by the nonadditive sign measure and two weight vectors. The nonadditive sign measure is a proper representation of the contribution rate of each combination of the feature attributes, including each singleton, toward the classification, and its nonadditivity reflects the interactions among the feature attributes.…

FineLIP: Extending CLIP's Reach via Fine-Grained Alignment with Longer Text Inputs

Mothilal Asokan, Kebin Wu, Fatima Albreiki

cs.CV · · cited 5× · arXiv ↗ · more like this ·

As a pioneering vision-language model, CLIP (Contrastive Language-Image Pre-training) has achieved significant success across various domains and a wide range of downstream vision-language tasks. However, the text encoders in popular CLIP models are limited to processing only 77 text tokens, which constrains their ability to effectively handle longer, detail-rich captions. Additionally, CLIP models often struggle to effectively capture detailed visual and textual information, which hampers their performance on tasks that require fine-grained analysis. To address these limitations, we present a novel approach, \textbf{FineLIP}, that extends the capabilities of CLIP. FineLIP enhances cross-modal text-image mapping by incorporating \textbf{Fine}-grained alignment with \textbf{L}onger text input within the CL\textbf{IP}-style framework. FineLIP first extends the positional embeddings to…

A Simple and Effective Design for Intelligent Sub-Nyquist Modulation Recognition

Kebin Wu, Yu Tian, Ebtesam Almazrouei +1 more

Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

Automatic modulation recognition of sub-Nyquist spectrum sensing is essential to demodulate and process the signals in a spectrum- and energy-efficient Internet of Things system. Motivated by the recent advances of deep learning, a promising direction is to automatically predict the modulation based on data-driven representation instead of hand-crafted features. Specifically, our solution SHELL (Simple solution witH ELegant detaiLs) provides a simple yet effective approach, which is capable of achieving high modulation recognition accuracy without complex network structure. Our solution obtained the 1st place in the ‘GBSense challenge 2022’ <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> . <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> http://www.gbsense.net/challenge/

Adaptive striping watershed segmentation method for processing microscopic images of overlapping irregular‐shaped and multicentre particles

Xi Xiao, Bingxin Bai, Ning Xu +1 more

Computer Vision and Pattern Recognition · Journal of Microscopy · · cited 4× · DOI ↗ · more like this ·

Oversegmentation is a major drawback of the morphological watershed algorithm. Here, we study and reveal that the oversegmentation is not only because of the irregular shapes of the particle images, which people are familiar with, but also because of some particles, such as ellipses, with more than one centre. A new parameter, the striping level, is introduced and the criterion for striping parameter is built to help find the right markers prior to segmentation. An adaptive striping watershed algorithm is established by applying a procedure, called the marker searching algorithm, to find the markers, which can effectively suppress the oversegmentation. The effectiveness of the proposed method is validated by analysing some typical particle images including the images of gold nanorod ensembles.

IPixMatch: Boost Semi-supervised Semantic Segmentation with Inter-Pixel Relation

Kebin Wu, Wenbin Li, Xiaofei Xiao

cs.CV · · cited 3× · arXiv ↗ · more like this ·

The scarcity of labeled data in real-world scenarios is a critical bottleneck of deep learning's effectiveness. Semi-supervised semantic segmentation has been a typical solution to achieve a desirable tradeoff between annotation cost and segmentation performance. However, previous approaches, whether based on consistency regularization or self-training, tend to neglect the contextual knowledge embedded within inter-pixel relations. This negligence leads to suboptimal performance and limited generalization. In this paper, we propose a novel approach IPixMatch designed to mine the neglected but valuable Inter-Pixel information for semi-supervised learning. Specifically, IPixMatch is constructed as an extension of the standard teacher-student network, incorporating additional loss terms to capture inter-pixel relations. It shines in low-data regimes by efficiently leveraging the limited…

Positional Bias in Multimodal Embedding Models: Do They Favor the Beginning, the Middle, or the End?

Kebin Wu, Fatima Albreiki

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Positional bias - where models overemphasize certain positions regardless of content - has been shown to negatively impact model performance across various tasks. While recent research has extensively examined positional bias in text generation models, its presence and effects in representation models remain underexplored. Even less is known about such biases in multimodal models. In this work, we investigate positional bias in multimodal representation models, specifically in the context of image-text retrieval. We begin by distinguishing between context importance and positional bias, and then assess the presence and extent of positional bias across different models and datasets. Our experiments demonstrate that positional bias is prevalent in multimodal models, but manifests differently across modalities: text encoders tend to exhibit bias toward the beginning of the input, whereas…

VisCon-100K: Leveraging Contextual Web Data for Fine-tuning Vision Language Models

Gokul Karthik Kumar, Iheb Chaabane, Kebin Wu

cs.CL · · cited 0× · arXiv ↗ · more like this ·

Vision-language models (VLMs) excel in various visual benchmarks but are often constrained by the lack of high-quality visual fine-tuning data. To address this challenge, we introduce VisCon-100K, a novel dataset derived from interleaved image-text web documents. Our approach transforms 45K web documents from the OBELICS dataset into 100K image conversation samples. We utilize GPT-4V to generate image-contextual captions and OpenChat 3.5 model to convert these captions into diverse free-form and multiple-choice question-answer pairs. Integrating this dataset for fine-tuning considerably enhances VLM performance across multiple benchmarks. Unlike methods that focus solely on fine-grained visual content, our approach leverages accompanying web context, yielding superior results. We also discover that a 'leaky modality mix', where conversation samples contain questions answerable from both…

Uni-Mlip: Unified Self-supervision for Medical Vision Language Pre-training

Ameera Bawazir, Kebin Wu, Wenbin Li

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Recent advancements in vision-language pre-training via contrastive learning have significantly improved performance across computer vision tasks. However, in the medical domain, obtaining multimodal data is often costly and challenging due to privacy, sensitivity, and annotation complexity. To mitigate data scarcity while boosting model performance, we introduce \textbf{Uni-Mlip}, a unified self-supervision framework specifically designed to enhance medical vision-language pre-training. Uni-Mlip seamlessly integrates cross-modality, uni-modality, and fused-modality self-supervision techniques at the data-level and the feature-level. Additionally, Uni-Mlip tailors uni-modal image self-supervision to accommodate the unique characteristics of medical images. Our experiments across datasets of varying scales demonstrate that Uni-Mlip significantly surpasses current state-of-the-art methods…

Semantic Segmentation Based on Multiple Granularity Learning

Kebin Wu, Ameera Bawazir, Xiaofei Xiao +4 more

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

Accurate and robust coarse semantic segmentation plays a key role in the pursuit of autonomous driving. We present an algorithm that regularizes the representation space of Semantic Segmentation by Multiple Granularity Learning (SSMGL). This approach explores multiple levels of semantic knowledge in an unified framework, where the fine-grained semantic information can be either labeled or unlabeled. In our experiments, we find that SSMGL can achieve better results (1) on both on-road and off-road benchmarks, (2) under different segmentation architectures, or (3) with different backbones. The method is plug-and-play, not specialized for autonomous driving applications, and can be easily extended to any other segmentation scenario. Moreover, our SSMGL approach does not increase the computational overhead in the inference stage.

Molecular Characterization of Binding of Substrates and Inhibitors to DT-Diaphorase: Combined Approach Involving Site-Directed Mutagenesis, Inhibitor-Binding Analysis, and

Computer Modeling, Shiuan Chen, Kebin Wu +4 more

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

The molecular basis of the interaction of DT-diaphorase with a cytotoxic nitrobenzamide CB1954 [5-(aziridin-1-yl)-2,4-dinitro-benzamide] and five inhibitors was investigated with wild-type DT-diaphorase (human and rat) and five mutants [three rat mutants (rY128D, rG150V, rH194D) and two human mutants (hY155F, hH161Q)]. hY155F and hH161Q were generated to evaluate a hypothesis that Tyr155 and His161 participate in the obligatory two-electron transfer reaction of the enzyme. The catalytic properties of hY155F and hH161Q were compared with a naturally occurring mutant, hP187S. Pro187 to Ser mu-tation disturbs the structure of the central parallel b-sheet, resulting in a reduction of the binding affinity of the flavin-adenine dinucleotide prosthetic group. With NADH as the elec-tron donor and menadione as the electron acceptor, the kcat

AccidentGPT: Large Multi-Modal Foundation Model for Traffic Accident Analysis

Kebin Wu, Wenbin Li, Xiaofei Xiao

cs.LG · · arXiv ↗ · more like this ·

Traffic accident analysis is pivotal for enhancing public safety and developing road regulations. Traditional approaches, although widely used, are often constrained by manual analysis processes, subjective decisions, uni-modal outputs, as well as privacy issues related to sensitive data. This paper introduces the idea of AccidentGPT, a foundation model of traffic accident analysis, which incorporates multi-modal input data to automatically reconstruct the accident process video with dynamics details, and furthermore provide multi-task analysis with multi-modal outputs. The design of the AccidentGPT is empowered with a multi-modality prompt with feedback for task-oriented adaptability, a hybrid training schema to leverage labelled and unlabelled data, and a edge-cloud split configuration for data privacy. To fully realize the functionalities of this model, we proposes several research…

Multimodal Transformers for Wireless Communications: A Case Study in Beam Prediction

Yu Tian, Qiyang Zhao, Zine el abidine Kherroubi +3 more

eess.SP · · arXiv ↗ · more like this ·

Wireless communications at high-frequency bands with large antenna arrays face challenges in beam management, which can potentially be improved by multimodality sensing information from cameras, LiDAR, radar, and GPS. In this paper, we present a multimodal transformer deep learning framework for sensing-assisted beam prediction. We employ a convolutional neural network to extract the features from a sequence of images, point clouds, and radar raw data sampled over time. At each convolutional layer, we use transformer encoders to learn the hidden relations between feature tokens from different modalities and time instances over abstraction space and produce encoded vectors for the next-level feature extraction. We train the model on a combination of different modalities with supervised learning. We try to enhance the model over imbalanced data by utilizing focal loss and exponential…