arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Yanping Fu

29 papers · 2014–2025

2014: 22015: 12016: 02017: 12018: 12019: 22020: 52021: 12022: 52023: 42024: 42025: 3
2014peak 5 in 20202025

Frequent co-authors

Papers

showing 1–25 of 29 RSS

Texture Mapping for 3D Reconstruction with RGB-D Sensor

Yanping Fu, Qingan Yan, Long Yang +2 more

Computer Vision and Pattern Recognition · · cited 97× · DOI ↗ · more like this ·

Acquiring realistic texture details for 3D models is important in 3D reconstruction. However, the existence of geometric errors, caused by noisy RGB-D sensor data, always makes the color images cannot be accurately aligned onto reconstructed 3D models. In this paper, we propose a global-to-local correction strategy to obtain more desired texture mapping results. Our algorithm first adaptively selects an optimal image for each face of the 3D model, which can effectively remove blurring and ghost artifacts produced by multiple image blending. We then adopt a non-rigid global-to-local correction step to reduce the seaming effect between textures. This can effectively compensate for the texture and the geometric misalignment caused by camera pose drift and geometric errors. We evaluate the proposed algorithm in a range of complex scenes and demonstrate its effective performance in…

Joint Texture and Geometry Optimization for RGB-D Reconstruction

Yanping Fu, Qingan Yan, Jie Liao +1 more

Computer Vision and Pattern Recognition · · cited 34× · DOI ↗ · more like this ·

Due to inevitable noises and quantization error, the reconstructed 3D models via RGB-D sensors always accompany geometric error and camera drifting, which consequently lead to blurring and unnatural texture mapping results. Most of the 3D reconstruction methods focus on either geometry refinement or texture improvement respectively, which subjectively decouples the inter-relationship between geometry and texture. In this paper, we propose a novel approach that can jointly optimize the camera poses, texture and geometry of the reconstructed model, and color consistency between the key-frames. Instead of computing Shape-From-Shading (SFS) expensively, our method directly optimizes the reconstructed mesh according to color and geometric consistency and high-boost normal cues, which can effectively overcome the texture-copy problem generated by SFS and achieve more detailed shape…

Pyramid Multi‐View Stereo with Local Consistency

Jie Liao, Yanping Fu, Qingan Yan +1 more

Computer Vision and Pattern Recognition · Computer Graphics Forum · · cited 30× · DOI ↗ · more like this ·

Abstract In this paper, we propose a PatchMatch‐based Multi‐View Stereo (MVS) algorithm which can efficiently estimate geometry for the textureless area. Conventional PatchMatch‐based MVS algorithms estimate depth and normal hypotheses mainly by optimizing photometric consistency metrics between patch in the reference image and its projection on other images. The photometric consistency works well in textured regions but can not discriminate textureless regions, which makes geometry estimation for textureless regions hard work. To address this issue, we introduce the local consistency. Based on the assumption that neighboring pixels with similar colors likely belong to the same surface and share approximate depth‐normal values, local consistency guides the depth and normal estimation with geometry from neighboring pixels with similar colors. To fasten the convergence of pixelwise local…

Surface Reconstruction via Fusing Sparse-Sequence of Depth Images

Long Yang, Qingan Yan, Yanping Fu +1 more

Computer Vision and Pattern Recognition · IEEE Transactions on Visualization and Computer Graphics · · cited 28× · DOI ↗ · more like this ·

Handheld scanning using commodity depth cameras provides a flexible and low-cost manner to get 3D models. The existing methods scan a target by densely fusing all the captured depth images, yet most frames are redundant. The jittering frames inevitably embedded in handheld scanning process will cause feature blurring on the reconstructed model and even trigger the scan failure (i.e., camera tracking losing). To address these problems, in this paper, we propose a novel sparse-sequence fusion (SSF) algorithm for handheld scanning using commodity depth cameras. It first extracts related measurements for analyzing camera motion. Then based on these measurements, we progressively construct a supporting subset for the captured depth image sequence to decrease the data redundancy and the interference from jittering frames. Since SSF will reveal the intrinsic heavy noise of the original depth…

NeuralRoom

Yusen Wang, Zongcheng Li, Yu Jiang +4 more

Computer Vision and Pattern Recognition · ACM Transactions on Graphics · · cited 22× · DOI ↗ · more like this ·

We present a novel neural surface reconstruction method called NeuralRoom for reconstructing room-sized indoor scenes directly from a set of 2D images. Recently, implicit neural representations have become a promising way to reconstruct surfaces from multiview images due to their high-quality results and simplicity. However, implicit neural representations usually cannot reconstruct indoor scenes well because they suffer severe shape-radiance ambiguity. We assume that the indoor scene consists of texture-rich and flat texture-less regions. In texture-rich regions, the multiview stereo can obtain accurate results. In the flat area, normal estimation networks usually obtain a good normal estimation. Based on the above observations, we reduce the possible spatial variation range of implicit neural surfaces by reliable geometric priors to alleviate shape-radiance ambiguity. Specifically, we…

Seamless Texture Optimization for RGB-D Reconstruction

Yanping Fu, Qingan Yan, Jie Liao +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Visualization and Computer Graphics · · cited 19× · DOI ↗ · more like this ·

Restoring high-fidelity textures for 3D reconstructed models are an increasing demand in AR/VR, cultural heritage protection, entertainment, and other relevant fields. Due to geometric errors and camera pose drifting, existing texture mapping algorithms are either plagued by blurring and ghosting or suffer from undesirable visual seams. In this paper, we propose a novel tri-directional similarity texture synthesis method to eliminate the texture inconsistency in RGB-D 3D reconstruction and generate visually realistic texture mapping results. In addition to RGB color information, we incorporate a novel color image texture detail layer serving as an additional context to improve the effectiveness and robustness of the proposed method. First, we select an optimal texture image for each triangle face of the reconstructed model to avoid texture blurring and ghosting. During the selection…

Sparse RGB-D images create a real thing: A flexible voxel based 3D reconstruction pipeline for single object

Fei Luo, Yongqiong Zhu, Yanping Fu +3 more

Computer Vision and Pattern Recognition · Visual Informatics · · cited 13× · DOI ↗ · more like this ·

Reconstructing 3D models for single objects with complex backgrounds has wide applications like 3D printing, AR/VR, and so on. It is necessary to consider the tradeoff between capturing data at low cost and getting high-quality reconstruction results. In this work, we propose a voxel-based modeling pipeline with sparse RGB-D images to effectively and efficiently reconstruct a single real object without the geometrical post-processing operation on background removal. First, referring to the idea of VisualHull, useless and inconsistent voxels of a targeted object are clipped. It helps focus on the target object and rectify the voxel projection information. Second, a modified TSDF calculation and voxel filling operations are proposed to alleviate the problem of depth missing in the depth images. They can improve TSDF value completeness for voxels on the surface of the object. After the…

Rapid and precise phase retrieval from two-frame tilt-shift based on Lissajous ellipse fitting and ellipse standardization

Yanping Fu, Qianchao Wu, Yong Yao +5 more

Computer Vision and Pattern Recognition · Optics Express · · cited 11× · DOI ↗ · more like this ·

A rapid and precise phase-retrieval method based on Lissajous ellipse fitting and ellipse standardization is demonstrated. It only requires two interferograms without pre-filtering, which reduces its complexity and shortens the processing time. The elliptic coefficients obtained by ellipse fitting are used for ellipse standardization. After compensating phase-shift errors by ellipse standardization, the phase distribution is extracted with high precision. It is suitable for fluctuation, noise, tilt-shift, simple and complex fringes. This method is effective for the number of fringes less than 1. The reliability of the method is verified by simulations and experiments, indicating high accuracy and less time consumption.

An improved median filter for removing extensive salt and pepper noise

Yanyan Wei, Yan Shi, Ling Yang +1 more

Computer Vision and Pattern Recognition · Lanzhou University Institutional Repository · · cited 9× · DOI ↗ · more like this ·

In this paper, an improved median filtering algorithm is proposed for the restoration of images that are highly corrupted by salt and pepper noise. The proposed algorithm (PA) replaces the noisy pixel with the median of the already processed pixel values of the selected window, in which all the pixels are noisy, by considering two complementary processing directions. It turns out that PA can efficiently remove the salt and pepper noise when the noise level is higher than 60%. Simulation results are given to illustrate that PA can be applied to not only gray scale but also color image denoising and outperforms the existing methods in terms of the qualitative and quantitative measures of the restored image.

Text-Region Matching for Multi-Label Image Recognition with Missing Labels

Leilei Ma, Hongxing Xie, Lei Wang +3 more

cs.CV · · cited 7× · arXiv ↗ · more like this ·

Recently, large-scale visual language pre-trained (VLP) models have demonstrated impressive performance across various downstream tasks. Motivated by these advancements, pioneering efforts have emerged in multi-label image recognition with missing labels, leveraging VLP prompt-tuning technology. However, they usually cannot match text and vision features well, due to complicated semantics gaps and missing labels in a multi-label image. To tackle this challenge, we propose $\textbf{T}$ext-$\textbf{R}$egion $\textbf{M}$atching for optimizing $\textbf{M}$ulti-$\textbf{L}$abel prompt tuning, namely TRM-ML, a novel method for enhancing meaningful cross-modal matching. Compared to existing methods, we advocate exploring the information of category-aware regions rather than the entire image or pixels, which contributes to bridging the semantic gap between textual and visual representations in…

Single Image Reflection removal Using Feature Difference Enhancement

Haifeng Zhao, Rui Zhou, Shaojie Zhang +1 more

Computer Vision and Pattern Recognition · · cited 4× · DOI ↗ · more like this ·

Most existing reflection removal methods pay too much attention to the transmission layer and ignore the mutual complementary mechanisms between the transmission layer and the reflection layer. To make full use of the complementarity and distinction between the reflection and transmission layers in reflection-contaminated images, we propose a novel single image reflection removal framework using the feature difference and adaptive information exchange between the transmission and reflection layers of reflection-contaminated images. First, we design a feature difference enhancement module to distinguish and enhance the feature difference of the reflective and transmissive layers. Second, we propose an adaptive information exchange module between transmission and reflection layers in the decoder, which can capture more complementary information. Finally, we introduce a 1/4 selective…

NeuralRoom: Geometry-Constrained Neural Implicit Surfaces for Indoor Scene Reconstruction

Yusen Wang, Zongcheng Li, Yu Jiang +4 more

cs.CV · · cited 4× · arXiv ↗ · more like this ·

We present a novel neural surface reconstruction method called NeuralRoom for reconstructing room-sized indoor scenes directly from a set of 2D images. Recently, implicit neural representations have become a promising way to reconstruct surfaces from multiview images due to their high-quality results and simplicity. However, implicit neural representations usually cannot reconstruct indoor scenes well because they suffer severe shape-radiance ambiguity. We assume that the indoor scene consists of texture-rich and flat texture-less regions. In texture-rich regions, the multiview stereo can obtain accurate results. In the flat area, normal estimation networks usually obtain a good normal estimation. Based on the above observations, we reduce the possible spatial variation range of implicit neural surfaces by reliable geometric priors to alleviate shape-radiance ambiguity. Specifically, we…

Transparent object segmentation from casually captured videos

Jie Liao, Yanping Fu, Qingan Yan +1 more

Computer Vision and Pattern Recognition · Computer Animation and Virtual Worlds · · cited 4× · DOI ↗ · more like this ·

Abstract Segmentation of transparent objects from sequences can be very useful in computer vision applications. However, without additional auxiliary information it can be hard work for traditional segmentation methods, as light in the transparent area captured by RGB cameras mostly derive from the background and the appearance of transparent objects changes with surroundings. In this article, we present a from‐coarse‐to‐fine transparent object segmentation method, which utilizes trajectory clustering to roughly distinguish the transparent from the background and refine the segmentation based on combination information of color and distortion. We further incorporate the transparency saliency with color and trajectory smoothness throughout the video to acquire a spatiotemporal segmentation based on graph‐cut. We conduct our method on various datasets. The results demonstrate that our…

DGECN: A Depth-Guided Edge Convolutional Network for End-to-End 6D Pose Estimation

Tuo Cao, Fei Luo, Yanping Fu +3 more

cs.CV · · cited 3× · arXiv ↗ · more like this ·

Monocular 6D pose estimation is a fundamental task in computer vision. Existing works often adopt a two-stage pipeline by establishing correspondences and utilizing a RANSAC algorithm to calculate 6 degrees-of-freedom (6DoF) pose. Recent works try to integrate differentiable RANSAC algorithms to achieve an end-to-end 6D pose estimation. However, most of them hardly consider the geometric features in 3D space, and ignore the topology cues when performing differentiable RANSAC algorithms. To this end, we proposed a Depth-Guided Edge Convolutional Network (DGECN) for 6D pose estimation task. We have made efforts from the following three aspects: 1) We take advantages ofestimated depth information to guide both the correspondences-extraction process and the cascaded differentiable RANSAC algorithm with geometric information. 2)We leverage the uncertainty ofthe estimated depth map to improve…

Dense multiview stereo based on image texture enhancement

Jie Liao, Mengqiang Wei, Yanping Fu +2 more

Computer Vision and Pattern Recognition · Computer Animation and Virtual Worlds · · cited 3× · DOI ↗ · more like this ·

Abstract In this paper, we propose a novel Multiview Stereo (MVS) method which can effectively estimate geometry in low‐textured regions. Conventional MVS algorithms predict geometry by performing dense correspondence estimation across multiple views under the constraint of epipolar geometry. As low‐textured regions contain less feature information for reliable matching, estimating geometry for low‐textured regions remains hard work for previous MVS methods. To address this issue, we propose an MVS method based on texture enhancement. By enhancing texture information for each input image via our multiscale bilateral decomposition and reconstruction algorithm, our method can estimate reliable geometry for low‐textured regions that are intractable for previous MVS methods. To densify the final output point cloud, we further propose a novel selective joint bilateral propagation filter…

Mixed Word Representation and Minimal Bi-GRU Model for Sentiment Analysis

Yanping Fu, Yun Liu, Yajing Wang +2 more

Artificial Intelligence · · cited 3× · DOI ↗ · more like this ·

In the mission of natural language processing, sentiment analysis is a formidable challenge due to the complexity of deep network architecture and the lack of standard sentiment word representation. In this paper, we proposed a new learning method of the word representation for the comprehensive information of texts and a minimal Bi-GRU (bidirectional gate recurrent unit) model for the task of sentiment classification. First, for capturing sentiment information of words, the supervised three-layer network is used for construct sentiment word representation. We propose the mixed word representation to denote the classification characteristics, which combines the word embedding of neural probabilistic language model with the proposed the sentiment word representation. Next, we propose bidirectional GRU network including forward and backward propagation to consider the semantic relations…

AlignFuse: Multi-feature Alignment and Fusion for Medical Image Segmentation

Shengyang Chao, Zijun Liu, Lili Huang +1 more

Computer Vision and Pattern Recognition · · cited 2× · DOI ↗ · more like this ·

U-Net, which is a U-shaped network, has made great progress on numerous medical image segmentation tracks. However, even if convolutional neural network (CNN) has a talent for extracting local information, it falls short in capturing global information due to the inherent drawback of the convolution operation. In contrast, whereby the design of tokenized images and self-attention mechanism, Transformer has a brilliant performance in modeling global contextual information but has a poor performance in grasping low-level details on account of the patch division which leads to ignorance of local correlation in each patch. In this paper, we develop a hybrid network structure, AlignFuse, which is in possession of the advantages of both CNN and Transformer. AlignFuse fits CNN and Transformer together in a parallel style, where Transformer leverages the high-level features and CNN pays more…

Depth‐Aware Shadow Removal

Yanping Fu, Zhenyu Gai, Haifeng Zhao +4 more

Computer Vision and Pattern Recognition · Computer Graphics Forum · · cited 2× · DOI ↗ · more like this ·

Abstract Shadow removal from a single image is an ill‐posed problem because shadow generation is affected by the complex interactions of geometry, albedo, and illumination. Most recent deep learning‐based methods try to directly estimate the mapping between the non‐shadow and shadow image pairs to predict the shadow‐free image. However, they are not very effective for shadow images with complex shadows or messy backgrounds. In this paper, we propose a novel end‐to‐end depth‐aware shadow removal method without using depth images, which estimates depth information from RGB images and leverages the depth feature as guidance to enhance shadow removal and refinement. The proposed framework consists of three components, including depth prediction, shadow removal, and boundary refinement. First, the depth prediction module is used to predict the corresponding depth map of the input shadow…

Folding patch correspondence for multiview stereo

Jie Liao, Yanping Fu, Qingan Yan +1 more

Computer Vision and Pattern Recognition · Computer Animation and Virtual Worlds · · cited 2× · DOI ↗ · more like this ·

Abstract In this article, we propose the novel folding patch model which can replace the traditional patch model utilized in patch‐based multiview stereo (MVS) methods to significantly improve the reconstruction results. The patch model is applied as an approximation of the scene surface differential in the geometric estimation procedure. By minimizing the photometric discrepancy of the projection of the patch model on multiple source images, patch‐based MVS algorithms optimize the position and normal values for the 3D hypothesis of the target pixel. The optimization is based on the assumption that the patch model can fit the target scene surface perfectly. However, when it comes to complex scenes crowded with sharp edges, splintery surfaces, or round surfaces, the patch model is inherently not suitable since even from the microscopic perspective these surfaces are not entirely flat. We…

TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenes

Yanping Fu, Wenbin Liao, Xinyuan Liu +4 more

cs.CV · · cited 1× · arXiv ↗ · more like this ·

As an emerging task that integrates perception and reasoning, topology reasoning in autonomous driving scenes has recently garnered widespread attention. However, existing work often emphasizes "perception over reasoning": they typically boost reasoning performance by enhancing the perception of lanes and directly adopt MLP to learn lane topology from lane query. This paradigm overlooks the geometric features intrinsic to the lanes themselves and are prone to being influenced by inherent endpoint shifts in lane detection. To tackle this issue, we propose an interpretable method for lane topology reasoning based on lane geometric distance and lane query similarity, named TopoLogic. This method mitigates the impact of endpoint shifts in geometric space, and introduces explicit similarity calculation in semantic space as a complement. By integrating results from both spaces, our methods…

Spectrum prediction for high-frequency radar based on Extreme Learning Machine

Yang Zhi-fen, Ling Yang, Yanping Fu

Artificial Intelligence · Lanzhou University Institutional Repository · · cited 1× · DOI ↗ · more like this ·

In this paper, a new predictive method based on Extreme Learning Machine is proposed to predict the spectrum data obtained from by frequency monitoring system of high-frequency radar. In order to improve the forecasting accuracy and real-time of spectrum prediction of high-frequency radar, Empirical Mode Decomposition method is used for the preprocessing of spectrum data. Based on the simulation environment of MATLAB, compared with the predictive method based on support vector regression, the results show that the proposed method performs better both at forecasting accuracy and speed.

Blind equalization of short burst signals based on twin support vector regressor and data-reusing method

Ling Yang, Yanping Fu, Yang Zhi-fen +1 more

Signal Processing · Lanzhou University Institutional Repository · · cited 1× · DOI ↗ · more like this ·

In this paper, blind equalization of short burst signals is formulated with the twin support vector regressor (TSVR) framework. The proposed algorithm combine the conventional cost function of TSVR with classical error function applied to blind equalization: the Godard's error function that describes the relationship between the input signals and the desired output signals of a blind equalizer is contained in the penalty terms of TSVR, and the iterative re-weighted least square (IRWLS) algorithm is used for twin support vector regressor to achieve fast convergence. In addition, it utilizes the data-reusing method for small amounts of data samples to reach stable convergence. Simulation experiments for constant modulus signals are done to prove the feasibility and validity of the proposed algorithm.

RAGNet: Large-scale Reasoning-based Affordance Segmentation Benchmark towards General Grasping

Dongming Wu, Yanping Fu, Saike Huang +8 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

General robotic grasping systems require accurate object affordance perception in diverse open-world scenarios following human instructions. However, current studies suffer from the problem of lacking reasoning-based large-scale affordance prediction data, leading to considerable concern about open-world effectiveness. To address this limitation, we build a large-scale grasping-oriented affordance segmentation benchmark with human-like instructions, named RAGNet. It contains 273k images, 180 categories, and 26k reasoning instructions. The images cover diverse embodied data domains, such as wild, robot, ego-centric, and even simulation data. They are carefully annotated with an affordance map, while the difficulty of language instructions is largely increased by removing their category name and only providing functional descriptions. Furthermore, we propose a comprehensive…

Fully Automated SAM for Single-source Domain Generalization in Medical Image Segmentation

Huanli Zhuo, Leilei Ma, Haifeng Zhao +3 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Although SAM-based single-source domain generalization models for medical image segmentation can mitigate the impact of domain shift on the model in cross-domain scenarios, these models still face two major challenges. First, the segmentation of SAM is highly dependent on domain-specific expert-annotated prompts, which prevents SAM from achieving fully automated medical image segmentation and therefore limits its application in clinical settings. Second, providing poor prompts (such as bounding boxes that are too small or too large) to the SAM prompt encoder can mislead SAM into generating incorrect mask results. Therefore, we propose the FA-SAM, a single-source domain generalization framework for medical image segmentation that achieves fully automated SAM. FA-SAM introduces two key innovations: an Auto-prompted Generation Model (AGM) branch equipped with a Shallow Feature Uncertainty…

3D Reconstruction and Texture Optimization Based on Differentiable Rendering

Yongxin Liu, Haifeng Zhao, Shaojie Zhang +1 more

Computer Vision and Pattern Recognition · · cited 0× · DOI ↗ · more like this ·

Due to noise and quantization errors inherent in depth cameras, RGB-D based 3D reconstruction algorithms inevitably suffer from defects such as texture blurring and ghosting. However, current texture optimization methods tend to only focus on optimizing one aspect, such as camera pose, geometry, or texture, without considering the highly coupled relationship between them. As a result, it is difficult to achieve global optimality. To address this issue, we propose a joint optimization framework based on differentiable rendering that simultaneously optimizes camera pose, geometry, and texture. By fully exploiting the complementary relationship between these aspects, we are able to reconstruct textures with high fidelity while recovering fine geometric details. First, we propose an optimized geometry model combined with adaptive subdivision, where we selectively subdivide the model only in…