Author

Yuming Xiang

29 papers · 2017–2026

2017peak 5 in 20232026

Frequent co-authors

Papers

showing 1–25 of 29 RSS

OS-SIFT: A Robust SIFT-Like Algorithm for High-Resolution Optical-to-SAR Image Registration in Suburban Areas

Computer Vision and Pattern Recognition · IEEE Transactions on Geoscience and Remote Sensing · 30 Jan 2018 · cited 303× · DOI ↗ · more like this ·

Although the scale-invariant feature transform (SIFT) algorithm has been successfully applied to both optical image registration and synthetic aperture radar (SAR) image registration, SIFT-like algorithms have failed to register high-resolution (HR) optical and SAR images due to large geometric differences and intensity differences. In this paper, to perform optical-to-SAR (OS) image registration, we proposed an advanced SIFT-like algorithm (OS-SIFT) that consists of three main modules: keypoint detection in two Harris scale spaces, orientation assignment and descriptor extraction, and keypoint matching. Considering the inherent properties of SAR images and optical images, the multiscale ratio of exponentially weighted averages and multiscale Sobel operators are used to calculate consistent gradients for the SAR images and optical images on the basis of which, as a result, two Harris…

Automatic Registration of Optical and SAR Images Via Improved Phase Congruency Model

Yuming Xiang, Rongshu Tao, Feng Wang +2 more

Computer Vision and Pattern Recognition · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · 2020 · cited 129× · DOI ↗ · more like this ·

In this article, we propose an automatic and efficient method to solve optical and synthetic aperture radar (SAR) image registration using the improved phase congruency (PC) model. First, evenly distributed keypoints are extracted from the optical images via the block-Harris method. Complementary grid points are then selected in image regions with poor structural information and supplemented to the keypoint set. For each keypoint, a robust feature representation that captures the local spatial relationship is proposed based on the improved PC model. Specifically, we propose to use two different PC models, the classic PC and the SAR-PC, to construct features for optical and SAR images, respectively. The PC features of several directions are aggregated to construct the feature descriptors, and a similarity metric via the phase correlation of feature descriptors is obtained. The proposed…

SAR-PC: Edge Detection in SAR Images via an Advanced Phase Congruency Model

Yuming Xiang, Feng Wang, Ling Wan +1 more

Computer Vision and Pattern Recognition · Remote Sensing · 25 Feb 2017 · cited 43× · DOI ↗ · more like this ·

Edge detection in Synthetic Aperture Radar (SAR) images has been a challenging task due to the speckle noise. Ratio-based edge detectors are robust operators for SAR images that provide constant false alarm rates, but they are only optimal for step edges. Edge detectors developed by the phase congruency model provide the identification of different types of edge features, but they suffer from speckle noise. By combining the advantages of the two edge detectors, we propose a SAR phase congruency detector (SAR-PC). Firstly, an improved local energy model for SAR images is obtained by replacing the convolution of raw image and the quadrature filters by the ratio responses. Secondly, a new noise level is estimated for the multiplicative noise. Substituting the SAR local energy and the new noise level into the phase congruency model, SAR-PC is derived. Edge response corresponds to the max…

A Robust Two-Stage Registration Algorithm for Large Optical and SAR Images

Yuming Xiang, Niangang Jiao, Feng Wang +1 more

Computer Vision and Pattern Recognition · IEEE Transactions on Geoscience and Remote Sensing · 8 Dec 2021 · cited 30× · DOI ↗ · more like this ·

Accurate optical and synthetic aperture radar (SAR) image registration is crucial to multisensor remote sensing applications. Though several algorithms have been proposed, the practical implementation that directly matches large and high-resolution optical and SAR images remains underexplored by the community. Equipped with the satellite positioning parameters, optical and SAR images can be roughly registered based on geographic coordinates. However, the relative positioning accuracy is still dozens, even hundreds of pixels due to the inaccuracies of sensor parameters and elevation. Consequently, we propose a robust registration algorithm, which consists of two stages, where the horizontal positioning errors can be reduced in the first stage, and then, we fine-tune the correspondences in the second stage. Specifically, we propose a novel template matching method based on the dilated…

A Global-to-Local Algorithm for High-Resolution Optical and SAR Image Registration

Yuming Xiang, Xuanqi Wang, Feng Wang +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Geoscience and Remote Sensing · 2023 · cited 26× · DOI ↗ · more like this ·

Multi-sensor remote sensing applications require the registration of optical and Synthetic Aperture Radar (SAR) images, which presents challenges due to significant radiometric and geometric differences resulting from distinct imaging mechanisms. Although various algorithms have been proposed, including hand-crafted features and deep learning networks, most of them focus on matching radiometric-invariant features while ignoring geometric differences. Furthermore, these algorithms often achieve promising results on datasets that use manually labeled ground truths that may be less reliable for high-resolution SAR images affected by speckle noise. To address these issues, we propose a robust global-to-local registration algorithm consisting of four modules: geocoding, global matching, local matching, and refinement. We generate a geometry-invariant mask in the geocoding module to help the…

An Edge-Sense Bidirectional Pyramid Network for Stereo Matching of VHR Remote Sensing Images

Rongshu Tao, Yuming Xiang, Hongjian You

Computer Vision and Pattern Recognition · Remote Sensing · 9 Dec 2020 · cited 26× · DOI ↗ · more like this ·

As an essential step in 3D reconstruction, stereo matching still faces unignorable problems due to the high resolution and complex structures of remote sensing images. Especially in occluded areas of tall buildings and textureless areas of waters and woods, precise disparity estimation has become a difficult but important task. In this paper, we develop a novel edge-sense bidirectional pyramid stereo matching network to solve the aforementioned problems. The cost volume is constructed from negative to positive disparities since the disparity range in remote sensing images varies greatly and traditional deep learning networks only work well for positive disparities. Then, the occlusion-aware maps based on the forward-backward consistency assumption are applied to reduce the influence of the occluded area. Moreover, we design an edge-sense smoothness loss to improve the performance of…

An Advanced Rotation Invariant Descriptor for SAR Image Registration

Yuming Xiang, Feng Wang, Ling Wan +1 more

Computer Vision and Pattern Recognition · Remote Sensing · 4 Jul 2017 · cited 17× · DOI ↗ · more like this ·

The Scale-Invariant Feature Transform (SIFT) algorithm and its many variants have been widely used in Synthetic Aperture Radar (SAR) image registration. The SIFT-like algorithms maintain rotation invariance by assigning a dominant orientation for each keypoint, while the calculation of dominant orientation is not robust due to the effect of speckle noise in SAR imagery. In this paper, we propose an advanced local descriptor for SAR image registration to achieve rotation invariance without assigning a dominant orientation. Based on the improved intensity orders, we first divide a circular neighborhood into several sub-regions. Second, rotation-invariant ratio orientation histograms of each sub-region are proposed by accumulating the ratio values of different directions in a rotation-invariant coordinate system. The proposed descriptor is composed of the concatenation of the histograms of…

Detector-Free Feature Matching for Optical and SAR Images Based on a Two-Step Strategy

Yuming Xiang, Liting Jiang, Feng Wang +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Geoscience and Remote Sensing · 2024 · cited 13× · DOI ↗ · more like this ·

Optical and synthetic aperture radar (SAR) image matching presents a formidable challenge due to their pronounced geometric and radiometric distinctions arising from multimodality. The distinct imaging mechanisms of optical and SAR sensors make it challenging to identify essentially homologous points in the physical sense, raising concerns about the accuracy and repeatability of correspondences in current feature matching methods. In this study, we introduce a detector-free feature matching algorithm specifically designed to match optical and SAR images through a two-step strategy. In the initial phase, our proposed method conducts pixelwise matching (PM) using downsampled feature descriptors, eliminating the necessity to identify repeatable keypoints. To mitigate complexity, we enforce a pseudo-epipolar constraint (PEC) to reduce computational costs by constraining the search range.…

Automatic Registration of Optical and SAR Images VIA Improved Phase Congruency

Yuming Xiang, Rongshu Tao, Feng Wang +1 more

Computer Vision and Pattern Recognition · July 2019 · cited 12× · DOI ↗ · more like this ·

Owing to the property of being constant to image contrast and the identification of various types of features, phase congruency (PC) model has been widely used in remote sensing applications. However, when the PC is directly applied to optical and synthetic aperture radar (SAR) image registration, it fails to handle large radiometric and geometric differences. In this paper, we propose an automatic algorithm to solve this problem. First, evenly-distributed keypoints are extracted from the optical images via the block harris method. Complementary grid points are selected in image regions with poor structure and texture information. Then a robust similarity metric based on the improved PC model is proposed. Since the two images show diverse properties, we utilize two different PC models, the traditional PC and the SAR-PC. The PC values of several directions are aggregated to construct the…

A NOVEL AND FAST CORNER DETECTION METHOD FOR SAR IMAGERY

Niangang Jiao, Wenchao Kang, Yuming Xiang +1 more

Computer Vision and Pattern Recognition · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences · 13 Sep 2017 · cited 10× · DOI ↗ · more like this ·

Abstract. Corners play an important role on image processing, while it is difficult to detect reliable and repeatable corners in SAR images due to the complex property of SAR sensors. In this paper, we propose a fast and novel corner detection method for SAR imagery. First, a local processing window is constructed for each point. We use the local mean of a 3 x 3 mask to represent a single point, which is weighted by a Gaussian template. Then the candidate point is compared with 16 surrounding points in the processing window. Considering the multiplicative property of speckle noise, the similarity measure between the center point and the surrounding points is calculated by the ratio of their local means. If there exist more than M continuous points are different from the center point, then the candidate point is labelled as a corner point. Finally, a selection strategy is implemented by…

An improved KAZE algorithm for SAR image matching

Sourabh Paul, A. Sherly Alphonse, Pratham Gupta +4 more

Computer Vision and Pattern Recognition · Remote Sensing Letters · 29 Jul 2024 · cited 8× · DOI ↗ · more like this ·

The KAZE algorithm has been popularly used to match the remote sensing images. However, it has limited performance when its standard form is directly applied to match the synthetic aperture radar (SAR) images containing significant multiplicative speckle noise. In this paper, an effective SAR image matching algorithm is proposed, which is a combination of KAZE, phase congruency, and speckle noise removing anisotropic diffusion. In this algorithm, the ratio-based Phase Congruency (PC) information is used to eliminate the erroneous features, which improves the repeatability rate of the KAZE features. In addition, the scale layers of the input SAR images are constructed by speckle noise removing anisotropic diffusion method which significantly reduces the effect of noise. The proposed method can improve the repeatability of the extracted KAZE features. Moreover, it can give better recall…

A Confidence-Aware Cascade Network for Multi-Scale Stereo Matching of Very-High-Resolution Remote Sensing Images

Rongshu Tao, Yuming Xiang, Hongjian You

Computer Vision and Pattern Recognition · Remote Sensing · 30 Mar 2022 · cited 7× · DOI ↗ · more like this ·

Stereomatching plays an essential role in 3D reconstruction using very-high-resolution (VHR) remote sensing images. However, it still faces unignorable challenges due to the multi-scale objects in large scenes and the multi-modality probability distribution in challenging regions, especially the occluded and textureless areas. Accurate disparity estimation in stereo matching for multi-scale objects has become a hard but crucial task. In this paper, to tackle these problems, we design a novel confidence-aware unimodal cascade and fusion pyramid network for stereo matching. The fused cost volume from the coarsest scale is used to generate the initial disparity map, and then the learnable confidence maps are generated to construct the unimodal cost distributions, which are used to narrow down the next-stage disparity search range. Moreover, we design a cross-scale interaction aggregation…

A Robust Multiscale Edge Detection Method for Accurate SAR Image Registration

Linhui Wang, Yuming Xiang, Hongjian You +2 more

Computer Vision and Pattern Recognition · IEEE Geoscience and Remote Sensing Letters · 2023 · cited 6× · DOI ↗ · more like this ·

Edge detection is a technique used to identify inherent structures within an image, and it is an essential requirement for synthetic aperture radar (SAR) applications. In particular, ratio-based edge detectors have been widely used in SAR image registration because of their ability to extract invariant features and reduce the effects of speckle noise. However, current edge detectors often struggle to accurately detect multi-scale objects and low-contrast structures. To address this issue, we present a robust multi-scale edge detector that uses a modified convolution kernel to improve the extensibility of edge features and aggregates multi-scale feature responses. We also propose a local scale estimation module to enhance edge responses in low-contrast areas and reduce noise effects. The experimental results demonstrate that our proposed method effectively preserves the integrity…

A General Framework of Remote Sensing Epipolar Image Generation

Xuanqi Wang, Feng Wang, Yuming Xiang +1 more

Computer Vision and Pattern Recognition · Remote Sensing · 11 Nov 2021 · cited 5× · DOI ↗ · more like this ·

Epipolar images can improve the efficiency and accuracy of dense matching by restricting the search range of correspondences from 2-D to 1-D, which play an important role in 3-D reconstruction. As most of the satellite images in archives are incidental collections, which do not have rigorous stereo properties, in this paper, we propose a general framework to generate epipolar images for both in-track and cross-track stereo images. We first investigate the theoretical epipolar constraints of single-sensor and multi-sensor images and then introduce the proposed framework in detail. Considering large elevation changes in mountain areas, the publicly available digital elevation model (DEM) is applied to reduce the initial offsets of two stereo images. The left image is projected into the image coordinate system of the right image using the rational polynomial coefficients (RPCs). By…

Decentralized Adaptive Formation via Consensus-Oriented Multi-Agent Communication

Yuming Xiang, Sizhao Li, Rongpeng Li +2 more

cs.AI · 23 Jul 2023 · cited 3× · arXiv ↗ · more like this ·

Adaptive multi-agent formation control, which requires the formation to flexibly adjust along with the quantity variations of agents in a decentralized manner, belongs to one of the most challenging issues in multi-agent systems, especially under communication-limited constraints. In this paper, we propose a novel Consensus-based Decentralized Adaptive Formation (Cons-DecAF) framework. Specifically, we develop a novel multi-agent reinforcement learning method, Consensus-oriented Multi-Agent Communication (ConsMAC), to enable agents to perceive global information and establish the consensus from local states by effectively aggregating neighbor messages. Afterwards, we leverage policy distillation to accomplish the adaptive formation adjustment. Meanwhile, instead of pre-assigning specific positions of agents, we employ a displacement-based formation by Hausdorff distance to significantly…

Learning to Find the Optimal Correspondence Between SAR and Optical Image Patches

Haoyuan Li, Fang Xu, Wen Yang +4 more

Computer Vision and Pattern Recognition · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · 2023 · cited 3× · DOI ↗ · more like this ·

This study addresses the problem of finding the optimal correspondence for a given synthetic aperture radar (SAR) image patch from a large collection of optical reference patches, which is crucial for various applications, including remote sensing, place recognition, and aircraft navigation. However, achieving one-to-one SAR-Optical patch correspondence is challenging due to the distinct modal discrepancy and the poor discriminability of the target instances. To address these challenges, we propose a cross-modal patch correspondence scheme that consists of two modules: A retrieval-based coarse search module and a correspondence refinement module. Specifically, to explicitly represent the modal discrepancy, we first introduce a cross-modal adversarial learning strategy in the coarse search module and learn the modal-invariant feature embedding for retrieval. Furthermore, to improve the…

Orthorectification of High-resolution SAR Images in Island Regions Based on Fast Multimodal Registration

Yuming XIANG, Fei TENG, Linhui WANG +3 more

Computer Vision and Pattern Recognition · DOAJ (DOAJ: Directory of Open Access Journals) · August 2024 · cited 2× · DOI ↗ · more like this ·

With the successive launch of high-resolution Synthetic Aperture Radar (SAR) satellites, conducting all-weather, all-time high-precision observation of island regions with variable weather conditions has become feasible. As a key preprocessing step in various remote sensing applications, orthorectification relies on high-precision control points to correct the geometric positioning errors of SAR images. However, obtaining artificial control points that meet SAR correction requirements in island areas is costly and risky. To address this challenge, this study first proposes a rapid registration algorithm for optical and SAR heterogeneous images, and then automatically extracts control points based on an optical reference base map, achieving orthorectification of SAR images in island regions. The proposed registration algorithm consists of two stages: constructing dense common features of…

Stereo Matching of VHR Remote Sensing Images via Bidirectional Pyramid Network

Rongshu Tao, Yuming Xiang, Hongjian You

Computer Vision and Pattern Recognition · 26 Sep 2020 · cited 2× · DOI ↗ · more like this ·

Stereo matching, an essential step in 3D reconstruction, still faces unignorable problems due to the very high resolution and complex structures of remote sensing images. Especially in occluded areas of high buildings and untextured areas of waters and woods, precise disparity estimation has become a difficult but important task. In this paper, we propose a novel method based on the pyramid stereo matching network to solve the aforementioned problems. Inspired by the classical optical flow estimation framework, we adopt the forward-backward consistency assumption to improve the accuracy. Moreover, we improve the construction of cost volume since the traditional deep-learning networks only work well for positive disparities and the disparity ranges in remote sensing images vary a lot. The proposed network is compared with two baselines. The experimental results show that our proposed…

Shape Similarity Measure Method Based on Principal Curvature Enhancement Distance Transformation

Feng Wang, Yuming Xiang, Xinghui Yao +1 more

Computer Vision and Pattern Recognition · July 2018 · cited 2× · DOI ↗ · more like this ·

The conventional shape similarity measurements of remote sensing data face problems in the situation of noise interference, partial information occlusion and missing. A method of shape similarity measurement based on principal curvature enhancement distance transformation is proposed. The distance transformation is carried out to extend the range of the shape contour, improving the robustness of the similarity measure. Besides, to ensure the accuracy of measurement results, the distance map is enhanced by the principal curvature of the shape contour, improving the response of contours with rich information. Application experiments of road vectors with GPS data and optical remote sensing images show that the method is effective in practical application.

Enhancing Photogrammetric DSM Based on Multiscale and Domain-Invariant Semantic Feature Learning

Xuanqi Wang, Liting Jiang, Yuming Xiang +4 more

Computer Vision and Pattern Recognition · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · 2025 · cited 1× · DOI ↗ · more like this ·

Despite the rapid development of stereo matching techniques, digital surface models (DSMs) reconstructed from disparities suffer from occlusion, solar shadow, and textureless ambiguity, thus failing to meet the requirements of 3D city modeling. To address this challenge, we proposed a DSM refinement network (RDSMNet) to improve the accuracy and completeness of photogrammetric DSMs. RDSMNet uptakes high-level semantic information from ortho-rectified stereo pairs using Transformer-based UNet architecture to preserve object structures of varying sizes. Meanwhile, a residual branch corrects the DSM values, which is combined with the semantic branch to generate the final refined result. Considering the significant diversity present in remote sensing images, we adopt the mixed-style technique to enhance the generalization capability of DSM refinement. To validate the performance of RDSMNet…

Imitation Learning based Alternative Multi-Agent Proximal Policy Optimization for Well-Formed Swarm-Oriented Pursuit Avoidance

Sizhao Li, Yuming Xiang, Rongpeng Li +2 more

cs.AI · 6 Nov 2023 · cited 1× · arXiv ↗ · more like this ·

Multi-Robot System (MRS) has garnered widespread research interest and fostered tremendous interesting applications, especially in cooperative control fields. Yet little light has been shed on the compound ability of formation, monitoring and defence in decentralized large-scale MRS for pursuit avoidance, which puts stringent requirements on the capability of coordination and adaptability. In this paper, we put forward a decentralized Imitation learning based Alternative Multi-Agent Proximal Policy Optimization (IA-MAPPO) algorithm to provide a flexible and communication-economic solution to execute the pursuit avoidance task in well-formed swarm. In particular, a policy-distillation based MAPPO executor is firstly devised to capably accomplish and swiftly switch between multiple formations in a centralized manner. Furthermore, we utilize imitation learning to decentralize the formation…

SAOF: A Semantic-Aware Optical Flow Framework for Fine-Grained Disparity Estimation in High-Resolution Satellite Stereo Images

Dingkai Wang, Feng Wang, Jingyi Cao +5 more

Computer Vision and Pattern Recognition · Remote Sensing · 12 Dec 2025 · cited 0× · DOI ↗ · more like this ·

Disparity estimation from high-resolution satellite stereo images is critical for 3D reconstruction but remains challenging due to large disparities, complex structures, and textureless regions. To address this, we propose a Semantic-Aware Optical Flow (SAOF) framework for fine-grained disparity estimation, which enhances optical flow-based via a multi-level optimization incorporating sub-top pyramid re-PatchMatch, scale-adaptive matching windows, and multi-feature cost refinement. For improving the spatial consistency of the resulting disparity map, SAMgeo-Reg is utilized to produce semantic prototypes, which are used to build guidance embeddings for integration into the optical flow estimation process. Experiments on the US3D dataset demonstrate that SAOF outperforms state-of-the-art methods across challenging scenarios. It achieves an average endpoint error (EPE) of 1.317 and a D1…

RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarms

Ziyao Wang, Rongpeng Li, Sizhao Li +4 more

cs.MA · July 2025 · cited 0× · arXiv ↗ · more like this ·

Intelligent control of Unmanned Aerial Vehicles (UAVs) swarms has emerged as a critical research focus, and it typically requires the swarm to navigate effectively while avoiding obstacles and achieving continuous coverage over multiple mission targets. Although traditional Multi-Agent Reinforcement Learning (MARL) approaches offer dynamic adaptability, they are hindered by the semantic gap in numerical communication and the rigidity of homogeneous role structures, resulting in poor generalization and limited task scalability. Recent advances in Large Language Model (LLM)-based control frameworks demonstrate strong semantic reasoning capabilities by leveraging extensive prior knowledge. However, due to the lack of online learning and over-reliance on static priors, these works often struggle with effective exploration, leading to reduced individual potential and overall system…

Unsupervised Stereo Matching Network For VHR Remote Sensing Images Based On Error Prediction

Liting Jiang, Yuming Xiang, Feng Wang +1 more

cs.CV · 14 Aug 2024 · cited 0× · arXiv ↗ · more like this ·

Stereo matching in remote sensing has recently garnered increased attention, primarily focusing on supervised learning. However, datasets with ground truth generated by expensive airbone Lidar exhibit limited quantity and diversity, constraining the effectiveness of supervised networks. In contrast, unsupervised learning methods can leverage the increasing availability of very-high-resolution (VHR) remote sensing images, offering considerable potential in the realm of stereo matching. Motivated by this intuition, we propose a novel unsupervised stereo matching network for VHR remote sensing images. A light-weight module to bridge confidence with predicted error is introduced to refine the core model. Robust unsupervised losses are formulated to enhance network convergence. The experimental results on US3D and WHU-Stereo datasets demonstrate that the proposed network achieves superior…

Crowd intelligent cooperative obstacle avoidance method inspired by brain attention mechanism

Yuming XIANG, Kun CHEN, Zhifeng ZHAO +2 more

Computer Vision and Pattern Recognition · DOAJ (DOAJ: Directory of Open Access Journals) · March 2022 · cited 0× · OpenAlex ↗ · more like this ·

A crowd intelligent (CI) system often acquires, calculates, and transmits a large amount of redundant information during the performing of exploration tasks, which inevitably results in inefficient use of the limited resources.Therefore, it emerges a strong incentive to design a task-driven mechanism for efficient utilization of computing and communication resources.A crowd intelligent cooperative obstacle avoidance method inspired by brain attention mechanism was proposed.Inspired by brain attention mechanism, the CI system introduced an intelligent selection module based on the deep Q network, by efficiently tuning the working state of sensors exploring the unknown environment and realized the acquisition and calculation of key necessary information with as little sensor overhead as possible.Meanwhile, based on the optimal reciprocal collision avoidance algorithm, a single agent fuses…