arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Di Lin

123 papers · 1999–2026

1999: 12000: 02001: 02002: 32003: 12004: 02005: 22006: 12007: 12008: 42009: 02010: 22011: 52012: 32013: 12014: 42015: 82016: 22017: 12018: 32019: 82020: 62021: 32022: 102023: 132024: 112025: 192026: 11
1999peak 19 in 20252026

Frequent co-authors

Papers

showing 1–25 of 123 RSS

ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentation

Di Lin, Jifeng Dai, Jiaya Jia +2 more

cs.CV · · cited 1,149× · arXiv ↗ · more like this ·

Large-scale data is of crucial importance for learning semantic segmentation models, but annotating per-pixel masks is a tedious and inefficient procedure. We note that for the topic of interactive image segmentation, scribbles are very widely used in academic research and commercial software, and are recognized as one of the most user-friendly ways of interacting. In this paper, we propose to use scribbles to annotate images, and develop an algorithm to train convolutional networks for semantic segmentation supervised by scribbles. Our algorithm is based on a graphical model that jointly propagates information from scribbles to unmarked pixels and learns network parameters. We present competitive object semantic segmentation results on the PASCAL VOC dataset by using scribbles as annotations. Scribbles are also favored for annotating stuff (e.g., water, sky, grass) that has no…

Deep LAC: Deep localization, alignment and classification for fine-grained recognition

Di Lin, Xiaoyong Shen, Cewu Lu +1 more

Computer Vision and Pattern Recognition · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · · cited 349× · DOI ↗ · more like this ·

We propose a fine-grained recognition system that incorporates part localization, alignment, and classification in one deep neural network. This is a nontrivial process, as the input to the classification module should be functions that enable back-propagation in constructing the solver. Our major contribution is to propose a valve linkage function (VLF) for back-propagation chaining and form our deep localization, alignment and classification (LAC) system. The VLF can adaptively compromise the errors of classification and alignment when training the LAC model. It in turn helps update localization. The performance on fine-grained object data bears out the effectiveness of our LAC system.

Cascaded Feature Network for Semantic Segmentation of RGB-D Images

Di Lin, Guangyong Chen, Daniel Cohen‐Or +2 more

Computer Vision and Pattern Recognition · · cited 160× · DOI ↗ · more like this ·

Fully convolutional network (FCN) has been successfully applied in semantic segmentation of scenes represented with RGB images. Images augmented with depth channel provide more understanding of the geometric information of the scene in the image. The question is how to best exploit this additional information to improve the segmentation performance. In this paper, we present a neural network with multiple branches for segmenting RGB-D images. Our approach is to use the available depth to split the image into layers with common visual characteristic of objects/scenes, or common “scene-resolution”. We introduce context-aware receptive field (CaRF) which provides a better control on the relevant contextual information of the learned features. Equipped with CaRF, each branch of the network semantically segments relevant similar scene-resolution, leading to a more focused domain which is…

MISF: Multi-level Interactive Siamese Filtering for High-Fidelity Image Inpainting

Xiaoguang Li, Qing Guo, Di Lin +3 more

cs.CV · · cited 129× · arXiv ↗ · more like this ·

Although achieving significant progress, existing deep generative inpainting methods are far from real-world applications due to the low generalization across different scenes. As a result, the generated images usually contain artifacts or the filled pixels differ greatly from the ground truth. Image-level predictive filtering is a widely used image restoration technique, predicting suitable kernels adaptively according to different input scenes. Inspired by this inherent advantage, we explore the possibility of addressing image inpainting as a filtering task. To this end, we first study the advantages and challenges of image-level predictive filtering for image inpainting: the method can preserve local structures and avoid artifacts but fails to fill large missing areas. Then, we propose semantic filtering by conducting filtering on the deep feature level, which fills the missing…

Learning Important Spatial Pooling Regions for Scene Classification

Di Lin, Cewu Lu, Renjie Liao +1 more

Computer Vision and Pattern Recognition · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · · cited 126× · DOI ↗ · more like this ·

We address the false response influence problem when learning and applying discriminative parts to construct the mid-level representation in scene classification. It is often caused by the complexity of latent image structure when convolving part filters with input images. This problem makes mid-level representation, even after pooling, not distinct enough to classify input data correctly to categories. Our solution is to learn important spatial pooling regions along with their appearance. The experiments show that this new framework suppresses false response and produces improved results on several datasets, including MIT-Indoor, 15-Scene, and UIUC 8-Sport. When combined with global image features, our method achieves state-of-the-art performance on these datasets.

Two-Class Weather Classification

Cewu Lu, Di Lin, Jiaya Jia +1 more

Computer Vision and Pattern Recognition · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · · cited 100× · DOI ↗ · more like this ·

Given a single outdoor image, this paper proposes a collaborative learning approach for labeling it as either sunny or cloudy. Never adequately addressed, this twoclass classification problem is by no means trivial given the great variety of outdoor images. Our weather feature combines special cues after properly encoding them into feature vectors. They then work collaboratively in synergy under a unified optimization framework that is aware of the presence (or absence) of a given weather cue during learning and classification. Extensive experiments and comparisons are performed to verify our method. We build a new weather image dataset consisting of 10K sunny and cloudy images, which is available online together with the executable.

SCN: Switchable Context Network for Semantic Segmentation of RGB-D Images

Di Lin, Ruimao Zhang, Yuanfeng Ji +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Cybernetics · · cited 91× · DOI ↗ · more like this ·

Context representations have been widely used to profit semantic image segmentation. The emergence of depth data provides additional information to construct more discriminating context representations. Depth data preserves the geometric relationship of objects in a scene, which is generally hard to be inferred from RGB images. While deep convolutional neural networks (CNNs) have been successful in solving semantic segmentation, we encounter the problem of optimizing CNN training for the informative context using depth data to enhance the segmentation accuracy. In this paper, we present a novel switchable context network (SCN) to facilitate semantic segmentation of RGB-D images. Depth data is used to identify objects existing in multiple image regions. The network analyzes the information in the image regions to identify different characteristics, which are then used selectively through…

ZigZagNet: Fusing Top-Down and Bottom-Up Context for Object Segmentation

Di Lin, Dingguo Shen, Siting Shen +4 more

Computer Vision and Pattern Recognition · · cited 72× · DOI ↗ · more like this ·

Multi-scale context information has proven to be essential for object segmentation tasks. Recent works construct the multi-scale context by aggregating convolutional feature maps extracted by different levels of a deep neural network. This is typically done by propagating and fusing features in a one-directional, top-down and bottom-up, manner. In this work, we introduce ZigZagNet, which aggregates a richer multi-context feature map by using not only dense top-down and bottom-up propagation, but also by introducing pathways crossing between different levels of the top-down and the bottom-up hierarchies, in a zig-zag fashion. Furthermore, the context information is exchanged and aggregated over multiple stages, where the fused feature maps from one stage are fed into the next one, yielding a more comprehensive context for improved segmentation performance. Our extensive evaluation on the…

Graphical passwords & qualitative spatial relations

Di Lin, Paul Dunphy, Patrick Olivier +1 more

Information Systems · · cited 65× · DOI ↗ · more like this ·

A potential drawback of graphical password schemes is that they are more vulnerable to shoulder surfing than conventional alphanumeric text passwords. We present a variation of the Draw-a-Secret scheme originally proposed by Jermyn et al [1] that is more resistant to shoulder surfing through the use of a qualitative mapping between user strokes and the password, and the use of dynamic grids to both obfuscate attributes of the user secret and encourage them to use different surface realizations of the secret. The use of qualitative spatial relations relaxes the tight constraints on the reconstruction of a secret; allowing a range of deviations from the original. We describe QDAS (Qualitative Draw-A-Secret), an initial implementation of this graphical password scheme, and the results of an empirical study in which we examined the memorability of secrets, and their susceptibility to…

Blockchain Consensus Based User Access Strategies in D2D Networks for Data-Intensive Applications

Di Lin, Yu Tang

Information Systems · IEEE Access · · cited 49× · DOI ↗ · more like this ·

A device-to-device (D2D) underlying cellular network is pervasive to support various wireless applications. However, due to the dramatic increase of data transmission in the network with limited amount of wireless resource, a few users may be required to temporarily disconnect from the network to avoid the interruption of data transmission in the whole network. A critical issue of determining the user access in D2D underlying networks is the authenticity of channel state information (CSI), and usually, a user with a higher CSI can be allocated a larger amount of wireless resource or have a higher probability of staying in the network. In this paper, we propose a blockchain consensus-based scheme to verify the authenticity of CSI and add the users who intentionally advocate a higher value of CSI into a fraud chain. Also, we consider both the cross-tier interference caused by a mobile…

Intelligent Bearing Anomaly Detection for Industrial Internet of Things Based on Auto-Encoder Wasserstein Generative Adversarial Network

Ruonan Liu, Dong Xiao, Di Lin +1 more

Artificial Intelligence · IEEE Internet of Things Journal · · cited 48× · DOI ↗ · more like this ·

Bearing anomaly detection plays a crucial role in modern industries as most rotating machinery faults are attributed to faulty bearings. However, acquiring fault samples in industry is a time-consuming and expensive process. To address this issue, this paper presents an integrated unsupervised learning method named AE-AnoWGAN (Autoencoder Wasserstein Generative Adversarial Network). AE-AnoWGAN is capable of detecting abnormal bearings and performing anomaly localization without the need for labeled data. In this approach, industrial data is initially processed using continuous wavelet transform to convert it into time-frequency representations (TFRs). These TFRs are then fed into the integrated AE-AnoWGAN for training. AE-AnoWGAN consists of multiple encoder-decoder and discriminator pairs, which are randomly paired and trained using adversarial training. The encoder maps the TFRs to a…

DSLN: Securing Internet of Things Through RF Fingerprint Recognition in Low-SNR Settings

Weiwei Wu, Su Hu, Di Lin +1 more

Artificial Intelligence · IEEE Internet of Things Journal · · cited 46× · DOI ↗ · more like this ·

The explosive growth of Internet of Things (IoT) has mandated the security of data access. Although authentication methods can enhance network security, their vulnerability to malicious attacks may be a barrier for the wide deployments in IoT scenarios. To address the security issue, we advocate the use of physical-layer security through radio-frequency (RF) fingerprint recognition. Observing that most RF fingerprint recognition methods show a degradation of performance under low signal-to-noise ratio (SNR) environments, we present a dynamic shrinkage learning network (DSLN) to enhance security for IoT applications, particularly in the setting of low SNR. We design a novel dynamic shrinkage threshold for improving the accuracy of recognition under low-SNR environments. Additionally, we design an identity shortcut for reducing the running time of RF fingerprint recognition. In comparison…

Dynamic Sample Selection for Federated Learning with Heterogeneous Data in Fog Computing

Lingshuang Cai, Di Lin, Jiale Zhang +1 more

Artificial Intelligence · UTS ePRESS (University of Technology Sydney) · · cited 45× · DOI ↗ · more like this ·

Federated learning is a state-of-the-art technology used in the fog computing, which allows distributed learning to train cross-device data while achieving efficient performance. Many current works have optimized the federated learning algorithm in homogeneous networks. However, in the actual application scenario of distributed learning, data is independently generated by each device, and this non-homologous data has different distribution characteristics. Therefore, the data used by each device for local learning is unbalanced and non-IID, and the heterogeneity of data affects the performance of federated learning and slows down the convergence. In this paper, we present a dynamic sample selection optimization algorithm, FedSS, to tackle heterogeneous data in federated learning. FedSS dynamically selects the training sample size during the gradient iteration based on the locally…

Leveraging Inpainting for Single-Image Shadow Removal

Xiaoguang Li, Qing Guo, Rabab Abdelfattah +4 more

cs.CV · · cited 44× · arXiv ↗ · more like this ·

Fully-supervised shadow removal methods achieve the best restoration qualities on public datasets but still generate some shadow remnants. One of the reasons is the lack of large-scale shadow & shadow-free image pairs. Unsupervised methods can alleviate the issue but their restoration qualities are much lower than those of fully-supervised methods. In this work, we find that pretraining shadow removal networks on the image inpainting dataset can reduce the shadow remnants significantly: a naive encoder-decoder network gets competitive restoration quality w.r.t. the state-of-the-art methods via only 10% shadow & shadow-free image pairs. After analyzing networks with/without inpainting pre-training via the information stored in the weight (IIW), we find that inpainting pretraining improves restoration quality in non-shadow regions and enhances the generalization ability of networks…

3D Inception U‐net with Asymmetric Loss for Cancer Detection in Automated Breast Ultrasound

Yi Wang, Chenchen Qin, Chuanlu Lin +6 more

Artificial Intelligence · Medical Physics · · cited 33× · DOI ↗ · more like this ·

PURPOSE: Breast cancer is the most common cancer and the leading cause of cancer-related deaths for women all over the world. Recently, automated breast ultrasound (ABUS) has become a new and promising screening modality for whole breast examination. However, reviewing volumetric ABUS is time-consuming and lesions could be missed during the examination. Therefore, computer-aided cancer detection in ABUS volume is extremely expected to help clinician for the breast cancer screening. METHODS: We develop a novel end-to-end 3D convolutional network for automated cancer detection in ABUS volume, in order to accelerate reviewing and meanwhile to provide high detection sensitivity with low false positives (FPs). Specifically, an efficient 3D Inception Unet-style architecture with fusion deep supervision mechanism is proposed to attain decent detection performance. In addition, a novel…

Zig-Zag Network for Semantic Segmentation of RGB-D Images

Di Lin, Hui Huang

Computer Vision and Pattern Recognition · IEEE Transactions on Pattern Analysis and Machine Intelligence · · cited 32× · DOI ↗ · more like this ·

Semantic segmentation of images requires an understanding of appearances of objects and their spatial relationships in scenes. The fully convolutional network (FCN) has been successfully applied to recognize objects' appearances, which are represented with RGB channels. Images augmented with depth channels provide more understanding of the geometric information of the scene in an image. In this paper, we present a multiple-branch neural network to utilize depth information to assist in the semantic segmentation of images. Our approach splits the image into layers according to the "scene-scale". We introduce the context-aware receptive field (CARF), which provides better control of the relevant context information of learned features. Each branch of the network is equipped with CARF to adaptively aggregate the context information of image regions, leading to a more focused domain that is…

FFNet: Frequency Fusion Network for Semantic Scene Completion

Xuzhi Wang, Di Lin, Liang Wan

Computer Vision and Pattern Recognition · Proceedings of the AAAI Conference on Artificial Intelligence · · cited 25× · DOI ↗ · more like this ·

Semantic scene completion (SSC) requires the estimation of the 3D geometric occupancies of objects in the scene, along with the object categories. Currently, many methods employ RGB-D images to capture the geometric and semantic information of objects. These methods use simple but popular spatial- and channel-wise operations, which fuse the information of RGB and depth data. Yet, they ignore the large discrepancy of RGB-D data and the uncertainty measurements of depth data. To solve this problem, we propose the Frequency Fusion Network (FFNet), a novel method for boosting semantic scene completion by better utilizing RGB-D data. FFNet explicitly correlates the RGB-D data in the frequency domain, different from the features directly extracted by the convolution operation. Then, the network uses the correlated information to guide the feature learning from the RG- B and depth images…

Edge-Aware Pyramidal Deformable Network for Unsupervised Registration of Brain MR Images

Yiqin Cao, Zhenyu Zhu, Yi Rao +5 more

Computer Vision and Pattern Recognition · Frontiers in Neuroscience · · cited 25× · DOI ↗ · more like this ·

Deformable image registration is of essential important for clinical diagnosis, treatment planning, and surgical navigation. However, most existing registration solutions require separate rigid alignment before deformable registration, and may not well handle the large deformation circumstances. We propose a novel edge-aware pyramidal deformable network (referred as EPReg) for unsupervised volumetric registration. Specifically, we propose to fully exploit the useful complementary information from the multi-level feature pyramids to predict multi-scale displacement fields. Such coarse-to-fine estimation facilitates the progressive refinement of the predicted registration field, which enables our network to handle large deformations between volumetric data. In addition, we integrate edge information with the original images as dual-inputs, which enhances the texture structures of image…

Optimizing MEC Networks for Healthcare Applications in 5G Communications With the Authenticity of Users’ Priorities

Di Lin, Su Hu, Yuan Gao +1 more

Information Systems · IEEE Access · · cited 23× · DOI ↗ · more like this ·

Mobile edge computing (MEC) is pervasive to support high-speed end-to-end data transmission and computation for 5th generation (5G) mobile communications by offloading computation tasks to the cloud at the edge of a cellular base station. In a cellular network for healthcare applications, we must consider the different priorities of data transmission and computation by referring to the emergency levels of patients. A critical issue of determining the allocation of wireless resources among users is the authenticity of their priorities (i.e., emergency levels). Without authenticating the users' priorities, a user who advocates a higher emergency level can allocate more wireless resources, leading to the insufficient wireless resources to the users who are actually in high priorities. In this paper, we investigate the optimization of end-to-end delay of wireless users in a cellular network…

Joint affine and deformable three‐dimensional networks for brain MRI registration

Zhenyu Zhu, Yiqin Cao, Chenchen Qin +5 more

Computer Vision and Pattern Recognition · Medical Physics · · cited 22× · DOI ↗ · more like this ·

PURPOSE: Volumetric medical image registration has important clinical significance. Traditional registration methods may be time-consuming when processing large volumetric data due to their iterative optimizations. In contrast, existing deep learning-based networks can obtain the registration quickly. However, most of them require independent rigid alignment before deformable registration; these two steps are often performed separately and cannot be end-to-end. METHODS: We propose an end-to-end joint affine and deformable network for three-dimensional (3D) medical image registration. The proposed network combines two deformation methods; the first one is for obtaining affine alignment and the second one is a deformable subnetwork for achieving the nonrigid registration. The parameters of the two subnetworks are shared. The global and local similarity measures are used as loss functions…

Edge Computing-Based Mobile Health System: Network Architecture and Resource Allocation

Di Lin, Yu Tang

Computer Networks and Communications · IEEE Systems Journal · · cited 15× · DOI ↗ · more like this ·

A cellular network with edge computing and microservice is pervasive to support mobile-health applications anytime and anywhere. Edge computing can potentially enhance the computational capabilities of a network, and microservice can help the network adapt to various mobile-health applications. In such a network, we present the design of its architecture, the allocation of its resources, as well as the management of its data. Specifically, we address a three-tier network architecture for mobile-health applications from the perspectives of communication, computation, as well as service. Also, we discuss the issues of resource allocation within the network in order to optimize its performance. Finally, we address the management of medical data (e.g., video streaming, medical images) in order to efficiently inquire them for diagnosis and medical treatment.

Deep LSAC for Fine-Grained Recognition

Di Lin, Yi Wang, Lingyu Liang +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Neural Networks and Learning Systems · · cited 12× · DOI ↗ · more like this ·

Fine-grained recognition emphasizes the identification of subtle differences among object categories given objects that appear in different shapes and poses. These variances should be reduced for reliable recognition. We propose a fine-grained recognition system that incorporates localization, segmentation, alignment, and classification in a unified deep neural network. The input to the classification module includes functions that enable backward-propagation (BP) in constructing the solver. Our major contribution is to propose a valve linkage function (VLF) for BP chaining and form our deep localization, segmentation, alignment, and classification (LSAC) system. The VLF can adaptively compromise errors of classification and alignment when training the LSAC model. It in turn helps to update the localization and segmentation. We evaluate our framework on two widely used fine-grained…

A delta-doped quantum well system with additional modulation doping

Dong-Sheng Luo, Li-Hung Lin, Yi-Chun Su +9 more

Artificial Intelligence · Nanoscale Research Letters · · cited 11× · DOI ↗ · more like this ·

A delta-doped quantum well with additional modulation doping may have potential applications. Utilizing such a hybrid system, it is possible to experimentally realize an extremely high two-dimensional electron gas (2DEG) density without suffering inter-electronic-subband scattering. In this article, the authors report on transport measurements on a delta-doped quantum well system with extra modulation doping. We have observed a 0-10 direct insulator-quantum Hall (I-QH) transition where the numbers 0 and 10 correspond to the insulator and Landau level filling factor ν = 10 QH state, respectively. In situ titled-magnetic field measurements reveal that the observed direct I-QH transition depends on the magnetic component perpendicular to the quantum well, and the electron system within this structure is 2D in nature. Furthermore, transport measurements on the 2DEG of this study show that…

Resource Allocation in a Secure Internet of Battle Vehicles Through RF Fingerprint Recognition

Di Lin, Weiwei Wu

Artificial Intelligence · IEEE Transactions on Vehicular Technology · · cited 10× · DOI ↗ · more like this ·

In the internet of battle vehicles (IoBV), a few unauthorized users may attack and intrude on a network. The attackers who sneak into the network may maliciously occupy invaluable wireless resources that are supposed to serve authorized users. To guarantee the quality of service (QoS) of authorized users, we novelly propose an architecture of secure IoBV through the radio frequency (RF) fingerprint recognition technology and investigate the optimal resource allocation scheme under such an architecture. With few training samples, we propose a meta-transfer-based few-shot learning method for RF fingerprint recognition and an algorithm to optimize the data rate in an IoBV. Compared with a few benchmarks, the analysis results show that our proposed algorithm can improve the overall data rate and reduce the computation time.

RF Fingerprint-Identification-Based Reliable Resource Allocation in an Internet of Battle Things

Di Lin, Weiwei Wu

Artificial Intelligence · IEEE Internet of Things Journal · · cited 9× · DOI ↗ · more like this ·

With the advances of Internet of Things (IoT) technology, the Internet of Battlefield Things (IoBT) has revolutionized the military battlefield. Unlike civilian IoT applications, a few adversarial attackers may sneak into an IoBT and destroy the network infrastructure by generating cyberattacks, e.g., Distributed Denial-of-Service (DDoS) attacks, making the Quality of Service (QoS) of network dramatically decrease. To improve the performance of a network, we propose two schemes of enhancing network QoS: one is user access control with the aid of RF fingerprinting because of small-scaled available signal samples, while the other is the optimization of network performance. Specifically, we address the optimization of network utility with the methods of power allocation and channel allocation. Mathematically, we propose a mixed-integer nonlinear (MIN) problem, which optimizes the…