Author

Youfang Lin

146 papers · 2004–2026

2004peak 31 in 20242026

Frequent co-authors

Papers

showing 1–25 of 146 RSS

Learning Dynamics and Heterogeneity of Spatial-Temporal Graph Data for Traffic Forecasting

Shengnan Guo, Youfang Lin, Huaiyu Wan +2 more

Signal Processing · IEEE Transactions on Knowledge and Data Engineering · 3 Feb 2021 · cited 704× · DOI ↗ · more like this ·

Accurate traffic forecasting is critical in improving safety, stability, and efficiency of intelligent transportation systems. Despite years of studies, accurate traffic prediction still faces the following challenges, including modeling the dynamics of trafﬁc data along both temporal and spatial dimensions, and capturing the periodicity and the spatial heterogeneity of trafﬁc data, and the problem is more difficult for long-term forecast. In this paper, we propose an Attention based Spatial-Temporal Graph Neural Network (ASTGNN) for traffic forecasting. Specifically, in the temporal dimension, we design a novel self-attention mechanism that is capable of utilizing the local context, which is specialized for numerical sequence representation transformation. It enables our prediction model to capture the temporal dynamics of traffic data and to enjoy global receptive ﬁelds that is…

Residual Networks for Light Field Image Super-Resolution

Shuo Zhang, Youfang Lin, Hao Sheng

Computer Vision and Pattern Recognition · June 2019 · cited 244× · DOI ↗ · more like this ·

Light field cameras are considered to have many potential applications since angular and spatial information is captured simultaneously. However, the limited spatial resolution has brought lots of difficulties in developing related applications and becomes the main bottleneck of light field cameras. In this paper, a learning-based method using residual convolutional networks is proposed to reconstruct light fields with higher spatial resolution. The view images in one light field are first grouped into different image stacks with consistent sub-pixel offsets and fed into different network branches to implicitly learn inherent corresponding relations. The residual information in different spatial directions is then calculated from each branch and further integrated to supplement high-frequency details for the view image. Finally, a flexible solution is proposed to super-resolve entire…

Pre-training Context and Time Aware Location Embeddings from Spatial-Temporal Trajectories for User Next Location Prediction

Yan Lin, Huaiyu Wan, Shengnan Guo +1 more

Transportation · Proceedings of the AAAI Conference on Artificial Intelligence · 18 May 2021 · cited 114× · DOI ↗ · more like this ·

Pre-training location embeddings from spatial-temporal trajectories is a fundamental procedure and very beneficial for user next location prediction. In the real world, a location usually has variable functionalities under different contextual environments. If the exact functions of a location in the trajectory can be reflected in its embedding, the accuracy of user next location prediction should be improved. Yet, existing location embeddings pre-trained on trajectories are mostly based on distributed word representations, which mix a location's various functionalities into one latent representation vector. To address this problem, we propose a Context and Time aware Location Embedding (CTLE) model, which calculates a location's representation vector with consideration of its specific contextual neighbors in trajectories. In this way, the multi-functional properties of locations can be…

End-to-End Light Field Spatial Super-Resolution Network Using Multiple Epipolar Geometry

Shuo Zhang, Chang Song, Youfang Lin

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · 2021 · cited 112× · DOI ↗ · more like this ·

Light Field (LF) cameras are considered to have many potential applications since angular and spatial information is captured simultaneously. However, the limited spatial resolution has brought lots of difficulties in developing related applications and becomes the main bottleneck of LF cameras. In this paper, an end-to-end learning-based method is proposed to simultaneously reconstruct all view images in LFs with higher spatial resolution. Based on the epipolar geometry, view images in one LF are first grouped into several image stacks and fed into different network branches to learn sub-pixel details for each view image. Since LFs have dense sampling in angular domain, sub-pixel details in multiple spatial directions are learned from corresponding angular directions in multiple branches, respectively. Then, sub-pixel details from different directions are further integrated to generate…

Attention-based Multi-Level Fusion Network for Light Field Depth Estimation

Jiaxin Chen, Shuo Zhang, Youfang Lin

Computer Vision and Pattern Recognition · Proceedings of the AAAI Conference on Artificial Intelligence · 18 May 2021 · cited 86× · DOI ↗ · more like this ·

Depth estimation from Light Field (LF) images is a crucial basis for LF related applications. Since multiple views with abundant information are available, how to effectively fuse features of these views is a key point for accurate LF depth estimation. In this paper, we propose a novel attention-based multi-level fusion network. Combined with the four-branch structure, we design intra-branch fusion strategy and inter-branch fusion strategy to hierarchically fuse effective features from different views. By introducing the attention mechanism, features of views with less occlusions and richer textures are selected inside and between these branches to provide more effective information for depth estimation. The depth maps are finally estimated after further aggregation. Experimental results shows the proposed method achieves state-of-the-art performance in both quantitative and qualitative…

Cooperative Edge Caching: A Multi-Agent Deep Learning Based Approach

Yuming Zhang, Bohao Feng, Wei Quan +4 more

Computer Networks and Communications · IEEE Access · 2020 · cited 64× · DOI ↗ · more like this ·

Ubiquitous Internet of Things (IoT) devices have fueled plenty of innovations in the emerging network paradigms. Among them, IoT edge caching has emerged as a promising technique to cope with the explosive growth in network data traffic, with Quality of Service (QoS) improved and energy saved. However, the intrinsic storage limitations of the edge servers poses a critical challenge for the IoT edge caching system. Enabling edge servers to cooperate with each other can provide a potential perspective to improve the edge storage utilization widely discussed. Nevertheless, it also incurs an additional communication overhead, eventually making the caching system more complex. As a result, how to perform an efficient cooperative caching becomes a critical issue. Thus, in this paper, we propose a deep reinforcement learning-based cooperative edge caching approach, which allows the distributed…

Diff-RNTraj: A Structure-aware Diffusion Model for Road Network-constrained Trajectory Generation

Tonglong Wei, Youfang Lin, Shengnan Guo +5 more

cs.LG · February 2024 · cited 60× · arXiv ↗ · more like this ·

Trajectory data is essential for various applications as it records the movement of vehicles. However, publicly available trajectory datasets remain limited in scale due to privacy concerns, which hinders the development of trajectory data mining and trajectory-based applications. To address this issue, some methods for generating synthetic trajectories have been proposed to expand the scale of the dataset. However, all existing methods generate trajectories in the geographical coordinate system, which poses two limitations for their utilization in practical applications: 1) the inability to ensure that the generated trajectories are constrained on the road. 2) the lack of road-related information. In this paper, we propose a new problem to meet the practical application need, \emph{i.e.}, road network-constrained trajectory (RNTraj) generation, which can directly generate trajectories…

Multiscale Wavelet Graph AutoEncoder for Multivariate Time-Series Anomaly Detection

Jing Wang, Shikuan Shao, Yunfei Bai +2 more

Artificial Intelligence · IEEE Transactions on Instrumentation and Measurement · 17 Nov 2022 · cited 48× · DOI ↗ · more like this ·

In industrial facilities or IT systems, there are lots of multivariate time series generated from various metrics. Anomaly detection in multivariate time series is of great importance in applications such as fault diagnosis and root cause discovery. Recently, some unsupervised methods have made great progress in this task, especially the reconstruction architecture of autoencoders (AEs), learning normal distribution, and producing a significant error for anomalies. Although AEs can reconstruct subtle abnormal patterns well with the powerful generalization ability, it also leads to a high false negative. Moreover, these AE-based models ignore the dependence among variables at different time scales. In this article, we propose a novel anomaly detection framework named Multiscale wavElet Graph AE (MEGA). The main idea is to integrate discrete wavelet transform (DWT) into AE to decompose…

Origin-Destination Travel Time Oracle for Map-based Services

Yan Lin, Huaiyu Wan, Jilin Hu +4 more

cs.LG · 6 Jul 2023 · cited 46× · arXiv ↗ · more like this ·

Given an origin (O), a destination (D), and a departure time (T), an Origin-Destination (OD) travel time oracle~(ODT-Oracle) returns an estimate of the time it takes to travel from O to D when departing at T. ODT-Oracles serve important purposes in map-based services. To enable the construction of such oracles, we provide a travel-time estimation (TTE) solution that leverages historical trajectories to estimate time-varying travel times for OD pairs. The problem is complicated by the fact that multiple historical trajectories with different travel times may connect an OD pair, while trajectories may vary from one another. To solve the problem, it is crucial to remove outlier trajectories when doing travel time estimation for future queries. We propose a novel, two-stage framework called Diffusion-based Origin-destination Travel Time Estimation (DOT), that solves the problem. First, DOT…

Graph2Route: A Dynamic Spatial-Temporal Graph Neural Network for Pick-up and Delivery Route Prediction

Haomin Wen, Youfang Lin, Xiaowei Mao +7 more

Transportation · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · 12 Aug 2022 · cited 44× · DOI ↗ · more like this ·

Pick-up and delivery (P&D) services such as food delivery have achieved explosive growth in recent years by providing customers with daily-life convenience. Though many service providers have invested considerably in routing tools, more and more practitioners realize that significant deviations exist between workers' actual routes and planned ones. So it is not wise to feed "optimal routes" as workers' actual service routes into downstream tasks (e.g., arrival-time prediction and order dispatching), whose performances count on the accuracy of route prediction, i.e., to predict the future service route of a worker's unfinished tasks. Therefore, to meet the rising calling for route prediction models that can capture workers' future routing behaviors, in this paper, we formulate the Pick-up and Delivery Route Prediction task (PDRP task for short) from the graph perspective for the first…

Pre-training General Trajectory Embeddings with Maximum Multi-view Entropy Coding

Yan Lin, Huaiyu Wan, Shengnan Guo +3 more

cs.CV · July 2022 · cited 42× · arXiv ↗ · more like this ·

Spatio-temporal trajectories provide valuable information about movement and travel behavior, enabling various downstream tasks that in turn power real-world applications. Learning trajectory embeddings can improve task performance but may incur high computational costs and face limited training data availability. Pre-training learns generic embeddings by means of specially constructed pretext tasks that enable learning from unlabeled data. Existing pre-training methods face (i) difficulties in learning general embeddings due to biases towards certain downstream tasks incurred by the pretext tasks, (ii) limitations in capturing both travel semantics and spatio-temporal correlations, and (iii) the complexity of long, irregularly sampled trajectories. To tackle these challenges, we propose Maximum Multi-view Trajectory Entropy Coding (MMTEC) for learning general and comprehensive…

Local-Global History-aware Contrastive Learning for Temporal Knowledge Graph Reasoning

Wei Chen, Huaiyu Wan, Yuting Wu +4 more

cs.AI · 4 Dec 2023 · cited 41× · arXiv ↗ · more like this ·

Temporal knowledge graphs (TKGs) have been identified as a promising approach to represent the dynamics of facts along the timeline. The extrapolation of TKG is to predict unknowable facts happening in the future, holding significant practical value across diverse fields. Most extrapolation studies in TKGs focus on modeling global historical fact repeating and cyclic patterns, as well as local historical adjacent fact evolution patterns, showing promising performance in predicting future unknown facts. Yet, existing methods still face two major challenges: (1) They usually neglect the importance of historical information in KG snapshots related to the queries when encoding the local and global historical information; (2) They exhibit weak anti-noise capabilities, which hinders their performance when the inputs are contaminated with noise.To this end, we propose a novel…

Micro-Lens Image Stack Upsampling for Densely-Sampled Light Field Reconstruction

Shuo Zhang, Chang Song, Zeqi Shen +1 more

Computer Vision and Pattern Recognition · IEEE Transactions on Computational Imaging · 2021 · cited 40× · DOI ↗ · more like this ·

Due to hardware restriction, it is costly to capture densely-sampled Light Fields (LFs) with high angular and spatial resolution, which becomes the main bottleneck of LFs development. In this paper, we propose a learning-based framework to synthesize novel views and reconstruct densely-sampled LFs from sparsely-sampled LFs. In the proposed framework, micro-lens image stacks and view image stacks are separately grouped, in which details in novel views are explored from spatial and angular domain. The two kinds of stacks contain epipolar information and 3D convolution layers are employed to effectively extract features that include structure information. Moreover, an innovative way is proposed to synthesize views by upsampling micro-lens image stacks using deconvolution layers. The parameters in decovolution layers provide the view position information and different interpolation and…

Package Pick-up Route Prediction via Modeling Couriers’ Spatial-Temporal Behaviors

Haomin Wen, Youfang Lin, Fan Wu +5 more

Computer Vision and Pattern Recognition · April 2021 · cited 37× · DOI ↗ · more like this ·

Over 10 billion packages are picked up every day in China. Accurate prediction of couriers' pick-up routes can help the dispatch system to assign packages to couriers more intelligently, which is able to further increase the pick-up efficiency and reduce the overdue rate. In the package pick-up scene, the decision-making of a courier is quite complex since it's affected by strict spatial-temporal constraints (e.g., package location, promised pick-up time, current time and courier's current location). In this paper, we propose a novel model, named DeepRoute, to predict couriers' future package pick-up routes according to the couriers' decision experience learnt from their historical spatial-temporal behaviors. Specifically, DeepRoute consists of three layers: 1) The representation layer produces experience-aware representations for unpicked-up packages. 2) The transformer encoder layer…

Skill-Based Hierarchical Reinforcement Learning for Target Visual Navigation

Shuo Wang, Zhihao Wu, Xiaobo Hu +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Multimedia · 2023 · cited 35× · DOI ↗ · more like this ·

Target visual navigation aims at controlling the agent to find a target object based on a monocular visual RGB image in each step. It is crucial for the agent to adapt to new environments. As target visual navigation is a complex task, understanding the behavior of the agent is beneficial for analyzing the reasons for failure. This work focuses on improving the readability and success rate of navigation policies. In this paper, we propose a framework named Skill-based Hierarchical Reinforcement Learning (SHRL) for target visual navigation. SHRL contains a high-level policy and three low-level skills. The high-level policy accomplishes the task by utilizing or stopping low-level skills at each step. Low-level skills are designed to separately solve three sub-tasks, i.e., <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Search…

Multi-Stream Progressive Restoration for Low-Light Light Field Enhancement and Denoising

Xianglang Wang, Youfang Lin, Shuo Zhang

Computer Vision and Pattern Recognition · IEEE Transactions on Computational Imaging · 2023 · cited 31× · DOI ↗ · more like this ·

Light Fields (LFs) are easily degraded by noise and low light. Low light LF enhancement and denoising are more challenging than single image tasks because the epipolar information among views should be taken into consideration. In this work, we propose a multiple stream progressive restoration network to restore the whole LF in just one forward pass. To make full use of the multiple views supplementary information and preserve the epipolar information, we design three types of input composed of view stacking. Each type of input corresponds to an restoration stream and provides specific complementary information. In addition, the weights are shared for each type of input in order to better maintain the epipolar information among views. To fully utilize the supplementary information, we then design a multi-stream interaction module to aggregate features from different restoration streams.…

Pre-Training Time-Aware Location Embeddings from Spatial-Temporal Trajectories

Huaiyu Wan, Yan Lin, Shengnan Guo +1 more

Transportation · IEEE Transactions on Knowledge and Data Engineering · 10 Feb 2021 · cited 31× · DOI ↗ · more like this ·

With the increasing accumulation of spatial-temporal trajectory data, location-based data mining has recently been extensively studied. A fundamental research topic in this field is learning the embedding vectors of locations through self-supervised pre-training. Pre-trained embedding vectors can utilize the highly available unlabeled trajectory data, and benefit downstream tasks in multiple aspects. However, most existing methods ignore the temporal information hidden in the visited time of locations in trajectories. Considering that human activities are highly regulated by specific periods of a day, temporal information can reflect some intrinsic characteristics of locations, so it is necessary to fuse them into location embedding vectors. In this paper, we propose a Time-Aware Location Embedding (TALE) pre-training method based on the CBOW framework, which is able to incorporate…

Light Field Reconstruction Using Efficient Pseudo 4D Epipolar-Aware Structure

Yangling Chen, Shuo Zhang, Chang Song +1 more

Computer Vision and Pattern Recognition · IEEE Transactions on Computational Imaging · 2022 · cited 30× · DOI ↗ · more like this ·

Limited by sensor resolution, Light Field (LF) images often suffer from an inherent trade-off between angular resolution and spatial resolution. LF reconstruction, including Spatial Super-Resolution (LFSSR) and Angular Super-Resolution (LFASR), upsamples LF in spatial and angular domain based on the complementary information in different views. In this paper, we propose efficient pseudo-4D end-to-end frameworks for LFSSR and LFASR, respectively. Since the epipolar information and spatial-angular information reflect the relationship between views, we propose to fully consider both of them to exploit complementary information thoroughly. Specifically, we first extract epipolar information from horizontally and vertically stacked views separately. Then an Epipolar-Aware Grid (EAG) network composed of Dual Interactive Blocks (DIBs) fully interacts the epipolar information, characterizing…

Occlusion-aware Bi-directional Guided Network for Light Field Salient Object Detection

Jing Dong, Shuo Zhang, Runmin Cong +1 more

Computer Vision and Pattern Recognition · 17 Oct 2021 · cited 30× · DOI ↗ · more like this ·

Existing light field based works utilize either views or focal stacks for saliency detection. However, since depth information exists implicitly in adjacent views or different focal slices, it is difficult to exploit scene depth information from both. By comparison, Epipolar Plane Images (EPIs) provide explicit accurate scene depth and occlusion information by projected pixel lines. Due to the fact that the depth of an object is often continuous, the distribution of occlusion edges concentrates more on object boundaries compared with traditional color edges, which is more beneficial for improving accuracy and completeness of saliency detection. In this paper, we propose a learning-based network to exploit occlusion features from EPIs and integrate high-level features from the central view for accurate salient object detection. Specifically, a novel Occlusion Extraction Module is…

Removing Foreground Occlusions in Light Field using Micro-lens Dynamic Filter

Shuo Zhang, Zeqi Shen, Youfang Lin

Computer Vision and Pattern Recognition · August 2021 · cited 26× · DOI ↗ · more like this ·

Foreground occlusion removal task aims to automatically detect and remove foreground occlusions and recover background objects. Since for Light Fields (LFs), background objects occluded in some views may be seen in other views, the foreground occlusion removal task for LFs is easy to achieve. In this paper, we propose a learning-based method combining ‘seeking’ and ‘generating’ to recover occluded background. Specifically, the micro-lens dynamic filters are proposed to ‘seek’ occluded background points in shifted micro-lens images and remove occlusions using angular information. The shifted images are then combined to further ‘generate’ background regions to supplement more background details using spatial information. By fully exploring the angular and spatial information in LFs, the dense and complex occlusions can be easily removed. Quantitative and qualitative experimental results…

High-Value Prioritized Experience Replay for Off-Policy Reinforcement Learning

Xi Cao, Huaiyu Wan, Youfang Lin +1 more

Artificial Intelligence · November 2019 · cited 24× · DOI ↗ · more like this ·

In deep reinforcement learning, experience replay has been shown an effective solution to handle sample-inefficiency. Prioritized Experience Replay (PER) uses temporal-difference error (TD error) as replay priority in Deep Q-Networks (DQN), so that agent can learn more effectively from important experiences. However, experiences with large TD error may appear near the edge of state space and these experiences do not help agent learn policy quickly. We present a novel technique called High-Value Prioritized Experience Replay (HVPER), which designs a combination of TD error and value (reward or state-action value) in replay priority. Specifically, we first propose prioritizing replay based on reward and TD error in sparse reward environment. Extendedly, we design prioritizing replay based on state-action value and TD error for more ordinary environment. We design experiments in the gym…

Micro-Macro Spatial-Temporal Graph-based Encoder-Decoder for Map-Constrained Trajectory Recovery

Tonglong Wei, Youfang Lin, Yan Lin +3 more

cs.LG · 29 Apr 2024 · cited 23× · arXiv ↗ · more like this ·

Recovering intermediate missing GPS points in a sparse trajectory, while adhering to the constraints of the road network, could offer deep insights into users' moving behaviors in intelligent transportation systems. Although recent studies have demonstrated the advantages of achieving map-constrained trajectory recovery via an end-to-end manner, they still face two significant challenges. Firstly, existing methods are mostly sequence-based models. It is extremely hard for them to comprehensively capture the micro-semantics of individual trajectory, including the information of each GPS point and the movement between two GPS points. Secondly, existing approaches ignore the impact of the macro-semantics, i.e., the road conditions and the people's shared travel preferences reflected by a group of trajectories. To address the above challenges, we propose a Micro-Macro Spatial-Temporal…

CrossFuN: Multiview Joint Cross-Fusion Network for Time-Series Anomaly Detection

Yunfei Bai, Jing Wang, X. H. Zhang +2 more

Artificial Intelligence · IEEE Transactions on Instrumentation and Measurement · 2023 · cited 22× · DOI ↗ · more like this ·

Time Series are often used to record the various states (i.e., metrics) of a system. Detecting the anomaly state is challenging because temporal dynamics and inter-metric dependencies need to be learned simultaneously, and anomaly types are diverse due to the complexity of the time series. Many anomaly detection models still leave some challenges unresolved. They mainly ignore the importance of information from frequency domain while concentrating on time domain modeling and further neglect the cross-domain effects of time and frequency domains. In this paper, we proposed a novel Multi-View Joint Cross Fusion Network (CrossFuN) to detect diverse types of anomaly, which has wide applicability to both univariate and multivariate time series. Particularly, based on the assumptions of Time-Frequency Heterogeneity and Time Frequency Coordination, a time-frequency joint cross fusion block is…

Inferring the Travel Purposes of Passenger Groups for Better Understanding of Passengers

Youfang Lin, Huaiyu Wan, Rui Jiang +2 more

Transportation · IEEE Transactions on Intelligent Transportation Systems · 23 Jun 2014 · cited 21× · DOI ↗ · more like this ·

People usually travel to the same destinations and for the same purposes together with other people in groups. Inferring the travel purposes of passenger groups is a very interesting research problem in the field of passenger transport, because it can help us to better understand passengers and should bring about meaningful changes for personalized travel service and decision making of passenger carriers, organizations, and even governments. In this paper, we attempt to solve this problem by utilizing the historical travel records of passengers. To overcome the constraint of the independent and identical distribution assumption of traditional classifiers, we propose a novel iterative classification approach based on the idea of collective inference. First, we construct cotravel networks by extracting social relations between passengers from their historical travel records that are…

Enhanced Spinning Parallelogram Operator Combining Color Constraint and Histogram Integration for Robust Light Field Depth Estimation

Weikun Wang, Youfang Lin, Shuo Zhang

Computer Vision and Pattern Recognition · IEEE Signal Processing Letters · 2021 · cited 20× · DOI ↗ · more like this ·

Accurate depth estimation is an essential part of most light field applications. Previous approach Spinning Parallelogram Operator (SPO) achieves robust depth estimation results in noisy and occluded scenes by fitting lines in Epipolar Plane Images (EPIs). However, only using histogram distances, SPO cannot handle complex occlusions and is sensitive to different parameters. In this letter, we propose enhanced Spinning Parallelogram Operator utilizing color constraint and histogram integration (SPO-CH) to address the above problems. The color consistency between different views is first introduced to exclude occlusions when measuring the histogram distances of occluded areas. We then design a novel Gaussian integration histogram that combines information from other adjacent bins, which improves the performances of noisy and texture-less scenes. Experimental results show that the proposed…