Author

Yiping

2,660 papers · 1753–2026

1967peak 254 in 20252026

Frequent co-authors

Papers

showing 1–25 of 2,660 RSS

Pre-Trained Image Processing Transformer

Hanting Chen, Yunhe Wang, Tianyu Guo +7 more

cs.CV · December 2020 · cited 2,332× · arXiv ↗ · more like this ·

As the computing power of modern hardware is increasing strongly, pre-trained deep learning models (e.g., BERT, GPT-3) learned on large-scale datasets have shown their effectiveness over conventional methods. The big progress is mainly contributed to the representation ability of transformer and its variant architectures. In this paper, we study the low-level computer vision task (e.g., denoising, super-resolution and deraining) and develop a new pre-trained model, namely, image processing transformer (IPT). To maximally excavate the capability of transformer, we present to utilize the well-known ImageNet benchmark for generating a large amount of corrupted image pairs. The IPT model is trained on these images with multi-heads and multi-tails. In addition, the contrastive learning is introduced for well adapting to different image processing tasks. The pre-trained model can therefore…

How Does Distance Education Compare With Classroom Instruction? A Meta-Analysis of the Empirical Literature

R Bernard, Philip C. Abrami, Yiping Lou +6 more

Education · Review of Educational Research · September 2004 · cited 1,768× · DOI ↗ · more like this ·

A meta-analysis of the comparative distance education (DE) literature between 1985 and 2002 was conducted. In total, 232 studies containing 688 independent achievement, attitude, and retention outcomes were analyzed. Overall results indicated effect sizes of essentially zero on all three measures and wide variability. This suggests that many applications of DE outperform their classroom counterparts and that many perform more poorly. Dividing achievement outcomes into synchronous and asynchronous forms of DE produced a somewhat different impression. In general, mean achievement effect sizes for synchronous applications favored classroom instruction, while effect sizes for asynchronous applications favored DE. However, significant heterogeneity remained in each subset.

Accurate Object Localization in Remote Sensing Images Based on Convolutional Neural Networks

Yang Long, Yiping Gong, Zhifeng Xiao +1 more

Computer Vision and Pattern Recognition · IEEE Transactions on Geoscience and Remote Sensing · 19 Jan 2017 · cited 856× · DOI ↗ · more like this ·

In this paper, we focus on tackling the problem of automatic accurate localization of detected objects in high-resolution remote sensing images. The two major problems for object localization in remote sensing images caused by the complex context information such images contain are achieving generalizability of the features used to describe objects and achieving accurate object locations. To address these challenges, we propose a new object localization framework, which can be divided into three processes: region proposal, classification, and accurate object localization process. First, a region proposal method is used to generate candidate regions with the aim of detecting all objects of interest within these images. Then, generic image features from a local image corresponding to each region proposal are extracted by a combination model of 2-D reduction convolutional neural networks…

Neurosurgeon

Yiping Kang, Johann Hauswald, Cao Gao +4 more

Computer Networks and Communications · 4 Apr 2017 · cited 748× · DOI ↗ · more like this ·

The computation for today's intelligent personal assistants such as Apple Siri, Google Now, and Microsoft Cortana, is performed in the cloud. This cloud-only approach requires significant amounts of data to be sent to the cloud over the wireless network and puts significant computational pressure on the datacenter. However, as the computational resources in mobile devices become more powerful and energy efficient, questions arise as to whether this cloud-only processing is desirable moving forward, and what are the implications of pushing some or all of this compute to the mobile devices on the edge.

Dynamic Spectrum Access with QoS and Interference Temperature Constraints

Yiping Xing, Chetan Nanjunda Mathur, M.A. Haleem +2 more

Computer Networks and Communications · IEEE Transactions on Mobile Computing · 2 Mar 2007 · cited 468× · DOI ↗ · more like this ·

Spectrum is one of the most precious radio resources. With the increasing demand for wireless communication, efficiently using the spectrum resource has become an essential issue. With the Federal Communications Commission's (FCC) spectrum policy reform, secondary spectrum sharing has gained increasing interest. One of the policy reforms introduces the concept of an interference temperature - the total allowable interference in a spectral band. This means that secondary users can use different transmit powers as long as the sum of these power is less than the interference threshold. In this paper, we study two problems in secondary spectrum access with minimum signal to interference noise ratio (quality of service (QoS)) guarantee under an interference temperature constraint. First, when all the secondary links can be supported, a nonlinear optimization problem with the objective to…

Ship Rotated Bounding Box Space for Ship Extraction From High-Resolution Optical Satellite Images With Complex Backgrounds

Zikun Liu, Hongzhen Wang, Lubin Weng +1 more

Computer Vision and Pattern Recognition · IEEE Geoscience and Remote Sensing Letters · 27 May 2016 · cited 428× · DOI ↗ · more like this ·

Extracting ships from complex backgrounds is the bottleneck of ship detection in high-resolution optical satellite images. In this letter, we propose a nearly closed-form ship rotated bounding box space used for ship detection and design a method to generate a small number of highly potential candidates based on this space. We first analyze the possibility of accurately covering all ships by labeling rotated bounding boxes. Moreover, to reduce search space, we construct a nearly closed-form ship rotated bounding box space. Then, by scoring for each latent candidate in the space using a two-cascaded linear model followed by binary linear programming, we select a small number of highly potential candidates. Moreover, we also propose a fast version of our method. Experiments on our data set validate the effectiveness of our method and the efficiency of its fast version, which achieves a…

You Only Propagate Once: Accelerating Adversarial Training via Maximal Principle

Dinghuai Zhang, Tianyuan Zhang, Yiping Lu +2 more

stat.ML · May 2019 · cited 396× · arXiv ↗ · more like this ·

Deep learning achieves state-of-the-art results in many tasks in computer vision and natural language processing. However, recent works have shown that deep networks can be vulnerable to adversarial perturbations, which raised a serious robustness issue of deep networks. Adversarial training, typically formulated as a robust optimization problem, is an effective way of improving the robustness of deep networks. A major drawback of existing adversarial training algorithms is the computational overhead of the generation of adversarial examples, typically far greater than that of the network training. This leads to the unbearable overall computational cost of adversarial training. In this paper, we show that adversarial training can be cast as a discrete time differential game. Through analyzing the Pontryagin's Maximal Principle (PMP) of the problem, we observe that the adversary update…

Learning to Respond with Deep Neural Networks for Retrieval-Based Human-Computer Conversation System

Rui Yan, Yiping Song, Hua Wu

Artificial Intelligence · 7 Jul 2016 · cited 372× · DOI ↗ · more like this ·

To establish an automatic conversation system between humans and computers is regarded as one of the most hardcore problems in computer science, which involves interdisciplinary techniques in information retrieval, natural language processing, artificial intelligence, etc. The challenges lie in how to respond so as to maintain a relevant and continuous conversation with humans. Along with the prosperity of Web 2.0, we are now able to collect extremely massive conversational data, which are publicly available. It casts a great opportunity to launch automatic conversation systems. Owing to the diversity of Web resources, a retrieval-based conversation system will be able to find at least some responses from the massive repository for any user inputs. Given a human issued message, i.e., query, our system would provide a reply after adequate training and learning of how to respond. In this…

A Multimodal Multiobjective Evolutionary Algorithm Using Two-Archive and Recombination Strategies

Yiping Liu, Gary G. Yen, Dunwei Gong

Computational Theory and Mathematics · IEEE Transactions on Evolutionary Computation · 6 Nov 2018 · cited 319× · DOI ↗ · more like this ·

There have been few researches on solving multimodal multiobjective optimization problems, whereas they are commonly seen in real-world applications but difficult for the existing evolutionary optimizers. In this paper, we propose a novel multimodal multiobjective evolutionary algorithm using two-archive and recombination strategies. In the proposed algorithm, the properties of decision variables and the relationships among them are analyzed at first to guide the evolutionary search. Then, a general framework using two archives, i.e., the convergence and the diversity archives, is adopted to cooperatively solve these problems. Moreover, the diversity archive simultaneously employs a clustering strategy to guarantee diversity in the objective space and a niche-based clearing strategy to promote the same in the decision space. At the end of evolution process, solutions in the convergence…

ThunderNet: Towards Real-time Generic Object Detection

Zheng Qin, Zeming Li, Zhaoning Zhang +4 more

cs.CV · March 2019 · cited 292× · arXiv ↗ · more like this ·

Real-time generic object detection on mobile platforms is a crucial but challenging computer vision task. However, previous CNN-based detectors suffer from enormous computational cost, which hinders them from real-time inference in computation-constrained scenarios. In this paper, we investigate the effectiveness of two-stage detectors in real-time generic detection and propose a lightweight two-stage detector named ThunderNet. In the backbone part, we analyze the drawbacks in previous lightweight backbones and present a lightweight backbone designed for object detection. In the detection part, we exploit an extremely efficient RPN and detection head design. To generate more discriminative feature representation, we design two efficient architecture blocks, Context Enhancement Module and Spatial Attention Module. At last, we investigate the balance between the input resolution, the…

Path problems in temporal graphs

Huanhuan Wu, James Cheng, Silu Huang +3 more

Computer Networks and Communications · Proceedings of the VLDB Endowment · May 2014 · cited 282× · DOI ↗ · more like this ·

Shortest path is a fundamental graph problem with numerous applications. However, the concept of classic shortest path is insufficient or even flawed in a temporal graph, as the temporal information determines the order of activities along any path. In this paper, we show the shortcomings of classic shortest path in a temporal graph, and study various concepts of "shortest" path for temporal graphs. Computing these temporal paths is challenging as subpaths of a "shortest" path may not be "shortest" in a temporal graph. We investigate properties of the temporal paths and propose efficient algorithms to compute them. We tested our algorithms on real world temporal graphs to verify their efficiency, and also show that temporal paths are essential for studying temporal graphs by comparing shortest paths in normal static graphs.

ThunderNet: Towards Real-Time Generic Object Detection on Mobile Devices

Zheng Qin, Zeming Li, Zhaoning Zhang +4 more

Computer Vision and Pattern Recognition · October 2019 · cited 274× · DOI ↗ · more like this ·

Real-time generic object detection on mobile platforms is a crucial but challenging computer vision task. Prior lightweight CNN-based detectors are inclined to use one-stage pipeline. In this paper, we investigate the effectiveness of two-stage detectors in real-time generic detection and propose a lightweight two-stage detector named ThunderNet. In the backbone part, we analyze the drawbacks in previous lightweight backbones and present a lightweight backbone designed for object detection. In the detection part, we exploit an extremely efficient RPN and detection head design. To generate more discriminative feature representation, we design two efficient architecture blocks, Context Enhancement Module and Spatial Attention Module. At last, we investigate the balance between the input resolution, the backbone, and the detection head. Benefit from the highly efficient backbone and…

A Many-Objective Evolutionary Algorithm Using A One-by-One Selection Strategy

Yiping Liu, Dunwei Gong, Jing Sun +1 more

Computational Theory and Mathematics · IEEE Transactions on Cybernetics · 9 Jan 2017 · cited 273× · DOI ↗ · more like this ·

Most existing multiobjective evolutionary algorithms experience difficulties in solving many-objective optimization problems due to their incapability to balance convergence and diversity in the high-dimensional objective space. In this paper, we propose a novel many-objective evolutionary algorithm using a one-by-one selection strategy. The main idea is that in the environmental selection, offspring individuals are selected one by one based on a computationally efficient convergence indicator to increase the selection pressure toward the Pareto optimal front. In the one-by-one selection, once an individual is selected, its neighbors are de-emphasized using a niche technique to guarantee the diversity of the population, in which the similarity between individuals is evaluated by means of a distribution indicator. In addition, different methods for calculating the convergence indicator…

Rotated region based CNN for ship detection

Zikun Liu, Jingao Hu, Lubin Weng +1 more

Computer Vision and Pattern Recognition · September 2017 · cited 264× · DOI ↗ · more like this ·

The state-of-the-art object detection networks for natural images have recently demonstrated impressive performances. However the complexity of ship detection in high resolution satellite images exposes the limited capacity of these networks for strip-like rotated assembled object detection which are common in remote sensing images. In this paper, we embrace this observation and introduce the rotated region based CNN (RR-CNN), which can learn and accurately extract features of rotated regions and locate rotated objects precisely. RR-CNN has three important new components including a rotated region of interest (RRoI) pooling layer, a rotated bounding box regression model and a multi-task method for non-maximal suppression (NMS) between different classes. Experimental results on the public ship dataset HRSC2016 confirm that RR-CNN outperforms baselines by a large margin.

General Instance Distillation for Object Detection

Xing Dai, Zeren Jiang, Zhao Wu +4 more

cs.CV · March 2021 · cited 262× · arXiv ↗ · more like this ·

In recent years, knowledge distillation has been proved to be an effective solution for model compression. This approach can make lightweight student models acquire the knowledge extracted from cumbersome teacher models. However, previous distillation methods of detection have weak generalization for different detection frameworks and rely heavily on ground truth (GT), ignoring the valuable relation information between instances. Thus, we propose a novel distillation method for detection tasks based on discriminative instances without considering the positive or negative distinguished by GT, which is called general instance distillation (GID). Our approach contains a general instance selection module (GISM) to make full use of feature-based, relation-based and response-based knowledge for distillation. Extensive results demonstrate that the student model achieves significant AP…

Sequence to Backward and Forward Sequences: A Content-Introducing Approach to Generative Short-Text Conversation

Lili Mou, Yiping Song, Rui Yan +3 more

cs.CL · July 2016 · cited 261× · arXiv ↗ · more like this ·

Using neural networks to generate replies in human-computer dialogue systems is attracting increasing attention over the past few years. However, the performance is not satisfactory: the neural network tends to generate safe, universally relevant replies which carry little meaning. In this paper, we propose a content-introducing approach to neural network-based generative dialogue systems. We first use pointwise mutual information (PMI) to predict a noun as a keyword, reflecting the main gist of the reply. We then propose seq2BF, a "sequence to backward and forward sequences" model, which generates a reply containing the given keyword. Experimental results show that our approach significantly outperforms traditional sequence-to-sequence models in terms of human evaluation and the entropy measure, and that the predicted keyword can appear at an appropriate position in the reply.

Fg-index

James Cheng, Yiping Ke, Wilfred Ng +1 more

Computer Vision and Pattern Recognition · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · 11 Jun 2007 · cited 259× · DOI ↗ · more like this ·

Graphs are prevalently used to model the relationships between objects in various domains. With the increasing usage of graph databases, it has become more and more demanding to efficiently process graph queries. Querying graph databases is costly since it involves subgraph isomorphism testing, which is an NP-complete problem. In recent years, some effective graph indexes have been proposed to first obtain a candidate answer set by filtering part of the false results and then perform verification on each candidate by checking subgraph isomorphism. Query performance is improved since the number of subgraph isomorphism tests is reduced. However, candidate verification is still inevitable, which can be expensive when the size of the candidate answer set is large. In this paper, we propose a novel indexing technique that constructs a nested inverted-index, called FG-index, based on the set…

Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View

Yiping Lu, Zhuohan Li, Di He +5 more

cs.LG · 6 Jun 2019 · cited 242× · arXiv ↗ · more like this ·

The Transformer architecture is widely used in natural language processing. Despite its success, the design principle of the Transformer remains elusive. In this paper, we provide a novel perspective towards understanding the architecture: we show that the Transformer can be mathematically interpreted as a numerical Ordinary Differential Equation (ODE) solver for a convection-diffusion equation in a multi-particle dynamic system. In particular, how words in a sentence are abstracted into contexts by passing through the layers of the Transformer can be interpreted as approximating multiple particles' movement in the space using the Lie-Trotter splitting scheme and the Euler's method. Given this ODE's perspective, the rich literature of numerical analysis can be brought to guide us in designing effective structures beyond the Transformer. As an example, we propose to replace the…

Application-specific instruction generation for configurable processor architectures

Jason Cong, Yiping Fan, Guoling Han +1 more

Hardware and Architecture · 22 Feb 2004 · cited 236× · DOI ↗ · more like this ·

Designing an application-specific embedded system in nanometer technologies has become more difficult than ever due to the rapid increase in design complexity and manufacturing cost. Efficiency and flexibility must be carefully balanced to meet different application requirements. The recently emerged configurable and extensible processor architectures offer a favorable tradeoff between efficiency and flexibility, and a promising way to minimize certain important metrics (e.g., execution time, code size, etc.) of the embedded processors. This paper addresses the problem of generating the application-specific instructions to improve the execution speed for configurable processors. A set of algorithms, including pattern generation, pattern selection, and application mapping, are proposed to efficiently utilize the instruction set extensibility of the target configurable processor.…

DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression

DeepSeek-AI, :, Anyi Xu +590 more

cs.CL · 17 Sep 2026 · cited 216× · arXiv ↗ · more like this ·

The widespread adoption of long-horizon agents has made model workloads increasingly input-heavy. Although prior work has substantially reduced the cost of long-context computation, prefill remains computationally expensive, and large KV caches continue to strain HBM and SSD capacity and data-transfer bandwidth. Together, these compute, storage, and bandwidth demands constitute the primary bottleneck to further lowering deployment costs. To address this challenge, we introduce DeepSeek-V4.1-Flash, a multimodal Mixture-of-Experts (MoE) model with 552B backbone parameters and support for contexts of up to one million tokens. With its Causal Encoder-Decoder (CED) architecture, the model activates 16B parameters per token during decode but only 8B parameters during prefill, substantially improving cost efficiency for agentic workloads. To push the limits of KV cache compression…

A Model for Sustainable Student Retention: A Holistic Perspective on the Student Dropout Problem with Special Attention to e-Learning

Zane L. Berge, Yiping Huang

Education · Maryland Shared Open Access Repository (USMAI Consortium) · May 2004 · cited 213× · DOI ↗ · more like this ·

This article introduces a comprehensive model to assist institutions in planning for interventions to address student dropout and to increase student retention. The model is the result of an extensive review, analysis, and synthesis of research and theoretical studies. It is flexible and represents a comprehensive set of factors related to student retention, categorized in meaningful ways, and can be used at multiple levels: institutional, departmental or program, by individual faculty, or by students. The need for a model of this kind has long been recognized because, as Woodley and Parlet (1983, cited in Cookson 1989) stated, there is a systematic problem involving the institution as a whole. The problem involving retention of students is not due to an isolated factor that can be “fixed,” but rather imagination and care must be used to carefully select interventions that are needed at…

Access to Housing in Urban China

John Logan, Yiping Fang, Zhan‐Xin Zhang

Political Science and International Relations · International Journal of Urban and Regional Research · 30 Nov 2009 · cited 206× · DOI ↗ · more like this ·

Abstract Like income inequality, housing inequality in urban China is strongly affected by state policies that give preferential treatment to insiders. In this case, the key policies are related to their residence status, which involves not only their migration history but also their legal position. Using data from the Chinese census of 2000 for eight large cities, this study shows how residence status affects access to various pathways to housing. In addition to the well‐known marginal housing situation of the recent ‘floating population’, it documents surprising advantages for migrants with urban registration status and persistent disadvantages for rural migrants regardless of how long they have lived in the city. Résumé Comme l’inégalité de revenu, l’inégalité de logement dans les villes chinoises est nettement affectée par les mesures étatiques qui privilégient les résidents en…

Dealing with Uncertainty: A Survey of Theories and Practices

Yiping Li, Jianwen Chen, Ling Feng

Signal Processing · IEEE Transactions on Knowledge and Data Engineering · 12 Sep 2012 · cited 204× · DOI ↗ · more like this ·

Uncertainty accompanies our life processes and covers almost all fields of scientific studies. Two general categories of uncertainty, namely, aleatory uncertainty and epistemic uncertainty, exist in the world. While aleatory uncertainty refers to the inherent randomness in nature, derived from natural variability of the physical world (e.g., random show of a flipped coin), epistemic uncertainty origins from human's lack of knowledge of the physical world, as well as ability of measuring and modeling the physical world (e.g., computation of the distance between two cities). Different kinds of uncertainty call for different handling methods. Aggarwal, Yu, Sarma, and Zhang et al. have made good surveys on uncertain database management based on the probability theory. This paper reviews multidisciplinary uncertainty processing activities in diverse fields. Beyond the dominant probability…

Black Trolls Matter: Racial and Ideological Asymmetries in Social Media Disinformation

Deen Freelon, Michael Bossetta, Chris Wells +3 more

Sociology and Political Science · Social Science Computer Review · 7 Apr 2020 · cited 185× · DOI ↗ · more like this ·

The recent rise of disinformation and propaganda on social media has attracted strong interest from social scientists. Research on the topic has repeatedly observed ideological asymmetries in disinformation content and reception, wherein conservatives are more likely to view, redistribute, and believe such content. However, preliminary evidence has suggested that race may also play a substantial role in determining the targeting and consumption of disinformation content. Such racial asymmetries may exist alongside, or even instead of, ideological ones. Our computational analysis of 5.2 million tweets by the Russian government-funded “troll farm” known as the Internet Research Agency sheds light on these possibilities. We find stark differences in the numbers of unique accounts and tweets originating from ostensibly liberal, conservative, and Black left-leaning individuals. But diverging…

DjiNN and Tonic

Johann Hauswald, Yiping Kang, Michael A. Laurenzano +6 more

Computer Vision and Pattern Recognition · 26 May 2015 · cited 165× · DOI ↗ · more like this ·

As applications such as Apple Siri, Google Now, Microsoft Cortana, and Amazon Echo continue to gain traction, web-service companies are adopting large deep neural networks (DNN) for machine learning challenges such as image processing, speech recognition, natural language processing, among others. A number of open questions arise as to the design of a server platform specialized for DNN and how modern warehouse scale computers (WSCs) should be outfitted to provide DNN as a service for these applications.