Author

Chun-E Fu

294 papers · 1987–2026

1987peak 21 in 20262026

Frequent co-authors

Papers

showing 1–25 of 294 RSS

CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification

Chun-Fu Chen, Quanfu Fan, Rameswar Panda

cs.CV · March 2021 · cited 2,271× · arXiv ↗ · more like this ·

The recently developed vision transformer (ViT) has achieved promising results on image classification compared to convolutional neural networks. Inspired by this, in this paper, we study how to learn multi-scale feature representations in transformer models for image classification. To this end, we propose a dual-branch transformer to combine image patches (i.e., tokens in a transformer) of different sizes to produce stronger image features. Our approach processes small-patch and large-patch tokens with two separate branches of different computational complexity and these tokens are then fused purely by attention multiple times to complement each other. Furthermore, to reduce computation, we develop a simple yet effective token fusion module based on cross attention, which uses a single token for each branch as a query to exchange information with other branches. Our proposed…

Fuzzy support vector machines

Chun-Fu Lin, Sheng‐De Wang

Computer Vision and Pattern Recognition · IEEE Transactions on Neural Networks · March 2002 · cited 1,489× · DOI ↗ · more like this ·

A support vector machine (SVM) learns the decision surface from two distinct classes of the input points. In many applications, each input point may not be fully assigned to one of these two classes. In this paper, we apply a fuzzy membership to each input point and reformulate the SVMs such that different input points can make different contributions to the learning of decision surface. We call the proposed method fuzzy SVMs (FSVMs).

NISP: Pruning Networks using Neuron Importance Score Propagation

Ruichi Yu, Ang Li, Chun-Fu Chen +6 more

cs.CV · November 2017 · cited 889× · arXiv ↗ · more like this ·

To reduce the significant redundancy in deep Convolutional Neural Networks (CNNs), most existing methods prune neurons by only considering statistics of an individual layer or two consecutive layers (e.g., prune one layer to minimize the reconstruction error of the next layer), ignoring the effect of error propagation in deep networks. In contrast, we argue that it is essential to prune neurons in the entire neuron network jointly based on a unified goal: minimizing the reconstruction error of important responses in the "final response layer" (FRL), which is the second-to-last layer before classification, for a pruned network to retrain its predictive power. Specifically, we apply feature ranking techniques to measure the importance of each neuron in the FRL, and formulate network pruning as a binary integer optimization problem and derive a closed-form solution to it for pruning…

RegionViT: Regional-to-Local Attention for Vision Transformers

Chun-Fu Chen, Rameswar Panda, Quanfu Fan

cs.CV · June 2021 · cited 262× · arXiv ↗ · more like this ·

Vision transformer (ViT) has recently shown its strong capability in achieving comparable results to convolutional neural networks (CNNs) on image classification. However, vanilla ViT simply inherits the same architecture from the natural language processing directly, which is often not optimized for vision applications. Motivated by this, in this paper, we propose a new architecture that adopts the pyramid structure and employ a novel regional-to-local attention rather than global self-attention in vision transformers. More specifically, our model first generates regional tokens and local tokens from an image with different patch sizes, where each regional token is associated with a set of local tokens based on the spatial location. The regional-to-local attention includes two steps: first, the regional self-attention extract global information among all regional tokens and then the…

Quantum equation of motion for computing molecular excitation energies on a noisy quantum processor

Pauline J Ollitrault, Abhinav Kandala, Chun-Fu Chen +7 more

quant-ph · October 2019 · cited 184× · arXiv ↗ · more like this ·

The computation of molecular excitation energies is essential for predicting photo-induced reactions of chemical and technological interest. While the classical computing resources needed for this task scale poorly, quantum algorithms emerge as promising alternatives. In particular, the extension of the variational quantum eigensolver algorithm to the computation of the excitation energies is an attractive option. However, there is currently a lack of such algorithms for correlated molecular systems that is amenable to near-term, noisy hardware. In this work, we propose an extension of the well-established classical equation of motion approach to a quantum algorithm for the calculation of molecular excitation energies on noisy quantum computers. In particular, we demonstrate the efficiency of this approach in the calculation of the excitation energies of the LiH molecule on an IBM…

Profiles of acculturative adjustment patterns among Chinese international students.

Kenneth T. Wang, Puncky P. Heppner, Chu‐Chun Fu +3 more

Communication · Journal of Counseling Psychology · 30 May 2012 · cited 183× · DOI ↗ · more like this ·

This is the first study to empirically identify distinct acculturative adjustment patterns of new international students over their first 3 semesters in the United States. The sample consisted of 507 Chinese international students studying in the United States. Using psychological distress as an indicator of acculturative adjustment, measured over 4 time points (prearrival, first semester, second semester, and third semester), 4 distinct groups of student adjustment trajectories emerged: (a) a group exhibiting high levels of psychological distress across each time point (consistently distressed; 10%), (b) a group with decreasing psychological distress scores from Time 1 to Time 2 (relieved; 14%), (c), those with a sharp peak in psychological distress at Time 2 and Time 3 (culture-shocked; 11%), and (d) a group with relatively consistent low psychological distress scores (well-adjusted…

Containing COVID-19 Among 627,386 Persons in Contact With the Diamond Princess Cruise Ship Passengers Who Disembarked in Taiwan: Big Data Analytics

Chi-Mai Chen, Hong-Wei Jyan, Shih-Chieh Chien +9 more

Information Systems · Journal of Medical Internet Research · 30 Apr 2020 · cited 166× · DOI ↗ · more like this ·

BACKGROUND: Low infection and case-fatality rates have been thus far observed in Taiwan. One of the reasons for this major success is better use of big data analytics in efficient contact tracing and management and surveillance of those who require quarantine and isolation. OBJECTIVE: We present here a unique application of big data analytics among Taiwanese people who had contact with more than 3000 passengers that disembarked at Keelung harbor in Taiwan for a 1-day tour on January 31, 2020, 5 days before the outbreak of coronavirus disease (COVID-19) on the Diamond Princess cruise ship on February 5, 2020, after an index case was identified on January 20, 2020. METHODS: The smart contact tracing-based mobile sensor data, cross-validated by other big sensor surveillance data, were analyzed by the mobile geopositioning method and rapid analysis to identify 627,386 potential…

A 1.3TOPS H.264/AVC single-chip encoder for HDTV applications

Yu‐Wen Huang, Tung-Chien Chen, Chen‐Han Tsai +9 more

Signal Processing · 30 Aug 2005 · cited 137× · DOI ↗ · more like this ·

An H.264/AVC encoder is implemented on a 31.72mm/sup 2/ die with 0.18/spl mu/m CMOS technology. A four-stage macroblock pipelined architecture encodes 720p 30f/s HDTV videos in real time at 108MHz. The encoded video quality is competitive with reference software requiring 3.6TOPS on a general-purpose processor-based platform.

More Is Less: Learning Efficient Video Representations by Big-Little Network and Depthwise Temporal Aggregation

Quanfu Fan, Chun-Fu Chen, Hilde Kuehne +2 more

cs.CV · 2 Dec 2019 · cited 136× · arXiv ↗ · more like this ·

Current state-of-the-art models for video action recognition are mostly based on expensive 3D ConvNets. This results in a need for large GPU clusters to train and evaluate such architectures. To address this problem, we present a lightweight and memory-friendly architecture for action recognition that performs on par with or better than current architectures by using only a fraction of resources. The proposed architecture is based on a combination of a deep subnet operating on low-resolution frames with a compact subnet operating on high-resolution frames, allowing for high efficiency and accuracy at the same time. We demonstrate that our approach achieves a reduction by $3\sim4$ times in FLOPs and $\sim2$ times in memory usage compared to the baseline. This enables training deeper models with more input frames under the same computational budget. To further obviate the need for…

A Broad Study on the Transferability of Visual Representations with Contrastive Learning

Ashraful Islam, Chun-Fu Chen, Rameswar Panda +3 more

cs.CV · March 2021 · cited 133× · arXiv ↗ · more like this ·

Tremendous progress has been made in visual representation learning, notably with the recent success of self-supervised contrastive learning methods. Supervised contrastive learning has also been shown to outperform its cross-entropy counterparts by leveraging labels for choosing where to contrast. However, there has been little work to explore the transfer capability of contrastive learning to a different domain. In this paper, we conduct a comprehensive study on the transferability of learned representations of different contrastive approaches for linear evaluation, full-network transfer, and few-shot recognition on 12 downstream datasets from different domains, and object detection tasks on MSCOCO and VOC0712. The results show that the contrastive approaches learn representations that are easily transferable to a different downstream task. We further observe that the joint objective…

AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model

Seungwhan Moon, Andrea Madotto, Zhaojiang Lin +10 more

cs.LG · 27 Sep 2023 · cited 130× · arXiv ↗ · more like this ·

We present Any-Modality Augmented Language Model (AnyMAL), a unified model that reasons over diverse input modality signals (i.e. text, image, video, audio, IMU motion sensor), and generates textual responses. AnyMAL inherits the powerful text-based reasoning abilities of the state-of-the-art LLMs including LLaMA-2 (70B), and converts modality-specific signals to the joint textual space through a pre-trained aligner module. To further strengthen the multimodal LLM's capabilities, we fine-tune the model with a multimodal instruction set manually collected to cover diverse topics and tasks beyond simple QAs. We conduct comprehensive empirical analysis comprising both human and automatic evaluations, and demonstrate state-of-the-art performance on various multimodal tasks.

Feature Engineering and Classifier Ensemble for KDD Cup 2010

Hsiang‐Fu Yu, Hung-Yi Lo, Hsun-Ping Hsieh +9 more

Artificial Intelligence · Knowledge Discovery and Data Mining · 2010 · cited 128× · OpenAlex ↗ · more like this ·

KDD Cup 2010 is an educational data mining competition. Participants are asked to learn a model from students ’ past behavior and then predict their future performance. At National Taiwan University, we organized a course for this competition. Most student sub-teams expanded features by various binarization and discretization techniques. The resulting sparse feature sets were trained by logistic regression (using LIBLINEAR). One sub-team considered condensed features using simple statistical techniques and applied Random Forest (through Weka) for training. Initial development was conducted on an internal split of training data for training and validation. We identified some useful feature combinations to improve performance. For the final submission, we combined results of student sub-teams by regularized linear regression. Our team is the first prize winner of both tracks (all teams…

Deep Analysis of CNN-based Spatio-temporal Representations for Action Recognition

Chun-Fu Chen, Rameswar Panda, Kandan Ramakrishnan +4 more

cs.CV · October 2020 · cited 126× · arXiv ↗ · more like this ·

In recent years, a number of approaches based on 2D or 3D convolutional neural networks (CNN) have emerged for video action recognition, achieving state-of-the-art results on several large-scale benchmark datasets. In this paper, we carry out in-depth comparative analysis to better understand the differences between these approaches and the progress made by them. To this end, we develop an unified framework for both 2D-CNN and 3D-CNN action models, which enables us to remove bells and whistles and provides a common ground for fair comparison. We then conduct an effort towards a large-scale analysis involving over 300 action recognition models. Our comprehensive analysis reveals that a) a significant leap is made in efficiency for action recognition, but not in accuracy; b) 2D-CNN and 3D-CNN models behave similarly in terms of spatio-temporal representation abilities and transferability.…

Survey of learning experiences and influence of learning style preferences on user intentions regarding <scp>MOOC</scp> s

Ray-I Chang, Yu Hsin Hung, Chun Fu Lin

Computer Science Applications · British Journal of Educational Technology · April 2015 · cited 107× · DOI ↗ · more like this ·

Abstract With the rapid development of web techniques, information and communication technology is being increasingly used in curricula, and learning portfolios can be automatically retrieved and maintained as learners interact through e‐learning platforms. Further, massive open online courses ( MOOC s), which apply such technology to provide open access to hundreds and thousands of learners, have recently gained popularity in higher education. Learning styles refer to an individual's approach to learning based on their preferences, strengths and weaknesses. It was speculated that different learning styles could affect a learner's preference for MOOC s. Therefore, in this study, we investigated the influence of learning styles on the learners' intentions to use MOOC s. The participants comprised 184 undergraduate students, who were surveyed regarding their learning experiences…

Dynamic Distillation Network for Cross-Domain Few-Shot Recognition with Unlabeled Data

Ashraful Islam, Chun-Fu Chen, Rameswar Panda +3 more

cs.CV · June 2021 · cited 106× · arXiv ↗ · more like this ·

Most existing works in few-shot learning rely on meta-learning the network on a large base dataset which is typically from the same domain as the target dataset. We tackle the problem of cross-domain few-shot learning where there is a large shift between the base and target domain. The problem of cross-domain few-shot recognition with unlabeled target data is largely unaddressed in the literature. STARTUP was the first method that tackles this problem using self-training. However, it uses a fixed teacher pretrained on a labeled base dataset to create soft labels for the unlabeled target samples. As the base dataset and unlabeled dataset are from different domains, projecting the target images in the class-domain of the base dataset with a fixed pretrained model might be sub-optimal. We propose a simple dynamic distillation-based approach to facilitate unlabeled images from the…

Big-Little Net: An Efficient Multi-Scale Feature Representation for Visual and Speech Recognition

Chun-Fu Chen, Quanfu Fan, Neil Mallinar +2 more

cs.CV · July 2018 · cited 105× · arXiv ↗ · more like this ·

In this paper, we propose a novel Convolutional Neural Network (CNN) architecture for learning multi-scale feature representations with good tradeoffs between speed and accuracy. This is achieved by using a multi-branch network, which has different computational complexity at different branches. Through frequent merging of features from branches at distinct scales, our model obtains multi-scale features while using less computation. The proposed approach demonstrates improvement of model efficiency and performance on both object recognition and speech recognition tasks,using popular architectures including ResNet and ResNeXt. For object recognition, our approach reduces computation by 33% on object recognition while improving accuracy with 0.9%. Furthermore, our model surpasses state-of-the-art CNN acceleration approaches by a large margin in accuracy and FLOPs reduction. On the task of…

AdaMML: Adaptive Multi-Modal Learning for Efficient Video Recognition

Rameswar Panda, Chun-Fu Chen, Quanfu Fan +4 more

cs.CV · 12 May 2021 · cited 72× · arXiv ↗ · more like this ·

Multi-modal learning, which focuses on utilizing various modalities to improve the performance of a model, is widely used in video recognition. While traditional multi-modal learning offers excellent recognition results, its computational expense limits its impact for many real-world applications. In this paper, we propose an adaptive multi-modal learning framework, called AdaMML, that selects on-the-fly the optimal modalities for each segment conditioned on the input for efficient video recognition. Specifically, given a video segment, a multi-modal policy network is used to decide what modalities should be used for processing by the recognition model, with the goal of improving both accuracy and efficiency. We efficiently train the policy network jointly with the recognition model using standard back-propagation. Extensive experiments on four challenging diverse datasets demonstrate…

Analysis and reduction of reference frames for motion estimation in MPEG-4 AVC/JVT/H.264

Yu‐Wen Huang, Bing-Yu Hsieh, Tu-Chih Wang +4 more

Signal Processing · 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03). · 3 Feb 2004 · cited 71× · DOI ↗ · more like this ·

In the new video coding standard, MPEG-4 AVC/JVT/H.264, motion estimation is allowed to use multiple reference frames. The reference software adopts a full search scheme, and the increased computation is in proportion to the number of searched reference frames. However, the reduction of prediction residues is highly dependent on the nature of the sequences, not on the number of searched frames. We present a method to speed up the matching process for multiple reference frames. For each macroblock, we analyze the available information after intra prediction and motion estimation from the previous frame to determine whether it is necessary to search more frames. The information we use includes selected mode, inter prediction residues, intra prediction residues, and motion vectors. Simulation results show that the proposed algorithm can save up to 90% of unnecessary frames while keeping…

VALHALLA: Visual Hallucination for Machine Translation

Yi Li, Rameswar Panda, Yoon Kim +4 more

cs.CV · 31 May 2022 · cited 59× · arXiv ↗ · more like this ·

Designing better machine translation systems by considering auxiliary inputs such as images has attracted much attention in recent years. While existing methods show promising performance over the conventional text-only translation systems, they typically require paired text and image as input during inference, which limits their applicability to real-world scenarios. In this paper, we introduce a visual hallucination framework, called VALHALLA, which requires only source sentences at inference time and instead uses hallucinated visual representations for multimodal machine translation. In particular, given a source sentence an autoregressive hallucination transformer is used to predict a discrete visual representation from the input text, and the combined text and hallucinated representations are utilized to obtain the target translation. We train the hallucination transformer jointly…

Dynamic Network Quantization for Efficient Video Inference

Ximeng Sun, Rameswar Panda, Chun-Fu Chen +3 more

cs.CV · 23 Aug 2021 · cited 58× · arXiv ↗ · more like this ·

Deep convolutional networks have recently achieved great success in video recognition, yet their practical realization remains a challenge due to the large amount of computational resources required to achieve robust recognition. Motivated by the effectiveness of quantization for boosting efficiency, in this paper, we propose a dynamic network quantization framework, that selects optimal precision for each frame conditioned on the input for efficient video recognition. Specifically, given a video clip, we train a very lightweight network in parallel with the recognition network, to produce a dynamic policy indicating which numerical precision to be used per frame in recognizing videos. We train both networks effectively using standard backpropagation with a loss to achieve both competitive performance and resource efficiency required for video recognition. Extensive experiments on four…

Fourier regularization method for solving a Cauchy problem for the Laplace equation

Chun-E Fu, Huichun Li, Zhi Qian +1 more

Mathematical Physics · Inverse Problems in Science and Engineering · March 2008 · cited 57× · DOI ↗ · more like this ·

In this article, we use Fourier method to solve a Cauchy problem for the Laplace equation in a strip region, the method is rather simple and convenient. Meanwhile, we overstep the Holder continuity and provide some more sharp error estimates between the exact solution and its approximation. Numerical examples also show that the method work effectively.

DBSCAN Spatial Clustering Analysis of Urban “Production–Living–Ecological” Space Based on POI Data: A Case Study of Central Urban Wuhan, China

Xiaoqiang Tu, Chun Fu, An Huang +2 more

Transportation · International Journal of Environmental Research and Public Health · 23 Apr 2022 · cited 56× · DOI ↗ · more like this ·

As urban spatial patterns are the prerequisite and foundation of urban planning, spatial pattern research will enable its improvement. The formation mechanism and definition of an urban "production-living-ecological" space is used here to construct a classification system for POI (points of interests) data, crawl POI data in Python, and DBSCAN (density-based spatial clustering of application with noise) to perform cluster analysis. This mechanism helps to determine the cluster density and to study the overall and component spatial patterns of the "production-living-ecological" space in the central urban area of Wuhan. The research results are as follows. (1) The spatial patterns of "production-living-ecological" space have significant spatial hierarchical characteristics. Among them, the spatial polarizations of "living" and "production" are significant, while the "ecological" spatial…

Task2Sim : Towards Effective Pre-training and Transfer from Synthetic Data

Samarth Mishra, Rameswar Panda, Cheng Perng Phoo +5 more

cs.CV · December 2021 · cited 47× · arXiv ↗ · more like this ·

Pre-training models on Imagenet or other massive datasets of real images has led to major advances in computer vision, albeit accompanied with shortcomings related to curation cost, privacy, usage rights, and ethical issues. In this paper, for the first time, we study the transferability of pre-trained models based on synthetic data generated by graphics simulators to downstream tasks from very different domains. In using such synthetic data for pre-training, we find that downstream performance on different tasks are favored by different configurations of simulation parameters (e.g. lighting, object pose, backgrounds, etc.), and that there is no one-size-fits-all solution. It is thus better to tailor synthetic pre-training data to a specific downstream task, for best performance. We introduce Task2Sim, a unified model mapping downstream task representations to optimal simulation…

Fractal soliton solutions for the fractal-fractional shallow water wave equation arising in ocean engineering

Kang‐Le Wang, Chun-Fu Wei

Modeling and Simulation · Alexandria Engineering Journal · 26 Oct 2022 · cited 43× · DOI ↗ · more like this ·

The generalized shallow water wave equation is an important mathematical model that is used to elaborate ocean engineering, weather simulations, tsunami prediction and tidal currents. In this work, the generalized (3 + 1)-dimensional fractal-fractional shallow water wave equation (FFSWWE) is investigated where fractal-fractional derivative is taken in the conformable derivative sense. Some new fractal soliton solutions of FFSWWE are successfully derived by the fractal-fractional variational wave method (FFVWM), which is a new mathematical technology. This new method has the advantages of being simple, efficient, and direct. The 3D graphics that describe these new fractal soliton solutions that were obtained are tremendously important for improving our understanding of physical oceanography.

A powerful and simple frequency formula to nonlinear fractal oscillators

Wang Kang-le, Chun-Fu Wei

Modeling and Simulation · Journal of low frequency noise, vibration and active control · 10 Aug 2020 · cited 37× · DOI ↗ · more like this ·

In this work, a fractal nonlinear oscillator is successfully established by fractal derivative in a fractal space, and its variational principle is obtained by semi-inverse transform method. The variational principle can provide conservation laws in an energy form. The approximate frequency of the fractal oscillator is found by a simple fractal frequency formula. An example shows the fractal frequency formula is a powerful and simple tool to fractal oscillators.