Author

Sheng Yu

531 papers · 1942–2026

1967peak 42 in 20242026

Frequent co-authors

Papers

showing 1–25 of 531 RSS

CNN-generated images are surprisingly easy to spot... for now

Sheng-Yu Wang, Oliver Wang, Richard Zhang +2 more

cs.CV · December 2019 · cited 1,676× · arXiv ↗ · more like this ·

In this work we ask whether it is possible to create a "universal" detector for telling apart real images from these generated by a CNN, regardless of architecture or dataset used. To test this, we collect a dataset consisting of fake images generated by 11 different CNN-based image generator models, chosen to span the space of commonly used architectures today (ProGAN, StyleGAN, BigGAN, CycleGAN, StarGAN, GauGAN, DeepFakes, cascaded refinement networks, implicit maximum likelihood estimation, second-order attention super-resolution, seeing-in-the-dark). We demonstrate that, with careful pre- and post-processing and data augmentation, a standard image classifier trained on only one specific CNN generator (ProGAN) is able to generalize surprisingly well to unseen architectures, datasets, and training methods (including the just released StyleGAN2). Our findings suggest the intriguing…

Ablating Concepts in Text-to-Image Diffusion Models

Nupur Kumari, Bingliang Zhang, Sheng-Yu Wang +3 more

cs.CV · March 2023 · cited 386× · arXiv ↗ · more like this ·

Large-scale text-to-image diffusion models can generate high-fidelity images with powerful compositional ability. However, these models are typically trained on an enormous amount of Internet data, often containing copyrighted material, licensed images, and personal photos. Furthermore, they have been found to replicate the style of various living artists or memorize exact training samples. How can we remove such copyrighted concepts or images without retraining the model from scratch? To achieve this goal, we propose an efficient method of ablating concepts in the pretrained model, i.e., preventing the generation of a target concept. Our algorithm learns to match the image distribution for a target style, instance, or text prompt we wish to ablate to the distribution corresponding to an anchor concept. This prevents the model from generating target concepts given its text condition.…

MIB: Metal Ion-Binding Site Prediction and Docking Server

Yu‐Feng Lin, Chih-Wen Cheng, Shih Chung-Shiuan +3 more

Computational Theory and Mathematics · Journal of Chemical Information and Modeling · 29 Nov 2016 · cited 299× · DOI ↗ · more like this ·

High Resolution Image Download MS PowerPoint Slide The structure of a protein determines its biological function(s) and its interactions with other factors; the binding regions tend to be conserved in sequence and structure, and the interacting residues involved are usually in close 3D space. The Protein Data Bank currently contains more than 110 000 protein structures, approximately one-third of which contain metal ions. Identifying and characterizing metal ion-binding sites is thus essential for investigating a protein’s function(s) and interactions. However, experimental approaches are time-consuming and costly. The web server reported here was built to predict metal ion-binding residues and to generate the predicted metal ion-bound 3D structure. Binding templates have been constructed for regions that bind 12 types of metal ion-binding residues have been used to construct binding…

BioBART: Pretraining and Evaluation of A Biomedical Generative Language Model

Hongyi Yuan, Zheng Yuan, Ruyi Gan +3 more

cs.CL · 22 Apr 2022 · cited 197× · arXiv ↗ · more like this ·

Pretrained language models have served as important backbones for natural language processing. Recently, in-domain pretraining has been shown to benefit various domain-specific downstream tasks. In the biomedical domain, natural language generation (NLG) tasks are of critical importance, while understudied. Approaching natural language understanding (NLU) tasks as NLG achieves satisfying performance in the general domain through constrained language generation or language prompting. We emphasize the lack of in-domain generative language models and the unsystematic generative downstream benchmarks in the biomedical domain, hindering the development of the research community. In this work, we introduce the generative language model BioBART that adapts BART to the biomedical domain. We collate various biomedical language generation tasks including dialogue, summarization, entity linking…

State Complexity of Regular Languages

Sheng Yü

Computational Theory and Mathematics · Justus-Liebig-Universität Gießen · 2001 · cited 196× · DOI ↗ · more like this ·

State complexity is a descriptional complexity measure for regular languages based on the deterministic finite automaton model. We investigate and review the problems related to the state complexity of regular languages, as well as finite languages, and their operations. In particular, we compare various state complexity results for general regular languages to those for finite languages.

Detecting Photoshopped Faces by Scripting Photoshop

Sheng-Yu Wang, Oliver Wang, Andrew Owens +2 more

cs.CV · June 2019 · cited 153× · arXiv ↗ · more like this ·

Most malicious photo manipulations are created using standard image editing tools, such as Adobe Photoshop. We present a method for detecting one very popular Photoshop manipulation -- image warping applied to human faces -- using a model trained entirely using fake images that were automatically generated by scripting Photoshop itself. We show that our model outperforms humans at the task of recognizing manipulated images, can predict the specific location of edits, and in some cases can be used to "undo" a manipulation to reconstruct the original, unedited image. We demonstrate that the system can be successfully applied to real, artist-created image manipulations.

Biomedical Question Answering: A Survey of Approaches and Challenges

Qiao Jin, Zheng Yuan, Guangzhi Xiong +7 more

cs.CL · February 2021 · cited 150× · arXiv ↗ · more like this ·

Automatic Question Answering (QA) has been successfully applied in various domains such as search engines and chatbots. Biomedical QA (BQA), as an emerging QA task, enables innovative applications to effectively perceive, access and understand complex biomedical knowledge. There have been tremendous developments of BQA in the past two decades, which we classify into 5 distinctive approaches: classic, information retrieval, machine reading comprehension, knowledge base and question entailment approaches. In this survey, we introduce available datasets and representative methods of each BQA approach in detail. Despite the developments, BQA systems are still immature and rarely used in real-life settings. We identify and characterize several key challenges in BQA that might lead to this issue, and discuss some potential future directions to explore.

Enabling phenotypic big data with PheNorm

Sheng Yu, Yumeng Ma, Jessica Gronsbell +9 more

Artificial Intelligence · Journal of the American Medical Informatics Association · 14 Sep 2017 · cited 127× · DOI ↗ · more like this ·

Objective: Electronic health record (EHR)-based phenotyping infers whether a patient has a disease based on the information in his or her EHR. A human-annotated training set with gold-standard disease status labels is usually required to build an algorithm for phenotyping based on a set of predictive features. The time intensiveness of annotation and feature curation severely limits the ability to achieve high-throughput phenotyping. While previous studies have successfully automated feature curation, annotation remains a major bottleneck. In this paper, we present PheNorm, a phenotyping algorithm that does not require expert-labeled samples for training. Methods: The most predictive features, such as the number of International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) codes or mentions of the target phenotype, are normalized to resemble a normal…

A sharpening of the Parikh mapping

Alexandru Mateescu, Arto Salomaa, Kai Salomaa +1 more

Computational Theory and Mathematics · RAIRO - Theoretical Informatics and Applications · November 2001 · cited 126× · DOI ↗ · more like this ·

In this paper we introduce a sharpening of the Parikh mapping and investigate its basic properties. The new mapping is based on square matrices of a certain form. The classical Parikh vector appears in such a matrix as the second diagonal. However, the matrix product gives more information about a word than the Parikh vector. We characterize the matrix products and establish also an interesting interconnection between mirror images of words and inverses of .

On the Limit Sets of Cellular Automata

Karel Čulík, Jan Pachl, Sheng Yü

Computational Theory and Mathematics · SIAM Journal on Computing · August 1989 · cited 123× · DOI ↗ · more like this ·

The limit sets of cellular automata, defined by Wolfram, play an important role in applications of cellular automata to complex systems. A number of results on limit sets are proved, considering both finite and infinite configurations of cellular automata. The main concern of this paper is with testing membership and (essential) emptiness of limit sets for linear and two-dimensional cellular automata.

Routing protocols for wireless sensor networks with mobile sinks: a survey

Sheng Yu, Baoxian Zhang, Cheng Li +1 more

Computer Networks and Communications · IEEE Communications Magazine · July 2014 · cited 119× · DOI ↗ · more like this ·

Wireless sensor networks with mobile sinks, mWSNs, have attracted a lot of attention recently. This is because sink mobility can greatly alleviate the hotspot issue in WSNs and further prolong the network lifetime. However, sink mobility also causes unexpected changes in network topology and data routing paths, which can largely affect the routing performance in such networks. Design of efficient routing protocols for mWSNs has been a critical issue, and much work has been carried out in this aspect. In this article, we first classify existing protocols based on different design criteria and then present a survey of the state-of-the-art routing protocols in this area. We illustrate how each of the protocols works, and discuss their advantages and disadvantages. Finally, we point out some future directions for efficient routing in mWSNs.

A FORMAL STUDY OF PRACTICAL REGULAR EXPRESSIONS

Cezar Câmpeanu, Kai Salomaa, Sheng Yü

Computational Theory and Mathematics · International Journal of Foundations of Computer Science · December 2003 · cited 98× · DOI ↗ · more like this ·

Regular expressions are used in many practical applications. Practical regular expressions are commonly called "regex". It is known that regex are different from regular expressions. In this paper, we give regex a formal treatment. We make a distinction between regex and extended regex; while regex represent regular languages, extended regex represent a family of languages larger than regular languages. We prove a pumping lemma for the languages expressed by extended regex. We show that the languages represented by extended regex are incomparable with context-free languages and a proper subset of context-sensitive languages. Other properties of the languages represented by extended regex are also studied.

Engineering Surface Analysis With Different Wavelet Bases

Sheng‐Yu Fu, Bala Muralikrishnan, J. Raja

Computer Vision and Pattern Recognition · Journal of Manufacturing Science and Engineering · November 2003 · cited 98× · DOI ↗ · more like this ·

Traditional surface texture analysis involves filtering surface profiles into different wavelength bands commonly referred to as roughness, waviness and form. The primary motivation in filtering surface profiles is to map each band to the manufacturing process that generated the part and the intended functional performance of the component. Current trends in manufacturing are towards tighter tolerances and higher performance standards that require close monitoring of the process. Thus, there is a need for finer bandwidths for process mapping and functional correlation. Wavelets are becoming increasingly popular tools for filtering profiles in an efficient manner into multiple bands. While they have broadly been demonstrated as having superior performance and capabilities than traditional filtering, fundamental issues such as choice of wavelet bases have remained unaddressed. The major…

Surrogate-assisted feature extraction for high-throughput phenotyping

Sheng Yu, Abhishek Chakrabortty, Katherine P. Liao +8 more

Artificial Intelligence · Journal of the American Medical Informatics Association · 15 Sep 2016 · cited 92× · DOI ↗ · more like this ·

OBJECTIVE: Phenotyping algorithms are capable of accurately identifying patients with specific phenotypes from within electronic medical records systems. However, developing phenotyping algorithms in a scalable way remains a challenge due to the extensive human resources required. This paper introduces a high-throughput unsupervised feature selection method, which improves the robustness and scalability of electronic medical record phenotyping without compromising its accuracy. METHODS: The proposed Surrogate-Assisted Feature Extraction (SAFE) method selects candidate features from a pool of comprehensive medical concepts found in publicly available knowledge sources. The target phenotype's International Classification of Diseases, Ninth Revision and natural language processing counts, acting as noisy surrogates to the gold-standard labels, are used to create silver-standard labels.…

Accelerating String Matching Using Multi-Threaded Algorithm on GPU

Cheng-Hung Lin, Sheng-Yu Tsai, Chen-Hsiung Liu +2 more

Hardware and Architecture · December 2010 · cited 74× · DOI ↗ · more like this ·

Network Intrusion Detection System has been widely used to protect computer systems from network attacks. Due to the ever-increasing number of attacks and network complexity, traditional software approaches on uni-processors have become inadequate for the current high-speed network. In this paper, we propose a novel parallel algorithm to speedup string matching performed on GPUs. We also innovate new state machine for string matching, the state machine of which is more suitable to be performed on GPU. We have also described several speedup techniques considering special architecture properties of GPU. The experimental results demonstrate the new algorithm on GPUs achieves up to 4,000 times speedup compared to the AC algorithm on CPU. Compared to other GPU approaches, the new algorithm achieves 3 times faster with significant improvement on memory efficiency. Furthermore, because the new…

Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuning

Hongyi Yuan, Zheng Yuan, Sheng Yu

cs.CL · April 2022 · cited 71× · arXiv ↗ · more like this ·

Entities lie in the heart of biomedical natural language understanding, and the biomedical entity linking (EL) task remains challenging due to the fine-grained and diversiform concept names. Generative methods achieve remarkable performances in general domain EL with less memory usage while requiring expensive pre-training. Previous biomedical EL methods leverage synonyms from knowledge bases (KB) which is not trivial to inject into a generative method. In this work, we use a generative approach to model biomedical EL and propose to inject synonyms knowledge in it. We propose KB-guided pre-training by constructing synthetic samples with synonyms and definitions from KB and require the model to recover concept names. We also propose synonyms-aware fine-tuning to select concept names for training, and propose decoder prompt and multi-synonyms constrained prefix tree for inference. Our…

A Survey on Operational State Complexity

Yuan Gao, Nelma Moreira, Rogério Reis +1 more

cs.FL · 10 Sep 2015 · cited 68× · arXiv ↗ · more like this ·

Descriptional complexity is the study of the conciseness of the various models representing formal languages. The state complexity of a regular language is the size, measured by the number of states of the smallest, either deterministic or nondeterministic, finite automaton that recognises it. Operational state complexity is the study of the state complexity of operations over languages. In this survey, we review the state complexities of individual regularity preserving language operations on regular and some subregular languages. Then we revisit the state complexities of the combination of individual operations. We also review methods of estimation and approximation of state complexity of more complex combined operations.

Tight Lower Bound for the State Complexity of Shuffle of Regular Languages

Cezar Câmpeanu, Kai Salomaa, Sheng Yü

Computational Theory and Mathematics · Justus-Liebig-Universität Gießen · 2002 · cited 66× · DOI ↗ · more like this ·

The upper bound for the state complexity of the shuffle of two regular languages is $2^{mn}-1$. We prove that this bound can be reached for some (not necessarily complete) deterministic finite automata With, respectively, $m$ and $n$ states. Our construction uses an alphabet of size 5.

Ultimate Generalization to Monotonicity for Uniform Convergence of Trigonometric Series

Song-Ping Zhou, Ping Zhou, Dan-Sheng Yu

math.CA · 27 Nov 2006 · cited 62× · arXiv ↗ · more like this ·

Chaundy and Jolliffe [4] proved that if $\{a_{n}\}$ is a non-increasing (monotonic) real sequence with $\lim\limits_{n\to \infty}a_{n}=0$, then a necessary and sufficient condition for the uniform convergence of the series $\sum_{n=1}^{\infty}a_{n}\sin nx$ is $ \lim\limits_{n\to \infty}na_{n}=0$. We generalize (or weaken) the monotonic condition on the coefficient sequence $\{a_{n}\}$ in this classical result to the so-called mean value bounded variation condition and prove that the generalized condition cannot be weakened further. We also establish an analogue to the generalized Chaundy and Jolliffe theorem in the complex space.

Generation of Synthetic Electronic Medical Record Text

Jiaqi Guan, Runzhe Li, Sheng Yu +1 more

cs.CL · 6 Dec 2018 · cited 61× · arXiv ↗ · more like this ·

Machine learning (ML) and Natural Language Processing (NLP) have achieved remarkable success in many fields and have brought new opportunities and high expectation in the analyses of medical data. The most common type of medical data is the massive free-text electronic medical records (EMR). It is widely regarded that mining such massive data can bring up important information for improving medical practices as well as for possible new discoveries on complex diseases. However, the free EMR texts are lacking consistent standards, rich of private information, and limited in availability. Also, as they are accumulated from everyday practices, it is often hard to have a balanced number of samples for the types of diseases under study. These problems hinder the development of ML and NLP methods for EMR data analysis. To tackle these problems, we developed a model to generate synthetic text…

Evaluating Data Attribution for Text-to-Image Models

Sheng-Yu Wang, Alexei A. Efros, Jun-Yan Zhu +1 more

cs.CV · June 2023 · cited 60× · arXiv ↗ · more like this ·

While large text-to-image models are able to synthesize "novel" images, these images are necessarily a reflection of the training data. The problem of data attribution in such models -- which of the images in the training set are most responsible for the appearance of a given generated image -- is a difficult yet important one. As an initial step toward this problem, we evaluate attribution through "customization" methods, which tune an existing large-scale model toward a given exemplar object or style. Our key insight is that this allows us to efficiently create synthetic images that are computationally influenced by the exemplar by construction. With our new dataset of such exemplar-influenced images, we are able to evaluate various data attribution algorithms and different possible feature spaces. Furthermore, by training on our dataset, we can tune standard models, such as DINO…

Pattern languages with and without erasing

Tao Jiang, Efim Kinber, Arto Salomaa +2 more

Artificial Intelligence · International Journal of Computer Mathematics · 1994 · cited 60× · DOI ↗ · more like this ·

The paper deals with the problems related to finding a pattern common to all words in a given set. We restrict our attention to patterns expressible by the use of variables ranging over words. Two essentially different cases result, depending on whether or not the empty word belongs to the range. We investigate equivalence and inclusion problems, patterns descriptive for a set, as well as some complexity issues. The inclusion problem between two pattern languages turns out to be of fundamental theoretical importance because many problems in the classical combinatorics of words can be reduced to it.

A novel medical image segmentation approach by using multi-branch segmentation network based on local and global information synchronous learning

Shangzhu Jin, Sheng Yu, Jun Peng +2 more

Computer Vision and Pattern Recognition · Scientific Reports · 25 Apr 2023 · cited 57× · DOI ↗ · more like this ·

In recent years, there have been several solutions to medical image segmentation, such as U-shaped structure, transformer-based network, and multi-scale feature learning method. However, their network parameters and real-time performance are often neglected and cannot segment boundary regions well. The main reason is that such networks have deep encoders, a large number of channels, and excessive attention to local information rather than global information, which is crucial to the accuracy of image segmentation. Therefore, we propose a novel multi-branch medical image segmentation network MBSNet. We first design two branches using a parallel residual mixer (PRM) module and dilate convolution block to capture the local and global information of the image. At the same time, a SE-Block and a new spatial attention module enhance the output features. Considering the different output…

A COVID-19 Pandemic Artificial Intelligence–Based System With Deep Learning Forecasting and Automatic Statistical Data Acquisition: Development and Implementation Study

Cheng-Sheng Yu, Shy-Shin Chang, Tzu‐Hao Chang +4 more

Modeling and Simulation · Journal of Medical Internet Research · 26 Apr 2021 · cited 57× · DOI ↗ · more like this ·

BACKGROUND: More than 79.2 million confirmed COVID-19 cases and 1.7 million deaths were caused by SARS-CoV-2; the disease was named COVID-19 by the World Health Organization. Control of the COVID-19 epidemic has become a crucial issue around the globe, but there are limited studies that investigate the global trend of the COVID-19 pandemic together with each country's policy measures. OBJECTIVE: We aimed to develop an online artificial intelligence (AI) system to analyze the dynamic trend of the COVID-19 pandemic, facilitate forecasting and predictive modeling, and produce a heat map visualization of policy measures in 171 countries. METHODS: The COVID-19 Pandemic AI System (CPAIS) integrated two data sets: the data set from the Oxford COVID-19 Government Response Tracker from the Blavatnik School of Government, which is maintained by the University of Oxford, and the data set from the…

Learning Long-Term Temporal Features With Deep Neural Networks for Human Action Recognition

Sheng Yu, Li Xie, Lin Liu +1 more

Computer Vision and Pattern Recognition · IEEE Access · 25 Dec 2019 · cited 53× · DOI ↗ · more like this ·

One of challenging tasks in the field of artificial intelligence is the human action recognition. In this paper, we propose a novel long-term temporal feature learning architecture for recognizing human action in video, named Pseudo Recurrent Residual Neural Networks (P-RRNNs), which exploits the recurrent architecture and composes each in different connection among units. Two-stream CNNs model (GoogLeNet) is employed for extracting local temporal and spatial features respectively. The local spatial and temporal features are then integrated into global long-term temporal features by using our proposed two-stream P-RRNNs. Finally, the Softmax layer fuses the outputs of two-stream P-RRNNs for action recognition. The experimental results on two standard databases UCF101 and HMDB51 demonstrate the outstanding performance of proposed method based on architectures for human action recognition.