arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Yongyi

912 papers · 1991–2026

1991: 11992: 01993: 51994: 21995: 11996: 11997: 11998: 01999: 12000: 12001: 52002: 162003: 112004: 92005: 182006: 152007: 192008: 122009: 232010: 292011: 182012: 242013: 122014: 262015: 322016: 342017: 252018: 282019: 392020: 482021: 522022: 522023: 802024: 892025: 1032026: 80
1991peak 103 in 20252026

Frequent co-authors

Papers

showing 1–25 of 912 RSS

TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation

Jieneng Chen, Yongyi Lu, Qihang Yu +6 more

cs.CV · · cited 6,404× · arXiv ↗ · more like this ·

Medical image segmentation is an essential prerequisite for developing healthcare systems, especially for disease diagnosis and treatment planning. On various medical image segmentation tasks, the u-shaped architecture, also known as U-Net, has become the de-facto standard and achieved tremendous success. However, due to the intrinsic locality of convolution operations, U-Net generally demonstrates limitations in explicitly modeling long-range dependency. Transformers, designed for sequence-to-sequence prediction, have emerged as alternative architectures with innate global self-attention mechanisms, but can result in limited localization abilities due to insufficient low-level details. In this paper, we propose TransUNet, which merits both Transformers and U-Net, as a strong alternative for medical image segmentation. On one hand, the Transformer encodes tokenized image patches from a…

TransUNet: Rethinking the U-Net architecture design for medical image segmentation through the lens of transformers

Jieneng Chen, Jieru Mei, Xianhang Li +9 more

Computer Vision and Pattern Recognition · Medical Image Analysis · · cited 988× · DOI ↗ · more like this ·

Medical image segmentation is crucial for healthcare, yet convolution-based methods like U-Net face limitations in modeling long-range dependencies. To address this, Transformers designed for sequence-to-sequence predictions have been integrated into medical image segmentation. However, a comprehensive understanding of Transformers' self-attention in U-Net components is lacking. TransUNet, first introduced in 2021, is widely recognized as one of the first models to integrate Transformer into medical image analysis. In this study, we present the versatile framework of TransUNet that encapsulates Transformers' self-attention into two key modules: (1) a Transformer encoder tokenizing image patches from a convolution neural network (CNN) feature map, facilitating global context extraction, and (2) a Transformer decoder refining candidate regions through cross-attention between proposals and…

A support vector machine approach for detection of microcalcifications

I. El-Naqa, Yongyi Yang, M.N. Wernick +2 more

Artificial Intelligence · IEEE Transactions on Medical Imaging · · cited 574× · DOI ↗ · more like this ·

In this paper, we investigate an approach based on support vector machines (SVMs) for detection of microcalcification (MC) clusters in digital mammograms, and propose a successive enhancement learning scheme for improved performance. SVM is a machine-learning method, based on the principle of structural risk minimization, which performs well when applied to data outside the training set. We formulate MC detection as a supervised-learning problem and apply SVM to develop the detection algorithm. We use the SVM to detect at each location in the image whether an MC is present or not. We tested the proposed method using a database of 76 clinical mammograms containing 1120 MCs. We use free-response receiver operating characteristic curves to evaluate detection performance, and compare the proposed algorithm with several existing methods. In our experiments, the proposed SVM framework…

Random effect models for repeated measures of zero-inflated count data

Yongyi Min, Alan Agresti

Statistics and Probability · Statistical Modelling · · cited 367× · DOI ↗ · more like this ·

For count responses, the situation of excess zeros (relative to what standard models allow) often occurs in biomedical and sociological applications. Modeling repeated measures of zero-inflated count data presents special challenges. This is because in addition to the problem of extra zeros, the correlation between measurements upon the same subject at different occasions needs to be taken into account. This article discusses random effect models for repeated measurements on this type of response variable. A useful model is the hurdle model with random effects, which separately handles the zero observations and the positive counts. In maximum likelihood model fitting, we consider both a normal distribution and a nonparametric approach for the random effects. A special case of the hurdle model can be used to test for zero inflation. Random effects can also be introduced in a…

MixUp as Locally Linear Out-Of-Manifold Regularization

Hongyu Guo, Yongyi Mao, Richong Zhang

cs.LG · · cited 359× · arXiv ↗ · more like this ·

MixUp is a recently proposed data-augmentation scheme, which linearly interpolates a random pair of training examples and correspondingly the one-hot representations of their labels. Training deep neural networks with such additional data is shown capable of significantly improving the predictive accuracy of the current art. The power of MixUp, however, is primarily established empirically and its working and effectiveness have not been explained in any depth. In this paper, we develop an understanding for MixUp as a form of "out-of-manifold regularization", which imposes certain "local linearity" constraints on the model's input space beyond the data manifold. This analysis enables us to identify a limitation of MixUp, which we call "manifold intrusion". In a nutshell, manifold intrusion in MixUp is a form of under-fitting resulting from conflicts between the synthetic labels of the…

Regularized reconstruction to reduce blocking artifacts of block discrete cosine transform compressed images

Yongyi Yang, N.P. Galatsanos, Aggelos K. Katsaggelos

Computer Vision and Pattern Recognition · IEEE Transactions on Circuits and Systems for Video Technology · · cited 355× · DOI ↗ · more like this ·

The reconstruction of images from incomplete block discrete cosine transform (BDCT) data is examined. The problem is formulated as one of regularized image recovery. According to this formulation, the image in the decoder is reconstructed by using not only the transmitted data but also prior knowledge about the smoothness of the original image, which complements the transmitted data. Two methods are proposed for solving this regularized recovery problem. The first is based on the theory of projections onto convex sets (POCS) while the second is based on the constrained least squares (CLS) approach. For the POCS-based method, a new constraint set is defined that conveys smoothness information not captured by the transmitted BDCT coefficients, and the projection onto it is computed. For the CLS method an objective function is proposed that captures the smoothness properties of the…

Machine Learning in Medical Imaging

Miles N. Wernick, Yongyi Yang, Jovan G. Brankov +2 more

Artificial Intelligence · IEEE Signal Processing Magazine · · cited 352× · DOI ↗ · more like this ·

This article will discuss very different ways of using machine learning that may be less familiar, and we will demonstrate through examples the role of these concepts in medical imaging. Although the term machine learning is relatively recent, the ideas of machine learning have been applied to medical imaging for decades, perhaps most notably in the areas of computer-aided diagnosis (CAD) and functional brain mapping. We will not attempt in this brief article to survey the rich literature of this field. Instead our goals will be 1) to acquaint the reader with some modern techniques that are now staples of the machine-learning field and 2) to illustrate how these techniques can be employed in various ways in medical imaging.

Projection-based spatially adaptive reconstruction of block-transform compressed images

Yongyi Yang, N.P. Galatsanos, Aggelos K. Katsaggelos

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · · cited 321× · DOI ↗ · more like this ·

At the present time, block-transform coding is probably the most popular approach for image compression. For this approach, the compressed images are decoded using only the transmitted transform data. We formulate image decoding as an image recovery problem. According to this approach, the decoded image is reconstructed using not only the transmitted data but, in addition, the prior knowledge that images before compression do not display between-block discontinuities. A spatially adaptive image recovery algorithm is proposed based on the theory of projections onto convex sets. Apart from the data constraint set, this algorithm uses another new constraint set that enforces between-block smoothness. The novelty of this set is that it captures both the local statistical properties of the image and the human perceptual characteristics. A simplified spatially adaptive recovery algorithm is…

A study on several Machine-learning methods for classification of Malignant and benign clustered microcalcifications

Liyang Wei, Yongyi Yang, Robert M. Nishikawa +1 more

Artificial Intelligence · IEEE Transactions on Medical Imaging · · cited 309× · DOI ↗ · more like this ·

In this paper, we investigate several state-of-the-art machine-learning methods for automated classification of clustered microcalcifications (MCs). The classifier is part of a computer-aided diagnosis (CADx) scheme that is aimed to assisting radiologists in making more accurate diagnoses of breast cancer on mammograms. The methods we considered were: support vector machine (SVM), kernel Fisher discriminant (KFD), relevance vector machine (RVM), and committee machines (ensemble averaging and AdaBoost), of which most have been developed recently in statistical learning theory. We formulated differentiation of malignant from benign MCs as a supervised learning problem, and applied these learning methods to develop the classification algorithm. As input, these methods used image features automatically extracted from clustered MCs. We tested these methods using a database of 697 clinical…

Augmenting Data with Mixup for Sentence Classification: An Empirical Study

Hongyu Guo, Yongyi Mao, Richong Zhang

cs.CL · · cited 269× · arXiv ↗ · more like this ·

Mixup, a recent proposed data augmentation method through linearly interpolating inputs and modeling targets of random samples, has demonstrated its capability of significantly improving the predictive accuracy of the state-of-the-art networks for image classification. However, how this technique can be applied to and what is its effectiveness on natural language processing (NLP) tasks have not been investigated. In this paper, we propose two strategies for the adaption of Mixup on sentence classification: one performs interpolation on word embeddings and another on sentence embeddings. We conduct experiments to evaluate our methods using several benchmark datasets. Our studies show that such interpolation strategies serve as an effective, domain independent data augmentation approach for sentence classification, and can result in significant accuracy improvement for both CNN and LSTM…

On Small-Sample Confidence Intervals for Parameters in Discrete Distributions

Alan Agresti, Yongyi Min

Statistics and Probability · Biometrics · · cited 209× · DOI ↗ · more like this ·

The traditional definition of a confidence interval requires the coverage probability at any value of the parameter to be at least the nominal confidence level. In constructing such intervals for parameters in discrete distributions, less conservative behavior results from inverting a single two-sided test than inverting two separate one-sided tests of half the nominal level each. We illustrate for a variety of discrete problems, including interval estimation of a binomial parameter, the difference and the ratio of two binomial parameters for independent samples, and the odds ratio.

Rateless coding over fading channels

Jeff Castura, Yongyi Mao

Computer Networks and Communications · IEEE Communications Letters · · cited 189× · DOI ↗ · more like this ·

We propose a framework for communication over fading channels utilizing rateless codes. An implementation using fountain codes is simulated, demonstrating that such a scheme has advantages in efficiency, reliability and robustness over conventional fixed-rate codes, particularly when channel state information is not available at the transmitter.

Domain Adaptive Relational Reasoning for 3D Multi-Organ Segmentation

Shuhao Fu, Yongyi Lu, Yan Wang +4 more

cs.CV · · cited 181× · arXiv ↗ · more like this ·

In this paper, we present a novel unsupervised domain adaptation (UDA) method, named Domain Adaptive Relational Reasoning (DARR), to generalize 3D multi-organ segmentation models to medical data collected from different scanners and/or protocols (domains). Our method is inspired by the fact that the spatial relationship between internal structures in medical images is relatively fixed, e.g., a spleen is always located at the tail of a pancreas, which serves as a latent variable to transfer the knowledge shared across multiple domains. We formulate the spatial relationship by solving a jigsaw puzzle task, i.e., recovering a CT scan from its shuffled patches, and jointly train it with the organ segmentation task. To guarantee the transferability of the learned spatial relationship to multiple domains, we additionally introduce two schemes: 1) Employing a super-resolution network also…

A heuristic search for good low-density parity-check codes at short block lengths

Yongyi Mao, Amir H. Banihashemi

Computer Networks and Communications · · cited 172× · DOI ↗ · more like this ·

For a given block length and given degree sequences of the underlying Tanner graph (TG), the ensemble of short low-density parity-check (LDPC) codes can have considerable variation in performance. We present an efficient heuristic method to find good LDPC codes based on what we define as the girth distribution of the TG. This method can be used effectively to design short codes for applications where delay and complexity are of major concern.

Long-Term Human Motion Prediction by Modeling Motion Context and Enhancing Motion Dynamic

Yongyi Tang, Lin Ma, Wei Liu +1 more

cs.CV · · cited 161× · arXiv ↗ · more like this ·

Human motion prediction aims at generating future frames of human motion based on an observed sequence of skeletons. Recent methods employ the latest hidden states of a recurrent neural network (RNN) to encode the historical skeletons, which can only address short-term prediction. In this work, we propose a motion context modeling by summarizing the historical human motion with respect to the current prediction. A modified highway unit (MHU) is proposed for efficiently eliminating motionless joints and estimating next pose given the motion context. Furthermore, we enhance the motion dynamic by minimizing the gram matrix loss for long-term motion prediction. Experimental results show that the proposed model can promisingly forecast the human future movements, which yields superior performances over related state-of-the-art approaches. Moreover, specifying the motion context with the…

On the representation and embedding of knowledge bases beyond binary relations

Jianfeng Wen, Jianxin Li, Yongyi Mao +2 more

cs.LG · · cited 159× · arXiv ↗ · more like this ·

The models developed to date for knowledge base embedding are all based on the assumption that the relations contained in knowledge bases are binary. For the training and testing of these embedding models, multi-fold (or n-ary) relational data are converted to triples (e.g., in FB15K dataset) and interpreted as instances of binary relations. This paper presents a canonical representation of knowledge bases containing multi-fold relations. We show that the existing embedding models on the popular FB15K datasets correspond to a sub-optimal modelling framework, resulting in a loss of structural information. We advocate a novel modelling framework, which models multi-fold relations directly using this canonical representation. Using this framework, the existing TransH model is generalized to a new model, m-TransH. We demonstrate experimentally that m-TransH outperforms TransH by a large…

Communication-Efficient Accurate Statistical Estimation

Jianqing Fan, Yongyi Guo, Kaizheng Wang

stat.ML · · cited 157× · arXiv ↗ · more like this ·

When the data are stored in a distributed manner, direct application of traditional statistical inference procedures is often prohibitive due to communication cost and privacy concerns. This paper develops and investigates two Communication-Efficient Accurate Statistical Estimators (CEASE), implemented through iterative algorithms for distributed optimization. In each iteration, node machines carry out computation in parallel and communicate with the central processor, which then broadcasts aggregated information to node machines for new updates. The algorithms adapt to the similarity among loss functions on node machines, and converge rapidly when each node machine has large enough sample size. Moreover, they do not require good initialization and enjoy linear converge guarantees under general conditions. The contraction rate of optimization errors is presented explicitly, with…

Relevance vector machine for automatic detection of clustered microcalcifications

Liyang Wei, Yongyi Yang, Robert M. Nishikawa +2 more

Artificial Intelligence · IEEE Transactions on Medical Imaging · · cited 156× · DOI ↗ · more like this ·

Clustered microcalcifications (MC) in mammograms can be an important early sign of breast cancer in women. Their accurate detection is important in computer-aided detection (CADe). In this paper, we propose the use of a recently developed machine-learning technique--relevance vector machine (RVM)--for detection of MCs in digital mammograms. RVM is based on Bayesian estimation theory, of which a distinctive feature is that it can yield a sparse decision function that is defined by only a very small number of so-called relevance vectors. By exploiting this sparse property of the RVM, we develop computerized detection algorithms that are not only accurate but also computationally efficient for MC detection in mammograms. We formulate MC detection as a supervised-learning problem, and apply RVM as a classifier to determine at each location in the mammogram if an MC object is present or not.…

Online Video Object Detection Using Association LSTM

Yongyi Lu, Cewu Lu, Chi–Keung Tang

Computer Vision and Pattern Recognition · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · · cited 144× · DOI ↗ · more like this ·

Video object detection is a fundamental tool for many applications. Since direct application of image-based object detection cannot leverage the rich temporal information inherent in video data, we advocate to the detection of long-range video object pattern. While the Long Short-Term Memory (LSTM) has been the de facto choice for such detection, currently LSTM cannot fundamentally model object association between consecutive frames. In this paper, we propose the association LSTM to address this fundamental association problem. Association LSTM not only regresses and classifiy directly on object locations and categories but also associates features to represent each output object. By minimizing the matching error between these features, we learn how to associate objects in two consecutive frames. Additionally, our method works in an online manner, which is important for most video…

Rateless Coding for Wireless Relay Channels

Jeff Castura, Yongyi Mao

Computer Networks and Communications · IEEE Transactions on Wireless Communications · · cited 143× · DOI ↗ · more like this ·

We propose a novel coding framework for wireless relay channels based on rateless codes, which allows for a natural extension to multiple antenna and multiple relay settings. The relaying protocol is half-duplex, and relays independently choose when to collaborate, if at all. With a simulated fountain code based implementation of this framework, we show that the use of rateless codes is both robust and efficient when the channel state information is not available at the transmitters

Modeling Nonnegative Data with Clumping at Zero: A Survey

Yongyi Min, Alan Agresti

Statistics and Probability · Journal of the Iranian Statistical Society · · cited 143× · OpenAlex ↗ · more like this ·

Applications in which data take nonnegative values but have a substantial proportion of values at zero occur in many dis- ciplines. The modeling of such clumped-at-zero or zero-inflated data is challenging. We survey models that have been proposed. We consider cases in which the response for the non-zero observations is continuous and in which it is discrete. For the continuous and then the discrete case, we review models for analyzing cross-sectional data. We then summarize extensions for repeated measurement analyses (e.g., in longitudinal studies), for which the literature is still sparse. We also mention applications in which more than one clump can oc- cur and we suggest problems for future research.

Prostate Cancer Localization With Multispectral MRI Using Cost-Sensitive Support Vector Machines and Conditional Random Fields

Yusuf Artan, Masoom A. Haider, Deanna L. Langer +6 more

Artificial Intelligence · IEEE Transactions on Image Processing · · cited 137× · DOI ↗ · more like this ·

Prostate cancer is a leading cause of cancer death for men in the United States. Fortunately, the survival rate for early diagnosed patients is relatively high. Therefore, in vivo imaging plays an important role for the detection and treatment of the disease. Accurate prostate cancer localization with noninvasive imaging can be used to guide biopsy, radiotherapy, and surgery as well as to monitor disease progression. Magnetic resonance imaging (MRI) performed with an endorectal coil provides higher prostate cancer localization accuracy, when compared to transrectal ultrasound (TRUS). However, in general, a single type of MRI is not sufficient for reliable tumor localization. As an alternative, multispectral MRI, i.e., the use of multiple MRI-derived datasets, has emerged as a promising noninvasive imaging technique for the localization of prostate cancer; however almost all studies are…

Prostate Cancer Segmentation With Simultaneous Estimation of Markov Random Field Parameters and Class

Xin Liu, Deanna L. Langer, Masoom A. Haider +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Medical Imaging · · cited 135× · DOI ↗ · more like this ·

Prostate cancer is one of the leading causes of death from cancer among men in the United States. Currently, high-resolution magnetic resonance imaging (MRI) has been shown to have higher accuracy than trans-rectal ultrasound (TRUS) when used to ascertain the presence of prostate cancer. As MRI can provide both morphological and functional images for a tissue of interest, some researchers are exploring the uses of multispectral MRI to guide prostate biopsies and radiation therapy. However, success with prostate cancer localization based on current imaging methods has been limited due to overlap in feature space of benign and malignant tissues using any one MRI method and the interobserver variability. In this paper, we present a new unsupervised segmentation method for prostate cancer detection, using fuzzy Markov random fields (fuzzy MRFs) for the segmentation of multispectral MR…

Skywork: A More Open Bilingual Foundation Model

Tianwen Wei, Liang Zhao, Lichang Zhang +27 more

cs.CL · · cited 134× · arXiv ↗ · more like this ·

In this technical report, we present Skywork-13B, a family of large language models (LLMs) trained on a corpus of over 3.2 trillion tokens drawn from both English and Chinese texts. This bilingual foundation model is the most extensively trained and openly published LLMs of comparable size to date. We introduce a two-stage training methodology using a segmented corpus, targeting general purpose training and then domain-specific enhancement training, respectively. We show that our model not only excels on popular benchmarks, but also achieves \emph{state of the art} performance in Chinese language modeling on diverse domains. Furthermore, we propose a novel leakage detection method, demonstrating that test data contamination is a pressing issue warranting further investigation by the LLM community. To spur future research, we release Skywork-13B along with checkpoints obtained during…