arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Yuning Yang

59 papers · 2002–2026

2002: 22003: 02004: 02005: 02006: 12007: 12008: 02009: 02010: 12011: 42012: 12013: 32014: 02015: 42016: 22017: 12018: 02019: 32020: 42021: 22022: 92023: 42024: 52025: 42026: 8
2002peak 9 in 20222026

Frequent co-authors

Papers

showing 1–25 of 59 RSS

Further Results for Perron–Frobenius Theorem for Nonnegative Tensors

Yuning Yang, Qingzhi Yang

Computational Mathematics · SIAM Journal on Matrix Analysis and Applications · · cited 434× · DOI ↗ · more like this ·

We give further results on the Perron–Frobenius theorem for tensors, generalize other theorems from matrices to tensors, and give an equivalent condition for nonnegative irreducible tensors.MSC codes74B9915A1815A69Keywordsnonnegative tensorPerron–Frobenius theoremKy Fan theoremmaxmin problem

Learning with the maximum correntropy criterion induced losses for regression

Yunlong Feng, Xiaolin Huang, Lei Shi +2 more

Signal Processing · Lirias (KU Leuven) · · cited 113× · DOI ↗ · more like this ·

Within the statistical learning framework, this paper studies the regression model associ-ated with the correntropy induced losses. The correntropy, as a similarity measure, has been frequently employed in signal processing and pattern recognition. Motivated by its empirical successes, this paper aims at presenting some theoretical understanding towards the maximum correntropy criterion in regression problems. Our focus in this paper is two-fold: first, we are concerned with the connections between the regression model associated with the correntropy induced loss and the least squares regression model. Second, we study its convergence property. A learning theory analysis which is centered around the above two aspects is conducted. From our analysis, we see that the scale parameter in the loss function balances the convergence rates of the regression model and its robustness. We then…

On some properties of nonnegative weakly irreducible tensors

Yuning Yang, Qingzhi Yang

math.SP · · cited 77× · arXiv ↗ · more like this ·

In this paper, we mainly focus on how to generalize some conclusions from nonnegative irreducible tensors to nonnegative weakly irreducible tensors. To do so, a basic and important lemma is proven using new tools. First, we give the definition of stochastic tensors. Then we show that every nonnegative weakly irreducible tensor with spectral radius being one is diagonally similar to a unique weakly irreducible stochastic tensor. Based on it, we prove some important lemmas, which help us to generalize the results related. Some counterexamples are provided to show that some conclusions for nonnegative irreducible tensors do not hold for nonnegative weakly irreducible tensors.

Robust Support Vector Machines for Classification with Nonconvex and Smooth Losses

Yunlong Feng, Yuning Yang, Xiaolin Huang +2 more

Computer Vision and Pattern Recognition · Neural Computation · · cited 54× · DOI ↗ · more like this ·

This letter addresses the robustness problem when learning a large margin classifier in the presence of label noise. In our study, we achieve this purpose by proposing robustified large margin support vector machines. The robustness of the proposed robust support vector classifiers (RSVC), which is interpreted from a weighted viewpoint in this work, is due to the use of nonconvex classification losses. Besides the robustness, we also show that the proposed RSCV is simultaneously smooth, which again benefits from using smooth classification losses. The idea of proposing RSVC comes from M-estimation in statistics since the proposed robust and smooth classification losses can be taken as one-sided cost functions in robust statistics. Its Fisher consistency property and generalization ability are also investigated. Besides the robustness and smoothness, another nice property of RSVC lies in…

Learning the User’s Deeper Preferences for Multi-modal Recommendation Systems

Fei Lei, Zhongqi Cao, Yuning Yang +2 more

Information Systems · ACM Transactions on Multimedia Computing Communications and Applications · · cited 40× · DOI ↗ · more like this ·

Recommendation system plays an important role in the rapid development of micro-video sharing platform. Micro-video has rich modal features, such as visual, audio, and text. It is of great significance to carry out personalized recommendation by integrating multi-modal features. However, most of the current multi-modal recommendation systems can only enrich the feature representation on the item side, while it leads to poor learning of user preferences. To solve this problem, we propose a novel module named Learning the User’s Deeper Preferences (LUDP) , which constructs the item-item modal similarity graph and user preference graph in each modality to explore the learning of item and user representation. Specifically, we construct item-item similar modalities graph using multi-modal features, the item ID embedding is propagated and aggregated on the graph to learn the latent structural…

A Rank-One Tensor Updating Algorithm for Tensor Completion

Yuning Yang, Yunlong Feng, Johan A. K. Suykens

Computational Mathematics · IEEE Signal Processing Letters · · cited 36× · DOI ↗ · more like this ·

© 1994-2012 IEEE. In this letter, we propose a rank-one tensor updating algorithm for solving tensor completion problems. Unlike the existing methods which penalize the tensor by using the sum of nuclear norms of unfolding matrices, our optimization model directly employs the tensor nuclear norm which is studied recently. Under the framework of the conditional gradient method, we show that at each iteration, solving the proposed model amounts to computing the tensor spectral norm and the related rank-one tensor. Because the problem of finding the related rank-one tensor is NP-hard, we propose a subroutine to solve it approximately, which is of low computational complexity. Experimental results on real datasets show that our algorithm is efficient and effective.

Rank-1 Tensor Properties with Applications to a Class of Tensor Optimization Problems

Yuning Yang, Yunlong Feng, Xiaolin Huang +1 more

Computational Mathematics · SIAM Journal on Optimization · · cited 24× · DOI ↗ · more like this ·

© 2016 Society for Industrial and Applied Mathematics. This paper studies models and algorithms for a class of tensor optimization problems, based on a rank-1 equivalence property between a tensor and certain unfoldings. It is first shown that in dth order tensor space, the set of rank-1 tensors is the same as the intersection of ⌈log2(d)⌉ tensor sets, of which tensors have a specific rank-1 balanced unfolding matrix. Moreover, the number ⌈log2(d)⌉ is proved to be optimal in some sense. Based on the above equivalence property, three relaxation approaches for solving the best rank-1 tensor approximation problems are proposed, including two convex relaxations and a nonconvex one. The two convex relaxations utilize the matrix nuclear norm regularization/constraints. They have the advantage of identifying whether the solution is a global optimizer of the original problem, by computing the…

The Epsilon-Alternating Least Squares for Orthogonal Low-Rank Tensor Approximation and Its Global Convergence

Yuning Yang

math.OC · · cited 18× · arXiv ↗ · more like this ·

The epsilon alternating least squares ($ε$-ALS) is developed and analyzed for canonical polyadic decomposition (approximation) of a higher-order tensor where one or more of the factor matrices are assumed to be columnwisely orthonormal. It is shown that the algorithm globally converges to a KKT point for all tensors without any assumption. For the original ALS, by further studying the properties of the polar decomposition, we also establish its global convergence under a reality assumption not stronger than those in the literature. These results completely address a question concerning the global convergence raised in [L. Wang, M. T. Chu and B. Yu, \emph{SIAM J. Matrix Anal. Appl.}, 36 (2015), pp. 1--19]. In addition, an initialization procedure is proposed, which possesses a provable lower bound when the number of columnwisely orthonormal factors is one. Armed with this initialization…

Dense Contrastive-Based Federated Learning for Dense Prediction Tasks on Medical Images

Yuning Yang, Xiaohong Liu, Tianrun Gao +3 more

Artificial Intelligence · IEEE Journal of Biomedical and Health Informatics · · cited 17× · DOI ↗ · more like this ·

Deep learning (DL) models have achieved remarkable success in various domains. But training an accurate DL model requires large amounts of data, which can be challenging to obtain in medical settings due to privacy concerns. Recently, federated learning (FL) has emerged as a promising solution that shares local models instead of raw data. However, FL in medical settings faces challenges of client drift due to the data heterogeneity across dispersed institutions. Although there exist studies to address this challenge, they mainly focus on the classification tasks that learn global representation of an entire image. Few have been studied on the dense prediction tasks, such as object detection. In this study, we propose dense contrastive-based federated learning (DCFL) tailored for dense prediction tasks in FL settings. DCFL introduces dense contrastive learning to FL, which aligns the…

Deep neural networks for syllable based acoustic modeling in Chinese speech recognition

Xiangang Li, Caifu Hong, Yuning Yang +1 more

Artificial Intelligence · · cited 9× · DOI ↗ · more like this ·

Recently, the deep neural networks (DNNs) based acoustic modeling methods have been successfully applied to many speech recognition tasks. This paper reports the work about applying DNNs for syllable based acoustic modeling in Chinese automatic speech recognition (ASR). Compared with initial/finals (IFs), syllable can implicitly model the intra-syllable variations in better accuracy. However, the context dependent syllable based modeling set holds too many units, bringing about heavy problems on modeling and decoding implementation. In this paper, a WFST decoding framework is applied. Moreover, the decision tree based state tying and DNNs based models are discussed for the acoustic model training. The experimental results show that compared with the traditional IFs based modeling method, the proposed syllable modeling method using DNNs is more robust for data sparsity problem, which…

Some modified relaxed alternating projection methods for solving the two-sets convex feasibility problem

Yuning Yang, Qingzhi Yang

Computational Theory and Mathematics · Optimization · · cited 7× · DOI ↗ · more like this ·

Let A, B be nonempty, closed convex sets in an n-dimensional Euclid space ℛ n . One problem is to find a* ∈ A and b* ∈ B such that ‖a* − b*‖ = inf a∈A,b∈B ‖a − b‖. Relaxed alternating projection (RAP) Cegielski and Suchocka [A. Cegielski and A. Suchocka, Relaxed alternating projection methods, SIAM J. Optim. 19 (2008), pp. 1093–1106.] algorithm is a method to solve this problem. This method directly calculates a self-adapt variable step-size which is larger than a positive number at every iteration, but it needs to compute the orthogonal projections P A and P B . However, in some cases, it is difficult or even impossible to compute P A and P B exactly. In this article, based on this method, we present some modified RAP algorithms, in which we replace P A and P B by and , where A k and B k are the halfspaces containing the original sets A and B, respectively. Then we employ three search…

An algorithm to find the spectral radius of nonnegative tensors and its convergence analysis

Yuning Yang, Qingzhi Yang, Yanguang Li

math.SP · · cited 7× · arXiv ↗ · more like this ·

In this paper we propose an iterative algorithm to find out the spectral radius of nonnegative tensors. This algorithm is an extension of the smoothing method for finding the largest eigenvalue of a nonnegative matrix \cite{s14}. For nonnegative irreducible tensors, we establish the converges of the algorithm. Finally we report some numerical results and conclude this paper with some remarks.

Higher order Matching Pursuit for Low Rank Tensor Learning

Yuning Yang, Siamak Mehrkanoon, Johan A. K. Suykens

stat.ML · · cited 5× · arXiv ↗ · more like this ·

Low rank tensor learning, such as tensor completion and multilinear multitask learning, has received much attention in recent years. In this paper, we propose higher order matching pursuit for low rank tensor learning problems with a convex or a nonconvex cost function, which is a generalization of the matching pursuit type methods. At each iteration, the main cost of the proposed methods is only to compute a rank-one tensor, which can be done efficiently, making the proposed methods scalable to large scale problems. Moreover, storing the resulting rank-one tensors is of low storage requirement, which can help to break the curse of dimensionality. The linear convergence rate of the proposed methods is established in various circumstances. Along with the main methods, we also provide a method of low computational complexity for approximately computing the rank-one tensors, with provable…

Reputation Mechanism Designed for Blockchain Empowered Dynamic Spectrum Sharing System

Yuning Yang, Xiaodong Xu, Shujun Han +2 more

Information Systems · 2022 IEEE 33rd Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · · cited 4× · DOI ↗ · more like this ·

Blockchain-based dynamic spectrum sharing (DSS) is viewed as a robust measure to address the management and allocation of spectrum resources for Internet of Things (IoT) ecosystems in a secure and auditable manner. However, existing blockchain empowered DSS systems commonly assume the perfect communications among the nodes without any interference and throughput constraints, which will mislead the spectrum owner into making suboptimal decisions, especially under the time-varying and unstable channel situation in IoT. To overcome the influence of the imperfect channel situations on DSS, we propose a novel reputation mechanism-based blockchain empowered DSS system in this paper. By considering both the historical transaction successful rate and the communication throughput and the real-time channel situations, the reputation mechanism enables the spectrum owner to make the appropriate…

Dynamic surface control for formation control of quadrotors with input constraints and disturbances

Dun Ao, Rui Wang, Fei Lei +1 more

Computer Networks and Communications · Transactions of the Institute of Measurement and Control · · cited 4× · DOI ↗ · more like this ·

In this paper, a novel formation control scheme is presented by integrating the dynamic surface control for multi-quadrotor subject with model uncertainties and external disturbances. First, according to requirements of formation control, the target trajectories of followers are obtained by the designed virtual quadrotors. Then, the formation control problem is transformed into the trajectory tracking control problem. Second, the saturation function and the auxiliary system are developed to make up for nonlinear terms arising from input saturation. A nonlinear extended state observer (ESO) is proposed to estimate and compensate for model uncertainties and external disturbances, and a dynamic surface controller based on the nonlinear ESO is constructed for the desired formation performance. In addition, the amount of communications between the quadrotors is decreased by the constructed…

FEDMBP: Multi-Branch Prototype Federated Learning on Heterogeneous Data

Tianrun Gao, Xiaohong Liu, Yuning Yang +1 more

Artificial Intelligence · · cited 3× · DOI ↗ · more like this ·

Federated learning (FL) enables collaborative model training across clients while preserving data privacy. However, FL faces the challenge of data heterogeneity, leading to biased local models that deviate from the global model during optimization. And existing FL algorithms like Federated Averaging (FedAvg) suffer from this issue. To address this problem, we propose a novel approach called multi-branch prototype federated learning (FedMBP). FedMBP creates auxiliary branches within each local model to integrate different levels of local and global prototypes, thus preventing local model drift by aligning local prototypes with global ones. We also introduce mixed cross-entropy on the auxiliary branches to effectively transfer global prototype knowledge to local models. We conduct experiments on three publicly available datasets, including natural and medical image domains. Our…

Effect of Ukraine-Russia Conflict on the Cryptocurrency Market: an Event Study Perspective

Yuning Yang

Information Systems · BCP Business & Management · · cited 3× · DOI ↗ · more like this ·

Russia massively invaded Ukraine on February 24, 2022, unavoidably having an effect on the world economy and finance. This paper uses the event study to research the short-term response of the February 2022 top 5 variable-price cryptocurrencies (BTC, ETH, BNB, XRP, SOL) to the Russia-Ukrainian war under the constant mean model. The cryptocurrency volatility was dramatic during the event window, and cryptocurrencies did not show the characteristics of safe haven. Overall, the result of the effect of the Russia-Ukraine war on the cryptocurrency market was negative, with the least negative impact on SOL and the most negative impact on BNB, XRP. Finally, Using the different event window analysis, it shows the cryptocurrency market return volatility rebounded, but it does not sufficiently indicate there is a positive trend in the cryptocurrency market after the event. The analysis of this…

Overview of SHRC-Ginkgo speech synthesis system for Blizzard Challenge 2013

Yansuo Yu, Fengyun Zhu, Xiangang Li +6 more

Artificial Intelligence · · cited 3× · DOI ↗ · more like this ·

This paper introduces the SHRC-Ginkgo speech synthesis system for Blizzard Challenge 2013. A unit selection based approach is adopted to develop our speech synthesis system using audiobook speech corpus. Aiming at roughly labeled corpora with several hundred hours of speech, our system adopts lightlysupervised acoustic model training of speech recognition to s-elect clean speech data with accurate text. Moreover, rich syntactic contexts instead of prosodic structure are utilized to refine traditional acoustic models. Through automatic syntactic parsing, this way can also help to label the corpora of several tens or even hundreds of hours automatically, thus avoiding manually prosodic annotation with time-consuming and expensive effort. In order to solve the problems of memory space expansion and running time burden for acoustic model training of large-scale corpora, a fast training…

Flexible Sharpness-Aware Personalized Federated Learning

Xinda Xing, Qiugang Zhan, Xiurui Xie +3 more

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence · · cited 2× · DOI ↗ · more like this ·

Personalized federated learning (PFL) is a new paradigm to address the statistical heterogeneity problem in federated learning. Most existing PFL methods focus on leveraging global and local information such as model interpolation or parameter decoupling. However, these methods often overlook the generalization potential during local client learning. From a local optimization perspective, we propose a simple and general PFL method, Federated learning with Flexible Sharpness-Aware Minimization (FedFSA). Specifically, we emphasize the importance of applying a larger perturbation to critical layers of the local model when using the Sharpness-Aware Minimization (SAM) optimizer. Then, we design a metric, perturbation sensitivity, to estimate the layer-wise sharpness of each local model. Based on this metric, FedFSA can flexibly select the layers with the highest sharpness to employ larger…

TimeAutoDiff: A Unified Framework for Generation, Imputation, Forecasting, and Time-Varying Metadata Conditioning of Heterogeneous Time Series Tabular Data

Namjoon Suh, Yuning Yang, Din-Yin Hsieh +4 more

cs.LG · · cited 2× · arXiv ↗ · more like this ·

We present TimeAutoDiff, a unified latent-diffusion framework for four fundamental time-series tasks: unconditional generation, missing-data imputation, forecasting, and time-varying-metadata conditional generation. The model natively supports heterogeneous features including continuous, binary, and categorical variables. We unify all tasks using a masked-modeling strategy in which a binary mask specifies which time-series cells are observed and which must be generated. TimeAutoDiff combines a lightweight variational autoencoder, which maps mixed-type features into a continuous latent sequence, with a diffusion model that learns temporal dynamics in this latent space. Two architectural choices provide strong speed and scalability benefits. The diffusion model samples an entire latent trajectory at once rather than denoising one timestep at a time, greatly reducing reverse-diffusion…

SPD-CFL: Stepwise Parameter Dropout for Efficient Continual Federated Learning

Yuning Yang, Han Yu, Chuan Sun +5 more

cs.LG · · cited 2× · arXiv ↗ · more like this ·

Federated Learning (FL) is a collaborative machine learning paradigm for training models on local sensitive data with privacy protection. Pre-trained transformer-based models have emerged as useful foundation models (FMs) to be fine-tuned for a wide range of downstream tasks. However, large-scale pre-trained models make it challenging for traditional FL due to high communication overhead in the resource-constrained IoT. This has inspired the field of parameter-efficient fine-tuning (PEFT) research. Existing PEFT methods attempt to optimize model performance at the given dropout level. Such an approach places the burden on human users to find a dropout rate that provides a satisfactory level of performance through trial-and-error, which is time consuming and resource intensive. To address this limitation, we propose the Step-wise Parameter Dropout for Continual Federated Learning…

The research of the side-channel analysis method based on deep learning for trusted platform module

Zhe Wang, Hui Wang, Yuning Yang +3 more

Artificial Intelligence · Journal of Physics Conference Series · · cited 2× · DOI ↗ · more like this ·

At present, the trusted platform module (TPM) has been widely used in electricity, finance, transportation, and other industries, and its security has attracted much attention. The research on the side-channel attack (SCA) can be conducive to improving the security design technology of trusted platform modules. The side channel attack on the trusted platform module is studied from the initial differential power analysis (DPA) to the machine learning method. This paper introduces the deep learning techniques in SCA and proposes a new SCA technique based on deep learning. Firstly, on basis of the characteristics of SCA on TPM, we improve the convolutional neural network (CNN) models, including ResNet, VGG, and Google Net. Then, for the SM4 cipher implemented with and without countermeasures, we implement some attack experiments by exploiting the SCA based on various deep learning models…

Hot-SVD: Higher-Order t-Singular Value Decomposition for Tensors based on Tensor-Tensor Product

Ying Wang, Yuning Yang

math.NA · · cited 2× · arXiv ↗ · more like this ·

This paper considers a way of generalizing the t-SVD of third-order tensors (regarded as tubal matrices) to tensors of arbitrary order N (which can be similarly regarded as tubal tensors of order (N-1)). \color{black}Such a generalization is different from the t-SVD for tensors of order greater than three [Martin, Shafer, Larue, SIAM J. Sci. Comput., 35 (2013), A474--A490]. The decomposition is called Hot-SVD since it can be recognized as a tensor-tensor product version of HOSVD. The existence of Hot-SVD is proved. To this end, a new transpose for third-order tensors is introduced. This transpose is crucial in the verification of Hot-SVD, since it serves as a bridge between tubal tensors and their unfoldings. We establish some properties of Hot-SVD, analogous to those of HOSVD, and in doing so we emphasize the perspective of tubal tensors. The truncated and sequentially truncated…