arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Lean Yu

28 papers · 2006–2026

2006: 32007: 22008: 22009: 12010: 12011: 02012: 02013: 22014: 12015: 12016: 32017: 02018: 12019: 02020: 02021: 02022: 12023: 22024: 12025: 42026: 3
2006peak 4 in 20252026

Frequent co-authors

Papers

showing 1–25 of 28 RSS

A Novel CEEMD-Based EELM Ensemble Learning Paradigm for Crude Oil Price Forecasting

Ling Tang, Wei Dai, Lean Yu +1 more

Artificial Intelligence · International Journal of Information Technology & Decision Making · · cited 140× · DOI ↗ · more like this ·

To enhance the prediction accuracy for crude oil price, a novel ensemble learning paradigm coupling complementary ensemble empirical mode decomposition (CEEMD) and extended extreme learning machine (EELM) is proposed. This novel method is actually an improved model under the effective "decomposition and ensemble" framework, especially for nonlinear, complex, and irregular data. In this proposed method, CEEMD, a current extension from the competitive decomposition family of empirical mode decomposition (EMD), is first applied to divide the original data (i.e., difficult task) into a number of components (i.e., relatively easy subtasks). Then, EELM, a recently developed, powerful, fast and stable intelligent learning technique, is implemented to predict all extracted components individually. Finally, these predicted results are aggregated into an ensemble result as the final prediction…

An integrated data preparation scheme for neural network data analysis

Lean Yu, Shouyang Wang, Kin Keung Lai

Artificial Intelligence · IEEE Transactions on Knowledge and Data Engineering · · cited 138× · DOI ↗ · more like this ·

Data preparation is an important and critical step in neural network modeling for complex data analysis and it has a huge impact on the success of a wide variety of complex data analysis tasks, such as data mining and knowledge discovery. Although data preparation in neural network data analysis is important, some existing literature about the neural network data preparation are scattered, and there is no systematic study about data preparation for neural network data analysis. In this study, we first propose an integrated data preparation scheme as a systematic study for neural network data analysis. In the integrated scheme, a survey of data preparation, focusing on problems with the data and corresponding processing techniques, is then provided. Meantime, some intelligent data preparation solution to some important issues and dilemmas with the integrated scheme are discussed in…

Privacy Preservation in Distributed Subgradient Optimization Algorithms

Youcheng Lou, Lean Yu, Shouyang Wang

cs.DC · · cited 89× · arXiv ↗ · more like this ·

Privacy preservation is becoming an increasingly important issue in data mining and machine learning. In this paper, we consider the privacy preserving features of distributed subgradient optimization algorithms. We first show that a well-known distributed subgradient synchronous optimization algorithm, in which all agents make their optimization updates simultaneously at all times, is not privacy preserving in the sense that the malicious agent can learn other agents' subgradients asymptotically. Then we propose a distributed subgradient projection asynchronous optimization algorithm without relying on any existing privacy preservation technique, where agents can exchange data between neighbors directly. In contrast to synchronous algorithms, in the new asynchronous algorithm agents make their optimization updates asynchronously. The introduced projection operation and asynchronous…

A Study on Information Technology Integrated Guided Discovery Instruction towards Students’ Learning Achievement and Learning Retention

Chich-Jen Shieh, Lean Yu

Information Systems · Eurasia Journal of Mathematics Science and Technology Education · · cited 52× · DOI ↗ · more like this ·

Background:In the information explosion era with constant changes of information, educators have promoted various effective learning strategies for students adapting to the complex modern society. The impact and influence of traditional teaching method have information technology integrated modern instruction and science concept learning play an important role. Teaching methods promoted in guided discovery instruction are to cultivate learners’ abilities of discovery, exploration, problem-solving and independent thinking, and creation and invention through discovery or creative learning. Students could actively and positively participate in learning and integrate and construct knowledge by themselves. In other words, all knowledge is individually operated and explained, rather than passively acquired.Material and methods:By applying quasi-experimental research with experimental design…

A MODIFIED LEAST SQUARES SUPPORT VECTOR MACHINE CLASSIFIER WITH APPLICATION TO CREDIT RISK ANALYSIS

Lean Yu, Shouyang Wang, Jie Cao

Artificial Intelligence · International Journal of Information Technology & Decision Making · · cited 37× · DOI ↗ · more like this ·

In this paper, a modified least squares support vector machine classifier, called the C-variable least squares support vector machine (C-VLSSVM) classifier, is proposed for credit risk analysis. The main idea of the proposed classifier is based on the prior knowledge that different classes may have different importance for modeling and more weight should be given to classes having more importance. The C-VLSSVM classifier can be obtained by a simple modification of the regularization parameter, based on the least squares support vector machine (LSSVM) classifier, whereby more weight is given to errors in classification of important classes, than to errors in classification of unimportant classes, while keeping the regularized terms in their original form. For illustration purpose, two real-world credit data sets are used to verify the effectiveness of the C-VLSSVM classifier.…

Prediction-Based Multi-Objective Optimization for Oil Purchasing and Distribution with the NSGA-II Algorithm

Lean Yu, Zebin Yang, Ling Tang

Artificial Intelligence · International Journal of Information Technology & Decision Making · · cited 22× · DOI ↗ · more like this ·

Due to the uncertainty in oil markets, this paper proposes a novel approach for oil purchasing and distribution optimization by incorporating price and demand prediction, i.e., the prediction-based oil purchasing-and-distribution optimization model. In particular, the proposed method bridges the latest information technology and decision-making technique by introducing the recently proposed information technology (i.e., extreme learning machine (ELM)) into the oil purchasing-and-distribution optimization model. Two main steps are involved: market prediction and planning optimization in the proposed model. In market prediction, the ELM technique is employed to provide fast training time and accurate forecasting results for oil prices and demands. In planning optimization, two objectives of general profit maximization and inventory risk minimization are considered; and the most popular…

Black-Box Attack-Based Security Evaluation Framework for Credit Card Fraud Detection Models

Jin Xiao, Yuhang Tian, Yanlin Jia +3 more

Artificial Intelligence · INFORMS journal on computing · · cited 17× · DOI ↗ · more like this ·

The security of credit card fraud detection (CCFD) models based on machine learning is important but rarely considered in the existing research. To this end, we propose a black-box attack-based security evaluation framework for CCFD models. Under this framework, the semisupervised learning technique and transfer-based black-box attack are combined to construct two versions of a semisupervised transfer black-box attack algorithm. Moreover, we introduce a new nonlinear optimization model to generate the adversarial examples against CCFD models and a security evaluation index to quantitatively evaluate the security of them. Computing experiments on two real data sets demonstrate that, facing the adversarial examples generated by the proposed attack algorithms, all six supervised models considered largely lose their ability to identify the fraudulent transactions, whereas the two…

The clustering-based case-based reasoning for imbalanced business failure prediction: a hybrid approach through integrating unsupervised process with supervised process

Hui Li, Jun-Ling Yu, Lean Yu +1 more

Artificial Intelligence · International Journal of Systems Science · · cited 15× · DOI ↗ · more like this ·

Case-based reasoning (CBR) is one of the main forecasting methods in business forecasting, which performs well in prediction and holds the ability of giving explanations for the results. In business failure prediction (BFP), the number of failed enterprises is relatively small, compared with the number of non-failed ones. However, the loss is huge when an enterprise fails. Therefore, it is necessary to develop methods (trained on imbalanced samples) which forecast well for this small proportion of failed enterprises and performs accurately on total accuracy meanwhile. Commonly used methods constructed on the assumption of balanced samples do not perform well in predicting minority samples on imbalanced samples consisting of the minority/failed enterprises and the majority/non-failed ones. This article develops a new method called clustering-based CBR (CBCBR), which integrates clustering…

An online learning algorithm with adaptive forgetting factors for feedforward neural networks in financial time series forecasting

Lean Yu, Shouyang Wang, Kin Keung Lai

Artificial Intelligence · Nonlinear dynamics and systems theory · · cited 14× · OpenAlex ↗ · more like this ·

In this study, an online learning algorithm for feedforward neural networks (FNN) based on the optimized learning rate and adaptive forgetting factor is proposed for online financial time series prediction. The new learning algorithm is developed for online predictions in terms of the gradient descent technique, and can speed up the FNN learning process substantially relative to the standard FNN algorithm, with simultaneous preservation of stability of the learning process. In order to verify the effectiveness and efficiency of the proposed online learning algorithm, two typical financial time series are chosen as testing targets for illustration purposes.

Quantile estimators with orthogonal pinball loss function

Lean Yu, Zebin Yang, Ling Tang

Statistics and Probability · Journal of Forecasting · · cited 12× · DOI ↗ · more like this ·

Abstract To guarantee stable quantile estimations even for noisy data, a novel loss function and novel quantile estimators are developed, by introducing the effective concept of orthogonal loss considering the noise in both response and explanatory variables. In particular, the pinball loss used in classical quantile estimators is improved into novel orthogonal pinball loss (OPL) by replacing vertical loss by orthogonal loss. Accordingly, linear quantile regression (QR) and support vector machine quantile regression (SVMQR) can be respectively extended into novel OPL‐based QR and OPL‐based SVMQR models. The empirical study on 10 publicly available datasets statistically verifies the superiority of the two OPL‐based models over their respective original forms in terms of prediction accuracy and quantile property, especially for extreme quantiles. Furthermore, the novel OPL‐based SVMQR…

LMCBert: An Automatic Academic Paper Rating Model Based on Large Language Models and Contrastive Learning

Chuanbin Liu, Xiaowu Zhang, Hongfei Zhao +3 more

Information Systems · IEEE Transactions on Cybernetics · · cited 6× · DOI ↗ · more like this ·

The acceptance of academic papers involves a complex peer-review process that requires substantial human and material resources and is susceptible to biases. With advancements in deep learning technologies, researchers have explored automated approaches for assessing paper acceptance. Existing automated academic paper rating methods primarily rely on the full content of papers to estimate acceptance probabilities. However, these methods are often inefficient and introduce redundant or irrelevant information. Additionally, while Bert can capture general semantic representations through pretraining on large-scale corpora, its performance on the automatic academic paper rating (AAPR) task remains suboptimal due to discrepancies between its pretraining corpus and academic texts. To address these issues, this study proposes LMCBert, a model that integrates large language models (LLMs) with…

An elm-based classification algorithm with optimal cutoff selection for credit risk assessment

Lean Yu, Xinxie Li, Ling Tang +1 more

Artificial Intelligence · Filomat · · cited 4× · DOI ↗ · more like this ·

In this paper, an extreme learning machine (ELM) classification algorithm with optimal cutoff selection is proposed for credit risk assessment. Different from existing models using a fixed cutoff value (0.0 or 0.5), the proposed classification model especially considers the optimal cutoff value as one important evaluation parameter in credit risk modeling, to enhance the assessment accuracy. In particular, using the powerful artificial intelligence (AI) tool of ELM as the basic classification, the simple but efficient optimization algorithm of grid search is employed to select the optimal cutoff value. Accordingly, three main steps are included: (1) ELM training using the training dataset, (2) cutoff optimization via the grid search method using the training and validation datasets, and (3) classification generalization based on the trained ELM and optimal cutoff using the testing…

Expert Credibility Prediction Model Based on Fuzzy C-Means Clustering and Similarity Association

Chuanbin Liu, Junming Guo, Xiaoming Zhang +2 more

Communication · IEEE Transactions on Fuzzy Systems · · cited 3× · DOI ↗ · more like this ·

In the current wave of technological innovation, the scientific and technological evaluation system not only plays a crucial role in assessing scientific research achievements but also serves as a driving force for advancing scientific research. To enhance the effectiveness and accuracy of peer review in the scientific and technological evaluation system, an integrating fuzzy C-Means clustering algorithm and similarity analysis method is proposed. In this methodology, the fuzzy C-Means clustering algorithm is first applied to conduct cluster analysis on expert feature attribute. Second, the recursive feature elimination feature selection is used to select the important features for enhancing the model generalization capability. The Gower distance of key features between experts is calculated to determine the similarity between experts, and the association features among experts are…

Group Recommendation Based on Heterogeneous Graph Algorithm for EBSNs

Yue Wu, Wei Huang Wayne, Lean Yu +1 more

Information Systems · IEEE Access · · cited 3× · DOI ↗ · more like this ·

Emerging event-based social networks (EBSNs), such as Meetup, have grown rapidly and become popular in recent years. EBSNs differ from conventional social networks such as Facebook in that they not only involve online social interactions but also include offline, in-person interactions. Thus, EBSNs are naturally heterogeneous and possess more valuable social information. Group recommendations in EBSNs are typically only based on the interest information filled in by users, or friends’ group information. Both these methods may not well reflect users’ real intentions. In this study, we propose a recommender system to predict groups that may interest EBSN users, based on a novel heterogeneous augmented graph method and a random walk with restart algorithm. In this approach, online and offline social interactions are combined into a single heterogeneous augmented graph capturing all useful…

Neural Network Metalearning for Parallel Textual Information Retrieval

Lean Yu, Shouyang Wang, Kin Keung Lai

Artificial Intelligence · · cited 3× · OpenAlex ↗ · more like this ·

In this study, a triple-phase neural network metalearning technique is proposed to perform parallel textual information retrieval tasks. In the first phase, the massive textual data collections with the terabyte scale are first partitioned into various relatively small textual data subsets. Then these small data subsets are moved to different computational agents. In the second phase, the single neural network model as the intelligent learning agent is applied to the different textual data subsets so as to retrieve some relevant text documents responding to a query. For a given query, the neural network learning agent, which is sufficiently trained by back-propagation learning algorithm on underlying text documents, can produce a relevance score between 0 and 1 for a certain text document. In the third phase, based on the different relevance scores produced by the previous phase, a…

A Framework of Web-Based Text Mining on the Grid

Lean Yu, Kin Keung Lai, Yue Wu

Computer Networks and Communications · ePrints Soton (University of Southampton) · · cited 3× · DOI ↗ · more like this ·

This study proposes a novel Web-based text mining (WTM) framework on the grid, which firstly applies the grid technology to text mining system for improving the performance of WTM. The WTM system is to implement a high performance text mining process on the grid, and provide users with a high efficiency text mining and knowledge discovery services. We focus our discussion on the formulation of this framework for WTM system on the grid. In this study, firstly, a general framework of grid-based WTM is proposed, then a main process about WTM on the grid is described, and subsequently the implementation of the proposed grid-based WTM framework model is given. Finally, some conclusions are given.

A Compressed Sensing-Based Denoising Approach in Crude Oil Price Forecasting

Yang Zhao, Lean Yu, Kaijian He

Computer Vision and Pattern Recognition · · cited 2× · DOI ↗ · more like this ·

Crude oil price forecasting has been a difficult challenge for years. To improve the forecasting performance, a novel forecasting method is proposed through combining compressed sensing based denoising (CSD) approach and least square support vector regression (LSSVR) forecasting model. In the forecasting model, the grid search algorithm is used to optimize the parameter of LSSVR. Compared with the wavelet denoising method, the compressed sensing based denoising method shows better performance when they are applied to forecasting models. The entire forecasting model CSD-LSSVR also shows its superiority in direction accuracy prediction which is of great significance in business decision making.

A Multi-Agent Neural Network System for Web Text Mining

Lean Yu, Shouyang Wang, Kin Keung Lai

Computer Networks and Communications · IGI Global eBooks · · cited 2× · DOI ↗ · more like this ·

With the rapid increase of the huge amount of online information, there is a strong demand for Web text mining which helps people discover some useful knowledge from Web documents. For this purpose, this chapter first proposes a back-propagation neural network (BPNN)-based Web text mining system for decision support. In the BPNN-based Web text mining system, four main processes, Web document search, Web text processing, text feature conversion, and BPNN-based knowledge discovery, are involved. Particularly, BPNN is used as an intelligent learning agent that learns about underlying Web documents. In order to scale the individual intelligent agent with the large number of Web documents, we then provide a multi-agent-based neural network system for Web text mining in a parallel way. For illustration purpose, a simulated experiment is performed. Experiment results reveal that the proposed…

GMM Enhanced Anchor-Based Spectral Clustering for Large-Scale Data

Wen Zhang, Jiangpeng Zhao, Lean Yu +1 more

Artificial Intelligence · IEEE Transactions on Neural Networks and Learning Systems · · cited 1× · DOI ↗ · more like this ·

Anchor-based methods are proposed to make use of anchors to produce an affinity matrix of objects to improve the scalability of traditional spectral clustering (SC). Nevertheless, the membership heterogeneity of objects inside a cluster, which would bring about low quality of anchors and hurt the clustering accuracy, is commonly neglected by existing anchor-based algorithms. To address this problem, this article proposes a novel approach to adopt the Gaussian mixture model (GMM) to enhance anchor-based SC for large-scale data in a two-stage divide-and-conquer manner. In the first stage, GMM with expectation maximization (EM) algorithm is employed to divide the objects into two categories as prior-consistent objects and prior-uncertain objects in considering the membership heterogeneity of objects. In the second stage, anchor-based SC is conducted on the prior-uncertain objects by…

Parallel Web Text Clustering with a Modular Self-Organizing Map System

Lean Yu, Shouyang Wang, Kin Keung Lai

Artificial Intelligence · Journal of Computer Information Systems · · cited 1× · OpenAlex ↗ · more like this ·

In this study, a multistage modular self-organizing map (SOM) model is proposed for parallel web text clustering. In the first stage, the large textual datasets are divided into some small disjoint datasets (i.e., task decomposition). In the second stage, each small data set is input into different unitary SOM models for word clustering map (i.e., modularization learning). In this stage, different SOM models are implemented in a parallel way to gain greater computational efficiency and scalability. In the third stage, based upon the outputs of each SOM module in the previous stage, another SOM model is used to integrate different word clustering results to formulate a text category map (i.e., module fusion). In the proposed model, word clustering map is embedded into text category map and thus a hierarchically modular SOM model is formulated. For illustration and verification purpose, a…

Adversarial Training–Based Deep Imbalanced Learning

Yuhang Tian, Jin Xiao, Lean Yu +4 more

Artificial Intelligence · INFORMS journal on computing · · cited 0× · DOI ↗ · more like this ·

Financial fraud detection is crucial in the banking and financial sectors, but it faces considerable challenges because of class imbalance in transaction data and the growing threat of adversarial attacks. These issues frequently undermine the effectiveness of deep neural networks despite their demonstrated potential in this domain. To address these challenges, this paper proposes a novel approach, adversarial training–based deep imbalanced learning (ATDIL), which integrates imbalanced learning and adversarial defense into a unified approach. ATDIL leverages an adversarial autoencoder to efficiently synthesize high-quality minority-class samples that are informative and adversarial, while maintaining low computational complexity. The effectiveness of ATDIL is rigorously validated through both theoretical and experimental analyses. Theoretically, the optimal solution form for the inner…

ML ‐ SGNN : A Novel Similarity‐Based Graph Neural Network With Meta‐Learning for Credit Classification With Low Sample Size

Jianxin Zhu, Yang Yu, Xiaoming Zhang +1 more

Artificial Intelligence · Expert Systems · · cited 0× · DOI ↗ · more like this ·

ABSTRACT In the field of credit risk classification, the prediction model needs to meet a large number of labelled samples to make the model fully trained. However, in some practical scenarios, it is difficult for financial institutions to obtain a large number of available labelled samples because of the cost or privacy. Shortage of samples will cause the prediction model ineffective or even invalid. To address low sample size problem, a novel similarity‐based graph neural network with meta‐learning called ML‐SGNN is proposed for credit classification with low sample size. In the proposed ML‐SGNN methodology, attribute co‐training based on meta‐learning strategy is first introduced to increase the generalisation capability of the proposed model under label scarcity condition. Then, a node update strategy based on similarity is proposed to aggregate features of samples with same label…

Adaptive Protection for Evolutionary Feature Construction in Symbolic Regression with Application to Credit Classification

Hengzhe Zhang, Qi Chen, Bing Xue +3 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Evolutionary feature construction has shown strong promise in symbolic regression by automatically discovering informative transformations of input features that enhance a simple base learner. However, existing approaches often lack explicit mechanisms to preserve important constructed features discovered during evolution, and valuable genetic material can be lost when genetic operators disrupt effective features. This paper introduces an adaptive protection mechanism that leverages feature importance metrics to selectively preserve constructed features during evolution. The mechanism provides stronger protection for more important constructed features while still allowing less important features to be modified and to incorporate useful building blocks from more important features. We evaluate the approach using multiple feature importance calculation methods and demonstrate its…

Forecasting Crude Oil Prices Using a Convolutional Neural Network with Time-Delay Embedding

Kaijian He, Lean Yu, Jia Liu +1 more

Computer Vision and Pattern Recognition · International Journal of Information Technology & Decision Making · · cited 0× · DOI ↗ · more like this ·

This paper proposes a novel hybrid forecasting model, TDE-CNN, to model the complex dynamics of crude oil price movements. The model integrates Time-Delay Embedding (TDE) Method with a Convolutional Neural Network (CNN) to leverage both spatial and temporal information. The TDE-CNN model uses the TDE method to transform raw crude oil data into higher-dimensional space to reveal underlying spatio-temporal patterns, while the CNN effectively models these patterns for improved predictive accuracy. The TDE-CNN model is applied to forecast major crude oil spot price movements, and its forecasting performance has been comprehensively and rigorously evaluated. Empirical results demonstrate that the TDE-CNN model achieves lower forecasting errors compared to benchmark models, as measured by Mean Squared Error (MSE). Additionally, the Diebold-Mariano test confirms that the improvement in…

Fraud Detection by Integrating Multisource Heterogeneous Presence-Only Data

Yongqin Qiu, Yuanxing Chen, Kan Fang +2 more

Artificial Intelligence · INFORMS journal on computing · · cited 0× · DOI ↗ · more like this ·

In credit fraud detection practice, certain fraudulent transactions often evade detection because of the hidden nature of fraudulent behavior. To address this issue, an increasing number of positive-unlabeled (PU) learning techniques have been employed by more and more financial institutions. However, most of these methods are designed for single data sets and do not take into account the heterogeneity of data when they are collected from different sources. In this paper, we propose an integrative PU learning method (I-PU) for pooling information from multiple heterogeneous PU data sets. A novel approach that penalizes group differences is developed to explicitly and automatically identify the cluster structures of coefficients across different data sets, thus offering a plausible interpretation of heterogeneity. Furthermore, we apply a bilevel selection method to detect the sparse…