Author

Cheng Hong

339 papers · 1981–2026

1981peak 29 in 20112026

Frequent co-authors

Papers

showing 1–25 of 339 RSS

PUMA: Secure Inference of LLaMA-7B in Five Minutes

Ye Dong, Wen-jie Lu, Yancheng Zheng +7 more

cs.CR · July 2023 · cited 124× · arXiv ↗ · more like this ·

With ChatGPT as a representative, tons of companies have began to provide services based on large Transformers models. However, using such a service inevitably leak users' prompts to the model provider. Previous studies have studied secure inference for Transformer models using secure multiparty computation (MPC), where model parameters and clients' prompts are kept secret. Despite this, these frameworks are still limited in terms of model performance, efficiency, and deployment. To address these limitations, we propose framework PUMA to enable fast and secure Transformer model inference. Our framework designs high quality approximations for expensive functions such as GeLU and softmax, and significantly reduce the cost of secure inference while preserving the model performance. Additionally, we design secure Embedding and LayerNorm procedures that faithfully implement the desired…

PEGASUS: Bridging Polynomial and Non-polynomial Evaluations in Homomorphic Encryption

Wenjie Lu, Zhicong Huang, Cheng Hong +2 more

Artificial Intelligence · May 2021 · cited 115× · DOI ↗ · more like this ·

Homomorphic encryption (HE) is considered as one of the most important primitives for privacy-preserving applications. However, an efficient approach to evaluate both polynomial and non-polynomial functions on encrypted data is still absent, which hinders the deployment of HE to real-life applications. To address this issue, we propose a practical framework PEGASUS. PEGASUS can efficiently switch back and forth between a packed CKKS ciphertext and FHEW ciphertexts without decryption, allowing us to evaluate arithmetic functions efficiently on the CKKS side, and to evaluate look-up tables on FHEW ciphertexts. Our FHEW → CKKS conversion algorithm is more practical than the existing methods. We improve the computational complexity from linear to sublinear. Moreover, the size of our conversion key is significantly smaller, e.g., reduced from 80 gigabytes to 12 megabytes. We present…

When Homomorphic Encryption Marries Secret Sharing: Secure Large-Scale Sparse Logistic Regression and Applications in Risk Control

Chaochao Chen, Jun Zhou, Li Wang +7 more

cs.CR · August 2020 · cited 108× · arXiv ↗ · more like this ·

Logistic Regression (LR) is the most widely used machine learning model in industry for its efficiency, robustness, and interpretability. Due to the problem of data isolation and the requirement of high model performance, many applications in industry call for building a secure and efficient LR model for multiple parties. Most existing work uses either Homomorphic Encryption (HE) or Secret Sharing (SS) to build secure LR. HE based methods can deal with high-dimensional sparse features, but they incur potential security risks. SS based methods have provable security, but they have efficiency issue under high-dimensional sparse features. In this paper, we first present CAESAR, which combines HE and SS to build secure large-scale sparse logistic regression model and achieves both efficiency and security. We then present the distributed implementation of CAESAR for scalability requirement.…

Answering Multi-Dimensional Analytical Queries under Local Differential Privacy

Tianhao Wang, Bolin Ding, Jingren Zhou +4 more

Artificial Intelligence · 18 Jun 2019 · cited 94× · DOI ↗ · more like this ·

Multi-dimensional analytical (MDA) queries are often issued against a fact table with predicates on (categorical or ordinal) dimensions and aggregations on one or more measures. In this paper, we study the problem of answering MDA queries under local differential privacy (LDP). In the absence of a trusted agent, sensitive dimensions are encoded in a privacy-preserving (LDP) way locally before being sent to the data collector. The data collector estimates the answers to MDA queries, based on the encoded dimensions. We propose several LDP encoders and estimation algorithms, to handle a large class of MDA queries with different types of predicates and aggregation functions. Our techniques are able to answer these queries with tight error bounds and scale well in high-dimensional settings (i.e., error is polylogarithmic in dimension sizes). We conduct experiments on real and synthetic data…

Chaotic maps in binary particle swarm optimization for feature selection

Cheng‐San Yang, Li‐Yeh Chuang, Jung-Chike Li +1 more

Artificial Intelligence · June 2008 · cited 55× · DOI ↗ · more like this ·

Feature selection is a useful pre-processing technique for solving classification problems. The challenge of using evolutionary algorithms lies in solving the feature selection problem caused by the number of features. Classification data may contain useless, redundant or misleading features. To increase the classification accuracy, the primary objective is to remove irrelevant features in the feature space and identify the relevant features. Binary particle swarm optimization (BPSO) has been applied successfully in solving feature selection problem. In this paper, two kinds of chaotic maps are embedded in binary particle swarm optimization (BPSO), a logistic map and a tent map, respectively. The purpose of the chaotic maps is to determine the inertia weight of the BPSO. In this study, we propose the chaotic binary particle swarm optimization (CBPSO) method to implement feature…

Boolean binary particle swarm optimization for feature selection

Cheng‐San Yang, Li‐Yeh Chuang, Chao-Hsuan Ke +1 more

Artificial Intelligence · June 2008 · cited 49× · DOI ↗ · more like this ·

Feature selection is the process of choosing a subset of features from an original set. This subset should be necessary, reasonably represent the original data, and useful for identification classification. The task of feature selection is to search for an optimal solution in a - usually large - search space. However, if the search space too large, difficulties can occur during the search process, often resulting in a considerable increase in computational time. A particle swarm optimization algorithm (PSO) is a relatively new evolutionary computation technique, which has previously been used to implement feature selection. However, particle swarm optimization, like other evolutionary algorithms, tends to converge at a local optimum early. In this paper, we introduce a Boolean function which improves on the disadvantages of standard particle swarm optimization and use it to implement a…

FEATURE SELECTION USING PSO-SVM

Chien-Hung Tu, Li‐Yeh Chuang, Jiyul Chang +1 more

Artificial Intelligence · International MultiConference of Engineers and Computer Scientists · 2006 · cited 49× · OpenAlex ↗ · more like this ·

Abstract—The feature selection process can be considered a problem of global combinatorial optimization in machine learning, which reduces the number of features, removes irrelevant, noisy and redundant data, and results in an acceptable classification accuracy. Feature selection is of great importance in pattern classification, medical data processing, machine learning, and data mining applications. Therefore, a good feature selection method based on the number of features investigated for sample classification is needed in order to speed up the processing rate, predictive accuracy, and to avoid incomprehensibility. In this paper, particle swarm optimization (PSO) is used to implement a feature selection, and support vector machines (SVMs) with the one-versus-rest method serve as a fitness function of PSO for the classification problem. The proposed method is applied to five…

A Neural Network for Thyroid Segmentation and Volume Estimation in CT Images

Chuan‐Yu Chang, Pau‐Choo Chung, Yong-cheng Hong +1 more

Artificial Intelligence · IEEE Computational Intelligence Magazine · 21 Oct 2011 · cited 48× · DOI ↗ · more like this ·

Thyroid region segmentation and volume estimation is a prerequisite step to diagnosing the pathology of the thyroid gland. In this study, a progressive learning vector quantization neural network (PLVQNN) combined with a preprocessing procedure is proposed for automatic thyroid segmentation and volume estimation using computerized tomography (CT) images. The preprocessing procedure is used to extract the region of interest (ROI) of thyroid glands and exclude non-thyroid glands based on thyroid anatomy. The PLVQNN contains several learning vector quantization neural networks (LVQNNs), each responsible for segmenting one slice of a thyroid CT image. The training of the PLVQNN is conducted starting from the LVQNN of most reliable (middle) slices, where the thyroid has the largest region. The training then propagates upwards and downwards to adjacent LVQNNs using the results of the middle…

Secure Social Recommendation based on Secret Sharing

Chaochao Chen, Liang Li, Bingzhe Wu +3 more

cs.LG · February 2020 · cited 44× · arXiv ↗ · more like this ·

Nowadays, privacy preserving machine learning has been drawing much attention in both industry and academy. Meanwhile, recommender systems have been extensively adopted by many commercial platforms (e.g. Amazon) and they are mainly built based on user-item interactions. Besides, social platforms (e.g. Facebook) have rich resources of user social information. It is well known that social information, which is rich on social platforms such as Facebook, are useful to recommender systems. It is anticipated to combine the social information with the user-item ratings to improve the overall recommendation performance. Most existing recommendation models are built based on the assumptions that the social information are available. However, different platforms are usually reluctant to (or cannot) share their data due to certain concerns. In this paper, we first propose a SEcure SOcial…

A new design of QCA‐based nanoscale multiplexer and its usage in communications

LI Xing-jun, Shao Zhiwei, Cheng Hong-ping +1 more

Computational Theory and Mathematics · International Journal of Communication Systems · December 2019 · cited 39× · DOI ↗ · more like this ·

Summary Quantum‐dot cellular automata (QCA) is one of the proposed nanotechnologies in the electronics industry, which offers a new construction for scheming digital circuits with less energy consumption on the nanoscale and possibly can be an appropriate replacement of complementary metal‐oxide semiconductor (CMOS) technology. Nanocommunication in QCA has attracted a wide range of researcher's attention. However, there is still a broad scope to design QCA‐based architecture for nanocommunication. The multiplexer is hugely used in the telecommunication system and transmits multiple data at the same time. Therefore, in this paper, a useful structure to implement a 2 to 1 multiplexer based on the novel XOR gate is presented and is used as a module to implement the 4 to 1 and 8 to 1 multiplexers. Simulations using QCADesigner tool are done to check the performance of the suggested designs.…

Catfish particle swarm optimization

Li‐Yeh Chuang, Sheng-Wei Tsai, Cheng‐Hong Yang

Artificial Intelligence · September 2008 · cited 36× · DOI ↗ · more like this ·

Catfish particle swarm optimization (CatfishPSO) is a novel optimization algorithm proposed in this paper. The mechanism is dependent on the incorporation of a catfish particle into the linearly decreasing weight particle swarm optimization (LDWPSO). The introduced catfish particle improves the performance of LDWPSO. Unlike other ordinary particles, the catfish particles will initialize a new search from the extreme points of the search space when the gbest fitness value (global optimum at each iteration) has not been changed for a given time, which results in further opportunities to find better solutions for the swarm by guiding the whole swarm to promising new regions of the search space, and accelerating convergence. In our experiment, CatfishPSO, LDWPSO and other improved PSO procedures were extensively compared on three benchmark test functions with 10, 20 and 30 different…

A new fuzzy‐based method for load balancing in the cloud‐based Internet of things using a grey wolf optimization algorithm

LI Xing-jun, Shao Zhiwei, Cheng Hong-ping +1 more

Computer Networks and Communications · International Journal of Communication Systems · 24 Feb 2020 · cited 34× · DOI ↗ · more like this ·

Summary Cloud computing provides high accessibility, scalability, and flexibility in the era of computing for different practical applications. Internet of things (IoT) is a new technology that connects the devices and things to provide user required services. Due to data and information upsurge on IoT, cloud computing is usually used for managing these data, which is known as cloud‐based IoT. Due to the high volume of requirements, service diversity is one of the critical challenges in cloud‐based IoT. Since the load balancing issue is one of the NP‐hard problems in heterogeneous environments, this article provides a new method for response time reduction using a well‐known grey wolf optimization algorithm. In this paper, we supposed that the response time is the same as the execution time of all the tasks that this parameter must be minimized. The way is determining the status of…

Feature Selection Using Memetic Algorithms

Cheng‐San Yang, Li‐Yeh Chuang, Yu-Jung Chen +1 more

Artificial Intelligence · November 2008 · cited 30× · DOI ↗ · more like this ·

The feature selection process can be considered a problem of global combinatorial optimization in machine learning, which reduces the number of features, removes irrelevant, noisy and redundant data, and results in acceptable classification accuracy. In this study, we propose a combined filter method (ReliefF) and a wrapper method (memetic algorithm, MA) for classification. The goal of our method is to filter the irrelevant features and select the most important feature subsets. We used the ReliefF algorithm to calculate and update the scores of every feature for each data set, and then applied a MA for feature selection. The K-nearest neighbor (K-NN) method with leave-one-out cross-validation (LOOCV) serves as a classifier for evaluating classification accuracies. The experimental results show that the proposed method is superior to existing methods in terms of classification accuracy.

Fuzzy support vector machines for adaptive Morse code recognition

Cheng‐Hong Yang, Li-Cheng Jin, Li‐Yeh Chuang

Computer Vision and Pattern Recognition · Medical Engineering & Physics · 27 Jun 2006 · cited 26× · DOI ↗ · more like this ·

Morse code is now being harnessed for use in rehabilitation applications of augmentative-alternative communication and assistive technology, facilitating mobility, environmental control and adapted worksite access. In this paper, Morse code is selected as a communication adaptive device for persons who suffer from muscle atrophy, cerebral palsy or other severe handicaps. A stable typing rate is strictly required for Morse code to be effective as a communication tool. Therefore, an adaptive automatic recognition method with a high recognition rate is needed. The proposed system uses both fuzzy support vector machines and the variable-degree variable-step-size least-mean-square algorithm to achieve these objectives. We apply fuzzy memberships to each point, and provide different contributions to the decision learning function for support vector machines. Statistical analyses demonstrated…

A Biogeography-Based Optimization with a Greedy Randomized Adaptive Search Procedure and the 2-Opt Algorithm for the Traveling Salesman Problem

Cheng-Hsiung Tsai, Yu‐Da Lin, Cheng-Hong Yang +3 more

Artificial Intelligence · Sustainability · 14 Mar 2023 · cited 25× · DOI ↗ · more like this ·

We develop a novel method to improve biogeography-based optimization (BBO) for solving the traveling salesman problem (TSP). The improved method is comprised of a greedy randomized adaptive search procedure, the 2-opt algorithm, and G2BBO. The G2BBO formulation is derived and the process flowchart is shown in this article. For solving TSP, G2BBO effectively avoids the local minimum problem and accelerates convergence by optimizing the initial values. To demonstrate, we adopt three public datasets (eil51, eil76, and kroa100) from TSPLIB and compare them with various well-known algorithms. The results of G2BBO as well as the other algorithms perform close enough to the optimal solutions in eil51 and eil76 where simple TSP coordinates are considered. In the case of kroa100, with more complicated coordinates, G2BBO shows greater performance over other methods.

A new quorum-based scheme for managing replicated data in distributed systems

Ching-Min Lin, Ge-Ming Chiu, Cheng-Hong Cho

Computer Networks and Communications · IEEE Transactions on Computers · December 2002 · cited 24× · DOI ↗ · more like this ·

We propose a new quorum-based scheme for managing replicated data in distributed systems. We first introduce a concept called difference pair to establish the basics for cyclic read-write coteries. A simple and efficient model is then presented to facilitate the construction of read-write coteries. The read-write coteries generated by the model are strictly symmetric. Our model can be applied to an arbitrary number of copy sites. More importantly, by introducing a parameter in the construction model, our scheme offers the flexibility of adjusting the sizes of read and write quorums. Such flexibility allows read and write quorums to be readily tailored for each individual data item according to its own request demand. Enhancement of data availability is also addressed by our model.

Quantification of the Leakage in Federated Learning

Zhaorui Li, Zhicong Huang, Chaochao Chen +1 more

cs.CR · October 2019 · cited 23× · arXiv ↗ · more like this ·

With the growing emphasis on users' privacy, federated learning has become more and more popular. Many architectures have been raised for a better security. Most architecture work on the assumption that data's gradient could not leak information. However, some work, recently, has shown such gradients may lead to leakage of the training data. In this paper, we discuss the leakage based on a federated approximated logistic regression model and show that such gradient's leakage could leak the complete training data if all elements of the inputs are either 0 or 1.

The expert system application for diagnosing human vitamin deficiency through forward chaining method

Dony Novaliendry, Cheng‐Hong Yang, A. Y. Denno Guara Labukti

Artificial Intelligence · October 2015 · cited 22× · DOI ↗ · more like this ·

Vitamins are organic foods that are indispensable for the growth and health of the body. In case of health problems, especially lack of vitamins, people are more trusting doctor and nutritionist to find out whether the treatment is still low-level disorder or chronic. With the use of technology applications such as expert systems, the needs of society in diagnosing early vitamin deficiency can be realized. An expert system is one branch of artificial intelligence to learn how to “adopt” an expert way of thinking and reasoning in solving a problem, and contains a decision and draw conclusions from a number of facts. Application of expert system diagnosis of vitamin deficiency in humans is in the form of desktop-based application. This application uses forward chaining method and technique of depth first search engines. Forward Chaining method is a a method that is driven by the data…

More Efficient Secure Matrix Multiplication for Unbalanced Recommender Systems

Zhicong Huang, Cheng Hong, Chenkai Weng +2 more

Artificial Intelligence · IEEE Transactions on Dependable and Secure Computing · 29 Dec 2021 · cited 21× · DOI ↗ · more like this ·

With recent advances in homomorphic encryption (HE), it becomes feasible to run non-interactive machine learning (ML) algorithms on encrypted data without decryption. In this work, we propose novel encoding methods to pack matrix in a compact way and more efficient methods to perform matrix multiplication on homomorphically encrypted data, leading to a speed boost of <inline-formula><tex-math notation="LaTeX">$1.5\times - 20\times$</tex-math></inline-formula> for slim rectangular matrix multiplication compared with state-of-the-art. Moreover, we integrate our optimized secure matrix arithmetic with the MPI distributed computing framework, achieving scalable parallel secure matrix computation. Equipped with the optimized matrix multiplication, we propose uSCORE , a privacy-preserving cross-domain recommendation system for the unbalanced scenario, where a big data owner provides…

Dimensionality Reduction using GA-PSO

Cheng‐Hong Yang, Chung-Jui Tu, Jun-Yang Chang +2 more

Artificial Intelligence · Advances in intelligent systems research/Advances in Intelligent Systems Research · 2006 · cited 20× · DOI ↗ · more like this ·

The feature selection process can be considered a problem of global combinatorial optimization in machine learning, which reduces the number of features, removes irrelevant, noisy and redundant data, and results in acceptable classification accuracy. In this paper, we propose a combination of genetic algorithms (GAs) and particle swarm optimization (PSO) for feature selection. The K-nearest neighbor (K-NN) method with leave-one-out cross-validation (LOOCV) serves as an evaluator for the GAs and the PSO. The proposed method is applied to five classification problems taken from the literature. Experimental results show that our method simplifies features effectively and obtains a higher classification accuracy compared to other feature selection methods.

An Improved Particle Swarm Optimization for Data Clustering

Li‐Yeh Chuang, Yu‐Da Lin, Cheng‐Hong Yang

Artificial Intelligence · 2012 · cited 19× · OpenAlex ↗ · more like this ·

In recent years, clustering is still a popular analysis tool for data statistics. The data structure identifying from the large-scale data has become a very important issue in the data mining problem. In this paper, an improved particle swarm optimization based on Gauss chaotic map for clustering is proposed. Gauss chaotic map adopts a random sequence with a random starting point as a parameter, and relies on this parameter to update the positions and velocities of the particles. It provides the significant chaos distribution to balance the exploration and exploitation capability for search process. This easy and fast function generates a random seed processes, and further improve the performance of PSO due to their unpredictability. In the experiments, the eight different clustering algorithms were extensively compared on six test data. The results indicate that the performance of our…

Privacy-preserving collaborative machine learning on genomic data using TensorFlow

Cheng Hong, Zhicong Huang, Wen-jie Lu +4 more

cs.CR · 29 Feb 2020 · cited 18× · arXiv ↗ · more like this ·

Machine learning (ML) methods have been widely used in genomic studies. However, genomic data are often held by different stakeholders (e.g. hospitals, universities, and healthcare companies) who consider the data as sensitive information, even though they desire to collaborate. To address this issue, recent works have proposed solutions using Secure Multi-party Computation (MPC), which train on the decentralized data in a way that the participants could learn nothing from each other beyond the final trained model. We design and implement several MPC-friendly ML primitives, including class weight adjustment and parallelizable approximation of activation function. In addition, we develop the solution as an extension to TF Encrypted~\citep{dahl2018private}, enabling us to quickly experiment with enhancements of both machine learning techniques and cryptographic protocols while leveraging…

A Secure Conjunctive Keywords Search over Encrypted Cloud Data Against Inclusion-Relation Attack

Ke Cai, Cheng Hong, Min Zhang +2 more

Artificial Intelligence · December 2013 · cited 18× · DOI ↗ · more like this ·

There exists a specific security issue in symmetric searchable encryption that, when doing CKS(Conjunctive Keywords Search), the trapdoors and search results may reveal the relationships between the keywords being searched. For example, if the search result of keywords set A is the superset of keywords set B's, it indicates A is a subset of B by a high chance. Most existing search methods that support CKS suffer from such inclusion-relation (IR) attacks. We define measurements on IR security and propose CKS-SE, a secure CKS scheme based on bloom filter that achieves IR-secure by randomizing and integrating expressions of trapdoors. Experiments show that the average false positives are within an acceptable rate, and the performance of CKS-SE is among the best ones.

The effects of initial population in genetic search for time constrained traveling salesman problems

Cheng-Hong Yang, Kendall E. Nygard

Artificial Intelligence · 1993 · cited 18× · DOI ↗ · more like this ·

We describe the application of Genetic Algorithms to the traveling salesman problem with time windows. A new type of crossover operator, called edge-type crossover, with a heuristically selected initial population, is used in the genetic search. When compared with alternative methods from the literature, experiments indicate that the heuristic initialization speeds the genetic search process.

DPSAaS

Min Xu, Tianhao Wang, Bolin Ding +3 more

Artificial Intelligence · Proceedings of the VLDB Endowment · August 2019 · cited 17× · DOI ↗ · more like this ·

Differential privacy has emerged as the de facto standard for privacy definitions, and been used by, e.g ., Apple, Google, Uber, and Microsoft, to collect sensitive information about users and to build privacy-preserving analytics engines. However, most of such advanced privacy-protection techniques are not accessible to mid-size companies and app developers in the cloud. We demonstrate a lightweight middleware DPSAaS , which provides d ifferentially p rivate data-sharing-and-analytics functionality a s cloud services. We focus on multi-dimensional analytical (MDA) queries under local differential privacy (LDP) in this demo. MDA queries against a fact table have predicates on (categorical or ordinal) dimensions and aggregate one or more measures. In the absence of a trusted…