Author

Fakhri Karray

276 papers · 2002–2026

2002peak 28 in 20252026

Frequent co-authors

Papers

showing 1–25 of 276 RSS

Human Activity Recognition Using Tools of Convolutional Neural Networks: A State of the Art Review, Data Sets, Challenges and Future Prospects

Md. Milon Islam, Sheikh Nooruddin, Fakhri Karray +1 more

eess.SP · 2 Feb 2022 · cited 186× · arXiv ↗ · more like this ·

Human Activity Recognition (HAR) plays a significant role in the everyday life of people because of its ability to learn extensive high-level information about human activity from wearable or stationary devices. A substantial amount of research has been conducted on HAR and numerous approaches based on deep learning and machine learning have been exploited by the research community to classify human activities. The main goal of this review is to summarize recent works based on a wide range of deep neural networks architecture, namely convolutional neural networks (CNNs) for human activity recognition. The reviewed systems are clustered into four categories depending on the use of input devices like multimodal sensing devices, smartphones, radar, and vision devices. This review describes the performances, strengths, weaknesses, and the used hyperparameters of CNN architectures for each…

Secure Federated Learning With Fully Homomorphic Encryption for IoT Communications

Neveen Hijazi, Moayad Aloqaily, Mohsen Guizani +2 more

Artificial Intelligence · IEEE Internet of Things Journal · 4 Aug 2023 · cited 182× · DOI ↗ · more like this ·

The emergence of the Internet of Things (IoT) has revolutionized people’s daily lives, providing superior quality services in cognitive cities, healthcare, and smart buildings. However, smart buildings use heterogeneous networks. The massive number of interconnected IoT devices increases the possibility of IoT attacks, emphasizing the necessity of secure and privacy-preserving solutions. Federated learning (FL) has recently emerged as a promising machine learning (ML) paradigm for IoT networks to address these concerns. In FL, multiple devices collaborate to learn a global model without sharing their raw data. However, FL still faces privacy and security concerns due to the transmission of sensitive data (i.e., model parameters) over insecure communication channels. These concerns can be addressed using fully homomorphic encryption (FHE), a powerful cryptographic technique that enables…

Eigenvalue and Generalized Eigenvalue Problems: Tutorial

Benyamin Ghojogh, Fakhri Karray, Mark Crowley

stat.ML · March 2019 · cited 163× · arXiv ↗ · more like this ·

This paper is a tutorial for eigenvalue and generalized eigenvalue problems. We first introduce eigenvalue problem, eigen-decomposition (spectral decomposition), and generalized eigenvalue problem. Then, we mention the optimization problems which yield to the eigenvalue and generalized eigenvalue problems. We also provide examples from machine learning, including principal component analysis, kernel supervised principal component analysis, and Fisher discriminant analysis, which result in eigenvalue and generalized eigenvalue problems. Finally, we introduce the solutions to both eigenvalue and generalized eigenvalue problems.

Internet of Things: Device Capabilities, Architectures, Protocols, and Smart Applications in Healthcare Domain

Md. Milon Islam, Sheikh Nooruddin, Fakhri Karray +1 more

Computer Networks and Communications · IEEE Internet of Things Journal · 13 Dec 2022 · cited 156× · DOI ↗ · more like this ·

Nowadays, the Internet has spread to practically every country around the world and is having unprecedented effects on people’s lives. The Internet of Things (IoT) is getting more popular and has a high level of interest in both practitioners and academicians in the age of wireless communication due to its diverse applications. The IoT is a technology that enables everyday things to become savvier, everyday computation toward becoming intellectual, and everyday communication to become a little more insightful. In this article, the most common and popular IoT device capabilities, architectures, and protocols are demonstrated in brief to provide a clear overview of the IoT technology to the researchers in this area. The common IoT device capabilities, including hardware (Raspberry Pi, Arduino, and ESP8266) and software (operating systems (OSs), and built-in tools) platforms are described…

Integrating Digital Twin and Advanced Intelligent Technologies to Realize the Metaverse

Moayad Aloqaily, Ouns Bouachir, Fakhri Karray +2 more

cs.HC · 3 Oct 2022 · cited 153× · arXiv ↗ · more like this ·

The advances in Artificial Intelligence (AI) have led to technological advancements in a plethora of domains. Healthcare, education, and smart city services are now enriched with AI capabilities. These technological advancements would not have been realized without the assistance of fast, secure, and fault-tolerant communication media. Traditional processing, communication and storage technologies cannot maintain high levels of scalability and user experience for immersive services. The metaverse is an immersive three-dimensional (3D) virtual world that integrates fantasy and reality into a virtual environment using advanced virtual reality (VR) and augmented reality (AR) devices. Such an environment is still being developed and requires extensive research in order for it to be realized to its highest attainable levels. In this article, we discuss some of the key issues required in…

On the optimal number of hidden nodes in a neural network

Nayer Wanas, G. Auda, Mohamed S. Kamel +1 more

Artificial Intelligence · 27 Nov 2002 · cited 132× · DOI ↗ · more like this ·

In this study we show, empirically, that the best performance of a neural network occurs when the number of hidden nodes is equal to log(T), where T is the number of training samples. This value represents the optimal performance of the neural network as well as the optimal associated computational cost. We also show that the measure of entropy in the hidden layer not only gives a good foresight to the performance of the neural network, but can be used as a criteria to optimize the neural network as well. This can be achieved by minimizing the network entropy (i.e. maximizing the entropy in the hidden layer) as a means of modifying the weights of the neural network.

An Efficient Concept-Based Mining Model for Enhancing Text Clustering

Shady Shehata, Fakhri Karray, Mohamed S. Kamel

Information Systems · IEEE Transactions on Knowledge and Data Engineering · 5 Aug 2009 · cited 131× · DOI ↗ · more like this ·

Most of the common techniques in text mining are based on the statistical analysis of a term, either word or phrase. Statistical analysis of a term frequency captures the importance of the term within a document only. However, two terms can have the same frequency in their documents, but one term contributes more to the meaning of its sentences than the other term. Thus, the underlying text mining model should indicate terms that capture the semantics of text. In this case, the mining model can capture terms that present the concepts of the sentence, which leads to discovery of the topic of the document. A new concept-based mining model that analyzes terms on the sentence, document, and corpus levels is introduced. The concept-based mining model can effectively discriminate between nonimportant terms with respect to sentence semantics and terms which hold the concepts that represent the…

Feature Selection and Feature Extraction in Pattern Analysis: A Literature Review

Benyamin Ghojogh, Maria N. Samad, Sayema Asif Mashhadi +4 more

cs.LG · 7 May 2019 · cited 104× · arXiv ↗ · more like this ·

Pattern analysis often requires a pre-processing stage for extracting or selecting features in order to help the classification, prediction, or clustering stage discriminate or represent the data in a better way. The reason for this requirement is that the raw data are complex and difficult to process without extracting or selecting appropriate features beforehand. This paper reviews theory and motivation of different common methods of feature selection and extraction and introduces some of their applications. Some numerical implementations are also shown for these methods. Finally, the methods in feature selection and extraction are compared.

Large Language Model Simulator for Cold-Start Recommendation

Feiran Huang, Yuanchen Bei, Zhenghang Yang +6 more

cs.IR · February 2024 · cited 92× · arXiv ↗ · more like this ·

Recommending cold items remains a significant challenge in billion-scale online recommendation systems. While warm items benefit from historical user behaviors, cold items rely solely on content features, limiting their recommendation performance and impacting user experience and revenue. Current models generate synthetic behavioral embeddings from content features but fail to address the core issue: the absence of historical behavior data. To tackle this, we introduce the LLM Simulator framework, which leverages large language models to simulate user interactions for cold items, fundamentally addressing the cold-start problem. However, simply using LLM to traverse all users can introduce significant complexity in billion-scale systems. To manage the computational complexity, we propose a coupled funnel ColdLLM framework for online recommendation. ColdLLM efficiently reduces the number…

Features Selection for Intrusion Detection Systems Based on Support Vector Machines

Safaa Zaman, Fakhri Karray

Computer Networks and Communications · 2009 · cited 78× · DOI ↗ · more like this ·

Intrusion detection systems (EDSs) deal with large amounts of data containing irrelevant and/or redundant features. These features result in a slow training and testing process, heavy computational resources, and low detection accuracy. Features selection, therefore, is an important issue in EDSs. A reduced features set improves system accuracy and speeds up the training and testing process considerably. In this paper, we propose a novel and simple method - enhanced support vector decision function (ESVDF)-for features selection. This method selects features based on two important factors: the feature's rank (weight), which is calculated using support vector decision function (SVDF), and the correlation between the features, which is determined by either the forward selection ranking (FSR) or backward elimination ranking (BER) algorithm. Our method significantly decreases training and…

Visual Attention for Robotic Cognition: A Survey

Momotaz Begum, Fakhri Karray

Computer Vision and Pattern Recognition · IEEE Transactions on Autonomous Mental Development · 14 Dec 2010 · cited 69× · DOI ↗ · more like this ·

The goal of the cognitive robotics research is to design robots with human-like cognition (albeit reduced complexity) in perception, reasoning, action planning, and decision making. Such a venture of cognitive robotics has developed robots with redundant number of sensors and actuators in order to perceive the world and act up on it in a human-like fashion. A major challenge to deal with these robots is managing the enormous amount of information continuously arriving through multiple sensors. The primates master this information management skill through their custom-built attention mechanism. Mimicking the attention behavior of the primates, therefore, has gained tremendous popularity in robotic research in the recent years ( Bar-Cohen , Biologically Inspired Intelligent Robots, 2003, and B. Webb , Biorobotics, 2003). The difficulties of redundant information management, however, is…

A robust adaptive fuzzy position/force control scheme for cooperative manipulators

Wail Gueaieb, Fakhri Karray, Salah Al-Sharhan

Computer Networks and Communications · IEEE Transactions on Control Systems Technology · July 2003 · cited 67× · DOI ↗ · more like this ·

We examine the complex problem of simultaneous position and internal force control in multiple cooperative manipulator systems. This is done in the presence of unwanted parametric and modeling uncertainties as well as external disturbances. A decentralized adaptive fuzzy controller scheme is proposed here. The controller makes use of a multi-input-multi-output fuzzy logic engine and a systematic online adaptation mechanism. Unlike conventional adaptive controllers, the proposed algorithm requires neither a precise mathematical model of the system's dynamics nor a linear parameterization of the system's uncertain physical parameters. Using a Lyapunov stability approach, the controller is proven to be robust in the face of varying intensity levels of the aforementioned uncertainties. The payload position/orientation error and that of the internal forces are also shown to asymptotically…

A concept-based model for enhancing text categorization

Shady Shehata, Fakhri Karray, Mohamed S. Kamel

Artificial Intelligence · 12 Aug 2007 · cited 65× · DOI ↗ · more like this ·

Most of text categorization techniques are based on word and/or phrase analysis of the text. Statistical analysis of a term frequency captures the importance of the term within a document only. However, two terms can have the same frequency in their documents, but one term contributes moreto the meaning of its sentences than the other term. Thus, the underlying model should indicate terms that capture these mantics of text. In this case, the model can capture terms that present the concepts of the sentence, which leads todiscover the topic of the document. A new concept-based model that analyzes terms on the sentence and document levels rather than the traditional analysis of document only is introduced. The concept-based model can effectively discriminate between non-important terms with respect to sentence semantics and terms which hold the concepts that represent the sentence…

Reproducing Kernel Hilbert Space, Mercer's Theorem, Eigenfunctions, Nyström Method, and Use of Kernels in Machine Learning: Tutorial and Survey

Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray +1 more

stat.ML · 15 Jun 2021 · cited 63× · arXiv ↗ · more like this ·

This is a tutorial and survey paper on kernels, kernel methods, and related fields. We start with reviewing the history of kernels in functional analysis and machine learning. Then, Mercer kernel, Hilbert and Banach spaces, Reproducing Kernel Hilbert Space (RKHS), Mercer's theorem and its proof, frequently used kernels, kernel construction from distance metric, important classes of kernels (including bounded, integrally positive definite, universal, stationary, and characteristic kernels), kernel centering and normalization, and eigenfunctions are explained in detail. Then, we introduce types of use of kernels in machine learning including kernel methods (such as kernel support vector machines), kernel learning by semi-definite programming, Hilbert-Schmidt independence criterion, maximum mean discrepancy, kernel mean embedding, and kernel dimensionality reduction. We also cover rank and…

Enhancing Text Clustering Using Concept-based Mining Model

Shady Shehata, Fakhri Karray, Mohamed S. Kamel

Information Systems · Proceedings · December 2006 · cited 61× · DOI ↗ · more like this ·

Most of text mining techniques are based on word and/or phrase analysis of the text. The statistical analysis of a term (word or phrase) frequency captures the importance of the term within a document. However, to achieve a more accurate analysis, the underlying mining technique should indicate terms that capture the semantics of the text from which the importance of a term in a sentence and in the document can be derived. A new concept-based mining model that relies on the analysis of both the sentence and the document, rather than, the traditional analysis of the document dataset only is introduced. The proposed mining model consists of a concept-based analysis of terms and a concept-based similarity measure. The term which contributes to the sentence semantics is analyzed with respect to its importance at the sentence and document levels. The model can efficiently find significant…

Connectionist-Based Dempster–Shafer Evidential Reasoning for Data Fusion

Otman Basir, Fakhri Karray, Hui Zhu

Artificial Intelligence · IEEE Transactions on Neural Networks · November 2005 · cited 61× · DOI ↗ · more like this ·

Dempster-Shafer evidence theory (DSET) is a popular paradigm for dealing with uncertainty and imprecision. Its corresponding evidential reasoning framework is theoretically attractive. However, there are outstanding issues that hinder its use in real-life applications. Two prominent issues in this regard are 1) the issue of basic probability assignments (masses) and 2) the issue of dependence among information sources. This paper attempts to deal with these issues by utilizing neural networks in the context of pattern classification application. First, a multilayer perceptron neural network with the mean squared error as a cost function is implemented to calculate, for each information source, posteriori probabilities for all classes. Second, an evidence structure construction scheme is developed for transferring the estimated posteriori probabilities to a set of masses along with the…

Multisensor Data Fusion

Bahador Khaleghi, Alaa Khamis, Fakhri Karray

Artificial Intelligence · 19 Dec 2017 · cited 56× · DOI ↗ · more like this ·

This chapter provides a comprehensive review of contemporary data fusion methodologies, and overviews the most recent developments and emerging trends in this field. It discusses the recent advances in mobile and ubiquitous sensing, cloud storage and computing, and prevalence of social networks, the new and emerging directions in data fusion research, such as social data fusion, cloud-enabled and big data fusion, and fusion of streaming data. Multisensor data fusion aims to overcome the limitations of individual sensors and produce accurate, robust, and reliable estimates of the world state based on multisensory information. The most common and popular conceptualization of fusion systems is the Joint Directors of Laboratories (JDL) model. Performance evaluation aims at studying the behavior of a data fusion system operated by various algorithms and comparing their pros and cons based on…

Multiview Supervised Dictionary Learning in Speech Emotion Recognition

Mehrdad J. Gangeh, Pouria Fewzee, Ali Ghodsi +2 more

Urban Studies · IEEE/ACM Transactions on Audio Speech and Language Processing · 22 Apr 2014 · cited 56× · DOI ↗ · more like this ·

Recently, a supervised dictionary learning (SDL) approach based on the Hilbert-Schmidt independence criterion (HSIC) has been proposed that learns the dictionary and the corresponding sparse coefficients in a space where the dependency between the data and the corresponding labels is maximized. In this paper, two multiview dictionary learning techniques are proposed based on this HSIC-based SDL. While one of these two techniques learns one dictionary and the corresponding coefficients in the space of fused features in all views, the other learns one dictionary in each view and subsequently fuses the sparse coefficients in the spaces of learned dictionaries. The effectiveness of the proposed multiview learning techniques in using the complementary information of single views is demonstrated in the application of speech emotion recognition (SER). The fully-continuous sub-challenge (FCSC)…

VD-Net: An Edge Vision-Based Surveillance System for Violence Detection

Mustaqeem Khan, Abdulmotaleb El Saddik, Wail Gueaieb +2 more

Computer Vision and Pattern Recognition · IEEE Access · 2024 · cited 47× · DOI ↗ · more like this ·

The automation of surveillance systems, driven by the rapid development of computer vision technology, has significantly enhanced the analysis of surveillance videos, particularly in recognition of human activity, including behavior analysis and violence detection, thereby bolstering public and industrial security. Despite these advancements, detecting and analyzing violent actions remains challenging, especially for real-time surveillance systems with limited computing power. We propose an artificial intelligence-based framework called VD-Net (Violence Detection Network), enabled by Intelligent Internet-of-Things (IIoT) to detect violent behavior in public and private spaces. The model utilizes lightweight special task temporal convolutional network (ST-TCN) blocks and several bottleneck layers to focus on salient features in the input sequence. The learned features passed from the…

Internet of Behavior and Explainable AI Systems for Influencing IoT Behavior

Haya Elayan, Moayad Aloqaily, Fakhri Karray +1 more

Information Systems · IEEE Network · 8 Aug 2022 · cited 47× · DOI ↗ · more like this ·

Pandemics and natural disasters over the years have changed the behavior of people, which has had a tremendous impact on all life aspects. With the technologies available in each era, governments, organizations, and companies have used these technologies to track, control, and influence the behavior of individuals for some benefits. Nowadays, the use of the Internet of Things (IoT), cloud computing, and Artificial Intelligence (AI) have made it easier to track and change the behavior of users through changing the behavior of IoT devices. This article introduces and discusses the concept of the Internet of Behavior (IoB) and its integration with Explainable AI (XAI) techniques to provide trusted and evident experience in the process of changing IoT behavior to ultimately influence user behavior. Therefore, We propose a system based on IoB and XAI that aims to influence user behavior and…

AI-based Blockchain for the Metaverse: Approaches and Challenges

Ouns Bouachir, Moayad Aloqaily, Fakhri Karray +1 more

Information Systems · 5 Sep 2022 · cited 44× · DOI ↗ · more like this ·

The recent advances in AI have enabled novel approaches and remarkable enhancements in the provision of existing services and applications. The metaverse is one of the emerging applications that got the advantages of this technological progression. Due to the cooperation between several cutting-edge technologies including IoT, digital twin (DT), and big data, the metaverse highly relies on the manipulation of an immense amount of gathered data. In this context, security is a major challenge, and as such, blockchain brings several advantages to the metaverse ecosystem as it allows secure and transparent data storage. However, with the dynamic nature of such an ecosystem and the fast variation in its AI-based services, the traditional blockchain features (e.g. smart contracts and consensus protocols) will face big challenges to meet the needed dynamic service requirements and scalability.…

CamoFocus: Enhancing Camouflage Object Detection with Split-Feature Focal Modulation and Context Refinement

Abbas Khan, Mustaqeem Khan, Wail Gueaieb +3 more

Computer Vision and Pattern Recognition · 3 Jan 2024 · cited 43× · DOI ↗ · more like this ·

Camouflage Object Detection (COD) involves the challenge of isolating a target object from a visually similar background, presenting a formidable challenge for learning algorithms. Drawing inspiration from state-of-the-art (SOTA) Focal Modulation Networks, our objective is to proficiently modulate the foreground and background components, thereby capturing the distinct features of each. We introduce a Feature Split and Modulation (FSM) module to attain this goal. This module efficiently separates the object from the background by utilizing foreground and background modulators guided by a supervisory mask. For enhanced feature refinement, we propose a Context Refinement Module (CRM), which considers features acquired from FSM across various spatial scales, leading to comprehensive enrichment and highly accurate prediction maps. Through extensive experimentation, we showcase the…

Fisher and Kernel Fisher Discriminant Analysis: Tutorial

Benyamin Ghojogh, Fakhri Karray, Mark Crowley

stat.ML · June 2019 · cited 43× · arXiv ↗ · more like this ·

This is a detailed tutorial paper which explains the Fisher discriminant Analysis (FDA) and kernel FDA. We start with projection and reconstruction. Then, one- and multi-dimensional FDA subspaces are covered. Scatters in two- and then multi-classes are explained in FDA. Then, we discuss on the rank of the scatters and the dimensionality of the subspace. A real-life example is also provided for interpreting FDA. Then, possible singularity of the scatter is discussed to introduce robust FDA. PCA and FDA directions are also compared. We also prove that FDA and linear discriminant analysis are equivalent. Fisher forest is also introduced as an ensemble of fisher subspaces useful for handling data with different features and dimensionality. Afterwards, kernel FDA is explained for both one- and multi-dimensional subspaces with both two- and multi-classes. Finally, some simulations are…

Distributed Genetic Algorithm with Bi-Coded Chromosomes and a New Evaluation Function for Features Selection

Tarek M. Hamdani, Adel M. Alimi, Fakhri Karray

Artificial Intelligence · 22 Sep 2006 · cited 41× · DOI ↗ · more like this ·

We propose a new feature selection method based on distributed genetic algorithms and bi-coded genes. This solution uses homogeneous and heterogeneous population strategies to minimize the complexity and to accelerate the algorithm convergence. The importance rate is computed for each feature measure to estimate the contribution of each feature in the finale selected vector. A new fitness function was proposed to take into consideration the recognition rate relatively to the size of the selected features subset. Two genetic codes are used to represent each member; a binary code to represent when the corresponding feature was selected or not; the second real code was used to estimate the importance rate of the selected feature or the selection probability for the non selected feature.

Multidimensional Scaling, Sammon Mapping, and Isomap: Tutorial and Survey

Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray +1 more

stat.ML · 17 Sep 2020 · cited 40× · arXiv ↗ · more like this ·

Multidimensional Scaling (MDS) is one of the first fundamental manifold learning methods. It can be categorized into several methods, i.e., classical MDS, kernel classical MDS, metric MDS, and non-metric MDS. Sammon mapping and Isomap can be considered as special cases of metric MDS and kernel classical MDS, respectively. In this tutorial and survey paper, we review the theory of MDS, Sammon mapping, and Isomap in detail. We explain all the mentioned categories of MDS. Then, Sammon mapping, Isomap, and kernel Isomap are explained. Out-of-sample embedding for MDS and Isomap using eigenfunctions and kernel mapping are introduced. Then, Nystrom approximation and its use in landmark MDS and landmark Isomap are introduced for big data embedding. We also provide some simulations for illustrating the embedding by these methods.