arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Usman

5,187 papers · 1952–2026

1967: 01968: 01969: 01970: 01971: 01972: 01973: 01974: 01975: 01976: 11977: 01978: 01979: 11980: 01981: 01982: 11983: 01984: 01985: 11986: 01987: 01988: 01989: 11990: 01991: 11992: 11993: 01994: 01995: 11996: 31997: 11998: 11999: 22000: 32001: 02002: 82003: 42004: 162005: 252006: 322007: 632008: 582009: 842010: 962011: 1302012: 1422013: 2002014: 2452015: 2792016: 3102017: 3802018: 4532019: 6272020: 8152021: 5212022: 902023: 902024: 1282025: 1942026: 178
1967peak 815 in 20202026

Frequent co-authors

Papers

showing 1–25 of 5,187 RSS

A Comprehensive Overview of Large Language Models

Humza Naveed, Asad Ullah Khan, Shi Qiu +6 more

cs.CL · · cited 2,025× · arXiv ↗ · more like this ·

Large Language Models (LLMs) have recently demonstrated remarkable capabilities in natural language processing tasks and beyond. This success of LLMs has led to a large influx of research contributions in this direction. These works encompass diverse topics such as architectural innovations, better training strategies, context length improvements, fine-tuning, multi-modal LLMs, robotics, datasets, benchmarking, efficiency, and more. With the rapid development of techniques and regular breakthroughs in LLM research, it has become considerably challenging to perceive the bigger picture of the advances in this direction. Considering the rapidly emerging plethora of literature on LLMs, it is imperative that the research community is able to benefit from a concise yet comprehensive overview of the recent developments in this field. This article provides an overview of the existing literature…

Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback

Stephen Casper, Xander Davies, Claudia Shi +29 more

cs.AI · · cited 986× · arXiv ↗ · more like this ·

Reinforcement learning from human feedback (RLHF) is a technique for training AI systems to align with human goals. RLHF has emerged as the central method used to finetune state-of-the-art large language models (LLMs). Despite this popularity, there has been relatively little public work systematizing its flaws. In this paper, we (1) survey open problems and fundamental limitations of RLHF and related methods; (2) overview techniques to understand, improve, and complement RLHF in practice; and (3) propose auditing and disclosure standards to improve societal oversight of RLHF systems. Our work emphasizes the limitations of RLHF and highlights the importance of a multi-faceted approach to the development of safer AI systems.

VisDA: The Visual Domain Adaptation Challenge

Xingchao Peng, Ben Usman, Neela Kaushik +3 more

cs.CV · · cited 941× · arXiv ↗ · more like this ·

We present the 2017 Visual Domain Adaptation (VisDA) dataset and challenge, a large-scale testbed for unsupervised domain adaptation across visual domains. Unsupervised domain adaptation aims to solve the real-world problem of domain shift, where machine learning models trained on one domain must be transferred and adapted to a novel visual domain without additional supervision. The VisDA2017 challenge is focused on the simulation-to-reality shift and has two associated tasks: image classification and image segmentation. The goal in both tracks is to first train a model on simulated, synthetic data in the source domain and then adapt it to perform well on real image data in the unlabeled test domain. Our dataset is the largest one to date for cross-domain object classification, with over 280K images across 12 categories in the combined training, validation and testing domains. The image…

Comprehensive Review of Artificial Neural Network Applications to Pattern Recognition

Oludare Isaac Abiodun, Muhammad Ubale Kiru, Aman Jantan +7 more

Artificial Intelligence · IEEE Access · · cited 728× · DOI ↗ · more like this ·

The era of artificial neural network (ANN) began with a simplified application in many fields and remarkable success in pattern recognition (PR) even in manufacturing industries. Although significant progress achieved and surveyed in addressing ANN application to PR challenges, nevertheless, some problems are yet to be resolved like whimsical orientation (the unknown path that cannot be accurately calculated due to its directional position). Other problem includes; object classification, location, scaling, neurons behavior analysis in hidden layers, rule, and template matching. Also, the lack of extant literature on the issues associated with ANN application to PR seems to slow down research focus and progress in the field. Hence, there is a need for state-of-the-art in neural networks application to PR to urgently address the above-highlights problems for more successes. The study…

A generalized temporal role-based access control model

James Joshi, Elisa Bertino, Usman Latif +1 more

Sociology and Political Science · IEEE Transactions on Knowledge and Data Engineering · · cited 610× · DOI ↗ · more like this ·

Role-based access control (RBAC) models have generated a great interest in the security community as a powerful and generalized approach to security management. In many practical scenarios, users may be restricted to assume roles only at predefined time periods. Furthermore, roles may only be invoked on prespecified intervals of time depending upon when certain actions are permitted. To capture such dynamic aspects of a role, a temporal RBAC (TRBAC) model has been recently proposed. However, the TRBAC model addresses the role enabling constraints only. In This work, we propose a generalized temporal role-based access control (GTRBAC) model capable of expressing a wider range of temporal constraints. In particular, the model allows expressing periodic as well as duration constraints on roles, user-role assignments, and role-permission assignments. In an interval, activation of a role can…

Using Blockchain for Electronic Health Records

Ayesha Shahnaz, Usman Qamar, Ayesha Khalid

Information Systems · IEEE Access · · cited 582× · DOI ↗ · more like this ·

Blockchain have been an interesting research area for a long time and the benefits it provides have been used by a number of various industries. Similarly, the healthcare sector stands to benefit immensely from the blockchain technology due to security, privacy, confidentiality and decentralization. Nevertheless, the Electronic Health Record (EHR) systems face problems regarding data security, integrity and management. In this paper, we discuss how the blockchain technology can be used to transform the EHR systems and could be a solution of these issues. We present a framework that could be used for the implementation of blockchain technology in healthcare sector for EHR. The aim of our proposed framework is firstly to implement blockchain technology for EHR and secondly to provide secure storage of electronic records by defining granular access rules for the users of the proposed…

Distributing the Kalman Filter for Large-Scale Systems

Usman A. Khan, Jose M. F. Moura

cs.IT · · cited 466× · arXiv ↗ · more like this ·

This paper derives a \emph{distributed} Kalman filter to estimate a sparsely connected, large-scale, $n-$dimensional, dynamical system monitored by a network of $N$ sensors. Local Kalman filters are implemented on the ($n_l-$dimensional, where $n_l\ll n$) sub-systems that are obtained after spatially decomposing the large-scale system. The resulting sub-systems overlap, which along with an assimilation procedure on the local Kalman filters, preserve an $L$th order Gauss-Markovian structure of the centralized error processes. The information loss due to the $L$th order Gauss-Markovian approximation is controllable as it can be characterized by a divergence that decreases as $L\uparrow$. The order of the approximation, $L$, leads to a lower bound on the dimension of the sub-systems, hence, providing a criterion for sub-system selection. The assimilation procedure is carried out on the…

Quantum Computing: A Taxonomy, Systematic Review and Future Directions

Sukhpal Singh Gill, Adarsh Kumar, Harvinder Singh +4 more

cs.ET · · cited 433× · arXiv ↗ · more like this ·

Quantum computing is an emerging paradigm with the potential to offer significant computational advantage over conventional classical computing by exploiting quantum-mechanical principles such as entanglement and superposition. It is anticipated that this computational advantage of quantum computing will help to solve many complex and computationally intractable problems in several areas such as drug design, data science, clean energy, finance, industrial chemical development, secure communications, and quantum chemistry. In recent years, tremendous progress in both quantum hardware development and quantum software/algorithm have brought quantum computing much closer to reality. Indeed, the demonstration of quantum supremacy marks a significant milestone in the Noisy Intermediate Scale Quantum (NISQ) era - the next logical step being the quantum advantage whereby quantum computers solve…

Standardization and Its Effects on K-Means Clustering Algorithm

Ismail Mohamad, Dauda Usman

Artificial Intelligence · Research Journal of Applied Sciences Engineering and Technology · · cited 409× · DOI ↗ · more like this ·

Data clustering is an important data exploration technique with many applications in data mining. <em>K</em>-means is one of the most well known methods of data mining that partitions a dataset into groups of patterns, many methods have been proposed to improve the performance of the <em>K</em>-means algorithm. Standardization is the central preprocessing step in data mining, to standardize values of features or attributes from different dynamic range into a specific range. In this paper, we have analyzed the performances of the three standardization methods on conventional <em>K</em>-means algorithm. By comparing the results on infectious diseases datasets, it was found that the result obtained by the z-score standardization method is more effective and efficient than min-max and decimal scaling standardization methods.

A Novel PCA-Firefly Based XGBoost Classification Model for Intrusion Detection in Networks Using GPU

Sweta Bhattacharya, Siva Rama Krishnan S, Praveen Kumar Reddy Maddikunta +5 more

Computer Networks and Communications · Electronics · · cited 355× · DOI ↗ · more like this ·

The enormous popularity of the internet across all spheres of human life has introduced various risks of malicious attacks in the network. The activities performed over the network could be effortlessly proliferated, which has led to the emergence of intrusion detection systems. The patterns of the attacks are also dynamic, which necessitates efficient classification and prediction of cyber attacks. In this paper we propose a hybrid principal component analysis (PCA)-firefly based machine learning model to classify intrusion detection system (IDS) datasets. The dataset used in the study is collected from Kaggle. The model first performs One-Hot encoding for the transformation of the IDS datasets. The hybrid PCA-firefly algorithm is then used for dimensionality reduction. The XGBoost algorithm is implemented on the reduced dataset for classification. A comprehensive evaluation of the…

COVIDSenti: A Large-Scale Benchmark Twitter Data Set for COVID-19 Sentiment Analysis

Usman Naseem, Imran Razzak, Matloob Khushi +2 more

Sociology and Political Science · IEEE Transactions on Computational Social Systems · · cited 337× · DOI ↗ · more like this ·

Social media (and the world at large) have been awash with news of the COVID-19 pandemic. With the passage of time, news and awareness about COVID-19 spread like the pandemic itself, with an explosion of messages, updates, videos, and posts. Mass hysteria manifest as another concern in addition to the health risk that COVID-19 presented. Predictably, public panic soon followed, mostly due to misconceptions, a lack of information, or sometimes outright misinformation about COVID-19 and its impacts. It is thus timely and important to conduct an <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">ex post facto</i> assessment of the early information flows during the pandemic on social media, as well as a case study of evolving public opinion on social media which is of general interest. This study aims to inform policy that can be applied to…

A linear algorithm for optimization over directed graphs with geometric convergence

Ran Xin, Usman A. Khan

math.OC · · cited 294× · arXiv ↗ · more like this ·

In this letter, we study distributed optimization, where a network of agents, abstracted as a directed graph, collaborates to minimize the average of locally-known convex functions. Most of the existing approaches over directed graphs are based on push-sum (type) techniques, which use an independent algorithm to asymptotically learn either the left or right eigenvector of the underlying weight matrices. This strategy causes additional computation, communication, and nonlinearity in the algorithm. In contrast, we propose a linear algorithm based on an inexact gradient method and a gradient estimation technique. Under the assumptions that each local function is strongly-convex with Lipschitz-continuous gradients, we show that the proposed algorithm geometrically converges to the global minimizer with a sufficiently small step-size. We present simulations to illustrate the theoretical…

Distributed Recurrent Neural Networks for Cooperative Control of Manipulators: A Game-Theoretic Perspective

Shuai Li, Jinbo He, Yangming Li +1 more

Computer Networks and Communications · IEEE Transactions on Neural Networks and Learning Systems · · cited 292× · DOI ↗ · more like this ·

This paper considers cooperative kinematic control of multiple manipulators using distributed recurrent neural networks and provides a tractable way to extend existing results on individual manipulator control using recurrent neural networks to the scenario with the coordination of multiple manipulators. The problem is formulated as a constrained game, where energy consumptions for each manipulator, saturations of control input, and the topological constraints imposed by the communication graph are considered. An implicit form of the Nash equilibrium for the game is obtained by converting the problem into its dual space. Then, a distributed dynamic controller based on recurrent neural networks is devised to drive the system toward the desired Nash equilibrium to seek the optimal solution of the cooperative control. Global stability and solution optimality of the proposed neural networks…

Structural elucidation of SARS-CoV-2 vital proteins: Computational methods reveal potential drug candidates against main protease, Nsp12 polymerase and Nsp13 helicase

Muhammad Usman Mirza, Matheus Froeyen

Computational Theory and Mathematics · Journal of Pharmaceutical Analysis · · cited 282× · DOI ↗ · more like this ·

Recently emerged SARS-CoV-2 caused a major outbreak of coronavirus disease 2019 (COVID-19) and instigated a widespread fear, threatening global health safety. To date, no licensed antiviral drugs or vaccines are available against COVID-19 although several clinical trials are under way to test possible therapies. During this urgent situation, computational drug discovery methods provide an alternative to tiresome high-throughput screening, particularly in the hit-to-lead-optimization stage. Identification of small molecules that specifically target viral replication apparatus has indicated the highest potential towards antiviral drug discovery. In this work, we present potential compounds that specifically target SARS-CoV-2 vital proteins, including the main protease, Nsp12 RNA polymerase and Nsp13 helicase. An integrative virtual screening and molecular dynamics simulations approach has…

SIT: A Lightweight Encryption Algorithm for Secure Internet of Things

Muhammad Usman, Irfan Ahmed, M. Imran Aslam +2 more

cs.CR · · cited 274× · arXiv ↗ · more like this ·

The Internet of Things (IoT) being a promising technology of the future is expected to connect billions of devices. The increased number of communication is expected to generate mountains of data and the security of data can be a threat. The devices in the architecture are essentially smaller in size and low powered. Conventional encryption algorithms are generally computationally expensive due to their complexity and requires many rounds to encrypt, essentially wasting the constrained energy of the gadgets. Less complex algorithm, however, may compromise the desired integrity. In this paper we propose a lightweight encryption algorithm named as Secure IoT (SIT). It is a 64-bit block cipher and requires 64-bit key to encrypt the data. The architecture of the algorithm is a mixture of feistel and a uniform substitution-permutation network. Simulations result shows the algorithm provides…

Breast Cancer Classification From Histopathological Images Using Patch-Based Deep Learning Modeling

Irum Hirra, Mubashir Ahmad, Ayaz Hussain +5 more

Artificial Intelligence · IEEE Access · · cited 271× · DOI ↗ · more like this ·

Accurate detection and classification of breast cancer is a critical task in medical imaging due to the complexity of breast tissues. Due to automatic feature extraction ability, deep learning methods have been successfully applied in different areas, especially in the field of medical imaging. In this study, a novel patch-based deep learning method called Pa-DBN-BC is proposed to detect and classify breast cancer on histopathology images using the Deep Belief Network (DBN). Features are extracted through an unsupervised pre-training and supervised fine-tuning phase. The network automatically extracts features from image patches. Logistic regression is used to classify the patches from histopathology images. The features extracted from the patches are fed to the model as input and the model presents the result as a probability matrix as either a positive sample (cancer) or a negative…

A survey of ontology learning techniques and applications

Muhammad Nabeel Asim, Muhammad Wasim, Muhammad Usman Ghani Khan +2 more

Artificial Intelligence · Database · · cited 251× · DOI ↗ · more like this ·

Ontologies have gained a lot of popularity and recognition in the semantic web because of their extensive use in Internet-based applications. Ontologies are often considered a fine source of semantics and interoperability in all artificially smart systems. Exponential increase in unstructured data on the web has made automated acquisition of ontology from unstructured text a most prominent research area. Several methodologies exploiting numerous techniques of various fields (machine learning, text mining, knowledge representation and reasoning, information retrieval and natural language processing) are being proposed to bring some level of automation in the process of ontology acquisition from unstructured text. This paper describes the process of ontology learning and further classification of ontology learning techniques into three classes (linguistics, statistical and logical) and…

Foundational Challenges in Assuring Alignment and Safety of Large Language Models

Usman Anwar, Abulhair Saparov, Javier Rando +39 more

cs.LG · · cited 248× · arXiv ↗ · more like this ·

This work identifies 18 foundational challenges in assuring the alignment and safety of large language models (LLMs). These challenges are organized into three different categories: scientific understanding of LLMs, development and deployment methods, and sociotechnical challenges. Based on the identified challenges, we pose $200+$ concrete research questions.

RRT*-SMART: A Rapid Convergence Implementation of RRT*

Jauwairia Nasir, Fahad Islam, Usman Malik +4 more

Computer Vision and Pattern Recognition · International Journal of Advanced Robotic Systems · · cited 244× · DOI ↗ · more like this ·

Many sampling based algorithms have been introduced recently. Among them Rapidly Exploring Random Tree (RRT) is one of the quickest and the most efficient obstacle free path finding algorithm. Although it ensures probabilistic completeness, it cannot guarantee finding the most optimal path. Rapidly Exploring Random Tree Star (RRT*), a recently proposed extension of RRT, claims to achieve convergence towards the optimal solution thus ensuring asymptotic optimality along with probabilistic completeness. However, it has been proven to take an infinite time to do so and with a slow convergence rate. In this paper an extension of RRT*, called as RRT*-Smart, has been prposed to overcome the limitaions of RRT*. The goal of the proposecd method is to accelerate the rate of convergence, in order to reach an optimum or near optimum solution at a much faster rate, thus reducing the execution time.…

ADD-OPT: Accelerated Distributed Directed Optimization

Chenguang Xi, Ran Xin, Usman A. Khan

math.OC · · cited 232× · arXiv ↗ · more like this ·

In this paper, we consider distributed optimization problems where the goal is to minimize a sum of objective functions over a multi-agent network. We focus on the case when the inter-agent communication is described by a strongly-connected, \emph{directed} graph. The proposed algorithm, ADD-OPT (Accelerated Distributed Directed Optimization), achieves the best known convergence rate for this class of problems,~$O(μ^{k}),0<μ<1$, given strongly-convex, objective functions with globally Lipschitz-continuous gradients, where~$k$ is the number of iterations. Moreover, ADD-OPT supports a wider and more realistic range of step-sizes in contrast to existing work. In particular, we show that ADD-OPT converges for arbitrarily small (positive) step-sizes. Simulations further illustrate our results.

Anomaly Detection in Automated Vehicles Using Multistage Attention-Based Convolutional Neural Network

Abdul Rehman Javed, Muhammad Usman, Saif Ur Rehman +2 more

Artificial Intelligence · IEEE Transactions on Intelligent Transportation Systems · · cited 215× · DOI ↗ · more like this ·

Connected and Automated Vehicles (CAVs), owing to their characteristics such as seamless and real-time transfer of data, are imperative infrastructural advancements to realize the emerging smart world. The sensor-generated data are, however, vulnerable to anomalies caused due to faults, errors, and/or cyberattacks, which may cause accidents resulting in fatal casualties. To help in avoiding such situations by timely detecting anomalies, this study proposes an anomaly detection method that incorporates a combination of a multi-stage attention mechanism with a Long Short-Term Memory (LSTM)-based Convolutional Neural Network (CNN), namely, MSALSTM-CNN. The data streams, in the proposed method, are converted into vectors and then processed for anomaly detection. We also designed a method, namely, weight-adjusted fine-tuned ensemble: WAVED, which works on the principle of average predicted…

Effort estimation in agile software development

Muhammad Usman, Emília Mendes, Frâncila Weidt +1 more

Information Systems · KTH Publication Database DiVA (KTH Royal Institute of Technology) · · cited 204× · DOI ↗ · more like this ·

Context: Ever since the emergence of agile methodologies in 2001, many software companies have shifted to Agile Software Development (ASD), and since then many studies have been conducted to investigate effort estimation within such context; however to date there is no single study that presents a detailed overview of the state of the art in effort estimation for ASD. Objectives: The aim of this study is to provide a detailed overview of the state of the art in the area of effort estimation in ASD. Method: To report the state of the art, we conducted a systematic literature review in accordance with the guidelines proposed in the evidence-based software engineering literature. Results: A total of 25 primary studies were selected; the main findings are: i) Subjective estimation techniques (e.g. expert judgment, planning poker, use case points estimation method) are the most frequently…

A Comprehensive Survey on Word Representation Models: From Classical to State-Of-The-Art Word Representation Language Models

Usman Naseem, Imran Razzak, Shah Khalid Khan +1 more

cs.CL · · cited 201× · arXiv ↗ · more like this ·

Word representation has always been an important research area in the history of natural language processing (NLP). Understanding such complex text data is imperative, given that it is rich in information and can be used widely across various applications. In this survey, we explore different word representation models and its power of expression, from the classical to modern-day state-of-the-art word representation language models (LMS). We describe a variety of text representation methods, and model designs have blossomed in the context of NLP, including SOTA LMs. These models can transform large volumes of text into effective vector representations capturing the same semantic information. Further, such representations can be utilized by various machine learning (ML) algorithms for a variety of NLP related tasks. In the end, this survey briefly discusses the commonly used ML and DL…

Distributed heavy-ball: A generalization and acceleration of first-order methods with gradient tracking

Ran Xin, Usman A. Khan

math.OC · · cited 200× · arXiv ↗ · more like this ·

We study distributed optimization to minimize a global objective that is a sum of smooth and strongly-convex local cost functions. Recently, several algorithms over undirected and directed graphs have been proposed that use a gradient tracking method to achieve linear convergence to the global minimizer. However, a connection between these different approaches has been unclear. In this paper, we first show that many of the existing first-order algorithms are in fact related with a simple state transformation, at the heart of which lies the $\mathcal{AB}$ algorithm. We then describe \textit{distributed heavy-ball}, denoted as $\mathcal{AB}m$, i.e., $\mathcal{AB}$ with momentum, that combines gradient tracking with a momentum term and uses nonidentical local step-sizes. By simultaneously implementing both row- and column-stochastic weights, $\mathcal{AB}m$ removes the conservatism in the…

Exploring estimator bias-variance tradeoffs using the uniform CR bound

Alfred O. Hero, Jeffrey A. Fessler, Mustofa Usman

Statistics and Probability · IEEE Transactions on Signal Processing · · cited 196× · DOI ↗ · more like this ·

We introduce a plane, which we call the delta-sigma plane, that is indexed by the norm of the estimator bias gradient and the variance of the estimator. The norm of the bias gradient is related to the maximum variation in the estimator bias function over a neighborhood of parameter space. Using a uniform Cramer-Rao (CR) bound on estimator variance, a delta-sigma tradeoff curve is specified that defines an "unachievable region" of the delta-sigma plane for a specified statistical model. In order to place an estimator on this plane for comparison with the delta-sigma tradeoff curve, the estimator variance, bias gradient, and bias gradient norm must be evaluated. We present a simple and accurate method for experimentally determining the bias gradient norm based on applying a bootstrap estimator to a sample mean constructed from the gradient of the log-likelihood. We demonstrate the methods…