arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Basim Azam

37 papers · 2019–2026

2019: 12020: 12021: 42022: 42023: 42024: 42025: 62026: 13
2019peak 13 in 20262026

Frequent co-authors

Papers

showing 1–25 of 37 RSS

Suitability of KANs for Computer Vision: A preliminary investigation

Basim Azam, Naveed Akhtar

cs.CV · · cited 6× · arXiv ↗ · more like this ·

Kolmogorov-Arnold Networks (KANs) introduce a paradigm of neural modeling that implements learnable functions on the edges of the networks, diverging from the traditional node-centric activations in neural networks. This work assesses the applicability and efficacy of KANs in visual modeling, focusing on fundamental recognition and segmentation tasks. We mainly analyze the performance and efficiency of different network architectures built using KAN concepts along with conventional building blocks of convolutional and linear layers, enabling a comparative analysis with the conventional models. Our findings are aimed at contributing to understanding the potential of KANs in computer vision, highlighting both their strengths and areas for further research. Our evaluation point toward the fact that while KAN-based architectures perform in line with the original claims, it may often be…

Explainable Image Recognition With Graph-Based Feature Extraction

Basim Azam, Deepthi Kuttichira, Brijesh Verma +2 more

Computer Vision and Pattern Recognition · IEEE Access · · cited 6× · DOI ↗ · more like this ·

Deep learning models have proven remarkably adept at extracting salient features from raw data, driving state-of-the-art performance across many domains. However, these models suffer from a lack of interpretability; they function as black boxes, obscuring the feature-level support of their predictions. Addressing this problem, we introduce a novel framework that combines the strengths of convolutional layers in extracting features with the adaptability of Graph Neural Networks (GNNs) to effectively represent the interconnections among neuron activations. Our framework operates in two phases: first, it identifies class-oriented neuron activations by analyzing image features, then these activations are encapsulated within a graph structure. The GNN in our system utilizes the connections between neuron activations to yield an interpretable final classification. This approach allows for the…

Formal Verification of Digital Circuits Using Simulator with Mathematical Foundation

Wilayat Khan, Basim Azam, Noman Shahid +2 more

Computational Theory and Mathematics · Applied Mechanics and Materials · · cited 5× · DOI ↗ · more like this ·

To ease hardware design process, circuits are normally designed in description languages such as Verilog and VHDL. The correctness of circuits is normally checked by exhaustive simulation in simulators such as Icarus and VCS. Both the description languages Verilog/VHDL and simulators Icarus/VCS do not have mathematical foundations and hence are not reliable and cannot be used to mathematically prove correctness of circuit designs. Hardware description languages with mathematical (formal) foundation such as VeriFormal, on the other hand, are more reliable, trustworthy and can be used for robust design. In this paper, we report our results of formal verifications of two simple hardware circuits designed in the formal description language VeriFormal. Using the VeriFormal simulator and the accompanied type checker tools, we prove reliability properties type safety, functional correctness…

Deep Learning Model with GA-based Visual Feature Selection and Context Integration

Ranju Mandal, Basim Azam, Brijesh Verma +1 more

Computer Vision and Pattern Recognition · Figshare · · cited 3× · DOI ↗ · more like this ·

Deep learning models have been very successful in computer vision and image processing applications. Since its inception, Convolutional Neural Network (CNN)-based deep learning models have consistently outperformed other machine learning methods on many significant image processing benchmarks. Many top-performing methods for image segmentation are also based on deep CNN models. However, deep CNN models fail to integrate global and local context alongside visual features despite having complex multi-layer architectures. We propose a novel three-layered deep learning model that learns independently global and local contextual information alongside visual features, and visual feature selection based on a genetic algorithm. The novelty of the proposed model is that One-vs-All binary class-based learners are introduced to learn Genetic Algorithm (GA) optimized features in the visual layer…

Class Probability-based Visual and Contextual Feature Integration for Image Parsing

Basim Azam, Ranju Mandal, Ligang Zhang +1 more

Computer Vision and Pattern Recognition · Figshare · · cited 3× · DOI ↗ · more like this ·

Deep learning networks have become one of the most promising architectures for image parsing tasks. Although existing deep networks consider global and local contextual information of the images to learn coarse features individually, they lack automatic adaptation to the contextual properties of scenes. In this work, we present a visual and contextual feature-based deep network for image parsing. The main novelty is in the 3-layer architecture which considers contextual information and each layer is independently trained and integrated. The network explores the contextual features along with the visual features for class label prediction with class-specific classifiers. The contextual features consider the prior information learned by calculating the co-occurrence of object labels both within a whole scene and between neighboring superpixels. The class-specific classifier deals with an…

A Novel Non-iterative Training Method for CNN Classifiers Using Gram–Schmidt Process

Basim Azam, Deepthi Kuttichira, Pubudu Sanjeewani +3 more

Artificial Intelligence · Neural Processing Letters · · cited 2× · DOI ↗ · more like this ·

Abstract Convolutional neural networks have become prominent machine learning models, particularly in the realm of computer vision, due to their ability to predict and extract robust features from raw image data. CNNs, similar to other neural network models, undergo training via backpropagation, an iterative technique. However, the backpropagation algorithm has notable challenges, including slow convergence, susceptibility to local minima, and hypersensitivity to learning rates. These challenges not only impact the model’s accuracy but also make the training process computationally intensive. To address these limitations, We introduce a novel approach that trains the CNN classifier using a non-iterative learning method. The proposed approach involves automatic extraction of pertinent features from the raw-data, followed by the application of Gram–Schmidt process to decompose the feature…

Dynamic Image Deblurring based on Crosshatch Attention Adversarial Network and Hybrid Loss

Ummama Aslam, Arslan Shaukat, Basim Azam

Computer Vision and Pattern Recognition · · cited 2× · DOI ↗ · more like this ·

Image deblurring techniques that uses deep learning have shown great potential but due to low generalizability, noise immunity and the correlation among different pixels is not addressed in detail that results in unwanted artifact that appears in the deblurred image. To tackle this problem an end-to-end approach is proposed for the recovery of sharp image from blurred one without the estimation of blur kernel. A special type of attention module known as crosshatch attention is used after Residual Block of Generator model for removing noise and for the collection of correlation of different pixels in an image. Hybrid Loss function is defined which focus on different part of image and improve edges and texture details. The performance of the model for deblurring is measured on GoPro dataset. Our proposed model has slightly higher objective and subjective evaluation i-e PSNR, SSIM value…

Relationship Aware Context Adaptive Feature Selection Framework for Image Parsing

Basim Azam, Ranju Mandal, Brijesh Verma

Computer Vision and Pattern Recognition · Figshare · · cited 2× · DOI ↗ · more like this ·

Feature selection for deep learning architectures is one of the important and challenging steps in developing an efficient image parsing application. In this paper, a novel image parsing architecture which makes use of unique feature selection is proposed. It introduces the idea of weighted relationship awareness to reduce the redundancy of features and optimally select an efficient subset of feature representations. The proposed architecture is evaluated on Cam Vid benchmark dataset. A comparison with state-of-the-art methods was conducted which showed significant improvements in terms of segmentation and classification accuracy.

The Planning Limits of Latent World Models

Ali Alrasheed, Basim Azam, Naveed Akhtar

cs.RO · · cited 1× · arXiv ↗ · more like this ·

World models offer a promising way to help robots understand how the physical world evolves and plan complex behaviours through imagination. Yet existing studies mainly demonstrate what these models can accomplish, leaving unclear when their predictions remain useful for planning and where they fail. We study this question using action-conditioned predictors built on five frozen self-supervised visual backbones: V-JEPA 2, V-JEPA 2.1, VideoMAEv2, VideoPrism, and DINOv2. We use frozen backbones to test representations intended to transfer across environments. We evaluate these models on diverse Meta-World manipulation tasks and real-robot interactions from BridgeData V2. We find that a world model guides action selection reliably only when the goal lies within, or slightly beyond, the trajectory it imagines during planning. With five-step rollouts, the length the predictor was trained on…

Plug-and-Play Interpretable Responsible Text-to-Image Generation via Dual-Space Multi-facet Concept Control

Basim Azam, Naveed Akhtar

cs.CV · · cited 1× · arXiv ↗ · more like this ·

Ethical issues around text-to-image (T2I) models demand a comprehensive control over the generative content. Existing techniques addressing these issues for responsible T2I models aim for the generated content to be fair and safe (non-violent/explicit). However, these methods remain bounded to handling the facets of responsibility concepts individually, while also lacking in interpretability. Moreover, they often require alteration to the original model, which compromises the model performance. In this work, we propose a unique technique to enable responsible T2I generation by simultaneously accounting for an extensive range of concepts for fair and safe content generation in a scalable manner. The key idea is to distill the target T2I pipeline with an external plug-and-play mechanism that learns an interpretable composite responsible space for the desired concepts, conditioned on the…

GO-N3RDet: Geometry Optimized NeRF-enhanced 3D Object Detector

Zechuan Li, Hongshan Yu, Yihao Ding +3 more

cs.CV · · cited 1× · arXiv ↗ · more like this ·

We propose GO-N3RDet, a scene-geometry optimized multi-view 3D object detector enhanced by neural radiance fields. The key to accurate 3D object detection is in effective voxel representation. However, due to occlusion and lack of 3D information, constructing 3D features from multi-view 2D images is challenging. Addressing that, we introduce a unique 3D positional information embedded voxel optimization mechanism to fuse multi-view features. To prioritize neural field reconstruction in object regions, we also devise a double importance sampling scheme for the NeRF branch of our detector. We additionally propose an opacity optimization module for precise voxel opacity prediction by enforcing multi-view consistency constraints. Moreover, to further improve voxel density consistency across multiple perspectives, we incorporate ray distance as a weighting factor to minimize cumulative ray…

Neuron Efficiency Index: An Empirical Method for Optimizing Parameters in Deep Learning

Basim Azam, Deepthi Kuttichira, Brijesh Verma

Computer Vision and Pattern Recognition · · cited 1× · DOI ↗ · more like this ·

Deep Neural Networks (DNNs) have undeniably achieved groundbreaking success across diverse applications. Nevertheless, their complex architectures inherently lead to substantial computational demands and memory prerequisites. To surmount these challenges, this research paper introduces a pioneering approach designed to amplify DNN efficiency via a unique iterative pruning technique Neuron Efficiency Index (NEI), that considers activation frequency of each neuron, class sensitivity and redundancy in the dense layer neurons. The central objective of this method is to curtail the computational burden of the model, all the while ensuring that performance remains intact and enhanced. The proposed technique is used to prune state-of-the-art architectures and comprehensive comparison is presented on benchmark dataset MNIST and CIFAR-10. The evaluation presents that proposed NEI improves the…

Context-Adaptive Deep Learning for Efficient Image Parsing in Remote Sensing: An Automated Parameter Selection Approach

Basim Azam, Brijesh Verma, Mengjie Zhang

Computer Vision and Pattern Recognition · Griffith Research Online (Griffith University, Queensland, Australia) · · cited 1× · DOI ↗ · more like this ·

Image parsing is among the core tasks in the field of image processing and computer vision having wide-ranging applications in the areas of autonomous driving, image interpretation, medical analysis, and remote sensing. The modern techniques despite performing the labeling tasks accurately face several challenges. Among these challenges, the computation of contextual information and the selection of optimized parameters are of prime importance in pixel-wise segmentation tasks. We propose a novel context adaptive image parsing framework that utilizes a unique parameter selection strategy to produce final pixel labels. The automatic parameter selection minimizes the computational overhead, reduces the time complexity, and improves upon the segmentation labels produced. The proposed framework is evaluated on Wuhan Dense Labelling Dataset (WHDLD). In addition, a comprehensive comparison…

Neural Network Feature Explanation Using Neuron Activation Rate Based Bipartite Graph

Deepthi Praveenlal Kuttichira, Basim Azam, Brijesh Verma +3 more

Artificial Intelligence · Griffith Research Online (Griffith University, Queensland, Australia) · · cited 1× · DOI ↗ · more like this ·

Deep Neural Networks (DNNs) are popular machine learning models that have gained popularity due to its good predictive accuracy and ability to automatically learn features from raw data. Convolutional Neural Networks (CNNs) are one such models that have gained popularity in the field of Computer Vision (CV). Despite the popularity, these models are notoriously black-box models. The decisions made by these models are not explainable. In this paper we propose a method to create a Neuron Activation Rate based Bipartite Graph (NARBG) , that can explain the decisions made by the model, based on the contributions of class specific features. In the proposed method, the features are extracted from the raw data using a CNN based architecture. From the extracted features, neuron activation rate is calculated. Based on these neuron activation rates, influential features for the target class…

A Novel Graph-based Framework for Explainable Image Classification: Features That Matter

Basim Azam, Brijesh Verma, Deepthi Praveenlal Kuttichira +1 more

Artificial Intelligence · Griffith Research Online (Griffith University, Queensland, Australia) · · cited 1× · DOI ↗ · more like this ·

The efficacy of any machine learning model is largely contingent on the quality of the features used for training. Hence, the extraction of robust and discriminative features from raw data is a critical step. This task, however, presents significant challenges. Although modern deep learning models are very advanced, they are often criticized for their black-box nature. The predictions made by these models are not readily interpretable in terms of the features that influenced them. In our research, we propose a novel framework that innovatively combines the prowess of convolutional layers for feature extraction with robustness of Graph Neural Networks (GNNs) to model the relationships of neuron activations for better interpretability. The proposed architecture initially generates features to produce class-based neuron activations, these activations are then incorporated into graph…

Fully Convolutional Neural Network with Relation Aware Context Information for Image Parsing

Basim Azam, Ranju Mandal, Brijesh Verma

Computer Vision and Pattern Recognition · Figshare · · cited 1× · DOI ↗ · more like this ·

Image parsing is among the core tasks in the field of computer vision. The automatic pixel-wise segmentation offers great potential in terms of application adaptability. Traditional convolutional networks have produced better segmentation maps however the research is continued for integration of context information with neural network approaches. In this paper, we propose an image parsing framework that explores the traditional convolutions in fully convolutional networks and learns rich semantic contextual information using the adjacent and spatial modules to generate probability maps. The implicit fusion of the probability maps generated enhances the accuracy of segmentation labels. The proposed framework improves the segmentation accuracy on the CamVid dataset achieving global accuracy of 89.8 %. A comprehensive comparison with state-of-the-art approaches demonstrates that the…

ODC: Orthogonal Drift Correction for Improved Text-to-Image Semantic Alignment at Inference

Kasra Kamali, Basim Azam, Tuan Duong Trinh +2 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Text-to-image models have achieved remarkable success in generating high-quality images from textual descriptions. However, they often struggle with "semantic drift," where the generated output fails to precisely align with complex or nuanced text prompts. While recent approaches have attempted to address semantic errors regarding attribute binding or object presence, there remains a gap for a more holistic method that addresses these issues by directly refining the text embeddings of the initial user prompt. In this work, we introduce Orthogonal Drift Correction (ODC), an inference-time guidance method designed to mitigate semantic drift without requiring model retraining or additional user inputs. ODC guides image generation through a two-stage process. In the first stage, it identifies the semantic drift by evaluating the initially generated image against the user prompt in a shared…

MEND: Label-Free Detection, Localisation, and Correction of Latent Hallucination in World Models

Ali J Alrasheed, Aryan Yazdan Parast, Basim Azam +2 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

World Models are appearing as the next major frontier in computer vision. However, their robustness is currently largely unexplored. We identify the phenomenon of hallucination in latent World Models: given a state and an action, the predicted next latent can decode to a scene that never occurs. Because the prediction is statistically ordinary and is fed back autoregressively by the model, the error is both silent and compounding. We study whether such latent hallucination can be detected, localised, and corrected at inference time, on a frozen self-supervised world model in the absence of ground-truth error labels. We introduce Masked Empirical-Bayes Neural Denoising (MEND), a single conditional score network trained by denoising score matching on real transitions, whose score field serves three roles: its magnitude detects hallucination, its per-token field localises it to specific…

A novel neuron efficiency metric for enhancing deep neural network pruning

Basim Azam, Brijesh Verma, Ashfaqur Rahman +1 more

Computer Vision and Pattern Recognition · Neural Computing and Applications · · cited 0× · DOI ↗ · more like this ·

Abstract Deep Neural Networks (DNNs) have achieved state-of-the-art performance across various domains, yet their widespread adoption remains constrained by substantial computational and memory demands. While model pruning has emerged as a compelling strategy to address these challenges, existing methods often suffer from critical shortcomings: (1) non-selective neuron pruning which overlooks neuron activation dynamics, leading to the removal of critical neurons; (2) an inability to account for task-specific neuron importance, which causes accuracy degradation; and (3) failure to mitigate redundancy in neuron activations, resulting in suboptimal compression. In this work, we propose a novel Neuron Efficiency Metric (NEM), which integrates three key components—Neuron Activation Rate (NAR), Class-specific Activation Strength (CAS), and Neuron Overlap Index (NOI)—to address these…

Unified graph-based framework for visual explainability in convolutional neural networks

Basim Azam, Pubudu Sanjeewani, Brijesh Verma +2 more

Artificial Intelligence · Information Sciences · · cited 0× · DOI ↗ · more like this ·

In deep learning, understanding the decision-making processes of complex models is essential for advancing interpretability and trust in artificial intelligence systems. We introduce Causal Relational Attribution Graph (C-RAG), designed to deliver comprehensive, multi-perspective explanations of convolutional neural networks (CNNs) via a graph representation. C-RAG integrates gradient-based local attribution with global feature importance by constructing a graph-based representation that captures hierarchical feature inter-dependencies. In this framework, feature clusters are represented as graph nodes, and their interactions are quantified through combined localized and global attribution metrics, ensuring interpretable insights into model behavior. We evaluate C-RAG across diverse benchmark datasets (ImageNet, CIFAR-10, MNIST) and CNN architectures (ResNet18, VGG19, DenseNet201…

DDB: Diffusion Driven Balancing to Address Spurious Correlations

Aryan Yazdan Parast, Basim Azam, Naveed Akhtar

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Deep neural networks trained with Empirical Risk Minimization (ERM) perform well when both training and test data come from the same domain, but they often fail to generalize to out-of-distribution samples. In image classification, these models may rely on spurious correlations that often exist between labels and irrelevant features of images, making predictions unreliable when those features do not exist. We propose a Diffusion Driven Balancing (DDB) technique to generate training samples with text-to-image diffusion models for addressing the spurious correlation problem. First, we compute the best describing token for the visual features pertaining to the causal components of samples by a textual inversion mechanism. Then, leveraging a language segmentation method and a diffusion model, we generate new samples by combining the causal component with the elements from other classes. We…

A Graph-based Context Learning Technique for Image Parsing

Basim Azam, Brijesh Verma

Computer Vision and Pattern Recognition · Griffith Research Online (Griffith University, Queensland, Australia) · · cited 0× · DOI ↗ · more like this ·

The modern deep learning-based architectures have performed well for pixel-wise segmentation tasks. The consideration of context is of vital importance for generation of accurate semantic information. In this research, a deep learning-based image parsing framework is proposed that utilizes novel relation-aware context learning technique. The proposed technique explores the graph constructs from the training data to learn the co-occurring context associations of object category labels using the graph edge connections. The proposed graph-based context learning technique defines the scene specific relation-awareness among semantic object categories, e.g., the probability of sky, road and building to co-exist in a scene is high. The proposed image parsing architecture (including the novel graph-based context learning technique) is evaluated on the benchmark datasets. In addition, a…

Genetic Algorithms for Optimising Context-based Neural Networks for Image Segmentation

Ranju Mandal, Basim Azam, Brijesh Verma +1 more

Computer Vision and Pattern Recognition · 2022 IEEE Symposium Series on Computational Intelligence (SSCI) · · cited 0× · DOI ↗ · more like this ·

Image segmentation is one of the major challenges in real-world computer vision applications. Context-embedded network models proposed for image segmentation have outperformed context-free models. However, optimized values of many parameters need to consider for such a complex network. The manual parameter selection process is ineffective and produces suboptimal performance for such a model. Therefore, we propose a context-based genetically optimized network model for image segmentation in this paper. Genetic algorithms enhance the performance of the deep network model by determining the best parameter values. The proposed three-level deep network is adaptable to image context by extracting visual and context-rich features and optimally integrating them to obtain final pixel labels for scene images. The genetic algorithm ensures optimal parameter values in all three levels to obtain a…

Feature Extractor Based on Class Specific Hidden Neuron Activations for Image Classification

Deepthi Praveenlal Kuttichira, Brijesh Verma, Basim Azam +2 more

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

Extracting good discriminative features plays a significant role in the predictive accuracy of any machine learning model. Engineering good features from raw data is a non-trivial and often a time-consuming task. Models like Convolutional Neural Networks (CNNs) have been very popular in the image classification tasks. This is due to CNN's excellent predictive capabilities and ability to automatically learn good features from raw data. One inherent draw back for CNNs and other deep learning models is that they are black-box models. The predictions made by these models cannot be explained based on features learned by them. In this paper, we put forth a novel feature extractor in which the features are automatically extracted from hidden neurons and convolutional neurons. The predictions made by the model are explained using the visualizations of the activation functions of the class…

Deep Learning Model with GA based Feature Selection and Context Integration

Ranju Mandal, Basim Azam, Brijesh Verma +1 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Deep learning models have been very successful in computer vision and image processing applications. Since its inception, Many top-performing methods for image segmentation are based on deep CNN models. However, deep CNN models fail to integrate global and local context alongside visual features despite having complex multi-layer architectures. We propose a novel three-layered deep learning model that assiminlate or learns independently global and local contextual information alongside visual features. The novelty of the proposed model is that One-vs-All binary class-based learners are introduced to learn Genetic Algorithm (GA) optimized features in the visual layer, followed by the contextual layer that learns global and local contexts of an image, and finally the third layer integrates all the information optimally to obtain the final class label. Stanford Background and CamVid…