arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Nilanjan Ray

163 papers · 2000–2026

2000: 12001: 12002: 22003: 12004: 12005: 42006: 02007: 22008: 52009: 22010: 22011: 62012: 32013: 52014: 102015: 42016: 142017: 102018: 52019: 52020: 82021: 112022: 152023: 132024: 92025: 132026: 10
2000peak 15 in 20222026

Frequent co-authors

Papers

showing 1–25 of 163 RSS

Small-Object Detection in Remote Sensing Images with End-to-End Edge-Enhanced GAN and Object Detector Network

Jakaria Rabbi, Nilanjan Ray, Matthias Schubert +2 more

cs.CV · · cited 307× · arXiv ↗ · more like this ·

The detection performance of small objects in remote sensing images is not satisfactory compared to large objects, especially in low-resolution and noisy images. A generative adversarial network (GAN)-based model called enhanced super-resolution GAN (ESRGAN) shows remarkable image enhancement performance, but reconstructed images miss high-frequency edge information. Therefore, object detection performance degrades for small objects on recovered noisy and low-resolution remote sensing images. Inspired by the success of edge enhanced GAN (EEGAN) and ESRGAN, we apply a new edge-enhanced super-resolution GAN (EESRGAN) to improve the image quality of remote sensing images and use different detector networks in an end-to-end manner where detector loss is backpropagated into the EESRGAN to improve the detection performance. We propose an architecture with three components: ESRGAN, Edge…

Real-Time Identification of Dynamic Events in Power Systems Using PMU Data, and Potential Applications—Models, Promises, and Challenges

Sukumar Brahma, Rajesh Kavasseri, Huiping Cao +3 more

Artificial Intelligence · IEEE Transactions on Power Delivery · · cited 169× · DOI ↗ · more like this ·

This paper explores the task of real-time identification of dynamic events leading to a layer of situational awareness that can become a reality due to increased penetration of phasor measurement units in transmission systems. Two underlying models for this task-data driven and physics based-are explored with examples. Challenges, advantages, and drawbacks of each model are discussed based on the availability of data, attributes of such data, and processing options. Potential applications of the task to improve security of power system protection and anomaly detection in the case of a cyberattack are conceptualized. Some known issues in data communications are discussed vis-a-vis the requirements imposed by the proposed task.

Convolutional Gated Recurrent Networks for Video Segmentation

Mennatullah Siam, Sepehr Valipour, Martin Jagersand +1 more

cs.CV · · cited 111× · arXiv ↗ · more like this ·

Semantic segmentation has recently witnessed major progress, where fully convolutional neural networks have shown to perform well. However, most of the previous work focused on improving single image segmentation. To our knowledge, no prior work has made use of temporal video information in a recurrent network. In this paper, we introduce a novel approach to implicitly utilize temporal data in videos for online semantic segmentation. The method relies on a fully convolutional network that is embedded into a gated recurrent architecture. This design receives a sequence of consecutive video frames and outputs the segmentation of the last frame. Convolutional gated recurrent networks are used for the recurrent part to preserve spatial connectivities in the image. Our proposed method can be applied in both online and batch segmentation. This architecture is tested for both binary and…

Fast Large-Scale Spectral Clustering via Explicit Feature Mapping

Li He, Nilanjan Ray, Yisheng Guan +1 more

Computer Vision and Pattern Recognition · IEEE Transactions on Cybernetics · · cited 104× · DOI ↗ · more like this ·

We propose an efficient spectral clustering method for large-scale data. The main idea in our method consists of employing random Fourier features to explicitly represent data in kernel space. The complexity of spectral clustering thus is shown lower than existing Nyström approximations on largescale data. With m training points from a total of n data points, Nyström method requires O(nmd + m <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</sup> + nm <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> ) operations, where d is the input dimension. In contrast, our proposed method requires O(nDd + D <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</sup> + n'D <sup xmlns:mml="http://www.w3.org/1998/Math/MathML"…

Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction

Sara Elkerdawy, Mostafa Elhoushi, Hong Zhang +1 more

cs.CV · · cited 62× · arXiv ↗ · more like this ·

Dynamic model pruning is a recent direction that allows for the inference of a different sub-network for each input sample during deployment. However, current dynamic methods rely on learning a continuous channel gating through regularization by inducing sparsity loss. This formulation introduces complexity in balancing different losses (e.g task loss, regularization loss). In addition, regularization based methods lack transparent tradeoff hyperparameter selection to realize a computational budget. Our contribution is two-fold: 1) decoupled task and pruning losses. 2) Simple hyperparameter selection that enables FLOPs reduction estimation before training. Inspired by the Hebbian theory in Neuroscience: "neurons that fire together wire together", we propose to predict a mask to process k filters in a layer based on the activation of its previous layer. We pose the problem as a…

Object Classification with Joint Projection and Low-rank Dictionary Learning

Homa Foroughi, Nilanjan Ray, Hong Zhang

cs.CV · · cited 39× · arXiv ↗ · more like this ·

For an object classification system, the most critical obstacles towards real-world applications are often caused by large intra-class variability, arising from different lightings, occlusion and corruption, in limited sample sets. Most methods in the literature would fail when the training samples are heavily occluded, corrupted or have significant illumination or viewpoint variations. Besides, most of the existing methods and especially deep learning-based methods, need large training sets to achieve a satisfactory recognition performance. Although using the pre-trained network on a generic large-scale dataset and fine-tune it to the small-sized target dataset is a widely used technique, this would not help when the content of base and target datasets are very different. To address these issues, we propose a joint projection and low-rank dictionary learning method using dual graph…

Anovel framework for automatic passenger counting

Satarupa Mukherjee, BaidyaNath Saha, Iqbal Jamal +2 more

Computer Vision and Pattern Recognition · · cited 38× · DOI ↗ · more like this ·

We propose a novel framework for counting passengers in a railway station. The framework has three components: people detection, tracking and validation. We detect every person using Hough circle when he or she enters the field of view. The person is then tracked using optical flow until (s)he leaves the field of view. Finally, the tracker generated trajectory is validated through a spatiotemporal background subtraction technique. The number of valid trajectories provides passenger count. Each of the three components of the proposed framework has been compared with competitive methods on three datasets of varying crowd densities. Extensive experiments have been conducted on the datasets having top views of the passengers. Experimental results demonstrate that the proposed algorithmic framework performs well both on dense and sparse crowds and it can successfully detect and track persons…

Edge Sensitive Variational Image Thresholding

Nilanjan Ray, Baidya Nath Saha

Computer Vision and Pattern Recognition · · cited 33× · DOI ↗ · more like this ·

In this paper we propose a locally adaptive image threshold technique via variational energy minimization. The novelty of the proposed method is that from an image it automatically computes the weights on the data fidelity and the regularization terms in the energy functional, unlike many other previously proposed variational formulations that require manual input of these weights by laborious trial and error. To achieve the automatic setting of the weighting parameters we propose a non-linear convex combination of the data fidelity and the regularization terms in the energy functional and seek the optimum threshold surface via minimax principle. Our choice of the novel energy functional allows fast computation of the unique minimax solution. As a specific segmentation application, the proposed technique shows promising results when applied to find lung boundary from MR imagery.…

Locating Brain Tumors from MR Imagery Using Symmetry

Nilanjan Ray, Baidya Nath Saha, Matthew Brown

Computer Vision and Pattern Recognition · Conference record/Conference record - Asilomar Conference on Signals, Systems, & Computers · · cited 30× · DOI ↗ · more like this ·

Tumor/abnormality segmentation from magnetic resonance imagery (MRI) can play a significant role in cancer research and clinical practice. Although accurate tumor segmentation by radiologists is ideal, it is extremely tedious. Experience shows that for MRI database indexing purposes approximate segmentations can be adequate. In this paper, we propose a straightforward, real-time technique to find a bounding box around the brain abnormality in an MR image. Our algorithm exploits left-to-right symmetry of the brain structure. The proposed detection algorithm can play a useful role in indexing and storage of bulk MRI data, as well as provide an initial step or seed to assist algorithms designed to find accurate tumor boundaries.

DRMIME: Differentiable Mutual Information and Matrix Exponential for Multi-Resolution Image Registration

Abhishek Nan, Matthew Tennant, Uriel Rubin +1 more

cs.CV · · cited 27× · arXiv ↗ · more like this ·

In this work, we present a novel unsupervised image registration algorithm. It is differentiable end-to-end and can be used for both multi-modal and mono-modal registration. This is done using mutual information (MI) as a metric. The novelty here is that rather than using traditional ways of approximating MI, we use a neural estimator called MINE and supplement it with matrix exponential for transformation matrix computation. This leads to improved results as compared to the standard algorithms available out-of-the-box in state-of-the-art image registration toolboxes.

Lightweight Monocular Depth Estimation Model by Joint End-to-End Filter pruning

Sara Elkerdawy, Hong Zhang, Nilanjan Ray

cs.CV · · cited 23× · arXiv ↗ · more like this ·

Convolutional neural networks (CNNs) have emerged as the state-of-the-art in multiple vision tasks including depth estimation. However, memory and computing power requirements remain as challenges to be tackled in these models. Monocular depth estimation has significant use in robotics and virtual reality that requires deployment on low-end devices. Training a small model from scratch results in a significant drop in accuracy and it does not benefit from pre-trained large models. Motivated by the literature of model pruning, we propose a lightweight monocular depth model obtained from a large trained model. This is achieved by removing the least important features with a novel joint end-to-end filter pruning. We propose to learn a binary mask for each filter to decide whether to drop the filter or not. These masks are trained jointly to exploit relations between filters at different…

Online Robust PCA for Malicious Attack-Resilience in Wide-Area Mode Metering Application

Kaveri Mahapatra, Nilanjan Ray Chaudhuri

Signal Processing · IEEE Transactions on Power Systems · · cited 23× · DOI ↗ · more like this ·

This paper presents a method for detecting and correcting malicious data corruptions in phasor measurement unit (PMU) measurements. Detection of malicious injections is formulated as a compressed sensing problem and the actual signals are recovered using an online robust principal component analysis-based algorithm. Different patterns of malicious injection attacks on PMU data are considered and the effect of corruption and reconstruction using the algorithm is analyzed on a wide-area mode metering application. The performance of the proposed algorithm has been evaluated with different subspace selection. A suitable threshold for the algorithm is selected by a graphical analysis of the receiver operating characteristics curve. Data from a 16-machine, 5-area New England-New York system is used along with a recursive modal estimation algorithm to validate the effectiveness of the proposed…

Layer Importance Estimation with Imprinting for Neural Network Quantization

Hongyang Liu, Sara Elkerdawy, Nilanjan Ray +1 more

Computer Vision and Pattern Recognition · · cited 21× · DOI ↗ · more like this ·

Neural network quantization has achieved a high compression rate using fixed low bit-width representation of weights and activations while maintaining the accuracy of the high-precision original network. However, mixed precision (per-layer bit-width precision) quantization requires careful tuning to maintain accuracy while achieving further compression and higher granularity than fixed-precision quantization. We propose an accuracy-aware criterion to quantify the layer’s importance rank. Our method applies imprinting per layer which acts as a proxy module for accuracy estimation in an efficient way. We rank the layers based on the accuracy gain from previous modules and iteratively quantize first those with less accuracy gain. Previous mixed-precision methods either rely on expensive search techniques such as reinforcement learning (RL) or end-to-end optimization with a lack of…

Texture based background subtraction

Dongxiang Zhou, Hong Zhang, Nilanjan Ray

Computer Vision and Pattern Recognition · · cited 21× · DOI ↗ · more like this ·

Background subtraction is an effective technique for motion detection. A traditional background subtraction algorithm assumes a moving object (or objects) with respect to a static background, and segments the moving object(s) by classifying pixels into foreground and background with trained statistical models. Because classical background subtraction algorithms work with intensity images, they cannot handle situations in which all pixels are moving. To address this deficiency, we present a novel background subtraction algorithm in this paper that is capable of detecting objects of interest while all pixels are in motion. The key idea behind our algorithm is to work with feature images, rather than the raw intensity images, in which foreground and background exhibit sufficiently different statistics. We in particular use texture as the feature, extracted with circular Gabor filters at…

Automatic blood cell classification based on joint histogram based feature and bhattacharya kernel

Sharmin Nilufar, Nilanjan Ray, Hong Zhang

Computer Vision and Pattern Recognition · · cited 18× · DOI ↗ · more like this ·

We propose a blood cell classification method with the aim of designing an automatic differential blood count system, which can help cancer diagnosis. The proposed system contains two automated steps: an active contour-based segmentation of blood cells from microscopy images and their classification. For classification we investigate several joint histogram-based features extracted from the segmented blood cells. We use support vector machine with a proposed kernel based on the Bhattacharya coefficient of joint histograms. Experimental results show the effectiveness of our system. Furthermore, comparative study illustrates that the proposed system outperforms other existing classification approaches in terms of classification accuracy.

Data Acceptance for Automated Leukocyte Tracking Through Segmentation of Spatiotemporal Images

Nilanjan Ray, Scott T. Acton

Computer Vision and Pattern Recognition · IEEE Transactions on Biomedical Engineering · · cited 18× · DOI ↗ · more like this ·

A crucial task in inflammation research and inflammatory drug validation is leukocyte velocity data collection from microscopic video imagery. Since manual methods are bias-prone and extremely time consuming, automated tracking methods are required to compute cell velocities. However, an automated tracking method is of little practical use unless it is accompanied by a mechanism to validate the tracker output. In this paper, we propose a validation technique that accepts or rejects the output of automated tracking methods. The proposed method first generates a spatiotemporal image from the cell locations given by a tracking method; then, it segments the spatiotemporal image to detect the presence or absence of a leukocyte. For segmenting the spatiotemporal images, we employ an edge-direction sensitive nonlinear filter followed by an active contour based technique. The proposed nonlinear…

Artificial Intelligence in Adaptive Education

Sulagna Das, Indranil Mutsuddi, Nilanjan Ray

Computer Science Applications · Advances in educational technologies and instructional design book series · · cited 17× · DOI ↗ · more like this ·

Integrating artificial intelligence (AI) in higher education has revolutionized how institutions design and enhance learning systems. Higher education institutions (HEIs) increasingly leverage adaptive learning techniques to create dynamic and personalized educational environments. These methods use teaching and learning data to tailor educational experiences to meet each student's unique needs and capabilities. AI-driven applications are at the core of this transformation, offering significant advantages such as improved learning experiences, flexible scheduling, immediate feedback, personalized educational management, and accelerated student progress. This chapter examines the multifaceted dimensions of adaptive learning within the education system, emphasizing the pivotal role of AI-driven technologies in enabling and advancing this innovative approach.

Cell Tracking in Video Microscopy Using Bipartite Graph Matching

Ananda S. Chowdhury, Rohit Kamal Chatterjee, Mayukh Ghosh +1 more

Computer Vision and Pattern Recognition · · cited 16× · DOI ↗ · more like this ·

Automated visual tracking of cells from video microscopy has many important biomedical applications. In this paper, we model the problem of cell tracking over pairs of video microscopy image frames as a minimum weight matching problem in bipartite graphs. The bipartite matching essentially establishes one-to-one correspondences between the cells in different frames. A key advantage of using bipartite matching is the inherent scalability, which arises from its polynomial time-complexity. We propose two different tracking methods based on bipartite graph matching and properties of Gaussian distributions. In both the methods, i) the centers of the cells appearing in two frames are treated as vertices of a bipartite graph and ii) the weight matrix contains information about distance between the cells (in two frames) and cell velocity. In the first method, we identify fast-moving cells based…

Convolutional gated recurrent networks for video semantic segmentation in automated driving

Mennatullah Siam, Sepehr Valipour, Martin Jägersand +2 more

Computer Vision and Pattern Recognition · · cited 15× · DOI ↗ · more like this ·

Semantic segmentation is an important visual perception module of automated driving. Most of the progress has been focused on single-frame image segmentation with an optional temporal post-processing. In this paper, we propose a novel algorithm to utilize the temporal information in the semantic segmentation model using convolutional gated recurrent networks. The main motivation is to design a spatio-temporal network which can leverage motion cues for aiding segmentation and providing temporally consistent results. The proposed algorithm makes use of a fully convolutional network (FCN) that is embedded into a gated recurrent architecture. We use FCN because of its simplicity and ease of extension and the embedding can extend to other architectures. We also chose an FCN model with reasonable computational complexity suitable for real-time applications. Experimental results show…

Clump splitting via bottleneck detection

Hui Wang, Hong Zhang, Nilanjan Ray

Computer Vision and Pattern Recognition · · cited 15× · DOI ↗ · more like this ·

Under-segmentation of an image with multiple objects is a common problem in image segmentation algorithms. This paper presents a novel approach for the splitting of clumps formed by multiple objects due to under-segmentation. The algorithm includes two steps: finding a pair of points for clump splitting, and joining the pair of selected points. In the first step, a pair of points for splitting is detected using a bottleneck rule, under the assumption that the desired objects have roughly convex shape. In the second step, the selected pair of splitting points is joined by finding the optimal splitting line between them, based on minimizing an image energy. The performance of this method is evaluated using images from various applications. Experimental results show that the proposed approach has several advantages over existing splitting methods in identifying points for splitting as well…

Inclusion filters: a class of self-dual connected operators

Nilanjan Ray, Scott T. Acton

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · · cited 15× · DOI ↗ · more like this ·

In this paper, we define a connected operator that either fills or retains the holes of the connected sets depending on application-specific criteria that are increasing in the set theoretic sense. We refer to this class of connected operators as inclusion filters, which are shown to be increasing, idempotent, and self dual (gray-level inversion invariance). We demonstrate self duality for 8-adjacency on a discrete Cartesian grid. Inclusion filters are defined first for binary-valued images, and then the definition is extended to grayscale imagery. It is also shown that inclusion filters are levelings, a larger class of connected operators. Several important applications of inclusion filters are demonstrated-automatic segmentation of the lung cavities from magnetic resonance imagery, user interactive shape delineation in content-based image retrieval, registration of intravital…

Deep Learning Based Parameterization of Diffeomorphic Image Registration for Cardiac Image Segmentation

Ameneh Sheikhjafari, Deepa Krishnaswamy, Michelle Noga +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on NanoBioscience · · cited 14× · DOI ↗ · more like this ·

Cardiac segmentation from magnetic resonance imaging (MRI) is one of the essential tasks in analyzing the anatomy and function of the heart for the assessment and diagnosis of cardiac diseases. However, cardiac MRI generates hundreds of images per scan, and manual annotation of them is challenging and time-consuming, and therefore processing these images automatically is of interest. This study proposes a novel end-to-end supervised cardiac MRI segmentation framework based on a diffeomorphic deformable registration that can segment cardiac chambers from 2D and 3D images or volumes. To represent actual cardiac deformation, the method parameterizes the transformation using radial and rotational components computed via deep learning, with a set of paired images and segmentation masks used for training. The formulation guarantees transformations that are invertible and prevents mesh…

Spectrogram based features selection using multiple kernel learning for speech/music discrimination

Sharmin Nilufar, Nilanjan Ray, Md. Khademul Islam Molla +1 more

Signal Processing · · cited 14× · DOI ↗ · more like this ·

This paper presents a multiple kernel learning (MKL) approach to speech/music discrimination (SMD). The time-frequency representation (spectrogram) implemented by short-time Fourier transform (STFT) of audio segment is decomposed by wavelet packet transform into different subband levels. The subbands, which contain rich texture information, are used as features for this discrimination problem. MKL technique is used to select the optimal subbands to discriminate the audio signals. The proposed MKL based algorithm is applied for SMD of a standard dataset. The experimental results show that the proposed technique yields noticeable improvements in classification accuracy and tolerance toward different noise types compared to the existing methods.

One-Shot Layer-Wise Accuracy Approximation For Layer Pruning

Sara Elkerdawy, Mostafa Elhoushi, Abhineet Singh +2 more

Computer Vision and Pattern Recognition · · cited 13× · DOI ↗ · more like this ·

Recent advances in neural networks pruning have made it possible to remove a large number of filters without any perceptible drop in accuracy. However, the gain in speed depends on the number of filters per layer. In this paper, we propose a one-shot layer-wise proxy classifier to estimate layer importance that in turn allows us to prune a whole layer. In contrast to existing filter pruning methods which attempt to reduce the layer width of a dense model, our method reduces its depth and can thus guarantee inference speed up. In our proposed method, we first go through the training data once to construct proxy classifiers for each layer using imprinting. Next, we prune layers with smallest accuracy difference from their preceding layer till a latency budget is achieved. Finally, we fine-tune the newly pruned model to improve accuracy. Experimental results showed 43.70% latency reduction…

A Structured Deep-Learning Based Approach for the Automated Segmentation of Human Leg Muscle from 3D MRI

Shrimanti Ghosh, Nilanjan Ray, Pierre Boulanger

Computer Vision and Pattern Recognition · · cited 13× · DOI ↗ · more like this ·

In this paper, we present an automated algorithm for segmenting human leg muscles from 3D MRI data using deep convolutional neural network (CNN). Using a generalized cylinder model the human leg muscle can be represented by two smooth 2D parametric images representing the contour of the muscle in the MRI image. The proposed CNN algorithm can predict these two parametrized images from raw 3D voxels. We use a pre-trained AlexNet as our baseline and further fine-tune the network that is suitable for this problem. In this scheme, AlexNet predicts a compressed vector obtained by applying principal component analysis, which is then back-projected into two parametric 2D images representing the leg muscle contours. We show that the proposed CNN with a structured regression model can out-perform conventional model-based segmentation approach such as the Active Appearance Model (AAM). The average…