arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Rahil Garnavi

18 papers · 2008–2021

2008: 12009: 02010: 02011: 12012: 02013: 02014: 02015: 42016: 02017: 12018: 62019: 22020: 12021: 2
2008peak 6 in 20182021

Frequent co-authors

Papers

showing 1–18 of 18 RSS

Generative OpenMax for Multi-Class Open Set Classification

ZongYuan Ge, Sergey Demyanov, Zetao Chen +1 more

cs.CV · · cited 476× · arXiv ↗ · more like this ·

We present a conceptually new and flexible method for multi-class open set classification. Unlike previous methods where unknown classes are inferred with respect to the feature or decision distance to the known classes, our approach is able to provide explicit modelling and decision score for unknown classes. The proposed method, called Gener- ative OpenMax (G-OpenMax), extends OpenMax by employing generative adversarial networks (GANs) for novel category image synthesis. We validate the proposed method on two datasets of handwritten digits and characters, resulting in superior results over previous deep learning based method OpenMax Moreover, G-OpenMax provides a way to visualize samples representing the unknown classes from open space. Our simple and effective approach could serve as a new direction to tackle the challenging multi-class open set classification problem.

Deformable medical image registration using generative adversarial networks

Dwarikanath Mahapatra, Bhavna Antony, Suman Sedai +1 more

Computer Vision and Pattern Recognition · · cited 164× · DOI ↗ · more like this ·

Conventional approaches to image registration consist of time consuming iterative methods. Most current deep learning (DL) based registration methods extract deep features to use in an iterative setting. We propose an end-to-end DL method for registering multimodal images. Our approach uses generative adversarial networks (GANs) that eliminates the need for time consuming iterative methods, and directly generates the registered image with the deformation field. Appropriate constraints in the GAN cost function produce accurately registered images in less than a second. Experiments demonstrate their accuracy for multimodal retinal and cardiac MR image registration.

A generalized framework for medical image classification and recognition

Mohammadali Abedini, Noel Codella, Jonathan H. Connell +5 more

Artificial Intelligence · IBM Journal of Research and Development · · cited 31× · DOI ↗ · more like this ·

In this work, we study the performance of a two-stage ensemble visual machine learning framework for classification of medical images. In the first stage, models are built for subsets of features and data, and in the second stage, models are combined. We demonstrate the performance of this framework in four contexts: 1) The public ImageCLEF (Cross Language Evaluation Forum) 2013 medical modality recognition benchmark, 2) echocardiography view and mode recognition, 3) dermatology disease recognition across two datasets, and 4) a broad medical image dataset, merged from multiple data sources into a collection of 158 categories covering both general and specific medical concepts—including modalities, body regions, views, and disease states. In the first context, the presented system achieves state-of-art performance of 82.2% multiclass accuracy. In the second context, the system attains…

Automatic Scale Severity Assessment Method in Psoriasis Skin Images Using Local Descriptors

Yasmeen George, M. Aldeen, Rahil Garnavi

Computer Vision and Pattern Recognition · IEEE Journal of Biomedical and Health Informatics · · cited 30× · DOI ↗ · more like this ·

Psoriasis is a chronic skin condition. Its clinical assessment involves four measures: erythema, scales, induration, and area. In this paper, we introduce a scale severity scoring framework for two-dimensional psoriasis skin images. Specifically, we leverage the bag-of-visual words (BoVWs) model for lesion feature extraction using superpixels as key points. BoVWs model is based on building a vocabulary with specific number of words (i.e., codebook size) by using a clustering algorithm with some local features extracted from a constructed set of key points. This is followed by three-class machine learning classifiers for scale scoring using support vector machine (SVM) and random forest. Besides, we examine eight different local color and texture descriptors, namely color histogram, local binary patterns, edge histogram descriptor, color layout descriptor, scalable color descriptor…

Texture Analysis in Lung HRCT Images

Azar Tolouee, Hamid Abrishami-Moghaddam, Rahil Garnavi +2 more

Computer Vision and Pattern Recognition · Espace ÉTS (ETS) · · cited 13× · DOI ↗ · more like this ·

Automatic classification of lung tissue patterns in high resolution computed tomography images of patients with interstitial lung diseases is an important stage in the construction of a computer-aided diagnosis system. To this end, a novel approach is proposed using two sets of overcomplete wavelet filters, namely discrete wavelet frames (DWF) and rotated wavelet frames (RWF), to extract the features which best characterizes the lung tissue patterns. Support vector machines learning algorithm is then applied to perform the pattern classification. Four different lung patterns (ground glass, honey combing, reticular, and normal) selected from a database of 340 images are classified using the proposed method. The overall multiclass accuracy reaches 90.72%, 95.85%, and 96.81% for DWF, RWF, and their combination, respectively. These results prove that RWF is superior to DWF, due to its…

Segmentation of Right Ventricle in Cardiac MR Images Using Shape Regression

Suman Sedai, Pallab Roy, Rahil Garnavi

Computer Vision and Pattern Recognition · Lecture notes in computer science · · cited 7× · DOI ↗ · more like this ·

Accurate and automatic segmentation of the right ventricle is challenging due to its complex anatomy and large shape variation observed between patients. In this paper the ability of shape regression is explored to segment right ventricle in presence of large shape variation among the patients. We propose a robust and efficient cascaded shape regression method which iteratively learns the final shape from a given initial shape. We use gradient boosted regression trees to learn each regressor in the cascade to take the advantage of supervised feature selection mechanism. A novel data augmentation method is proposed to generate synthetic training samples to improve regressors performance. In addition to that, a robust fusion method is proposed to reduce the the variance in the predictions given by different initial shapes, which is a major drawback of cascade regression based methods. The…

Multi-atlas label fusion using hybrid of discriminative and generative classifiers for segmentation of cardiac MR images

Suman Sedai, Rahil Garnavi, Pallab Roy +1 more

Computer Vision and Pattern Recognition · PubMed · · cited 2× · DOI ↗ · more like this ·

Multi-atlas segmentation first registers each atlas image to the target image and transfers the label of atlas image to the coordinate system of the target image. The transferred labels are then combined, using a label fusion algorithm. In this paper, we propose a novel label fusion method which aggregates discriminative learning and generative modeling for segmentation of cardiac MR images. First, a probabilistic Random Forest classifier is trained as a discriminative model to obtain the prior probability of a label at the given voxel of the target image. Then, a probability distribution of image patches is modeled using Gaussian Mixture Model for each label, providing the likelihood of the voxel belonging to the label. The final label posterior is obtained by combining the classification score and the likelihood score under Bayesian rule. Comparative study performed on MICCAI 2013…

Deep Semantic Instance Segmentation of Tree-like Structures Using Synthetic Data

Kerry Halupka, Rahil Garnavi, Stephen Moore

cs.CV · · cited 1× · arXiv ↗ · more like this ·

Tree-like structures, such as blood vessels, often express complexity at very fine scales, requiring high-resolution grids to adequately describe their shape. Such sparse morphology can alternately be represented by locations of centreline points, but learning from this type of data with deep learning is challenging due to it being unordered, and permutation invariant. In this work, we propose a deep neural network that directly consumes unordered points along the centreline of a branching structure, to identify the topology of the represented structure in a single-shot. Key to our approach is the use of a novel multi-task loss function, enabling instance segmentation of arbitrarily complex branching structures. We train the network solely using synthetically generated data, utilizing domain randomization to facilitate the transfer to real 2D and 3D data. Results show that our network…

IBM Research at Image CLEF 2015: Medical Clustering Task.

Suman Sedai, Xi Liang, Mani Abedini +3 more

Computer Vision and Pattern Recognition · CLEF (Working Notes) · · cited 0× · OpenAlex ↗ · more like this ·

In this paper, we present the learning strategies and fea- ture extraction techniques that were applied by the IBM Research Aus- tralia team to the Medical Clustering challenge of ImageCLEF 2015. The challenge is to automatically annotate and categorize X-ray images into head-neck, body, upper-limb, lower-limb and foreign object cate- gories. Our proposed methodology and details of experiments for each submitted run has been discussed in this paper, followed by nal results provided by the competition organizers. The key components used in our submissions are based on sparse coding of SIFT, local binary patterns and multi-scale local binary patterns with spatial pyramid, advanced sher vector, various SVM kernels, and an eective fusion methodol- ogy, to ensure high classication accuracy. Comprehensive experiments demonstrate the eectiveness of the proposed system. Six out of the ten…

Skin Lesion Segmentation Using Color Channel Optimization and Clustering-based Histogram

Rahil Garnavi, Mohammad Aldeen, M. Emre Celebi +3 more

Political Science and International Relations · · cited 0× · OpenAlex ↗ · more like this ·

Abstract—Automatic segmentation of skin lesions is the first step towards the automated analysis of malignant melanoma. Although numerous segmentation methods have been developed, few studies have focused on determining the most effective color space for melanoma application. This paper proposes an automatic segmentation algorithm based on color space analysis and clustering-based histogram thresholding, a process which is able to determine the optimal color channel for detecting the borders in dermoscopy images. The algorithm is tested on a set of 30 high resolution dermoscopy images. A comprehensive evaluation of the results is provided, where borders manually drawn by four dermatologists, are compared to automated borders detected by the proposed algorithm, applying three previously used metrics of accuracy, sensitivity, and specificity and a new metric of similarity. By performing…

Uncertainty guided semi-supervised segmentation of retinal layers in OCT images

Suman Sedai, Bhavna Antony, Ravneet Rai +5 more

cs.CV · · arXiv ↗ · more like this ·

Deep convolutional neural networks have shown outstanding performance in medical image segmentation tasks. The usual problem when training supervised deep learning methods is the lack of labeled data which is time-consuming and costly to obtain. In this paper, we propose a novel uncertainty-guided semi-supervised learning based on a student-teacher approach for training the segmentation network using limited labeled samples and a large number of unlabeled images. First, a teacher segmentation model is trained from the labeled samples using Bayesian deep learning. The trained model is used to generate soft segmentation labels and uncertainty maps for the unlabeled set. The student model is then updated using the softly segmented samples and the corresponding pixel-wise confidence of the segmentation quality estimated from the uncertainty of the teacher model using a newly designed loss…

Analyzing Epistemic and Aleatoric Uncertainty for Drusen Segmentation in Optical Coherence Tomography Images

Tinu Theckel Joy, Suman Sedai, Rahil Garnavi

eess.IV · · arXiv ↗ · more like this ·

Age-related macular degeneration (AMD) is one of the leading causes of permanent vision loss in people aged over 60 years. Accurate segmentation of biomarkers such as drusen that points to the early stages of AMD is crucial in preventing further vision impairment. However, segmenting drusen is extremely challenging due to their varied sizes and appearances, low contrast and noise resemblance. Most existing literature, therefore, have focused on size estimation of drusen using classification, leaving the challenge of accurate segmentation less tackled. Additionally, obtaining the pixel-wise annotations is extremely costly and such labels can often be noisy, suffering from inter-observer and intra-observer variability. Quantification of uncertainty associated with segmentation tasks offers principled measures to inspect the segmentation output. Realizing its utility in identifying…

Dueling Deep Q-Network for Unsupervised Inter-frame Eye Movement Correction in Optical Coherence Tomography Volumes

Yasmeen M. George, Suman Sedai, Bhavna J. Antony +4 more

cs.LG · · arXiv ↗ · more like this ·

In optical coherence tomography (OCT) volumes of retina, the sequential acquisition of the individual slices makes this modality prone to motion artifacts, misalignments between adjacent slices being the most noticeable. Any distortion in OCT volumes can bias structural analysis and influence the outcome of longitudinal studies. On the other hand, presence of speckle noise that is characteristic of this imaging modality, leads to inaccuracies when traditional registration techniques are employed. Also, the lack of a well-defined ground truth makes supervised deep-learning techniques ill-posed to tackle the problem. In this paper, we tackle these issues by using deep reinforcement learning to correct inter-frame movements in an unsupervised manner. Specifically, we use dueling deep Q-network to train an artificial agent to find the optimal policy, i.e. a sequence of actions, that best…

Inference of visual field test performance from OCT volumes using deep learning

Stefan Maetschke, Bhavna Antony, Hiroshi Ishikawa +3 more

cs.CV · · arXiv ↗ · more like this ·

Visual field tests (VFT) are pivotal for glaucoma diagnosis and conducted regularly to monitor disease progression. Here we address the question to what degree aggregate VFT measurements such as Visual Field Index (VFI) and Mean Deviation (MD) can be inferred from Optical Coherence Tomography (OCT) scans of the Optic Nerve Head (ONH) or the macula. Accurate inference of VFT measurements from OCT could reduce examination time and cost. We propose a novel 3D Convolutional Neural Network (CNN) for this task and compare its accuracy with classical machine learning (ML) algorithms trained on common, segmentation-based OCT, features employed for glaucoma diagnostics. Peak accuracies were achieved on ONH scans when inferring VFI with a Pearson Correlation (PC) of 0.88$\pm$0.035 for the CNN and a significantly lower (p $<$ 0.01) PC of 0.74$\pm$0.090 for the best performing, classical ML…

Joint Segmentation and Uncertainty Visualization of Retinal Layers in Optical Coherence Tomography Images using Bayesian Deep Learning

Suman Sedai, Bhavna Antony, Dwarikanath Mahapatra +1 more

cs.CV · · arXiv ↗ · more like this ·

Optical coherence tomography (OCT) is commonly used to analyze retinal layers for assessment of ocular diseases. In this paper, we propose a method for retinal layer segmentation and quantification of uncertainty based on Bayesian deep learning. Our method not only performs end-to-end segmentation of retinal layers, but also gives the pixel wise uncertainty measure of the segmentation output. The generated uncertainty map can be used to identify erroneously segmented image regions which is useful in downstream analysis. We have validated our method on a dataset of 1487 images obtained from 15 subjects (OCT volumes) and compared it against the state-of-the-art segmentation algorithms that does not take uncertainty into account. The proposed uncertainty based segmentation method results in comparable or improved performance, and most importantly is more robust against noise.

Deep multiscale convolutional feature learning for weakly supervised localization of chest pathologies in X-ray images

Suman Sedai, Dwarikanath Mahapatra, Zongyuan Ge +2 more

cs.CV · · arXiv ↗ · more like this ·

Localization of chest pathologies in chest X-ray images is a challenging task because of their varying sizes and appearances. We propose a novel weakly supervised method to localize chest pathologies using class aware deep multiscale feature learning. Our method leverages intermediate feature maps from CNN layers at different stages of a deep network during the training of a classification model using image level annotations of pathologies. During the training phase, a set of \emph{layer relevance weights} are learned for each pathology class and the CNN is optimized to perform pathology classification by convex combination of feature maps from both shallow and deep layers using the learned weights. During the test phase, to localize the predicted pathology, the multiscale attention map is obtained by convex combination of class activation maps from each stage using the \emph{layer…

Chest X-rays Classification: A Multi-Label and Fine-Grained Problem

Zongyuan Ge, Dwarikanath Mahapatra, Suman Sedai +2 more

cs.CV · · arXiv ↗ · more like this ·

The widely used ChestX-ray14 dataset addresses an important medical image classification problem and has the following caveats: 1) many lung pathologies are visually similar, 2) a variant of diseases including lung cancer, tuberculosis, and pneumonia are present in a single scan, i.e. multiple labels and 3) The incidence of healthy images is much larger than diseased samples, creating imbalanced data. These properties are common in medical domain. Existing literature uses stateof- the-art DensetNet/Resnet models being transfer learned where output neurons of the networks are trained for individual diseases to cater for multiple diseases labels in each image. However, most of them don't consider relationship between multiple classes. In this work we have proposed a novel error function, Multi-label Softmax Loss (MSML), to specifically address the properties of multiple labels and…

A feature agnostic approach for glaucoma detection in OCT volumes

Stefan Maetschke, Bhavna Antony, Hiroshi Ishikawa +3 more

cs.CV · · arXiv ↗ · more like this ·

Optical coherence tomography (OCT) based measurements of retinal layer thickness, such as the retinal nerve fibre layer (RNFL) and the ganglion cell with inner plexiform layer (GCIPL) are commonly used for the diagnosis and monitoring of glaucoma. Previously, machine learning techniques have utilized segmentation-based imaging features such as the peripapillary RNFL thickness and the cup-to-disc ratio. Here, we propose a deep learning technique that classifies eyes as healthy or glaucomatous directly from raw, unsegmented OCT volumes of the optic nerve head (ONH) using a 3D Convolutional Neural Network (CNN). We compared the accuracy of this technique with various feature-based machine learning algorithms and demonstrated the superiority of the proposed deep learning based method. Logistic regression was found to be the best performing classical machine learning technique with an AUC of…