arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Jayant Kumar

87 papers · 1987–2026

1987: 21988: 01989: 01990: 01991: 01992: 01993: 01994: 01995: 01996: 01997: 01998: 01999: 02000: 02001: 02002: 02003: 12004: 12005: 12006: 02007: 22008: 12009: 12010: 32011: 32012: 12013: 72014: 52015: 62016: 52017: 32018: 02019: 62020: 02021: 52022: 52023: 62024: 102025: 72026: 6
1987peak 10 in 20242026

Frequent co-authors

Papers

showing 1–25 of 87 RSS

Convolutional Neural Networks for Document Image Classification

Le Kang, Jayant Kumar, Peng Ye +2 more

Computer Vision and Pattern Recognition · · cited 176× · DOI ↗ · more like this ·

This paper presents a Convolutional Neural Network (CNN) for document image classification. In particular, document image classes are defined by the structural similarity. Previous approaches rely on hand-crafted features for capturing structural information. In contrast, we propose to learn features from raw image pixels using CNN. The use of CNN is motivated by the the hierarchical nature of document layout. Equipped with rectified linear units and trained with dropout, our CNN performs well even when document layouts present large inner-class variations. Experiments on public challenging datasets demonstrate the effectiveness of the proposed approach.

Beyond Human Opinion Scores: Blind Image Quality Assessment Based on Synthetic Scores

Peng Ye, Jayant Kumar, David Doermann

Computer Vision and Pattern Recognition · · cited 89× · DOI ↗ · more like this ·

State-of-the-art general purpose Blind Image Quality Assessment (BIQA) models rely on examples of distorted images and corresponding human opinion scores to learn a regression function that maps image features to a quality score. These types of models are considered "opinion-aware" (OA) BIQA models. A large set of human scored training examples is usually required to train a reliable OA-BIQA model. However, obtaining human opinion scores through subjective testing is often expensive and time-consuming. It is therefore desirable to develop "opinion-free" (OF) BIQA models that do not require human opinion scores for training. This paper proposes BLISS (Blind Learning of Image Quality using Synthetic Scores). BLISS is a simple, yet effective method for extending OA-BIQA models to OF-BIQA models. Instead of training on human opinion scores, we propose to train BIQA models on synthetic…

Deep Temporal Multimodal Fusion for Medical Procedure Monitoring Using Wearable Sensors

Edgar A. Bernal, Xitong Yang, Qun Li +4 more

Computer Vision and Pattern Recognition · IEEE Transactions on Multimedia · · cited 74× · DOI ↗ · more like this ·

Process monitoring and verification have a wide range of uses in the medical and healthcare fields. Currently, such tasks are often carried out by a trained specialist, which makes them expensive, inefficient, and time-consuming. Recent advances in automated video- and multimodal-data-based action and activity recognition have made it possible to reduce the extent of manual intervention required to effectively carry out process supervision tasks. In this paper, we propose algorithms for automated egocentric human action and activity recognition from multimodal data, with a target application of monitoring and assisting a user perform a multistep medical procedure. We propose a supervised deep multimodal fusion framework that relies on concurrent processing of motion data acquired with wearable sensors and video data acquired with an egocentric or body-mounted camera. We demonstrate the…

Real-Time No-Reference Image Quality Assessment Based on Filter Learning

Peng Ye, Jayant Kumar, Le Kang +1 more

Computer Vision and Pattern Recognition · · cited 69× · DOI ↗ · more like this ·

This paper addresses the problem of general-purpose No-Reference Image Quality Assessment (NR-IQA) with the goal of developing a real-time, cross-domain model that can predict the quality of distorted images without prior knowledge of non-distorted reference images and types of distortions present in these images. The contributions of our work are two-fold: first, the proposed method is highly efficient. NR-IQA measures are often used in real-time imaging or communication systems, therefore it is important to have a fast NR-IQA algorithm that can be used in these real-time applications. Second, the proposed method has the potential to be used in multiple image domains. Previous work on NR-IQA focus primarily on predicting quality of natural scene image with respect to human perception, yet, in other image domains, the final receiver of a digital image may not be a human. The proposed…

Handwritten Arabic text line segmentation using affinity propagation

Jayant Kumar, Wael AbdAlmageed, Le Kang +1 more

Computer Vision and Pattern Recognition · · cited 63× · DOI ↗ · more like this ·

In this paper, we present a novel graph-based method for extracting handwritten text lines in monochromatic Arabic document images. Our approach consists of two steps - Coarse text line estimation using primary components which define the line and assignment of diacritic components which are more difficult to associate with a given line. We first estimate local orientation at each primary component to build a sparse similarity graph. We then, use a shortest path algorithm to compute similarities between non-neighboring components. From this graph, we obtain coarse text lines using two estimates obtained from Affinity propagation and Breadth-first search. In the second step, we assign secondary components to each text line. The proposed method is very fast and robust to non-uniform skew and character size variations, normally present in handwritten text lines. We evaluate our method…

Learning Document Structure for Retrieval and Classification

Jayant Kumar, Peng Ye, David Doermann

Computer Vision and Pattern Recognition · · cited 45× · OpenAlex ↗ · more like this ·

In this paper, we present a method for the retrieval of document images with chosen layout characteristics. The proposed method is based on statistics of patchcodewords over different regions of image. We begin with a set of wanted and a random set of unwanted images representative of a large heterogeneous collection. We then use raw-image patches extracted from the unlabeled images to learn a codebook. To model the spatial relationships between patches, the image is recursively partitioned horizontally and vertically, and a histogram of patch-codewords is computed in each partition. The resulting set of features give a high precision and recall for the retrieval of hand-drawn and machine-print table-documents, and unconstrained mixed form-type documents, when trained using a random forest classifier. We compare our method to the spatial-pyramid method, and show that the proposed…

Fog Computing-Integrated ML-Based Framework and Solutions for Intelligent Systems

R. Pitchai, K. Venkatesh Guru, Jayneel Gandhi +3 more

Computer Networks and Communications · Advances in systems analysis, software engineering, and high performance computing book series · · cited 40× · DOI ↗ · more like this ·

The integration of fog computing and machine learning (ML) in digital healthcare has revolutionized patient care, operations, and personalized treatment. This chapter explores the potential of fog computing in telemedicine, remote monitoring, and personalized treatment. It highlights its role in addressing data processing challenges, enabling real-time data analytics, and ensuring secure transmission of medical information. Key case studies demonstrate how these integrated solutions are driving innovation in the healthcare industry. The combination of fog computing and ML offers a promising avenue for the future of digital healthcare, focusing on data-driven decision-making and precision medicine.

Segmentation of Handwritten Textlines in Presence of Touching Components

Jayant Kumar, Le Kang, David Doermann +1 more

Computer Vision and Pattern Recognition · · cited 39× · DOI ↗ · more like this ·

This paper presents an approach to text line extraction in handwritten document images which combines local and global techniques. We propose a graph-based technique to detect touching and proximity errors that are common with handwritten text lines. In a refinement step, we use Expectation-Maximization (EM) to iteratively split the error segments to obtain correct text-lines. We show improvement in accuracies using our correction method on datasets of Arabic document images. Results on a set of artificially generated proximity images show that the method is effective for handling touching errors in handwritten document images.

Unsupervised Classification of Structurally Similar Document Images

Jayant Kumar, David Doermann

Computer Vision and Pattern Recognition · · cited 36× · DOI ↗ · more like this ·

In this paper, we present a learning based approach for computing structural similarities among document images for unsupervised exploration in large document collections. The approach is based on multiple levels of content and structure. At a local level, a bag-of-visual words based on SURF features provides an effective way of computing content similarity. The document is then recursively partitioned and a histogram of codewords is computed for each partition. Structural similarity is computed using a random forest classifier trained with these histogram features. We experiment with three diverse datasets of document images varying in size, degree of structural similarity, and types of document images. Our results demonstrate that the proposed approach provides an effective general framework for grouping structurally similar document images.

Line Removal and Restoration of Handwritten Strokes

K Arvind, Jayant Kumar, A. G. Ramakrishnan

Computer Vision and Pattern Recognition · NOT FOUND REPOSITORY (Indian Institute of Science Bangalore) · · cited 27× · DOI ↗ · more like this ·

In document images, we often find printed lines over-lapping with hand written elements especially in case of signatures. Typical examples of such images are bank cheques and payment slips. Although the detection and removal of the horizontal lines has been addressed, the restoration of the handwritten area after removal of lines, persists to be a problem of interest. In this paper, we propose a method for line removal and restoration of the erased areas of the handwritten elements. Subjective evaluation of the results have been conducted to analyze the effectiveness of the proposed method. The results are promising with an accuracy of 86.33%. The entire process takes less than half a second for completion on a 2.4 GHz 512 MB RAM Pentium IV PC for a document image.

Text detection in scene images using stroke width and nearest-neighbor constraints

Apurva Kumar Srivastav, Jayant Kumar

Computer Vision and Pattern Recognition · · cited 23× · DOI ↗ · more like this ·

Text in scene images can provide very useful as well as vital information and hence, its detection and recognition is an important task. We propose an adaptive edge-based connected-component method for text-detection in natural scene images. The approach is based on three reasonable assumptions - (i) characters of a particular word are locally aligned in a certain direction (ii) each character is of uniform color ( iii) stroke width is almost constant for most of the characters in a particular word. We apply color quantization and use the luminance to obtain the intensity values. An improved edge-detection technique that performs adaptive thresholding is used to capture all possible text components with some non-text components initially. Then, we remove obvious non-text component based on a few heuristics. Further, we classify those components as text for which we successfully obtain…

Shape codebook based handwritten and machine printed text zone extraction

Jayant Kumar, Rohit Prasad, Huiagu Cao +3 more

Computer Vision and Pattern Recognition · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 21× · DOI ↗ · more like this ·

In this paper, we present a novel method for extracting handwritten and printed text zones from noisy document images with mixed content. We use Triple-Adjacent-Segment (TAS) based features which encode local shape characteristics of text in a consistent manner. We first construct two codebooks of the shape features extracted from a set of handwritten and printed text documents respectively. We then compute the normalized histogram of codewords for each segmented zone and use it to train a Support Vector Machine (SVM) classifier. The codebook based approach is robust to the background noise present in the image and TAS features are invariant to translation, scale and rotation of text. In experiments, we show that a pixel-weighted zone classification accuracy of 98% can be achieved for noisy Arabic documents. Further, we demonstrate the effectiveness of our method for document page…

Page Rule-Line Removal Using Linear Subspaces in Monochromatic Handwritten Arabic Documents

Wael AbdAlmageed, Jayant Kumar, David Doermann

Computer Vision and Pattern Recognition · · cited 21× · DOI ↗ · more like this ·

In this paper we present a novel method for removing page rule lines in monochromatic handwritten Arabic documents using subspace methods with minimal effect on the quality of the foreground text. We use moment and histogram properties to extract features that represent the characteristics of the underlying rule lines. A linear subspace is incrementally built to obtain a line model that can be used to identify rule line pixels. We also introduce a novel scheme for evaluating noise removal algorithms in general and we use it to assess the quality of our rule line removal algorithm. Experimental results presented on a data set of 50 Arabic documents, handwritten by different writers, demonstrate the effectiveness of the proposed method.

Adaptive spectral smoothening for development of robust keyword spotting system

Biswaranjan Pattanayak, Jayant Kumar Rout, Gayadhar Pradhan

Artificial Intelligence · IET Signal Processing · · cited 17× · DOI ↗ · more like this ·

It is well known that a keyword spotting (KWS) system provides significantly reduced performance in mismatched training and test conditions. In this work, an approach is proposed for reducing the mismatches between the training and test speech due to speaker‐related variabilities and environmental noises. In the proposed approach, the variational‐mode decomposition is first performed on the short‐term magnitude spectra to decompose it into a number of variational mode functions (VMFs) in an adaptive manner. Then, a sufficiently smoothed spectra are reconstructed by selecting only two lower frequency VMFs. When the KWS system is developed by using Mel frequency cepstral coefficients (MFCCs) extracted from the smoothed spectra, a significantly improved performance is observed for pitch and noise mismatched test conditions. To further suppress the mismatches due to the pitch and speaking…

On-the-fly hand detection training with application in egocentric action recognition

Jayant Kumar, Qun Li, Survi Kyal +2 more

Computer Vision and Pattern Recognition · · cited 17× · DOI ↗ · more like this ·

We propose a novel approach to segment hand regions in egocentric video that requires no manual labeling of training samples. The user wearing a head-mounted camera is prompted to perform a simple gesture during an initial calibration step. A combination of color and motion analysis that exploits knowledge of the expected gesture is applied on the calibration video frames to automatically label hand pixels in an unsupervised fashion. The hand pixels identified in this manner are used to train a statistical-model-based hand detector. Superpixel region growing is used to perform segmentation refinement and improve robustness to noise. Experiments show that our hand detection technique based on the proposed on-the-fly training approach significantly outperforms state-of-the-art techniques with respect to accuracy and robustness on a variety of challenging videos. This is due primarily to…

SmartDCap

Francine Chen, Scott L. Carter, Laurent Denoue +1 more

Computer Vision and Pattern Recognition · · cited 17× · DOI ↗ · more like this ·

People frequently capture photos with their smartphones, and some are starting to capture images of documents. However, the quality of captured document images is often lower than expected, even when an application that performs post-processing to improve the image is used. To improve the quality of captured images before post-processing, we developed the Smart Document Capture (SmartDCap) application that provides real-time feedback to users about the likely quality of a captured image. The quality measures capture the sharpness and framing of a page or regions on a page, such as a set of one or more columns, a part of a column, a figure, or a table. Using our approach, while users adjust the camera position, the application automatically determines when to take a picture of a document to produce a good quality result. We performed a subjective evaluation comparing SmartDCap and the…

The graph search machine (GSM): A VLSI architecture for connected speech recognition and other applications

Stephen C. Glinski, T.M. Lalumia, D.R. Cassiday +4 more

Artificial Intelligence · Proceedings of the IEEE · · cited 12× · DOI ↗ · more like this ·

A programmable VLSI architecture is described for efficiently computing a variety of kernel operations for speech recognition. These operations include dynamic programming for isolated and connected word recognition using both the template matching approach and the Hidden Markov Model (HMM) approach, the use of finite-state grammars (FSG) for connected word recognition, and metric computations for vector quantization and distance measurement. These are collectively referred to as "graph search" operations since a diagram consisting of arcs and nodes is commonly used to illustrate the HMM or FSG. As well as being able to efficiently compute a wide class of speech processing operations, the architecture is useful in other areas such as image processing. A chip design has been completed using 1.75-µm CMOS design rules and combines both custom and standard cell aproaches.

Deep learning architectures for domain adaptation in HOV/HOT lane enforcement

Safwan Wshah, Beilei Xu, Orhan Bulan +2 more

Computer Vision and Pattern Recognition · · cited 11× · DOI ↗ · more like this ·

High Occupancy Vehicle (HOV) and High Occupancy Tolling (HOT) lanes have been commonly practiced in several jurisdictions to reduce traffic congestion and promote car pooling. Camera-based methods have been recently proposed for a cost-efficient, safe and effective HOV/HOT lane enforcement with the prevalence of video cameras in transportation imaging applications. An important step in automated lane enforcement systems is classification of localized window/windshield images to distinguish passenger from no-passenger vehicles to identify violators. This can be performed using deep convolutional neural networks (CNNs), which are shown to significantly outperform hand-crafted features in several classification tasks. Training/fine-tuning CNNs require a set of passenger/no-passenger images manually labeled by an operator, which requires substantial time and effort that can result in…

Mobile Video Capture of Multi-page Documents

Jayant Kumar, Raja Bala, Hengzhou Ding +1 more

Computer Vision and Pattern Recognition · · cited 10× · DOI ↗ · more like this ·

This paper presents a mobile application for capturing images of printed multi-page documents with a smartphone camera. With today's available document capture applications, the user has to carefully capture individual photographs of each page and assemble them into a document, leading to a cumbersome and time consuming user experience. We propose a novel approach of using video to capture multipage documents. Our algorithm automatically selects the best still images corresponding to individual pages of the document from the video. The technique combines video motion analysis, inertial sensor signals, and an image quality (IQ) prediction technique to select the best page images from the video. For the latter, we extend a previous no-reference IQ prediction algorithm to suit the needs of our video application. The algorithm has been implemented on an iPhone 4S. Individual pages are…

Fast Rule-Line Removal Using Integral Images and Support Vector Machines

Jayant Kumar, David Doermann

Computer Vision and Pattern Recognition · · cited 10× · DOI ↗ · more like this ·

In this paper, we present a fast and effective method for removing pre-printed rule-lines in handwritten document images. We use an integral-image representation which allows fast computation of features and apply techniques for large scale Support Vector learning using a data selection strategy to sample a small subset of training data. Results on both constructed and real-world data sets show that the method is effective for rule-line removal. We compare our method to a subspace-based method and show that better accuracy can be achieved in considerably less time. The integral-image based features proposed in the paper are generic and can be applied to other problems as well.

Document Image Classification and Labeling Using Multiple Instance Learning

Jayant Kumar, Jaishanker K. Pillai, David Doermann

Computer Vision and Pattern Recognition · · cited 10× · DOI ↗ · more like this ·

The labeling of large sets of images for training or testing analysis systems can be a very costly and time-consuming process. Multiple instance learning (MIL) is a generalization of traditional supervised learning which relaxes the need for exact labels on training instances. Instead, the labels are required only for a set of instances known as bags. In this paper, we apply MIL to the retrieval and localization of signatures and the retrieval of images containing machine-printed text, and show that a gain of 15-20% in performance can be achieved over the supervised learning with weak-labeling. We also compare our approach to supervised learning with fully annotated training data and report a competitive accuracy for MIL. Using our experiments on real-world datasets, we show that MIL is a good alternative when the training data has only document-level annotation.

A processor for graph search algorithms

Stephen C. Glinski, T.M. Lalumia, D.R. Cassiday +4 more

Artificial Intelligence · · cited 10× · DOI ↗ · more like this ·

This report will describe a programmable signal processor with a pipelined arithemetic unit capable of 40 MIPs operation in graph search kernel operations. Thus a fivefold improvement in speech and image processing algorithms can be obtained over conventional architectures The chip was fabricated in a 1.5μm CMOS technology, occupies 43.4mm <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> and operates at 20MHz.

Neural network approach for Indian currency recognition

Jayant Kumar Nayak, Chaitan Majhi, Apurva Kumar Srivastav +1 more

Computer Vision and Pattern Recognition · · cited 9× · DOI ↗ · more like this ·

It is very difficult to count currency notes of different denominations in a bundle. We propose a system which can be implemented in paper currency counting machines to count Indian currency notes of different denominations efficiently and accurately. The system takes an image of standard orientation in upright position of Indian currency notes and detects its denomination accordingly. It makes use of image processing technique and artificial neural networks.

Learning Text-Line Segmentation Using Codebooks and Graph Partitioning

Le Kang, Jayant Kumar, Peng Ye +1 more

Computer Vision and Pattern Recognition · · cited 7× · DOI ↗ · more like this ·

In this paper, we present a codebook based method for handwritten text-line segmentation which uses image-patches in the training data to learn a graph-based similarity for clustering. We first construct a codebook of image-patches using K-medoids, and obtain exemplars which encode local evidence. We then obtain the corresponding codewords for all patches extracted from a given image and construct a similarity graph using the learned evidence and partitioned to obtain text-lines. Our learning based approach performs well on a field dataset containing degraded and un-constrained handwritten Arabic document images. Results on ICDAR 2009 segmentation contest dataset show that the method is competitive with previous approaches.

Comparison of Early and Late Information Fusion for Multi-camera HOV Lane Enforcement

Beilei Xu, Orhan Bulan, Jayant Kumar +3 more

Computer Vision and Pattern Recognition · · cited 6× · DOI ↗ · more like this ·

High Occupancy Vehicle (HOV) lanes encourage carpooling and have been a common method used by transportation agencies to reduce congestion on highways. Image-based enforcement for HOV lanes is an emerging technology that uses one or more cameras mounted on overhead gantries and/or roadside poles to capture imagery inside vehicles and make computer vision based assessments of the occupancy state of the vehicle. One proposed system uses two cameras to capture images of the front seat and rear seat of vehicles traveling in HOV lanes and identifies violators by processing the captured images. In this paper, we compare combining information from the two cameras using either an early fusion approach or a late fusion approach to determine whether the vehicle is a car pool lane violator or not. The performance is compared on a set of images acquired 'in-the-wild' from public roadway testing…