arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Navdeep Kumar

28 papers · 2012–2026

2012: 22013: 02014: 02015: 32016: 02017: 12018: 02019: 02020: 02021: 12022: 52023: 42024: 42025: 62026: 2
2012peak 6 in 20252026

Frequent co-authors

Papers

showing 1–25 of 28 RSS

IoT Fog-Enabled Multi-Node Centralized Ecosystem for Real Time Screening and Monitoring of Health Information

Vikas Khullar, Harjit Singh, Yini Miró +5 more

Computer Networks and Communications · Applied Sciences · · cited 38× · DOI ↗ · more like this ·

In today’s technological and stressful world, when everyone is busy in their daily routines and places blind faith in pharmaceutical advancements to protect their health, the sudden, horrifying effects of the COVID-19 pandemic have resulted in serious emotional and psychological impacts in the general population. In spite of advanced vaccination campaigns, fear and hesitation have become a part of human life since there are a number of people who do not want to take these immunity boosting vaccinations. Such people may become carriers of infectious viruses, leading to a more rapid rate of spread; therefore, this class of spreaders needs to be screened at the earliest opportunity. In this context, there is a need for advanced health monitoring systems which can assist the pharmaceutical industry to monitor and record the health status of people. To address this need and reduce the…

Image steganography using Discrete Wavelet Transformation and Artificial Bee Colony Optimization

Amandeep Kaur, Rupinder Kaur, Navdeep Kumar

Computer Vision and Pattern Recognition · · cited 10× · DOI ↗ · more like this ·

With the evolution of Internet Technology the need for the security of information during its transmission has also increased rapidly. Steganography plays a prominent role in the field of data hiding and providing a means for secret communication. Steganography basically refers to the process of secretly hiding messages into a cover medium in a way that only the receiver can suspect its existence. In this paper a new technique for image steganography has been discussed that utilizes the LSB substitution in the contour region of the image. The Pixel Value difference of the region has also been taken in to account in order to increase the embedding capacity of data. A new fitness function has been designed for the Artificial Bee Colony Optimization Algorithm that helps to calculate the best positions where data can be embedded. The results obtained using the proposed method provide an…

Review of Various Techniques for Medical Image Compression

Harpreet Kaur, Rupinder Kaur, Navdeep Kumar

Computer Vision and Pattern Recognition · International Journal of Computer Applications · · cited 7× · DOI ↗ · more like this ·

Image Compression generally refers to reducing the size of an image for the purpose of minimizing storage space as well as reducing the transfer time when transmitted over the network. Compression is very useful in medical imaging as a large quantity of storage is needed for storing medical images which can further be delivered for diagnosis. An appropriate technique for compression is needed for saving storage capacity as well as network bandwidth. It is also necessary that the valuable information should not be lost after compression of an image. In this paper various techniques of lossless image compression for medical images have been reviewed. The evaluation of performance is based on the parameter compression ratio.

Lossless compression of DICOM images using genetic algorithm

Harpreet Kaur Channi, Rupinder Kaur, Navdeep Kumar

Computer Vision and Pattern Recognition · · cited 6× · DOI ↗ · more like this ·

The numerous medical images generated by various imaging devices require a huge amount of storage space and minimum transmission bandwidth. So, it is necessary to use an appropriate technique for compression of medical images in order to meet the above concerns. This paper proposes a technique for lossless compression of significant parts by extracting the region of interest in DICOM images. The extracted region is compressed using Huffman encoding and genetic algorithm for the enhancement of compression ratio. Additionally, the value of PSNR has also been calculated. When the results of the proposed technique are compared with the previous method, it is found that there is an increase of more than 400% in the compression ratio. It also provides an average increase of 20% in the compression ratio by using Huffman encoding.

Policy Gradient for Rectangular Robust Markov Decision Processes

Navdeep Kumar, Esther Derman, Matthieu Geist +2 more

cs.LG · · cited 3× · arXiv ↗ · more like this ·

Policy gradient methods have become a standard for training reinforcement learning agents in a scalable and efficient manner. However, they do not account for transition uncertainty, whereas learning robust policies can be computationally expensive. In this paper, we introduce robust policy gradient (RPG), a policy-based method that efficiently solves rectangular robust Markov decision processes (MDPs). We provide a closed-form expression for the worst occupation measure. Incidentally, we find that the worst kernel is a rank-one perturbation of the nominal. Combining the worst occupation measure with a robust Q-value estimation yields an explicit form of the robust gradient. Our resulting RPG can be estimated from data with the same time complexity as its non-robust equivalent. Hence, it relieves the computational burden of convex optimization problems required for training robust…

Generalization of Software Metrics on Software as a Service (SaaS)

Ram Singh, Avinash Bhagat, Navdeep Kumar

Computer Networks and Communications · · cited 3× · DOI ↗ · more like this ·

"Upgradation", simply means learn from your past experiences and make efforts to change your present and future to attain more and more satisfaction. From the era of single job processing to batch processing and then to multiprocessing, we have updated our work process, computing environment, business rules and so on. With the advent of increased awareness of IT in common man, everyone wants to upgrade themselves. IT companies provide software that can install on client machines and produce outputs as per requirements of client. But it will be more advantageous when different kind of software will be made available at one place for usage. This paper aims in providing functionalities of SaaS, types of software as a service, types of SaaS users and certain important software metrics that are required to check the performance of SaaS.

Personalised Recommendation Systems using RL

J Sheela, Harshit Katragadda, Navdeep Kumar +3 more

Information Systems · · cited 2× · DOI ↗ · more like this ·

In recent years, recommendation systems have evolved significantly, with advancements in graph networks and reinforcement learning (RL) demonstrating considerable promise. This research work presents a novel approach that integrates graph-based representations of user-genre interactions with RL techniques to enhance the effectiveness of personalized recommendation systems. The integration of graph networks allows us to capture intricate relationships inherent in recommendation systems, such as user-genre interactions and item-item similarities. By modeling these relationships within a graph framework, our approach enables us to learn meaningful representations conducive to informed decision-making. Furthermore, the adoption of RL empowers the system to dynamically adapt and refine its recommendations over time by learning from user feedback. Through iterative exploration and…

Data Reduction Techniques in Wireless Sensor Networks with AI

Gagan Deep Arora, Navdeep Kumar Chopra, N. Gopinath +3 more

Computer Networks and Communications · · cited 2× · DOI ↗ · more like this ·

Due to their numerous uses in practically every part of life and their related problems, such as energy saving, a longer life cycle, and better resource usage, the research of wireless sensor networks is ongoing. Its extensive use successfully saves and processes a considerable volume of sensor data. Since the sensor nodes are frequently placed in challenging locations where less expensive resources are required for data collection and processing, this presents a new difficulty. One method for minimizing the quantity of sensor data is data reduction. A review of data reduction methods has been provided in this publication. The different data reduction approaches that have been put forth over the years have been examined, along with their advantages and disadvantages, ways in which they can be helpful, and whether or not using them in contexts with limited resources is worthwhile.

Efficient Policy Iteration for Robust Markov Decision Processes via Regularization

Navdeep Kumar, Kfir Levy, Kaixin Wang +1 more

cs.AI · · cited 2× · arXiv ↗ · more like this ·

Robust Markov decision processes (MDPs) provide a general framework to model decision problems where the system dynamics are changing or only partially known. Efficient methods for some \texttt{sa}-rectangular robust MDPs exist, using its equivalence with reward regularized MDPs, generalizable to online settings. In comparison to \texttt{sa}-rectangular robust MDPs, \texttt{s}-rectangular robust MDPs are less restrictive but much more difficult to deal with. Interestingly, recent works have established the equivalence between \texttt{s}-rectangular robust MDPs and policy regularized MDPs. But we don't have a clear understanding to exploit this equivalence, to do policy improvement steps to get the optimal value function or policy. We don't have a clear understanding of greedy/optimal policy except it can be stochastic. There exist no methods that can naturally be generalized to…

Solving Non-Rectangular Reward-Robust MDPs via Frequency Regularization

Uri Gadot, Esther Derman, Navdeep Kumar +3 more

cs.LG · · cited 1× · arXiv ↗ · more like this ·

In robust Markov decision processes (RMDPs), it is assumed that the reward and the transition dynamics lie in a given uncertainty set. By targeting maximal return under the most adversarial model from that set, RMDPs address performance sensitivity to misspecified environments. Yet, to preserve computational tractability, the uncertainty set is traditionally independently structured for each state. This so-called rectangularity condition is solely motivated by computational concerns. As a result, it lacks a practical incentive and may lead to overly conservative behavior. In this work, we study coupled reward RMDPs where the transition kernel is fixed, but the reward function lies within an $α$-radius from a nominal one. We draw a direct connection between this type of non-rectangular reward-RMDPs and applying policy visitation frequency regularization. We introduce a policy-gradient…

Bring Your Own (Non-Robust) Algorithm to Solve Robust MDPs by Estimating The Worst Kernel

Kaixin Wang, Uri Gadot, Navdeep Kumar +2 more

cs.LG · · cited 1× · arXiv ↗ · more like this ·

Robust Markov Decision Processes (RMDPs) provide a framework for sequential decision-making that is robust to perturbations on the transition kernel. However, current RMDP methods are often limited to small-scale problems, hindering their use in high-dimensional domains. To bridge this gap, we present EWoK, a novel online approach to solve RMDP that Estimates the Worst transition Kernel to learn robust policies. Unlike previous works that regularize the policy or value updates, EWoK achieves robustness by simulating the worst scenarios for the agent while retaining complete flexibility in the learning process. Notably, EWoK can be applied on top of any off-the-shelf {\em non-robust} RL algorithm, enabling easy scaling to high-dimensional domains. Our experiments, spanning from simple Cartpole to high-dimensional DeepMind Control Suite environments, demonstrate the effectiveness and…

Policy Gradient for Reinforcement Learning with General Utilities

Navdeep Kumar, Kaixin Wang, Kfir Levy +1 more

cs.LG · · cited 1× · arXiv ↗ · more like this ·

In Reinforcement Learning (RL), the goal of agents is to discover an optimal policy that maximizes the expected cumulative rewards. This objective may also be viewed as finding a policy that optimizes a linear function of its state-action occupancy measure, hereafter referred as Linear RL. However, many supervised and unsupervised RL problems are not covered in the Linear RL framework, such as apprenticeship learning, pure exploration and variational intrinsic control, where the objectives are non-linear functions of the occupancy measures. RL with non-linear utilities looks unwieldy, as methods like Bellman equation, value iteration, policy gradient, dynamic programming that had tremendous success in Linear RL, fail to trivially generalize. In this paper, we derive the policy gradient theorem for RL with general utilities. The policy gradient theorem proves to be a cornerstone in…

Age Detection from Facial Images Using Python

Paladugu Reshvanth, N. Venkat Rao, Modekurty Sri Krishna Kumar +4 more

Computer Vision and Pattern Recognition · 2021 Fifth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · · cited 1× · DOI ↗ · more like this ·

Age detection is a process of automatically discerning the age of a person solely forms a photo of their face. This involves two stages, face detection and then age recognition by giving it as a feed to age detector algorithm. The main aim of the project is to build a robust age detection model by using model weights as pre trained model and use it to predict the age of the person in an image. This research work will use webcam feed as input to get live results.

Educational Philosophy of empiricism and its evaluation in present educational system

Navdeep Kumar Maurya

Education · RESEARCH REVIEW International Journal of Multidisciplinary · · cited 0× · DOI ↗ · more like this ·

Empiricism is a philosophy rooted in scientific thinking that regards direct sensory experiences as the primary means of acquiring knowledge. It stands in opposition to rationalism. According to this philosophy, all knowledge arises from observation, experience, and scientific methods. Empiricism takes three forms: classical empiricism, radical empiricism, and modern or liberal empiricism. Both quantitative and qualitative reasoning methods are used in empiricism to examine evidence. Its scope ranges from complete to partial. In education, empiricism helps in developing critical thinking and analytical skills, which form the foundation of scientific thought. In teaching, empiricism can be fostered among children through project-based methods, problem-solving approaches, field visits, and similar techniques. In this process, the teacher plays the role of a guide. Abstract: अनुभववाद एक…

Policy Gradient with Tree Search: Avoiding Local Optimas through Lookahead

Uri Koren, Navdeep Kumar, Uri Gadot +3 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Classical policy gradient (PG) methods in reinforcement learning frequently converge to suboptimal local optima, a challenge exacerbated in large or complex environments. This work investigates Policy Gradient with Tree Search (PGTS), an approach that integrates an $m$-step lookahead mechanism to enhance policy optimization. We provide theoretical analysis demonstrating that increasing the tree search depth $m$-monotonically reduces the set of undesirable stationary points and, consequently, improves the worst-case performance of any resulting stationary policy. Critically, our analysis accommodates practical scenarios where policy updates are restricted to states visited by the current policy, rather than requiring updates across the entire state space. Empirical evaluations on diverse MDP structures, including Ladder, Tightrope, and Gridworld environments, illustrate PGTS's ability to…

"EXAMINATION AND EVALUATION IN THE NEW EDUCATION POLICY (NEP)-2020"

Dr. Navdeep Kumar Maurya

Education · Zenodo (CERN European Organization for Nuclear Research) · · cited 0× · DOI ↗ · more like this ·

The ability and achievement of students are measured through examinations and their evaluation. In the present times conducting objective exam and making objective evaluation is a big challenge. For this many suggestions have been given in NEP 2020. So That Continuous and comprehensive evaluation Can be done on all four stage or sources of the student's educational Life. Examination and assessment have been reformed at all Levels of elementary education Primary Education, meddle Education, Secondary Education and Higher Education also. in this there is talk of promoting Semester and grade system as well as opening National Assessment Conter. Along with flexible exams and assessment, National Testing Agency has been asked to Conduct National Achievement Survey. Strengthened the evaluation System by Suggesting Academic Credit Bank and Transfer creat.

L.M.S. : A Platform for Educational Marketing and Deschooling

Navdeep Kumar Maurya

Sociology and Political Science · Journal of Research in Humanities and Social Science · · cited 0× · DOI ↗ · more like this ·

Learning management system (LMS) is a educational technology for managing subject knowledge in this. Teacher and students connect on one platform through an apps and complete the teaching-learning process. LMS is a form of e-learning in this the correct management of subject matter. Knowledge and skills is delivered to the students through an apps. Many institutions related to education learning management reach the students through an app of LMS and to increase its popularity, they also provide discounts in fees along with advertisement. Some of them are also involved in the stock market and earning money. LMS provides knowledge of various subjects areas. Skills and Technology on a single platform. Students join as per their convenience through I.D. and password and ensure success from admission till examination of degree and certificates, many schools, colleges and universities also…

Real-Time Indian Sign Language Translation Using Deep Learning and Multilingual Speech Technologies

Vaishaal Shankar, B. Tharun Kumar, Navdeep Kumar +1 more

Human-Computer Interaction · International Research Journal of Innovations in Engineering and Technology · · cited 0× · DOI ↗ · more like this ·

This paper introduces a novel hybrid framework for Indian Sign Language (ISL) translation that performs real-time recognition of both static and dynamic gestures and generates multilingual outputs in both text and speech.Unlike existing systems that are limited to either static classification or single-language outputs, our approach integrates a fine-tuned ResNet50V2 model for static gesture classification (98.7% accuracy) and a YOLOv8m detector for dynamic word recognition (88.7% mAP@50).The system employs MediaPipe for efficient hand landmark extraction and incorporates frame-skipping and cooldown strategies to optimize real-time performance on CPU-based devices, achieving an average of 3.4 FPS without GPU acceleration.Recognized gestures are mapped to sequences, translated into eight Indian languages using Google Translate, and converted into synthesized speech using…

A STUDY OF ATTITUDE TOWARDS MODERNIZATION OF STUDENT'S STUDYING IN SECONDARY SCHOOLS

Dr. Navdeep Kumar Maurya

Education · Zenodo (CERN European Organization for Nuclear Research) · · cited 0× · DOI ↗ · more like this ·

Modernization is a dynamic process establishes new ideas and values of emerging from the traditions and practices of the society. Students come to study in secondary schools in adolescence, this is an important stage of life in this, do they give less importance to old ideas, traditions, religiosity and want to do something new in life? They like science and logic knowledge along with social mobility. A new expression towards modernity begins to develop. It has been studied in this research. In this research was done on 100 students on the basis of null hypothesis and it was found that there is a significance difference between students towards modernity and there is a difference between the boys & girls science stream also. Whereas it was found that there is no significant difference towards modernization among the girls student of Art and Science stream the same result was found in…

On the Convergence of Single-Timescale Actor-Critic

Navdeep Kumar, Priyank Agrawal, Giorgia Ramponi +2 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

We analyze the global convergence of the single-timescale actor-critic (AC) algorithm for the infinite-horizon discounted Markov Decision Processes (MDPs) with finite state spaces. To this end, we introduce an elegant analytical framework for handling complex, coupled recursions inherent in the algorithm. Leveraging this framework, we establish that the algorithm converges to an $ε$-close \textbf{globally optimal} policy with a sample complexity of \( O(ε^{-3}) \). This significantly improves upon the existing complexity of $O(ε^{-2})$ to achieve $ε$-close \textbf{stationary policy}, which is equivalent to the complexity of $O(ε^{-4})$ to achieve $ε$-close \textbf{globally optimal} policy using gradient domination lemma. Furthermore, we demonstrate that to achieve this improvement, the step sizes for both the actor and critic must decay as \( O(k^{-\frac{2}{3}}) \) with iteration $k$…

An Efficient Solution to s-Rectangular Robust Markov Decision Processes

Navdeep Kumar, Kfir Levy, Kaixin Wang +1 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

We present an efficient robust value iteration for \texttt{s}-rectangular robust Markov Decision Processes (MDPs) with a time complexity comparable to standard (non-robust) MDPs which is significantly faster than any existing method. We do so by deriving the optimal robust Bellman operator in concrete forms using our $L_p$ water filling lemma. We unveil the exact form of the optimal policies, which turn out to be novel threshold policies with the probability of playing an action proportional to its advantage.

AN ANALYTICAL REVIEW ON WIRELESS SENSOR CLUSTERING FOR THE PROLONG NETWORK LIFE TIME

IKGPTU, Jalandhar, India, Navdeep Kumar Chopra

Computer Networks and Communications · International Journal of Advanced Research in Computer Science · · cited 0× · DOI ↗ · more like this ·

Wireless sensor network is the group of small units called nodes which has gained a lot of light due to its variant applications in various sectors. The tiny mechanical devices referred as sensor nodes are deployed in the very rough area and they are left unattended to uninterruptedly report about the environment parameters .Nodes in rough areas rapidly diminish energy resources, which lead to disruption in network services. This is the main problem of data collection scenarios in which CH’s have a huge burden of collecting and relaying statistics. The relay load on heads particularly intensifies as the sink distance decreases. For balancing the load of traffic and the energy consumption in WSN, the CH role must be switched among all the network nodes and the sizes of cluster must be carefully determined at every portion of the network. These devices have energy which is consumed during…

Potential and Challenges of Rural Tourism in Punjab

Navdeep Kumar

Sociology and Political Science · PARIPEX-INDIAN JOURNAL OF RESEARCH · · cited 0× · DOI ↗ · more like this ·

Real India lives in villages. Almost 74% of the population lives in its 7 million villages. Rural areas are an integral part of the modern tourist experience. The recognition of rural tourism as an alternative to mainstream is a recent concept. The basic concept of rural tourism was envisaged with benefit accruing to local community through entrepreneurial opportunities, income generation, employment opportunities, conservation and development of rural arts and crafts, investment for infrastructure development and preservation of the environment and heritage. There is a large potential market for rural tourism especially for foreign tourists that need to be tapped strategically. Besides, there is a huge domestic tourism market with an estimated 240 million tourists. The World Tourism Organization notes that there is a clear trend in the growth of rural tourism. The World Travel and…

Horizon Imagination: Efficient On-Policy Rollout in Diffusion World Models

Lior Cohen, Ofir Nabati, Kaixin Wang +2 more

cs.LG · · arXiv ↗ · more like this ·

We study diffusion-based world models for reinforcement learning, which offer high generative fidelity but face critical efficiency challenges in control. Current methods either require heavyweight models at inference or rely on highly sequential imagination, both of which impose prohibitive computational costs. We propose Horizon Imagination (HI), an on-policy imagination process for discrete stochastic policies that denoises multiple future observations in parallel. HI incorporates a stabilization mechanism and a novel sampling schedule that decouples the denoising budget from the effective horizon over which denoising is applied while also supporting sub-frame budgets. Experiments on Atari 100K and Craftium show that our approach maintains control performance with a sub-frame budget of half the denoising steps and achieves superior generation quality under varied schedules. Code is…

Optimal Sample Complexity for Single Time-Scale Actor-Critic with Momentum

Navdeep Kumar, Tehila Dahan, Lior Cohen +4 more

cs.LG · · arXiv ↗ · more like this ·

We establish an optimal sample complexity of $O(ε^{-2})$ for obtaining an $ε$-optimal global policy using a single-timescale actor-critic (AC) algorithm in infinite-horizon discounted Markov decision processes (MDPs) with finite state-action spaces, improving upon the prior state of the art of $O(ε^{-3})$. Our approach applies STORM (STOchastic Recursive Momentum) to reduce variance in the critic updates. However, because samples are drawn from a nonstationary occupancy measure induced by the evolving policy, variance reduction via STORM alone is insufficient. To address this challenge, we maintain a buffer of small fraction of recent samples and uniformly sample from it for each critic update. Importantly, these mechanisms are compatible with existing deep learning architectures and require only minor modifications, without compromising practical applicability.