arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Chayan Banerjee

25 papers · 2013–2026

2013: 32014: 32015: 12016: 12017: 02018: 02019: 02020: 02021: 22022: 22023: 32024: 22025: 42026: 4
2013peak 4 in 20252026

Frequent co-authors

Papers

showing 1–25 of 25 RSS

A Survey on Physics Informed Reinforcement Learning: Review and Open Problems

Chayan Banerjee, Kien Nguyen, Clinton Fookes +1 more

cs.LG · · cited 84× · arXiv ↗ · more like this ·

The inclusion of physical information in machine learning frameworks has revolutionized many application areas. This involves enhancing the learning process by incorporating physical constraints and adhering to physical laws. In this work we explore their utility for reinforcement learning applications. We present a thorough review of the literature on incorporating physics information, as known as physics priors, in reinforcement learning approaches, commonly referred to as physics-informed reinforcement learning (PIRL). We introduce a novel taxonomy with the reinforcement learning pipeline as the backbone to classify existing works, compare and contrast them, and derive crucial insights. Existing works are analyzed with regard to the representation/ form of the governing physics modeled for integration, their specific contribution to the typical reinforcement learning architecture…

Improved Soft Actor-Critic: Mixing Prioritized Off-Policy Samples With On-Policy Experiences

Chayan Banerjee, Zhiyong Chen, Nasimul Noman

Artificial Intelligence · IEEE Transactions on Neural Networks and Learning Systems · · cited 53× · DOI ↗ · more like this ·

Soft actor-critic (SAC) is an off-policy actor-critic (AC) reinforcement learning (RL) algorithm, essentially based on entropy regularization. SAC trains a policy by maximizing the trade-off between expected return and entropy (randomness in the policy). It has achieved the state-of-the-art performance on a range of continuous control benchmark tasks, outperforming prior on-policy and off-policy methods. SAC works in an off-policy fashion where data are sampled uniformly from past experiences (stored in a buffer) using which the parameters of the policy and value function networks are updated. We propose certain crucial modifications for boosting the performance of SAC and making it more sample efficient. In our proposed improved SAC (ISAC), we first introduce a new prioritization scheme for selecting better samples from the experience replay (ER) buffer. Second we use a mixture of the…

Energy conservation in wireless sensor network using block cellular automata

Chayan Banerjee, Shubhra Saxena

Computer Networks and Communications · · cited 6× · DOI ↗ · more like this ·

Energy conservation is a very critical issue in WSN. A lot of work has been done on the techniques of topology control so that sensor nodes which are not in direct use can be put to a low power consuming state, thus saving energy. Recently improvements have been done in this field by considering individual sensors as individual cell in a grid and applying cellular automata principles to it. Our work uses Block cellular automata, thus considering a number of sensor nodes as a group or block. The grouping or clustering is performed by Grid clustering technique. The member nodes of a block or cluster will select a Cluster Head (CH), which will represent the block as a whole. The CA principles are applied here, by taking a whole block as a single unit and it will decide on the power mode of the CH. Other power conservation algorithms are applied within the cluster so as to increase the…

Boosting Exploration in Actor-Critic Algorithms by Incentivizing Plausible Novel States

Chayan Banerjee, Zhiyong Chen, Nasimul Noman

cs.LG · · cited 5× · arXiv ↗ · more like this ·

Actor-critic (AC) algorithms are a class of model-free deep reinforcement learning algorithms, which have proven their efficacy in diverse domains, especially in solving continuous control problems. Improvement of exploration (action entropy) and exploitation (expected return) using more efficient samples is a critical issue in AC algorithms. A basic strategy of a learning algorithm is to facilitate indiscriminately exploring all of the environment state space, as well as to encourage exploring rarely visited states rather than frequently visited one. Under this strategy, we propose a new method to boost exploration through an intrinsic reward, based on measurement of a state's novelty and the associated benefit of exploring the state (with regards to policy optimization), altogether called plausible novelty. With incentivized exploration of plausible novel states, an AC algorithm is…

PSO with dynamic acceleration coefficient based on mutiple constraint satisfaction: Implementing Fuzzy Inference System

Chayan Banerjee, Ruchi Sawal

Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

Particle Swarm Optimization (PSO) parameters like the Inertia weight and acceleration coefficients are generally kept constant in classical PSO. But it has been found that changing these parameters dynamically makes the PSO more efficient. In this paper we propose a modified PSO algorithm where we change the value of the acceleration coefficient dynamically over iterations. We have used a Fuzzy Inference system (FIS) to obtain a new coefficient value for the PSO for each round. The coefficient depends on satisfaction of certain constraints given as inputs to the FIS. This dynamic modification of the coefficient has been found to increase the efficiency of PSO and also improve its convergence speed.

Multiple Generation of Bengali Static Signatures

Moises Díaz, Sukalpa Chanda, Miguel A. Ferrer +5 more

Computer Vision and Pattern Recognition · University of Groningen research database (University of Groningen / Centre for Information Technology) · · cited 3× · DOI ↗ · more like this ·

Handwritten signature datasets are really necessary for the purpose of developing and training automatic signature verification systems. It is desired that all samples in a signature dataset should exhibit both inter-personal and intra-personal variability. A possibility to model this reality seems to be obtained through the synthesis of signatures. In this paper we propose a method based on motor equivalence model theory to generate static Bengali signatures. This theory divides the human action to write mainly into cognitive and motor levels. Due to difference between scripts, we have redesigned our previous synthesizer [1,2], which generates static Western signatures. The experiments assess whether this method can approach the intra and inter-personal variability of the Bengali-100 Static Signature DB from a performance-based validation. The similarities reported in the experimental…

Energy conservation in wireless sensor network using irregular cellular automata

Chayan Banerjee

Computational Theory and Mathematics · · cited 3× · DOI ↗ · more like this ·

Wireless sensor nodes are severely constrained by energy consumption as they are battery powered. Most topology control techniques that are used for energy conservation assume that the sensor nodes are uniformly deployed, mostly in form of grids. In a real world scenario a grid based deployment presents its own set of problems and limitations. The current paper proposes improvement over a block cellular automata based energy conservation approach. In place of uniform grid, an irregular cellular automata approach has been proposed in this paper. Voronoi tessellations are used for clustering and a new neighborhood rule is proposed for non-uniform neighborhood of irregular cellular automata.

LOID: Lane Occlusion Inpainting and Detection for Enhanced Autonomous Driving Systems

Aayush Agrawal, Ashmitha Jaysi Sivakumar, Ibrahim Kaif +1 more

cs.CV · · cited 2× · arXiv ↗ · more like this ·

Accurate lane detection is essential for effective path planning and lane following in autonomous driving, especially in scenarios with significant occlusion from vehicles and pedestrians. Existing models often struggle under such conditions, leading to unreliable navigation and safety risks. We propose two innovative approaches to enhance lane detection in these challenging environments, each showing notable improvements over current methods. The first approach aug-Segment improves conventional lane detection models by augmenting the training dataset of CULanes with simulated occlusions and training a segmentation model. This method achieves a 12% improvement over a number of SOTA models on the CULanes dataset, demonstrating that enriched training data can better handle occlusions, however, since this model lacked robustness to certain settings, our main contribution is the second…

Improved Soft Actor-Critic: Mixing Prioritized Off-Policy Samples with On-Policy Experience

Chayan Banerjee, Zhiyong Chen, Nasimul Noman

cs.LG · · cited 2× · arXiv ↗ · more like this ·

Soft Actor-Critic (SAC) is an off-policy actor-critic reinforcement learning algorithm, essentially based on entropy regularization. SAC trains a policy by maximizing the trade-off between expected return and entropy (randomness in the policy). It has achieved state-of-the-art performance on a range of continuous-control benchmark tasks, outperforming prior on-policy and off-policy methods. SAC works in an off-policy fashion where data are sampled uniformly from past experiences (stored in a buffer) using which parameters of the policy and value function networks are updated. We propose certain crucial modifications for boosting the performance of SAC and make it more sample efficient. In our proposed improved SAC, we firstly introduce a new prioritization scheme for selecting better samples from the experience replay buffer. Secondly we use a mixture of the prioritized off-policy data…

Consensus achievement in multiagent system using adapted firefly algorithm

Chayan Banerjee, Shubhra Saxena, Indu Sharma

Computer Networks and Communications · · cited 2× · DOI ↗ · more like this ·

Consensus is a very relevant issue with respect to Multiagent systems. In this paper we have implemented an adapted version of Firefly Algorithm to achieve a consensus among a set of agents. The algorithm is analyzed and results shows that it is an effective way to achieve consensus.

Enhancing Exploration in Actor-Critic Algorithms:An Approach to Incentivize Plausible Novel States

Chayan Banerjee, Zhiyong Chen, Nasimul Noman

Artificial Intelligence · · cited 1× · DOI ↗ · more like this ·

<p>Actor-critic (AC) algorithms are model-free deep reinforcement learning techniques that have consistently demon- strated their effectiveness across various domains, especially in addressing continuous control challenges. Enhancing exploration (action entropy) and exploitation (expected return) through more efficient sample utilization is pivotal in AC algorithms. The fundamental strategy of a learning algorithm is to intelligently navigate the environment’s state space, prioritizing the explo- ration of rarely visited states over frequently encountered ones. In alignment with this strategy, we propose an innovative approach to bolster exploration by employing an intrinsic reward based on a state’s novelty and the potential benefits of exploring that state, which we term plausible novelty. Our approach is designed for seamless integration into off-policy AC algorithms. Through…

Optimal Actor-Critic Policy with Optimized Training Datasets

Chayan Banerjee, Zhiyong Chen, Nasimul Noman +1 more

cs.LG · · cited 1× · arXiv ↗ · more like this ·

Actor-critic (AC) algorithms are known for their efficacy and high performance in solving reinforcement learning problems, but they also suffer from low sampling efficiency. An AC based policy optimization process is iterative and needs to frequently access the agent-environment system to evaluate and update the policy by rolling out the policy, collecting rewards and states (i.e. samples), and learning from them. It ultimately requires a huge number of samples to learn an optimal policy. To improve sampling efficiency, we propose a strategy to optimize the training dataset that contains significantly less samples collected from the AC process. The dataset optimization is made of a best episode only operation, a policy parameter-fitness model, and a genetic algorithm module. The optimal policy network trained by the optimized training dataset exhibits superior performance compared to…

Sybil node detection in peer-to-peer networks using indirect validation

Chayan Banerjee, Shubhra Saxena

Computer Networks and Communications · · cited 1× · DOI ↗ · more like this ·

Peer- to- peer networks are used extensively today. Due to this wide use P2P networks is a target of malicious attacks. The most mentionable of them is the Sybil attack. Existing approaches for detection and mitigation of Sybil nodes are either computationally costly or are dependent on belief models found in social networks. It has been found that these belief models are themselves vulnerable to other attacks. In this paper, we propose a new type of indirect validation where we have a two stage validation in place to check that if a suspected node is Sybil or not. We crosscheck belief data from local monitor nodes and community detection data from randomly selected global monitor nodes, and then validate a suspected node. The proposed approach is found to be with less computation overheads and less vulnerable to malicious attacks.

Cellular Automata based Degree Priority Routing Algorithm for Irregular Mesh Topology NOCs

Chayan Banerjee, Amol K. Boke

Computer Networks and Communications · · cited 1× · OpenAlex ↗ · more like this ·

Irregular mesh topologies are used nowadays in NOCs due to the variation in the size & shape of IP modules integrated on a SOC. Irregular topology presents problems of routing, as eachnode may differ in their degree. Degree priority routing algorithms have already been proposed, which enables fast and dynamic routing. In this paper an improvement on the existing Degree priority routing (DPR) algorithm is proposed, by introducing Cellular Automata based neighborhood into the picture. The proposed technique enables each node to retain the degree information of its 4 neighbors (in a Cellular automata based Von Neumann neighborhood)and serves as a ‘one node ’ hub to decide on the next best node to route the message to. This way a considerable amount of time is saved on DPR algorithms to route the message to the next best node with the optimal degree.

Zero-Shot LLMs in Human-in-the-Loop RL: Replacing Human Feedback for Reward Shaping

Mohammad Saif Nazir, Chayan Banerjee

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Reinforcement learning (RL) often struggles with reward misalignment, where agents optimize given rewards but fail to exhibit the desired behaviors. This arises when the reward function incentivizes proxy behaviors misaligned with the true objective. While human-in-the-loop (HITL) methods can mitigate this issue, they also introduce biases, leading to inconsistent and subjective feedback that complicates learning. To address these challenges, we propose two key contributions. First, we extend the use of zero-shot, off-the-shelf large language models (LLMs) for reward shaping beyond natural language processing (NLP) to continuous control tasks. Using LLMs as direct feedback providers eliminates the need for surrogate models trained on human feedback, which often inherit biases from training data. Second, we introduce a hybrid framework (LLM-HFBF) that enables LLMs to identify and correct…

Consensus achievement in multi-agent swarms using weighted median

Chayan Banerjee, Indu Sharma

Computer Networks and Communications · · cited 0× · DOI ↗ · more like this ·

Achievement of consensus in multi-agent system is a topic of much research lately. Most of the consensus achievement algorithms are iteration based and are not able to address additional objectives and constraints. We propose an algorithm that is simple, distributed and able to achieve consensus after considering multiple objectives. In a group of decision making agents, to find a consensus, we calculate the median of the group. Ultimately the median is pulled to a lower or higher value depending on the summation of constraint based parameters or weights of the agents. Analysis showed the efficacy of the algorithm.

Breaking the Epistemic Trap: Active Perception Under Compound Uncertainty

Chayan Banerjee, Ethan Goan

eess.SY · · arXiv ↗ · more like this ·

Deploying reinforcement learning in safety critical domains, from autonomous vehicles to medical decision support, is constrained by failures arising when systems encounter unfamiliar conditions. We argue that the fundamental bottleneck is not individual challenges like changing dynamics or incomplete observations, but their synergistic interaction, which we term the Epistemic Trap: agents cannot estimate their state without knowing system dynamics, nor learn dynamics without accurate state information. Proof-of-concept experiments in simulated locomotion reveal that combining these uncertainties causes failures far worse than either challenge alone, a 77% observed degradation against the 46% additive prediction, demonstrating that compounding failure modes can emerge and, when they do, far exceed what additive reasoning would predict. Conventional approaches typically adopt a passive…

Sustainable Multi-Agent Crowdsourcing via Physics-Informed Bandits

Chayan Banerjee

cs.MA · · arXiv ↗ · more like this ·

Crowdsourcing platforms face a four-way tension between allocation quality, workforce sustainability, operational feasibility, and strategic contractor behaviour--a dilemma we formalise as the Cold-Start, Burnout, Utilisation, and Strategic Agency Dilemma. Existing methods resolve at most two of these tensions simultaneously: greedy heuristics and multi-criteria decision making (MCDM) methods achieve Day-1 quality but cause catastrophic burnout, while bandit algorithms eliminate burnout only through operationally infeasible 100% workforce utilisation.To address this, we introduce FORGE, a physics-grounded $K+1$ multi-agent simulator in which each contractor is a rational agent that declares its own load-acceptance threshold based on its fatigue state, converting the standard passive Restless Multi-Armed Bandit (RMAB) into a genuine Stackelberg game. Operating within FORGE, we propose a…

CWM: Contrastive World Models for Action Feasibility Learning in Embodied Agent Pipelines

Chayan Banerjee

cs.AI · · arXiv ↗ · more like this ·

A reliable action feasibility scorer is a critical bottleneck in embodied agent pipelines: before any planning or reasoning occurs, the agent must identify which candidate actions are physically executable in the current state. Existing approaches use supervised fine-tuning (SFT) to train action scorers, but SFT treats each candidate independently and does not explicitly teach the model to discriminate between actions that are physically correct and those that are subtly wrong. We propose the Contrastive World Model (CWM), which fine-tunes a large language model (LLM) as an action scorer using an InfoNCE contrastive objective with hard-mined negative examples. The key idea is to push valid actions away from invalid ones in scoring space, with special emphasis on hard negatives: semantically similar but physically incompatible candidates. We evaluate CWM on the ScienceWorld benchmark…

Physics-Informed Neuro-Symbolic Recommender System: A Dual-Physics Approach for Personalized Nutrition

Chayan Banerjee

cs.IR · · arXiv ↗ · more like this ·

Traditional e-commerce recommender systems primarily optimize for user engagement and purchase likelihood, often neglecting the rigid physiological constraints required for human health. Standard collaborative filtering algorithms are structurally blind to these hard limits, frequently suggesting bundles that fail to meet specific total daily energy expenditure and macronutrient balance requirements. To address this disconnect, this paper introduces a Physics-Informed Neuro-Symbolic Recommender System that integrates nutritional science directly into the recommendation pipeline via a dual-layer architecture. The framework begins by constructing a semantic knowledge graph using sentence-level encoders to strictly align commercial products with authoritative nutritional data. During the training phase, an implicit physics regularizer applies a differentiable thermodynamic loss function…

Reinforcement Learning based Traffic Signal Control for Queue Minimization: From Lane-based to Laneless Traffic

Anirud Nandakumar, Chayan Banerjee, Lelitha Devi Vanajakshi

eess.SY · · arXiv ↗ · more like this ·

Efficient traffic signal control (TSC) is essential for reducing congestion and delays. Traditional TSC methods struggle to capture the dynamics of laneless, heterogeneous traffic. We propose a reinforcement learning (RL) based adaptive TSC framework whose reward depends only on approach-level queue length, motivated by the difficulty of obtaining per-vehicle measurements in laneless traffic, and evaluate it using SUMO on a conventional lane-based, homogeneous (LBHO) intersection and on a non-orthogonal laneless, heterogeneous (LLHE) intersection. On the LBHO site, the lowest mean configuration has about 23\% lower mean queue length than a Dynamic Webster baseline, and the unselected Full-State configuration about 15\% lower. On the LLHE site, all RL configurations have 66-73\% lower mean queue length than a Dynamic Webster baseline under nominal demand, and 63--74\% lower under two…

Physics-Informed Operator Learning for Hemodynamic Modeling

Ryan Chappell, Chayan Banerjee, Kien Nguyen +1 more

cs.LG · · arXiv ↗ · more like this ·

Accurate modeling of personalized cardiovascular dynamics is crucial for non-invasive monitoring and therapy planning. State-of-the-art physics-informed neural network (PINN) approaches employ deep, multi-branch architectures with adversarial or contrastive objectives to enforce partial differential equation constraints. While effective, these enhancements introduce significant training and implementation complexity, limiting scalability and practical deployment. We investigate physics-informed neural operator learning models as efficient supervisory signals for training simplified architectures through knowledge distillation. Our approach pre-trains a physics-informed DeepONet (PI-DeepONet) on high-fidelity cuffless blood pressure recordings to learn operator mappings from raw wearable waveforms to beat-to-beat pressure signals under embedded physics constraints. This pre-trained…

Mining--Gym: A Configurable RL Benchmarking Environment for Truck Dispatch Scheduling

Chayan Banerjee, Kien Nguyen, Clinton Fookes

cs.LG · · arXiv ↗ · more like this ·

Optimizing the mining process -- particularly truck dispatch scheduling -- is a key driver of efficiency in open-pit operations. However, the dynamic and stochastic nature of these environments, with uncertainties such as equipment failures, truck maintenance, and variable haul cycle times, challenges traditional optimization. While Reinforcement Learning (RL) shows strong potential for adaptive decision-making in mining logistics, practical deployment requires evaluation in realistic, customizable simulation environments. The lack of standardized benchmarking hampers fair algorithm comparison, reproducibility, and real-world applicability of RL solutions. To address this, we present Mining-Gym -- a configurable, open-source benchmarking environment for training, testing, and evaluating RL algorithms in mining process optimization. Built on Salabim-based Discrete Event Simulation (DES)…

PINNs for Medical Image Analysis: A Survey

Chayan Banerjee, Kien Nguyen, Olivier Salvado +2 more

eess.IV · · arXiv ↗ · more like this ·

The incorporation of physical information in machine learning frameworks is transforming medical image analysis (MIA). By integrating fundamental knowledge and governing physical laws, these models achieve enhanced robustness and interpretability. In this work, we explore the utility of physics-informed approaches for MIA (PIMIA) tasks such as registration, generation, classification, and reconstruction. We present a systematic literature review of over 80 papers on physics-informed methods dedicated to MIA. We propose a unified taxonomy to investigate what physics knowledge and processes are modelled, how they are represented, and the strategies to incorporate them into MIA models. We delve deep into a wide range of image analysis tasks, from imaging, generation, prediction, inverse imaging (super-resolution and reconstruction), registration, and image analysis (segmentation and…

Physics-Informed Computer Vision: A Review and Perspectives

Chayan Banerjee, Kien Nguyen, Clinton Fookes +1 more

eess.IV · · arXiv ↗ · more like this ·

The incorporation of physical information in machine learning frameworks is opening and transforming many application domains. Here the learning process is augmented through the induction of fundamental knowledge and governing physical laws. In this work, we explore their utility for computer vision tasks in interpreting and understanding visual data. We present a systematic literature review of more than 250 papers on formulation and approaches to computer vision tasks guided by physical laws. We begin by decomposing the popular computer vision pipeline into a taxonomy of stages and investigate approaches to incorporate governing physical equations in each stage. Existing approaches in computer vision tasks are analyzed with regard to what governing physical processes are modeled and formulated, and how they are incorporated, i.e. modification of input data (observation bias)…