arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Nishanth Kumar

41 papers · 2013–2026

2013: 12014: 02015: 02016: 02017: 12018: 02019: 22020: 52021: 22022: 32023: 22024: 112025: 72026: 7
2013peak 11 in 20242026

Frequent co-authors

Papers

showing 1–25 of 41 RSS

Predicate Invention for Bilevel Planning

Tom Silver, Rohan Chitnis, Nishanth Kumar +4 more

cs.AI · · cited 93× · arXiv ↗ · more like this ·

Efficient planning in continuous state and action spaces is fundamentally hard, even when the transition model is deterministic and known. One way to alleviate this challenge is to perform bilevel planning with abstractions, where a high-level search for abstract plans is used to guide planning in the original transition space. Previous work has shown that when state abstractions in the form of symbolic predicates are hand-designed, operators and samplers for bilevel planning can be learned from demonstrations. In this work, we propose an algorithm for learning predicates from demonstrations, eliminating the need for manually specified state abstractions. Our key idea is to learn predicates by optimizing a surrogate objective that is tractable but faithful to our real efficient-planning objective. We use this surrogate objective in a hill-climbing search over predicate sets drawn from a…

Multi-Object Search using Object-Oriented POMDPs

Arthur Wandzel, Yoonseon Oh, Michael Fishman +3 more

Computer Vision and Pattern Recognition · · cited 37× · DOI ↗ · more like this ·

A core capability of robots is to reason about multiple objects under uncertainty. Partially Observable Markov Decision Processes (POMDPs) provide a means of reasoning under uncertainty for sequential decision making, but are computationally intractable in large domains. In this paper, we propose Object-Oriented POMDPs (OO-POMDPs), which represent the state and observation spaces in terms of classes and objects. The structure afforded by OO-POMDPs support a factorization of the agent's belief into independent object distributions, which enables the size of the belief to scale linearly versus exponentially in the number of objects. We formulate a novel Multi-Object Search (MOS) task as an OO-POMDP for mobile robotics domains in which the agent must find the locations of multiple objects. Our solution exploits the structure of OO-POMDPs by featuring human language to selectively update…

AccessFlex: Flexible Attribute Based Access Control Scheme for Sharing Access Privileges in Cloud Storage

Bharath Setturu, Nishanth Kumar Pathi, Shinu Abhi +1 more

Sociology and Political Science · · cited 5× · DOI ↗ · more like this ·

With the rapid growth of cloud storage adoption, ensuring efficient access control and tamper verification has become a critical concern. This paper presents AccessFlex, a Flexible Attribute-Based Access Control Scheme for Sharing Access Privileges in Cloud Storage. The proposed system is developed using Python and MySQL database servers to achieve robust and secure cloud storage management. AccessFlex introduces three key actors in the system: Admin, Data Owner, and Data User. Admin manages cryptography keys and data consumer attributes. Data Owners can securely upload files to the cloud storage server and define access details for Data Users. Data Users are granted access to authorized files based on their attributes. The AccessFlex system guarantees confidentiality, integrity, and accountability, providing a comprehensive solution for secure file management in cloud storage…

Preference-Conditioned Language-Guided Abstraction

Andi Peng, Andreea Bobu, Belinda Z. Li +5 more

cs.RO · · cited 5× · arXiv ↗ · more like this ·

Learning from demonstrations is a common way for users to teach robots, but it is prone to spurious feature correlations. Recent work constructs state abstractions, i.e. visual representations containing task-relevant features, from language as a way to perform more generalizable learning. However, these abstractions also depend on a user's preference for what matters in a task, which may be hard to describe or infeasible to exhaustively specify using language alone. How do we construct abstractions to capture these latent preferences? We observe that how humans behave reveals how they see the world. Our key insight is that changes in human behavior inform us that there are differences in preferences for how humans see the world, i.e. their state abstractions. In this work, we propose using language models (LMs) to query for those preferences directly given knowledge that a change in…

Learning Deep Parameterized Skills from Demonstration for Re-targetable Visuomotor Control

Jonathan Chang, Nishanth Kumar, Sean Hastings +6 more

cs.RO · · cited 5× · arXiv ↗ · more like this ·

Robots need to learn skills that can not only generalize across similar problems but also be directed to a specific goal. Previous methods either train a new skill for every different goal or do not infer the specific target in the presence of multiple goals from visual data. We introduce an end-to-end method that represents targetable visuomotor skills as a goal-parameterized neural network policy. By training on an informative subset of available goals with the associated target parameters, we are able to learn a policy that can zero-shot generalize to previously unseen goals. We evaluate our method in a representative 2D simulation of a button-grid and on both button-pressing and peg-insertion tasks on two different physical arms. We demonstrate that our model trained on 33% of the possible goals is able to generalize to more than 90% of the targets in the scene for both simulation…

VisualPredicator: Learning Abstract World Models with Neuro-Symbolic Predicates for Robot Planning

Yichao Liang, Nishanth Kumar, Hao Tang +5 more

cs.AI · · cited 3× · arXiv ↗ · more like this ·

Broadly intelligent agents should form task-specific abstractions that selectively expose the essential elements of a task, while abstracting away the complexity of the raw sensorimotor space. In this work, we present Neuro-Symbolic Predicates, a first-order abstraction language that combines the strengths of symbolic and neural knowledge representations. We outline an online algorithm for inventing such predicates and learning abstract world models. We compare our approach to hierarchical reinforcement learning, vision-language model planning, and symbolic predicate invention approaches, on both in- and out-of-distribution tasks across five simulated robotic domains. Results show that our approach offers better sample complexity, stronger out-of-distribution generalization, and improved interpretability.

Just Label What You Need: Fine-Grained Active Selection for Perception and Prediction through Partially Labeled Scenes

Sean Segal, Nishanth Kumar, Sergio Casas +4 more

cs.CV · · cited 3× · arXiv ↗ · more like this ·

Self-driving vehicles must perceive and predict the future positions of nearby actors in order to avoid collisions and drive safely. A learned deep learning module is often responsible for this task, requiring large-scale, high-quality training datasets. As data collection is often significantly cheaper than labeling in this domain, the decision of which subset of examples to label can have a profound impact on model performance. Active learning techniques, which leverage the state of the current model to iteratively select examples for labeling, offer a promising solution to this problem. However, despite the appeal of this approach, there has been little scientific analysis of active learning approaches for the perception and prediction (P&P) problem. In this work, we study active learning techniques for P&P and find that the traditional active learning formulation is ill-suited for…

PGMax: Factor Graphs for Discrete Probabilistic Graphical Models and Loopy Belief Propagation in JAX

Guangyao Zhou, Antoine Dedieu, Nishanth Kumar +4 more

cs.LG · · cited 2× · arXiv ↗ · more like this ·

PGMax is an open-source Python package for (a) easily specifying discrete Probabilistic Graphical Models (PGMs) as factor graphs; and (b) automatically running efficient and scalable loopy belief propagation (LBP) in JAX. PGMax supports general factor graphs with tractable factors, and leverages modern accelerators like GPUs for inference. Compared with existing alternatives, PGMax obtains higher-quality inference results with up to three orders-of-magnitude inference time speedups. PGMax additionally interacts seamlessly with the rapidly growing JAX ecosystem, opening up new research possibilities. Our source code, examples and documentation are available at https://github.com/deepmind/PGMax.

Task Scoping for Efficient Planning in Open Worlds (Student Abstract)

Nishanth Kumar, Michael Fishman, Natasha Danas +3 more

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence · · cited 2× · DOI ↗ · more like this ·

We propose an abstraction method for open-world environments expressed as Factored Markov Decision Processes (FMDPs) with very large state and action spaces. Our method prunes state and action variables that are irrelevant to the optimal value function on the state subspace the agent would visit when following any optimal policy from the initial state. This method thus enables tractable fast planning within large open-world FMDPs.

Automated IoT Security Configuration Audit Framework in AWS Cloud for Real-Time Threat Detection

Rahul Mohan, Nishanth Kumar Pathi, Rashmi Agarwal

Computer Networks and Communications · · cited 1× · DOI ↗ · more like this ·

The widespread deployment of Internet of Things (IoT) devices introduces significant security concerns due to frequent misconfigurations and outdated security protocols that create exploitable vulnerabilities. This paper proposes a novel automated framework for continuous auditing of security configurations in IoT ecosystems deployed on Amazon Web Services (AWS). The framework seamlessly integrates AWS IoT Core, Device Defender, Lambda, Security Hub, and SNS to create an end-to-end solution that identifies vulnerabilities and enforces remediation in real-time, differentiating it from existing isolated security tools. Experimental results demonstrate measurable improvements, including 93% reduction in misconfiguration identification time, automated remediation of critical vulnerabilities within minutes rather than hours, and centralized compliance monitoring that improves overall…

Enhancing Healthcare Data Privacy with Zero Knowledge Proof on AWS

Bhatt Vinayak Vishwanath, Nishanth Kumar Pathi, Shinu Abhi

Artificial Intelligence · · cited 1× · DOI ↗ · more like this ·

Zero Knowledge Proof (ZKP) is a cryptographic method that allows a prover to demonstrate to a verifier that a statement is true without revealing any additional information. This is highly relevant in healthcare, where data privacy is critical. By integrating ZKP into healthcare applications, sensitive patient data can be securely verified without exposing unnecessary information. In healthcare, protecting sensitive data while enabling seamless collaboration between doctors, laboratories, and other entities is crucial. Sharing or verifying data often leads to privacy risks. The project aims to develop a ZKP protocol for a healthcare system, allowing secure and private verification of sensitive medical data between doctors and laboratories. The ZKP protocol is implemented using a hybrid system with cloud services and local machines for secure computation. AWS Key Management Service (KMS)…

From Pixels to Predicates: Learning Symbolic World Models via Pretrained Vision-Language Models

Ashay Athalye, Nishanth Kumar, Tom Silver +4 more

cs.RO · · cited 1× · arXiv ↗ · more like this ·

Our aim is to learn to solve long-horizon decision-making problems in complex robotics domains given low-level skills and a handful of short-horizon demonstrations containing sequences of images. To this end, we focus on learning abstract symbolic world models that facilitate zero-shot generalization to novel goals via planning. A critical component of such models is the set of symbolic predicates that define properties of and relationships between objects. In this work, we leverage pretrained vision-language models (VLMs) to propose a large set of visual predicates potentially relevant for decision-making, and to evaluate those predicates directly from camera images. At training time, we pass the proposed predicates and demonstrations into an optimization-based model-learning algorithm to obtain an abstract symbolic world model that is defined in terms of a compact subset of the…

Adaptive Language-Guided Abstraction from Contrastive Explanations

Andi Peng, Belinda Z. Li, Ilia Sucholutsky +4 more

cs.RO · · cited 1× · arXiv ↗ · more like this ·

Many approaches to robot learning begin by inferring a reward function from a set of human demonstrations. To learn a good reward, it is necessary to determine which features of the environment are relevant before determining how these features should be used to compute reward. End-to-end methods for joint feature and reward learning (e.g., using deep networks or program synthesis techniques) often yield brittle reward functions that are sensitive to spurious state features. By contrast, humans can often generalizably learn from a small number of demonstrations by incorporating strong priors about what features of a demonstration are likely meaningful for a task of interest. How do we build robots that leverage this kind of background knowledge when learning from new demonstrations? This paper describes a method named ALGAE (Adaptive Language-Guided Abstraction from [Contrastive]…

MinePlanner: A Benchmark for Long-Horizon Planning in Large Minecraft Worlds

William Hill, Ireton Liu, Anita De Mello Koch +4 more

cs.AI · · cited 1× · arXiv ↗ · more like this ·

We propose a new benchmark for planning tasks based on the Minecraft game. Our benchmark contains 45 tasks overall, but also provides support for creating both propositional and numeric instances of new Minecraft tasks automatically. We benchmark numeric and propositional planning systems on these tasks, with results demonstrating that state-of-the-art planners are currently incapable of dealing with many of the challenges advanced by our new benchmark, such as scaling to instances with thousands of objects. Based on these results, we identify areas of improvement for future planners. Our framework is made available at https://github.com/IretonLiu/mine-pddl/.

Recognition Of Facial Expression By Smart Music Player Via Human Face Mood Recommendation

L. Rahunathan, D. Sivabalaselvamani, Mr.Ragavendran K +2 more

Computer Vision and Pattern Recognition · 2021 5th International Conference on Electronics, Communication and Aerospace Technology (ICECA) · · cited 1× · DOI ↗ · more like this ·

Identification of a person's intention, feeling and cognitive state requires the use of facial expressions. By building a suggestion system, it may be possible to aid a user in deciding which music to listen to, lowering the user's stress levels. To recognize facial emotion expression, researchers used YOLOv4, a type of one-shot, end-to-end deep neural network. YOLO v4 obtains progressive leads to time period, using 43.5 percent AP operating at 65 independent authorities in a Tesla V100. No one has used YOLOv4 to our knowledge.

FEIJOA: Task-Driven Grounding and Execution for Mobile Manipulation

Aditya Agarwal, William Shen, Sahit Chintalapudi +6 more

cs.RO · · cited 0× · arXiv ↗ · more like this ·

A mobile manipulator asked to "put the toys away in the toy box" must decide which objects are toys and which container the user means, then find base poses, grasps, and placements it can execute. Because a scene representation is built before the instruction is known, it may lack the attributes, affordances, or concepts needed to resolve the task. We present FEIJOA, a language-model agent that grounds the instruction at test time. It queries a grounding tool over a posed RGB-D scan, inspects the returned candidates, and refines its queries until they resolve the instruction. An embodiment-aware harness checks each skill's preconditions, samples base poses from which the target is reachable, and verifies the skill's effect from observations before and after execution. On 103 open-ended grounding queries, FEIJOA resolves 94.2% exactly, compared with 68.0% for the best prebuilt…

A Frequency-Domain Artificial Reverberator Plug-In

Jonas Roth, Nishanth Kumar, Silvan Krebs +2 more

eess.AS · · cited 0× · arXiv ↗ · more like this ·

We present FDverb, a frequency-domain artificial reverberator, based on the idea of a vocoder with a noise carrier signal. Using a short-time Fourier transform (STFT) for analysis and synthesis, FDverb generates late reverberation by weighting spectral noise components with envelopes. We extend FDverb with early reflections, nonlinear decay, and pitch shifting. These extensions enable creative sound-design applications. We provide FDverb as an open-source DAW plug-in, using the JUCE framework.

Sexual Harassment Perception and Disclosure: A Preliminary Study of Adolescent Boys in Mangaluru, India

Nadeem Qureshi, Nishanth Kumar, Muhammed Anas +3 more

Gender Studies · Journal of Health and Allied Sciences NU · · cited 0× · DOI ↗ · more like this ·

Objectives Societal expectations of male strength and toughness create a climate where male victims of sexual assault are disbelieved and shamed, leading to silencing and further victimisation. The present research assessed the perception of sexual harassment among adolescent boys and examined the barriers they face when disclosing these experiences. Material and Methods This quantitative, descriptive survey was conducted among 272 adolescent boys enrolled in Pre-University colleges. Participants were recruited using a convenience sampling technique. Data collection involved using a socio-demographic questionnaire, the Boys’ Perception of Sexual Harassment Rating Scale, and the Barriers to Disclose Sexual Harassment Checklist. Subject matter experts validated the instruments. Before data collection, ethical approval was obtained from the institutional ethics committee, and permission…

A Comprehensive Review of Current Trends and Regulatory Frameworks in Generic Drug Development

Chinna Reddy Palem*, Ravindar Rendla, Nishanth Kumar Nagamalli, Vamshi Krishna Lekkala, Sridhar Gumudevelli

Education · Zenodo (CERN European Organization for Nuclear Research) · · cited 0× · DOI ↗ · more like this ·

Generic drug development is a scientifically rigorous process distinct from innovator drug development, focusing on bioequivalence to ensure comparable safety, efficacy, and therapeutic outcomes. As innovation-driven drug development remains time and cost intensive, many pharmaceutical industries particularly in developing countries prioritize generics as a viable alternative. Current generic drug development integrates Quality by Design (QbD) principles to enhance product and process understanding, while continuous manufacturing and Process Analytical Technology (PAT) tools are increasingly adopted to ensure real-time quality control and regulatory compliance. Despite lower costs and faster timelines, developers face complex challenges in mapping innovator quality and meeting diverse, stringent regulatory standards across global regulatory such as FDA (US), EMA (Europe), PMDA (Japan)…

Next-Generation Dry Powder Inhalers: Advances in Characterization and Evolving Regulatory Frameworks

Chinna Reddy Palem1*, Vamshi Krishna Lekkala2, Nishanth Kumar Nagamalli1, Praveen Rao Balguri2, Sridhar Gumudevelli2

Artificial Intelligence · Zenodo (CERN European Organization for Nuclear Research) · · cited 0× · DOI ↗ · more like this ·

Dry powder inhalers (DPIs) have emerged as a vital platform for pulmonary drug delivery, offering targeted deposition, improved patient compliance, and enhanced formulation stability. As DPI technologies continue to advance, comprehensive characterization and regulatory alignment are essential to ensure therapeutic efficacy and patient safety. In this review covered an in-depth overview of in vitro performance testing of DPIs, including delivered dose uniformity, aerodynamic particle size distribution, fine particle dose, fine particle fraction, emitted dose, and inhaler resistance. Also covered recent advances in analytical methodologies, emphasizing their significance in predicting ex vivo and in vivo performance and maintaining batch-to-batch consistency. Discussed the regulatory framework through the perspective of the FDA’s draft guidance on metered dose inhaler and dry powder…

Seeing is Believing: Belief-Space Planning with Foundation Models as Uncertainty Estimators

Linfeng Zhao, Willie McClinton, Aidan Curtis +4 more

cs.AI · · cited 0× · arXiv ↗ · more like this ·

Generalizable robotic mobile manipulation in open-world environments poses significant challenges due to long horizons, complex goals, and partial observability. A promising approach to address these challenges involves planning with a library of parameterized skills, where a task planner sequences these skills to achieve goals specified in structured languages, such as logical expressions over symbolic facts. While vision-language models (VLMs) can be used to ground these expressions, they often assume full observability, leading to suboptimal behavior when the agent lacks sufficient information to evaluate facts with certainty. This paper introduces a novel framework that leverages VLMs as a perception module to estimate uncertainty and facilitate symbolic grounding. Our approach constructs a symbolic belief representation and uses a belief-space planner to generate uncertainty-aware…

Differentiable GPU-Parallelized Task and Motion Planning

William Shen, Caelan Garrett, Nishanth Kumar +5 more

cs.RO · · cited 0× · arXiv ↗ · more like this ·

Planning long-horizon robot manipulation requires making discrete decisions about which objects to interact with and continuous decisions about how to interact with them. A robot planner must select grasps, placements, and motions that are feasible and safe. This class of problems falls under Task and Motion Planning (TAMP) and poses significant computational challenges in terms of algorithm runtime and solution quality, particularly when the solution space is highly constrained. To address these challenges, we propose a new bilevel TAMP algorithm that leverages GPU parallelism to efficiently explore thousands of candidate continuous solutions simultaneously. Our approach uses GPU parallelism to sample an initial batch of solution seeds for a plan skeleton and to apply differentiable optimization on this batch to satisfy plan constraints and minimize solution cost with respect to soft…

Open-World Task and Motion Planning via Vision-Language Model Generated Constraints

Nishanth Kumar, William Shen, Fabio Ramos +4 more

cs.RO · · cited 0× · arXiv ↗ · more like this ·

Foundation models like Vision-Language Models (VLMs) excel at common sense vision and language tasks such as visual question answering. However, they cannot yet directly solve complex, long-horizon robot manipulation problems requiring precise continuous reasoning. Task and Motion Planning (TAMP) systems can handle long-horizon reasoning through discrete-continuous hybrid search over parameterized skills, but rely on detailed environment models and cannot interpret novel human objectives, such as arbitrary natural language goals. We propose integrating VLMs into TAMP systems by having them generate discrete and continuous language-parameterized constraints that enable open-world reasoning. Specifically, we use VLMs to generate discrete action ordering constraints that constrain TAMP search over action sequences, and continuous constraints in the form of code that augments traditional…

Urbanization, economic development, and income distribution dynamics in India

Anand Sahasranaman, Nishanth Kumar, Luis M. A. Bettencourt

physics.soc-ph · · cited 0× · arXiv ↗ · more like this ·

India's urbanization is often characterized as particularly challenging and very unequal but systematic empirical analyses, comparable to other nations, have largely been lacking. Here, we characterize India's economic and human development along with changes in its personal income distribution as a function of the nation's growing urbanization. On aggregate, we find that India outperforms most other nations in the growth of various indicators of development with urbanization, including income and human development. These results are due in part to India's present low levels of urbanization but also demonstrate the transformational role of its cities in driving multi-dimensional development. To test these changes at the more local level, we study the income distributions of large Indian cities to find evidence for high positive growth in the lowest decile (poorest) of the population…

Learning to Bridge the Gap: Efficient Novelty Recovery with Planning and Reinforcement Learning

Alicia Li, Nishanth Kumar, Tomás Lozano-Pérez +1 more

cs.RO · · cited 0× · arXiv ↗ · more like this ·

The real world is unpredictable. Therefore, to solve long-horizon decision-making problems with autonomous robots, we must construct agents that are capable of adapting to changes in the environment during deployment. Model-based planning approaches can enable robots to solve complex, long-horizon tasks in a variety of environments. However, such approaches tend to be brittle when deployed into an environment featuring a novel situation that their underlying model does not account for. In this work, we propose to learn a ``bridge policy'' via Reinforcement Learning (RL) to adapt to such novelties. We introduce a simple formulation for such learning, where the RL problem is constructed with a special ``CallPlanner'' action that terminates the bridge policy and hands control of the agent back to the planner. This allows the RL policy to learn the set of states in which querying the…