arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Deep Shah

19 papers · 2007–2026

2007: 12008: 02009: 02010: 02011: 02012: 02013: 12014: 02015: 12016: 02017: 02018: 12019: 02020: 02021: 02022: 02023: 02024: 02025: 12026: 14
2007peak 14 in 20262026

Frequent co-authors

Papers

showing 1–19 of 19 RSS

Automatic text summarization of Wikipedia articles

Dharmendra Hingu, Deep Shah, Sandeep S. Udmale

Artificial Intelligence · · cited 37× · DOI ↗ · more like this ·

The main objective of a text summarization system is to identify the most important information from the given text and present it to the end users. In this paper, Wikipedia articles are given as input to system and extractive text summarization is presented by identifying text features and scoring the sentences accordingly. The text is first pre-processed to tokenize the sentences and perform stemming operations. We then score the sentences using the different text features. Two novel approaches implemented are using the citations present in the text and identifying synonyms. These features along with the traditional methods are used to score the sentences. The scores are used to classify the sentence to be in the summary text or not with the help of a neural network. The user can provide what percentage of the original text should be in the summary. It is found that scoring the…

Electronic Properties of Carbon Nanotubes Calculated from Density Functional Theory and the Empirical pi-Bond Model

Deep Shah, Nicolas A. Bruque, Khairul Alam +2 more

cond-mat.mes-hall · · cited 10× · arXiv ↗ · more like this ·

The validity of the DFT models implemented by FIREBALL for CNT electronic device modeling is assessed. The effective masses, band gaps, and transmission coefficients of semi-conducting, zigzag, (n,0) carbon nanotubes (CNTs) resulting from the ab initio tight-binding density functional theory (DFT) code FIREBALL and the empirical, nearest-neighbor pi-bond model are compared for all semiconducting n values 5 <(=) n <(=) 35. The DFT values for the effective masses differ from the pi-bond values by +(-) 9% over the range of n values, 17 <(=) n <(=) 29, most important for electronic device applications. Over the range 13 <(=) n <(=) 35, the DFT bandgaps are less than the empirical bandgaps by 20-180 meV depending on the functional and the n value. The pi-bond model gives results that differ signifcantly from the DFT results when the CNT diameter goes below 1 nm due to the large curvature of…

Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security

Sanket Badhe, Deep Shah, Priyanka Tiwari +1 more

cs.AI · · cited 1× · arXiv ↗ · more like this ·

Autonomous large language model (LLM) agents increasingly face reliability, context consumption, and execution stability bottlenecks when deployed on complex, long-horizon tasks. While monolithic prompt engineering and stateless tool-calling paradigms struggle to scale, the field is rapidly converging toward \emph{agentic skills}: modular procedural abstractions that externalize execution knowledge into reusable, executable, and portable artifacts. This paper establishes a unified systems foundation and reference architecture for the agentic skills ecosystem. We formalize skills as externalized procedural knowledge bridging high-level cognitive planning with deterministic execution environments, and systematically delineate the architecture across a nine-stage lifecycle: autonomous discovery, authoring and representation formats, memory storage, dynamic retrieval and routing…

Smart Model Routing for Order-of-Magnitude LLM Cost Reduction

Hesham Elbakoury, Deep Shah, Ankur Sharma

cs.DC · · cited 0× · arXiv ↗ · more like this ·

Frontier large language models (LLMs) deliver the strongest response quality but carry per-token prices often more than an order of magnitude above those of smaller, task-adequate models. Smart model routing addresses this mismatch by assigning each query to the cheapest model expected to answer it adequately, rather than sending every request to the most capable, most expensive endpoint. This paper develops a formal cost-quality optimization framework for routing -- including a derived optimal threshold-policy structure, a calibration-versus-discrimination distinction, a cascade breakeven condition, and a sensitivity analysis over price ratio and traffic skew -- situates that framework against the principal routing architectures and the signals used to estimate query difficulty, and works through a numerical example showing how a calibrated router can reduce blended inference cost by…

Last Translation Benchmark

Vilém Zouhar, Niyati Bafna, Mukund Choudhary +257 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

For scientific progress, we need benchmarks that test the limits of state-of-the-art models, and evaluation methods that inform us about failure cases. As models get stronger, standard benchmarks for machine translation are approaching saturation. Further, automatic translation metrics are unreliable, opaque, and vulnerable to reward-hacking. Even gold human evaluation is not problem-free, because it often lacks reproducibility, objectivity, and scalability. Overall, this prevents us from tracking progress in the field and identifying pathways for improvement. We introduce the Last Translation Benchmark, a collection of human-authored and peer-reviewed examples (texts, images, audio, videos) that break leading machine translation models. We also present a new evaluation approach: each example comes with handcrafted verification rules describing concrete failure cases on that example…

Assessment of operational preparedness of Ayushman arogya mandirs for comprehensive primary health care in Bhavnagar district of Western India

Kartik Prajapati, Kailesh Bhalani, Deep Shah

Political Science and International Relations · Discover Public Health · · cited 0× · DOI ↗ · more like this ·

Ayushman Arogya Mandirs (AAMs) under the Ayushman Bharat programme are central to delivering comprehensive primary health care, aligned with the goals of ‘universal health coverage’ and ‘health for all’. Assessing their preparedness is essential to ensure effective service delivery. To assess the preparedness of Ayushman arogya mandirs in Bhavnagar district. A cross-sectional assessment of 63 AAMs in Bhavnagar district was conducted from July 2021 to September 2022. Facilities were evaluated through physical inspection, record verification and staff interviews. Findings were summarized using descriptive statistics. Most AAMs had dedicated buildings (85.7%), out-patient department rooms (100%) and waiting areas (82.5%); however, facility signages and staff information displays were poorly available (< 25%). Information, education and communication materials were largely displayed in…

CATAPP: A SMART DEVICE APPLICATION FOR WINDOWS PHONE

Jadhav Archana, Bingi Nayana, Lokhande Priyanka +3 more

Information Systems · · cited 0× · OpenAlex ↗ · more like this ·

CATApp is a mobile application developed for MBA aspirants to help them prepare on the go. It basically lets the user take test on the mobile device and track progress for each category of questions. It is currently available on Android and iOS platforms. Owing to the upcoming release of Windows 8 SDK supporting metro interface, we are planning to develop the app for Windows platform. Windows version of the app will mainly focus on tablets and phones. As Microsoft is working hard to compete with Android and iOS by implementing cutting edge features required for mobile platform, it is the right time to start developing apps for Windows Phone.

The Agent Operating System (AOS): A Reference Operating Architecture for Distributed Agentic Systems

Ankur Sharma, Deep Shah

cs.AI · · arXiv ↗ · more like this ·

Large language models have transformed artificial intelligence from isolated prediction services into components of long-running, distributed systems that reason, invoke tools, retrieve external state, delegate tasks, and act on behalf of users and organizations. The surrounding ecosystem has responded with agent frameworks, workflow engines, model-serving platforms, memory systems, communication protocols, and observability tools. These technologies improve execution, but they do not provide a stable, implementation-independent operating architecture for governing intent, selecting capabilities, preserving authority across delegation, controlling uncertainty, coordinating runtime behavior, and reconstructing why consequential actions occurred. This paper proposes the Agent Operating System (AOS), a vendor-neutral reference operating architecture for distributed agentic systems. AOS…

MVEB: Massive Video Embedding Benchmark

Adnan El Assadi, Roman Solomatin, Isaac Chung +13 more

cs.CV · · arXiv ↗ · more like this ·

We introduce the Massive Video Embedding Benchmark (MVEB), a 23-task benchmark for video embeddings spanning classification, zero-shot classification, clustering, pair classification, retrieval, and video-centric question answering. We evaluate 33 models and find that no single model dominates: MLLM-based embeddings lead on classification, clustering, pair classification, and QA; multimodal binding leads on retrieval and zero-shot classification; generative MLLMs without contrastive adaptation collapse on cross-modal tasks. Paired video-only vs. audio+video evaluations show that audio's contribution depends on dataset annotation provenance: audio helps when labels were produced from both modalities and hurts when they were produced from visuals alone, a six-point gap consistent across model families. MVEB is derived from MVEB+, a 184-task pool, and is designed to maintain task diversity…

Agent Operating Systems (AOS): Integrating Agentic Control Planes into, and Beyond, Traditional Operating Systems

Ankur Sharma, Deep Shah

cs.CR · · arXiv ↗ · more like this ·

Traditional operating systems were designed around deterministic programs, explicit control flow, and human initiated workflows. Their core abstractions processes, threads, system calls, files, and permissions assume bounded behavior and predictable interaction patterns. Agentic AI systems introduce a different execution model: long-lived, goal-directed entities that reason probabilistically, invoke tools dynamically, and adapt behavior based on feedback. While agents can be implemented as user-space applications today, their execution characteristics stress OS boundaries in scheduling, memory and state management, security, observability, and governance. This paper introduces the concept of an Agent Operating System (AOS), a systems architecture that integrates an agentic control plane into existing operating systems or, in some models, subsumes selected OS responsibilities over time.…

The Silent Vote: Improving Zero-Shot LLM Reliability by Aggregating Semantic Neighborhoods

Sanket Badhe, Priyanka Tiwari, Deep Shah

cs.CL · · arXiv ↗ · more like this ·

Large Language Models are increasingly used as zero-shot classifiers in complex reasoning tasks. However, standard constrained decoding suffers from a phenomenon we define as Renormalization Bias. When a model is restricted to a small set of target labels, the standard softmax operation discards the probability mass assigned to semantic synonyms in the original distribution. This loss of information, which we call the Silent Vote, results in artificial overconfidence and poor calibration. We propose Semantic Softmax, an inference-time layer that recovers this lost information by aggregating the scores of the semantic neighborhood surrounding each target label. We evaluate this approach on Qwen-3 and Phi-4-mini models using GoEmotions and Civil Comments datasets. Our results demonstrate consistent improvements across all evaluation metrics: Semantic Softmax substantially reduces Expected…

Time, Causality, and Observability Failures in Distributed AI Inference Systems

Ankur Sharma, Deep Shah, David Lariviere +1 more

cs.AI · · arXiv ↗ · more like this ·

Distributed AI inference pipelines rely heavily on timestamp-based observability to understand system behavior. This work demonstrates that even small clock skew between nodes can cause observability to become causally incorrect while the system itself remains functionally correct and performant. We present controlled experiments on a multi-node AI inference pipeline, where clock skew is introduced at a single stage. Results show that no violations are observed under synchronized conditions and up to 3 ms skew, while clear causality violations emerge by 5 ms. Despite this, system throughput and output correctness remain largely unaffected. We further observe that violation behavior is not strictly static. In longer runs, negative span rates may stabilize or decrease over time, indicating that effective skew evolves due to relative clock drift between nodes. Experiments were conducted…

CROP: Token-Efficient Reasoning in Large Language Models via Regularized Prompt Optimization

Deep Shah, Sanket Badhe, Nehal Kathrotia +1 more

cs.CL · · arXiv ↗ · more like this ·

Large Language Models utilizing reasoning techniques improve task performance but incur significant latency and token costs due to verbose generation. Existing automatic prompt optimization(APO) frameworks target task accuracy exclusively at the expense of generating long reasoning traces. We propose Cost-Regularized Optimization of Prompts (CROP), an APO method that introduces regularization on response length by generating textual feedback in addition to standard accuracy feedback. This forces the optimization process to produce prompts that elicit concise responses containing only critical information and reasoning. We evaluate our approach on complex reasoning datasets, specifically GSM8K, LogiQA and BIG-Bench Hard. We achieved an 80.6\% reduction in token consumption while maintaining competitive accuracy, seeing only a nominal decline in performance. This presents a pragmatic…

Long-Tail Knowledge in Large Language Models: Taxonomy, Mechanisms, Interventions and Implications

Sanket Badhe, Deep Shah, Nehal Kathrotia

cs.CL · · arXiv ↗ · more like this ·

Large language models (LLMs) are trained on web-scale corpora that exhibit steep power-law distributions, in which the distribution of knowledge is highly long-tailed, with most appearing infrequently. While scaling has improved average-case performance, persistent failures on low-frequency, domain-specific, cultural, and temporal knowledge remain poorly characterized. This paper develops a structured taxonomy and analysis of long-Tail Knowledge in large language models, synthesizing prior work across technical and sociotechnical perspectives. We introduce a structured analytical framework that synthesizes prior work across four complementary axes: how long-Tail Knowledge is defined, the mechanisms by which it is lost or distorted during training and inference, the technical interventions proposed to mitigate these failures, and the implications of these failures for fairness…

Mining Generalizable Activation Functions

Alex Vitvitskyi, Michael Boratko, Matej Grcic +3 more

cs.LG · · arXiv ↗ · more like this ·

The choice of activation function is an active area of research, with different proposals aimed at improving optimization, while maintaining expressivity. Additionally, the activation function can significantly alter the implicit inductive bias of the architecture, controlling its non-linear behavior. In this paper, in line with previous work, we argue that evolutionary search provides a useful framework for finding new activation functions, while we also make two novel observations. The first is that modern pipelines, such as AlphaEvolve, which relies on frontier LLMs as a mutator operator, allows for a much wider and flexible search space; e.g., over all possible python functions within a certain FLOP budget, eliminating the need for manually constructed search spaces. In addition, these pipelines will be biased towards meaningful activation functions, given their ability to represent…

Prompt-Level Distillation: A Non-Parametric Alternative to Model Fine-Tuning for Efficient Reasoning

Sanket Badhe, Deep Shah

cs.CL · · arXiv ↗ · more like this ·

Advanced reasoning typically requires Chain-of-Thought prompting, which is accurate but incurs prohibitive latency and substantial test-time inference costs. The standard alternative, fine-tuning smaller models, often sacrifices interpretability while introducing significant resource and operational overhead. To address these limitations, we introduce Prompt-Level Distillation (PLD). We extract explicit reasoning patterns from a Teacher model and organize them into a structured list of expressive instructions for the Student model's System Prompt. Evaluated using Gemma-3 4B, PLD improved Macro F1 scores on StereoSet (57\% to 90.0\%) and Contract-NLI (67\% to 83\%), while increasing LogiQA accuracy to 70\%. Similar results on Mistral Small 3.1 demonstrate cross-architecture generalizability, enabling these compact models to match frontier performance with negligible latency overhead.…

Taxonomy of the Retrieval System Framework: Pitfalls and Paradigms

Deep Shah, Sanket Badhe, Nehal Kathrotia

cs.IR · · arXiv ↗ · more like this ·

Designing an embedding retrieval system requires navigating a complex design space of conflicting trade-offs between efficiency and effectiveness. This work structures these decisions as a vertical traversal of the system design stack. We begin with the Representation Layer by examining how loss functions and architectures, specifically Bi-encoders and Cross-encoders, define semantic relevance and geometric projection. Next, we analyze the Granularity Layer and evaluate how segmentation strategies like Atomic and Hierarchical chunking mitigate information bottlenecks in long-context documents. Moving to the Orchestration Layer, we discuss methods that transcend the single-vector paradigm, including hierarchical retrieval, agentic decomposition, and multi-stage reranking pipelines to resolve capacity limitations. Finally, we address the Robustness Layer by identifying architectural…

Collective Communication for 100k+ GPUs

Min Si, Pavan Balaji, Yongzhou Chen +36 more

cs.DC · · arXiv ↗ · more like this ·

The increasing scale of large language models (LLMs) necessitates highly efficient collective communication frameworks, particularly as training workloads extend to hundreds of thousands of GPUs. Traditional communication methods face significant throughput and latency limitations at this scale, hindering both the development and deployment of state-of-the-art models. This paper presents the NCCLX collective communication framework, developed at Meta, engineered to optimize performance across the full LLM lifecycle, from the synchronous demands of large-scale training to the low-latency requirements of inference. The framework is designed to support complex workloads on clusters exceeding 100,000 GPUs, ensuring reliable, high-throughput, and low-latency data exchange. Empirical evaluation on the Llama4 model demonstrates substantial improvements in communication efficiency. This…