arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

New this week

New in physics.data-an Data Analysis and Statistics

16 papers in physics.data-an from 6 November to 12 November 2026.

Includes papers cross-listed here; the counts on the field chips are by primary category.

showing 1–16 of 16, newest first RSS

Peak Performance in Matched Filtering: Fused Correlation and Statistically Controlled Screening on CPUs and GPUs

Alexander H. Nitz, Keisi Kacanja, Collin D. Capano

astro-ph.IM · · cited 0× · arXiv ↗ · more like this ·

Batched matched filtering and cross-correlation over large template banks are a primary computational cost in gravitational-wave astronomy, seismology, and radio transient searches. Standard pipelines pair a general-purpose inverse Fast Fourier Transform (FFT) with separate multiplication and peak-finding kernels, writing intermediate spectra and full correlation series to memory for every template. We fuse the conjugate product into the first inverse-transform butterflies and the peak reduction into the last so only candidate peaks leave processor registers, and tile batches in 2D so $K^2$ correlations reuse $2K$ cached spectra. This shifts filtering from a DRAM-bandwidth-bound to an on-chip cache-bandwidth-bound regime. In some situations, the signal-to-noise ratio (SNR) is concentrated toward lower frequencies while higher frequencies dominate the transform length. We develop a…

Library of peptides: Analysis of a complex reactive mixture with the use of statistical physics and inference

Laura Messio, Taleen Peker, Roba Moumné +1 more

physics.chem-ph · · cited 0× · arXiv ↗ · more like this ·

Self-assembled mixtures enable the exploration of vast chemical diversity, yet characterizing the hundreds of coexisting species they contain remains a major challenge. Standard analytical techniques such as chromatography and spectroscopy produce overlapping signals that cannot be resolved by conventional deconvolution methods, which neglect the concentration correlations imposed by the reactive network. Here, we introduce a framework that bridges statistical physics and analytical chemistry to deconvolute complex self-assembled mixtures from partial spectral data. Inspired by Potts models of protein folding, we express the chemical potential of each compound as a function of a reduced set of parameters-intrinsic building-block energies and pairwise coupling terms between neighboring building blocks in the sequence. Coupling this model with the law of mass action yields equilibrium…

Visibility graphs of irregularly sampled two-dimensional fields via Voronoi tessellations

Francisco J. Muñoz, Juan Carlos Nuño

math.DS · · cited 0× · arXiv ↗ · more like this ·

Visibility graphs map a time series into a network by linking two data whenever the straight line between them is not obstructed by intermediate data. Their extension to two-dimensional fields has so far been restricted to regular lattices, where visibility is checked along a finite number of lattice directions. We propose a definition for scalar data sampled at arbitrary, irregularly scattered points of the plane. Each point is assigned its Voronoi cell, so that the data become a landscape of prisms, and two points are linked when the line of sight between them clears the cells crossed by the connecting segment. This yields horizontal ($\HVGV$) and natural ($\NVGV$) Voronoi visibility graphs that reduce exactly to the classical horizontal and natural visibility graphs when the points are collinear, contain the Gabriel graph of the point set, and can be built by an exact walk through…

Open Quantum System Embedded in an Optimized Reservoir of Molecules

Somayeh Ahmadkhani, Sara Panahian Jand, Luigi Delle Site

physics.chem-ph · · cited 0× · arXiv ↗ · more like this ·

Open-boundary Quantum Mechanics/Molecular Mechanics (QM/MM) simulation provides a direct way to test whether a quantum subsystem and its surrounding classical reservoir are physically consistent. Here we use this framework to replace a standard flexible TIP3P reservoir by a dipole-renormalized (DR) Amber-compatible three-site water model optimized against a full \textit{ab initio} trajectory of liquid water. The renormalization targets the molecular dipole distribution and adjusts the atomic charges, bonded, and Lennard-Jones interaction parameters through a stochastic optimization procedure. In the case of a large QM region ($\langle N\rangle\approx 440$), where the surface-to-volume ratio is small, the DR reservoir induces, as expected, Grand Canonical statistics for the quantum subsystem. In smaller subsystems ($\langle N\rangle\approx 190$), where the surface-to-volume condition is…

Chaos without Local Spectral Instability in a Kicked Oscillator

Vincenzo Citro, Giuseppe Petrillo, Didier Sornette

nlin.CD · · cited 0× · arXiv ↗ · more like this ·

A damped harmonic oscillator kicked by a pulsed periodic potential can be chaotic although every local Jacobian has eigenvalues inside the unit circle. Damped rotation between kicks lets non-normal shears of opposite curvature compound, so ordered products of contracting Jacobians amplify perturbations. We derive the exact joint spectral radius of the Jacobian family and an exact Lyapunov-exponent decomposition showing how this geometric pumping overcomes dissipation. The proposed mechanism can be realized with laser-cooled trapped ions in a pulsed optical lattice.

Learning to Calibrate Jet Energies

Bogdan Malaescu, Benjamin Nachman, Mukul Ram +2 more

physics.data-an · · cited 0× · arXiv ↗ · more like this ·

Hadronic jets are produced copiously at the Large Hadron Collider, and are a vital element of its physics program. Accurate reconstruction of their energies is therefore crucial, including correction for pile-up, detector response and data-simulation differences. Currently, each correction is performed by fitting parametric functional forms, an approach which is effective but can be fragile and challenging to extend. We present a prototype machine-learning pipeline which performs pile-up dependency removal, absolute corrections and data-mc corrections. No functional form is imposed on the correction, additional features can be easily added, and the pipeline matches or exceeds the performance of the functional approach at nearly every stage.

A regularization-independent Information Criterion for correlated data

Davide Laudicina

hep-lat · · cited 0× · arXiv ↗ · more like this ·

We generalize the Akaike Information Criterion (AIC) to allow model and data subset selection when regularized fits are performed on correlated data. While the standard generalization to regularized fits is inherently dependent on the type of regularization applied to the data covariance matrix, our definition, the RIAIC, is, on average, regularization-independent. The regularization-independence is achieved by defining the new Information Criterion as an estimator of the model-dependent contribution to the correlated Kullback--Leibler divergence. The Bayesian extension is derived as well. We test the new criterion on lattice QCD data by performing regularized fits and show that it reproduces the selection properties of the standard correlated AIC, with fluctuations which are compatible with the expected statistical uncertainties. These results enable the application of subset and model…

Distinguishing thyroid nodule malignancy using digital palpation

Brendan M. Unikewicz, Joseph E. Bonavia, Ekaterina L. Koelliker +7 more

physics.data-an · · cited 0× · arXiv ↗ · more like this ·

Accurate pre-operative diagnosis of thyroid nodules remains a major clinical challenge. Current diagnostic techniques rely on fine-needle aspiration and demonstrate high rates of inconclusive results, often leading to avoidable thyroidectomies with lifelong implications. Here, we introduce a mechanics-based diagnostic method that leverages Digital Palpation to determine malignancy and identify tissue subtypes in human thyroid nodules. From a cohort of patients undergoing thyroidectomies, we evaluated ex vivo thyroid specimens and processed the resulting mechanical data from 36 tests in 10 thyroid nodules. Principal Component Analysis reveals that these experimental results are distributed within a three-dimensional space of interpretable scalar features reflecting tissue grittiness, strength, and toughness, which map closely to descriptions of malignant and benign nodules given by…

Causal discovery from Bayesian symbolic regression

Roger Guimerà, Kai-Hendrik Cohrs, Sergio Pedreira +2 more

stat.ML · · cited 0× · arXiv ↗ · more like this ·

Causal discovery from observational data is central to scientific reasoning, yet established constraint-based and score-based methods often recover only a Markov equivalence class and provide no signal in bivariate or strongly autocorrelated regimes typical in some areas of science. Here, we recast causal discovery as a Bayesian symbolic regression problem. Given a set of candidate parents for each target variable, the Bayesian symbolic regression samples closed-form expressions from a posterior over symbolic models. The fraction of sampled expressions in which each candidate variable appears defines a posterior inclusion probability that we use as the causal score. This replaces pointwise model selection by an ensemble of plausible mechanisms. We evaluate the method on coupled nonlinear bivariate dynamics, on the CauseMe benchmark suite spanning linear, chaotic, nonlinear…

FAIR Universe Weak Lensing ML Uncertainty Challenge: Dataset and Cosmological Inference Competition

Biwei Dai, Po-Wen Chang, Erwan Allys +37 more

astro-ph.CO · · cited 0× · arXiv ↗ · more like this ·

Weak gravitational lensing is a powerful cosmological probe that enables direct mapping of the matter distribution and precise constraints on the fundamental parameters governing structure formation in the universe. In recent years, machine learning has shown strong potential for extracting cosmological information from weak-lensing data beyond traditional summary statistics. However, progress has been limited by the lack of standardized benchmarks that capture the complexity of the dataset, simulator imperfections, and various systematic biases encountered in realistic analyses. To address this gap, we present the FAIR Universe Weak Lensing Machine Learning Uncertainty Challenge, one of the NeurIPS 2025 competitions, as a benchmark dataset and evaluation study. Our dataset reflects realistic weak-lensing observations, incorporating multiple systematic biases, and thereby providing a…

Test beam results for machine-learning-based reconstruction of resistive silicon sensors

Don C. Wong, Leena Diehl, Spencer Ellis +14 more

physics.ins-det · · cited 0× · arXiv ↗ · more like this ·

The advent of Low-Gain Avalanche Diodes (LGADs) and AC-coupled Low-Gain Avalanche Diodes (AC-LGADs) as candidate technologies for four-dimensional tracking has moved part of the reconstruction burden onto the analog waveforms of the sensor, in which the charge shared between electrodes encodes the impact position well below the electrode pitch. Recovering that position is a continuous, non-linear inverse problem. Transient Current Technique measurements characterize this problem at fixed injected charge and high signal-to-noise, whereas a minimum-ionizing beam adds Landau fluctuations in the deposited charge under detector operating conditions. We report test beam results for full-waveform reconstruction of an AC-LGAD of 500 $μ$m pitch read out on a $2\times2$ pad matrix, exposed to the 120 GeV pion beam of the CERN Super Proton Synchrotron (SPS) and read out alongside a six-plane…

Beyond node strengths: the topological content of weighted bipartite networks

Daniele Cirulli, Lorenzo Buffa, Giulio Cimini +3 more

physics.soc-ph · · cited 0× · arXiv ↗ · more like this ·

Weighted bipartite networks encode the topology and intensity of interactions between two disjoint sets of nodes. However, it is unclear whether the observed pattern of connections is already explained by node interaction volumes or contains additional structural information. Here we introduce a hierarchy of maximum-entropy models for continuous weighted bipartite networks that preserves node strengths alone, strengths and global density, or strengths and the complete degree sequence. Across economic, technological, ecological, social and lexical systems, we find that strength constraints alone are generally insufficient to reproduce empirical structures. Yet the missing topological information is often low-dimensional: a single constraint controlling network density frequently provides the most parsimonious description, whereas networks with stronger residual degree heterogeneity…

Domain Adaptive Graph Neural Networks for Neutrino Experiments

Hemalata Nayak, Giuseppe Cerati, Aleksandra Ćiprijanović +1 more

physics.data-an · · cited 0× · arXiv ↗ · more like this ·

Weakly interacting particles such as neutrinos require highly efficient and precise detection methods to enable searches for new physics. Deep learning, and particularly Graph Neural Networks (GNNs), has shown promise for reconstruction tasks in liquid argon time projection chamber (LArTPC) neutrino experiments. However, differences between simulations and experimental data introduce domain shifts that can degrade model performance and potentially mimic or obscure new-physics signals. Here, we demonstrate that robust learning across datasets can still be achieved by using domain adaptation during training. We introduce, to our knowledge for the first time, domain-adaptation-enabled GNNs for robust LArTPC reconstruction tasks. We use MicroBooNE open dataset as our labeled source domain, and introduce four perturbed datasets as our unlabeled target domains-- including a fixed scale…

Scalable Unitary State-Encoding for Generic Large Data

Vittorio Pagni, Peter K. Schuhmacher, Michael Felderer +2 more

quant-ph · · cited 0× · arXiv ↗ · more like this ·

Efficient encoding of data into quantum states remains a fundamental bottleneck in many quantum computing protocols, which would otherwise offer advantages over their classical counterparts. Here, we introduce deterministic and scalable amplitude-encoding methods with low two-qubit gate costs and tunable trade-offs between circuit depth and encoding fidelity. Our approaches require no amplitude amplification or mid-circuit measurement and are capable of encoding arbitrary complex data or queryable functions by using tensor-networks to go beyond what can be held in classical memory. Our principle contributions are two complementary algorithms for simplifying fully controlled multiplexer circuits to one- and two-qubit gates. In the first, we formally map the elimination of redundant gate controls to a Boolean logic minimization problem, while in the second we utilize a single ancilla…

comfort-db: A Python toolkit to access, preprocess and explore the oceanographic COMFORT dataset

Yvonne Jenniges, Are Olsen, Boris Peter Koch +1 more

cs.SE · · cited 0× · arXiv ↗ · more like this ·

comfort-db is a Python library that facilitates working with the COMFORT SQLite dataset, version 2. The dataset assembles global oceanographic measurements from ten datasets and contains a total of 458,724,734 in situ measurements from the years 1772 to 2020. comfort-db enables easy access to the database and provides preprocessing and exploratory analysis utilities. Preprocessing supports variable scaling and filtering by space, time and quality. Unit conversions can be applied during data loading or separately via a converter object. Gridding is supported and optionally works with bathymetry data to exclude grid cells on land. Moreover, the library supports general and field-specific exploratory data analysis through plotting functions, an interactive Dash app and functions to compute oceanographic profile and water mass statistics. comfort-db is open source (MIT license) and…

Domain-Adapted Deep Optical Flow for Multiphase Velocimetry in Unsteady Cloud Cavitation

Naga Nitish Chamala, Sanjay Vasanth Kethanur Balasubramaniam, Olivier Coutier-Delgosha

physics.flu-dyn · · cited 0× · arXiv ↗ · more like this ·

Time-resolved velocimetry inside cloud cavitation remains a fundamental measurement problem. Particle image velocimetry (PIV) requires uniform tracer seeding and undistorted particle images, and cavitating flow violates both, because tracers do not penetrate vapor structures and refractive index mismatch across deforming interfaces produces spurious vectors. We present a domain-adapted deep optical flow framework for two-phase velocimetry, built on a Recurrent All-Pairs Field Transforms (RAFT) architecture fine-tuned on synthetic image pairs rendered from multiphase OpenFOAM simulations (RAFT-CloudCav). It is evaluated against a pre-trained generalist RAFT model, Farnebäck and OpenPIV on 130,000 frames/s recordings of a Venturi test section at 30 and 48 L/min. As no experimental ground truth exists, validation uses three quantities that require none, namely the integrated flow rate…