arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Ruichen Xu

27 papers · 2023–2026

2023: 12024: 42025: 102026: 12
2023peak 12 in 20262026

Frequent co-authors

Papers

showing 1–25 of 27 RSS

Tackling Privacy Heterogeneity in Federated Learning

Ruichen Xu, Ying–Jun Angela Zhang, Jianwei Huang

Artificial Intelligence · · cited 2× · DOI ↗ · more like this ·

Differentially private federated learning enables clients with privacy concerns to collaboratively train a model while preserving their privacy. Clients' locally available data and maximum tolerable privacy budgets will affect their contributions to the training performance. To date, existing studies focus on homogeneous privacy budgets and thus there lack systematic studies regarding the impact of clients' diverse privacy budgets (privacy heterogeneity). This paper represents the first step toward filling this gap. Through rigorous convergence analysis, we illustrate that the influence of privacy protection on training loss is affected by client selection probabilities. In addition, client selection and privacy protection together induce a non-vanishing training error in federated learning. Our analysis then shows that the non-vanishing training error is a convex function of client…

Joint Client Selection and Privacy Compensation for Differentially Private Federated Learning

Ruichen Xu, Ying–Jun Angela Zhang, Jianwei Huang

Artificial Intelligence · · cited 1× · DOI ↗ · more like this ·

Differentially private federated learning learns a global machine learning model from clients' distributed private data while providing privacy protections. However, clients under differential privacy protection still sustain a certain degree of potential privacy leakage, which can result in the clients' reluctance to participate in model training. Hence, both client selection and privacy compensation are important decisions to determine which clients will join the learning. In particular, since a client's privacy leakage increases with his participation frequency, the client selection decision is tightly coupled with the privacy compensation. This paper proposes a joint client selection and privacy compensation Bayesian-optimal mechanism design approach. Despite being a challenging non-convex optimization problem, we propose an efficient algorithm to solve it. We first characterize the…

Nonvanishing of special $L$-values of cusp forms on $\mathrm{GL}(2)$ with totally split prime power twists: without the class number hypothesis

Ruichen Xu

math.NT · · cited 0× · arXiv ↗ · more like this ·

Let $F$ be a number field and $f$ a normalized cuspidal Hecke eigenform on $\mathrm{GL}(2)$ over $F$, with $k/2$ as the central critical point of its $L$-function $L(f,s)$. Let $\mathfrak{p}$ be a totally split prime ideal of $F$ lying above an odd prime $p$ and coprime to the level ideal of $f$. In this article, we show that $L(f\otimesϕ, k/2)$ does not vanish for sufficiently ramified Hecke characters of $F$ of $p$-power order and $\mathfrak{p}$-power conductor. Our result improves previous works of Jaesung Kwon and Hae-Sang Sun, in which the additional hypothesis that $p$ does not divide the class number of $F$ is required.

Less Data, Better Timing: Student-Curriculum Coupling for VLM On-Policy Distillation in Temporal Video Grounding

Jiacheng Qiu, Yunsoo Kim, Ruichen Xu +3 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

On-policy distillation (OPD) provides dense supervision directly on student-generated trajectories, making it an effective post-training strategy for vision-language models in temporal video grounding (TVG). However, existing pipelines typically construct the training curriculum from a fixed teacher and the initial student state, implicitly assuming that selected examples retain positive supervision value throughout optimization. We show that supervision trustworthiness and supervision necessity are distinct yet coupled: the former concerns target credibility, while the latter varies with the student's current task competence; together, they shape supervision value. Building on this coupled view, we introduce Student-Curriculum Coupling (SCC), a closed-loop framework in which a compact Anchor-Frontier curriculum defines the candidate supervision space and the evolving student…

PDE-OBS: Controlled Evaluation Across Observation Patterns

Ruichen Xu, Siyao Wang, Fang Wan +7 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Physical-field reconstruction and forecasting depend on both measurement density and spatial layout, yet evaluation under a single observation pattern does not characterize performance when that pattern changes. We introduce PDE-OBS, an integrated benchmarking platform spanning numerical data generation, model training, and inference and evaluation under varying observation conditions. It combines 560,000 fields and trajectories from seven partial differential equation families with configurable observation operators and seven adapted baseline methods for stationary reconstruction and short-horizon forecasting. Separating observation construction from physical records allows users to specify parameterized patterns and deterministic mixtures for training and testing while preserving prediction targets and data splits. The evaluation protocol uses references trained for each test pattern…

SCOPE: Observation-Conditioned Full-Target Prediction for Sparse PDE Inference

Ruichen Xu, Siyao Wang, Fang Wan +8 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Recovering complete physical fields from sparse observations is challenging because the measurements may not uniquely determine the underlying state. Diffusion-based PDE solvers address this problem through iterative sampling whereas neural operators provide deterministic one-pass predictions. We propose SCOPE (Sparse-Context Observability-aware Predictive Embeddings) to recover complete PDE fields from sparse observations by coupling full-field latent prediction with physical reconstruction. A shared decoder reconstructs fields from both predicted and complete-view representations so that representation learning is guided by both physical recovery and latent matching. We derive a quadratic risk decomposition at fixed teacher-decoder pairs showing why optimal latent prediction need not yield optimal field reconstruction. We also establish sufficient conditions for decoder improvements…

Zeta elements for $p$-ordinary modular forms over imaginary quadratic fields and applications

Ruichen Xu

math.NT · · cited 0× · arXiv ↗ · more like this ·

Let $p\geq 5$ be a prime, and let $f$ be a $p$-ordinary cuspidal newform of even weight $k = 2r \geq 2$ and level $N$, with $p \nmid N$ and trivial nebentype. In this article, we prove Kato's Iwasawa main conjecture for $f$, formulated in terms of the $p$-adic $L$-function of $f$, under the sole assumptions that the associated Galois representation of $f$ satisfies the big-image hypothesis and that its residual representation is absolutely irreducible. This generalises the main result of Burungale--Castella--Skinner, which treats elliptic curves over $\mathbb{Q}$ with good ordinary reduction at $p$. Our proof follows their general strategy. A key new ingredient is the construction, over an imaginary quadratic field in which $p$ splits, of a zeta element attached to $f$, together with a proof of its explicit reciprocity laws, generalising the corresponding work of…

Pseudonullity for fine Selmer groups over multiple $\mathbb{Z}_p^{d}$-extensions

Peikai Qi, Ruichen Xu

math.NT · · cited 0× · arXiv ↗ · more like this ·

In this article, we develop vertical control theorems for fine Selmer groups associated with Galois representations and their deformations in $p$-adic families. We apply them to provide new evidence for Conjectures A and B of Coates--Sujatha and to obtain pseudonullity of the fine Selmer groups for cyclotomic characters, elliptic curves, classical cuspidal newforms, and Hida families of $p$-ordinary cuspidal newforms.

Kolmogorov-Arnold Representation for Symplectic Learning: Advancing Hamiltonian Neural Networks

Zongyu Wu, Ruichen Xu, Luoyao Chen +3 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

We propose a Kolmogorov-Arnold Representation-based Hamiltonian Neural Network (KAR-HNN) that replaces the Multilayer Perceptrons (MLPs) with univariate transformations. While Hamiltonian Neural Networks (HNNs) ensure energy conservation by learning Hamiltonian functions directly from data, existing implementations, often relying on MLPs, cause hypersensitivity to the hyperparameters while exploring complex energy landscapes. Our approach exploits the localized function approximations to better capture high-frequency and multi-scale dynamics, reducing energy drift and improving long-term predictive stability. The networks preserve the symplectic form of Hamiltonian systems, and thus maintain interpretability and physical consistency. After assessing KAR-HNN on four benchmark problems including spring-mass, simple pendulum, two- and three-body problem, we foresee its effectiveness for…

Provable Knowledge Acquisition and Extraction in One-Layer Transformers

Ruichen Xu, Kexin Chen

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Large language models may encounter factual knowledge during pre-training yet fail to reliably use that knowledge after fine-tuning. Despite growing empirical evidence that MLP layers store factual associations and fine-tuning affects factual recall, the training-dynamics mechanisms linking next-token pre-training, knowledge storage, and post-fine-tuning extraction remain poorly understood. We study this problem in a stylized one-layer transformer with self-attention and MLP modules, trained by next-token prediction and subsequently fine-tuned on question-answering data. Under suitable regularity conditions, we first prove that the model reaches near-optimal pre-training loss while learning structured attention patterns and relation-specific feature directions, giving a mechanism for factual knowledge acquisition. We then show that fine-tuning can turn the Q&A prompt format into a…

GAGA: Gaussianity-Aware Gaussian Approximation for Efficient 3D Molecular Generation

Jingxiang Qu, Wenhan Gao, Ruichen Xu +1 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Gaussian Probability Path based Generative Models (GPPGMs) generate data by reversing a stochastic process that progressively corrupts samples with Gaussian noise. Despite state-of-the-art results in 3D molecular generation, their deployment is hindered by the high cost of long generative trajectories, often requiring hundreds to thousands of steps during training and sampling. In this work, we propose a principled method, named GAGA, to improve generation efficiency without sacrificing training granularity or inference fidelity of GPPGMs. Our key insight is that different data modalities obtain sufficient Gaussianity at markedly different steps during the forward process. Based on this observation, we analytically identify a characteristic step at which molecular data attains sufficient Gaussianity, after which the trajectory can be replaced by a closed-form Gaussian approximation.…

Velocity-Inferred Hamiltonian Neural Networks: Learning Energy-Conserving Dynamics from Position-Only Data

Ruichen Xu, Zongyu Wu, Luoyao Chen +5 more

physics.comp-ph · · cited 0× · arXiv ↗ · more like this ·

Data-driven modeling of physical systems often relies on learning both positions and momenta to accurately capture Hamiltonian dynamics. However, in many practical scenarios, only position measurements are readily available. In this work, we introduce a method to train a standard Hamiltonian Neural Network (HNN) using only position data, enabled by a theoretical result that permits transforming the Hamiltonian $H(q,p)$ into a form $H(q, v)$. Under certain assumptions, namely, an invertible relationship between momentum and velocity, we formally prove the validity of this substitution and demonstrate how it allows us to infer momentum from position alone. We apply our approach to canonical examples including the spring-mass system, pendulum, two-body, and three-body problems. Our results show that using only position data is sufficient for stable and energy-consistent long-term…

The Impact of Move Schemes on Simulated Annealing Performance

Ruichen Xu, Haochun Wang, Yuefan Deng

math.OC · · cited 0× · arXiv ↗ · more like this ·

Designing an effective move-generation function for Simulated Annealing (SA) in complex models remains a significant challenge. In this work, we present a combination of theoretical analysis and numerical experiments to examine the impact of various move-generation parameters -- such as how many particles are moved and by what distance at each iteration -- under different temperature schedules and system sizes. Our numerical studies, carried out on both the Lennard-Jones problem and an additional benchmark, reveal that moving exactly one randomly chosen particle per iteration offers the most efficient performance. We analyze acceptance rates, exploration properties, and convergence behavior, providing evidence that partial-coordinate updates can outperform full-coordinate moves in certain high-dimensional settings. These findings offer practical guidelines for optimizing SA methods in a…

Rethinking Benign Overfitting in Two-Layer Neural Networks

Ruichen Xu, Kexin Chen

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Recent theoretical studies (Kou et al., 2023; Cao et al., 2022) have revealed a sharp phase transition from benign to harmful overfitting when the noise-to-feature ratio exceeds a threshold-a situation common in long-tailed data distributions where atypical data is prevalent. However, harmful overfitting rarely happens in overparameterized neural networks. Further experimental results suggested that memorization is necessary for achieving near-optimal generalization error in long-tailed data distributions (Feldman & Zhang, 2020). We argue that this discrepancy between theoretical predictions and empirical observations arises because previous feature-noise data models overlook the heterogeneous nature of noise across different data classes. In this paper, we refine the feature-noise data model by incorporating class-dependent heterogeneous noise and re-examine the overfitting phenomenon…

On the Mordell-Weil rank of certain CM abelian varieties over anticyclotomic towers

Haidong Li, Ruichen Xu

math.NT · · cited 0× · arXiv ↗ · more like this ·

Let $K/\mathbb{Q}$ be an imaginary quadratic extension, and let $p$ be an odd prime. In this paper, we investigate the growth of Mordell-Weil ranks of CM abelian varieties associated with Hecke characters over $K$ of infinite type $(1, 0)$ along the $\mathbb{Z}_p$-anticyclotomic tower of $K$. Our results cover all decomposition types of $p$ in $K$. The analytic aspect of our proof is based on our computations of the local and global root numbers of Hecke characters, together with a recent generalization by H. Jia of D. Rohrlich's result concerning the relation between the vanishing orders of Hecke $L$-functions and their root numbers. The arithmetic conclusions then follow from the Gross-Zagier formula and the Kolyvagin machinery.

Fuze dual-channel ballistic height fusion and prediction algorithm based on FCI-KF

Dan Wu, Ke Zhang, Xin Wang +2 more

Artificial Intelligence · Journal of Physics Conference Series · · cited 0× · DOI ↗ · more like this ·

Abstract To improve the measurement accuracy of the ballistic height and anti-interference ability of fuze in complex environments, the fuze dual-channel ballistic height fusion and prediction algorithm based on Fast Covariance Intersection fusion Kalman Filter (FCI-KF) is proposed. Firstly, the state model and observation model are established, the improved Kalman Filter (KF) algorithm is used to predict the height of the single-channel and then the Fast Covariance Intersection (FCI) algorithm is used to fuse the dual-channel data. This algorithm does not need to calculate the cross-covariance matrix between channels, hence the amount of calculation is small, which is convenient for engineering realization. Finally, the algorithm is simulated and verified, the simulation results show that the measurement accuracy of the proposed algorithm can be significantly improved compared with the…

The Gan-Gross-Prasad period of Klingen Eisenstein families over unitary groups

Ruichen Xu

math.NT · · cited 0× · arXiv ↗ · more like this ·

In this article, we compute the Gan-Gross-Prasad period integral of Klingen Eisenstein series over the unitary group $\mathrm{U}(m+1, n+1)$ with a cuspidal automorphic form over $\mathrm{U}(m+1, n)$, and show that it is related to certain special Rankin-Selberg $L$-values. We $p$-adically interpolate these Gan-Gross-Prasad period integrals as the Klingen Eisenstein series and the cuspidal automorphic form vary in Hida families. As a byproduct, we obtain a $p$-adic $L$-function of Rankin-Selberg type over $\mathrm{U}(m,n) \times \mathrm{U}(m+1, n)$. The ultimate motivation is to show the $p$-primitive property of Klingen Eisenstein series over unitary groups, by computing such Gan-Gross-Prasad period integrals, and this article is a starting point of this project. The $p$-primitivity of Eisenstein series is an essential property in the automorphic method in Iwasawa theory.

HP-JEPA: Hierarchical Partitioning for Multi-Resolution Graph Joint-Embedding Predictive Learning

Ruichen Xu, Jingxiang Qu, Wenhan Gao +5 more

cs.LG · · arXiv ↗ · more like this ·

Graph self-supervised learning aims to learn transferable representations from large-scale unlabeled graph data. Joint-embedding predictive architectures (JEPAs) avoid explicit negative-pair construction and raw-input reconstruction by predicting masked targets directly in latent space. However, existing graph JEPAs typically rely on a single predefined graph partition, biasing the learned representations toward one structural granularity and limiting their ability to capture complementary patterns at different graph scales. To address this limitation, we propose HP-JEPA, a hierarchical partitioning framework for multi-resolution graph joint-embedding prediction. HP-JEPA organizes each graph into an ordered bank of coarse-to-fine partition resolutions and performs context-target latent prediction separately at each resolution using an online encoder, an exponential-moving-average target…

Towards Principled Test-Time Adaptation for Time Series Forecasting

Haochun Wang, Ruichen Xu, Georgios Kementzidis +3 more

cs.LG · · arXiv ↗ · more like this ·

Test-time adaptation (TTA) has recently emerged as a promising approach for improving time series forecasting (TSF) under distribution shift. Existing TSF-TTA methods differ in how they utilize revealed targets, yet the resulting adaptation protocols remain heterogeneous and lack a clearly unified formulation. To address this issue, we revisit TSF-TTA from the perspective of protocol cleanliness and propose an adaptation protocol based solely on matured ground truth, yielding a more principled setting for adaptation. Under this protocol, we further diagnose existing adapters in the frequency domain and find that their prediction corrections often exhibit limited and weakly structured spectral modifications. Motivated by this diagnosis, we propose Frequency-Aware Calibration (FAC), a lightweight calibration method that directly parameterizes prediction corrections in the frequency…

Differential Privacy in Two-Layer Networks: How DP-SGD Harms Fairness and Robustness

Ruichen Xu, Kexin Chen

cs.LG · · arXiv ↗ · more like this ·

Differentially private learning is essential for training models on sensitive data, but empirical studies consistently show that it can degrade performance, introduce fairness issues like disparate impact, and reduce adversarial robustness. The theoretical underpinnings of these phenomena in modern, non-convex neural networks remain largely unexplored. This paper introduces a unified feature-centric framework to analyze the feature learning dynamics of differentially private stochastic gradient descent (DP-SGD) in two-layer ReLU convolutional neural networks. Our analysis establishes test loss bounds governed by a crucial metric: the feature-to-noise ratio (FNR). We demonstrate that the noise required for privacy leads to suboptimal feature learning, and specifically show that: 1) imbalanced FNRs across classes and subpopulations cause disparate impact; 2) even in the same class, noise…

Feature Resemblance: Towards a Theoretical Understanding of Analogical Reasoning in Transformers

Ruichen Xu, Wenjing Yan, Ying-Jun Angela Zhang

cs.CL · · arXiv ↗ · more like this ·

Understanding reasoning in large language models is complicated by evaluations that conflate multiple reasoning types. We isolate analogical reasoning, where a model transfers an attribute between entities that share known properties, and study when such transfer can emerge from training. To make the problem analytically tractable, we study a minimal transformer-style abstraction that isolates how learned representations support analogical reasoning. Within this setting, we prove three key results. First, joint training on similarity and attribution premises enables analogical reasoning through aligned representations. Second, sequential training succeeds only when similarity structure is learned before specific attributes, revealing a curriculum asymmetry. Third, in our stylized setting, two-hop reasoning $(a \to b, b \to c \Rightarrow a \to c)$ can be viewed as analogical reasoning…

Tackling Privacy Heterogeneity in Differentially Private Federated Learning

Ruichen Xu, Ying-Jun Angela Zhang, Jianwei Huang

cs.LG · · arXiv ↗ · more like this ·

Differentially private federated learning (DP-FL) enables clients to collaboratively train machine learning models while preserving the privacy of their local data. However, most existing DP-FL approaches assume that all clients share a uniform privacy budget, an assumption that does not hold in real-world scenarios where privacy requirements vary widely. This privacy heterogeneity poses a significant challenge: conventional client selection strategies, which typically rely on data quantity, cannot distinguish between clients providing high-quality updates and those introducing substantial noise due to strict privacy constraints. To address this gap, we present the first systematic study of privacy-aware client selection in DP-FL. We establish a theoretical foundation by deriving a convergence analysis that quantifies the impact of privacy heterogeneity on training error. Building on…

JSAM: Privacy Straggler-Resilient Joint Client Selection and Incentive Mechanism Design in Differentially Private Federated Learning

Ruichen Xu, Ying-Jun Angela Zhang, Jianwei Huang

cs.LG · · arXiv ↗ · more like this ·

Differentially private federated learning faces a fundamental tension: privacy protection mechanisms that safeguard client data simultaneously create quantifiable privacy costs that discourage participation, undermining the collaborative training process. Existing incentive mechanisms rely on unbiased client selection, forcing servers to compensate even the most privacy-sensitive clients ("privacy stragglers"), leading to systemic inefficiency and suboptimal resource allocation. We introduce JSAM (Joint client Selection and privacy compensAtion Mechanism), a Bayesian-optimal framework that simultaneously optimizes client selection probabilities and privacy compensation to maximize training effectiveness under budget constraints. Our approach transforms a complex 2N-dimensional optimization problem into an efficient three-dimensional formulation through novel theoretical characterization…

Can Data-Driven Dynamics Reveal Hidden Physics? There Is A Need for Interpretable Neural Operators

Wenhan Gao, Jian Luo, Fang Wan +4 more

cs.LG · · arXiv ↗ · more like this ·

Recently, neural operators have emerged as powerful tools for learning mappings between function spaces, enabling data-driven simulations of complex dynamics. Despite their successes, a deeper understanding of their learning mechanisms remains underexplored. In this work, we classify neural operators into two types: (1) Spatial domain models that learn on grids and (2) Functional domain models that learn with function bases. We present several viewpoints based on this classification and focus on learning data-driven dynamics adhering to physical principles. Specifically, we provide a way to explain the prediction-making process of neural operators and show that neural operator can learn hidden physical patterns from data. However, this explanation method is limited to specific situations, highlighting the urgent need for generalizable explanation methods. Next, we show that a simple…

Boundary-Informed Method of Lines for Physics Informed Neural Networks

Maximilian Cederholm, Siyao Wang, Haochun Wang +2 more

physics.comp-ph · · arXiv ↗ · more like this ·

We propose a hybrid solver that fuses the dimensionality-reduction strengths of the Method of Lines (MOL) with the flexibility of Physics-Informed Neural Networks (PINNs). Instead of approximating spatial derivatives with fixed finite-difference stencils - whose truncation errors force extremely fine meshes - our method trains a neural network to represent the initial spatial profile and then employs automatic differentiation to obtain spectrally accurate gradients at arbitrary nodes. These high-fidelity derivatives define the right-hand side of the MOL-generated ordinary-differential system, and time integration is replaced with a secondary temporal PINN while spatial accuracy is retained without mesh refinement. The resulting "boundary-informed MOL-PINN" matches or surpasses conventional MOL in accuracy using an order of magnitude fewer collocation points, thereby shrinking memory…