arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Yurui Lai

8 papers · 2021–2026

2021: 12022: 12023: 12024: 22025: 22026: 1
2021peak 2 in 20242026

Frequent co-authors

Papers

showing 1–8 of 8 RSS

Efficient Topology-aware Data Augmentation for High-Degree Graph Neural Networks

Yurui Lai, Xiaoyang Lin, Renchi Yang +1 more

cs.LG · · cited 11× · arXiv ↗ · more like this ·

In recent years, graph neural networks (GNNs) have emerged as a potent tool for learning on graph-structured data and won fruitful successes in varied fields. The majority of GNNs follow the message-passing paradigm, where representations of each node are learned by recursively aggregating features of its neighbors. However, this mechanism brings severe over-smoothing and efficiency issues over high-degree graphs (HDGs), wherein most nodes have dozens (or even hundreds) of neighbors, such as social networks, transaction graphs, power grids, etc. Additionally, such graphs usually encompass rich and complex structure semantics, which are hard to capture merely by feature aggregations in GNNs. Motivated by the above limitations, we propose TADA, an efficient and effective front-mounted data augmentation framework for GNNs on HDGs. Under the hood, TADA includes two key modules: (i) feature…

Leveraging Large Language Models for Effective Label-free Node Classification in Text-Attributed Graphs

Taiyan Zhang, Renchi Yang, Yurui Lai +3 more

cs.LG · · cited 1× · arXiv ↗ · more like this ·

Graph neural networks (GNNs) have become the preferred models for node classification in graph data due to their robust capabilities in integrating graph structures and attributes. However, these models heavily depend on a substantial amount of high-quality labeled data for training, which is often costly to obtain. With the rise of large language models (LLMs), a promising approach is to utilize their exceptional zero-shot capabilities and extensive knowledge for node labeling. Despite encouraging results, this approach either requires numerous queries to LLMs or suffers from reduced performance due to noisy labels generated by LLMs. To address these challenges, we introduce Locle, an active self-training framework that does Label-free node Classification with LLMs cost-Effectively. Locle iteratively identifies small sets of "critical" samples using GNNs and extracts informative…

Simple yet Effective Graph Distillation via Clustering

Yurui Lai, Taiyan Zhang, Renchi Yang

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Despite plentiful successes achieved by graph representation learning in various domains, the training of graph neural networks (GNNs) still remains tenaciously challenging due to the tremendous computational overhead needed for sizable graphs in practice. Recently, graph data distillation (GDD), which seeks to distill large graphs into compact and informative ones, has emerged as a promising technique to enable efficient GNN training. However, most existing GDD works rely on heuristics that align model gradients or representation distributions on condensed and original graphs, leading to compromised result quality, expensive training for distilling large graphs, or both. Motivated by this, this paper presents an efficient and effective GDD approach, ClustGDD. Under the hood, ClustGDD resorts to synthesizing the condensed graph and node attributes through fast and theoretically-grounded…

Self-attention Dual Embedding for Graphs with Heterophily

Yurui Lai, Taiyan Zhang, Rui Fan

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Graph Neural Networks (GNNs) have been highly successful for the node classification task. GNNs typically assume graphs are homophilic, i.e. neighboring nodes are likely to belong to the same class. However, a number of real-world graphs are heterophilic, and this leads to much lower classification accuracy using standard GNNs. In this work, we design a novel GNN which is effective for both heterophilic and homophilic graphs. Our work is based on three main observations. First, we show that node features and graph topology provide different amounts of informativeness in different graphs, and therefore they should be encoded independently and prioritized in an adaptive manner. Second, we show that allowing negative attention weights when propagating graph topology information improves accuracy. Finally, we show that asymmetric attention weights between nodes are helpful. We design a GNN…

NCCR: Neighbor and Cluster Consistency Regularization for Improving Graph Node Classification

Feiming Yang, Yurui Lai, Leshan Wang +1 more

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

Semi-supervised node classification in graphs is a key problem in machine learning, and graph neural networks (GNNs) currently achieve state-of-the-art performance. However, traditional GNNs fail to make use of a substantial amount of information available in a graph. For example, the training loss is often defined only with respect to labeled training nodes, which usually make up a small proportion of the graph. Also, most graphs exhibit a certain degree of homophily, in which neighboring nodes are likely to belong to the same class, but GNNs typically do not make use of this property in an explicit way. In this work, we introduce a new type of consistency regularization which is able to make use of data from unlabeled nodes and also exploits graph homophily in a novel and more accurate way. Additionally, we observe that nodes in a graph may exhibit different amounts of homophily, so…

Denoised Internal Models: a Brain-Inspired Autoencoder against Adversarial Attacks

Kaiyuan Liu, Xingyu Li, Yurui Lai +6 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Despite its great success, deep learning severely suffers from robustness; that is, deep neural networks are very vulnerable to adversarial attacks, even the simplest ones. Inspired by recent advances in brain science, we propose the Denoised Internal Models (DIM), a novel generative autoencoder-based model to tackle this challenge. Simulating the pipeline in the human brain for visual signal processing, DIM adopts a two-stage approach. In the first stage, DIM uses a denoiser to reduce the noise and the dimensions of inputs, reflecting the information pre-processing in the thalamus. Inspired from the sparse coding of memory-related traces in the primary visual cortex, the second stage produces a set of internal models, one for each category. We evaluate DIM over 42 adversarial attacks, showing that DIM effectively defenses against all the attacks and outperforms the SOTA on the overall…

Semi-Supervised Text-Attributed Graph Distillation

Yurui Lai, Samir Moustafa, Renchi Yang +1 more

cs.AI · · arXiv ↗ · more like this ·

{\em Text-Attributed Graphs} (TAGs) have emerged as an expressive data model for integrating graph topology with rich textual semantics. Existing representation learning methods over TAGs suffer from severe scalability bottlenecks, particularly together with {\em Large Language Models} (LLMs). While data distillation offers a promising data-centric solution, existing methods fail to capture the complex interplay between graph and text modalities, struggle with the label scarcity inherent in semi-supervised settings, and lack the ability to produce the human-readable textual attributes required for downstream LLM-based tasks. To address these challenges, we propose \algo{}, a unified semi-supervised framework guided by the {\em Wasserstein Distance} (WSD). Grounded in our empirical findings on real TAGs, \algo{} introduces a graph-text collaborative encoding module that utilizes…

Rethinking Semi-Supervised Node Classification with Self-Supervised Graph Clustering

Songbo Wang, Renchi Yang, Yurui Lai +2 more

cs.LG · · arXiv ↗ · more like this ·

The emergence of graph neural networks (GNNs) has offered a powerful tool for semi-supervised node classification tasks. Subsequent studies have achieved further improvements through refining the message passing schemes in GNN models or exploiting various data augmentation techniques to mitigate limited supervision. In real graphs, nodes often tend to form tightly-knit communities/clusters, which embody abundant signals for compensating label scarcity in semi-supervised node classification but are not explored in prior methods. Inspired by this, this paper presents NCGC that integrates self-supervised graph clustering and semi-supervised classification into a unified framework. Firstly, we theoretically unify the optimization objectives of GNNs and spectral graph clustering, and based on that, develop soft orthogonal GNNs (SOGNs) that leverage a refined message passing paradigm to…