arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Da Yan

156 papers · 1986–2026

1986: 11987: 01988: 01989: 01990: 01991: 01992: 01993: 01994: 01995: 01996: 01997: 01998: 01999: 02000: 12001: 02002: 12003: 12004: 02005: 12006: 02007: 12008: 12009: 02010: 32011: 122012: 112013: 112014: 82015: 42016: 92017: 52018: 42019: 72020: 152021: 112022: 112023: 102024: 162025: 82026: 4
1986peak 16 in 20242026

Frequent co-authors

Papers

showing 1–25 of 156 RSS

Towards Understanding Sycophancy in Language Models

Mrinank Sharma, Meg Tong, Tomasz Korbak +16 more

cs.CL · · cited 1,420× · arXiv ↗ · more like this ·

Human feedback is commonly utilized to finetune AI assistants. But human feedback may also encourage model responses that match user beliefs over truthful ones, a behaviour known as sycophancy. We investigate the prevalence of sycophancy in models whose finetuning procedure made use of human feedback, and the potential role of human preference judgments in such behavior. We first demonstrate that five state-of-the-art AI assistants consistently exhibit sycophancy across four varied free-form text-generation tasks. To understand if human preferences drive this broadly observed behavior, we analyze existing human preference data. We find that when a response matches a user's views, it is more likely to be preferred. Moreover, both humans and preference models (PMs) prefer convincingly-written sycophantic responses over correct ones a non-negligible fraction of the time. Optimizing model…

Discovering Language Model Behaviors with Model-Written Evaluations

Ethan Perez, Sam Ringer, Kamilė Lukošiūtė +60 more

cs.CL · · cited 1,090× · arXiv ↗ · more like this ·

As language models (LMs) scale, they develop many novel behaviors, good and bad, exacerbating the need to evaluate how they behave. Prior work creates evaluations with crowdwork (which is time-consuming and expensive) or existing data sources (which are not always available). Here, we automatically generate evaluations with LMs. We explore approaches with varying amounts of human effort, from instructing LMs to write yes/no questions to making complex Winogender schemas with multiple stages of LM-based generation and filtering. Crowdworkers rate the examples as highly relevant and agree with 90-100% of labels, sometimes more so than corresponding human-written datasets. We generate 154 datasets and discover new cases of inverse scaling where LMs get worse with size. Larger LMs repeat back a dialog user's preferred answer ("sycophancy") and express greater desire to pursue concerning…

Blogel

Da Yan, James Cheng, Yi Lu +1 more

Computer Vision and Pattern Recognition · Proceedings of the VLDB Endowment · · cited 255× · DOI ↗ · more like this ·

The rapid growth in the volume of many real-world graphs (e.g., social networks, web graphs, and spatial networks) has led to the development of various vertex-centric distributed graph computing systems in recent years. However, real-world graphs from different domains have very different characteristics, which often create bottlenecks in vertex-centric parallel graph computation. We identify three such important characteristics from a wide spectrum of real-world graphs, namely (1)skewed degree distribution, (2)large diameter, and (3)(relatively) high density. Among them, only (1) has been studied by existing systems, but many real-world power-law graphs also exhibit the characteristics of (2) and (3). In this paper, we propose a block-centric framework, called Blogel, which naturally handles all the three adverse graph characteristics. Blogel programmers may think like a block and…

Large-scale distributed graph computing systems

Yi Lu, James Cheng, Da Yan +1 more

Computer Vision and Pattern Recognition · Proceedings of the VLDB Endowment · · cited 157× · DOI ↗ · more like this ·

With the prevalence of graph data in real-world applications (e.g., social networks, mobile phone networks, web graphs, etc.) and their ever-increasing size, many distributed graph computing systems have been developed in recent years to process and analyze massive graphs. Most of these systems adopt Pregel's vertex-centric computing model, while various techniques have been proposed to address the limitations in the Pregel framework. However, there is a lack of comprehensive comparative analysis to evaluate the performance of various systems and their techniques, making it difficult for users to choose the best system for their applications. We conduct extensive experiments to evaluate the performance of existing systems on graphs with different characteristics and on algorithms with different design logic. We also study the effectiveness of various techniques adopted in existing…

Effective Techniques for Message Reduction and Load Balancing in Distributed Graph Computation

Da Yan, James Cheng, Yi Lu +1 more

cs.DC · · cited 124× · arXiv ↗ · more like this ·

Massive graphs, such as online social networks and communication networks, have become common today. To efficiently analyze such large graphs, many distributed graph computing systems have been developed. These systems employ the "think like a vertex" programming paradigm, where a program proceeds in iterations and at each iteration, vertices exchange messages with each other. However, using Pregel's simple message passing mechanism, some vertices may send/receive significantly more messages than others due to either the high degree of these vertices or the logic of the algorithm used. This forms the communication bottleneck and leads to imbalanced workload among machines in the cluster. In this paper, we propose two effective message reduction techniques: (1)vertex mirroring with message combining, and (2)an additional request-respond API. These techniques not only reduce the total…

The Future is Big Graphs! A Community View on Graph Processing Systems

Sherif Sakr, Angela Bonifati, Hannes Voigt +38 more

cs.DC · · cited 118× · arXiv ↗ · more like this ·

Graphs are by nature unifying abstractions that can leverage interconnectedness to represent, explore, predict, and explain real- and digital-world phenomena. Although real users and consumers of graph instances and graph workloads understand these abstractions, future problems will require new abstractions and systems. What needs to happen in the next decade for big graph processing to continue to succeed?

Pregel algorithms for graph connectivity problems with performance guarantees

Da Yan, James Cheng, Kai Xing +3 more

Computer Vision and Pattern Recognition · Proceedings of the VLDB Endowment · · cited 116× · DOI ↗ · more like this ·

Graphs in real life applications are often huge, such as the Web graph and various social networks. These massive graphs are often stored and processed in distributed sites. In this paper, we study graph algorithms that adopt Google's Pregel, an iterative vertex-centric framework for graph processing in the Cloud. We first identify a set of desirable properties of an efficient Pregel algorithm, such as linear space, communication and computation cost per iteration, and logarithmic number of iterations. We define such an algorithm as a practical Pregel algorithm (PPA). We then propose PPAs for computing connected components (CCs), biconnected components (BCCs) and strongly connected components (SCCs). The PPAs for computing BCCs and SCCs use the PPAs of many fundamental graph problems as building blocks, which are of interest by themselves. Extensive experiments over large real graphs…

G-Miner

Hongzhi Chen, Miao Liu, Yunjian Zhao +3 more

Computer Vision and Pattern Recognition · · cited 107× · DOI ↗ · more like this ·

Graph mining is one of the most important areas in data mining. However, scalable solutions for graph mining are still lacking as existing studies focus on sequential algorithms. While many distributed graph processing systems have been proposed in recent years, most of them were designed to parallelize computations such as PageRank and Breadth-First Search that keep states on individual vertices and propagate updates along edges. Graph mining, on the other hand, may generate many subgraphs whose number can far exceed the number of vertices. This inevitably leads to much higher computational and space complexity rendering existing graph systems inefficient. We propose G-Miner, a distributed system with a new architecture designed for general graph mining. G-Miner adopts a unified programming framework for implementing a wide range of graph mining algorithms. We model subgraph processing…

Big Graph Analytics Platforms

Da Yan, Yingyi Bu, Yuanyuan Tian +1 more

Computer Vision and Pattern Recognition · Foundations and Trends in Databases · · cited 89× · DOI ↗ · more like this ·

Due to the growing need to process large graph and network datasets created by modern applications, recent years have witnessed a surging interest in developing big graph platforms. Tens of such big graph systems have already been developed, but there lacks a systematic categorization and comparison of these systems. This article provides a timely and comprehensive survey of existing big graph systems, and summarizes their key ideas and technical contributions from various aspects. In addition to the popular vertex-centric systems which espouse a think-like-a-vertex paradigm for developing parallel graph applications, this survey also covers other programming and computation models, contrasts those against each other, and provides a vision for the future research on big graph analytics platforms. This survey aims to help readers get a systematic picture of the landscape of recent big…

Demystifying Tensor Cores to Optimize Half-Precision Matrix Multiply

Da Yan, Wei Wang, Xiaowen Chu

Hardware and Architecture · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · · cited 67× · DOI ↗ · more like this ·

Half-precision matrix multiply has played a key role in the training of deep learning models. The newly designed Nvidia Tensor Cores offer the native instructions for half-precision small matrix multiply, based on which Half-precision General Matrix Multiply (HGEMM) routines are developed and can be accessed through high-level APIs. In this paper, we, for the first time, demystify how Tensor Cores on NVIDIA Turing architecture work in great details, including the instructions used, the registers and data layout required, as well as the throughput and latency of Tensor Core operations. We further benchmark the memory system of Turing GPUs and conduct quantitative analysis of the performance. Our analysis shows that the bandwidth of DRAM, L2 cache and shared memory is the new bottleneck for HGEMM, whose performance is previously believed to be bound by computation. Based on our newly…

Diversified Temporal Subgraph Pattern Mining

Yi Yang, Da Yan, Huanhuan Wu +3 more

Information Systems · · cited 67× · DOI ↗ · more like this ·

Many graphs in real-world applications, such as telecommunications networks, social-interaction graphs and co-authorship graphs, contain temporal information. However, existing graph mining algorithms fail to exploit these temporal information and the resulting subgraph patterns do not contain any temporal attribute. In this paper, we study the problem of mining a set of diversified temporal subgraph patterns from a temporal graph, where each subgraph is associated with the time interval that the pattern spans. This problem motivates important applications such as finding social trends in social networks, or detecting temporal hotspots in telecommunications networks. We propose a divide-and-conquer algorithm along with effective pruning techniques, and our approach runs 2 to 3 orders of magnitude faster than a baseline algorithm and obtains high-quality temporal subgraph patterns in…

L2 writer engagement with automated written corrective feedback provided by ChatGPT: A mixed-method multiple case study

Da Yan, Shuxian Zhang

Artificial Intelligence · Humanities and Social Sciences Communications · · cited 57× · DOI ↗ · more like this ·

Automated written corrective feedback (AWCF) has been widely applied in second language (L2) writing classrooms in the past few decades. Recently, the introduction of tools based on generative artificial intelligence (GAI) such as ChatGPT heralds groundbreaking changes in the conceptualization and practice of AWCF in L2 pedagogy. However, students’ engagement in such an interactive and intelligent learning environment remains unstudied. The present study aims to investigate L2 writers’ behavioral, cognitive, and affective engagement with ChatGPT as an AWCF provider for writing products. This mixed-method multiple case study explored four L2 writers’ behavioral, cognitive, and affective engagement with AWCF provided by ChatGPT. Bearing the conversational and generative mechanisms of ChatGPT in mind, data on students’ engagement were collected from various sources: prompt writing…

Mining Probabilistically Frequent Sequential Patterns in Large Uncertain Databases

Zhou Zhao, Da Yan, Wilfred Ng

Signal Processing · IEEE Transactions on Knowledge and Data Engineering · · cited 53× · DOI ↗ · more like this ·

Data uncertainty is inherent in many real-world applications such as environmental surveillance and mobile tracking. Mining sequential patterns from inaccurate data, such as those data arising from sensor readings and GPS trajectories, is important for discovering hidden knowledge in such applications. In this paper, we propose to measure pattern frequentness based on the possible world semantics. We establish two uncertain sequence data models abstracted from many real-life applications involving uncertain sequence data, and formulate the problem of mining probabilistically frequent sequential patterns (or p-FSPs) from data that conform to our models. However, the number of possible worlds is extremely large, which makes the mining prohibitively expensive. Inspired by the famous PrefixSpan algorithm, we develop two new algorithms, collectively called U-PrefixSpan, for p-FSP mining.…

Efficient algorithms for finding optimal meeting point on road networks

Da Yan, Zhou Zhao, Wilfred Ng

Signal Processing · Proceedings of the VLDB Endowment · · cited 51× · DOI ↗ · more like this ·

Given a set of points Q on a road network, an optimal meeting point (OMP) query returns the point on a road network G = ( V , E ) with the smallest sum of network distances to all the points in Q. This problem has many real world applications, such as minimizing the total travel cost for a group of people who want to find a location for gathering. While this problem has been well studied in the Euclidean space, the recently proposed state-of-the-art algorithm for solving this problem in the context of road networks is still not efficient. In this paper, we propose a new baseline algorithm for the OMP query, which reduces the search space from | Q | · | E | to | V | + | Q |. We also present two effective pruning techniques that further accelerate the baseline algorithm. Finally, in order to support spatial applications that involve large flow of queries and require fast response, an…

G-thinker: A Distributed Framework for Mining Subgraphs in a Big Graph

Da Yan, Guimu Guo, Md Mashiur Rahman Chowdhury +3 more

Computer Vision and Pattern Recognition · · cited 46× · DOI ↗ · more like this ·

Mining from a big graph those subgraphs that satisfy certain conditions is useful in many applications such as community detection and subgraph matching. These problems have a high time complexity, but existing systems to scale them are all IO-bound in execution. We propose the first truly CPU-bound distributed framework called G-thinker that adopts a user-friendly subgraph-centric vertex-pulling API for writing distributed subgraph mining algorithms. To utilize all CPU cores of a cluster, G-thinker features (1) a highly-concurrent vertex cache for parallel task access and (2) a lightweight task scheduling approach that ensures high task throughput. These designs well overlap communication with computation to minimize the CPU idle time. Extensive experiments demonstrate that G-thinker achieves orders of magnitude speedup compared even with the fastest existing subgraph-centric system…

A general-purpose query-centric framework for querying big graphs

Da Yan, James Cheng, M. TAMER ÖZSU +5 more

Computer Vision and Pattern Recognition · Proceedings of the VLDB Endowment · · cited 45× · DOI ↗ · more like this ·

Pioneered by Google's Pregel, many distributed systems have been developed for large-scale graph analytics. These systems employ a user-friendly "think like a vertex" programming model, and exhibit good scalability for tasks where the majority of graph vertices participate in computation. However, the design of these systems can seriously under-utilize the resources in a cluster for processing light-workload graph queries, where only a small fraction of vertices need to be accessed. In this work, we develop a new open-source system, called Quegel , for querying big graphs. Quegel treats queries as first-class citizens in its design: users only need to specify the Pregel-like algorithm for a generic query, and Quegel processes light-workload graph queries on demand, using a novel superstep-sharing execution model to effectively utilize the cluster resources. Quegel further provides a…

GraphD: Distributed Vertex-Centric Graph Processing Beyond the Memory Limit

Da Yan, Yuzhen Huang, Miao Liu +4 more

Computer Vision and Pattern Recognition · IEEE Transactions on Parallel and Distributed Systems · · cited 43× · DOI ↗ · more like this ·

We propose GraphD, an out-of-core Pregel-like system targeting efficient big graph processing with a small cluster of commodity PCs connected by Gigabit Ethernet, an environment affordable to most users. This is in contrast to some recent efforts for out-of-core graph computation with specialized hardware. In our setting, a vertex-centric program is often data-intensive, since the CPU cost of calculating a message value is negligible compared with the network cost of transmitting that message. As a result, network bandwidth is usually the bottleneck, and out-of-core execution would not sacrifice performance if disk IO overhead can be hidden by message transmission, which is achieved by GraphD through the parallelism of computation and communication. GraphD streams edge and message data on local disks, and thus consumes negligible memory space. For a broad class of Pregel algorithms…

Modulating Functions Based Algorithm for the Estimation of the Coefficients and Differentiation Order for a Space-Fractional Advection-Dispersion Equation

Abeer Aldoghaither, Da‐Yan Liu, Taous‐Meriem Laleg‐Kirati

Modeling and Simulation · SIAM Journal on Scientific Computing · · cited 43× · DOI ↗ · more like this ·

In this paper, a new method, based on the so-called modulating functions, is proposed to estimate average velocity, dispersion coefficient, and differentiation order in a space-fractional advection-dispersion equation, where the average velocity and the dispersion coefficient are space-varying. First, the average velocity and the dispersion coefficient are estimated by applying the modulating functions method, where the problem is transformed into a linear system of algebraic equations. Then, the modulating functions method combined with a Newton's iteration algorithm is applied to estimate the coefficients and the differentiation order simultaneously. The local convergence of the proposed method is proved. Numerical results are presented with noisy measurements to show the effectiveness and robustness of the proposed method. It is worth mentioning that this method can be extended to…

Efficient Algorithms for Maximal k-Biplex Enumeration

Kaiqiang Yu, Cheng Long, Shengxin Liu +1 more

cs.DB · · cited 39× · arXiv ↗ · more like this ·

Mining maximal subgraphs with cohesive structures from a bipartite graph has been widely studied. One important cohesive structure on bipartite graphs is k-biplex, where each vertex on one side disconnects at most k vertices on the other side. In this paper, we study the maximal k-biplex enumeration problem which enumerates all maximal k-biplexes. Existing methods suffer from efficiency and/or scalability issues and have the time of waiting for the next output exponential w.r.t. the size of the input bipartite graph (i.e., an exponential delay). In this paper, we adopt a reverse search framework called bTraversal, which corresponds to a depth-first search (DFS) procedure on an implicit solution graph on top of all maximal k-biplexes. We then develop a series of techniques for improving and implementing this framework including (1) carefully selecting an initial solution to start DFS…

Flocking in target pursuit for multi-agent systems with partial informed agents

Xiangfeng Luo, Da-Yan Liu, Xinping Guan +1 more

Computer Networks and Communications · IET Control Theory and Applications · · cited 35× · DOI ↗ · more like this ·

In this study, the authors investigate the problem of flocking motion combined with topology optimisation for mobile multi-agent systems. In most of the recent literatures, all agents are assumed to be informed of target's information for all time to maintain connectivity. Actually, it is not essential to make all agents be informed. In this study, the authors present a distributed topology optimisation scheme to reduce the communication complexity of keeping connectivity while the multi-agent system pursuits a virtual target. This optimisation scheme is performed in the discrete space of graphs and relies on two key ideas. First, it generates optimally rigid graphs for each agent with its neighbouring flockmates. Second, partial agents are selected as the informed units to maintain the connectivity of the multi-agent system. Based on this scheme, the authors propose a distributed…

Efficient methods for finding influential locations with adaptive grids

Da Yan, Raymond Chi-Wing Wong, Wilfred Ng

Signal Processing · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · · cited 35× · DOI ↗ · more like this ·

Given a set S of servers and a set C of clients, an optimal-location query returns a location where a new server can attract the greatest number of clients. Optimal-location queries are important in a lot of real-life applications, such as mobile service planning or resource distribution in an area. Previous studies assume that a client always visits its nearest server, which is too strict to be true in reality. In this paper, we relax this assumption and propose a new model to tackle this problem. We further generalize the problem to finding top-k optimal locations. The main challenge is that, even the fastest approach in existing studies needs to take hours to answer an optimal-location query on a typical real world dataset, which significantly limits the applications of the query. Using our relaxed model, we design an efficient grid-based approximation algorithm called FILM (Fast…

Mining probabilistically frequent sequential patterns in uncertain databases

Zhou Zhao, Da Yan, Wilfred Ng

Information Systems · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · · cited 33× · DOI ↗ · more like this ·

Data uncertainty is inherent in many real-world applications such as environmental surveillance and mobile tracking. As a result, mining sequential patterns from inaccurate data, such as sensor readings and GPS trajectories, is important for discovering hidden knowledge in such applications. Previous work uses expected support as the measurement of pattern frequentness, which has inherent weaknesses with respect to the underlying probability model, and is therefore ineffective for mining high-quality sequential patterns from uncertain sequence databases.

Fraction-Score: A New Support Measure for Co-location Pattern Mining

Harry Kai-Ho Chan, Cheng Long, Da Yan +1 more

Information Systems · DR-NTU (Nanyang Technological University) · · cited 31× · DOI ↗ · more like this ·

Co-location patterns are well-established on spatial objects with categorical labels, which capture the phenomenon that objects with certain labels are often located in close geographic proximity. Similar to frequent itemsets, co-location patterns are defined based on a support measure which quantifies the popularity (or prevalence) of a pattern candidate (a label set). Quite a few support measures exist for defining co-location patterns and they share an idea of counting the number of instances of a given label set C as its support, where an instance of C is an object set whose objects carry all the labels in C and are located close to one another. Unfortunately, these measures suffer from various weaknesses, e.g., some fail to capture all possible instances while some others overlook the cases when multiple instances overlap. In this paper, we propose a new measure called…

Autonomous localized path planning algorithm for UAVs based on TD3 strategy

Zhao Feiyu, LI Da-yan, Wang Zhengxu +2 more

Computer Vision and Pattern Recognition · Scientific Reports · · cited 29× · DOI ↗ · more like this ·

Unmanned Aerial Vehicles are useful tools for many applications. However, autonomous path planning for Unmanned Aerial Vehicles in unfamiliar environments is a challenging problem when facing a series of problems such as poor consistency, high influence by the native controller of the Unmanned Aerial Vehicles. In this paper, we investigate reinforcement learning-based autonomous local path planning methods for Unmanned Aerial Vehicles with high autonomous decision-making capability and locally high portability. We propose an autonomous local path planning algorithm based on the TD3 strategy to solve the problem of local obstacle avoidance and path planning in unfamiliar environments using autonomous decision-making of Unmanned Aerial Vehicles. The simulation results on Gazebo show that our method can effectively realize the autonomous local path planning task for Unmanned Aerial…

PrefixFPM: A Parallel Framework for General-Purpose Frequent Pattern Mining

Da Yan, Wenwen Qu, Guimu Guo +1 more

Information Systems · · cited 29× · DOI ↗ · more like this ·

Frequent pattern mining (FPM) has been a focused theme in data mining research for decades, but there lacks a general programming framework that can be easily customized to mine different kinds of frequent patterns, and existing solutions to FPM over big transaction databases are IO-bound rendering CPU cores underutilized even though FPM is NP-hard. This paper presents, PrefixFPM, a general-purpose framework for FPM that is able to fully utilize the CPU cores in a multicore machine. PrefixFPM follows the idea of prefix projection to partition the workloads of PFM into independent tasks by divide and conquer. PrefixFPM exposes a unified programming interface to users who can customize it to mine their desired patterns, and the parallel execution engine is transparent to end-users and can be reused for mining all kinds of patterns. We have adapted the state-of-the-art serial algorithms…