Author

Mark Coates

207 papers · 2000–2026

2000peak 19 in 20252026

Frequent co-authors

Papers

showing 1–25 of 207 RSS

Network Tomography: Recent Developments

Rui Castro, Mark Coates, Gang Liang +2 more

Computer Networks and Communications · Statistical Science · August 2004 · cited 438× · DOI ↗ · more like this ·

Today’s Internet is a massive, distributed network which continues to explode in size as e-commerce and related activities grow. The heterogeneous and largely unregulated structure of the Internet renders tasks such as dynamic routing, optimized service provision, service level verification and detection of anomalous/malicious behavior extremely challenging. The problem is compounded by the fact that one cannot rely on the cooperation of individual servers and routers to aid in the collection of network traffic measurements vital for these tasks. In many ways, network monitoring and inference problems bear a strong resemblance to other “inverse problems” in which key aspects of a system are not directly observable. Familiar signal processing or statistical problems such as tomographic image reconstruction and phylogenetic tree identification have interesting connections to those arising…

Distributed Average Consensus With Dithered Quantization

Tuncer C. Aysal, Mark Coates, Michael Rabbat

Computer Networks and Communications · IEEE Transactions on Signal Processing · 18 Sep 2008 · cited 311× · DOI ↗ · more like this ·

In this paper, we develop algorithms for distributed computation of averages of the node data over networks with bandwidth/power constraints or large volumes of data. Distributed averaging algorithms fail to achieve consensus when deterministic uniform quantization is adopted. We propose a distributed algorithm in which the nodes utilize probabilistically quantized information, i.e., dithered quantization, to communicate with each other. The algorithm we develop is a dynamical system that generates sequences achieving a consensus at one of the quantization values almost surely. In addition, we show that the expected value of the consensus is equal to the average of the original sensor data. We derive an upper bound on the mean-square-error performance of the probabilistically quantized distributed averaging (PQDA). Moreover, we show that the convergence of the PQDA is monotonic by…

Distributed particle filters for sensor networks

Mark Coates

Artificial Intelligence · 26 Apr 2004 · cited 274× · DOI ↗ · more like this ·

This paper describes two methodologies for performing distributed particle filtering in a sensor network. It considers the scenario in which a set of sensor nodes make multiple, noisy measurements of an underlying, time-varying state that describes the monitored system. The goal of

Bayesian graph convolutional neural networks for semi-supervised classification

Yingxue Zhang, Soumyasundar Pal, Mark Coates +1 more

stat.ML · 27 Nov 2018 · cited 270× · arXiv ↗ · more like this ·

Recently, techniques for applying convolutional neural networks to graph-structured data have emerged. Graph convolutional neural networks (GCNNs) have been used to address node and graph classification and matrix completion. Although the performance has been impressive, the current implementations have limited capability to incorporate uncertainty in the graph structure. Almost all GCNNs process a graph as though it is a ground-truth depiction of the relationship between nodes, but often the graphs employed in applications are themselves derived from noisy data or modelling assumptions. Spurious edges may be included; other edges may be missing between nodes that have very strong relationships. In this paper we adopt a Bayesian approach, viewing the observed graph as a realization from a parametric family of random graphs. We then target inference of the joint posterior of the random…

Memory Augmented Graph Neural Networks for Sequential Recommendation

Chen Ma, Liheng Ma, Yingxue Zhang +3 more

cs.IR · 26 Dec 2019 · cited 245× · arXiv ↗ · more like this ·

The chronological order of user-item interactions can reveal time-evolving and sequential user behaviors in many recommender systems. The items that users will interact with may depend on the items accessed in the past. However, the substantial increase of users and items makes sequential recommender systems still face non-trivial challenges: (1) the hardness of modeling the short-term user interests; (2) the difficulty of capturing the long-term user interests; (3) the effective modeling of item co-occurrence patterns. To tackle these challenges, we propose a memory augmented graph neural network (MA-GNN) to capture both the long- and short-term user interests. Specifically, we apply a graph neural network to model the item contextual information within a short-term period and utilize a shared memory network to capture the long-range dependencies between items. In addition to the…

Graph Inductive Biases in Transformers without Message Passing

Liheng Ma, Chen Lin, Derek Lim +5 more

cs.LG · 27 May 2023 · cited 227× · arXiv ↗ · more like this ·

Transformers for graph data are increasingly widely studied and successful in numerous learning tasks. Graph inductive biases are crucial for Graph Transformers, and previous works incorporate them using message-passing modules and/or positional encodings. However, Graph Transformers that use message-passing inherit known issues of message-passing, and differ significantly from Transformers used in other domains, thus making transfer of research advances more difficult. On the other hand, Graph Transformers without message-passing often perform poorly on smaller datasets, where inductive biases are more crucial. To bridge this gap, we propose the Graph Inductive bias Transformer (GRIT) -- a new Graph Transformer that incorporates graph inductive biases without using message passing. GRIT is based on several architectural changes that are each theoretically and empirically justified…

Neighbor Interaction Aware Graph Convolution Networks for Recommendation

Jianing Sun, Yingxue Zhang, Wei Guo +5 more

Information Systems · 25 Jul 2020 · cited 170× · DOI ↗ · more like this ·

Personalized recommendation plays an important role in many online services. Substantial research has been dedicated to learning embeddings of users and items to predict a user's preference for an item based on the similarity of the representations. In many settings, there is abundant relationship information, including user-item interaction history, user-user and item-item similarities. In an attempt to exploit these relationships to learn better embeddings, researchers have turned to the emerging field of Graph Convolutional Neural Networks (GCNs), and applied GCNs for recommendation. Although these prior works have demonstrated promising performance, directly apply GCNs to process the user-item bipartite graph is suboptimal because the GCNs do not consider the intrinsic differences between user nodes and item nodes. Additionally, existing large-scale graph neural networks use…

Maximum likelihood network topology identification from edge-based unicast measurements

Mark Coates, Rui Castro, Robert Nowak +3 more

Computer Networks and Communications · TU/e Research Portal · June 2002 · cited 167× · DOI ↗ · more like this ·

Network tomography is a process for inferring "internal" link-level delay and loss performance information based on end-to-end (edge) network measurements. These methods require knowledge of the network topology; therefore a first crucial step in the tomography process is topology identification. This paper considers the problem of discovering network topology solely from host-based, unicast measurements, without internal network cooperation. First, we introduce a novel delay-based measurement scheme that does not require clock synchronization, making it more practical than other previous proposals. In contrast to methods that rely on network cooperation , our methodology has the potential to identify layer two elements (provided they are logical topology branching points and induce some measurable delay). Second, we propose a maximum penalized likelihood criterion for topology…

Multi-Graph Convolution Collaborative Filtering

Jianing Sun, Yingxue Zhang, Chen Ma +4 more

cs.IR · January 2020 · cited 151× · arXiv ↗ · more like this ·

Personalized recommendation is ubiquitous, playing an important role in many online services. Substantial research has been dedicated to learning vector representations of users and items with the goal of predicting a user's preference for an item based on the similarity of the representations. Techniques range from classic matrix factorization to more recent deep learning based methods. However, we argue that existing methods do not make full use of the information that is available from user-item interaction data and the similarities between user pairs and item pairs. In this work, we develop a graph convolution-based recommendation framework, named Multi-Graph Convolution Collaborative Filtering (Multi-GCCF), which explicitly incorporates multiple graphs in the embedding learning process. Multi-GCCF not only expressively models the high-order information via a partite user-item…

Network Loss Inference Using Unicast End-to-End Measurement

Mark Coates, Robert D. Nowak

Computer Networks and Communications · Rice Digital Scholarship Archive (Rice University) · 20 Sep 2000 · cited 148× · OpenAlex ↗ · more like this ·

The fundamental objective of this work is to determine the extent to which unicast, end-to-end network measurement is capable of determining internal network losses. The major contributions of this paper are two-fold: we formulate a measurement procedure for network loss inference based on end-to-end packet pair measurements, and we develop a statistical modeling and computation framework for inferring internal network loss characteristics. Simulation experiments demonstrate the potential of our new framework. 1.

Multivariate Online Anomaly Detection Using Kernel Recursive Least Squares

Tarem Ahmed, Mark Coates, Anukool Lakhina

Artificial Intelligence · May 2007 · cited 147× · DOI ↗ · more like this ·

High-speed backbones are regularly affected by various kinds of network anomalies, ranging from malicious attacks to harmless large data transfers. Different types of anomalies affect the network in different ways, and it is difficult to know a priori how a potential anomaly will exhibit itself in traffic statistics. In this paper we describe an online, sequential, anomaly detection algorithm, that is suitable for use with multivariate data. The proposed algorithm is based on the kernel version of the recursive least squares algorithm. It assumes no model for network traffic or anomalies, and constructs and adapts a dictionary of features that approximately spans the subspace of normal behaviour. The algorithm raises an alarm immediately upon encountering a deviation from the norm. Through comparison with existing block-based offline methods based upon Principal Component Analysis, we…

Distributed Average Consensus using Probabilistic Quantization

Tuncer C. Aysal, Mark Coates, Michael Rabbat

Computer Networks and Communications · 2007 IEEE/SP 14th Workshop on Statistical Signal Processing · August 2007 · cited 143× · DOI ↗ · more like this ·

In this paper, we develop algorithms for distributed computation of averages of the node data over networks with bandwidth/power constraints or large volumes of data. Distributed averaging algorithms fail to achieve consensus when deterministic uniform quantization is adopted. We propose a distributed algorithm in which the nodes utilize probabilistically quantized information to communicate with each other. The algorithm we develop is a dynamical system that generates sequences achieving a consensus, which is one of the quantization values. In addition, we show that the expected value of the consensus is equal to the average of the original sensor data. We report the results of simulations conducted to evaluate the behavior and the effectiveness of the proposed algorithm in various scenarios.

Machine learning approaches to network anomaly detection

Tarem Ahmed, Boris N. Oreshkin, Mark Coates

Artificial Intelligence · USENIX workshop on Tackling computer systems problems with machine learning techniques · 10 Apr 2007 · cited 131× · DOI ↗ · more like this ·

Protein synthesis is crucial for the maintenance of long-term-memory-related synaptic plasticity. The prion-like cytoplasmic polyadenylation element-binding protein 3 (CPEB3) regulates the translation of several mRNAs important for long-term synaptic plasticity in the hippocampus. Here, we provide evidence that the prion-like aggregation and activity of CPEB3 is controlled by SUMOylation. In the basal state, CPEB3 is a repressor and is soluble. Under these circumstances, CPEB3 is SUMOylated in hippocampal neurons both in vitro and in vivo. Following neuronal stimulation, CPEB3 is converted into an active form that promotes the translation of target mRNAs, and this is associated with a decrease of SUMOylation and an increase of aggregation. A chimeric CPEB3 protein fused to SUMO cannot form aggregates and cannot activate the translation of target mRNAs. These findings suggest a model…

Multi-resolution Time-Series Transformer for Long-term Forecasting

Yitian Zhang, Liheng Ma, Soumyasundar Pal +2 more

cs.LG · November 2023 · cited 117× · arXiv ↗ · more like this ·

The performance of transformers for time-series forecasting has improved significantly. Recent architectures learn complex temporal patterns by segmenting a time-series into patches and using the patches as tokens. The patch size controls the ability of transformers to learn the temporal patterns at different frequencies: shorter patches are effective for learning localized, high-frequency patterns, whereas mining long-term seasonalities and trends requires longer patches. Inspired by this observation, we propose a novel framework, Multi-resolution Time-Series Transformer (MTST), which consists of a multi-branch architecture for simultaneous modeling of diverse temporal patterns at different resolutions. In contrast to many existing time-series transformers, we employ relative positional encoding, which is better suited for extracting periodic components at different scales. Extensive…

GraphSAIL: Graph Structure Aware Incremental Learning for Recommender Systems

Yishi Xu, Yingxue Zhang, Wei Guo +3 more

cs.IR · August 2020 · cited 117× · arXiv ↗ · more like this ·

Given the convenience of collecting information through online services, recommender systems now consume large scale data and play a more important role in improving user experience. With the recent emergence of Graph Neural Networks (GNNs), GNN-based recommender models have shown the advantage of modeling the recommender system as a user-item bipartite graph to learn representations of users and items. However, such models are expensive to train and difficult to perform frequent updates to provide the most up-to-date recommendations. In this work, we propose to update GNN-based recommender models incrementally so that the computation time can be greatly reduced and models can be updated more frequently. We develop a Graph Structure Aware Incremental Learning framework, GraphSAIL, to address the commonly experienced catastrophic forgetting problem that occurs when training a model in an…

Optimization and Analysis of Distributed Averaging with Short Node Memory

Boris N. Oreshkin, Mark J. Coates, Michael G. Rabbat

cs.DC · March 2009 · cited 113× · arXiv ↗ · more like this ·

In this paper, we demonstrate, both theoretically and by numerical examples, that adding a local prediction component to the update rule can significantly improve the convergence rate of distributed averaging algorithms. We focus on the case where the local predictor is a linear combination of the node's two previous values (i.e., two memory taps), and our update rule computes a combination of the predictor and the usual weighted linear combination of values received from neighbouring nodes. We derive the optimal mixing parameter for combining the predictor with the neighbors' values, and carry out a theoretical analysis of the improvement in convergence rate that can be obtained using this acceleration methodology. For a chain topology on n nodes, this leads to a factor of n improvement over the one-step algorithm, and for a two-dimensional grid, our approach achieves a factor of n^1/2…

Multiple source, multiple destination network tomography

Michael Rabbat, Robert Nowak, Mark Coates

Computer Networks and Communications · 23 Dec 2004 · cited 108× · DOI ↗ · more like this ·

The problem of identifying topology and inferring link-level performance parameters such as packet drop rate or delay variance using only end-to-end measurements is commonly referred to as network tomography. This paper describes a collaborative framework for performing network tomography on topologies with multiple sources and multiple destinations, without assuming the topology to be known. Using multiple sources potentially provides a more accurate and refined characterization of the internal network. We present a novel multiple source active measurement procedure using a semirandomized probing scheme and packet arrival order measurements which do not require precise synchronization between the participating hosts. A decision-theoretic framework is developed enabling the joint characterization of topology and internal performance. We design a statistical test based on the generalized…

Accelerated Distributed Average Consensus via Localized Node State Prediction

Tuncer C. Aysal, Boris N. Oreshkin, Mark Coates

Computer Networks and Communications · IEEE Transactions on Signal Processing · 8 Dec 2008 · cited 90× · DOI ↗ · more like this ·

This paper proposes an approach to accelerate local, linear iterative network algorithms asymptotically achieving distributed average consensus. We focus on the class of algorithms in which each node initializes its ldquostate valuerdquo to the local measurement and then at each iteration of the algorithm, updates this state value by adding a weighted sum of its own and its neighbors' state values. Provided the weight matrix satisfies certain convergence conditions, the state values asymptotically converge to the average of the measurements, but the convergence is generally slow, impeding the practical application of these algorithms. In order to improve the rate of convergence, we propose a novel method where each node employs a linear predictor to predict future node values. The local update then becomes a convex (weighted) sum of the original consensus update and the prediction…

A Framework for Recommending Accurate and Diverse Items Using Bayesian Graph Convolutional Neural Networks

Jianing Sun, Wei Guo, Dengcheng Zhang +8 more

Information Systems · 20 Aug 2020 · cited 89× · DOI ↗ · more like this ·

Personalized recommender systems are playing an increasingly important role for online consumption platforms. Because of the multitude of relationships existing in recommender systems, Graph Neural Networks (GNNs) based approaches have been proposed to better characterize the various relationships between a user and items while modeling a user's preferences. Previous graph-based recommendation approaches process the observed user-item interaction graph as a ground-truth depiction of the relationships between users and items. However, especially in the implicit recommendation setting, all the unobserved user-item interactions are usually assumed to be negative samples. There are missing links that represent a user's future actions. In addition, there may be spurious or misleading positive interactions. To alleviate the above issue, in this work, we take a first step to introduce a…

Video-on-Demand Networks: Design Approaches and Future Challenges

Frederic Thouin, Mark Coates

Computer Networks and Communications · IEEE Network · March 2007 · cited 87× · DOI ↗ · more like this ·

IP network based deployments of interactive video-on-demand (VoD) systems are today very limited in scope, but there is a strong belief among telecommunication companies that this market will expand exponentially in the next few years. In this article, we outline the components of VoD architectures and survey the current approaches to their design. We strive to identify the research challenges that must be addressed in the development of design tools that can determine how to expand upon an existing network infrastructure to support video-on-demand. The long tail of content and extensive growth in usage are expected to have a major impact on the streaming and storage requirements of such systems. Hybrid VoD architectures that incorporate peer-to-peer exchange are an extremely promising paradigm, but there are many challenges in developing operational and economically feasible…

A multi-sensor multi-Bernoulli filter

Augustin-Alexandru Saucan, Mark Coates, Michael Rabbat

stat.ME · September 2016 · cited 78× · arXiv ↗ · more like this ·

In this paper we derive a multi-sensor multi-Bernoulli (MS-MeMBer) filter for multi-target tracking. Measurements from multiple sensors are employed by the proposed filter to update a set of tracks modeled as a multi-Bernoulli random finite set. An exact implementation of the MS-MeMBer update procedure is computationally intractable. We propose an efficient approximate implementation by using a greedy measurement partitioning mechanism. The proposed filter allows for Gaussian mixture or particle filter implementations. Numerical simulations conducted for both linear-Gaussian and non-linear models highlight the improved accuracy of the MS-MeMBer filter and its reduced computational load with respect to the multi-sensor cardinalized probability hypothesis density filter and the iterated-corrector cardinality-balanced multi-Bernoulli filter especially for low probabilities of detection.

Epidemiological Modelling of Peer-to-Peer Viruses and Pollution

R.W. Thommes, Mark Coates

Computer Networks and Communications · April 2006 · cited 76× · DOI ↗ · more like this ·

Abstract — The popularity of peer-to-peer (P2P) networks makes them an attractive target to the creators of viruses and other malicious code. Recently a number of viruses designed specifically to spread via P2P networks have emerged. Pollution has also become increasingly prevalent as copyright holders inject multiple decoy versions in order to impede item distribution. In this paper we derive deterministic epidemiological models for the propagation of a P2P virus through a P2P network and the dissemination of pollution. We report on discrete simulations that provide some verification that the models remain sufficiently accurate despite variations in individual peer conduct to provide insight into the behaviour of the system. The paper examines the steady-state behaviour and illustrates how the models may be used to estimate in a computationally efficient manner how effective object…

Network tomography for internal delay estimation

Mark Coates, Robert D. Nowak

Computer Networks and Communications · 13 Nov 2002 · cited 75× · DOI ↗ · more like this ·

On-line, spatially localized information about internal network performance can greatly assist dynamic routing algorithms and traffic transmission protocols. However, it is impractical to measure network traffic at all points in the network. A promising alternative is to measure only at the edge of the network and infer internal behavior from these measurements. We concentrate on the estimation and localization of internal delays based on end-to-end delay measurements from sources to receivers. We develop an EM algorithm for computing MLE of the internal delay distributions in cases where the network dynamics are stationary over the observation period. For time-varying cases, we propose a sequential Monte Carlo procedure capable of tracking non-stationary delay characteristics. Simulations are included to demonstrate the promise of these techniques.

Particle Filtering with Invertible Particle Flow

Yunpeng Li, Mark Coates

stat.ME · July 2016 · cited 68× · arXiv ↗ · more like this ·

A key challenge when designing particle filters in high-dimensional state spaces is the construction of a proposal distribution that is close to the posterior distribution. Recent advances in particle flow filters provide a promising avenue to avoid weight degeneracy; particles drawn from the prior distribution are migrated in the state-space to the posterior distribution by solving partial differential equations. Numerous particle flow filters have been proposed based on different assumptions concerning the flow dynamics. Approximations are needed in the implementation of all of these filters; as a result the articles do not exactly match a sample drawn from the desired posterior distribution. Past efforts to correct the discrepancies involve expensive calculations of importance weights. In this paper, we present new filters which incorporate deterministic particle flows into an…

Multisensor CPHD filter

Santosh Nannuru, Stephane Blouin, Mark Coates +1 more

stat.ME · April 2015 · cited 62× · arXiv ↗ · more like this ·

The single sensor probability hypothesis density (PHD) and cardinalized probability hypothesis density (CPHD) filters have been developed in the literature using the random finite set framework. The existing multisensor extensions of these filters have limitations such as sensor order dependence, numerical instability or high computational requirements. In this paper we derive update equations for the multisensor CPHD filter. The multisensor PHD filter is derived as a special case. Exact implementation of the multisensor CPHD involves sums over all partitions of the measurements from different sensors and is thus intractable. We propose a computationally tractable approximation which combines a greedy measurement partitioning algorithm with the Gaussian mixture representation of the PHD. Our greedy approximation method allows the user to control the tradeoff between computational…