arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Roy Timo

28 papers · 2006–2021

2006: 32007: 32008: 02009: 22010: 12011: 32012: 32013: 02014: 12015: 12016: 92017: 12018: 02019: 02020: 02021: 1
2006peak 9 in 20162021

Frequent co-authors

Papers

showing 1–25 of 28 RSS

Noisy Broadcast Networks with Receiver Caching

Shirin Saeedi Bidokhti, Michèle Wigger, Roy Timo

cs.IT · · cited 96× · arXiv ↗ · more like this ·

We study noisy broadcast networks with local cache memories at the receivers, where the transmitter can pre-store information even before learning the receivers' requests. We mostly focus on packet-erasure broadcast networks with two disjoint sets of receivers: a set of weak receivers with all-equal erasure probabilities and equal cache sizes and a set of strong receivers with all-equal erasure probabilities and no cache memories. We present lower and upper bounds on the capacity-memory tradeoff of this network. The lower bound is achieved by a new joint cache-channel coding idea and significantly improves on schemes that are based on separate cache-channel coding. We discuss how this coding idea could be extended to more general discrete memoryless broadcast channels and to unequal cache sizes. Our upper bound holds for all stochastically degraded broadcast channels. For the described…

Joint Cache-Channel Coding over Erasure Broadcast Channels

Roy Timo, Michele Wigger

cs.IT · · cited 58× · arXiv ↗ · more like this ·

We consider a cache-aided communications system in which a transmitter communicates with many receivers over an erasure broadcast channel. The system serves as a basic model for communicating on-demand content during periods of high network congestion, where some content can be pre-placed in local caches near the receivers. We formulate the cache-aided communications problem as a joint cache-channel coding problem, and characterise some information-theoretic tradeoffs between reliable communications rates and cache sizes. We show that if the receivers experience different channel qualities, then using unequal cache sizes and joint cache-channel coding improves system efficiency.

A Rate-Distortion Approach to Caching

Roy Timo, Shirin Saeedi Bidokhti, Michèle Wigger +1 more

cs.IT · · cited 36× · arXiv ↗ · more like this ·

This paper takes a rate-distortion approach to understanding the information-theoretic laws governing cache-aided communications systems. Specifically, we characterise the optimal tradeoffs between the delivery rate, cache capacity and reconstruction distortions for a single-user problem and some special cases of a two-user problem. Our analysis considers discrete memoryless sources, expected- and excess-distortion constraints, and separable and f-separable distortion functions. We also establish a strong converse for separable-distortion functions, and we show that lossy versions of common information (Gács-Körner and Wyner) play an important role in caching. Finally, we illustrate and explicitly evaluate these laws for multivariate Gaussian sources and binary symmetric sources.

Erasure broadcast networks with receiver caching

Shirin Saeedi Bidokhti, Michèle Wigger, Roy Timo

Computer Networks and Communications · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 36× · DOI ↗ · more like this ·

We study the capacity of a broadcast packet-erasure network with receiver caching. The receivers in the network are divided into two groups: A group of strong receivers with small packet erasure probabilities, and a group of weak receivers with large packet erasure probabilities. The weak receivers are provided with local cache memories as compensation for their poor channels. Achievable (lower) and converse (upper) bounds for the optimal capacity-memory tradeoff are derived. The lower bounds are proved using new joint cache-channel coding schemes that significantly outperform naive separate cache-channel coding schemes. For the case of two receivers, the capacity-memory tradeoff is completely characterized for a range of useful cache memory sizes.

Testing against independence with multiple decision centers

Michèle Wigger, Roy Timo

Computer Networks and Communications · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · · cited 33× · DOI ↗ · more like this ·

We consider a three-terminal distributed hypothesis testing against independence problem. Two terminals, which act as decision centers, are required to decide whether their observed sequences are probabilistically independent of the sequence observed at the third terminal. The third terminal communicates with the two decision centers over three rate-limited noise-free pipes (error free channels): A common pipe that is connected to both centers, and two private pipes that connect separately to each center. We characterize the optimal exponential decay of the type-II error probabilities at the two decision centers given that the type-I error probabilities vanish for increasing blocklengths. The optimal exponents are determined by a certain information-theoretic optimization problem that depends on the maximum rates allowed over the noise-free communication pipes.

On Entropy Measures for Dynamic Network Topologies: Limits to MANET

Roy Timo, Kim Blackmore, Leif Hanlen

Computer Networks and Communications · ANU Open Research (Australian National University) · · cited 19× · DOI ↗ · more like this ·

What are the fundamental limits on the communications potential of wireless networks? We contend that quantifying topological dynamics resulting from node movement enables one to: find the minimum overhead required by the network to maintain connectivity and, calculate the communication potential of the network. A mobility metric is proposed for the unbiased comparison of networks. This is an entropy measure based on the uncertainty of change in the topology of the network, and is referred to as topological uncertainty. Topological uncertainty determines the minimum overhead required by the network to correctly identify the topology and hence, provide node connectivity. We use topological uncertainty to derive fundamental bounds on the maximum bit rate available within a mobile ad-hoc networking environment. Our work demonstrates the potential of entropy measures to describe the…

Multi-Way Relay Networks: Orthogonal Uplink, Source-Channel Separation and Code Design

Roy Timo, Gottfried Lechner, Lawrence Ong +1 more

cs.IT · · cited 14× · arXiv ↗ · more like this ·

We consider a multi-way relay network with an orthogonal uplink and correlated sources, and we characterise reliable communication (in the usual Shannon sense) with a single-letter expression. The characterisation is obtained using a joint source-channel random-coding argument, which is based on a combination of Wyner et al.'s "Cascaded Slepian-Wolf Source Coding" and Tuncel's "Slepian-Wolf Coding over Broadcast Channels". We prove a separation theorem for the special case of two nodes; that is, we show that a modular code architecture with separate source and channel coding functions is (asymptotically) optimal. Finally, we propose a practical coding scheme based on low-density parity-check codes, and we analyse its performance using multi-edge density evolution.

Strong Stochastic Stability for MANET Mobility Models

Roy Timo, Kim Blackmore, Leif Hanlen

Computer Networks and Communications · ˜The œ... IEEE International Conference on Networks/˜The œIEEE International Conference on Networks · · cited 11× · DOI ↗ · more like this ·

At the core of any MANET simulation is a mobility model. To help ensure reliable simulation results, it is of interest to know if the mobility model is stable: Will time-averaged measurements of "mobility model events" converge? For example, does the time-averaged distance between a pair of nodes converge as simulation time increases? In this paper, we study the stability of a class of discrete Random Waypoint Mobility Models (RWMMs). This class includes the classic Random Waypoint Mobility Model. We show that each mobility model in this class satisfies a pointwise ergodic theorem (a generalized strong law of large numbers); thus, all bounded time-averaged measurements of mobility model events converge with probability one. A corollary of this ergodic theorem shows that each mobility model in this class also possesses a time-stationary regime.

A converse for lossy source coding in the finite blocklength regime

Lars Palzer, Roy Timo

Computer Vision and Pattern Recognition · Repository for Publications and Research Data (ETH Zurich) · · cited 10× · DOI ↗ · more like this ·

We present a converse bound for lossy source coding in the finite blocklength regime.The bound is based on d-tilted information, and it combines ideas from two different converse techniques by Kostina and Verd .When particularised to the binary and Gaussian memoryless sources, the new bound gives slightly tighter results in certain blocklength regimes.

The Two-Way Relay Network with Arbitrarily Correlated Sources and an Orthogonal MAC

Roy Timo, Lawrence Ong, Gottfried Lechner

Computer Networks and Communications · UniSA Research Outputs Repository (University of South Australia) · · cited 6× · DOI ↗ · more like this ·

The problem of loss less joint source-channel coding for the two-way relay network with an orthogonal multiple access channel is studied. Necessary and sufficient conditions for reliable communication are given, and a separation theorem for source and channel coding is proved.

MANETs: Routing Overhead and Reliability

Roy Timo, Leif Hanlen

Computer Networks and Communications · · cited 6× · DOI ↗ · more like this ·

Node mobility and physical channel effects cause the quality of links in wireless networks to fluctuate randomly. At the network layer, these changes are accommodated by the control information (overhead) of routing protocols. We provide lower bounds on the minimum average control overhead of deterministic routing protocols. When routing devices use noisy, out-of-date, or guess topology information, routing errors will occur. The number of "routing errors" experienced by well known routing schemes grows non-trivially with increased estimation noise. Route error growth is a novel characterization of protocol robustness for switched packet networks. This work motivates an information theoretic view of routing protocols

Lossy Broadcasting in Two-Way Relay Networks with Common Reconstructions

Roy Timo, Alex Grant, Gerhard Kramer

cs.IT · · cited 4× · arXiv ↗ · more like this ·

The broadcast phase (downlink transmission) of the two-way relay network is studied in the source coding and joint source-channel coding settings. The rates needed for reliable communication are characterised for a number of special cases including: small distortions, deterministic distortion measures, and jointly Gaussian sources with quadratic distortion measures. The broadcast problem is also studied with common-reconstruction decoding constraints, and the rates needed for reliable communication are characterised for all discrete memoryless sources and per-letter distortion measures.

A lower bound on network layer control information

Roy Timo, Leif Hanlen, Kim Blackmore

Computer Networks and Communications · ANU Open Research (Australian National University) · · cited 4× · OpenAlex ↗ · more like this ·

Any asymptotic mean stationary mobility model generates, at the network layer, a route process that satisfies the Asymptotic Equipartition Partition Theorem of Information Theory. This permits an information theoretic lower bound for network layer control information. By recasting the mobility problem as a Dynamical System, we provide a unique and rigorous examination of mobility models and routing protocols. In particular, new results on stationary and ergodic properties of common mobility models – via two useful generalizations – are provided. The important concept ‘perfect simulation’ for reliable, and repeatable, results is formalized. A fixed to variable length encoding lemma – of independent interest – for asymptotically mean stationary sources is developed. Finally, a lower bound on network layer control information is presented. 1.

Slepian-Wolf Coding for Broadcasting with Cooperative Base-Stations

Roy Timo, Michéle Wigger

cs.IT · · cited 3× · arXiv ↗ · more like this ·

We propose a base-station (BS) cooperation model for broadcasting a discrete memoryless source in a cellular or heterogeneous network. The model allows the receivers to use helper BSs to improve network performance, and it permits the receivers to have prior side information about the source. We establish the model's information-theoretic limits in two operational modes: In Mode 1, the helper BSs are given information about the channel codeword transmitted by the main BS, and in Mode 2 they are provided correlated side information about the source. Optimal codes for Mode 1 use \emph{hash-and-forward coding} at the helper BSs; while, in Mode 2, optimal codes use source codes from Wyner's \emph{helper source-coding problem} at the helper BSs. We prove the optimality of both approaches by way of a new list-decoding generalisation of [8, Thm. 6], and, in doing so, show an operational…

The Finite Field Multi-Way Relay Channel with Correlated Sources: The Three-User Case

Lawrence Ong, Roy Timo, Gottfried Lechner +2 more

cs.IT · · cited 3× · arXiv ↗ · more like this ·

The three-user finite field multi-way relay channel with correlated sources is considered. The three users generate possibly correlated messages, and each user is to transmit its message to the two other users reliably in the Shannon sense. As there is no direct link among the users, communication is carried out via a relay, and the link from the users to the relay and those from the relay to the users are finite field adder channels with additive noise of arbitrary distribution. The problem is to determine the set of all possible achievable rates, defined as channel uses per source symbol for reliable communication. For two classes of source/channel combinations, the solution is obtained using Slepian-Wolf source coding combined with functional-decode-forward channel coding.

On the entropy rate of word-valued sources

Roy Timo, Kim Blackmore, Leif Hanlen

Artificial Intelligence · ANU Open Research (Australian National University) · · cited 3× · DOI ↗ · more like this ·

A word-valued source Y is a discrete finite alphabet random process which is created by encoding a discrete random process X with a symbol-to-word function f. In Information Theory (in particular source coding), it is of interest to know which word valued sources possess an entropy rate Hmacr(Y). Nishiara and Morita showed that if X is independent and identically distributed and f is prefix free, then Hmacr(Y) exists and is equal to Hmacr(X) divided the expected codeword length. This "conservation of entropy" result was latter extended by Goto, Matsushima and Hirasawa to include stationary and ergodic X. In this paper, we extend these results to ergodic and Asymptotically Mean Stationary (AMS) X: If X is Asymptotically Mean Stationary (AMS), then Hmacr(Y) is equal to the expectation of the entropy rate of each stationary ergodic sub-source of X divided by the expected codeword length of…

The Finite Field Multi-Way Relay Channel with Correlated Sources: Beyond Three Users

Lawrence Ong, Roy Timo, Sarah J. Johnson

cs.IT · · cited 2× · arXiv ↗ · more like this ·

The multi-way relay channel (MWRC) models cooperative communication networks in which many users exchange messages via a relay. In this paper, we consider the finite field MWRC with correlated messages. The problem is to find all achievable rates, defined as the number of channel uses required per reliable exchange of message tuple. For the case of three users, we have previously established that for a special class of source distributions, the set of all achievable rates can be found [Ong et al., ISIT 2010]. The class is specified by an almost balanced conditional mutual information (ABCMI) condition. In this paper, we first generalize the ABCMI condition to the case of more than three users. We then show that if the sources satisfy the ABCMI condition, then the set of all achievable rates is found and can be attained using a separate source-channel coding architecture.

Word-Valued Sources: an Ergodic Theorem, an AEP and the Conservation of Entropy

Roy Timo, Kim Blackmore, Leif Hanlen

cs.IT · · cited 2× · arXiv ↗ · more like this ·

A word-valued source $\mathbf{Y} = Y_1,Y_2,...$ is discrete random process that is formed by sequentially encoding the symbols of a random process $\mathbf{X} = X_1,X_2,...$ with codewords from a codebook $\mathscr{C}$. These processes appear frequently in information theory (in particular, in the analysis of source-coding algorithms), so it is of interest to give conditions on $\mathbf{X}$ and $\mathscr{C}$ for which $\mathbf{Y}$ will satisfy an ergodic theorem and possess an Asymptotic Equipartition Property (AEP). In this correspondence, we prove the following: (1) if $\mathbf{X}$ is asymptotically mean stationary, then $\mathbf{Y}$ will satisfy a pointwise ergodic theorem and possess an AEP; and, (2) if the codebook $\mathscr{C}$ is prefix-free, then the entropy rate of $\mathbf{Y}$ is equal to the entropy rate of $\mathbf{X}$ normalized by the average codeword length.

Strong stochastic stability for Dynamic Source Routing

Roy Timo, Kim Blackmore, John Papandriopoulos

Computer Networks and Communications · ANU Open Research (Australian National University) · · cited 2× · DOI ↗ · more like this ·

Node movement in a mobile ad-hoc network (MANET) simulation is defined by the mobility model. To ensure reliable simulation results, many research papers have investigated the stability (or instability) of popular mobility models. In general, these works have been concerned with the following question: Will time-averaged measurements of ldquomobility model eventsrdquo converge? For example, will average node speed or position converge as simulation time increases? These works, however, do not address stability questions at different network layers. In this paper, we study the following problem: When is the output of a network protocol stable? Network protocols are complex distributed systems, which may (or may not) preserve the stability of the mobility model. We study a basic version of the popular dynamic source routing (DSR) protocol and show that if a pointwise ergodic theorem (a…

Complete Interference Mitigation Through Receiver-Caching in Wyner's Networks

Michèle Wigger, Roy Timo, Shlomo Shamai

cs.IT · · cited 1× · arXiv ↗ · more like this ·

We present upper and lower bounds on the per-user multiplexing gain (MG) of Wyner's circular soft-handoff model and Wyner's circular full model with cognitive transmitters and receivers with cache memories. The bounds are tight for cache memories with prelog $μ\geq 2/3D$ in the soft-handoff model and for $μ\geq D$ in the full model, where $D$ denotes the number of possibly demanded files. In these cases the per-user MG of the two models is $1+μ/D$, the same as for non-interfering point-to-point links with caches at the receivers. Large receiver cache-memories thus allow to completely mitigate interference in these networks.

Sparse Graph Codes for the Two-Way Relay Network with Correlated Sources

Gottfried Lechner, Roy Timo, Lawrence Ong

Computer Networks and Communications · Figshare · · cited 1× · DOI ↗ · more like this ·

We consider the two-way relay network where two nodes communicate via a relay. We assume that the data at the nodes are correlated (e.g., measurements in a sensor network) and that there is no direct communication between the nodes. The nodes communicate via the relay using a two-phase protocol consisting of an uplink part over an orthogonal multiple access channel and a downlink part over a broadcast channel. The individual codes as well as the overall system can be represented by a joint factor graph consisting of a source code at each node, a channel code for the each uplink and a channel code for the downlink. The optimality of separation of source and channel coding implies that it is optimal to individually design these codes. We focus on low-density parity-check codes where code design corresponds to the optimisation of their degree distributions.

A Multiway Relay Channel with Balanced Sources

Lawrence Ong, Roy Timo

cs.IT · · cited 0× · arXiv ↗ · more like this ·

We consider a joint source-channel coding problem on a finite-field multiway relay channel, and we give closed-form lower and upper bounds on the optimal source-channel rate. These bounds are shown to be tight for all discrete memoryless sources in a certain class $\mathcal{P}^*$, and we demonstrate that strict source-channel separation is optimal within this class. We show how to test whether a given source belongs to $\mathcal{P}^*$, we give a balanced-information regularity condition for $\mathcal{P}^*$, and we express $\mathcal{P}^*$ in terms of conditional multiple-mutual informations. Finally, we show that $\mathcal{P}^*$ is useful for a centralised storage problem.

Fueling the Next Quantum Leap in Cellular Networks: Embracing AI in 5G Evolution towards 6G

Xingqin Lin, Mingzhe Chen, Henrik Rydén +6 more

cs.NI · · arXiv ↗ · more like this ·

Cellular networks, such as 5G systems, are becoming increasingly complex for supporting various deployment scenarios and applications. Embracing artificial intelligence (AI) in 5G evolution is critical to managing the complexity and fueling the next quantum leap in 6G cellular networks. In this article, we share our experience and best practices in applying AI in cellular networks. We first present a primer on the state of the art of AI in cellular networks, including basic concepts and recent key advances. Then we discuss 3GPP standardization aspects and share various design rationales influencing standardization. We also present case studies with real network data to showcase how AI can improve network performance and enable network automation.

On Hypothesis Testing Against Independence with Multiple Decision Centers

Sadaf Salehkalaibar, Michele Wigger, Roy Timo

cs.IT · · arXiv ↗ · more like this ·

A distributed binary hypothesis testing problem is studied with one observer and two decision centers. Achievable type-II error exponents are derived for testing against conditional independence when the observer communicates with the two decision centers over one common and two individual noise-free bit pipes and when it communicates with them over a noisy broadcast channel (BC). The results are based on a coding and testing scheme that splits the observations into subblocks, so that transmitter and receivers can independently apply to each subblock either Gray-Wyner coordination coding with side-information or hybrid joint source-channel coding with side-information, followed by a Neyman-Pearson test over the subblocks at the receivers. This approach allows to avoid introducing further error exponents that one would expect from the receivers' decoding operations related to binning or…

Common Reconstructions in the Successive Refinement Problem with Receiver Side Information

Badri N. Vellambi, Roy Timo

cs.IT · · arXiv ↗ · more like this ·

We study a variant of the successive refinement problem with receiver side information where the receivers require identical reconstructions. We present general inner and outer bounds for the rate region for this variant and present a single-letter characterization of the admissible rate region for several classes of the joint distribution of the source and the side information. The characterization indicates that the side information can be fully used to reduce the communication rates via binning; however, the reconstruction functions can depend only on the Gács-Körner common randomness shared by the two receivers. Unlike existing (inner and outer) bounds to the rate region of the general successive refinement problem, the characterization of the admissible rate region derived for several settings of the variant studied requires only one auxiliary random variable. Using the derived…