Author

Bill Lin

166 papers · 1992–2026

1992peak 14 in 20092026

Frequent co-authors

Papers

showing 1–25 of 166 RSS

ORION3.0: A Comprehensive NoC Router Estimation Tool

Andrew B. Kahng, Bill Lin, Siddhartha Nath

Computer Networks and Communications · IEEE Embedded Systems Letters · 10 Feb 2015 · cited 123× · DOI ↗ · more like this ·

Networks-on-Chip (NoCs) are increasingly used in many-core architectures. ORION2.0 (see Ref [1] Kahng etal., Proc. DATE, 2009, pp. 423-428) is a widely adopted NoC power and area estimation tool, but its estimation models can have large errors (up to 185%) versus actual implementations. We present ORION3.0, an open-source tool whose parametric and nonparametric modeling methodologies fundamentally differ from ORION2.0 logic template-based approaches in that the estimation models are derived from actual physical implementation data. When compared with actual implementations, ORION3.0 models achieve average estimation errors of no more than 9.3% across microarchitecture, implementation, and operational parameters as well as multiple router RTL generators. A comprehensive suite of these methodologies has been implemented in ORION3.0 (see Ref [2] Available online…

Efficient Distribution Similarity Identification in Clustered Federated Learning via Principal Angles Between Client Data Subspaces

Saeed Vahidian, Mahdi Morafah, Weijia Wang +4 more

cs.LG · 21 Sep 2022 · cited 119× · arXiv ↗ · more like this ·

Clustered federated learning (FL) has been shown to produce promising results by grouping clients into clusters. This is especially effective in scenarios where separate groups of clients have significant differences in the distributions of their local data. Existing clustered FL algorithms are essentially trying to group together clients with similar distributions so that clients in the same cluster can leverage each other's data to better perform federated learning. However, prior clustered FL algorithms attempt to learn these distribution similarities indirectly during training, which can be quite time consuming as many rounds of federated learning may be required until the formation of clusters is stabilized. In this paper, we propose a new approach to federated learning that directly aims to efficiently identify distribution similarities among clients by analyzing the principal…

A methodology for efficient estimation of switching activity in sequential logic circuits

José Monteiro, Srinivas Devadas, Bill Lin

Hardware and Architecture · 1994 · cited 103× · DOI ↗ · more like this ·

W e describe a computationally ecient s c heme to approximate average switching activity in sequential circuits which requires the solution of a non-linear system of equations of size N, where the variables correspond to state line probabilities. W e show that the approximation method is within 3% of the exact Chapman-Kolmogorov method, but is orders of magnitude faster for large circuits. Previous sequential switching activity estimation methods can have signicantly greater inaccuracies.

Personalized Federated Learning by Structured and Unstructured Pruning under Data Heterogeneity

Saeed Vahidian, Mahdi Morafah, Bill Lin

cs.LG · 10 May 2021 · cited 86× · arXiv ↗ · more like this ·

The traditional approach in FL tries to learn a single global model collaboratively with the help of many clients under the orchestration of a central server. However, learning a single global model might not work well for all clients participating in the FL under data heterogeneity. Therefore, the personalization of the global model becomes crucial in handling the challenges that arise with statistical heterogeneity and the non-IID distribution of data. Unlike prior works, in this work we propose a new approach for obtaining a personalized model from a client-level objective. This further motivates all clients to participate in federation even under statistical heterogeneity in order to improve their performance, instead of merely being a source of data and model training for the central server. To realize this personalization, we leverage finding a small subnetwork for each client by…

Rethinking Data Heterogeneity in Federated Learning: Introducing a New Notion and Standard Benchmarks

Mahdi Morafah, Saeed Vahidian, Chen Chen +2 more

cs.LG · 30 Sep 2022 · cited 85× · arXiv ↗ · more like this ·

Though successful, federated learning presents new challenges for machine learning, especially when the issue of data heterogeneity, also known as Non-IID data, arises. To cope with the statistical heterogeneity, previous works incorporated a proximal term in local optimization or modified the model aggregation scheme at the server side or advocated clustered federated learning approaches where the central server groups agent population into clusters with jointly trainable data distributions to take the advantage of a certain level of personalization. While effective, they lack a deep elaboration on what kind of data heterogeneity and how the data heterogeneity impacts the accuracy performance of the participating clients. In contrast to many of the prior federated learning approaches, we demonstrate not only the issue of data heterogeneity in current setups is not necessarily a problem…

FLIS: Clustered Federated Learning via Inference Similarity for Non-IID Data Distribution

Mahdi Morafah, Saeed Vahidian, Weijia Wang +1 more

cs.LG · 20 Aug 2022 · cited 82× · arXiv ↗ · more like this ·

Classical federated learning approaches yield significant performance degradation in the presence of Non-IID data distributions of participants. When the distribution of each local dataset is highly different from the global one, the local objective of each client will be inconsistent with the global optima which incur a drift in the local updates. This phenomenon highly impacts the performance of clients. This is while the primary incentive for clients to participate in federated learning is to obtain better personalized models. To address the above-mentioned issue, we present a new algorithm, FLIS, which groups the clients population in clusters with jointly trainable data distributions by leveraging the inference similarity of clients' models. This framework captures settings where different groups of users have their own objectives (learning tasks) but by aggregating their data with…

Destination-based adaptive routing on 2D mesh networks

Rohit Sunkam Ramanujam, Bill Lin

Computer Networks and Communications · 25 Oct 2010 · cited 79× · DOI ↗ · more like this ·

The choice of routing algorithm plays a vital role in the performance of on-chip interconnection networks. Adaptive routing is appealing because it offers better latency and throughput than oblivious routing, especially under non-uniform and bursty traffic. The performance of an adaptive routing algorithm is determined by its ability to accurately estimate congestion in the network. In this regard, maintaining global congestion information using a separate monitoring network offers better congestion visibility into distant parts of the network than solutions relying only on local congestion state. However, the main challenge in designing such routing schemes is to keep the logic and bandwidth overhead as low as possible to fit into the tight power, area and delay budgets of on-chip routers. In this paper, we propose a minimal destination-based adaptive routing strategy (DAR) where every…

Constructing application-specific heterogeneous embedded architectures from custom HW/SW applications

Steven Vercauteren, Bill Lin, Hugo De Man

Hardware and Architecture · 1996 · cited 76× · DOI ↗ · more like this ·

Deep sub-micron processing technologies have enabled the implementation of new application-specificembeddedarchitecturesthat integrate multiple software programmable processors (e.g. DSPs, microcontrollers) and dedicated hardware components together onto a single cost-efficient IC. These application-specific architectures are emerging as a key design solution to today&apos;s microelectronics design problems, which are being driven by emerging applications in the areas of wireless communication, broadband networking, and multimedia computing. However, the constructionof these customized heterogeneous multiprocessor architectures, while ensuring that the hardware and software parts communicate correctly, is a tremendously difficult and highly error proned task with little or no tool support. In this paper, we present a solution to this embedded architecture cosynthesis problem based…

MINIMALIST: An Environment for the Synthesis, Verification and Testability of Burst-Mode Asynchronous Machines

Robert M. Fuhrer, Steven M. Nowick, Michael Theobald +3 more

Hardware and Architecture · Columbia Academic Commons (Columbia University) · 1999 · cited 75× · DOI ↗ · more like this ·

MINIMALIST is a new extensible environment for the synthesis and verification of burst-mode asynchronous finite-state machines. MINIMALIST embodies a complete technology-independent synthesis path, with state-of-the-art exact and heuristic asynchronous synthesis algorithms, e.g.optimal state assignment (CHASM), two-level hazard-free logic minimization (HFMIN, ESPRESSO-HF, and IMPYMIN), and synthesis-for-testability. Unlike other asynchronous synthesis packages, MINIMALIST also offers many options:literal vs. product optimization, single- vs. multi-output logic minimization, using vs. not using fed-back outputs as state variables, and exploring varied code lengths during state assignment, thus allowing the designer to explore trade-offs and select the implementation style which best suits the application. MINIMALIST benchmark results demonstrate its ability to produce implementations…

Design of a High-Throughput Distributed Shared-Buffer NoC Router

Rohit Sunkam Ramanujam, Vassos Soteriou, Bill Lin +1 more

Computer Networks and Communications · DSpace@MIT (Massachusetts Institute of Technology) · 2010 · cited 72× · DOI ↗ · more like this ·

Router microarchitecture plays a central role in the performance of an on-chip network (NoC). Buffers are needed in routers to house incoming flits which cannot be immediately forwarded due to contention. This buffering can be done at the inputs or the outputs of a router, corresponding to an input-buffered router (IBR) or an output-buffered router (OBR). OBRs are attractive because they can sustain higher throughputs and have lower queuing delays under high loads than IBRs. However, a direct implementation of an OBR requires a router speedup equal to the number of ports, making such a design prohibitive under aggressive clocking needs and limited power budgets of most NoC applications. In this paper, we propose a new router design that aims to emulate an OBR practically, based on a distributed shared-buffer (DSB) router architecture. We introduce innovations to address the unique…

Synthesis of concurrent system interface modules with automatic protocol conversion generation

Bill Lin, Steven Vercauteren

Computational Theory and Mathematics · International Conference on Computer Aided Design · 6 Nov 1994 · cited 65× · DOI ↗ · more like this ·

Abstract — We describe a new high-level compiler called Integral for designing system interface modules. The input is a high-level concurrent algorithmic specification that can model complex concurrent control flow, logical and arithmetic computations, abstract communication, and low-level behavior. For abstract communication between two communicating modules that obey different I/O protocols, the necessary protocol conversion behaviors are automatically synthesized using a Petri net theoretic approach. We present a synthesis trajectory that can synthesize the necessary hardware resources, control circuitry, and protocol conversion behaviors for implementing system interface modules. 1

Software synthesis of process-based concurrent programs

Bill Lin

Hardware and Architecture · 1998 · cited 64× · DOI ↗ · more like this ·

We present a Petri net theoretic approach to the software synthesis problem that can synthesize ordinary C programs from process-based concurrent specifications without the need for a run-time multi-threading environment. The synthesized C programs can be readily retargeted to different processors using available optimizing C compilers. Our compiler can also generate sequential Java programs as output, which can also be readily mapped to a target processor without the need for a multi-threading environment. Initial results demonstrate significant potentials for improvements over current run-time solutions.

A generalized state assignment theory for transformations on signal transition graphs

Peter Vanbekbergen, Bill Lin, Gert Goosens +1 more

Computational Theory and Mathematics · 8 Nov 1992 · cited 61× · DOI ↗ · more like this ·

Abstract. In this article, we propose a global assignment theory for encoding state graph transformations. A constraint satisfaction framework is proposed that can guarantee necessary and sufficient conditions for a state graph assignment to result in a transformed state graph that is free of critical races. Performing transformations at the state graph level has the advantage that the requirements imposed on the initial STG are very weak. Unlike previous methods, the initial STG need not be a live, safe, nor a free choice net. The only requirement is that the corresponding initial state graph is finite, connected, and has a consistent state assignment. Hence, a very broad range of signal transition graphs can be synthesized. The transformations achievable using the proposed framework correspond to very complex transformations on signal transition graphs. Even transformations that…

Learning Accurate and Interpretable Decision Rule Sets from Neural Networks

Litao Qiao, Weijia Wang, Bill Lin

cs.LG · 12 Mar 2021 · cited 59× · arXiv ↗ · more like this ·

This paper proposes a new paradigm for learning a set of independent logical rules in disjunctive normal form as an interpretable model for classification. We consider the problem of learning an interpretable decision rule set as training a neural network in a specific, yet very simple two-layer architecture. Each neuron in the first layer directly maps to an interpretable if-then rule after training, and the output neuron in the second layer directly maps to a disjunction of the first-layer rules to form the decision rule set. Our representation of neurons in this first rules layer enables us to encode both the positive and the negative association of features in a decision rule. State-of-the-art neural net training approaches can be leveraged for learning highly accurate classification models. Moreover, we propose a sparsity-based regularization approach to balance between…

Explicit modeling of control and data for improved NoC router estimation

Andrew B. Kahng, Bill Lin, Siddhartha Nath

Computer Networks and Communications · 31 May 2012 · cited 52× · DOI ↗ · more like this ·

Networks-on-Chip (NoCs) are scalable fabrics for interconnection networks used in many-core architectures. ORION2.0 is a widely adopted NoC power and area estimation tool; however, its models for area, power and gate count can have large errors (up to 110% on average) versus actual implementation. In this work, we propose a new methodology that analyzes netlists of NoC routers that have been placed and routed by commercial tools, and then performs explicit modeling of control and data paths followed by regression analysis to create highly accurate gate count, area and power models for NoCs. When compared with actual implementations, our new models have average estimation errors of no more than 9.8% across microarchitecture and implementation parameters. We further describe modeling extensions that enable more detailed flit-level power estimation when integrated with simulation tools…

A High-Throughput Distributed Shared-Buffer NoC Router

Vassos Soteriou, Rohit Sunkam Ramanujam, Bill Lin +1 more

Computer Networks and Communications · IEEE Computer Architecture Letters · 2009 · cited 51× · DOI ↗ · more like this ·

Microarchitectural configurations of buffers in routers have a significant impact on the overall performance of an on-chip network (NoC). This buffering can be at the inputs or the outputs of a router, corresponding to an input-buffered router (IBR) or an output-buffered router (OBR). OBRs are attractive because they have higher throughput and lower queuing delays under high loads than IBRs. However, a direct implementation of OBRs requires a router speedup equal to the number of ports, making such a design prohibitive given the aggressive clocking and power budgets of most NoC applications. In this letter, we propose a new router design that aims to emulate an OBR practically based on a distributed shared-buffer (DSB) router architecture. We introduce innovations to address the unique constraints of NoCs, including efficient pipelining and novel flow control. Our DSB design can achieve…

Accurate Machine-Learning-Based On-Chip Router Modeling

Kwangok Jeong, Andrew B. Kahng, Bill Lin +1 more

Computer Networks and Communications · IEEE Embedded Systems Letters · 3 Jun 2010 · cited 44× · DOI ↗ · more like this ·

As industry moves towards multicore chips, networks-on-chip (NoCs) are emerging as the scalable fabric for interconnecting the cores. With power now the first-order design constraint, early-stage estimation of NoC power, performance, and area has become crucially important. In this work, we develop accurate architecture-level on-chip router cost models using machine-learning-based regression techniques. Compared against existing models (e.g., ORION 2.0 and parametric models), our models reduce estimation error by up to 89% on average.

Flow Graph Balancing for Minimizing the Required Memory Bandwidth

Sven Wuytack, Francky Catthoor, Gjalt De Jong +2 more

Hardware and Architecture · 1996 · cited 42× · OpenAlex ↗ · more like this ·

In this paper we present the problem of flow graph balancing for minimizing the required memory bandwidth. Our goal is to minimize the required memory bandwidth within the given cycle budget by adding ordering constraints to the flow graph. This allows the subsequent memory allocation and assignment tasks to come up with a cheaper memory architecture with less memories and memory ports. The effect of flow graph balancing is shown on an example. We show that it is important to take into account which data is being accessed in parallel, instead of only considering the number of simultaneous memory accesses. This leads to the optimization of a conflict graph. 1. Introduction Many important applications deal with large amounts of data. This is the case both in multi-dimensional signal processing applications like video and image processing, which handle indexed signals in the context of…

BRICK

Nan Hua, Bill Lin, Jun Xu +1 more

Hardware and Architecture · 6 Nov 2008 · cited 40× · DOI ↗ · more like this ·

In this paper, we present an exact active statistics counter architecture called BRICK (Bucketized Rank Indexed Counters) that can efficiently store per-flow variable-width statistics counters entirely in SRAM while supporting both fast updates and lookups (e.g., 40 Gb/s line rates). BRICK exploits statistical multiplexing by randomly bundling counters into small fixed-size buckets and supports dynamic sizing of counters by employing an innovative indexing scheme called rank-indexing. Experiments with Internet traces show that our solution can indeed maintain large arrays of exact active statistics counters with moderate amounts of SRAM.

Application-specific network-on-chip architecture synthesis based on set partitions and Steiner trees

Shan Yan, Bill Lin

Computer Networks and Communications · Asia and South Pacific Design Automation Conference · 21 Jan 2008 · cited 36× · DOI ↗ · more like this ·

Abstract — This paper considers the problem of synthesizing application-specific Network-on-Chip (NoC) architectures. We propose two heuristic algorithms called CLUSTER and DECOM-POSE that can systematically examine different set partitions of communication flows, and we propose Rectilinear-Steiner-Tree (RST) based algorithms for generating an efficient network topol-ogy for each group in the partition. Different evaluation functions in fitting with the implementation backend and the correspond-ing implementation technology can be incorporated into our so-lution framework to evaluate the implementation cost of the set partitions and RST topologies generated. In particular, we exper-imented with an implementation cost model based on the power consumption parameters of a 70nm process technology where leakage power is a major source of energy consumption. Ex-perimental results on a variety…

FedNLP: A Research Platform for Federated Learning in Natural Language Processing.

Bill Lin, Chaoyang He, Zihang Zeng +5 more

Artificial Intelligence · 18 Apr 2021 · cited 33× · OpenAlex ↗ · more like this ·

Increasing concerns and regulations about data privacy, necessitate the study of privacy-preserving methods for natural language processing (NLP) applications. Federated learning (FL) provides promising methods for a large number of clients (i.e., personal devices or organizations) to collaboratively learn a shared global model to benefit all clients, while allowing users to keep their data locally. To facilitate FL research in NLP, we present the FedNLP, a research platform for federated learning in NLP. FedNLP supports various popular task formulations in NLP such as text classification, sequence tagging, question answering, seq2seq generation, and language modeling. We also implement an interface between Transformer language models (e.g., BERT) and FL methods (e.g., FedAvg, FedOpt, etc.) for distributed training. The evaluation protocol of this interface supports a comprehensive…

A communicating Petri net model for the design of concurrent asynchronous modules

Gjalt G. de Jong, Bill Lin

Computational Theory and Mathematics · 1994 · cited 33× · DOI ↗ · more like this ·

Abstract Current asynchronous tools are focussed mainly on the design of a single interface module. In many applications, one must design interacting interface modules that potentially communicate in complex and intricate ways. When designing communicating asynchronous modules, several difficult problems arise. First, even if each individual module can be synthesized correctly, according to the environmental assumptions specified for that module, the composition of the communicating modules may not work properly. Thus, one needs to have a way to model how the modules interact with each other, and to verify that their cooperation is consistent. In addition, means should be provided for communication and synchronization at a level higher than signal transitions, and for exploiting the communicating nature of these modules in optimization. This paper proposes a communicating Petri net…

Design and implementation of high-speed symmetric crossbar schedulers

J. Hurt, April C. May, Xiaohan Zhu +1 more

Computer Networks and Communications · 20 Jan 2003 · cited 31× · DOI ↗ · more like this ·

Crossbar architectures are widely used to implement high-performance network switches and routers. A crossbar switch can transfer cells between multiple ports simultaneously by closing multiple cross points. This crossbar configuration must be determined by an intelligent centralized scheduler that can ensure fairness and high utilization. In this paper, we describe the design and implementation of two symmetric scheduling algorithms for configuring crossbars in input-queued switches that support virtual output queueing. Our target is a fast packet switch that can support 32 ports, each operating at 20 Gbps. Using a 0.35 /spl mu/m CMOS process, the faster of the two schedulers is capable of configuring a 32/spl times/32 crossbar once every 12.61 ns. Our scheduler designs are based on a two-dimensional ripple carry arbiter architecture. To ensure fairness, both architectures support a…

Revisiting State Blow-Up: Automatically Building Augmented-FA While Preserving Functional Equivalence

Xiaodong Yu, Bill Lin, Michela Becchi

Hardware and Architecture · IEEE Journal on Selected Areas in Communications · 17 Sep 2014 · cited 30× · DOI ↗ · more like this ·

Regular expression matching, a central task in deep packet inspection and other networking applications, has been traditionally implemented through finite automata. Thanks to their limited per-character processing and memory bandwidth requirements, deterministic finite automata (DFA) are a natural choice for memory-based implementations. In the presence of large datasets of complex patterns, however, DFA suffer from the well-known state explosion problem. Specifically, state explosion can take place during DFA generation when the considered patterns contain bounded and unbounded repetitions of wildcards or large character sets. Several alternative FA representations have been proposed to address this problem. However, these proposals all suffer from one or more of the following problems: some can avoid state explosion only on datasets of limited size and complexity; some have…

Rank-indexed hashing: A compact construction of Bloom filters and variants

Nan Hua, Haiquan Zhao, Bill Lin +1 more

Computer Networks and Communications · Proceedings/Proceedings - International Conference on Network Protocols · October 2008 · cited 29× · DOI ↗ · more like this ·

Bloom filter and its variants have found widespread use in many networking applications. For these applications, minimizing storage cost is paramount as these filters often need to be implemented using scarce and costly (on-chip) SRAM. Besides supporting membership queries, Bloom filters have been generalized to support deletions and the encoding of information. Although a standard Bloom filter construction has proven to be extremely space-efficient, it is unnecessarily costly when generalized. Alternative constructions based on storing fingerprints in hash tables have been proposed that offer the same functionality as some Bloom filter variants, but using less space. In this paper, we propose a new fingerprint hash table construction called Rank-Indexed Hashing that can achieve very compact representations. A rank-indexed hashing construction that offers the same functionality as a…