Author

Stark C. Draper

159 papers · 1970–2026

1970peak 16 in 20112026

Frequent co-authors

Papers

showing 1–25 of 159 RSS

Secure Biometrics: Concepts, Authentication Architectures and Challenges

Shantanu Rane, Ye Wang, Stark. C. Draper +1 more

cs.CR · 21 May 2013 · cited 100× · arXiv ↗ · more like this ·

BIOMETRICS are an important and widely used class of methods for identity verification and access control. Biometrics are attractive because they are inherent properties of an individual. They need not be remembered like passwords, and are not easily lost or forged like identifying documents. At the same time, bio- metrics are fundamentally noisy and irreplaceable. There are always slight variations among the measurements of a given biometric, and, unlike passwords or identification numbers, biometrics are derived from physical characteristics that cannot easily be changed. The proliferation of biometric usage raises critical privacy and security concerns that, due to the noisy nature of biometrics, cannot be addressed using standard cryptographic methods. In this article we present an overview of "secure biometrics", also referred to as "biometric template protection", an emerging…

Using Distributed Source Coding to Secure Fingerprint Biometrics

Stark C. Draper, Ashish Khisti, Emin Martinian +2 more

Signal Processing · 2007 · cited 99× · DOI ↗ · more like this ·

We describe a method to encode fingerprint biometrics securely for use, e.g., in encryption or access control. The system is secure because the stored data does not suffice to recreate the original fingerprint biometric. Therefore, a breach in database security does not lead to the loss of biometric data. At the same time the stored data suffices to validate a probe fingerprint. Our approach is based on the use of distributed source coding techniques implemented with graph-based codes. We present a statistical model of the relationship between the enrollment biometric and the (noisy) biometric measurement taking during authentication. We describe how to validate or reject a candidate biometric probe given the probe and the stored encoded data. We report the effectiveness of our method as tested on a database consisting of 579 data sets, each containing roughly 15 measurements of a…

The ADMM penalized decoder for LDPC codes

Xishuo Liu, Stark C. Draper

cs.IT · 17 Sep 2014 · cited 87× · arXiv ↗ · more like this ·

Linear programming (LP) decoding for low-density parity-check (LDPC) codes proposed by Feldman et al. is shown to have theoretical guarantees in several regimes and empirically is not observed to suffer from an error floor. However at low signal-to-noise ratios (SNRs), LP decoding is observed to have worse error performance than belief propagation (BP) decoding. In this paper, we seek to improve LP decoding at low SNRs while still achieving good high SNR performance. We first present a new decoding framework obtained by trying to solve a non-convex optimization problem using the alternating direction method of multipliers (ADMM). This non-convex problem is constructed by adding a penalty term to the LP decoding objective. The goal of the penalty term is to make "pseudocodewords", which are the non-integer vertices of the LP relaxation to which the LP decoder fails, more costly. We name…

Feature extraction for a Slepian-Wolf biometric system using LDPC codes

Yagiz Sutcu, Shantanu Rane, Jonathan S. Yedidia +2 more

Signal Processing · July 2008 · cited 84× · DOI ↗ · more like this ·

We present an information-theoretically secure biometric storage system using graph-based error correcting codes in a Slepian-Wolf coding framework. Our architecture is motivated by the noisy nature of personal biometrics and the requirement to provide security without storing the true biometric at the device. The principal difficulty is that real biometric signals, such as fingerprints, do not obey the i.i.d. or ergodic statistics that are required for the underlying typicality properties in the Slepian-Wolf coding framework. To meet this challenge, we propose to transform the biometric data into binary feature vectors that are i.i.d. Bernoulli(0.5), independent across different users, and related within the same user through a BSC-p channel with small p< 0.5. Since this is a standard channel model for LDPC codes, the feature vectors are now suitable for LDPC syndrome coding. The…

Construction of high-girth QC-LDPC codes

Yige Wang, Jonathan S. Yedidia, Stark C. Draper

Computer Networks and Communications · September 2008 · cited 78× · DOI ↗ · more like this ·

We describe a hill-climbing algorithm that constructs high-girth quasi-cyclic low-density parity check (QC-LDPC) codes. Given a desired girth, the algorithm can find QC-LDPC codes of shorter block-length in much less time compared with the previously proposed ldquoguess-and-testrdquo algorithm. An analysis is also provided to explain when guess-and-test would be expected to perform well or badly.

Toward Compression of Encrypted Images and Video Sequences

Daniel Schonberg, Stark C. Draper, Chuohao Yeo +1 more

Computer Vision and Pattern Recognition · IEEE Transactions on Information Forensics and Security · 25 Nov 2008 · cited 70× · DOI ↗ · more like this ·

We present a framework for compressing encrypted media, such as images and videos. Encryption masks the source, rendering traditional compression algorithms ineffective. By conceiving of the problem as one of distributed source coding, it has been shown in prior work that encrypted data are as compressible as unencrypted data. However, there are two major challenges to realize these theoretical results. The first is the development of models that capture the underlying statistical structure and are compatible with our framework. The second is that since the source is masked by encryption, the compressor does not know what rate to target. We tackle these issues in this paper. We first develop statistical models for images before extending it to videos, where our techniques really gain traction. As an illustration, we compare our results to a state-of-the-art motion-compensated lossless…

SleepScale: Runtime Joint Speed Scaling and Sleep States Management for Power Efficient Data Centers

Yanpei Liu, Stark C. Draper, Nam Sung Kim

cs.PF · 21 Apr 2014 · cited 62× · arXiv ↗ · more like this ·

Power consumption in data centers has been growing significantly in recent years. To reduce power, servers are being equipped with increasingly sophisticated power management mechanisms. Different mechanisms offer dramatically different trade-offs between power savings and performance penalties. Considering the complexity, variety, and temporally varying nature of the applications hosted in a typical data center, intelligently determining which power management policy to use and when is a complicated task. In this paper we analyze a system model featuring both performance scaling and low-power states. We reveal the interplay between performance scaling and low-power states via intensive simulation and analytic verification. Based on the observations, we present SleepScale, a runtime power management tool designed to efficiently exploit existing power control mechanisms. At run time…

A Theoretical Analysis of Authentication, Privacy and Reusability Across Secure Biometric Systems

Ye Wang, Shantanu Rane, Stark C. Draper +1 more

cs.IT · 23 Dec 2011 · cited 61× · arXiv ↗ · more like this ·

We present a theoretical framework for the analysis of privacy and security tradeoffs in secure biometric authentication systems. We use this framework to conduct a comparative information-theoretic analysis of two biometric systems that are based on linear error correction codes, namely fuzzy commitment and secure sketches. We derive upper bounds for the probability of false rejection ($P_{FR}$) and false acceptance ($P_{FA}$) for these systems. We use mutual information to quantify the information leaked about a user's biometric identity, in the scenario where one or multiple biometric enrollments of the user are fully or partially compromised. We also quantify the probability of successful attack ($P_{SA}$) based on the compromised information. Our analysis reveals that fuzzy commitment and secure sketch systems have identical $P_{FR}, P_{FA}, P_{SA}$ and information leakage, but…

Hierarchical and High-Girth QC LDPC Codes

Yige Wang, Stark C. Draper, Jonathan S. Yedidia

cs.IT · 3 Nov 2011 · cited 61× · arXiv ↗ · more like this ·

We present a general approach to designing capacity-approaching high-girth low-density parity-check (LDPC) codes that are friendly to hardware implementation. Our methodology starts by defining a new class of "hierarchical" quasi-cyclic (HQC) LDPC codes that generalizes the structure of quasi-cyclic (QC) LDPC codes. Whereas the parity check matrices of QC LDPC codes are composed of circulant sub-matrices, those of HQC LDPC codes are composed of a hierarchy of circulant sub-matrices that are in turn constructed from circulant sub-matrices, and so on, through some number of levels. We show how to map any class of codes defined using a protograph into a family of HQC LDPC codes. Next, we present a girth-maximizing algorithm that optimizes the degrees of freedom within the family of codes to yield a high-girth HQC LDPC code. Finally, we discuss how certain characteristics of a code…

Anytime coding for distributed computation

Nuwan S. Ferdinand, Stark C. Draper

Artificial Intelligence · September 2016 · cited 59× · DOI ↗ · more like this ·

A novel coding scheme is proposed to speed up distributed computation through a form of approximate computing. It is known that task replication can greatly mitigate the “straggler effect” in cloud computing, wherein an overall computation can be significantly delayed by slowed processing nodes (or “stragglers”). It has also been demonstrated that, in certain contexts, ideas of error-correction coding can more efficiently deal with stragglers than pure replication. The approach proposed herein builds on these earlier observations through an “anytime” approach to approximate computing. In this paradigm, over time one can produces approximate solutions of increasing accuracy. To accomplish this we first decompose a computational job in to tasks of various priorities. Next, we apply linear error correction coding to produce subtasks that are assigned to different processors. The…

On Rateless Coding over Fading Channels with Delay Constraints

Jeff Castura, Yongyi Mao, Stark C. Draper

Computer Networks and Communications · July 2006 · cited 57× · DOI ↗ · more like this ·

We explore the use of rateless coding for communication over fading channels with delay constraints. Both quasi-static fading and block-fading channels are considered. When only the receiver has channel information, we show there exist rateless codes that are both reliable and efficient for every channel realization of such channels. We then apply these codes to a wireless streaming application with a sequence of playback deadlines. Rateless strategies demonstrate benefits in terms of throughput and outage probability compared to fixed-rate schemes

Notary: Hardware Techniques to Enhance Signatures

Luke Yen, Stark C. Draper, Mark D. Hill

Computer Networks and Communications · 2008 · cited 54× · OpenAlex ↗ · more like this ·

Hardware signatures have been recently proposed as an efficient mechanism to detect conflicts amongst concurrently running transactions in transactional memory systems (e.g., Bulk, LogTM-SE, and SigTM). Signatures use fixed hardware to represent an unbounded number of addresses, but may lead to false conflicts (detecting a conflict when none exists). Previous work recommends that signatures be implemented with parallel Bloom filters with two or four hash functions (e.g., H3). Two problems exist with current signature designs. First, H3 implementations use many XOR gates. This increases hardware area and power overheads. Second, signature false positives can result from conflicts with signature bits set by private memory addresses that do not require isolation. This paper develops Notary, a coupling of two signature enhancements to ameliorate these problems. First, we use address entropy…

4 The ADMM penalized decoder for LDPC codes∗

Xishuo Liu, Stark C. Draper

Computer Networks and Communications · 2014 · cited 51× · OpenAlex ↗ · more like this ·

Linear programming (LP) decoding for low-density parity-check codes was introduced by Feldman et al. and has been shown to have theoretical guarantees in several regimes. Furthermore, it has been reported in the literature-via simulation and via instanton analysis-that LP decoding displays better error rate performance at high signal-to-noise ratios (SNR) than does belief propagation (BP) decoding. However, at low SNRs, LP decoding is observed to have worse performance than BP. In this paper, we seek to improve LP decoding at low SNRs while maintaining LP decoding's high SNR performance. Our main contribution is a new class of decoders obtained by applying the alternating direction method of multipliers (ADMM) algorithm to a set of non-convex optimization problems. These non-convex problems are constructed by adding a penalty term to the objective of LP decoding. The goal of the penalty…

Anytime MiniBatch: Exploiting Stragglers in Online Distributed Optimization

Nuwan Ferdinand, Haider Al-Lawati, Stark C. Draper +1 more

cs.LG · 10 Jun 2020 · cited 49× · arXiv ↗ · more like this ·

Distributed optimization is vital in solving large-scale machine learning problems. A widely-shared feature of distributed optimization techniques is the requirement that all nodes complete their assigned tasks in each computational epoch before the system can proceed to the next epoch. In such settings, slow nodes, called stragglers, can greatly slow progress. To mitigate the impact of stragglers, we propose an online distributed optimization method called Anytime Minibatch. In this approach, all nodes are given a fixed time to compute the gradients of as many data samples as possible. The result is a variable per-node minibatch size. Workers then get a fixed communication time to average their minibatch gradients via several rounds of consensus, which are then used to update primal variables via dual averaging. Anytime Minibatch prevents stragglers from holding up the system without…

On Compression of Encrypted Images

Daniel Schonberg, Stark C. Draper, Kannan Ramchandran

Computer Vision and Pattern Recognition · October 2006 · cited 49× · DOI ↗ · more like this ·

Coding schemes for secure and efficient communication over noiseless public channels traditionally compress and then encrypt the source data. In some cases reversing the ordering of compression and encryption would be useful, e.g., in enabling the efficient distribution of protected media content. Indeed, not only is it possible to reverse the order, but under some conditions neither security nor compression efficiency need be sacrificed. In earlier work on this problem we have assumed that the source data is either memoryless or has a 1-D Markov structure. Such models are poor matches for the 2-D structure of images. In this work, we use a 2-D source model, and develop a scheme to compress encrypted images based on LDPC codes. We present practical simulation results for compressing bi-level images. In tests, we are able to compress an encrypted 10, 000 bit bi-level image to 4, 299 bits…

SleepScale

Yanpei Liu, Stark C. Draper, Nam Sung Kim

Information Systems · ACM SIGARCH Computer Architecture News · 14 Jun 2014 · cited 47× · DOI ↗ · more like this ·

Power consumption in data centers has been growing significantly in recent years. To reduce power, servers are beingequipped with increasingly sophisticated power management mechanisms. Different mechanisms offer dramatically different trade-offs between power savings and performance penalties. Considering the complexity, variety, and temporallyvarying nature of the applications hosted in a typical data center, intelligently determining which power management policy to use and when is a complicated task. In this paper we analyze a system model featuring both performance scaling and low-power states. We reveal the interplay between performance scaling and low-power states via intensive simulation and analytic verification. Based on the observations, we present SleepScale, a runtime power management tool designed to efficiently exploit existing power control mechanisms. At run time…

ML decoding via mixed-integer adaptive linear programming

Stark C. Draper, Jonathan S. Yedidia, Yige Wang

Computer Networks and Communications · June 2007 · cited 46× · DOI ↗ · more like this ·

Linear programming (LP) decoding was introduced by Feldman et al. (IEEE Trans. Inform. Theory Mar. 2005) as a novel way to decode binary low-density parity-check codes. Taghavi and Siegel (Proc. ISIT 2006) describe a computationally simplified decoding approach they term "adaptive" LP decoding. Adaptive LP decoding starts with a sub-set of the LP constraints, and iteratively adds violated constraints until an optimum of the original LP is found. Usually only a tiny fraction of the original constraints need to be reinstated, leading to huge efficiency gains compared to ordinary LP decoding. Here we describe a modification of the adaptive LP decoder that results in a maximum likelihood (ML) decoder. Whenever the adaptive LP decoder returns a pseudo-codeword rather than a codeword, we add an integer constraint on the least certain symbol of the pseudo-codeword. For certain codes, and…

Efficient variable length channel coding for unknown DMCs

Stark C. Draper, Brendan J. Frey, Frank R. Kschischang

Computer Networks and Communications · 23 Dec 2004 · cited 41× · DOI ↗ · more like this ·

We present a strategy for the reliable communication of a message, in a variable number of channel uses, over an unknown discrete memoryless channel (DMC). The decoder periodically tests the received sequence and, when it can decode, sends an acknowledgment to the transmitter, which then stops transmitting. By choosing the size of the codebook large enough, the rate that is reliably realized by the strategy can be made to approach arbitrarily closely the mutual information between channel input and output induced by the user-chosen input distribution. The strategy presented can be considered as a generalization to arbitrary unknown DMCs of earlier variable length coding schemes, such as digital fountain codes for binary erasure channels (BECs), and a coding strategy for binary symmetric channels (BSCs) presented by Tchamkerten and Telatar

Cooperative Transmission for Wireless Networks Using Mutual-Information Accumulation

Stark C. Draper, Lingjia Liu, Andreas F. Molisch +1 more

Computer Networks and Communications · IEEE Transactions on Information Theory · August 2011 · cited 39× · DOI ↗ · more like this ·

Cooperation between the nodes of wireless multihop networks can increase communication reliability, reduce energy consumption, and decrease latency. The possible improvements are even greater when nodes perform mutual information accumulation. In this paper, we investigate resource allocation for unicast and multicast transmission in such networks. Given a network, a source, and a destination, our objective is to minimize end-to-end transmission delay under energy and bandwidth constraints. We provide an algorithm that determines which nodes should participate in forwarding the message and what resources (time, energy, bandwidth) should be allocated to each. Our approach factors into two sub-problems, each of which can be solved efficiently. For any transmission order we show that solving for the optimum resource allocation can be formulated as a linear programming problem. We then show…

Hierarchical Coded Matrix Multiplication

Shahrzad Kiani, Nuwan Ferdinand, Stark C. Draper

cs.IT · 20 Jul 2019 · cited 37× · arXiv ↗ · more like this ·

Slow working nodes, known as stragglers, can greatly reduce the speed of distributed computation. Coded matrix multiplication is a recently introduced technique that enables straggler-resistant distributed multiplication of large matrices. A key property is that the finishing time depends only on the work completed by a set of the fastest workers, while the work done by the slowest workers is ignored completely. This paper is motivated by the observation that in real-world commercial cloud computing systems such as Amazon's Elastic Compute Cloud (EC2) the distinction between fast and slow nodes is often a soft one. Thus, if we could also exploit the work completed by stragglers we may realize substantial performance gains. To realize such gains, in this paper we use the idea of hierarchical coding (Ferdinand and Draper, IEEE Int. Symp. Inf. Theory, 2018). We decompose the overall matrix…

Learning the Interference Graph of a Wireless Network

Jing Yang, Stark Draper, Robert Nowak

cs.IT · August 2012 · cited 36× · arXiv ↗ · more like this ·

A key challenge in wireless networking is the management of interference between transmissions. Identifying which transmitters interfere with each other is a crucial first step. In this paper we cast the task of estimating the a wireless interference environment as a graph learning problem. Nodes represent transmitters and edges represent the presence of interference between pairs of transmitters. We passively observe network traffic transmission patterns and collect information on transmission successes and failures. We establish bounds on the number of observations (each a snapshot of a network traffic pattern) required to identify the interference graph reliably with high probability. Our main results are scaling laws that tell us how the number of observations must grow in terms of the total number of nodes $n$ in the network and the maximum number of interfering transmitters $d$…

Irregular Polar Coding for Complexity-Constrained Lightwave Systems

Toshiaki Koike–Akino, Congzhe Cao, Ye Wang +8 more

Computer Networks and Communications · Journal of Lightwave Technology · 5 Feb 2018 · cited 30× · DOI ↗ · more like this ·

Next-generation fiber-optic communications call for ultra-reliable forward error correction codes that are capable of low-power and low-latency decoding. In this paper, we propose a new class of polar codes, whose polarization units are irregularly pruned to reduce computational complexity and decoding latency without sacrificing error correction performance. We then experimentally demonstrate that the proposed irregular polar codes can outperform state-of-the-art low-density parity-check (LDPC) codes, while decoding complexity and latency can be reduced by at least 30% and 70%, respectively, versus regular polar codes, while also obtaining a marginal performance improvement.

Anytime Exploitation of Stragglers in Synchronous Stochastic Gradient Descent

Nuwan S. Ferdinand, Benjamin Gharachorloo, Stark C. Draper

Artificial Intelligence · December 2017 · cited 30× · DOI ↗ · more like this ·

In this paper we propose an approach to parallelizing synchronous stochastic gradient descent (SGD) that we term “Anytime-Gradients”. The Anytime-Gradients is designed to exploit the work completed by slow compute nodes or “stragglers”. In many approaches work completed by these nodes, while only partial, is discarded completely. To maintain synchronization in our approach, each computational epoch is of fixed duration, and at the end of each epoch, workers send updated parameter vectors to a master mode for combination. The master weights each update by the amount of work done. The Anytime-Gradients scheme is robust to both persistent and non-persistent stragglers and requires no prior knowledge about processor abilities. We show that the scheme effectively exploits stragglers and outperforms existing methods.

Divide and Concur and Difference-Map BP Decoders for LDPC Codes

Jonathan S. Yedidia, Yige Wang, Stark C. Draper

Computer Networks and Communications · IEEE Transactions on Information Theory · 21 Jan 2011 · cited 29× · DOI ↗ · more like this ·

The “Divide and Concur” (DC) algorithm introduced by Gravel and Elser can be considered a competitor to the belief propagation (BP) algorithm, in that both algorithms can be applied to a wide variety of constraint satisfaction, optimization, and inference problems. We show that DC can be interpreted as a message-passing algorithm on a “normal” factor graph. The “difference-map” dynamics of the DC algorithm enables it to avoid “traps” which may be related to the “trapping sets” or “pseudo-codewords” that plague BP decoders of low-density parity check (LDPC) codes in the error-floor regime. We investigate two decoders for LDPC codes based on these ideas. The first decoder is based directly on DC, while the second decoder borrows the important “difference-map” concept from the DC algorithm and translates it into a BP-like decoder. We show that this “difference-map belief propagation”…

Unequal Message Protection: Asymptotic and Non-Asymptotic Tradeoffs

Yanina Y. Shkel, Vincent Y. F. Tan, Stark C. Draper

cs.IT · 5 May 2014 · cited 28× · arXiv ↗ · more like this ·

We study a form of unequal error protection that we term "unequal message protection" (UMP). The message set of a UMP code is a union of $m$ disjoint message classes. Each class has its own error protection requirement, with some classes needing better error protection than others. We analyze the tradeoff between rates of message classes and the levels of error protection of these codes. We demonstrate that there is a clear performance loss compared to homogeneous (classical) codes with equivalent parameters. This is in sharp contrast to previous literature that considers UMP codes. To obtain our results we generalize finite block length achievability and converse bounds due to Polyanskiy-Poor-Verdú. We evaluate our bounds for the binary symmetric and binary erasure channels, and analyze the asymptotic characteristic of the bounds in the fixed error and moderate deviations regimes. In…