arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Neil Spring

85 papers · 1992–2026

1992: 11993: 01994: 01995: 01996: 01997: 21998: 11999: 12000: 12001: 12002: 32003: 62004: 32005: 22006: 92007: 32008: 162009: 102010: 22011: 32012: 02013: 02014: 22015: 42016: 32017: 22018: 42019: 22020: 02021: 02022: 12023: 02024: 22025: 02026: 1
1992peak 16 in 20082026

Frequent co-authors

Papers

showing 1–25 of 85 RSS

Measuring ISP Topologies With Rocketfuel

Neil Spring, Ratul Mahajan, David Wetherall +1 more

Computer Networks and Communications · IEEE/ACM Transactions on Networking · · cited 1,278× · DOI ↗ · more like this ·

To date, realistic ISP topologies have not been accessible to the research community, leaving work that depends on topology on an uncertain footing. In this paper, we present new Internet mapping techniques that have enabled us to measure router-level ISP topologies. Our techniques reduce the number of required traces compared to a brute-force, all-to-all approach by three orders of magnitude without a significant loss in accuracy. They include the use of BGP routing tables to focus the measurements, the elimination of redundant measurements by exploiting properties of IP routing, better alias resolution, and the use of DNS to divide each map into POPs and backbone. We collect maps from ten diverse ISPs using our techniques, and find that our maps are substantially more complete than those of earlier Internet mapping efforts. We also report on properties of these maps, including the…

Persona

Randy Baden, Adam Bender, Neil Spring +2 more

Sociology and Political Science · · cited 497× · DOI ↗ · more like this ·

Online social networks (OSNs) are immensely popular, with some claiming over 200 million users. Users share private content, such as personal information or photographs, using OSN applications. Users must trust the OSN service to protect personal information even as the OSN provider benefits from examining and sharing that information. We present Persona, an OSN where users dictate who may access their information. Persona hides user data with attribute-based encryption (ABE), allowing users to apply fine-grained policies over who may view their data. Persona provides an effective means of creating applications in which users, not the OSN, define policy over access to private data. We demonstrate new cryptographic mechanisms that enhance the general applicability of ABE. We show how Persona provides the functionality of existing online social networks with additional privacy benefits.…

A protocol-independent technique for eliminating redundant network traffic

Neil Spring, David Wetherall

Computer Networks and Communications · ACM SIGCOMM Computer Communication Review · · cited 306× · DOI ↗ · more like this ·

We present a technique for identifying repetitive information transfers and use it to analyze the redundancy of network traffic. Our insight is that dynamic content, streaming media and other traffic that is not caught by today's Web caches is nonetheless likely to derive from similar information. We have therefore adapted similarity detection techniques to the problem of designing a system to eliminate redundant transfers. We identify repeated byte ranges between packets to avoid retransmitting the redundant data. We find a high level of redundancy and are able to detect repetition that Web proxy caches are not. In our traces, after Web proxy caching has been applied, an additional 39% of the original volume of Web traffic is found to be redundant. Moreover, because our technique makes no assumptions about HTTP protocol syntax or caching semantics, it provides immediate benefits for…

Inferring link weights using end-to-end measurements

Ratul Mahajan, Neil Spring, David Wetherall +1 more

Computer Networks and Communications · · cited 230× · DOI ↗ · more like this ·

We describe a novel constraint-based approach to approximate ISP link weights using only end-to-end measurements. Common routing protocols such as OSPF and IS-IS choose least-cost paths using link weights, so inferred weights provide a simple, concise, and useful model of intradomain routing. Our approach extends router-level ISP maps, which include only connectivity, with link weights that are consistent with routing. Our inferred weights agree well with observed routing: while our inferred weights fully characterize the set of shortest paths between 84--99% of the router-pairs, alternative models based on hop count and latency do so for only 47--81% of the pairs.

Bittorrent is an auction

Dave Levin, Katrina LaCurts, Neil Spring +1 more

Computer Networks and Communications · ACM SIGCOMM Computer Communication Review · · cited 174× · DOI ↗ · more like this ·

Incentives play a crucial role in BitTorrent, motivating users to upload to others to achieve fast download times for all peers. Though long believed to be robust to strategic manipulation, recent work has empirically shown that BitTorrent does not provide its users incentive to follow the protocol. We propose an auction-based model to study and improve upon BitTorrent's incentives. The insight behind our model is that BitTorrent uses, not tit-for-tat as widely believed, but an auction to decide which peers to serve. Our model not only captures known, performance-improving strategies, it shapes our thinking toward new, effective strategies. For example, our analysis demonstrates, counter-intuitively, that BitTorrent peers have incentive to intelligently under-report what pieces of the file they have to their neighbors. We implement and evaluate a modification to BitTorrent in which…

Scriptroute: a public internet measurement facility

Neil Spring, David Wetherall, Tom Anderson

Artificial Intelligence · USENIX Symposium on Internet Technologies and Systems · · cited 170× · OpenAlex ↗ · more like this ·

We present Scriptroute, a system that allows ordinary Internet users to conduct network measurements from remote vantage points. We seek to combine the flex-ibility found in dedicated measurement testbeds such as NIMI with the general accessibility and popularityof Web-based public traceroute servers. To use Scriptroute, clients use DNS to discover measurement serversand then submit a measurement script for execution in a sandboxed, resource-limited environment. The serversensure that the script does not expose the network to attack by applying source- and destination-specific filtersand security checks, and by rate-limiting traffic. Scriptroute code is publicly available and has been de-ployed on the PlanetLab testbed of 42 sites. As proof-of-concept, we have used it both to create RPT, a toolfor measuring routing trees toward a destination, and to repeat the experiment used to…

Using PlanetLab for network research

Neil Spring, Larry Peterson, Andy Bavier +1 more

Computer Networks and Communications · ACM SIGOPS Operating Systems Review · · cited 163× · DOI ↗ · more like this ·

PlanetLab is a continuously-evolving global network research testbed that is simultaneously used by hundreds of researchers for diverse tasks, ranging from short-term self-contained experiments among PlanetLab nodes to continuously-running Web-accessible services with tens of thousands of non-PlanetLab users. While PlanetLab cannot provide a perfectly-customized environment for every experiment, it has been changing over time, and the base of knowledge of how to best utilize it has also been growing. As a result, many of the early observations researchers made about PlanetLab would change if rechecked today. In this paper, we discuss these issues and explain whether they remain, have been addressed via PlanetLab's evolution, or can be avoided by the use of best practices. Where possible, we provide quantitative evidence showing the realities of PlanetLab and possible research avenues to…

The causes of path inflation

Neil Spring, Ratul Mahajan, Thomas E. Anderson

Computer Networks and Communications · · cited 158× · DOI ↗ · more like this ·

Researchers have shown that the Internet exhibits path inflation -- end-to-end paths can be significantly longer than necessary. We present a trace-driven study of 65 ISPs that characterizes the root causes of path inflation, namely topology and routing policy choices within an ISP, between pairs of ISPs, and across the global Internet. To do so, we develop and validate novel techniques to infer intra-domain and peering policies from end-to-end measurements. We provide the first measured characterization of ISP peering policies. In addition to "early-exit," we observe a significant degree of helpful non-early-exit, load-balancing, and other policies in use between peers. We find that traffic engineering (the explicit addition of policy constraints on top of topology constraints) is widespread in both intra- and inter-domain routing. However, intra-domain traffic engineering has minimal…

User-level internet path diagnosis

Ratul Mahajan, Neil Spring, David Wetherall +1 more

Computer Networks and Communications · ACM SIGOPS Operating Systems Review · · cited 152× · DOI ↗ · more like this ·

Diagnosing faults in the Internet is arduous and time-consuming, in part because the network is composed of diverse components spread across many administrative domains. We consider an extreme form of this problem: can end users, with no special privileges, identify and pinpoint faults inside the network that degrade the performance of their applications? To answer this question, we present both an architecture for user-level Internet path diagnosis and a practical tool to diagnose paths in the current Internet. Our architecture requires only a small amount of network support, yet it is nearly as complete as analyzing a packet trace collected at all routers along the path. Our tool, tulip, diagnoses reordering, loss and significant queuing events by leveraging well deployed but little exploited router features that approximate our architecture. Tulip can locate points of reordering and…

Temporal Summaries: Supporting Temporal Categorical Searching, Aggregation and Comparison

T.D. Wang, Catherine Plaisant, Ben Shneiderman +5 more

Computer Vision and Pattern Recognition · IEEE Transactions on Visualization and Computer Graphics · · cited 139× · DOI ↗ · more like this ·

When analyzing thousands of event histories, analysts often want to see the events as an aggregate to detect insights and generate new hypotheses about the data. An analysis tool must emphasize both the prevalence and the temporal ordering of these events. Additionally, the analysis tool must also support flexible comparisons to allow analysts to gather visual evidence. In a previous work, we introduced align, rank, and filter (ARF) to accentuate temporal ordering. In this paper, we present temporal summaries, an interactive visualization technique that highlights the prevalence of event occurrences. Temporal summaries dynamically aggregate events in multiple granularities (year, month, week, day, hour, etc.) for the purpose of spotting trends over time and comparing several groups of records. They provide affordances for analysts to perform temporal range filters. We demonstrate the…

Quantifying the Causes of Path Inflation

Neil Spring, Ratul Mahajan, Thomas E. Anderson

Computer Networks and Communications · ACM Special Interest Group on Data Communication · · cited 138× · OpenAlex ↗ · more like this ·

Researchers have shown that the Internet exhibits path inflation -- end-to-end paths can be significantly longer than necessary. We present a trace-driven study of 65 ISPs that characterizes the root causes of path inflation, namely topology and routing policy choices within an ISP, between pairs of ISPs, and across the global Internet. To do so, we develop and validate novel techniques to infer intra-domain and peering policies from end-to-end measurements. We provide the first measured characterization of ISP peering policies. In addition to "early-exit," we observe a significant degree of helpful non-early-exit, load-balancing, and other policies in use between peers. We find that traffic engineering (the explicit addition of policy constraints on top of topology constraints) is widespread in both intra- and inter-domain routing. However, intra-domain traffic…

Implementing a performance forecasting system for metacomputing

Rich Wolski, Neil Spring, Chris L. Peterson

Computer Networks and Communications · · cited 130× · DOI ↗ · more like this ·

In this paper we describe the design and implementation of a system called the Network Weather Service (NWS) that takes periodic measurements of deliverable resource performance from distributed networked resources, and uses numerical models to dynamically generate forecasts of future performance levels. These performance forecasts, along with measures of performance fluctuation (e.g the mean square prediction error) and forecast lifetime that the NWS generates, are made available to schedulers and other resource management mechanisms at runtime so that they may determine the quality-of-service that will be available from each resource. We describe the architecture of the NWS and implementations that we have developed and are currently deploying for the Legion [13] and Globus/Nexus [7] metacomputing infrastructures. We also detail NWS forecasts of resource performance using both the…

Discarte

Rob Sherwood, Adam Bender, Neil Spring

Artificial Intelligence · ACM SIGCOMM Computer Communication Review · · cited 109× · DOI ↗ · more like this ·

Internet topology discovery consists of inferring the inter-router connectivity ("links") and the mapping from IP addresses to routers ("alias resolution"). Current topology discovery techniques use TTL-limited "traceroute" probes to discover links and use direct router probing to resolve aliases. The often-ignored record route (RR) IP option provides a source of disparate topology data that could augment existing techniques, but it is difficult to properly align with traceroute-based topologies because router RR implementations are under-standardized. Correctly aligned RR and traceroute topologies have fewer false links, include anonymous and hidden routers, and discover aliases for routers that do not respond to direct probing. More accurate and feature-rich topologies benefit overlay construction and network diagnostics, modeling, and measurement. We present DisCarte, a system for…

Predicting the CPU availability of time-shared Unix systems on the computational grid

Rich Wolski, Neil Spring, J.E. Hayes

Computer Networks and Communications · · cited 109× · DOI ↗ · more like this ·

Focuses on the problem of making short- and medium-term forecasts of CPU availability on time-shared Unix systems. We evaluate the accuracy with which availability can be measured using the Unix load average, the Unix utility "vmstat" and the Network Weather Service (NWS) CPU sensor that uses both. We also examine the autocorrelation between successive CPU measurements to determine their degree of self-similarity. While our observations show a long-range autocorrelation dependence, we demonstrate how this dependence manifests itself in the short- and medium-term predictability of the CPU resources in our study.

A structural approach to latency prediction

Harsha V. Madhyastha, Thomas E. Anderson, Arvind Krishnamurthy +2 more

Computer Networks and Communications · · cited 93× · DOI ↗ · more like this ·

Several models have been recently proposed for predicting the latency of end to end Internet paths. These models treat the Internet as a black-box, ignoring its internal structure. While these models are simple, they can often fail systematically; for example, the most widely used models use metric embeddings that predict no benefit to detour routes even though half of all Internet routes can benefit from detours.In this paper, we adopt a structural approach that predicts path latency based on measurements of the Internet's routing topology, PoP connectivity, and routing policy. We find that our approach outperforms Vivaldi, the most widely used black-box model. Furthermore, unlike metric embeddings, our approach successfully predicts 65% of detour routes in the Internet. The number of measurements used in our approach is comparable with that required by black box techniques, but using…

Maranello: practical partial packet recovery for 802.11

Bo Han, Aaron Schulman, Francesco Gringoli +6 more

Computer Networks and Communications · Institutional Research Information System (Università degli Studi di Brescia) · · cited 91× · DOI ↗ · more like this ·

Partial packet recovery protocols attempt to repair corrupted packets instead of retransmitting them in their entirety. Recent approaches have used physical layer confidence estimates or additional error detection codes embedded in each transmission to identify corrupt bits, or have applied forward error correction to repair without such explicit knowledge. In contrast to these approaches, our goal is a practical design that simultaneously: (a) requires no extra bits in correct packets, (b) reduces recovery latency, except in rare instances, (c) remains compatible with existing 802.11 devices by obeying timing and backoff standards, and (d) can be incrementally deployed on widely available access points and wireless cards. In this paper, we design, implement, and evaluate Maranello, a novel partial packet recovery mechanism for 802.11. In Maranello, the receiver computes checksums over…

Pingin' in the rain

Aaron Schulman, Neil Spring

Computer Networks and Communications · · cited 82× · DOI ↗ · more like this ·

Residential Internet connections are susceptible to weather-caused outages: Lightning and wind cause local power failures, direct lightning strikes destroy equipment, and water in the atmosphere degrades satellite links. Outages caused by severe events such as fires and undersea cable cuts are often reported upon by operators and studied by researchers. In contrast, outages cause by ordinary weather are typically limited in scope, and because of their small scale, there has not been comparable effort to understand how weather affects everyday last-mile Internet connectivity. We design and deploy a measurement tool called ThunderPing that measures the connectivity of residential Inter- net hosts before, during, and after forecast periods of severe weather. ThunderPing uses weather alerts from the US National Weather Service to choose a set of residential host addresses to ping from…

EventAction: Visual analytics for temporal event sequence recommendation

Fan Du, Catherine Plaisant, Neil Spring +1 more

Computer Vision and Pattern Recognition · · cited 75× · DOI ↗ · more like this ·

Recommender systems are being widely used to assist people in making decisions, for example, recommending films to watch or books to buy. Despite its ubiquity, the problem of presenting the recommendations of temporal event sequences has not been studied. We propose EventAction, which to our knowledge, is the first attempt at a prescriptive analytics interface designed to present and explain recommendations of temporal event sequences. EventAction provides a visual analytics approach to (1) identify similar records, (2) explore potential outcomes, (3) review recommended temporal event sequences that might help achieve the users' goals, and (4) interactively assist users as they define a personalized action plan associated with a probability of success. Following the design study framework, we designed and deployed EventAction in the context of student advising and reported on the…

Receiver based management of low bandwidth access links

Neil Spring, M. Chesire, Matthew J. Berryman +3 more

Computer Networks and Communications · · cited 75× · DOI ↗ · more like this ·

In this paper, we describe a receiver-based congestion control policy that leverages TCP flow control mechanisms to prioritize mixed traffic loads across access links. We manage queueing at the access link to: (1) improve the response time of interactive network applications; (2) reduce congestion-related packet losses; while (3) maintaining high throughput for bulk-transfer applications. Our policy controls queue length by manipulating receive socket buffer sizes. We have implemented this solution in a dynamically loadable Linux kernel module, and tested it over low-bandwidth links. Our approach yields a 7-fold improvement in packet latency over an unmodified system while maintaining 94% link utilization. In the common case, congestion-related packet losses at the access link can be eliminated. Finally, by prioritizing short flows, we show that our system reduces the time to download a…

Fixing ally's growing pains with velocity modeling

Adam Bender, Rob Sherwood, Neil Spring

Computer Networks and Communications · · cited 71× · DOI ↗ · more like this ·

Mapping the router topology is an important component of Internet measurement. Alias resolution, the process of mapping IP addresses to routers, is critical to accurate Internet mapping. Ally, a popular alias resolution tool, was developed to resolve aliases in individual ISPs, but its probabilistic accuracy and need to send O(n2) probes to infer aliases among n IP addresses make it unappealing for large-scale Internet mapping. In this paper, we present RadarGun, a tool that uses IP identifier velocity modeling to improve the accuracy and scalability of the Ally-based resolution technique. We provide analytical bounds on Ally's accuracy and validate our predicted aliases against Ally. Additionally, we show that velocity modeling requires only O(n) probes and thus scales to Internet-sized mapping efforts.

Touring the internet in a TCP sidecar

Rob Sherwood, Neil Spring

Computer Networks and Communications · · cited 69× · DOI ↗ · more like this ·

An accurate router-level topology of the Internet would benefit many research areas, including network diagnosis, inter-domain traffic engineering, and overlay construction. We present TCP Sidecar and Passenger, two elements of a system for router-level Internet topology discovery. Sidecar transparently injects measurement probes into non-measurement TCP streams, while Passenger combines TTL-limited probes with the often-ignored IP record route option. The combined approach mitigates problems associated with traceroute-based topology discovery, including abuse reports, spurious edge inference from multi-path routing, unresolved IP aliases, long network timeouts, and link discovery behind NATs and firewalls. We believe that we are the first mapping project to measure MPLS use with ICMP extensions and record route behavior when the TTL is not decremented. We are able to discover NATs when…

Application level scheduling of gene sequence comparison on metacomputers

Neil Spring, Rich Wolski

Computer Networks and Communications · · cited 56× · DOI ↗ · more like this ·

This paper investigates the efficacy of ApplicationLevel Scheduling (AppLeS) [3] for a parallel gene sequence library comparison application in production metacomputing settings. We compare an AppLeSenhanced version of the application to an original implementation designed and tuned to use the native scheduling mechanisms of Mentat [6] -- a metacomputing software infrastructure. The experimental data shows that the AppLeS versions outperform the best Mentat versions over a range of problem sizes and computational settings. The structure of the AppLeS we have defined for this application does not depend on the scheduling algorithms that it uses. Instead, the AppLeS scheduler considers the uncertainty associated with the information it uses in its scheduling decisions to choose between the static placement of computation, and the dynamic assignment of computation during execution. We…

Internet anycast

Zhihao Li, Dave Levin, Neil Spring +1 more

Computer Networks and Communications · · cited 54× · DOI ↗ · more like this ·

Internet anycast depends on inter-domain routing to direct clients to their "closest" sites. Using data collected from a root DNS server for over a year (400M+ queries/day from 100+ sites), we characterize the load balancing and latency performance of global anycast. Our analysis shows that site loads are often unbalanced, and that most queries travel longer than necessary, many by over 5000 km.

Reasons Dynamic Addresses Change

Ramakrishna Padmanabhan, Amogh Dhamdhere, Emile Aben +2 more

Computer Networks and Communications · · cited 48× · DOI ↗ · more like this ·

Applications often use IP addresses as end host identifiers based on the assumption that IP addresses do not change frequently, even when dynamically assigned. The validity of this assumption depends upon the duration of time that an IP address continues to be assigned to the same end host, and this duration in turn, depends upon the various causes that can induce the currently assigned IP address to change. In this work, we identify different causes that can lead to an address change and analyze their effect in ISPs around the world using data gathered from 3,038 RIPE Atlas probes hosted across 929 ASes and 156 countries across all 12 months of 2015. Our observations reveal information about ISP practices, outages, and dynamic address prefixes. For example, we found 20 ISPs around the world that periodically reassign addresses after a fixed period, typically a multiple of 24 hours. We…