arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Sadiq Jaffer

14 papers · 2020–2026

2020: 22021: 12022: 02023: 12024: 12025: 62026: 3
2020peak 6 in 20252026

Frequent co-authors

Papers

showing 1–14 of 14 RSS

Retrofitting Effect Handlers onto OCaml

KC Sivaramakrishnan, Stephen Dolan, Leo White +3 more

cs.PL · · cited 82× · arXiv ↗ · more like this ·

Effect handlers have been gathering momentum as a mechanism for modular programming with user-defined effects. Effect handlers allow for non-local control flow mechanisms such as generators, async/await, lightweight threads and coroutines to be composably expressed. We present a design and evaluate a full-fledged efficient implementation of effect handlers for OCaml, an industrial-strength multi-paradigm programming language. Our implementation strives to maintain the backwards compatibility and performance profile of existing OCaml code. Retrofitting effect handlers onto OCaml is challenging since OCaml does not currently have any non-local control flow mechanisms other than exceptions. Our implementation of effect handlers for OCaml: (i) imposes a mean 1% overhead on a comprehensive macro benchmark suite that does not use effect handlers; (ii) remains compatible with program analysis…

TESSERA: Temporal Embeddings of Surface Spectra for Earth Representation and Analysis

Zhengpeng Feng, Clement Atzberger, Sadiq Jaffer +11 more

cs.LG · · cited 61× · arXiv ↗ · more like this ·

Satellite Earth-observation (EO) time series in the optical and microwave ranges of the electromagnetic spectrum are often irregular due to orbital patterns and cloud obstruction. Compositing addresses these issues but loses information with respect to vegetation phenology, which is critical for many downstream tasks. Instead, we present TESSERA, a pixel-wise foundation model for multi-modal (Sentinel-1/2) EO time series that learns robust, label-efficient embeddings. During model training, TESSERA uses Barlow Twins and sparse random temporal sampling to enforce invariance to the selection of valid observations. We employ two key regularizers: global shuffling to decorrelate spatial neighborhoods and mix-based regulation to improve invariance under extreme sparsity. We find that for diverse classification, segmentation, and regression tasks, TESSERA embeddings deliver state-of-the-art…

Retrofitting Parallelism onto OCaml

KC Sivaramakrishnan, Stephen Dolan, Leo White +6 more

cs.PL · · cited 42× · arXiv ↗ · more like this ·

OCaml is an industrial-strength, multi-paradigm programming language, widely used in industry and academia. OCaml is also one of the few modern managed system programming languages to lack support for shared memory parallel programming. This paper describes the design, a full-fledged implementation and evaluation of a mostly-concurrent garbage collector (GC) for the multicore extension of the OCaml programming language. Given that we propose to add parallelism to a widely used programming language with millions of lines of existing code, we face the challenge of maintaining backwards compatibility--not just in terms of the language features but also the performance of single-threaded code running with the new GC. To this end, the paper presents a series of novel techniques and demonstrates that the new GC strikes a balance between performance and feature backwards compatibility for…

AI-assisted Living Evidence Databases for Conservation Science

Sadiq Jaffer, William H. Morgan, S.A. Reynolds +3 more

Computer Vision and Pattern Recognition · · cited 22× · DOI ↗ · more like this ·

Living evidence databases offer a robust and dynamic alternative to static systematic reviews but require a resilient technical infrastructure for continuous evidence processing. This working paper describes the architecture and implementation of a complete, end-to-end pipeline for this purpose, developed initially for the conservation science domain. Designed to operate on local infrastructure using self-hosted models, the system ingests and normalizes documents from academic publishers, screens them for relevance using a multi-stage process, and extracts structured data according to a predefined schema. Key features include a hybrid retrieval model; a human-AI collaborative process for refining inclusion criteria from complex protocols, and the integration of an established, statistically-principled stopping rule to ensure efficiency. In a baseline evaluation against a prior…

Careful design of Large Language Model pipelines enables expert-level retrieval of evidence-based information from syntheses and databases

Radhika Iyer, Alec Philip Christie, Anil Madhavapeddy +3 more

General Social Sciences · PLoS ONE · · cited 11× · DOI ↗ · more like this ·

Wise use of evidence to support efficient conservation action is key to tackling biodiversity loss with limited time and resources. Evidence syntheses provide key recommendations for conservation decision-makers by assessing and summarising evidence, but are not always easy to access, digest, and use. Recent advances in Large Language Models (LLMs) present both opportunities and risks in enabling faster and more intuitive systems to access evidence syntheses and databases. Such systems for natural language search and open-ended evidence-based responses are pipelines comprising many components. Most critical of these components are the LLM used and how evidence is retrieved from the database. We evaluate the performance of ten LLMs across six different database retrieval strategies against human experts in answering synthetic multiple-choice question exams on the effects of conservation…

Random Forest vs. SVM vs. KNN in classifying Smartphone and Smartwatch sensor data using CRISP-DM

Sadiq Jaffer Saleh, Sayed Qasim Ali, Ahmed M. Zeki

Computer Vision and Pattern Recognition · 2020 International Conference on Data Analytics for Business and Industry: Way Towards a Sustainable Economy (ICDABI) · · cited 7× · DOI ↗ · more like this ·

Nowadays IoT sensors become one of the major sources of data, starting from home automation going to daily devices. Focusing on handsets that have the most significant contribution factor on data blooming and booming. The problem at hand is data mining methods comparison, for selecting the best method that serves sensor data. Methodology used was CRISP-DM. This paper found Random Forest data mining method to work best under the described circumstances.

Emission Impossible: privacy-preserving carbon emissions claims

Jessica Man, Sadiq Jaffer, Patrick Ferris +2 more

cs.CR · · cited 2× · arXiv ↗ · more like this ·

Information and Communication Technologies (ICT) have a significant climate impact, and data centres account for a large proportion of the carbon emissions from ICT. To achieve sustainability goals, it is important that all parties involved in ICT supply chains can track and share accurate carbon emissions data with their customers, investors, and the authorities. However, businesses have strong incentives to make their numbers look good, whilst less so to publish their accounting methods along with all the input data, due to the risk of revealing sensitive information. It would be uneconomical to use a trusted third party to verify the data for every report for each party in the chain. As a result, carbon emissions reporting in supply chains currently relies on unverified data. This paper proposes a methodology that applies cryptography and zero-knowledge proofs for carbon emissions…

Forecasting Earth Surface Change in Embedding Space

Jingtao Li, Sadiq Jaffer, Anil Madhavapeddy +7 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Repeated satellite imagery permits understanding of how our planet changes over time, letting us predict its future and plan mitigating actions. Most existing studies that rely on a time series of satellite observations forecast the spectral values at each pixel for a future target date. However, clouds, shadows, and sensor noise often corrupt these observations, so that spectral forecasters waste much of their capacity on low-level features or noise rather than real change. With the advent of Earth foundation models, we argue that forecasting in embedding space is a feasible and more effective alternative. To this end, we design a token space that handles irregular histories from different sensors and foundation models and supports forecasts at any query date. Tokens from this space are inputs to our proposed forecaster, E$^2$Forecast, which is a transformer with two branches: a…

Earth observation embeddings are effective sub-grid descriptors for probabilistic weather downscaling

Pedro Sousa, Will Tebbutt, Sadiq Jaffer +3 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Global weather reanalyses and forecasts resolve the evolving atmospheric state on coarse grids, but site-specific applications require predictions at arbitrary locations where near-surface conditions also depend on unresolved terrain and land-surface properties. Existing probabilistic downscalers address this gap using hand-crafted topographic descriptors. We ask instead whether Earth observation foundation models can provide transferable sub-grid surface representations for probabilistic weather downscaling. We augment a convolutional conditional neural process that downscales coarse ERA5 reanalysis fields at ~25 km resolution with a learned local surface descriptor, obtained by compressing a patch of TESSERA embeddings at 10 m resolution. Although these embeddings summarise surface conditions over annual timescales, they improve downscaling of instantaneous 2 m temperature and 10 m…

Solving Package Management via Hypergraph Dependency Resolution

Ryan Gibb, Patrick Ferris, David Allsopp +7 more

cs.SE · · cited 0× · arXiv ↗ · more like this ·

Package managers are everywhere, with seemingly every language and operating system implementing their own solution. The lack of interoperability between these systems means that multi-lingual projects are unable to express precise dependencies across language ecosystems, and external system and hardware dependencies are typically implicit and unversioned. We define HyperRes, a formal system for describing versioned dependency resolution using a hypergraph that is expressive enough to model many ecosystems and solve dependency constraints across them. We define translations from dozens of existing package managers to HyperRes and comprehensively demonstrate that dependency resolution can work across ecosystems that are currently distinct. This does not require users to shift their choice of package managers; instead, HyperRes allows for the translation of packaging metadata between…

TESSERA v2: Scaling Pixel-wise Earth Foundation Models

Zhengpeng Feng, Sadiq Jaffer, Ira Shokar +12 more

cs.CV · · arXiv ↗ · more like this ·

Pixel-wise Earth-observation (EO) foundation models are now achieving state-of-the-art performance via generated spatial embeddings. However, how these models scale and how best to spend a pretraining budget remain poorly understood. We present the largest controlled scaling study for EO to date: 395 training runs within a fixed pixel-wise Barlow Twins family, each evaluated on 15 diverse downstream tasks. We find that pretraining loss barely predicts downstream performance (|Pearson r| < 0.2), so selecting models by loss wastes a large share of the compute. We also find that, as the training budget grows, the encoder and the data should grow together while the projector stays fixed, which gives a simple rule for allocating compute. Using this rule, we train a family of pixel-wise teachers (0.5B, 1B, and 2B) and distil the largest into compact students for embeddings-as-data deployment.…

Steps towards an Ecology for the Internet

Anil Madhavapeddy, Sam Reynolds, Alec P. Christie +10 more

cs.NI · · arXiv ↗ · more like this ·

The Internet has grown from a humble set of protocols for end-to-end connectivity into a critical global system with no builtin "immune system". In the next decade the Internet will likely grow to a trillion nodes and need protection from threats ranging from floods of fake generative data to AI-driven malware. Unfortunately, growing centralisation has lead to the breakdown of mutualism across the network, with surveillance capitalism now the dominant business model. We take lessons from from biological systems towards evolving a more resilient Internet that can integrate adaptation mechanisms into its fabric. We also contribute ideas for how the Internet might incorporate digital immune systems, including how software stacks might mutate to encourage more architectural diversity. We strongly advocate for the Internet to "re-decentralise" towards incentivising more mutualistic forms of…

Global, robust and comparable digital carbon assets

Sadiq Jaffer, Michael Dales, Patrick Ferris +5 more

cs.CR · · arXiv ↗ · more like this ·

Carbon credits purchased in the voluntary carbon market allow unavoidable emissions, such as from international flights for essential travel, to be offset by an equivalent climate benefit, such as avoiding emissions from tropical deforestation. However, many concerns regarding the credibility of these offsetting claims have been raised. Moreover, the credit market is manual, therefore inefficient and unscalable, and non-fungible, therefore illiquid. To address these issues, we propose an efficient digital methodology that combines remote sensing data, modern econometric techniques, and on-chain certification and trading to create a new digital carbon asset (the PACT stablecoin) against which carbon offsetting claims can be transparently verified. PACT stablecoins are produced as outputs from a reproducible computational pipeline for estimating the climate benefits of carbon offset…

Planetary computing for data-driven environmental policy-making

Patrick Ferris, Michael Dales, Sadiq Jaffer +8 more

cs.DC · · arXiv ↗ · more like this ·

We make a case for "planetary computing" -- infrastructure to handle the ingestion, transformation, analysis and publication of global data products for furthering environmental science and enabling better informed policy-making. We draw on our experiences as a team of computer scientists working with environmental scientists on forest carbon and biodiversity preservation, and classify existing solutions by their flexibility in scalably processing geospatial data, and also how well they support building trust in the results via traceability and reproducibility. We identify research gaps in the intersection of computing and environmental science around how to handle continuously changing datasets that are often collected across decades and require careful access control rather than being fully open access.