an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org
Author
10 papers · 2010–2025
showing 1–10 of 10 RSS
Linear models with fixed effects and many dummy variables are common in some fields. Such models are straightforward to estimate unless the factors have too many levels. The R package lfe solves this problem by implementing a generalization of the within transformation to multiple factors, tailored for large problems.
When doing two‐way fixed‐effects ordinary least squares estimations, both the variances and covariance of the fixed effects are biased. A formula for a bias correction is known, but in large datasets, it involves inverses of impractically large matrices. We detail how to compute the bias correction in this case. Copyright © 2014 John Wiley & Sons, Ltd.
We present some theoretical results which simplifies the estimation of linear models with multiple high-dimensional fixed effects. In particular, we show how to sweep out multiple fixed effects from the normal equations, in analogy with the common within-groups estimator.
Simen Gaure, Stefanos Koffas, Stjepan Picek +1 more
Large Language Models (LLMs) are susceptible to various attacks but can also improve the security of diverse systems. However, how well do open source LLMs behave as covertext distributions to, e.g., facilitate censorship-resistant communication? In this paper, we explore open-source LLM-based covert channels. We empirically measure the security vs. capacity of two open-source LLM models (Llama-7B and GPT-2) to assess their performance as covert channels. Although our results indicate that such channels are not likely to achieve high practical bitrates, we also show that the chance for an adversary to detect covert communication is low. To ensure our results can be used with the least effort as a general reference, we employ a conceptually simple and concise scheme and only assume public models.
Simen Gaure, Stefanos Koffas, Stjepan Picek +1 more
Large Language Models (LLMs) have gained significant popularity recently. LLMs are susceptible to various attacks but can also improve the security of diverse systems. However, besides enabling more secure systems, how well do open source LLMs behave as covertext distributions to, e.g., facilitate censorship-resistant communication? In this paper, we explore open-source LLM-based covert channels. We empirically measure the security vs. capacity of an open-source LLM model (Llama-7B) to assess its performance as a covert channel. Although our results indicate that such channels are not likely to achieve high practical bitrates, we also show that the chance for an adversary to detect covert communication is low. To ensure our results can be used with the least effort as a general reference, we employ a conceptually simple and concise scheme and only assume public models.
Simen Gaure, Ragnar Frisch, Vignettebuilder Knitr +2 more
Description Transforms away factors with many levels prior to doing an OLS. Useful for estimating linear models with multiple group fixed effects, and for estimating linear models which uses factors with many levels as pure control variables. Includes support for instrumental variables, conditional F statistics for weak instruments, robust and multi-way clustered standard errors, as well as limited mobility bias correction.
Here is a proof for the demeaning method used in lfe, and a de- scription of the methods used for solving the residual equations. As well as a toy-example. This is a preliminary version of (3). This method, formulated as the Gauss-Seidel algorithm, was noted in (4) without the author noticing it in the rst version of this paper.
It is shown that the conditional logit likelihood can be computed in a reasonable time. By this we mean that if T is the number of periods, n is the number of successes, then the likelihood for an individual superficially requires T n n
Simen Gaure, Knut Røed, Gérard J. van den Berg +1 more
Consider a setting where a treatment that starts at some point during a spell (e.g. in unemployment) may impact on the hazard rate of the spell duration, and where the impact may be heterogeneous across subjects. We provide Monte Carlo evidence on the feasibility of estimating the distribution of treatment effects from duration data with selectivity, by means of a nonparametric maximum likelihood estimator with unrestricted numbers of mass points for the heterogeneity distribution. We find that specifying the treatment effect as homogenous may yield misleading average results if the true effects are heterogeneous, even when the sorting into treatment is appropriately accounted for. Specifying the treatment effect as a random coefficient allows for precise estimation of informative average treatment effects including the program's overall impact on the mean duration.
Erik Biørn, Simen Gaure, Simen Markussen +1 more
We examine the remarkable rise in absenteeism among Norwegian employees since the early 1990's, with particular emphasis on disentangling the roles of cohort, age, and time. Based on a fixed effects model, we show that individual age-adjusted absence propensities have risen even more than aggregate absence rates from 1993 to 2005, debunking the popular hypothesis that the rise in absenteeism resulted from the inclusion of new cohorts – with weaker work-norms – into the workforce. We also reject the idea that the rise in absenteeism resulted from more successful integration of workers with poor health; on the contrary, a massive rise in disability rolls during the 1990’s suggest that poor-health workers have left the labor market in unprecedented numbers.