arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Hause Lin

27 papers · 2020–2026

2020: 12021: 22022: 52023: 52024: 62025: 62026: 2
2020peak 6 in 20242026

Frequent co-authors

Papers

showing 1–25 of 27 RSS

High level of correspondence across different news domain quality rating sets

Hause Lin, Jana Lasser, Stephan Lewandowsky +4 more

Sociology and Political Science · UWA Profiles and Research Repository (University of Western Australia) · · cited 62× · DOI ↗ · more like this ·

One widely used approach for quantifying misinformation consumption and sharing is to evaluate the quality of the news domains a user interacts with. However, different media organizations and fact-checkers have produced different sets of news domain quality ratings, raising questions about the reliability of these quality ratings. Here, we compared 6 sets of expert ratings and found that they generally correlated highly with one another. We then created a comprehensive set of domain ratings for use by the research community (github.com/hauselin/domain-quality-ratings), leveraging an ensemble “wisdom of experts” approach. To do so, we performed imputation together with principal component analysis to generate a set of aggregate ratings. The resulting rating set comprises 11,520 domains—the most extensive coverage to date—and correlates well with other rating sets that have more limited…

Thinking more or thinking differently? Using drift-diffusion modeling to illuminate why accuracy prompts decrease misinformation sharing

Hause Lin, Gordon Pennycook, David G. Rand

Sociology and Political Science · PsyArXiv (OSF Preprints) · · cited 42× · DOI ↗ · more like this ·

Recent experiments have found that prompting people to think about accuracy reduces misinformation sharing intentions. The process by which this effect operates, however, remains unclear. Do accuracy prompts cause people to "stop and think," increasing deliberation? Or do they change what people think about, drawing attention to accuracy? Since these two accounts predict the same behavioral outcomes (i.e., increased sharing discernment following a prompt), we used computational modeling of sharing decisions with response time data, as well as out-of-sample ratings of headline perceived accuracy, to test the accounts' divergent predictions across six studies (N = 5633). The results suggest that accuracy prompts do not increase the amount of deliberation people engage in. Instead, they increase the weight participants put on accuracy while deliberating. By showing that prompting people…

How effective are TikTok misinformation debunking videos?

Puneet Bhargava, Katie MacDonald, Christie Newton +2 more

Sociology and Political Science · Harvard Kennedy School Misinformation Review · · cited 25× · DOI ↗ · more like this ·

TikTok provides opportunity for citizen-led debunking where users correct other users’ misinformation. In the present study (N=1,169), participants either watched and rated the credibility of (1) a misinformation video, (2) a correction video, or (3) a misinformation video followed by a correction video (“debunking”). Afterwards, participants rated both a factual and a misinformation video about the same topic and judged the accuracy of the claim furthered by the misinformation video. We found modest evidence for the effectiveness of debunking on people’s ability to subsequently discern between true and false videos, but stronger evidence on subsequent belief in the false claim itself.

The levers of political persuasion with conversational artificial intelligence

Kobi Hackenburg, Ben M Tappin, Luke Hewitt +7 more

Sociology and Political Science · Science · · cited 21× · DOI ↗ · more like this ·

There are widespread fears that conversational artificial intelligence (AI) could soon exert unprecedented influence over human beliefs. In this work, in three large-scale experiments ( N = 76,977 participants), we deployed 19 large language models (LLMs)—including some post-trained explicitly for persuasion—to evaluate their persuasiveness on 707 political issues. We then checked the factual accuracy of 466,769 resulting LLM claims. We show that the persuasive power of current and near-future AI is likely to stem more from post-training and prompting methods—which boosted persuasiveness by as much as 51 and 27%, respectively—than from personalization or increasing model scale, which had smaller effects. We further show that these methods increased persuasion by exploiting LLMs’ ability to rapidly access and strategically deploy information and that, notably, where they increased AI…

Reducing misinformation sharing at scale using digital accuracy prompt ads

Hause Lin, Haritz Garro, Nils Wernerfelt +8 more

Sociology and Political Science · PsyArXiv (OSF Preprints) · · cited 21× · DOI ↗ · more like this ·

Interventions to reduce misinformation sharing have been a major focus in recent years. Developing “content-neutral” interventions that do not require specific fact-checks or warnings related to individual false claims is particularly important in developing scalable solutions. Here, we provide the first evaluations of a content-neutral intervention to reduce misinformation sharing conducted at scale in the field. Specifically, across two on-platform randomized controlled trials, one on Meta’s Facebook (N=33,043,471) and the other on Twitter (N=75,763), we find that simple messages reminding people to think about accuracy—delivered to large numbers of users using digital advertisements—reduce misinformation sharing, with effect sizes on par with what is typically observed in digital advertising experiments. On Facebook, in the hour after receiving an accuracy prompt ad, we found a 2.6%…

How many others have shared this? Experimentally investigating the effects of social cues on engagement, misinformation, and unpredictability on social media

Ziv Epstein, Hause Lin, Gordon Pennycook +1 more

cs.SI · · cited 18× · arXiv ↗ · more like this ·

Unlike traditional media, social media typically provides quantified metrics of how many users have engaged with each piece of content. Some have argued that the presence of these cues promotes the spread of misinformation. Here we investigate the causal effect of social cues on users' engagement with social media posts. We conducted an experiment with N=628 Americans on a custom-built newsfeed interface where we systematically varied the presence and strength of social cues. We find that when cues are shown, indicating that a larger number of others have engaged with a post, users were more likely to share and like that post. Furthermore, relative to a control without social cues, the presence of social cues increased the sharing of true relative to false news. The presence of social cues also makes it more difficult to precisely predict how popular any given post would be. Together…

Promises and perils of experimentation: The mutual internal validity problem

Hause Lin, Kaitlyn M. Werner, Michael Inzlicht

Safety Research · PsyArXiv (OSF Preprints) · · cited 17× · DOI ↗ · more like this ·

Researchers run experiments to test theories, search for and document phenomena, develop theories, or advise policymakers. When testing theories, experiments must be internally valid but do not have to be externally valid. However, when experiments are used to search for and document phenomena, develop theories, or advise policymakers, external validity matters. Conflating these goals and failing to recognize their tensions with validity concerns can lead to problems with theorizing. Experimenters in psychology should be aware of the mutual-internal-validity problem, long recognized by experimental economists. When phenomena elicited by experiments are used to develop theories that, in turn, influence the design of theory-testing experiments, experiments and theories can become wedded to each other and lose touch with reality. They capture and explain phenomena within but not beyond the…

Technique-based inoculation and accuracy prompts must be combined to increase truth discernment online

Gordon Pennycook, Adam J. Berinsky, Puneet Bhargava +5 more

Sociology and Political Science · PsyArXiv (OSF Preprints) · · cited 13× · DOI ↗ · more like this ·

Misinformation remains a serious problem and continues to be a major focus of intervention efforts. Psychological inoculation - a popular intervention approach wherein people are taught to identify manipulation techniques - is being adopted at scale around the globe by technology companies in an effort to combat misinformation. Yet the efficacy of this approach for increasing belief accuracy remains unclear, as prior work has largely focused on technique identification - rather than accuracy judgments - using synthetic materials that do not contain claims of truth or falsity. To address this issue, we conducted 5 studies with 7,286 online participants using a set of news headlines based on real-world false and true content in which we systematically varied the presence or absence of emotional manipulation. Although an emotional manipulation inoculation video did help participants…

Conscientiousness does not moderate the association between political ideology and susceptibility to fake news sharing

Hause Lin, David G. Rand, Gordon Pennycook

Sociology and Political Science · PsyArXiv (OSF Preprints) · · cited 11× · DOI ↗ · more like this ·

Recent work suggests that personality moderates the relationship between political ideology and the sharing of misinformation. Specifically, Lawson and Kakkar (2021) claimed that fake news sharing was driven mostly by low conscientiousness conservatives. We re-analyzed their data and conducted five new preregistered conceptual replications to reexamine their claims (N = 2433; stopping rule determined via Bayesian sequential sampling). The results did not support their claim that conscientious conservatives shared less fake news; instead, their findings pertain to overall sharing rates (of both true and fake news), rather than specifically to fake news. That is, the association between conscientiousness and misinformation sharing (when it occurs) is explained by lower overall sharing instead of a particular resistance to fake news per se. Our results highlight the importance of…

Yourfeed: Towards open science and interoperable systems for social media

Ziv Epstein, Hause Lin

cs.HC · · cited 11× · arXiv ↗ · more like this ·

Existing social media platforms (SMPs) make it incredibly difficult for researchers to conduct studies on social media, which in turn has created a knowledge gap between academia and industry about the effects of platform design on user behavior. To close the gap, we introduce Yourfeed, a research tool for conducting ecologically valid social media research. We introduce the platform architecture, as well key opportunities such as assessing the effects of exposure of content on downstream beliefs and attitudes, measuring attentional exposure via dwell time, and evaluating heterogeneous newsfeed algorithms. We discuss the underlying philosophy of interoperability for social media and future developments for the platform.

Quantifying attention via dwell time and engagement in a social media browsing environment

Ziv Epstein, Hause Lin, Gordon Pennycook +1 more

cs.HC · · cited 7× · arXiv ↗ · more like this ·

Modern computational systems have an unprecedented ability to detect, leverage and influence human attention. Prior work identified user engagement and dwell time as two key metrics of attention in digital environments, but these metrics have yet to be integrated into a unified model that can advance the theory andpractice of digital attention. We draw on work from cognitive science, digital advertising, and AI to propose a two-stage model of attention for social media environments that disentangles engagement and dwell. In an online experiment, we show that attention operates differently in these two stages and find clear evidence of dissociation: when dwelling on posts (Stage 1), users attend more to sensational than credible content, but when deciding whether to engage with content (Stage 2), users attend more to credible than sensational content. These findings have implications for…

Addressing climate change skepticism and inaction using human-AI dialogues

Gabriela Czarnek, Reed Orchinik, Hause Lin +4 more

Sociology and Political Science · · cited 5× · DOI ↗ · more like this ·

We ask whether facts and evidence - tailored by an AI model to address each person’s specific concerns - can address climate skepticism and inaction. Participants first described their main climate change reservation. The most prevalent were the belief that climate change has natural causes (15%), feeling overwhelmed by the problem (10%), and concerns about the economic consequences of climate policies (8%). Participants were then randomized to (1) have a conversation with a Large Language Model (LLM) that was given the goal of addressing their climate reservations, (2) discuss an irrelevant topic with the LLM (i.e., control), or (3) receive static information about the scientific consensus around climate change (i.e., “standard-of-care”). The LLM treatment significantly and substantially reduced participants’ conviction in their specific reservations, while consensus messaging did not.…

ollamar: An R package for running large language models

Hause Lin, Tawab Safi

General Social Sciences · The Journal of Open Source Software · · cited 5× · DOI ↗ · more like this ·

Large language models (LLMs) have transformed natural language processing and AI applications across numerous domains.While cloud-based LLMs are common, locally deployed models offer distinct advantages in reproducibility, data privacy, security, and customization.ollamar is an R package that provides an interface to Ollama, enabling researchers and data scientists to integrate locally-hosted LLMs into their R workflows seamlessly.It implements a consistent API design that aligns with other programming languages and follows established LLM usage conventions.It further distinguishes itself by offering flexible output formats and easy management of conversation history.ollamar is maintained on GitHub and available through the Comprehensive R Archive Network (CRAN), where it regularly undergoes comprehensive continuous integration testing across multiple platforms.

Limited effectiveness of psychological inoculation against misinformation in a social media feed

Sze Yuh Nina Wang, Samantha C. Phillips, Kathleen M. Carley +2 more

Sociology and Political Science · · cited 3× · DOI ↗ · more like this ·

Psychological inoculation is a promising and potentially scalable approach to counter misinformation. The goal of inoculation is to teach people to recognize manipulation techniques, such as emotional language, commonly found in misinformation online. While there is substantial evidence that inoculation increases technique recognition when directly assessed, it is not clear if this effect transfers to spontaneous detection of techniques and disengagement with the associated content in real-life contexts. In particular, emotional appeals are abundant on social media and known drivers of attention and engagement. Therefore, we examined the effects of emotional language and emotional manipulation inoculation on attention and engagement in a simulated social media feed environment. Through five pre-registered studies, we found that inoculation only decreased engagement with emotionally…

External validity of social experiments

Hause Lin, Michael N. Stagnaro

Sociology and Political Science · PsyArXiv (OSF Preprints) · · cited 2× · DOI ↗ · more like this ·

The social sciences have made significant progress in understanding human behavior and social phenomena in the last century. The experimental method has been fundamental for testing theories, searching for and documenting phenomena, developing theories, and generating policy-based evidence. We highlight how failing to recognize these different goals of experimentation can lead to problematic theories and findings that lack external validity, generalizability, and relevance in real-world contexts. Importantly, we discuss how attrition can threaten internal and external validity. The increasing reliance on online and field experiments also exacerbates the existing threats of attrition to external validity. Thus, to reap the true benefits of experimentation, social scientists must ensure they design experiments with the appropriate degrees of internal and external validity, recruit…

Accuracy prompts protect professional content moderators from the illusory truth effect

Hause Lin, Marlyn Thomas Savio, Xieyining Huang +5 more

Artificial Intelligence · PsyArXiv (OSF Preprints) · · cited 1× · DOI ↗ · more like this ·

Content moderators review problematic content for technology companies. One concern about this critical job is that repeated exposure to false claims could cause moderators to come to believe the very claims they are supposed to moderate, via the “illusory truth effect.” In a first field experiment with a global content moderation company (N = 199), we found that exposure to false claims while working as moderators did indeed increase subsequent belief among (mostly Indian and Philippine) employees. We then tested an intervention to mitigate this effect: inducing an accuracy mindset. In both general population samples (N_India = 997; N_Philippines = 1184) and a second field experiment with professional content moderators (N = 239), we replicate the illusory truth effect in the control condition, and find that inducing participants to consider accuracy when first exposed to the claims…

Addressing climate change skepticism and inaction using human-AI dialogues

Reed Orchinik, Hause Lin, Thomas Costello +4 more

Sociology and Political Science · PsyArXiv (OSF Preprints) · · cited 0× · OpenAlex ↗ · more like this ·

We ask whether facts and evidence - tailored by an AI model to address each person’s specific concerns - can address climate skepticism and inaction. Participants first described their main climate change reservation. The most prevalent were the belief that climate change has natural causes (15%), feeling overwhelmed by the problem (10%), and concerns about the economic consequences of climate policies (8%). Participants were then randomized to (1) have a conversation with a Large Language Model (LLM) that was given the goal of addressing their climate reservations, (2) discuss an irrelevant topic with the LLM (i.e., control), or (3) receive static information about the scientific consensus around climate change (i.e., “standard-of-care”). The LLM treatment significantly and substantially reduced participants’ conviction in their specific reservations, while consensus messaging did not.…

Partisan sortedness is used to signal trustworthiness

Samantha C. Phillips, Hause Lin, Mohsen Mosleh +1 more

Communication · PsyArXiv (OSF Preprints) · · cited 0× · DOI ↗ · more like this ·

Americans overestimate the extremity of differences between, and homogeneity among, the (non-political) characteristics and preferences of Republicans versus Democrats. We propose that everyday self-presentation contributes to these misperceptions: signaling motives lead people to represent themselves as more ``sorted'', i.e. as having preferences and characteristics that are closely aligned with what is perceived as typical of their party. This leads observers to have miscalibrated (and exaggerated) perceptions of differences between the groups. We present two studies testing the hypothesis that signaling motives exaggerate public expressions of partisan sortedness. Study 1 examines how social media users' profile descriptions vary in sortedness across social media platforms using two multi-platform datasets (N=740,055; 10,224). Study 2 (N=3,013) demonstrates a causal effect of…

Limited effectiveness of psychological inoculation against misinformation in a social media feed

Gordon Pennycook, Sze Yuh Nina Wang, Kathleen M. Carley +2 more

Sociology and Political Science · PsyArXiv (OSF Preprints) · · cited 0× · OpenAlex ↗ · more like this ·

Psychological inoculation is a promising and potentially scalable approach to counter misinformation. The goal of inoculation is to teach people to recognize manipulation techniques, such as emotional language, commonly found in misinformation online. While there is substantial evidence that inoculation increases technique recognition when directly assessed, it is not clear if this effect transfers to spontaneous detection of techniques and disengagement with the associated content in real-life contexts. In particular, emotional appeals are abundant on social media and known drivers of attention and engagement. Therefore, we examined the effects of emotional language and emotional manipulation inoculation on attention and engagement in a simulated social media feed environment. Through five pre-registered studies, we found that inoculation only decreased engagement with emotionally…

WITHDRAWN

Hause Lin, Tawab Safi

General Social Sciences · PsyArXiv (OSF Preprints) · · cited 0× · DOI ↗ · more like this ·

Large language models (LLMs) have transformed natural language processing and AI applications across numerous domains. While cloud-based LLMs are common, locally deployed models offer distinct advantages in reproducibility, data privacy, security, and customization. ollamar is an R package that provides an interface to Ollama, enabling researchers and data scientists to seamlessly integrate locally-hosted LLMs into their R workflows. It implements a consistent API design that aligns with other programming languages and follows established LLM usage conventions. It further distinguishes itself by offering flexible output formats, and easy management of conversation history. ollamar is maintained on GitHub and available through the Comprehensive R Archive Network (CRAN), where it regularly undergoes comprehensive continuous integration testing across multiple platforms.

Repeated exposure increases professional content moderators’ belief in false claims

Hause Lin, Marlyn Thomas Savio, Xieyining Huang +3 more

Artificial Intelligence · PsyArXiv (OSF Preprints) · · cited 0× · DOI ↗ · more like this ·

Content moderators regularly review problematic content for technology companies, and repeated exposure to claims could cause moderators to come to believe the very claims they are supposed to moderate. However, the nature of their jobs might buffer against this repetition-induced truth effect. We conducted a field experiment with TaskUs, a global content moderation company, to examine moderators’ (N = 199) susceptibility to the repetition effect when reviewing claims in true and false news headlines. The moderators judged news headlines they had previously been exposed to as more accurate than novel headlines, regardless of whether the headlines were true or false. These results highlight the need to understand the consequences of content moderation and develop interventions to mitigate the repetition effect among moderators, which will contribute to a healthier internet for everyone.

The scientific value of explanation and prediction

Hause Lin

Artificial Intelligence · OSF Preprints (OSF Preprints) · · cited 0× · DOI ↗ · more like this ·

Deep neural network models have revived longstanding debates on the value of explanation versus prediction for advancing science. Bowers et al.'s critique will not make these models go away, but it is likely to prompt new work that seeks to reconcile explanatory and predictive models, which could change how we determine what constitutes valuable scientific knowledge.

Cognitive Effort for Self, Strangers, and Charities

Gregory John Depow, Hause Lin, Michael Inzlicht

Sociology and Political Science · PsyArXiv (OSF Preprints) · · cited 0× · DOI ↗ · more like this ·

Effort is aversive and often avoided, even when earning benefits for oneself. Yet, people sometimes work hard for others. How do people decide who is worth their effort? Prior work shows people avoid physical effort for strangers relative to themselves, but invest more physical effort for charity. Here, we find that people avoid cognitive effort for others relative to themselves, even when the cause is a personally meaningful charity. In two studies, participants repeatedly decided whether to invest cognitive effort to gain financial rewards for themselves and others. In Study 1, participants (N = 51; 150 choices) were less willing to invest cognitive effort for a charity than themselves. In Study 2, participants (N = 47; 225 choices) were more willing to work cognitively for a charity than an intragroup stranger, but again preferred cognitive exertion that benefited themselves.…

Using drift-diffusion modeling to illuminate why accuracy prompts decrease misinformation sharing

Pennycook, Gordon, Hause Lin, Rand, David

Sociology and Political Science · OSF Preprints (OSF Preprints) · · cited 0× · DOI ↗ · more like this ·

Recent experiments have found that prompting people to think about accuracy reduces misinformation sharing intentions. The process by which this effect operates, however, remains unclear. Do accuracy prompts cause people to "stop and think," increasing deliberation? Or do they change what people think about, drawing attention to accuracy? Since these two accounts predict the same behavioral outcomes (i.e., increased sharing discernment following a prompt), we used computational modeling of sharing decisions with response time data, as well as out-of-sample ratings of headline perceived accuracy, to test the accounts' divergent predictions across six studies (N = 5633). The results suggest that accuracy prompts do not increase the amount of deliberation people engage in. Instead, they increase the weight participants put on accuracy while deliberating. By showing that prompting people…

Celebrity messages reduce online hate and limit its spread

Eaman Jahani, Blas Kolic, Manuel Tonneau +5 more

cs.SI · · arXiv ↗ · more like this ·

Online hate spreads rapidly, yet little is known about whether preventive and scalable strategies can curb it. We conducted the largest randomized controlled trial of hate speech prevention to date: a 20-week messaging campaign on X in Nigeria targeting ethnic hate. 73,136 users who had previously engaged with hate speech were randomly assigned to receive prosocial video messages from Nigerian celebrities. The campaign reduced hate content by 2.5% to 5.5% during treatment, with about 75% of the reduction persisting over the following four months. Reaching a larger share of a user's audience reduced amplification of that user's hate posts among both treated and untreated users, cutting hate reposts by over 50% for the most exposed accounts. Scalable messaging can limit online hate without removing content.