arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Edwin Simpson

53 papers · 1987–2026

1987: 11988: 01989: 01990: 01991: 01992: 11993: 01994: 01995: 01996: 01997: 01998: 01999: 02000: 02001: 02002: 02003: 02004: 02005: 02006: 02007: 02008: 22009: 42010: 02011: 22012: 22013: 12014: 12015: 22016: 02017: 02018: 22019: 52020: 82021: 42022: 22023: 02024: 52025: 62026: 5
1987peak 8 in 20202026

Frequent co-authors

Papers

showing 1–25 of 53 RSS

Text Processing Like Humans Do: Visually Attacking and Shielding NLP Systems

Steffen Eger, Gözde Gül Şahin, Andreas Rücklé +6 more

cs.CL · · cited 202× · arXiv ↗ · more like this ·

Visual modifications to text are often used to obfuscate offensive comments in social media (e.g., "!d10t") or as a writing style ("1337" in "leet speak"), among other scenarios. We consider this as a new type of adversarial attack in NLP, a setting to which humans are very robust, as our experiments with both simple and more difficult visual input perturbations demonstrate. We then investigate the impact of visual adversarial attacks on current NLP systems on character-, word-, and sentence-level tasks, showing that both neural and non-neural models are, in contrast to humans, extremely sensitive to such attacks, suffering performance decreases of up to 82\%. We then explore three shielding methods---visual character embeddings, adversarial training, and rule-based recovery---which substantially improve the robustness of the models. However, the shielding methods still fall behind…

Efficient Methods for Natural Language Processing: A Survey

Marcos Treviso, Ji-Ung Lee, Tianchu Ji +19 more

cs.CL · · cited 170× · arXiv ↗ · more like this ·

Recent work in natural language processing (NLP) has yielded appealing results from scaling model parameters and training data; however, using only scale to improve performance means that resource consumption also grows. Such resources include data, time, storage, or energy, all of which are naturally limited and unevenly distributed. This motivates research into efficient methods that require fewer resources to achieve similar results. This survey synthesizes and relates current methods and findings in efficient NLP. We aim to provide both guidance for conducting NLP under limited resources, and point towards promising research directions for developing more efficient methods.

Text Processing Like Humans Do: Visually Attacking and Shielding

Steffen Eger, Gözde Gül Şahin, Andreas Rücklé +6 more

Artificial Intelligence · Explore Bristol Research · · cited 85× · DOI ↗ · more like this ·

Steffen Eger, Gözde Gül Şahin, Andreas Rücklé, Ji-Ung Lee, Claudia Schulz, Mohsen Mesgar, Krishnkant Swarnkar, Edwin Simpson, Iryna Gurevych. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 2019.

Predicting Economic Indicators from Web Text Using Sentiment Composition

Abby Levenberg, Stephen Pulman, Karo Moilanen +2 more

Artificial Intelligence · International Journal of Computer and Communication Engineering · · cited 36× · DOI ↗ · more like this ·

Of late there has been a significant amount of work on us-ing sources of text data from the Web (such as Twitter or Google Trends) to predict financial and economic variables of interest. Much of this work has relied on some form or other of superficial sentiment analysis to represent the text. In this work we present a novel approach to predict-ing economic variables using sentiment composition over text streams of Web data. We treat each text stream as a separate sentiment source with its own predictive distribu-tion. We then use a Bayesian classifier combination model to combine the separate predictions into a single optimal prediction for the Nonfarm Payroll index, a primary eco-nomic indicator. Our results show that we can achieve high predictive accuracy using sentiment over big text streams.

Content-Centered Collaboration Spaces in the Cloud

John Erickson, Susan H. Spence, Michael Rhodes +5 more

Computer Networks and Communications · IEEE Internet Computing · · cited 36× · DOI ↗ · more like this ·

Emphasizing communication, collaborative work, and community, the authors envision a cloud-based platform that inverts the traditional application-content relationship by placing content rather than applications at the center, enabling users to rapidly build customized solutions around their content items. The future of collaboration will focus on building and sustaining communities around content, tasks, and ideas. Hosted entities known as content spaces will support ecosystems of users and developers around this content. To make their case, the authors review the dominant trends in computing that motivate the exploration of new approaches for content-centered collaboration and discuss ways to address certain core problems for users and organizations.

Language Understanding in the Wild

Edwin Simpson, Matteo Venanzi, Steven Reece +4 more

Computer Science Applications · ePrints Soton (University of Southampton) · · cited 24× · DOI ↗ · more like this ·

Social media has led to the democratisation of opinion sharing. A wealth of information about public opinions, current events, and authors' insights into specific topics can be gained by understanding the text written by users. However, there is a wide variation in the language used by different authors in different contexts on the web. This diversity in language makes interpretation an extremely challenging task. Crowdsourcing presents an opportunity to interpret the sentiment, or topic, of free-text. However, the subjectivity and bias of human interpreters raise challenges in inferring the semantics expressed by the text. To overcome this problem, we present a novel Bayesian approach to language understanding that relies on aggregated crowdsourced judgements. Our model encodes the relationships between labels and text features in documents, such as tweets, web articles, and blog…

Low Resource Sequence Tagging with Weak Labels

Edwin Simpson, Jonas Pfeiffer, Iryna Gurevych

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence · · cited 14× · DOI ↗ · more like this ·

Current methods for sequence tagging depend on large quantities of domain-specific training data, limiting their use in new, user-defined tasks with few or no annotations. While crowdsourcing can be a cheap source of labels, it often introduces errors that degrade the performance of models trained on such crowdsourced data. Another solution is to use transfer learning to tackle low resource sequence labelling, but current approaches rely heavily on similar high resource datasets in different languages. In this paper, we propose a domain adaptation method using Bayesian sequence combination to exploit pre-trained models and unreliable crowdsourced data that does not require high resource data in a different language. Our method boosts performance by learning the relationship between each labeller and the target task and trains a sequence labeller on the target domain with little or no…

Dynamic Bayesian Combination of Multiple Imperfect Classifiers

Edwin Simpson, Stephen Roberts, Ioannis Psorakis +1 more

math.ST · · cited 7× · arXiv ↗ · more like this ·

Classifier combination methods need to make best use of the outputs of multiple, imperfect classifiers to enable higher accuracy classifications. In many situations, such as when human decisions need to be combined, the base decisions can vary enormously in reliability. A Bayesian approach to such uncertain combination allows us to infer the differences in performance between individuals and to incorporate any available prior knowledge about their abilities when training data is sparse. In this paper we explore Bayesian classifier combination, using the computationally efficient framework of variational Bayesian inference. We apply the approach to real data from a large citizen science project, Galaxy Zoo Supernovae, and show that our method far outperforms other established approaches to imperfect decision combination. We go on to analyse the putative community structure of the…

Interactive Text Ranking with Bayesian Optimization: A Case Study on Community QA and Summarization

Edwin Simpson, Yang Gao, Iryna Gurevych

Artificial Intelligence · Transactions of the Association for Computational Linguistics · · cited 6× · DOI ↗ · more like this ·

For many NLP applications, such as question answering and summarization, the goal is to select the best solution from a large space of candidates to meet a particular user’s needs. To address the lack of user or task-specific training data, we propose an interactive text ranking approach that actively selects pairs of candidates, from which the user selects the best. Unlike previous strategies, which attempt to learn a ranking across the whole candidate space, our method uses Bayesian optimization to focus the user’s labeling effort on high quality candidates and integrate prior knowledge to cope better with small data scenarios. We apply our method to community question answering (cQA) and extractive multidocument summarization, finding that it significantly outperforms existing interactive approaches. We also show that the ranking function learned by our method is an effective reward…

Improving Factual Consistency Between a Response and Persona Facts

Mohsen Mesgar, Edwin Simpson, Iryna Gurevych

cs.CL · · cited 6× · arXiv ↗ · more like this ·

Neural models for response generation produce responses that are semantically plausible but not necessarily factually consistent with facts describing the speaker's persona. These models are trained with fully supervised learning where the objective function barely captures factual consistency. We propose to fine-tune these models by reinforcement learning and an efficient reward function that explicitly captures the consistency between a response and persona facts as well as semantic plausibility. Our automatic and human evaluations on the PersonaChat corpus confirm that our approach increases the rate of responses that are factually consistent with persona facts over its supervised counterpart while retaining the language quality of responses.

Aggregating and Learning from Multiple Annotators

Silviu Paun, Edwin Simpson

Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

The success of NLP research is founded on high-quality annotated datasets, which are usually obtained from multiple expert annotators or crowd workers. The standard practice to training machine learning models is to first adjudicate the disagreements and then perform the training. To this end, there has been a lot of work on aggregating annotations, particularly for classification tasks. However, many other tasks, particularly in NLP, have unique characteristics not considered by standard models of annotation, e.g., label interdependencies in sequence labelling tasks, unrestricted labels for anaphoric annotation, or preference labels for ranking texts. In recent years, researchers have picked up on this and are covering the gap. A first objective of this tutorial is to connect NLP researchers with state-of-the-art aggregation models for a diverse set of canonical language annotation…

Low Resource Multi-Task Sequence Tagging -- Revisiting Dynamic Conditional Random Fields

Jonas Pfeiffer, Edwin Simpson, Iryna Gurevych

cs.CL · · cited 4× · arXiv ↗ · more like this ·

We compare different models for low resource multi-task sequence tagging that leverage dependencies between label sequences for different tasks. Our analysis is aimed at datasets where each example has labels for multiple tasks. Current approaches use either a separate model for each task or standard multi-task learning to learn shared feature representations. However, these approaches ignore correlations between label sequences, which can provide important information in settings with small training datasets. To analyze which scenarios can profit from modeling dependencies between labels in different tasks, we revisit dynamic conditional random fields (CRFs) and combine them with deep neural networks. We compare single-task, multi-task and dynamic CRF setups for three diverse datasets at both sentence and document levels in English and German low resource scenarios. We show that…

A Bayesian Approach for Sequence Tagging with Crowds

Edwin Simpson, Iryna Gurevych

cs.CL · · cited 4× · arXiv ↗ · more like this ·

Current methods for sequence tagging, a core task in NLP, are data hungry, which motivates the use of crowdsourcing as a cheap way to obtain labelled data. However, annotators are often unreliable and current aggregation methods cannot capture common types of span annotation errors. To address this, we propose a Bayesian method for aggregating sequence tags that reduces errors by modelling sequential dependencies between the annotations as well as the ground-truth labels. By taking a Bayesian approach, we account for uncertainty in the model due to both annotator errors and the lack of data for modelling annotators who complete few tasks. We evaluate our model on crowdsourced data for named entity recognition, information extraction and argument mining, showing that our sequential model outperforms the previous state of the art. We also find that our approach can reduce crowdsourcing…

Analyzing Communal Tag Relationships for Enhanced Navigation and User Modeling

Edwin Simpson, Mark H. Butler

Signal Processing · IGI Global eBooks · · cited 4× · DOI ↗ · more like this ·

The increasing amount of available information has created a demand for better, more automated methods of finding and organizing different types of information resources. This chapter investigates methods for enabling improved navigation, user modeling, and personalization using collaboratively generated tags. The authors discuss the advantages and limitations of tags, and describe how relationships between tags can be used to discover latent structures that can automatically organize a collection of tags owned by a community. They give a hierarchical clustering algorithm for extracting latent structure and explain methods for determining tag specificity, then use visualization to examine latent structures. Finally the authors discuss future trends including using latent tag structures to create user models.

How well can LLMs Grade Essays in Arabic?

Rayed Ghazawi, Edwin Simpson

cs.CL · · cited 2× · arXiv ↗ · more like this ·

This research assesses the effectiveness of state-of-the-art large language models (LLMs), including ChatGPT, Llama, Aya, Jais, and ACEGPT, in the task of Arabic automated essay scoring (AES) using the AR-AES dataset. It explores various evaluation methodologies, including zero-shot, few-shot in-context learning, and fine-tuning, and examines the influence of instruction-following capabilities through the inclusion of marking guidelines within the prompts. A mixed-language prompting strategy, integrating English prompts with Arabic content, was implemented to improve model comprehension and performance. Among the models tested, ACEGPT demonstrated the strongest performance across the dataset, achieving a Quadratic Weighted Kappa (QWK) of 0.67, but was outperformed by a smaller BERT-based model with a QWK of 0.88. The study identifies challenges faced by LLMs in processing Arabic…

Assisting Decision Making in Scholarly Peer Review: A Preference Learning Perspective

Nils Dycke, Edwin Simpson, Ilia Kuznetsov +1 more

cs.CL · · cited 2× · arXiv ↗ · more like this ·

Peer review is the primary means of quality control in academia; as an outcome of a peer review process, program and area chairs make acceptance decisions for each paper based on the review reports and scores they received. Quality of scientific work is multi-faceted; coupled with the subjectivity of reviewing, this makes final decision making difficult and time-consuming. To support this final step of peer review, we formalize it as a paper ranking problem. We introduce a novel, multi-faceted generic evaluation framework for ranking submissions based on peer reviews that takes into account effectiveness, efficiency and fairness. We propose a preference learning perspective on the task that considers both review texts and scores to alleviate the inevitable bias and noise in reviews. Our experiments on peer review data from the ACL 2018 conference demonstrate the superiority of our…

Ranking Creative Language Characteristics in Small Data Scenarios

Julia Siekiera, Marius Köppel, Edwin Simpson +3 more

cs.CL · · cited 2× · arXiv ↗ · more like this ·

The ability to rank creative natural language provides an important general tool for downstream language understanding and generation. However, current deep ranking models require substantial amounts of labeled data that are difficult and expensive to obtain for different domains, languages and creative characteristics. A recent neural approach, the DirectRanker, promises to reduce the amount of training data needed but its application to text isn't fully explored. We therefore adapt the DirectRanker to provide a new deep model for ranking creative language with small data. We compare DirectRanker with a Bayesian approach, Gaussian process preference learning (GPPL), which has previously been shown to work well with sparse data. Our experiments with sparse training data show that while the performance of standard neural ranking approaches collapses with small training datasets…

Scalable Bayesian Preference Learning for Crowds

Edwin Simpson, Iryna Gurevych

cs.LG · · cited 2× · arXiv ↗ · more like this ·

We propose a scalable Bayesian preference learning method for jointly predicting the preferences of individuals as well as the consensus of a crowd from pairwise labels. Peoples' opinions often differ greatly, making it difficult to predict their preferences from small amounts of personal data. Individual biases also make it harder to infer the consensus of a crowd when there are few labels per item. We address these challenges by combining matrix factorisation with Gaussian processes, using a Bayesian approach to account for uncertainty arising from noisy and sparse data. Our method exploits input features, such as text embeddings and user metadata, to predict preferences for new items and users that are not in the training set. As previous solutions based on Gaussian processes do not scale to large numbers of users, items or pairwise labels, we propose a stochastic variational…

Impact identification using matched filtering and spectral cross correlation

David E. Norwood, Edwin Simpson, Satish M. Mahajan

Computer Networks and Communications · · cited 2× · DOI ↗ · more like this ·

Matched filtering is a common method for analyzing known waveforms of interest. From analyzing images for target recognition, to identifying coding within a noisy transmission, matched filtering via cross correlation is commonly used. This paper presents an implementation for identifying impacts using an accelerometer and matched filtering via cross correlation. Matlab was used for proof of concept and simulation. The Altera DE2 FPGA development board employing matched filters and Labview employing spectral cross correlation were used for the real-time implementation.

Using a Bayesian Model to Combine LDA Features with Crowdsourced Responses

Edwin Simpson, Steven Reece, Antonio Penta +1 more

Computer Science Applications · Text REtrieval Conference · · cited 2× · OpenAlex ↗ · more like this ·

This paper describes a crowdsourcing system that integrates machine learning techniques with hu-man classifiers, showing how to apply a Bayesian approach to classifier combination to the challenge of crowdsourcing document topic labels. First, we use a number of NLP techniques to extract informative document features. We then screen and select workers using Amazon Mechanical Turk to label selected documents. We then apply Independent Bayesian Classifier Combination (IBCC) to classify the complete set of documents in a semi-supervised manner, taking into account the unreliability of crowd-sourced la-bels. More documents are then selected intelligently for labeling by the crowd. We demonstrate superior results using IBCC compared to a two-stage classifier and strong performance with only 16 % documents labelled by the crowd. 1

Surrogate modeling for realistic early-stage landing gear design load estimates

S. van den Broek, Tom Hunns, Edwin Simpson +2 more

Computational Theory and Mathematics · Aerospace Science and Technology · · cited 1× · DOI ↗ · more like this ·

• Gaussian Process surrogate models accurately predict nonlinear landing gear dynamics. • PCA reduces dimensionality enabling efficient optimization of landing gear parameters. • Per-sample uncertainty optimization reduces conservatism in early-stage design loads. • Sobol sensitivity analysis identifies aircraft pitch and mass as key load drivers. • Framework integrates uncertainty quantification with subsystem optimization seamlessly. The work presented in this paper focuses on surrogate modeling for early-stage landing gear design to enable rapid load prediction and optimization under uncertainty. We propose an approach that integrates Gaussian-Process regression with Principal Component Analysis to approximate the dynamic behavior of a simplified landing gear model. The work presented in this paper focuses on surrogate modeling for early-stage landing gear design to enable rapid load…

Medfluencer: A Network Representation of Medical Influencers' Identities and Discourse on Social Media

Zhijin Guo, Edwin Simpson, Roberta Bernardi

cs.SI · · cited 1× · arXiv ↗ · more like this ·

In our study, we first constructed a dataset from the tweets of the top 100 medical influencers with the highest Influencer Score during the COVID-19 pandemic. This dataset was then used to construct a socio-semantic network, mapping both their identities and key topics, which are crucial for understanding their impact on public health discourse. To achieve this, we developed a few-shot multi-label classifier to identify influencers and their network actors' identities, employed BERTopic for extracting thematic content, and integrated these components into a network model to analyze their impact on health discourse. To ensure the reproducibility of our results, we have made the code available at https://github.com/ZhijinGuo/Medinfluencer.

Towards Abstractive Timeline Summarisation using Preference-based Reinforcement Learning

Yuxuan Ye, Edwin Simpson

cs.LG · · cited 1× · arXiv ↗ · more like this ·

This paper introduces a novel pipeline for summarising timelines of events reported by multiple news sources. Transformer-based models for abstractive summarisation generate coherent and concise summaries of long documents but can fail to outperform established extractive methods on specialised tasks such as timeline summarisation (TLS). While extractive summaries are more faithful to their sources, they may be less readable and contain redundant or unnecessary information. This paper proposes a preference-based reinforcement learning (PBRL) method for adapting pretrained abstractive summarisers to TLS, which can overcome the drawbacks of extractive timeline summaries. We define a compound reward function that learns from keywords of interest and pairwise preference labels, which we use to fine-tune a pretrained abstractive summariser via offline reinforcement learning. We carry out…

A Proposal: Interactively Learning to Summarise Timelines by Reinforcement Learning

Yuxuan Ye, Edwin Simpson

Artificial Intelligence · Bristol Research (University of Bristol) · · cited 1× · DOI ↗ · more like this ·

Timeline Summarisation (TLS) aims to generate a concise, time-ordered list of events described in sources such as news articles. However, current systems do not provide an adequate way to adapt to new domains nor to focus on the aspects of interest to a particular user. Therefore, we propose a method for interactively learning abstractive TLS using Reinforcement Learning (RL). We define a compound reward function and use RL to finetune an abstractive Multi-document Summarisation (MDS) model, which avoids the need to train using reference summaries. One of the sub-reward functions will be learned interactively from user feedback to ensure the consistency between users' demands and the generated timeline. The other sub-reward functions contribute to topical coherence and linguistic fluency. We plan experiments to evaluate whether our approach could generate accurate and precise timelines…