Author

Maite Taboada

60 papers · 1996–2026

1996peak 7 in 20132026

Frequent co-authors

Papers

showing 1–25 of 60 RSS

Lexicon-Based Methods for Sentiment Analysis

Maite Taboada, Julian Brooke, Milan Tofiloski +2 more

Artificial Intelligence · Computational Linguistics · 5 Apr 2011 · cited 3,255× · DOI ↗ · more like this ·

We present a lexicon-based approach to extracting sentiment from text. The Semantic Orientation CALculator (SO-CAL) uses dictionaries of words annotated with their semantic orientation (polarity and strength), and incorporates intensification and negation. SO-CAL is applied to the polarity classification task, the process of assigning a positive or negative label to a text that captures the text's opinion towards its main subject matter. We show that SO-CAL's performance is consistent across domains and in completely unseen data. Additionally, we describe the process of dictionary creation, and our use of Mechanical Turk to check dictionaries for consistency and reliability.

Sentiment Analysis: An Overview from Linguistics

Maite Taboada

Artificial Intelligence · Annual Review of Linguistics · 22 Sep 2015 · cited 402× · DOI ↗ · more like this ·

Sentiment analysis is a growing field at the intersection of linguistics and computer science that attempts to automatically determine the sentiment contained in text. Sentiment can be characterized as positive or negative evaluation expressed through language. Common applications of sentiment analysis include the automatic determination of whether a review posted online (of a movie, a book, or a consumer product) is positive or negative toward the item being reviewed. Sentiment analysis is now a common tool in the repertoire of social media analysis carried out by companies, marketers, and political analysts. Research on sentiment analysis extracts information from positive and negative words in text, from the context of those words, and from the linguistic structure of the text. This brief review examines in particular the contributions that linguistic knowledge can make to the task…

Cross-Linguistic Sentiment Analysis: From English to Spanish

Julian Brooke, Milan Tofiloski, Maite Taboada

Artificial Intelligence · Recent Advances in Natural Language Processing · September 2009 · cited 189× · OpenAlex ↗ · more like this ·

We explore the adaptation of English resources and techniques for text sentiment analysis to a new language, Spanish. Our main focus is the modification of an existing English semantic orientation calculator and the building of dictionaries; however we also compare alternate approaches, including machine translation and Support Vector Machine classification. The results indicate that, although languageindependent methods provide a decent baseline performance, there is also a significant cost to automation, and thus the best path to long-term improvement is through the inclusion of language-specific knowledge and resources. 1.

Analyzing Appraisal Automatically

Maite Taboada, Jack Grieve

Artificial Intelligence · National Conference on Artificial Intelligence · 2004 · cited 180× · OpenAlex ↗ · more like this ·

We present a method for classifying texts automatically, based on their subjective content. We apply a standard method for calculating semantic orientation (Turney 2002), and expand it by giving more prominence to certain parts of the text, where we believe most subjective content is concentrated. We also apply a linguistic classification of Appraisal and find that it could be helpful in distinguishing different types of subjective texts (e.g., movie reviews from consumer product reviews). Classifying Sentiment The task of classifying texts based on their subjective content, or sentiment, is considered to be difficult to implement computationally. There is, however, a growing body of research both in computational and theoretical linguistics that

Big Data and quality data for fake news and misinformation detection

Fatemeh Torabi Asr, Maite Taboada

Sociology and Political Science · Big Data & Society · 2019 · cited 155× · DOI ↗ · more like this ·

Fake news has become an important topic of research in a variety of disciplines including linguistics and computer science. In this paper, we explain how the problem is approached from the perspective of natural language processing, with the goal of building a system to automatically detect misinformation in news. The main challenge in this line of research is collecting quality data, i.e., instances of fake and real news articles on a balanced distribution of topics. We review available datasets and introduce the MisInfoText repository as a contribution of our lab to the community. We make available the full text of the news articles, together with veracity labels previously assigned based on manual assessment of the articles’ truth content. We also perform a topic modelling experiment to elaborate on the gaps and sources of imbalance in currently available datasets to guide future…

A machine‐learning approach to negation and speculation detection for sentiment analysis

Noa P. Cruz, Maite Taboada, Ruslan Mitkov

Artificial Intelligence · Journal of the Association for Information Science and Technology · 13 May 2015 · cited 96× · DOI ↗ · more like this ·

Recognizing negative and speculative information is highly relevant for sentiment analysis. This paper presents a machine‐learning approach to automatically detect this kind of information in the review domain. The resulting system works in two steps: in the first pass, negation/speculation cues are identified, and in the second phase the full scope of these cues is determined. The system is trained and evaluated on the S imon F raser U niversity R eview corpus, which is extensively used in opinion mining. The results show how the proposed method outstrips the baseline by as much as roughly 20% in the negation cue detection and around 13% in the scope recognition, both in terms of F 1 . In speculation, the performance obtained in the cue prediction phase is close to that obtained by a human rater carrying out the same task. In the scope detection, the results are also promising and…

The SFU Opinion and Comments Corpus: A Corpus for the Analysis of Online News Comments

Varada Kolhatkar, Hanhan Wu, Luca Cavasso +3 more

Artificial Intelligence · Corpus Pragmatics · 2 Nov 2019 · cited 84× · DOI ↗ · more like this ·

in the 5-year period between 2012 and 2016, a total of 10,339 articles and 663,173 comments. SOCC is part of a project that investigates the linguistic characteristics of online comments. The corpus can be used to study a host of pragmatic phenomena. Among other aspects, researchers can explore: the connections between articles and comments; the connections of comments to each other; the types of topics discussed in comments; the nice (constructive) or mean (toxic) ways in which commenters respond to each other; how language is used to convey very specific types of evaluation; and how negation affects the interpretation of evaluative meaning in discourse. Our current focus is the study of constructiveness and evaluation in the comments. To that end, we have annotated a subset of the large corpus (1043 comments) with four layers of annotations: constructiveness, toxicity, negation and…

Evaluative Language Beyond Bags of Words: Linguistic Insights and Computational Applications

Farah Benamara, Maite Taboada, Yannick Mathieu

Artificial Intelligence · Computational Linguistics · 14 Dec 2016 · cited 80× · DOI ↗ · more like this ·

The study of evaluation, affect, and subjectivity is a multidisciplinary enterprise, including sociology, psychology, economics, linguistics, and computer science. A number of excellent computational linguistics and linguistic surveys of the field exist. Most surveys, however, do not bring the two disciplines together to show how methods from linguistics can benefit computational sentiment analysis systems. In this survey, we show how incorporating linguistic insights, discourse information, and other contextual phenomena, in combination with the statistical exploitation of data, can result in an improvement over approaches that take advantage of only one of these perspectives. We first provide a comprehensive introduction to evaluative language from both a linguistic and computational perspective. We then argue that the standard computational definition of the concept of evaluative…

A syntactic and lexical-based discourse segmenter

Milan Tofiloski, Julian Brooke, Maite Taboada

Artificial Intelligence · 2009 · cited 78× · DOI ↗ · more like this ·

We present a syntactic and lexically based discourse segmenter (SLSeg) that is designed to avoid the common problem of over-segmenting text. Segmentation is the first step in a discourse parser, a system that constructs discourse trees from elementary discourse units. We compare SLSeg to a probabilistic segmenter, showing that a conservative approach increases precision at the expense of recall, while retaining a high F-score across both formal and informal texts.

Rhetorical relations in multimodal documents

Maite Taboada, Christopher Habel

Artificial Intelligence · Discourse Studies · February 2013 · cited 67× · DOI ↗ · more like this ·

We present a corpus-based study of coherence in multimodal documents. We concern ourselves with the types of relationships between graphs and tables and the text of the document in which they appear. In order to understand and categorize the types of relations across modalities, we are making use of Rhetorical Structure Theory (Mann and Thompson, 1988), and propose that this can adequately describe these types of relations. We analyzed a corpus comprising three different genres, and consisting of about 1500 pages of material and almost 600 figures, tables and graphs. We show that figures stand in both presentational and subject matter relations to the text, and that the relationship between figures and text is one of a small set out of the larger possible rhetorical relations. We also discuss several issues that arise in the treatment of multimodal material, such as the potential for…

Genre-based paragraph classification for sentiment analysis

Maite Taboada, Julian Brooke, Manfred Stede

Artificial Intelligence · 2009 · cited 54× · DOI ↗ · more like this ·

We present a taxonomy and classification system for distinguishing between different types of paragraphs in movie reviews: formal vs. functional paragraphs and, within the latter, between description and comment. The classification is used for sentiment extraction, achieving improvement over a baseline without paragraph classification.

Gender Bias in the News: A Scalable Topic Modelling and Visualization Framework

P. Prabhakar Rao, Maite Taboada

General Social Sciences · Frontiers in Artificial Intelligence · 16 Jun 2021 · cited 47× · DOI ↗ · more like this ·

We present a topic modelling and data visualization methodology to examine gender-based disparities in news articles by topic. Existing research in topic modelling is largely focused on the text mining of closed corpora, i.e., those that include a fixed collection of composite texts. We showcase a methodology to discover topics via Latent Dirichlet Allocation, which can reliably produce human-interpretable topics over an open news corpus that continually grows with time. Our system generates topics, or distributions of keywords, for news articles on a monthly basis, to consistently detect key events and trends aligned with events in the real world. Findings from 2 years worth of news articles in mainstream English-language Canadian media indicate that certain topics feature either women or men more prominently and exhibit different types of language. Perhaps unsurprisingly, topics such…

Constructive Language in News Comments

Varada Kolhatkar, Maite Taboada

Artificial Intelligence · 2017 · cited 47× · DOI ↗ · more like this ·

We discuss the characteristics of constructive news comments, and present methods to identify them. First, we define the notion of constructiveness. Second, we annotate a corpus for constructiveness. Third, we explore whether available argumentation corpora can be useful to identify constructiveness in news comments. Our model trained on argumentation corpora achieves a top accuracy of 72.59% (baseline=49.44%) on our crowdannotated test data. Finally, we examine the relation between constructiveness and toxicity. In our crowd-annotated data, 21.42% of the non-constructive comments and 17.89% of the constructive comments are toxic, suggesting that non-constructive comments are not much more toxic than constructive comments.

Contrastive analyses of evaluation in text

Maite Taboada, Marta Carretero

Artificial Intelligence · Linguistics and the Human Sciences · 13 Dec 2012 · cited 47× · DOI ↗ · more like this ·

This paper reports on part of the research on evaluative language currently carried out within the CONTRANOT project,[lxxviii] which aims at the creation and validation of contrastive functional descriptions through corpus analysis and annotation in English and Spanish. More concretely, we will present the coding scheme designed for Attitude, a subcategory of Appraisal as studied within Systemic-Functional Linguistics (Martin and White, 2005; White, 2003). The criteria for selection and annotation of spans of Attitude in the coding scheme are specified and illustrated with examples from the Simon Fraser University Review Corpus (Taboada, 2008), a corpus of consumer-generated reviews on hotels, books and movies, and a small-scale English-Spanish contrastive analysis of these reviews has been carried out. The scheme is to be used for the future annotation of evaluation in an…

The Gender Gap Tracker: Using Natural Language Processing to measure gender bias in media

Fatemeh Torabi Asr, Mohammad Mazraeh, Alexandre Lopes +4 more

Sociology and Political Science · PLoS ONE · 29 Jan 2021 · cited 39× · DOI ↗ · more like this ·

We examine gender bias in media by tallying the number of men and women quoted in news text, using the Gender Gap Tracker, a software system we developed specifically for this purpose. The Gender Gap Tracker downloads and analyzes the online daily publication of seven English-language Canadian news outlets and enhances the data with multiple layers of linguistic information. We describe the Natural Language Processing technology behind this system, the curation of off-the-shelf tools and resources that we used to build it, and the parts that we developed. We evaluate the system in each language processing task and report errors using real-world examples. Finally, by applying the Tracker to the data, we provide valuable insights about the proportion of people mentioned and quoted, by gender, news organization, and author gender. Data collected between October 1, 2018 and September 30…

Mapping Different Rhetorical Relation Annotations: A Proposal

Farah Benamara, Maite Taboada

Artificial Intelligence · Open Archive Toulouse Archive Ouverte (University of Toulouse) · 2015 · cited 37× · DOI ↗ · more like this ·

Annotation efforts have resulted in the availability of a number of corpora with rhetorical relation information. The corpora, unfortunately, are annotated under different theoretical approaches and have different hierarchies of relations. In addition, new sets of rhetorical relations have been proposed to account for language variation. The types of relations, however, tend to overlap or be related in specific ways. We believe that differences across approaches are minimal, and a unified set of relations that works across languages is possible. This paper details a new taxonomy of relations organized in four top level-classes with a total of 26 relations. We propose a mapping between existing annotations and show that our taxonomy is robust across theories, and can be applied to multiple languages.

Introduction to the Special Issue on Language in Social Media: Exploiting Discourse and Other Contextual Information

Farah Benamara, Diana Inkpen, Maite Taboada

Artificial Intelligence · Computational Linguistics · 18 Sep 2018 · cited 36× · DOI ↗ · more like this ·

Social media content is changing the way people interact with each other and share information, personal messages, and opinions about situations, objects, and past experiences. Most social media texts are short online conversational posts or comments that do not contain enough information for natural language processing (NLP) tools, as they are often accompanied by non-linguistic contextual information, including meta-data (e.g., the user’s profile, the social network of the user, and their interactions with other users). Exploiting such different types of context and their interactions makes the automatic processing of social media texts a challenging research task. Indeed, simply applying traditional text mining tools is clearly sub-optimal, as, typically, these tools take into account neither the interactive dimension nor the particular nature of this data, which shares properties…

Annotation upon Annotation: Adding Signalling Information to a Corpus of Discourse Relations

Maite Taboada, Debopam Das

Artificial Intelligence · Dialogue & Discourse · 16 Aug 2013 · cited 35× · DOI ↗ · more like this ·

We present an annotation effort that involves adding a new layer of annotation to an existing corpus. We are interested in how rhetorical relations are signalled in discourse, and thus begin with a corpus already annotated for rhetorical relations, to which we add signalling information. We show that a very large number of relations carry signals that identify them as such. The detailed, extensive analysis of signals in the corpus will aid research in the automatic parsing of discourse relations.

A corpus analysis of online news comments using the Appraisal framework

Luca Cavasso, Maite Taboada

Artificial Intelligence · Journal of Corpora and Discourse Studies · 27 Apr 2021 · cited 32× · DOI ↗ · more like this ·

We present detailed analyses of the distribution of Appraisal categories (Martin and White, 2005) in a corpus of online news comments. The corpus consists of just over one thousand comments posted in response to a variety of opinion pieces on the website of the Canadian newspaper The Globe and Mail. We annotated all the comments with labels corresponding to different categories of the Appraisal framework. Analyses of the annotations show that comments are overwhelmingly negative, and that they favour two of the subtypes of Attitude (Judgment and Appreciation) over the third, Affect. The paper contributes a methodology for annotating Appraisal, and results that show the interaction of Appraisal with negation, the constructive (or not) nature of comments, and the level of toxicity found in them. The results show that highly opinionated language is expressed as an objective opinion…

Loving and hating the movies in English, German and Spanish

Maite Taboada, Marta Carretero, Jennifer Hinnell

Artificial Intelligence · Languages in Contrast · 4 Mar 2014 · cited 28× · DOI ↗ · more like this ·

We present a quantitative analysis of evaluative language in a genre in which it is particularly prominent, that of movie reviews. The data chosen are non-professional consumer-generated reviews written in English, German and Spanish. The reviews are analysed in terms of the categories of Attitude and Graduation within the Appraisal framework (Martin and White, 2005). A number of similarities in the distribution of the Appraisal subcategories were found across the three languages, such as the high frequency of Appreciation and the narrow relationship between the global polarity of the reviews and the individual polarity of the spans. More importantly, the analysis uncovers a number of cross-linguistic distributional differences, which may be explained in terms of a wide array of factors, such as lexicogrammar, word order, argumentative style or sociocultural reasons.

Classifying Constructive Comments

Varada Kolhatkar, Nithum Thain, Jeffrey Sorensen +2 more

cs.CL · April 2020 · cited 26× · arXiv ↗ · more like this ·

We introduce the Constructive Comments Corpus (C3), comprised of 12,000 annotated news comments, intended to help build new tools for online communities to improve the quality of their discussions. We define constructive comments as high-quality comments that make a contribution to the conversation. We explain the crowd worker annotation scheme and define a taxonomy of sub-characteristics of constructiveness. The quality of the annotation scheme and the resulting dataset is evaluated using measurements of inter-annotator agreement, expert assessment of a sample, and by the constructiveness sub-characteristics, which we show provide a proxy for the general constructiveness concept. We provide models for constructiveness trained on C3 using both feature-based and a variety of deep learning approaches and demonstrate that these models capture general rather than topic- or domain-specific…

Using New York Times Picks to Identify Constructive Comments

Varada Kolhatkar, Maite Taboada

Artificial Intelligence · 2017 · cited 26× · DOI ↗ · more like this ·

We examine the extent to which we are able to automatically identify constructive online comments. We build several classifiers using New York Times Picks as positive examples and non-constructive thread comments from the Yahoo News Annotated Comments Corpus as negative examples of constructive online comments. We evaluate these classifiers on a crowdannotated corpus containing 1,121 comments. Our best classifier achieves a top F1 score of 0.84.

Deciding on units of analysis within Centering Theory

Maite Taboada, Loreley Hadic Zabala

Artificial Intelligence · Corpus Linguistics and Linguistic Theory · 2008 · cited 26× · DOI ↗ · more like this ·

Many efforts in corpora annotation start with segmenting discourse into units of analysis. In this paper, we present a method for deciding on segmentation units within Centering Theory (Grosz et al. 1995). We survey the different existing methods to break down discourse into utterances and discuss the results of a comparison study among them. The contribution of our study is that it was carried out with spoken data and in two different languages (English and Spanish). Our comparison suggests that the best unit of analysis for Centering-based annotation is the finite clause. The final result is a set of guidelines for how to segment discourse for Centering analysis, which is also potentially applicable to other analyses.

Negation detection for sentiment analysis: A case study in Spanish

Salud María Jiménez-Zafra, Noa P. Cruz-Díaz, Maite Taboada +1 more

Artificial Intelligence · Natural Language Engineering · 7 Jul 2020 · cited 20× · DOI ↗ · more like this ·

Abstract Accurate negation identification is one of the most important tasks in the context of sentiment analysis. In order to correctly interpret the sentiment value of a particular expression, we need to identify whether it is in the scope of negation. While much of the work on negation detection has focused on English, we have seen recent developments that provide accurate identification of negation in other languages. In this paper, we provide an overview of negation detection systems and describe an implementation of a Spanish system for negation cue detection and scope identification. We apply this system to the sentiment analysis task, confirming also for Spanish that improvements can be gained from accurate negation detection. The paper contributes an implementation of negation detection for sentiment analysis in Spanish and a detailed error analysis. This is the first work in…

The Data Challenge in Misinformation Detection: Source Reputation vs. Content Veracity

Fatemeh Torabi Asr, Maite Taboada

Sociology and Political Science · 2018 · cited 15× · DOI ↗ · more like this ·

Misinformation detection at the level of full news articles is a text classification problem. Reliably labeled data in this domain is rare. Previous work relied on news articles collected from so-called "reputable" and "suspicious" websites and labeled accordingly. We leverage fact-checking websites to collect individuallylabeled news articles with regard to the veracity of their content and use this data to test the cross-domain generalization of a classifier trained on bigger text collections but labeled according to source reputation. Our results suggest that reputation-based classification is not sufficient for predicting the veracity level of the majority of news articles, and that the system performance on different test datasets depends on topic distribution. Therefore collecting well-balanced and carefully-assessed training data is a priority for developing robust misinformation…