arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Sandip Modha

21 papers · 2015–2025

2015: 12016: 02017: 02018: 12019: 32020: 12021: 42022: 22023: 32024: 42025: 2
2015peak 4 in 20212025

Frequent co-authors

Papers

showing 1–21 of 21 RSS

Overview of the HASOC track at FIRE 2019

Thomas Mandl, Sandip Modha, Prasenjit Majumder +4 more

Artificial Intelligence · · cited 274× · DOI ↗ · more like this ·

The identification of Hate Speech in Social Media is of great importance and receives much attention in the text classification community. There is a huge demand for research for languages other than English. The HASOC track intends to stimulate development in Hate Speech for Hindi, German and English. Three datasets were developed from Twitter and Facebook and made available. Binary classification and more fine-grained subclasses were offered in 3 subtasks. For all subtasks, 321 experiments were submitted. The approaches used most often were LSTM networks processing word embedding input. The performance of the best system for identification of Hate Speech for English, Hindi, and German was a Marco-F1 score of 0.78, 0.81 and 0.61, respectively.

Overview of the HASOC track at FIRE 2020: Hate Speech and Offensive Content Identification in Indo-European Languages

Thomas Mandla, Sandip Modha, Gautam Kishore Shahi +5 more

cs.CL · · cited 178× · arXiv ↗ · more like this ·

With the growth of social media, the spread of hate speech is also increasing rapidly. Social media are widely used in many countries. Also Hate Speech is spreading in these countries. This brings a need for multilingual Hate Speech detection algorithms. Much research in this area is dedicated to English at the moment. The HASOC track intends to provide a platform to develop and optimize Hate Speech detection algorithms for Hindi, German and English. The dataset is collected from a Twitter archive and pre-classified by a machine learning system. HASOC has two sub-task for all three languages: task A is a binary classification problem (Hate and Not Offensive) while task B is a fine-grained classification problem for three classes (HATE) Hate speech, OFFENSIVE and PROFANITY. Overall, 252 runs were submitted by 40 teams. The performance of the best classification algorithms for task A are…

Overview of the HASOC Track at FIRE 2020: Hate Speech and Offensive Language Identification in Tamil, Malayalam, Hindi, English and German

Thomas Mandl, Sandip Modha, M. Anand Kumar +1 more

Artificial Intelligence · Forum for Information Retrieval Evaluation · · cited 164× · DOI ↗ · more like this ·

This paper presents the HASOC track and its two parts. HASOC is dedicated to evaluate technology for finding Offensive Language and Hate Speech. HASOC is creating test collections for languages with few resources and English for comparison. The first track within HASOC has continued work from 2019 and provided a testbed of Twitter posts for Hindi, German and English. The second track within HASOC has created test resources for Tamil and Malayalam in native and Latin script. Posts were extracted mainly from Youtube and Twitter. Both tracks have attracted much interest and over 40 research groups have participated as well as described their approaches in papers. In this overview, we present the tasks, the data and the main results.

Overview of the HASOC Subtrack at FIRE 2021: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages and Conversational Hate Speech

Sandip Modha, Thomas Mandl, Gautam Kishore Shahi +4 more

Artificial Intelligence · Forum for Information Retrieval Evaluation · · cited 76× · DOI ↗ · more like this ·

The HASOC track is dedicated to the evaluation of technology for finding Offensive Language and Hate Speech. HASOC is creating a multilingual data corpus mainly for English and under-resourced languages(Hindi and Marathi). This paper presents one HASOC subtrack with two tasks. In 2021, we organized the classification task for English, Hindi, and Marathi. The first task consists of two classification tasks; Subtask 1A consists of a binary and fine-grained classification into offensive and non-offensive tweets. Subtask 1B asks to classify the tweets into Hate, Profane and offensive. Task 2 consists of identifying tweets given additional context in the form of the preceding conversion. During the shared task, 65 teams have submitted 652 runs. This overview paper briefly presents the task descriptions, the data and the results obtained from the participant’s submission.

Filtering Aggression from the Multilingual Social Media Feed

Sandip Modha, Prasenjit Majumder, Thomas Mandl

Artificial Intelligence · International Conference on Computational Linguistics · · cited 45× · OpenAlex ↗ · more like this ·

This paper describes the participation of team DA-LD-Hildesheim from the Information Retrieval Lab(IRLAB) at DA-IICT Gandhinagar, India in collaboration with the University of Hildesheim, Germany and LDRP-ITR, Gandhinagar, India in a shared task on Aggression Identification workshop in COLING 2018. The objective of the shared task is to identify the level of aggression from the User-Generated contents within Social media written in English, Devnagiri Hindi and Romanized Hindi. Aggression levels are categorized into three predefined classes namely: ‘Overtly Aggressive‘, ‘Covertly Aggressive‘ and ‘Non-aggressive‘. The participating teams are required to develop a multi-class classifier which classifies User-generated content into these pre-defined classes. Instead of relying on a bag-of-words model, we have used pre-trained vectors for word embedding. We have performed experiments with…

Overview of the HASOC Subtrack at FIRE 2022: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages

Shrey Satapara, Prasenjit Majumder, Thomas Mandl +6 more

Artificial Intelligence · · cited 38× · DOI ↗ · more like this ·

In recent years, the spread of online offensive content has become of great concern, motivating researchers to develop robust systems capable of identifying such content automatically. To carry out a fair evaluation of these systems, several international shared tasks have been organized, providing the community with essential benchmark data and evaluation methods for various languages. Organized since 2019, the HASOC (Hate Speech and Offensive Content Identification) shared task is one of these initiatives. In its fourth iteration, HASOC 2022 included three tasks for English-Hindi codemix, German and Marathi. Tasks 1 and 2 were on conversational hate speech detection. The idea is to detect supporting hate speech, profanity, or other forms of offensiveness depending on the surrounding context of Twitter posts. Task 1 was offered in Hindi-English codemix and German. Task 2 was provided…

An empirical evaluation of text representation schemes to filter the social media stream

Sandip Modha, Prasenjit Majumder, Thomas Mandl

Artificial Intelligence · Journal of Experimental & Theoretical Artificial Intelligence · · cited 16× · DOI ↗ · more like this ·

Modeling text in a numerical representation is a prime task for any Natural Language Processing downstream task such as text classification. This paper attempts to study the effectiveness of text representation schemes on the text classification task, such as aggressive text detection, a special case of Hate speech from social media. Aggression levels are categorized into three predefined classes, namely: ‘Non-aggressive’ (NAG), ‘Overtly Aggressive’ (OAG), and ‘Covertly Aggressive’ (CAG). Various text representation schemes based on BoW techniques, word embedding, contextual word embedding, sentence embedding on traditional classifiers, and deep neural models are compared on a text classification problem. The weighted F1 score is used as a primary evaluation metric. The results show that text representation using Googles’ universal sentence encoder (USE) performs better than word…

DA-LD-Hildesheim at SemEval-2019 Task 6: Tracking Offensive Content with Deep Learning using Shallow Representation

Sandip Modha, Prasenjit Majumder, Daksh Patel

Artificial Intelligence · · cited 14× · DOI ↗ · more like this ·

This paper presents the participation of team DA-LD-Hildesheim of Information Retrieval and Language Processing lab at DA-IICT, India in Semeval-19 OffenEval track. The aim of this shared task is to identify offensive content at fined-grained level granularity. The task is divided into three sub-tasks. The system is required to check whether social media posts contain any offensive or profane content or not, targeted or untargeted towards any entity and classifying targeted posts into the individual, group or other categories. Social media posts suffer from data sparsity problem, Therefore, the distributed word representation technique is chosen over the Bag-of-Words for the text representation. Since limited labeled data was available for the training, pre-trained word vectors are used and fine-tuned on this classification task. Various deep learning models based on LSTM, Bidirectional…

Overview of the HASOC Subtrack at FIRE 2021: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages

Thomas Mandl, Sandip Modha, Gautam Kishore Shahi +8 more

cs.CL · · cited 8× · arXiv ↗ · more like this ·

The widespread of offensive content online such as hate speech poses a growing societal problem. AI tools are necessary for supporting the moderation process at online platforms. For the evaluation of these identification tools, continuous experimentation with data sets in different languages are necessary. The HASOC track (Hate Speech and Offensive Content Identification) is dedicated to develop benchmark data for this purpose. This paper presents the HASOC subtrack for English, Hindi, and Marathi. The data set was assembled from Twitter. This subtrack has two sub-tasks. Task A is a binary classification problem (Hate and Not Offensive) offered for all three languages. Task B is a fine-grained classification problem for three classes (HATE) Hate speech, OFFENSIVE and PROFANITY offered for English and Hindi. Overall, 652 runs were submitted by 65 teams. The performance of the best…

FIRE 2022 ILSUM Track: Indian Language Summarization

Shrey Satapara, Bhavan Modha, Sandip Modha +1 more

Artificial Intelligence · · cited 6× · DOI ↗ · more like this ·

This abstract provides a short overview of the first edition of the shared task on Indian Language Summarization (ILSUM) organized at the 14th Forum for Information Retrieval Evaluation (FIRE 2022). A more detailed discussion is available in the track overview paper. The objective of this shared task was to create benchmark data for text summarization in Indian languages. This edition included three languages Hindi, Gujarati, and Indian English which is an officially recognized dialect of English mainly used in the Indian subcontinent. The task saw an enthusiastic response, with registrations from over 50 teams. A total of 12 teams submitted test runs across the three languages out of which 10 teams submitted working notes. Standard ROUGE metrics were used as the evaluation metric.

Overview of the HASOC Subtracks at FIRE 2023: Hate Speech and Offensive Content Identification in Assamese, Bengali, Bodo, Gujarati and Sinhala

Tharindu Ranasinghe, Koyel Ghosh, Aditya Shankar Pal +5 more

Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

The evaluation of content moderation systems requires reliable benchmark data. This task becomes particularly formidable for low-resource languages, where obtaining or curating such data poses significant challenges. Addressing this issue, HASOC 2023 organised various shared tasks focused on identifying offensive content in low-resource languages. This paper reports on tasks for hate speech detection in several Indo-Aryan languages—Assamese, Bengali, Gujarati, and Sinhala as well as a Sino-Tibetan language, Bodo, for which limited linguistic resources currently exist. The shared task involved the compilation of multiple datasets. In total, nearly 200 runs were submitted by more than 30 teams, which are presented and analysed in this report.

Fighting Fire with Fire: Adversarial Prompting to Generate a Misinformation Detection Dataset

Shrey Satapara, Parth Mehta, Debasis Ganguly +1 more

cs.CL · · cited 2× · arXiv ↗ · more like this ·

The recent success in language generation capabilities of large language models (LLMs), such as GPT, Bard, Llama etc., can potentially lead to concerns about their possible misuse in inducing mass agitation and communal hatred via generating fake news and spreading misinformation. Traditional means of developing a misinformation ground-truth dataset does not scale well because of the extensive manual effort required to annotate the data. In this paper, we propose an LLM-based approach of creating silver-standard ground-truth datasets for identifying misinformation. Specifically speaking, given a trusted news article, our proposed approach involves prompting LLMs to automatically generate a summarised version of the original article. The prompts in our proposed approach act as a controlling mechanism to generate specific types of factual incorrectness in the generated summaries, e.g.…

Overview of the HASOC Subtracks at FIRE 2023: Detection of Hate Spans and Conversational Hate-Speech

Shrey Satapara, Sarah Masud, Hiren Madhu +5 more

Artificial Intelligence · · cited 2× · DOI ↗ · more like this ·

The proliferation of hateful content on Social Media has drawn a lot of attention lately, which has prompted practitioners to develop systems that can recognize this kind of content automatically. The evaluation requires reliable benchmark data and evaluation techniques. This paper reports on two sub-tracks related to Hate Speech detection. The task ICHCL provided a dataset in code-mixed Hindi, which includes the conversational context of a tweet. In many cases, including the context is necessary for detecting the hatefulness of the tweet. The best submission reached an F1 measure of 0.8. The task HateNorm (Identification of Tokens Contributing to Explicit Hate in English by Span Detection) introduced a span annotated dataset and required systems to find a sequence of words relevant to the hatefulness of a post. The highest scoring system obtained a macro-F1 of 0.581.

Indian Language Summarization at FIRE 2023

Shrey Satapara, Parth Mehta, Sandip Modha +1 more

Artificial Intelligence · ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) · · cited 2× · DOI ↗ · more like this ·

This abstract provides a short overview of the second edition of the shared task on Indian Language Summarization (ILSUM) organized at the 15th Forum for Information Retrieval Evaluation (FIRE 2023). A more detailed discussion of the approaches used by the participating teams is available in the track overview paper. ILSUM 2023 consisted of two sub-tasks. The first sub-task continued the summarization task from last year. Besides extending the datasets for Hindi, Gujarati and Indian English we also introduced Bengali this year. The second sub-task focused on detecting misinformation in machine-generated summaries. While the task saw an enthusiastic response in registrations, with 25 teams requesting the dataset, only 6 teams finally submitted the runs and 4 of them submitted the working notes.

Findings from shared tasks on hate speech detection: Performance patterns for low-resource languages

Koyel Ghosh, Saptarshi Saha, Thomas Mandl +1 more

Artificial Intelligence · Pattern Recognition Letters · · cited 1× · DOI ↗ · more like this ·

In the digital era, social media has emerged as a powerful channel for expressing opinions, but online platforms have also become a breeding ground for hate speech targeting individuals based on color, caste, gender, sexual orientation, and political ideologies. Despite growing interest in automatic hate speech detection, existing research remains predominantly focused on English, underscoring a critical need to extend efforts to under-resourced languages. To bridge this gap, the HASOC (Hate Speech and Offensive Content Identification) shared task has been promoting multilingual hate speech research. In this paper, we present a brief overview of these four shared tasks (Assamese, Bengali, Bodo and English), datasets, participating systems, and their performance across standard evaluation metrics—precision, recall, accuracy, and macro F1 score. In addition, we analyze the inter-system…

An Empirical Evaluation of Text Representation Schemes on Multilingual Social Web to Filter the Textual Aggression

Sandip Modha, Prasenjit Majumder

cs.IR · · cited 1× · arXiv ↗ · more like this ·

This paper attempt to study the effectiveness of text representation schemes on two tasks namely: User Aggression and Fact Detection from the social media contents. In User Aggression detection, The aim is to identify the level of aggression from the contents generated in the Social media and written in the English, Devanagari Hindi and Romanized Hindi. Aggression levels are categorized into three predefined classes namely: `Non-aggressive`, `Overtly Aggressive`, and `Covertly Aggressive`. During the disaster-related incident, Social media like, Twitter is flooded with millions of posts. In such emergency situations, identification of factual posts is important for organizations involved in the relief operation. We anticipated this problem as a combination of classification and Ranking problem. This paper presents a comparison of various text representation scheme based on BoW…

AIDME: A Scalable, Interpretable Framework for AI-Aided Scoping Reviews

Michael Soprano, Sandip Modha, Kevin Roitero +4 more

Sociology and Political Science · Open MIND · · cited 0× · DOI ↗ · more like this ·

Scientific publishing is expanding rapidly across disciplines, making it increasingly difficult for researchers to organize, filter, and synthesize the literature. Systematic reviews address this challenge through structured analysis, but the early stages, particularly the screening phase, can become overwhelming when faced with thousands of records. Scoping reviews are often used as a preparatory step to explore and structure the literature before applying stricter protocols such as the PRISMA 2020 guidelines. In this work, we introduce AIDME (AI-Aided Document Mapping and Evaluation), a general-purpose framework that leverages Large Language Models (LLMs), topic modeling, thematic labeling, and citation network analysis to support the creation of scoping reviews in research areas with high publication volume. AIDME enables scalable filtering, clustering, labeling, and prioritization…

Overview of the PIR Track at FIRE 2024: Evaluation of Personalised Information Retrieval

Pranav Kasela, Marco Braga, Effrosyni Sokli +6 more

Artificial Intelligence · BOA (University of Milano-Bicocca) · · cited 0× · DOI ↗ · more like this ·

This abstract provides a short overview of the first edition of the shared task on Personalised Information Retrieval (PIR) organized at the 16th Forum for Information Retrieval Evaluation (FIRE 2024). A more detailed discussion of the approaches used by the participating teams is available in the track overview paper. PIR 2024 consisted of two sub-tasks. The first sub-task aims to explore the personalisation in cQA based on user profiles, following the standard IR pipeline. The second one, instead, aims to investigate the personalisation in cQA based on user profiles using recent LLMs and prompt engineering. Although the tasks saw an enthusiastic response in registrations, with 10 teams requesting the dataset, only 1 team finally submitted the runs, and 2 of them submitted the working notes.

Report on the 14th Italian Information Retrieval Workshop (IIR 2024)

Eddy Maddalena, Stefano Mizzaro, Kevin Roitero +6 more

Information Systems · ACM SIGIR Forum · · cited 0× · DOI ↗ · more like this ·

IIR 2024, the 14th Italian Information Retrieval Workshop, served as the annual event for the Information Retrieval (IR) and Recommender Systems (RS) communities both in Italy and collaborating with Italian research institutions. This year's event spanned two days and featured studies on various topics within IR, RS, and Large Language Models (LLMs). Key focus areas included enhanced retrieval models, personalized information systems, conversational interfaces and user-centric systems, comparative evaluations and metrics, and practical applications in specific fields. IIR 2024 was jointly organized by the University of Udine and the University of Milano-Bicocca and was held in Udine, Italy. Date : September 5--6, 2024. Website : https://iir2024.uniud.it/.

Retrieving Semantics for Fact-Checking: A Comparative Approach using CQ (Claim to Question) & AQ (Answer to Question)

Nicolò Urbani, Sandip Modha, Gabriella Pasi

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

Fact-checking using evidences is the preferred way to tackle the issue of misinformation in the society.The democratization of information through social media has accelerated the spread of information, allowing misinformation to reach and influence a vast audience.The significant impact of these falsehoods on society and public opinion underscores the need for automated approaches to identify and combat this phenomenon.This paper describes the participation of team IKR3-UNIMIB in AVeriTeC (Automated Verification of Textual Claims) 2024 shared task.We proposed a methods to retrieve evidence in the question and answer format and predict the veracity of a claim.As part of the AVeriTeC shared task, our method combines similarity-based ColBERT re-ranker with traditional keyword search using BM25.Additionally, a recent promising approach, Chain of RAG (CoRAG) is introduced to generate…

A Comparitive Analysis Multilingual Word Tagging in Transliterated Content

Yagnesh Jani, Sandip Modha

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

In this report we consider the problem of labeling the languages of words in mixed-language documents and remove disambiguity. For many languages that use non- Roman based indigenousscripts (e.g., Arabic, Greek and Indic languages) one can often find a large amount of user generated transliterated content on the Web in the Roman script. This content createsa monolingual or multi-lingual space with much script which we refer to as the Transliterated-Script space. This report describes a method to tag the word in multilingual transliterated content and remove disambiguity. The technique is based on the heuristic approach and comparing to different methods results. Therefore, it is a non-trivial task to tag the word and find disambiguity.