arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Mahmoud Azab

15 papers · 2013–2024

2013: 12014: 02015: 12016: 02017: 02018: 52019: 22020: 02021: 12022: 22023: 22024: 1
2013peak 5 in 20182024

Frequent co-authors

Papers

showing 1–15 of 15 RSS

Normalized Contrastive Learning for Text-Video Retrieval

Yookoon Park, Mahmoud Azab, Bo Xiong +4 more

cs.IR · · cited 15× · arXiv ↗ · more like this ·

Cross-modal contrastive learning has led the recent advances in multimodal retrieval with its simplicity and effectiveness. In this work, however, we reveal that cross-modal contrastive learning suffers from incorrect normalization of the sum retrieval probabilities of each text or video instance. Specifically, we show that many test instances are either over- or under-represented during retrieval, significantly hurting the retrieval performance. To address this problem, we propose Normalized Contrastive Learning (NCL) which utilizes the Sinkhorn-Knopp algorithm to compute the instance-wise biases that properly normalize the sum retrieval probabilities of each instance so that every text and video instance is fairly represented during cross-modal retrieval. Empirical study shows that NCL brings consistent and significant gains in text-video retrieval on different model architectures…

Using Word Semantics To Assist English as a Second Language Learners

Mahmoud Azab, Chris Hokamp, Rada Mihalcea

Artificial Intelligence · · cited 15× · DOI ↗ · more like this ·

We introduce an interactive interface that aims to help English as a Second Language (ESL) students overcome language related hindrances while reading a text. The interface allows the user to find supplementary information on selected difficult words. The interface is empowered by our lexical substitution engine that provides context-based synonyms for difficult words. We also provide a practical solution for a real-world usage scenario. We demonstrate using the lexical substitution engine -as a browser extension that can annotate and disambiguate difficult words on any webpage.

Representing Movie Characters in Dialogues

Mahmoud Azab, Noriyuki Kojima, Jia Deng +1 more

Computer Vision and Pattern Recognition · · cited 13× · DOI ↗ · more like this ·

We introduce a new embedding model to represent movie characters and their interactions in a dialogue by encoding in the same representation the language used by these characters as well as information about the other participants in the dialogue. We evaluate the performance of these new character embeddings on two tasks: (1) character relatedness, using a dataset we introduce consisting of a dense character interaction matrix for 4,761 unique character pairs over 22 hours of dialogue from eighteen movies; and (2) character relation classification, for fine-and coarse-grained relations, as well as sentiment relations. Our experiments show that our model significantly outperforms the traditional Word2Vec continuous bag-of-words and skip-gram models, demonstrating the effectiveness of the character embeddings we introduce. We further show how these embeddings can be used in conjunction…

Dudley North visits North London: Learning When to Transliterate to Arabic

Mahmoud Azab, Houda Bouamor, Behrang Mohit +1 more

Artificial Intelligence · Figshare · · cited 12× · DOI ↗ · more like this ·

We report the results of our work on automating the transliteration decision of named entities for English to Arabic machine translation. We construct a classification-based framework to automate this decision, evaluate our classifier both in the limited news and the diverse Wikipedia domains, and achieve promising accuracy. Moreover, we demonstrate a reduction of translation error and an improvement in the performance of an English-to-Arabic machine translation system.

Speaker Naming in Movies

Mahmoud Azab, Mingzhe Wang, Max Smith +3 more

cs.CL · · cited 8× · arXiv ↗ · more like this ·

We propose a new model for speaker naming in movies that leverages visual, textual, and acoustic modalities in an unified optimization framework. To evaluate the performance of our model, we introduce a new dataset consisting of six episodes of the Big Bang Theory TV show and eighteen full movies covering different genres. Our experiments show that our multimodal model significantly outperforms several competitive baselines on the average weighted F-score metric. To demonstrate the effectiveness of our framework, we design an end-to-end memory network model that leverages our speaker naming model and achieves state-of-the-art results on the subtitles task of the MovieQA 2017 Challenge.

An NLP-based Reading Tool for Aiding Non-native English Readers

Mahmoud Azab, Ahmed Salama, Kemal Oflazer +3 more

Artificial Intelligence · Figshare · · cited 8× · DOI ↗ · more like this ·

This paper describes a text-reading tool that makes extensive use of widely available NLP tools and resources to aid non-native English speakers overcome language related hindrances while reading a text. It is a web-based tool, that can be accessed from browsers running on PCs or tablets, and provides the reader with an intelligent e-book functionality

An English Reading Tool as a NLP Showcase

Mahmoud Azab, Ahmed Salama, Kemal Oflazer +3 more

Artificial Intelligence · Figshare · · cited 4× · DOI ↗ · more like this ·

We introduce -SmartReader- an English reading tool for non-native English readers to overcome language related hindrances while reading a text. It makes extensive use of widely-available NLP tools and resources. SmartReader is a web-based application that can be accessed from standard browsers running on PCs or tablets. A user can choose a text document from the system’s library they want to read or can upload a new document of their own and the system will display an interactive version of such text, that provides the reader with an intelligent e-book functionality.

Leisure-Time Exercise improves the Well-being of Arab Undergraduate Students

Kashef Zayed, Ghada Al-Khasawneh, Ehab Omara +6 more

Education · DOAJ (DOAJ: Directory of Open Access Journals) · · cited 1× · OpenAlex ↗ · more like this ·

This study aims to evaluate leisure-time exercise and mental well-being of undergraduate Arab students. To achieve these goals, a self-reported exercise scale and Warwick-Edinburgh Mental Well-being Scale (W-EMWBS) were administered on a sample of 703 undergraduate Arab students registered in universities in four Arab countries (318 males, and 385 females; m age = 19.97 ± 1.86) Descriptive statistics showed that the participants had good levels of mental well-being and that only 26% of them regularly engage in sports activities according to the global recommended health standards, while 39% of them do not practice sports at all. The results revealed that participants who used to engage in different levels of exercise and physical activities during their leisure times have better levels of mental well-being compared to their physically inactive counterparts (p =.000). The study concluded…

CompCap: Improving Multimodal Large Language Models with Composite Captions

Xiaohui Chen, Satya Narayan Shukla, Mahmoud Azab +8 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

How well can Multimodal Large Language Models (MLLMs) understand composite images? Composite images (CIs) are synthetic visuals created by merging multiple visual elements, such as charts, posters, or screenshots, rather than being captured directly by a camera. While CIs are prevalent in real-world applications, recent MLLM developments have primarily focused on interpreting natural images (NIs). Our research reveals that current MLLMs face significant challenges in accurately understanding CIs, often struggling to extract information or perform complex reasoning based on these images. We find that existing training data for CIs are mostly formatted for question-answer tasks (e.g., in datasets like ChartQA and ScienceQA), while high-quality image-caption datasets, critical for robust vision-language alignment, are only available for NIs. To bridge this gap, we introduce Composite…

Analytical study of social networking sites usage and social anxiety among physical education students

Omar Amir, Mohannad Alzughailat, Osama Abdel Fattah +3 more

Sociology and Political Science · International Journal of Public Health Science (IJPHS) · · cited 0× · DOI ↗ · more like this ·

<div class="translate-tooltip-mtz green sm-root translate hidden_translate"><div class="header-wrapper">Social networking sites usages (SNSu) are online platforms used for communication, sharing, and connecting with others. This paper aims to investigate the current status of SNSu among students in physical education college, as well as the differences in SNSu based on gender. Additionally, we aimed to assess the level of social anxiety among the study participants and examine whether it varied by gender and SNSu. We conducted a descriptive survey among 1,109 physical education students (688 females and 421 males) enrolled in public universities. We administered the social anxiety disorder-adult and SNSu questionnaire using Google Forms. We analyzed the data using means, standard deviations, frequencies, percentages, One-way ANOVA, and chi-square tests with a confidence…

Fighting FIRe with FIRE: Assessing the Validity of Text-to-Video Retrieval Benchmarks

Pedro Rodriguez, Mahmoud Azab, Becka Silvert +4 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

Searching troves of videos with textual descriptions is a core multimodal retrieval task. Owing to the lack of a purpose-built dataset for text-to-video retrieval, video captioning datasets have been re-purposed to evaluate models by (1) treating captions as positive matches to their respective videos and (2) assuming all other videos to be negatives. However, this methodology leads to a fundamental flaw during evaluation: since captions are marked as relevant only to their original video, many alternate videos also match the caption, which introduces false-negative caption-video pairs. We show that when these false negatives are corrected, a recent state-of-the-art model gains 25\% recall points -- a difference that threatens the validity of the benchmark itself. To diagnose and mitigate this issue, we annotate and release 683K additional caption-video pairs. Using these, we recompute…

Translate or Transliterate? Modeling the Decision For English to Arabic Machine Translation

Mahmoud Azab

Artificial Intelligence · Qatar Foundation Annual Research Forum Volume 2013 Issue 1 · · cited 0× · DOI ↗ · more like this ·

Translation of named entities (NEs) is important for NLP applications such as Machine Translation (MT) and Cross-lingual Information Retrieval. For MT, named entities are major subset of the out-of-vocabulary terms. Due to their diversity, they cannot always be found in parallel corpora, dictionaries or gazetteers. Thus, state-of-the-art MT systems need to handle NEs in specific ways: (i) direct translation which results in missing many out of vocabulary terms and (ii) blind transliteration of out of vocabulary terms which does not necessarily contribute to translation adequacy and may actually create noisy contexts for the language model and the decoder. For example, in the sentence "Dudley North visits North London", the MT system is expected to transliterate "North" in the former case, and translate "North" in the latter. In this…

A Comparative Analysis of Content-based Geolocation in Blogs and Tweets

Konstantinos Pappas, Mahmoud Azab, Rada Mihalcea

cs.CL · · arXiv ↗ · more like this ·

The geolocation of online information is an essential component in any geospatial application. While most of the previous work on geolocation has focused on Twitter, in this paper we quantify and compare the performance of text-based geolocation methods on social media data drawn from both Blogger and Twitter. We introduce a novel set of location specific features that are both highly informative and easily interpretable, and show that we can achieve error rate reductions of up to 12.5% with respect to the best previously proposed geolocation features. We also show that despite posting longer text, Blogger users are significantly harder to geolocate than Twitter users. Additionally, we investigate the effect of training and testing on different media (cross-media predictions), or combining multiple social media sources (multi-media predictions). Finally, we explore the geolocability of…