arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Yulia Kumar

30 papers · 2004–2026

2004: 12005: 02006: 02007: 02008: 02009: 02010: 02011: 02012: 02013: 02014: 02015: 02016: 02017: 02018: 02019: 02020: 12021: 02022: 52023: 62024: 122025: 42026: 1
2004peak 12 in 20242026

Frequent co-authors

Papers

showing 1–25 of 30 RSS

Bias and Cyberbullying Detection and Data Generation Using Transformer Artificial Intelligence Models and Top Large Language Models

Yulia Kumar, Kuan Huang, Angelo Perez +5 more

Artificial Intelligence · Electronics · · cited 16× · DOI ↗ · more like this ·

Despite significant advancements in Artificial Intelligence (AI) and Large Language Models (LLMs), detecting and mitigating bias remains a critical challenge, particularly on social media platforms like X (formerly Twitter), to address the prevalent cyberbullying on these platforms. This research investigates the effectiveness of leading LLMs in generating synthetic biased and cyberbullying data and evaluates the proficiency of transformer AI models in detecting bias and cyberbullying within both authentic and synthetic contexts. The study involves semantic analysis and feature engineering on a dataset of over 48,000 sentences related to cyberbullying collected from Twitter (before it became X). Utilizing state-of-the-art LLMs and AI tools such as ChatGPT-4, Pi AI, Claude 3 Opus, and Gemini-1.5, synthetic biased, cyberbullying, and neutral data were generated to deepen the understanding…

Chef Dalle: Transforming Cooking with Multi-Model Multimodal AI

Brendan Hannon, Yulia Kumar, J. Jenny Li +1 more

Artificial Intelligence · Computers · · cited 13× · DOI ↗ · more like this ·

In an era where dietary habits significantly impact health, technological interventions can offer personalized and accessible food choices. This paper introduces Chef Dalle, a recipe recommendation system that leverages multi-model and multimodal human-computer interaction (HCI) techniques to provide personalized cooking guidance. The application integrates voice-to-text conversion via Whisper and ingredient image recognition through GPT-Vision. It employs an advanced recipe filtering system that utilizes user-provided ingredients to fetch recipes, which are then evaluated through multi-model AI through integrations of OpenAI, Google Gemini, Claude, and/or Anthropic APIs to deliver highly personalized recommendations. These methods enable users to interact with the system using voice, text, or images, accommodating various dietary restrictions and preferences. Furthermore, the…

A Testing Framework for AI Linguistic Systems (testFAILS)

Yulia Kumar, Patricia Morreale, Peter Sorial +3 more

Artificial Intelligence · Preprints.org · · cited 13× · DOI ↗ · more like this ·

This paper presents an innovative testing framework, testFAILS, designed for the rigorous evaluation of AI Linguistic Systems, with a particular emphasis on various iterations of ChatGPT. Leveraging orthogonal array coverage, this framework provides a robust mechanism for assessing AI systems, addressing the critical question, "How should we evaluate AI?" While the Turing test has traditionally been the benchmark for AI evaluation, we argue that current publicly available chatbots, despite their rapid advancements, have yet to meet this standard. However, the pace of progress suggests that achieving Turing test-level performance may be imminent. In the interim, the need for effective AI evaluation and testing methodologies remains paramount. Our research, which is ongoing, has already validated several versions of ChatGPT, and we are currently conducting comprehensive…

From Vulnerabilities to Improvements- A Deep Dive into Adversarial Testing of AI Models

Brendan Hannon, Yulia Kumar, Peter Sorial +2 more

Artificial Intelligence · · cited 12× · DOI ↗ · more like this ·

The security vulnerabilities inherent in large language models (LLMs), such as OpenAI's ChatGPT-3.5 and ChatGPT -4, Bing Bot, and Google's Bard, are explored in this paper. The focus is on the susceptibility of these models to malicious prompting and the potential for generating unethical content. An investigation is conducted into the responses these models provide when tasked with completing a movie script involving a character disseminating information about murder, weapons, and drugs. The analysis reveals that, despite the presence of filters designed to prevent the generation of unethical or harmful content, these models can be manipulated through malicious prompts to produce inappropriate and even illegal responses. This discovery underscores the urgent need for a comprehensive understanding of these vulnerabilities, as well as the development of effective measures to enhance the…

Evaluation of the Use of Growth Mindset in the CS Classroom

Daehan Kwak, Patricia Morreale, Sarah Hug +5 more

Computer Science Applications · Proceedings of the 53rd ACM Technical Symposium on Computer Science Education · · cited 12× · DOI ↗ · more like this ·

Within computer science education, a growth mindset is encouraged. However, faculty development on the use of growth mindset in the classroom is rare and resources to support the use of a growth mindset are limited. A framework for a computer science growth mindset classroom, which includes faculty development, lesson plans, and vocabulary for use with students, has been developed. The objective is to determine if faculty development in growth mindset and active use of the growth mindset cues in the CS0 and CS1 classroom result in superior academic outcomes. Comparative study results are presented for two semesters of virtual classroom environments: one semester without Growth Mindset, and one semester with Growth Mindset. Female students demonstrated the most growth, as measured by academic grades, in CS0, and maintained that growth in CS1. Males demonstrated growth as well, with both…

Robust Testing of AI Language Model Resiliency with Novel Adversarial Prompts

Brendan Hannon, Yulia Kumar, Dejaun Gayle +2 more

Artificial Intelligence · Electronics · · cited 10× · DOI ↗ · more like this ·

In the rapidly advancing field of Artificial Intelligence (AI), this study presents a critical evaluation of the resilience and cybersecurity efficacy of leading AI models, including ChatGPT-4, Bard, Claude, and Microsoft Copilot. Central to this research are innovative adversarial prompts designed to rigorously test the content moderation capabilities of these AI systems. This study introduces new adversarial tests and the Response Quality Score (RQS), a metric specifically developed to assess the nuances of AI responses. Additionally, the research spotlights FreedomGPT, an AI tool engineered to optimize the alignment between user intent and AI interpretation. The empirical results from this investigation are pivotal for assessing AI models’ current robustness and security. They highlight the necessity for ongoing development and meticulous testing to bolster AI defenses against…

Transformers and LLMs as the New Benchmark in Early Cancer Detection

Yulia Kumar, Kuan Huang, Zachary Gordon +4 more

Computer Vision and Pattern Recognition · ITM Web of Conferences · · cited 8× · DOI ↗ · more like this ·

The study explores the transformative capabilities of Transformers and Large Language Models (LLMs) in the early detection of Acute Lymphoblastic Leukaemia (ALL). The researchers benchmark Vision Transformers with Deformable Attention (DAT) and Hierarchical Vision Transformers (Swin) against established Convolutional Neural Networks (CNNs) like ResNet-50 and VGG-16. The findings reveal that transformer models exhibit remarkable accuracy in identifying ALL from original images, demonstrating efficiency in image analysis without necessitating labour-intensive segmentation. A thorough bias analysis is conducted to ensure the robustness and fairness of the models. The promising performance of the transformer models indicates a trajectory towards surpassing CNNs in cancer detection, setting new standards for accuracy. In addition, the study explores the capabilities of LLMs in…

An Assure AI Bot (AAAI bot)

N. Tellez, J. Serra, U. Ebreso +4 more

Artificial Intelligence · 2022 International Symposium on Networks, Computers and Communications (ISNCC) · · cited 7× · DOI ↗ · more like this ·

Artificial Intelligence (AI) bots receive much attention and usage in industry manufacturing and even store cashier applications. Our research is to train AI bots to be software engineering assistants, specifically to detect biases and errors inside AI software applications. An example application is an AI machine learning system that sorts and classifies people according to various attributes, such as the algorithms involved in criminal sentencing, hiring, and admission practices. Biases, unfair decisions, and flaws in terms of the diversity, equity, and inclusion (DEI), in such systems could have severe consequences. As a Hispanic-Serving Institution, we are concerned about underrepresented groups and devoted an extended amount of our time to implementing “An Assure AI” (AAAI) Bot to detect biases and errors in AI applications. Our state-of-the-art AI Bot was developed based on our…

Preliminary Results from Integrating Chatbots and Low-Code AI in Computer Science Coursework

Yulia Kumar, Anjana Manikandan, J. Jenny Li +1 more

Artificial Intelligence · · cited 6× · DOI ↗ · more like this ·

The study investigates the application of chatbots and low-code AI tools in advancing Computer Science (CS) education, concentrating on the CS AI Explorations course and the AI for ALL extracurricular programs. It addresses two main research questions: firstly, the impact of chatbots on student growth and engagement in undergraduate research, and secondly, the potential of low-code AI platforms to bridge the gap between theoretical and practical AI skills. Conducted during the 2022–2024 academic years, this research combines case studies and empirical data to evaluate the effectiveness of integrating these technologies into conventional teaching methodologies. The preliminary findings suggest a significant transformative potential for chatbots and low-code AI, offering valuable insights for future educational strategies and developing more dynamic, interactive learning environments.…

Robust Testing of AI Language Models Resilience with Novel Adversarial Prompts

Brendan Hannon, Yulia Kumar, Dejaun Gayle +2 more

Artificial Intelligence · Preprints.org · · cited 6× · DOI ↗ · more like this ·

In the rapidly advancing field of Artificial Intelligence (AI), this study presents a critical evaluation of the resilience and cybersecurity efficacy of leading AI models, including ChatGPT-4, Bard, Claude, and Microsoft Copilot. Central to this research is the use of innovative adversarial prompts designed to rigorously test the content moderation capabilities of these AI systems. The study introduces new types of adversarial tests and the Response Quality Score (RQS), a metric specifically developed to assess the nuances of AI responses. Additionally, the research spotlights FreedomGPT, an AI tool engineered to optimize the alignment between user intent and AI interpretation. The empirical results from this investigation are pivotal for assessing the current robustness and security of AI models. They highlight the necessity for ongoing development and meticulous testing to bolster AI…

Preliminary Results of Applying Transformers to Geoscience and Earth Science Data

Julio Delgado, U. Ebreso, Yulia Kumar +2 more

Artificial Intelligence · · cited 6× · DOI ↗ · more like this ·

Transformers with neural networks (NN) have become a dominant technology in AI/ML to achieve better accuracy in classification and prediction. We experimentally compare transformer-based NN and convolutional NN using various applications such as pollen detection and weather ITCZ prediction. Using machine learning in geoscience, earth sciences, and other natural sciences is not entirely new, but applying transformers to data from these environments creates many new opportunities. We apply Facebook's detection transformer (DETR) neural network, developed in 2020, to pollen and weather data to detect forty-four types of pollen and classify earth snapshots into two categories: having vs. not having the phenomena of double Intertropical Convergence Zones (ITCZs) in them. As we conduct our trials, we observe and document how the model performs on both datasets, detect the biases present in…

Bias and Cyberbullying Detection and Data Generation with Transformer AI Models and top LLMs

Yulia Kumar, Kuan Huang, Angelo Perez +5 more

Artificial Intelligence · Preprints.org · · cited 5× · DOI ↗ · more like this ·

Despite significant advancements in Artificial Intelligence (AI) and Large Language Models (LLMs), detecting and mitigating bias remains a critical challenge, particularly within social media platforms like X (formerly Twitter) and in addressing cyberbullying present on them. This research investigates the effectiveness of leading LLMs in generating synthetic biased and cyberbullying data and evaluates the proficiency of Transformer AI models in detecting bias and cyberbullying within both authentic and synthetic contexts. The study involves semantic analysis and feature engineering on a dataset of over 48,000 sentences related to cyberbullying collected from Twitter (before it became X). Leveraging state-of-the-art LLMs such as ChatGPT-4o, Pi AI, Claude 3 Opus, and Gemini-1.5, synthetic biased, cyberbullying, and neutral data were generated to deepen the understanding of bias in…

Applying Swin Architecture to diverse Sign Language Datasets

Yulia Kumar, Kuan Huang, Chin-Chien Lin +4 more

Human-Computer Interaction · Preprints.org · · cited 5× · DOI ↗ · more like this ·

In the era of Artificial Intelligence (AI), comprehending and responding to non-verbal communication is increasingly vital. This research extends AI's reach in bridging communication gaps, notably benefiting American Sign Language (ASL) and Taiwan Sign Language (TSL) communities. It focuses on employing various AI models, especially the Hierarchical Vision Transformer with Shifted Windows (Swin), for recognizing diverse sign language datasets. The study assesses Swin architecture's adaptability to different sign languages, aiming to create a universal platform for Unvoiced communities. Utilizing deep learning and transformer technologies, hybrid application prototypes have been developed for ASL-to-English translations and vice versa, with plans to expand this to multiple sign languages. The Swin models, trained on varied dataset sizes, show considerable accuracy…

ChatGPT as a Game-Changer for Embedding Emojis in Faculty Feedback

Ethan Kupershtein, Yulia Kumar, Anjana Manikandan +2 more

Education · · cited 5× · DOI ↗ · more like this ·

This study explores the potential of integrating emojis, and digital pictographs, into faculty feedback to augment student learning outcomes. This additional layer of expressiveness, encouragement, and involvement adds a personal touch to the often distant and virtual student-educator communications, fostering motivation. The study focuses on the impact of emojis on the learning process within the scrutinized Computer Science (CS) Department. Capitalizing on the capabilities of OpenAI's Large Language Model (LLM) ChatGPT-4, its Application Programming Interface (API), and associated tools and third-party plugins, a system that translates text into corresponding emojis and vice versa has been developed. The proposed application offers direct benefits to educators by simplifying the provision of detailed and extensive feedback to students. The primary research question is: Can the…

Validation of AI models for ITCZ Detection from Climate Data

J. Serra, Ruth Gomez Quezada, Stacy Fortes +6 more

Artificial Intelligence · 2022 5th International Conference on Data Science and Information Technology (DSIT) · · cited 5× · DOI ↗ · more like this ·

The Climate Change topic itself and associated life adjustments became a top global problem of the XXI century. It requires immediate attention and long-term solutions. Physical tracing of weather changes, performed without Artificial Intelligence (AI), is not capable of detection in a timely manner and correctly classifying dangerous situations, which is crucial for making rapid decisions and taking immediate actions on the ground. AI and Machine Learning (ML) systems are currently dominating solutions in Computer Science research fields and the issues of their testing and validation remain a critical open problem due to their uncertain outcomes. We use test automation to validate and assure the quality of various AI systems for one kind of weather prediction. The subject of our study is Inter-Tropical Convergence Zones (ITCZs). ITCZs play an important role in the global circulation…

Adversarial Testing of LLMs Across Multiple Languages

Yulia Kumar, Christopher Paredes, Gang Yang +2 more

Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

This study builds on prior research in the field of jailbreaking, focusing on the vulnerabilities of state-of-the-art Large Language Models (LLMs) and their associated chatbots. The primary objective is to evaluate these vulnerabilities through a multilingual lens, extending the scope of previous monolingual studies. The main chatbots under examination include ChatGPT (both legacy ChatGPT -3.5 and the latest ChatGPT -40 model), Gemini, Microsoft Copilot, and Perplexity. Researchers conducted multilingual adversarial attacks, facilitating cross-language and cross-model comparisons, and explored different modalities, such as text versus speech inputs. The findings reveal significant weaknesses in these major models, particularly in their susceptibility to adversarial attacks conducted in languages such as Spanish, Russian, and Traditional Chinese. Given the global proliferation and…

Chef Dalle: Transforming Cooking with Multimodal AI

Brendan Hannon, Yulia Kumar, J. Jenny Li +1 more

Artificial Intelligence · Preprints.org · · cited 4× · DOI ↗ · more like this ·

In an era where dietary habits significantly impact health, technological interventions can offer personalized and accessible food choices. This paper introduces Chef Dalle, a recipe recommen-dation system that leverages multimodal human-computer interaction (HCI) techniques to pro-vide personalized cooking guidance. The application integrates voice-to-text conversion via Whisper, ingredient image recognition through GPT-Vision, and employs TF-IDF vectorization alongside cosine similarity for personalized recipe recommendations. These methods enable users to interact with the system using voice, text, or images, accommodating various dietary re-strictions and preferences. Furthermore, the utilization of DALL-E 3 for generating recipe images enhances user engagement. User feedback mechanisms allow for the refinement of future rec-ommendations, demonstrating the system's…

Love the Way You Lie: Unmasking the Deceptions of LLMs

Yulia Kumar, Zachary Gordon, Patricia Morreale +2 more

Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

Within the dynamic realm of Artificial Intelligence (AI), models like ChatGPT, Bard, and Bing are renowned for replicating human language. However, their emergence sparks debate over biases and trustworthiness. This research delves into the predominant inaccuracies in chatbots that tend to mislead novices and explores the possibility of establishing an AI Reliability (AIR) framework to fortify trust in these entities. Errors are categorized as factual inaccuracies, misinformation, fabricated data, and deviations from topics, among others. The in-progress AIR Framework offers a meticulous approach to assess chatbot accuracy, leveraging the experiences of nearly 100 CS/IT students with mainly ChatGPT. Recognizing the limitations and hallucinations of these models is essential as they become integral to our lives, underscoring the imperative for responsible and reliable AI.

Embedding Equitable Design in the CS Computing Curricula

Pankati Patel, Patricia Morreale, Yulia Kumar +4 more

Computer Science Applications · · cited 4× · DOI ↗ · more like this ·

Computer science (CS) students' curricula is heavily focused on technical skills, and CS ethics, usability, equity, and people/society considerations are not well-integrated into the CS curriculum. If these topics are introduced, they are disconnected from the core courses. As a result, students do not learn to incorporate inclusive practices into their software designs. Thus, students create software through the perspective of a computer scientist - when the important perspective is that of the intended users. As a result, students entering the workforce are inclined to design software that is non-inclusive. We propose the integration of inclusive design in the undergraduate curriculum will result in students creating inclusive software. This research, based on the foundations of inclusive design methods, investigates a new approach to teaching CS. Inclusive software design is embedded…

A Comprehensive Survey of MapReduce Models for Processing Big Data

Hemn Barzan Abdalla, Yulia Kumar, Yue Zhao +1 more

Computer Networks and Communications · Big Data and Cognitive Computing · · cited 3× · DOI ↗ · more like this ·

With the rapid increase in the amount of big data, traditional software tools are facing complexity in tackling big data, which is a huge concern in the research industry. In addition, the management and processing of big data have become more difficult, thus increasing security threats. Various fields encountered issues in fully making use of these large-scale data with supported decision-making. Data mining methods have been tremendously improved to identify patterns for sorting a larger set of data. MapReduce models provide greater advantages for in-depth data evaluation and can be compatible with various applications. This survey analyses the various map-reducing models utilized for big data processing, the techniques harnessed in the reviewed literature, and the challenges. Furthermore, this survey reviews the major advancements of diverse types of map-reduce models, namely Hadoop…

Optimizing Large Language Models for Auto-Generation of Programming Quizzes

Yulia Kumar, Anjana Manikandan, J. Jenny Li +1 more

Computer Networks and Communications · · cited 3× · DOI ↗ · more like this ·

This study analyzes the use of Large Language Models (LLMs) like ChatGPT in creating quizzes for Java programming courses, specifically Object-Oriented Programming (CS1) and Data Structures (CS2). It aims to evaluate the accuracy of LLM-generated assessments, understand the benefits and drawbacks of using LLMs in CS education from educators' viewpoints, and identify effective prompt engineering strategies to enhance the quality of educational materials. The research compares quizzes made by LLMs against human-created content to assess their consistency with Java programming principles, alignment with CS1 and CS2 learning goals, and their impact on student engagement and comprehension, providing insights into LLMs' effectiveness in academic assessment creation for computer science education.

Evaluating the Effectiveness of Equitable K-12 Professional Learning Access in Computer Science

Jean Chu, Yulia Kumar, Daehan Kwak +3 more

Computer Science Applications · · cited 3× · DOI ↗ · more like this ·

Computer science professional learning, widely available to 9-12 educators, has increased the number of AP CS courses offered in the U.S. and the number of students taking those courses. However, access to all CS classes remains unequal, dependent on the state, district, counselors, and teachers providing a pathway for K-12 students into the CS classrooms. A15-month project was undertaken to provide professional learning for K-12 educators to provide broader access for more students. The goal was to increase the knowledge and preparation of teachers in a wide range of school districts, as defined by socioeconomic status (SES), to meet state CS standards. Objectives included increasing the number of educators to teach CS, expanding equitable access to high-quality CS education, and providing resources to school districts to support CS education across the K-12 curriculum. Research…

ChatGPT Translation of Program Code for Image Sketch Abstraction

Yulia Kumar, Zachary Gordon, Oluwatunmise Alabi +4 more

Computer Vision and Pattern Recognition · Preprints.org · · cited 2× · DOI ↗ · more like this ·

The migration from MATLAB to Python (M-to-PY) has gained significant traction in recent computational research. While MATLAB has long served as a linchpin in myriad scientific endeavors, there's an emerging trend to rejuvenate these projects using Python's extensive AI tools and libraries. This study presents a semi-automated process for M-to-PY conversion, using a detailed case study of an image skeletonization project comprising fifteen MATLAB files and a 1404-image dataset. Skeletonization is foundational for ongoing 3D motion detection research using AI transformers, predominantly developed in Python. The utilization of ChatGPT-4, acting as an AI co-programmer, is pivotal in this conversion. By leveraging the public OpenAI API, we developed an M-to-PY converter prototype, evaluated its efficacy using test cases from the Bard bot, and subsequently employed the converted code in an AI…

Investigating Deep Learning for Predicting Multi-linguistic Interactions with a Chatterbot

Robert Kulesza, Yulia Kumar, Roberto Ruíz +4 more

Artificial Intelligence · · cited 2× · DOI ↗ · more like this ·

Deep Learning (DL) becomes a mainstream technique for Artificial Intelligence (AI) machine learning because of its success in performing many tasks, such as image recognition, speech interpretation, language prediction and translation. We are investigating the underlying principles of DL Neural Networks (NN) to design optimal DL NN for predicting human multi-linguistic conversations with a chatterbot. This research attempts to tackle the well-known open problem of finding optimal NN designs for data of various characteristics. We are in particular focusing on Recurrent Neural Networks (RNN) models with time progression, which takes into consideration the results from the previous steps plus the current input to predict the next step, i.e. it `remembers' what it has previously learnt. Through the experiments of tuning an RNN to achieve an optimal performance in terms of accuracy and…

Assessing the Impact of Professional Development on K-12 CS Education: A One-Year Follow-Up Survey Analysis

Yulia Kumar, Anjana Manikandan, Ethan Kupershtein +2 more

Computer Networks and Communications · · cited 1× · DOI ↗ · more like this ·

The paper presents the findings from a one-year follow-up survey analyzing the impact of a targeted professional development (PD) program conducted by a state Computer Science (CS) hub on K-12 CS education. It scrutinizes the long-term effects of the PD initiative on educators' pedagogical strategies and students' readiness for college-level CS coursework. The study focuses on integrating the introductory course CS0, which shapes educational strategies and outcomes. Through the lens of three research questions, the analysis delves into the enhancements in educators' instructional approaches following PD, the ongoing influence of PD on the integration of interdisciplinary methods within CS curricula, and the correlation between PD and student engagement and achievement in CS disciplines. The survey of thirty educators reveals a sustained implementation of acquired pedagogical practices…