arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Alison Cheng

10 papers · 2018–2026

2018: 32019: 02020: 02021: 12022: 12023: 12024: 12025: 22026: 1
2018peak 3 in 20182026

Frequent co-authors

Papers

showing 1–10 of 10 RSS

Advanced Knowledge Tracing: Incorporating Process Data and Curricula Information via an Attention-Based Framework for Accuracy and Interpretability

Yikai Lu, Lingbo Tong, Alison Cheng

Computer Science Applications · OSF Preprints (OSF Preprints) · · cited 3× · DOI ↗ · more like this ·

Knowledge tracing aims to model and predict students' knowledge states during learning activities. Traditional methods like Bayesian Knowledge Tracing (BKT) and logistic regression have limitations in granularity and performance, while deep knowledge tracing (DKT) models often suffer from lacking transparency. This paper proposes a Transformer-based framework that emphasizes both accuracy and interpretability. It captures the relationship between student behaviors and learning outcomes considering the distinction between exam and exercise problems. We participated in the EDMCup 2023 Contest using the proposed framework and achieved first place on the task of predicting students' performance on end-of-unit test problems using clickstream data from previous assignments. Furthermore, the framework provides meaningful insights by analyzing user actions and visualizing attention weight…

Classroom-based Assessment Practices of U.S. College Faculty in Response to Emergency Teaching Circumstances during the COVID-19 Pandemic

Teresa Ober, Xiangyu Xu, Emily W. Kane +2 more

Education · PsyArXiv (OSF Preprints) · · cited 2× · DOI ↗ · more like this ·

We investigated the perceived impact of COVID-19 on the pedagogical practices of college instructors through the lens of situated theories of learning, focusing on assessment. An online survey was administered to 145 faculty teaching at over 80 different U.S. institutions (Mean age=41.29 years, SD age=10.95; %female=69.7) between February-July 2021. Most (88.7%) reported at least one course they taught shifted from an in-person to an online format during Spring 2020. During the pandemic-affected portion of Spring 2020 and even into Spring 2021, instructors appeared more likely to assign untimed, open-book assessments administered outside of class time that were not proctored in person. Instructors provided additional details about how they prioritized content, adjusted their grading, prepared students for exams, navigated the difficulties administering assessments online, and handled…

Clarifying the Effect of Test Speededness

Maxwell Hong, Alison Cheng

Sociology and Political Science · PsyArXiv (OSF Preprints) · · cited 2× · DOI ↗ · more like this ·

In the context of high-stakes tests, test takers who do not have enough time to complete a test rush towards the end and may engage in speeded behavior when tests do not penalize guessing. Using mathematical derivations and simulations, Attali (2005) showed that random guessing responses should attenuate inter-item correlations, and therefore decrease estimates of reliability. Meanwhile, Wise and DeMars (2009) showed that random guessing could in fact inflate reliability estimates using real data. We provide analytical derivations on how speededness could affect correlations between two dichotomous items in multiple ways, depending on the manifestation and prevalence of test speededness. Furthermore, we provide two simulation studies that evaluate the magnitude of impact of test speededness on inter-item correlations and Cronbach's Alpha. We found that the impact of test speededness can…

AI Academy: Building Generative AI Literacy in Higher Ed Instructors

Si Chen, Xiuxiu Tang, Alison Cheng +3 more

cs.HC · · cited 0× · arXiv ↗ · more like this ·

Generative AI is reshaping higher education, yet research has focused largely on students, while instructors remain understudied despite their central role in mediating adoption and modeling responsible use. We present the \textit{AI Academy}, a faculty development program that combined AI exploration with pedagogical reflection and peer learning. Rather than a course evaluated for outcomes, the Academy provided a setting to study how instructors build AI literacies in relation to tools, policies, peer practices, and institutional supports. We studied 25 instructors through pre/post surveys, learning logs, and facilitator interviews. Findings show AI literacy gains alongside new insights. We position instructors as designers of responsible AI practices and contribute a replicable program model, a co-constructed survey instrument, and design insights for professional development that…

Enhancing Mastery-Based Learning an Analytical Approach to Providing Actionable Support

Thomas Joyce, Bo Pei, Alison Cheng +2 more

Safety Research · IGI Global eBooks · · cited 0× · DOI ↗ · more like this ·

Mastery-based learning allows post-secondary instructors to tailor their pedagogical methods to individual student needs. This chapter proposes an analytical framework for providing instructors with actionable learning support in two offerings of the same mathematics course employing mastery-based homework assignments. Our analytical framework includes five components: overall course analysis, performance distribution analysis, feature correlation analysis, predictive model construction and evaluation, and difficult topics analysis. By leveraging descriptive statistics, logistic regression models, and feature selection techniques in combination with practical knowledge about course content, we determined significant predictors of final exam performance and common challenging topics in both courses. Our study demonstrates the benefits of applying learning analytics tools in courses with…

A Family of Sequential Item Response Models for Multiple-Choice, Multiple-Attempt Test Items

Yikai Lu, Jim Fowler, Alison Cheng

Computer Networks and Communications · OSF Preprints (OSF Preprints) · · cited 0× · DOI ↗ · more like this ·

We consider a test which allows students to attempt a multiple-choice question multiple times (i.e., multiple attempts). The most extreme form of multiple attempts is the answer-until-correct (AUC) procedure, which allows subjects to respond to a multiple-choice item until the correct answer option is selected. Previous research has demonstrated that multiple-attempt procedures such as AUC could potentially enhance learning, increase reliability, and discourage guessing. However, for multiple-choice items, guessing is still non-ignorable. Traditional models of sequential item response theory (SIRT) could model multiple-attempt procedures but fail to take guessing into account. The purpose of this study is to propose SIRT models for multiple-choice, multiple-attempt items (SIRT-MM). First, we defined a family of SIRT-MM models by imposing or lifting constraints on certain parameters to…

Adaptation to Remote Teaching During Spring 2020 amidst COVID-19: Perspectives of High School Advanced Placement Statistics Teachers

Teresa Ober, Matt Carter, Meghan R. Coggins +4 more

Statistics and Probability · PsyArXiv (OSF Preprints) · · cited 0× · DOI ↗ · more like this ·

During the Spring 2020 semester, K-12 teachers throughout many parts of the world adapted from face-to-face to online teaching. To better understand these experiences, seven advanced placement (AP) Statistics high school teachers were interviewed following a semi-structured protocol. A collaborative and consensus-driven analysis of transcripts revealed 12 distinct themes. The three most extensively discussed themes appeared to be assessment (19.11%), communication methods (12.23%), and use of online instructional approaches (11.90%). Teachers from schools that did not provide devices to students (i.e., not “one-to-one”) tended to report concerns around digital access more frequently (6.87%) and tended to express a more negative sentiment (Sentiment Mean=–.09) than teachers at schools that provided devices (5.69%; Sentiment Mean=1.35, p<.01). These findings highlight issues facing…

Robust Maximum Marginal Likelihood (RMML) Estimation for Item Response Theory Models

Maxwell Hong, Alison Cheng

Statistics and Probability · PsyArXiv (OSF Preprints) · · cited 0× · DOI ↗ · more like this ·

Self-report data are common in psychological and survey research. Unfortunately, manyof these samples are plagued with careless responses due to unmotivated participants. Thepurpose of this study is to propose and evaluate a robust estimation method in order to detectcareless, or unmotivated, responders while leveraging Item Response Theory (IRT) person fitstatistics. First, we outline a general framework for robust estimation specific for IRT models.Subsequently, we conduct a simulation study covering multiple conditions to evaluate theperformance of the proposed method. Ultimately, we show how robust maximum marginallikelihood (RMML) estimation significantly improves detection rates for careless responders andreduce bias in item parameters across conditions. Furthermore, we apply our method to a realdataset to illustrate the utility of the proposed method. Our findings suggest that…

Evaluation of R Packages with IRT 2PL Model

Maxwell Hong, Alison Cheng, Shuya Zhang

Statistics and Probability · OSF Preprints (OSF Preprints) · · cited 0× · DOI ↗ · more like this ·

This simulation study compares the three most popular R packages: ltm, mirt and TAM, in terms of the accuracy and precision of item parameter estimation and computational efficiency for the IRT 2PL model. Ability parameters are simulated from a normal, uniform and a skewed distribution. Response matrices are simulated and the three packages are used to estimate item parameters. Bias and MSE of item parameter estimates and computing time are compared. Ultimately, the three packages are comparably accurate so recommendations are based mostly on computational efficiency. For normally distributed ability, mirt is preferred while for a uniform or skewed ability distribution TAM is recommended. ltm, though computationally least efficient among the three, has the merit of easy coding.

AI4CAREER: Responsible AI for STEM Career Development at Scale in K-16 Education

Sugana Chawla, Si Chen, Julia Qian +5 more

cs.CY · · arXiv ↗ · more like this ·

Rapid advances in artificial intelligence (AI) are reshaping how students imagine, explore, and prepare for STEM careers across K-16 education. As AI systems increasingly influence feedback, advising, and access to information about opportunities, they are becoming part of the developmental infrastructure that shapes career identity formation and readiness. Yet uncertainty remains about how AI-supported career exploration tools should be designed, governed, and evaluated at scale, particularly across developmental stages and institutional contexts. This half-day workshop convenes researchers, educators, practitioners, and policymakers to examine responsible AI for STEM career development. We focus on four themes: (1) how AI reshapes definitions and assessment of STEM career readiness; (2) appropriate roles and boundaries for AI in career decision-making; (3) developmental alignment of…