arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Joshua Quick

19 papers · 2000–2024

2000: 12001: 02002: 02003: 02004: 02005: 02006: 02007: 02008: 02009: 02010: 02011: 02012: 02013: 12014: 02015: 22016: 02017: 02018: 02019: 12020: 22021: 22022: 42023: 52024: 1
2000peak 5 in 20232024

Frequent co-authors

Papers

showing 1–19 of 19 RSS

A Pandemic of Busywork: Increased Online Coursework Following the Transition to Remote Instruction is Associated with Reduced Academic Achievement

Benjamin Motz, Joshua Quick, Julie Wernert +1 more

Computer Science Applications · Online Learning · · cited 54× · DOI ↗ · more like this ·

Under normal circumstances, when students invest more effort in their schoolwork, they generally show evidence of improved academic achievement. But when universities abruptly transitioned to remote instruction in Spring 2020, instructors assigned rapidly-prepared online learning activities, disrupting the normal relationship between effort and outcomes. In this study, we examine this relationship using data observed from a large-scale survey of undergraduate students, from logs of student activity in the online learning management system, and from students’ estimated cumulative performance in their courses (n = 4,636). We find that there was a general increase in the number of assignments that students were expected to complete following the transition to remote instruction, and that students who spent more time and reported more effort carrying out this coursework generally had lower…

The validity and utility of activity logs as a measure of student engagement

Benjamin Motz, Joshua Quick, Noah L. Schroeder +2 more

Computer Science Applications · · cited 41× · DOI ↗ · more like this ·

Learning management system (LMS) web logs provide granular, near-real-time records of student behavior as learners interact with online course materials in digital learning environments. However, it remains unclear whether LMS activity indeed reflects behavioral properties of student engagement, and it also remains unclear how to deal with variability in LMS usage across a diversity of courses. In this study, we evaluate whether instructors' subjective ratings of their students' engagement are related to features of LMS activity for 9,021 students enrolled in 473 for-credit courses. We find that estimators derived from LMS web logs are closely related to instructor ratings of engagement, however, we also observe that there is not a single generic relationship between activity and engagement, and what constitutes the behavioral components of "engagement" will be contingent on course…

LAK of Direction

Benjamin Motz, Yoav Bergner, Christopher Brooks +6 more

Computer Science Applications · Journal of Learning Analytics · · cited 39× · DOI ↗ · more like this ·

Learning analytics defines itself with a focus on data from learners and learning environments, with corresponding goals of understanding and optimizing student learning. In this regard, learning analytics research, ideally, should be characterized by studies that make use of data from learners engaged in education systems, should measure student learning, and should make efforts to intervene and improve these learning environments. However, a common concern among members of the learning analytics research community is that these standards are not being met. In two analysis waves, we review a large and comprehensive sample of research articles from the proceedings of the three most recent Learning Analytics and Knowledge conferences, the premier conference venue for learning analytics research, and from articles published during the same time in the Journal of Learning Analytics (over…

Automated Educative Nudges to Reduce Missed Assignments in College

Benjamin Motz, Matthew G. Mallon, Joshua Quick

Education · IEEE Transactions on Learning Technologies · · cited 37× · DOI ↗ · more like this ·

As institutions of higher education increasingly utilize online learning management systems, college students are asked to submit more assignments online. Under this regime, when most assignments are posted and submitted online, it is possible to know if a student is missing a submission for an imminent deadline, and to intervene proactively to reduce missed assignments and improve student outcomes. Toward this goal, we designed and evaluated a scalable targeted intervention: a mobile app that would deploy push notifications when students were missing submissions for assignments with imminent deadlines. Results from two experimental pilots demonstrate that this intervention system significantly decreased missed assignments compared with control notifications about instructor announcements to the class (in Experiment 1), and improved assignment adherence and course grades compared with…

An Introduction to Fairness, Absence of Bias, and Equity in Learning Analytics

Suraj Uttamchandani, Joshua Quick

Computer Science Applications · Solar eBooks · · cited 22× · DOI ↗ · more like this ·

In this chapter, we examine the ways educational justice has been and may be taken up in learning analytics research. To do so, we first outline how we see equity as playing a necessary role in the future development of the learning analytics community. Next, we review how equity has been explored in this area heretofore, focusing on notions of algorithmic fairness and absence of bias. Then, we turn to newer political approaches to the study of learning that are emerging in the learning sciences. We summarize trends in this research’s conceptualizations of equity and the political dimensions of learning. Finally, we connect these related ways of thinking about social justice with respect to learning analytics, and examine the tensions and possibilities at their intersection. We close with some recommendations for the learning analytics field to ensure that it contributes to positive…

What college students say, and what they do

Joshua Quick, Benjamin Motz, Jamie Israel +1 more

Computer Science Applications · OSF Preprints (OSF Preprints) · · cited 21× · DOI ↗ · more like this ·

A central concern in learning analytics specifically and educational research more generally is the alignment of robust, coherent measures to well-developed conceptual and theoretical frameworks. Capturing and representing processes of learning remains an ongoing challenge in all areas of educational inquiry and presents substantive considerations on the nature of learning, knowledge, and assessment & measurement that have been continuously refined in various areas of education and pedagogical practice. Learning analytics as a still developing method of inquiry has yet to substantively navigate the alignment of measurement, capture, and representation of learning to theoretical frameworks despite being used to identify various practical concerns such as at risk students. This study seeks to address these concerns by comparing behavioral measurements from learning management systems to…

When online courses became the student union: Technologies for peer interaction and their association with improved outcomes during COVID-19.

Benjamin Motz, Joshua Quick, Anastasia S. Morrone

Education · Technology Mind and Behavior · · cited 10× · DOI ↗ · more like this ·

While a variety of learning technologies are presently available to facilitate student-to-student peer interactions and collaborative learning online, recent research suggests that students’ opportunities to interact with their peers were significantly reduced following the abrupt transition to remote instruction due to coronavirus disease. This raises concerns because peer interaction is known to be a key ingredient in effective online learning environments, and during remote instruction, the primary connection between a student and their identity as a member of a college community would have been online courses. In this study, we investigate whether and how collaborative technologies supported peer interaction, and students’ learning, during remote instruction. Specifically, we used results from a multicampus survey of students and instructors, as well as data from our online…

A LAK of Direction: Misalignment Between the Goals of Learning Analytics and its Research Scholarship

Benjamin Motz, Joshua Quick, Chris Brooks +5 more

Computer Science Applications · EdArXiv (OSF Preprints) · · cited 7× · DOI ↗ · more like this ·

Learning analytics defines itself with a focus on learner data, with corresponding goals of understanding and optimizing student learning. In this regard, learning analytics research, ideally, should be characterized by studies that make use of data from learners engaged in education systems, should measure student learning, and should make efforts to intervene and improve these learning environments. However, a common concern among members of the learning analytics research community is that these standards are not being met. In the current study, we review a large and comprehensive sample of research articles from the proceedings of two recent Learning Analytics and Knowledge conferences, the premier conference venue for learning analytics research. We find that 36.3% of articles do not analyze data from learners in a formal education system, 70.5% do not include any measure of…

Going Remote: Actionable Insights from Indiana University’s Transition to Remote Instruction due to COVID-19

Benjamin Motz, Harmony Jankowski, Winona Snapp‐Childs +1 more

Education · IUScholarWorks (Indiana University) · · cited 7× · DOI ↗ · more like this ·

On March 10, 2020, Indiana University (IU) announced the suspension of in-person instruction due to COVID-19. At that time, the eLearning Research and Practice Lab, a laboratory within the Indiana University Pervasive Technology Institute, began preparing to conduct a full-census survey of all undergraduates and instructors across all IU campuses. The study’s purpose was to examine student and instructor experiences of the transition to remote instruction, and to identify actionable insights that may improve instruction during future semesters. This report was prepared and distributed internally at IU, in order to provide rapid evidence-based recommendations for instructional practice.

Formative and summative analyses of disciplinary engagement and learning in a big open online course

Daniel T. Hickey, Joshua Quick, Xinyi Shen

Education · IUScholarWorks (Indiana University) · · cited 7× · DOI ↗ · more like this ·

Situative theories of knowing and participatory approaches to learning and assessment were used to offer a big open online course on Educational Assessment using Google CourseBuilder in 2013. The course was started by 160 students and completed by 60, with relatively extensive instructor interaction with individual learners. This yielded much higher levels of engagement and learning than are typical of open or conventional online courses. The course was further refined and offered a second time in 2014, where it was started by 76 students and completed by 22, with a much lower level of support. Comparable levels of engagement and learning were obtained, suggesting that this participatory approach to learning and assessment can indeed be managed with more typical instructor support. Nonetheless, additional automation and streamlining is called for if the model is to eventually be used in…

Gradescope in Large Lecture Classrooms: A Case Study at Indiana University

Carrie A. Hansel, Anne Ottenbreit‐Leftwich, Joshua Quick +2 more

Education · Journal of Teaching and Learning with Technology · · cited 5× · DOI ↗ · more like this ·

This qualitative, multi-case study explores how instructors at one higher education institution used an emerging technology, Gradescope, in their large classes to support the assessment of student learning. The study examines the practices of two instructors who taught large lecture classes with more than 100 students and used Gradescope to assist with the assessment of student learning. Results indicate that using Gradescope helped the instructors overcome specific challenges associated with large lecture courses, such as grading a large volume of assignments, , providing timely feedback, and maintaining grading consistency across large numbers of students and graders. Course DFW rates decreased and average course grades increased during the semester where the instructors used Gradescope. Instructors reported increased grading efficiency and improved student satisfaction. However, the…

Lost in Translation: Determining the Generalizability of Temporal Models across Course Contexts 

Joshua Quick, Benjamin Motz, Anastasia S. Morrone

Computer Science Applications · · cited 4× · DOI ↗ · more like this ·

A common activity in learning analytics research is to demonstrate a new analytical technique by applying it to data from a single course. We explore whether the value of an analytical approach might generalize across course contexts. Accordingly, we conduct a conceptual replication of a well-cited temporal modeling study using self-regulated learning (SRL) taxonomies. We attempt to conceptually replicate this previous work through the analysis of 411 students across 19 courses’ trace event data. Using established SRL categorizations, learner actions are sequenced to identify regular clusters of interaction through hierarchical clustering methods. These clusters are then compared with the entire data corpus and each other through the development of first-order Markov models to develop process maps. Our findings indicate that, although some general patterns of SRL can generalize, these…

Digital Badges and Ethics: The Uses of Individual Learning Data in Social Contexts.

James E. Willis, Joshua Quick, Daniel T. Hickey

Computer Science Applications · IUScholarWorks (Indiana University) · · cited 4× · OpenAlex ↗ · more like this ·

Empirical evidence contained in open digital badges has the capability to change educational curricula, assessments, and priorities. Because badge data in educational, social media, and workforce contexts is publicly available, questions of privacy and ethics should be scrutinized. Due to change driven by digital transparency, ethical questions at the intersection of learning analytics and the data contained in badges poses three distinct, yet related questions: within learning analytics systems, can the use of educational data in digital badges be used in a predictive manner to create a deterministic future for individual learners? Can badge data that is freely and openly accessible in social media be used against individuals if it exposes intellectual weaknesses? And, can the student data in badges be isolated to exploit particular skills for nefarious reasons, i.e. surveillance or…

A Baseline Measure of Open Research Practices in Learning Analytics

Benjamin Motz, Chris Brooks, Joshua Quick +5 more

Computer Science Applications · EdArXiv (OSF Preprints) · · cited 2× · DOI ↗ · more like this ·

Considering that the central theme of learning analytics is data, there are uniquely strong benefits to sharing data, materials, and analysis code in this field. These open research practices facilitate transparency in research, and transparency can improve the quality of learning analytics methods, improve the reliability of findings, and improve the scope of impact of new developments. The Society for Learning Analytics research recently adopted a motion to advance on these goals. To inform this effort, we conducted a systematic review of articles published in the past two proceedings of the Learning Analytics and Knowledge conference, measuring the frequency of openly-shared data, materials, and analysis code. We find that 7.5% of articles made their data available, 13.7% made materials available, and 5.5% made analysis code available. We discuss these findings in the context of…

Proof of Concept and Design Principles for Culturally-Sustaining Educational Assessment

Daniel Hickey, Charmian Lam, Qianxu Morgan Luo +1 more

Education · Proceedings. · · cited 0× · DOI ↗ · more like this ·

Despite broad scholarly agreement supporting culturally-responsive education, uptake remains sporadic because of multiple forms of resistance.We contend that educational assessment is a crucial locus of resistance and inclusivity.We introduce an approach to formative and summative assessment that responds to multiple forms of resistance and is organized around four levels of increasingly formal assessment.We present new assessment design principles based on an initial proof of concept from a graduate course on assessment.

The Effect of Cross-age Tutoring on Reading Attitude

Joshua Quick

Artificial Intelligence · The Keep (Eastern Illinois University) · · cited 0× · OpenAlex ↗ · more like this ·

TO: Graduate Degree Candidates (who have written formal theses) SUBJECT: Permission to Reproduce Theses The University Library is receiving a number of request from other institutions asking permission to reproduce dissertations for inclusion in their library holdings. Although no copyright laws are involved, we feel that professional courtesy demands that permission be obtained from the author before we allow these to be copied. PLEASE SIGN ONE OF THE FOLLOWING STATEMENTS: Booth Library of Eastern Illinois University has my permission to lend my thesis to a reputable college or university for the purpose of copying it for inclusion in that institution's library or research holdings. 7114/2oco Date I respectfully request Booth Library of Eastern Illinois University NOT allow my thesis to be reproduced because:

Subtle interactions for distress regulation: efficiency of a haptic wearable according to personality

Adolphe J. Bequet, Antonio R. Hidalgo-Munoz, Fabien Moreau +2 more

cs.HC · · arXiv ↗ · more like this ·

The incorporation of empathic systems in everyday life draws a lot of attention from society. Specifically, the use of wearables to perform stress regulation is a growing field of research. Among techniques explored, the haptic emulation of lowered physiological signals has been suggested to be promising. However, some discrepancies remain in empirical research focusing on such biofeedback (BF) regarding their efficacy, and the mechanisms underlying the effects of these wearables remains unclear. Moreover, the influence of individual traits on the efficiency of BF has been marginally studied, while it has been shown that personality could impact both stress and its regulation. The aim of this study is to investigate the outcome of interactions with these technologies from a psycho-physiological standpoint, but also to explore whether personality may influence its efficiency when other…

CONCOCT: Clustering cONtigs on COverage and ComposiTion

Johannes Alneberg, Brynjar Smari Bjarnason, Ino de Bruijn +6 more

q-bio.GN · · arXiv ↗ · more like this ·

Metagenomics enables the reconstruction of microbial genomes in complex microbial communities without the need for culturing. Since assembly typically results in fragmented genomes the grouping of genome fragments (contigs) belonging to the same genome, a process referred to as binning, remains a major informatics challenge. Here we present CONCOCT, a computer program that combines three types of information - sequence composition, coverage across multiple sample, and read-pair linkage - to automatically bin contigs into genomes. We demonstrate high recall and precision rates of the program on artificial as well as real human gut metagenome datasets.