arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Natalie Simper

10 papers · 2015–2026

2015: 12016: 02017: 02018: 32019: 12020: 12021: 22022: 02023: 12024: 02025: 02026: 1
2015peak 3 in 20182026

Frequent co-authors

Papers

showing 1–10 of 10 RSS

Assessing teamwork in undergraduate education: a measurement tool to evaluate individual teamwork skills

Emily Britton, Natalie Simper, Andrew Leger +1 more

Education · Assessment & Evaluation in Higher Education · · cited 123× · DOI ↗ · more like this ·

Effective teamwork skills are essential for success in an increasingly team-based workplace. However, research suggests that there is often confusion concerning how teamwork is measured and assessed, making it difficult to develop these skills in undergraduate curricula. The goal of the present study was to develop a sustainable tool for assessing individual teamwork skills, with the intention of refining and measuring these skills over time. The TeamUp rubric was selected as the preliminary standardised measure of teamwork and tested in a second year undergraduate course (Phase One). Although the tool displayed acceptable psychometric properties, there was concern that it was too lengthy, compromising student completion. This prompted refinement and modification leading to the development of the Team-Q, which was again tested in the same undergraduate course (Phase Two). The new tool…

Assessment cultures in higher education: reducing barriers and enabling change

Natalie Simper, Katarina Mårtensson, Amanda Berry +1 more

Education · Assessment & Evaluation in Higher Education · · cited 42× · DOI ↗ · more like this ·

A series of worldwide projects concerning assessment, student outcomes and quality in higher education has revealed the need for a change in how higher education institutions assess student outcomes; however, many academics remain unconvinced. The success of assessment change arguably depends on the assessment culture within the institution. This qualitative investigation of assessment cultures draws on the perspectives of 35 academics from Australia, Canada and Sweden. Data were analysed through a socio-cultural lens, with results supporting assessment cultures related to institutional structures and collegial relationships. The results also suggest the existence of assessment microcultures embedded in disciplines. This study provides concurrent validity to previous studies of assessment cultures, evidenced from institutional leadership perspectives, through the analysis of academic…

Teaching Evidence-Based Medicine to Medical Students Using Wikipedia as a Platform

Heather Murray, Melanie Walker, Jennifer Dawson +2 more

Communication · Academic Medicine · · cited 26× · DOI ↗ · more like this ·

PROBLEM: While ideal curricular structures for effective teaching of evidence-based medicine (EBM) have not been definitively determined, optimal strategies ensure that EBM teaching is interactive and clinically based, aligns with major trends in education and health care, and uses longitudinally integrated, whole-task activities. APPROACH: The authors developed a longitudinal, semester-long project, embedded in a first-year medicine course, through which they taught EBM using Wikipedia as a platform. Students worked individually and in small groups to choose a medicine-related Wikipedia article, identify information gaps, search for high-quality resources, appraise the sources, and incorporate the new information into the article (i.e., by editing Wikipedia). Students also applied their new appraisal skills to critique a second article. The authors used an online tool to track and…

Assessment thresholds for academic staff: constructive alignment and differentiation of standards

Natalie Simper

Education · Assessment & Evaluation in Higher Education · · cited 19× · DOI ↗ · more like this ·

This qualitative study utilized episodic narrative interviews to investigate assessment thresholds involved in the development of assessment literacy. The goal of the study was to inform efforts toward quality improvements in higher education. Thirty-five academic staff from universities in Australia, Canada and Sweden shared stories of significant changes they made to their assessment practice. Thematic analysis found troublesome aspects to include instructor expectations, lack of consistency, differentiation of performance, student expectations, time constraints/workload, logistical/technological constraints and assessment policy. A belief in meaningful learning, embracing constraints and the desire to meet the needs of students, added to other enablers for assessment change, such as resources, support and strategic use of technology. Findings suggested assessment thresholds of…

Informal academic networks and the value of significant social interactions in supporting quality assessment practices

Natalie Simper, Nicoleta Maynard, Katarina Mårtensson

Education · Higher Education Research & Development · · cited 12× · DOI ↗ · more like this ·

This research investigated social interactions within small significant networks across a range of higher education settings to determine their role in supporting improvements to assessment. Thirty-four academic staff from three higher education settings (Australia, Canada and Sweden) provided assessment change examples and drew network diagrams to explain their interactions. Significant social interactions were defined as engaged exchanges between people who trust and respect each other, around topics that hold common value. They led to an emotional response, promoted reflection and resulted in action and/or a shift in thinking. Significant social interactions were demonstrated to be effective in supporting changes in assessment practices. The qualitative findings were supplemented with quantitative investigation of the relational ties within the networks. The most significant…

Student learning in the workplace

Natalie Simper, Launa Gauthier, Jill Scott

Education · Journal of Workplace Learning · · cited 10× · DOI ↗ · more like this ·

Purpose This paper aims to outline a proof of concept for a framework to support students in reflecting on and in articulating their disciplinary, contextual and professional learning in the workplace. The purpose of the framework was to help students to recognize and articulate their transferable employability skills in preparation for the workplace or further studies upon graduation. Design/methodology/approach Researchers developed a Learning Evaluation and Reflection Narrative (LEARN) activity to facilitate real-world articulation of workplace learning. A group of work placement students completed pre- and post-work surveys, prompting reflection on their learning goals and behaviors. The Transferable Learning Orientation Survey comprised five constructs: goal orientation, learning belief, self-efficacy, transfer (deep learning) and organization. Subsequently, they completed a…

Comparison of standardized assessment methods: logistics, costs, incentives and use of data

Natalie Simper, Brian Frank, Jake Kaupp +2 more

Education · Assessment & Evaluation in Higher Education · · cited 8× · DOI ↗ · more like this ·

Critical thinking, problem solving and communication are fundamental elements of undergraduate education, but methods for assessing these skills across an institution are susceptible to logistical, motivational and financial issues. Queen’s University conducted two research studies investigating the use of standardised tests to assess cognitive skill development across the institution. Synthesis of results from implementing the Collegiate Learning Assessment (CLA+), the Critical Thinking Assessment Test (CAT), and the HEIghtenTM test found that student test effort was a significant factor, and effort level correlated with performance at r = .33. Test incentives were also a significant factor; effort levels for the $25 financial incentive group were one standard deviation higher than effort for the in-class test group. A dedicated computer lab was the preferred option for computer-based…

Rubric authoring tool for supporting the development an assessment of cognitive skills in higher education

Natalie Simper

Education · Teaching & Learning Inquiry The ISSOTL Journal · · cited 7× · DOI ↗ · more like this ·

This paper explores a method to support instructors in assessing cognitive skills in their course, designed to enable aggregation of data across an institution. A rubric authoring tool, ‘BASICS’ (Building Assessment Scaffolds for Intellectual Cognitive Skills) was built as part of the Queen’s University Learning Outcomes Assessment (LOA) Project. It provides a workflow for assessment choices and generates an assessment rubric that can be tailored to individual needs based on user input. The dimensions and criteria in BASICS were adapted from the Valid Assessment of Learning in Undergraduate Education (VALUE) rubrics, and drew on annotations from over 900 work samples from the LOA project. This paper summarizes the development of the tool, and presents initial reliability and validity data from a pilot study. The pilot found that the BASICS developed rubric was consistent for the…

Engagement in Assessment Change and the Role of SoTL

Natalie Simper, Amanda Berry, Katarina Mårtensson +1 more

Education · The Canadian Journal for the Scholarship of Teaching and Learning · · cited 1× · DOI ↗ · more like this ·

This study follows a network-based Assessment Redesign Project at a Canadian university to investigate engagement and sustained implementation. The following strategies were employed in the project: mini-grants, embedded support, a community of practice, and social networks. Assessment facilitators worked in discipline clusters to achieve mutual goals for assessment reform targeted at the authentic assessment of critical thinking and problem-solving. Interviews were conducted with nine of the 25 project members one-year post-implementation. The study adopted a motivational theoretical lens to investigate how the experience of the Assessment Redesign Project affected motivation and the continued adoption or propagation of assessment strategies. Participants commented on how helpful the embedded support had been in building their assessment skills or knowledge. The mini-grants were used…

Enhancing Student Self-Efficacy Through Feed-Forward Interventions in Real Estate Development Feasibility Analysis

Matthew Moorhead, Natalie Simper

Statistics and Probability · Journal of Real Estate Practice and Education · · cited 0× · DOI ↗ · more like this ·

This study examined whether a feed-forward learning intervention and assessment activity improved student self-efficacy in undergraduate and postgraduate real estate development subjects. Self-efficacy is pivotal when learners must integrate quantitative analysis with judgment under uncertainty, yet little is known about how pre-task guidance cultivates this confidence in real estate education and other data-rich programs. Given the complexity of development feasibility analysis, students—especially those without industry experience—often feel overwhelmed. Because no instrument specifically measured self-efficacy in real estate development, we adapted and piloted an existing tool with 36 students, yielding a two-construct measure. We then implemented a pre–post design with 47 students to test the effect of the assessment design and feed-forward on specific and general self-efficacy.…