Skip to main content

Publications

Comparing study features is easy but identifying next steps is hard: Evaluating critical thinking through the Biology Lab Inventory of Critical Thinking in Ecology

Cornell Affiliated Author(s)
Author
Ashley Heim
David Esparza
N. Holmes
Michelle Smith
Abstract
Critical thinking, which can be defined as the evidence-based ways in which people decide what to trust and what to do, is an important competency included in many undergraduate science, technology, engineering, and mathematics (STEM) courses. To help instructors effectively measure critical thinking, we developed the Biology Lab Inventory of Critical Thinking in Ecology (Eco-BLIC), a freely available, closed-response assessment of undergraduate students critical thinking in ecology.
Journal
Ecology and Evolution
Date Published

Impact of traditional physics lab instruction on students’ critical thinking skills in a Finnish context

Cornell Affiliated Author(s)
Author
P. Pirinen
A. Lehtinen
N.G. Holmes
Abstract

Recent studies have given incentives to physics departments around the world to revise the learning goals of their lab courses to emphasize experimentation skills over reinforcing lecture content. Evaluation instruments have been developed to measure the achievement of learning goals, and one such instrument is the Physics Lab Inventory of Critical thinking (PLIC). The PLIC measures respondents’ ability to evaluate models, evaluate methods, and to suggest the next steps for an investigation.

Journal
European Journal of Physics
Date Published
Funding Source
2020-1-FI01-KA226-HE-092531

Taking on a manager role can support women's physics lab identity development

Cornell Affiliated Author(s)
Author
E.M. Stump
M. Dew
S. Jeon
N.G. Holmes
Abstract

Prior research has indicated that students in the undergraduate physics lab divide work inequitably with regard to gender. In this work, we further probed women's experiences in lab group work, focusing on women who take on managerial and leadership roles in the lab. We interviewed and surveyed women enrolled in a sophomore-level project-based lab course, drawing on a practice-linked identity framework to characterize their opportunities for engagement and identity development within the course.

Journal
Physical Review Physics Education Research
Date Published
Funding Source
DGE-2139899
DUE-1836617

Conceptual understanding of sources of uncertainty: A new perspective on classifying student thinking about measurement

Cornell Affiliated Author(s)
Author
Emily Stump
Gina Passante
Natasha Holmes
Abstract
Measurement uncertainty is a key concept in undergraduate physics laboratory courses. Prior work has introduced two paradigms of student thinking about sources of measurement uncertainty: pointlike thinkers, who believe that a single measurement can produce the true value in an experiment, and setlike thinkers, who believe that a set of measurements is necessary to draw conclusions. Other work, however, has suggested that very few students are pointlike thinkers and many students do not apply consistent pointlike or setlike thinking in all contexts.
Conference Name
APS April Meeting 2023
Date Published

Exploring student framing in non-traditional physics labs

Cornell Affiliated Author(s)
Author
Natasha Holmes
Meagan Sundstrom
David Hammer
Rachel Scherr
Ian Descamps
Sophia Jeon
Abstract
Too often, traditional physics laboratory exercises have trained students to expect to follow rote procedures and confirm known results. Nationally, labs are being redesigned to help students to learn and to use practices of authentic scientific research. As instructors and departments make these changes, we must understand how students experience these shifts in both pedagogy, learning goals, and epistemology.
Conference Name
APS April Meeting 2023
Date Published

Using networks to relate student interactions to their recognition of strong peers

Cornell Affiliated Author(s)
Author
Meagan Sundstrom
Lee Simpfendoerfer
Annie Tan
Natasha Holmes
Abstract

Gaining recognition from peers has been shown to improve student persistence and career intentions in physics. It is important, therefore, to understand how students develop perceptions of their peers. Prior research suggests that interactions are one possible mechanism for peer recognition: interacting with others allows students to demonstrate their physics skills and knowledge and acquire recognition as a physicist. To probe this explanation directly, we use methods from social network analysis to compare students' self-reported interactions to their recognition of strong peers.

Conference Name
APS April Meeting 2023
Date Published

Validating a Weekly Survey to Understand Student Division of Roles in Physics Labs

Cornell Affiliated Author(s)
Author
Matthew Dew
Emily Stump
Natasha Holmes
Abstract
In introductory physics laboratories, students typically work in groups where they divide and share different roles to complete assignments. Data on student participation in these different roles within groups help assess equity in labs. However, little work has investigated the division of these roles week-to-week with class observations as it is a time-intensive process. To address this, we designed a closed-ended survey delivered weekly during lecture to measure student perceptions of their involvement in various roles.
Conference Name
APS April Meeting 2023
Date Published

Why the machine (dis)agrees: understanding uncertainty in natural language processing classifications

Cornell Affiliated Author(s)
Author
Rebeckah Fussell
Natasha Holmes
Abstract
As interest increases in using natural language processing methods ( machine coding ) to supplant labor-intensive human coding of survey responses, the physics education research community needs methods to determine the accuracy and reliability of machine coding. Existing literature uses measures of agreement between human and machine coding (e.g., Cohen s kappa) to assess machine coding.
Conference Name
APS April Meeting 2023
Date Published

Introductory physics students' recognition of strong peers: Gender and racial or ethnic bias differ by course level and context

Cornell Affiliated Author(s)
Author
M. Sundstrom
A.B. Heim
B. Park
N.G. Holmes
Abstract

Researchers have pinpointed recognition from others as one of the most important dimensions of students' science and engineering identity. Studies, however, have found gender biases in students' recognition of their peers, with inconsistent patterns across introductory science and engineering courses. Toward finding the source of this variation, we examine whether a gender bias exists in students' nominations of strong peers across three different remote, introductory physics courses with varying student populations (varying demographics, majors, and course levels).

Journal
Physical Review Physics Education Research
Date Published
Funding Source
DGE-2139899
DUE-1836617

Exploring diverse students’ negotiation of lab roles through positioning

Cornell Affiliated Author(s)
Author
M. Akubo
M. Sundstrom
N.G. Holmes
Abstract

Prior work has found inequities in what experimental roles students take on during instructional labs. Research also suggests that this role division might arise implicitly and that prompting explicit role negotiation might improve equity in lab group work. To understand these various ways students negotiate roles in their lab groups, we use the lens of positioning to analyze two different video episodes of a gender-and-race-diverse group of three students.

Conference Name
Conference
Date Published
Funding Source
DGE-2139899
DUE-1836617