Skip to main content

Publications

Method to assess the trustworthiness of machine coding at scale

Author
Rebeckah Fussell
Emily Stump
N. Holmes
Abstract
Physics education researchers are interested in using the tools of machine learning and natural language processing to make quantitative claims from natural language and text data, such as open-ended responses to survey questions. The aspiration is that this form of machine coding may be more efficient and consistent than human coding, allowing much larger and broader datasets to be analyzed than is practical with human coders.
Journal
Physical Review Physics Education Research
Date Published

Context affects student thinking about sources of uncertainty in classical and quantum mechanics

Cornell Affiliated Author(s)
Author
E.M. Stump
M. Dew
G. Passante
N.G. Holmes
Abstract

Measurement uncertainty is an important topic in the undergraduate laboratory curriculum. Previous research on student thinking about experimental measurement uncertainty has focused primarily on introductory-level students' procedural reasoning about data collection and interpretation. In this paper, we extended this prior work to study upper-level students' thinking about sources of measurement uncertainty across experimental contexts, with a particular focus on classical and quantum mechanics contexts.

Journal
Physical Review Physics Education Research
Date Published

Comparing introductory and beyond-introductory students' reasoning about uncertainty

Cornell Affiliated Author(s)
Author
E.M. Stump
M. Hughes
G. Passante
N.G. Holmes
Abstract

This paper is part of the Focused Collection on Instructional labs: Improving traditions and new directions.] Uncertainty is an important concept in physics laboratory instruction. However, little work has examined how students reason about uncertainty beyond the introductory (intro) level. In this work we aimed to compare intro and beyond-intro students' ideas about uncertainty.

Journal
Physical Review Physics Education Research
Date Published

Instructing nontraditional physics labs: Toward responsiveness to student epistemic framing

Author
M. Sundstrom
R.K. Fussell
A.M. Phillips
M. Akubo
S.E. Allen
D. Hammer
R.E. Scherr
N.G. Holmes
Abstract

[This paper is part of the Focused Collection on Instructional labs: Improving traditions and new directions.] Research on nontraditional laboratory (lab) activities in physics shows that students often expect to verify predetermined results, as takes place in traditional lab activities. This understanding of what is taking place, or epistemic framing, may impact students' behaviors in the lab, either productively or unproductively.

Journal
Physical Review Physics Education Research
Date Published

Comparing introductory and beyond-introductory students reasoning about uncertainty

Cornell Affiliated Author(s)
Author
Emily Stump
Mark Hughes
Gina Passante
N. Holmes
Abstract

Uncertainty is an important concept in physics laboratory instruction. However, little work has examined how students reason about uncertainty beyond the introductory (intro) level. In this work we aimed to compare intro and beyond-intro students’ ideas about uncertainty. We administered a survey to students at 10 different universities with questions probing procedural reasoning about measurement, student-identified sources of uncertainty, and predictive reasoning about data distributions.

Journal
Physical Review Physics Education Research
Date Published

Instructing nontraditional physics labs: Toward responsiveness to student epistemic framing

Author
Meagan Sundstrom
Rebeckah Fussell
Anna Phillips
Mark Akubo
Scott Allen
David Hammer
Rachel Scherr
Natasha Holmes
Abstract

This paper is part of the Focused Collection on Instructional labs: Improving traditions and new directions.] Research on nontraditional laboratory (lab) activities in physics shows that students often expect to verify predetermined results, as takes place in traditional lab activities. This understanding of what is taking place, or epistemic framing, may impact students’ behaviors in the lab, either productively or unproductively.

Journal
Physical Review Physics Education Research
Date Published

New perspectives on student reasoning about measurement uncertainty: More or better data

Cornell Affiliated Author(s)
Author
Andy Schang
Matthew Dew
Emily Stump
N. Holmes
Gina Passante
Abstract

Uncertainty is an important and fundamental concept in physics education. Students are often first exposed to uncertainty in introductory labs, expand their knowledge across lab courses, and then are introduced to quantum mechanical uncertainty in upper-division courses. This study is part of a larger project evaluating student thinking about uncertainty across these contexts.

Journal
Physical Review Physics Education Research
Date Published

Comparing study features is easy but identifying next steps is hard: Evaluating critical thinking through the Biology Lab Inventory of Critical Thinking in Ecology

Cornell Affiliated Author(s)
Author
Ashley Heim
David Esparza
N. Holmes
Michelle Smith
Abstract
Critical thinking, which can be defined as the evidence-based ways in which people decide what to trust and what to do, is an important competency included in many undergraduate science, technology, engineering, and mathematics (STEM) courses. To help instructors effectively measure critical thinking, we developed the Biology Lab Inventory of Critical Thinking in Ecology (Eco-BLIC), a freely available, closed-response assessment of undergraduate students critical thinking in ecology.
Journal
Ecology and Evolution
Date Published

Impact of traditional physics lab instruction on students’ critical thinking skills in a Finnish context

Cornell Affiliated Author(s)
Author
P. Pirinen
A. Lehtinen
N.G. Holmes
Abstract

Recent studies have given incentives to physics departments around the world to revise the learning goals of their lab courses to emphasize experimentation skills over reinforcing lecture content. Evaluation instruments have been developed to measure the achievement of learning goals, and one such instrument is the Physics Lab Inventory of Critical thinking (PLIC). The PLIC measures respondents’ ability to evaluate models, evaluate methods, and to suggest the next steps for an investigation.

Journal
European Journal of Physics
Date Published
Funding Source
2020-1-FI01-KA226-HE-092531

Taking on a manager role can support women's physics lab identity development

Cornell Affiliated Author(s)
Author
E.M. Stump
M. Dew
S. Jeon
N.G. Holmes
Abstract

Prior research has indicated that students in the undergraduate physics lab divide work inequitably with regard to gender. In this work, we further probed women's experiences in lab group work, focusing on women who take on managerial and leadership roles in the lab. We interviewed and surveyed women enrolled in a sophomore-level project-based lab course, drawing on a practice-linked identity framework to characterize their opportunities for engagement and identity development within the course.

Journal
Physical Review Physics Education Research
Date Published
Funding Source
DGE-2139899
DUE-1836617