Skip to main content

Publications

Examination of quantitative methods for analyzing data from concept inventories

Cornell Affiliated Author(s)
Author
E. Burkholder
C. Walsh
N.G. Holmes
Abstract

Physics education research (PER) has long used concept inventories to investigate student learning over time and to compare performance across various student subpopulations. PER has traditionally used normalized gain to explore these questions but has begun to use established methods from other fields, including Cohen's d, multiple linear regression, and linear mixed effects models. The choice of analysis method for examining student learning gains in PER is a current subject of debate.

Journal
Physical Review Physics Education Research
Date Published

What do equitable physics lab groups look like in light of inchargeness?

Cornell Affiliated Author(s)
Author
S. Jeon
E. Sayre
N.G. Holmes
Abstract

In physics labs, students experience a wide range of equitable and inequitable interactions. We developed a methodology to characterize different lab groups in terms of their bid exchanges and inchargeness. An equitable group is one in which every student’s bids are heard and acknowledged. Our analysis of equitable and inequitable groups raises questions about how inchargeness and gender interact to affect the functionality of a lab group. © ISLS.

Conference Name
.
Date Published

Group roles in unstructured labs show inequitable gender divide

Cornell Affiliated Author(s)
Author
K.N. Quinn
M.M. Kelley
K.L. McGill
E.M. Smith
Z. Whipps
N.G. Holmes
Abstract

Instructional labs are being transformed to better reflect authentic scientific practice, often by removing aspects of pedagogical structure to support student agency and decision making. We explored how these changes impact men's and women's participation in group work associated with labs through clustering methods on the quantified behavior of students. We compared the group roles students take on in two different types of instructional settings: (i) highly structured traditional labs, and (ii) less structured inquiry-based labs.

Journal
Physical Review Physics Education Research
Date Published
Funding Source
1836617

How expectations of confirmation influence students' experimentation decisions in introductory labs

Cornell Affiliated Author(s)
Author
E.M. Smith
M.M. Stein
N.G. Holmes
Abstract

Many instructional physics labs are shifting to teach experimentation skills, rather than to demonstrate or confirm canonical physics phenomena. Our previous work found that many students engage in questionable research practices in attempts to confirm the canonical physics phenomena, even when confirmation is explicitly not the goal of the lab.

Journal
Physical Review Physics Education Research
Date Published

Ready student one: Exploring the predictors of student learning in virtual reality

Cornell Affiliated Author(s)
Author
J. Madden
S. Pandita
J.P. Schuldt
B. Kim
A.S. Won
N.G. Holmes
Abstract

Immersive virtual reality (VR) has enormous potential for education, but classroom resources are limited. Thus, it is important to identify whether and when VR provides sufficient advantages over other modes of learning to justify its deployment. In a between-subjects experiment, we compared three methods of teaching Moon phases (a hands-on activity, VR, and a desktop simulation) and measured student improvement on existing learning and attitudinal measures.

Journal
PLoS ONE
Date Published

Developing scientific decision making by structuring and supporting student agency

Cornell Affiliated Author(s)
Author
N.G. Holmes
B. Keep
C.E. Wieman
Abstract

Scientific expertise is manifested through extensive cycles of making and acting on decisions. To learn the processes and practices of science, therefore, students must have practice with scientific decision making. We argue that this can only happen if students are afforded agency: the opportunity to make decisions to pursue a goal. In this study, we compared two different introductory physics labs through the lens of structuring and supporting student agency.

Journal
Physical Review Physics Education Research
Date Published

Direct measurement of the impact of teaching experimentation in physics labs

Cornell Affiliated Author(s)
Author
E.M. Smith
M.M. Stein
C. Walsh
N.G. Holmes
Abstract

While there have been many calls to improve the quality of instructional physics labs, there exists little research on the effectiveness of lab instruction. This study provides a direct comparison between labs that have goals to reinforce physics content to those that emphasize experimentation skills. In this controlled study, all students attended the same lecture and discussion sections, had the same homework and exams, but attended labs that had one of two aims: teaching experimentation or reinforcing content.

Journal
Physical Review X
Date Published

Assessing the assessment: Mutual information between response choices and factor scores

Cornell Affiliated Author(s)
Author
C. Walsh
N.G. Holmes
Abstract

Validated formative assessment tools provide a reliable way to compare student learning across variables such as pedagogy and curricula, or demographics. Such assessments typically employ a closed-response format developed from student responses to open-response questions and interviews with students and experts. The validity and reliability of these assessments is usually evaluated using statistical tools such as classical test theory or item response theory.

Conference Name
Conference
Date Published
Funding Source
1611482

Context of authority may affect students’ evaluations of measurement

Cornell Affiliated Author(s)
Author
E.M. Smith
N. Chodkowski
N.G. Holmes
Abstract

Recent research in introductory physics labs suggests that most students judge the quality of a measurement based on a comparison with theory. To probe this dimension of students’ judgments based on authority, we sought to evaluate whether students’ responses about evaluations of measurement depended on contextual cues. We asked students which measurement of the acceleration due to gravity was ‘better:’ (1) one given with uncertainty and found by ‘you and your friend’ or ‘you and your research group’ or (2) a textbook value with no reported uncertainty but more significant figures.

Conference Name
Conference
Date Published

Student interpretations of uncertainty in classical and quantum mechanics experiments

Cornell Affiliated Author(s)
Author
M.M. Stein
C. White
G. Passante
N.G. Holmes
Abstract

Measurements in quantum mechanics are often taught in an abstract, theoretical context. Compared to what is known about student understanding of experimental data in classical mechanics, it is unclear how students think about measurement and uncertainty in the context of experimental data from quantum mechanical systems. In this paper, we tested how students interpret the variability in data from hypothetical experiments in classical and quantum mechanics.

Conference Name
Conference
Date Published
Funding Source
DUE-1808945
DUE-1809183