Skip to main content

Publications

Developing scientific decision making by structuring and supporting student agency

Cornell Affiliated Author(s)
Author
N.G. Holmes
B. Keep
C.E. Wieman
Abstract

Scientific expertise is manifested through extensive cycles of making and acting on decisions. To learn the processes and practices of science, therefore, students must have practice with scientific decision making. We argue that this can only happen if students are afforded agency: the opportunity to make decisions to pursue a goal. In this study, we compared two different introductory physics labs through the lens of structuring and supporting student agency.

Journal
Physical Review Physics Education Research
Date Published
Group (Lab)
Natasha Holmes Group

Direct measurement of the impact of teaching experimentation in physics labs

Cornell Affiliated Author(s)
Author
E.M. Smith
M.M. Stein
C. Walsh
N.G. Holmes
Abstract

While there have been many calls to improve the quality of instructional physics labs, there exists little research on the effectiveness of lab instruction. This study provides a direct comparison between labs that have goals to reinforce physics content to those that emphasize experimentation skills. In this controlled study, all students attended the same lecture and discussion sections, had the same homework and exams, but attended labs that had one of two aims: teaching experimentation or reinforcing content.

Journal
Physical Review X
Date Published
Group (Lab)
Natasha Holmes Group

Assessing the assessment: Mutual information between response choices and factor scores

Cornell Affiliated Author(s)
Author
C. Walsh
N.G. Holmes
Abstract

Validated formative assessment tools provide a reliable way to compare student learning across variables such as pedagogy and curricula, or demographics. Such assessments typically employ a closed-response format developed from student responses to open-response questions and interviews with students and experts. The validity and reliability of these assessments is usually evaluated using statistical tools such as classical test theory or item response theory.

Conference Name
Conference
Date Published
Funding Source
1611482
Group (Lab)
Natasha Holmes Group

Context of authority may affect students’ evaluations of measurement

Cornell Affiliated Author(s)
Author
E.M. Smith
N. Chodkowski
N.G. Holmes
Abstract

Recent research in introductory physics labs suggests that most students judge the quality of a measurement based on a comparison with theory. To probe this dimension of students’ judgments based on authority, we sought to evaluate whether students’ responses about evaluations of measurement depended on contextual cues. We asked students which measurement of the acceleration due to gravity was ‘better:’ (1) one given with uncertainty and found by ‘you and your friend’ or ‘you and your research group’ or (2) a textbook value with no reported uncertainty but more significant figures.

Conference Name
Conference
Date Published
Group (Lab)
Natasha Holmes Group

Student interpretations of uncertainty in classical and quantum mechanics experiments

Cornell Affiliated Author(s)
Author
M.M. Stein
C. White
G. Passante
N.G. Holmes
Abstract

Measurements in quantum mechanics are often taught in an abstract, theoretical context. Compared to what is known about student understanding of experimental data in classical mechanics, it is unclear how students think about measurement and uncertainty in the context of experimental data from quantum mechanical systems. In this paper, we tested how students interpret the variability in data from hypothetical experiments in classical and quantum mechanics.

Conference Name
Conference
Date Published
Funding Source
DUE-1808945
DUE-1809183
Group (Lab)
Natasha Holmes Group

Why Traditional Labs Fail, and What We Can Do About It

Cornell Affiliated Author(s)
Author
N.G. Holmes
Abstract

Science is, at its core, an empirical discipline: Theories must coordinate with evidence obtained through systematic, scientific investigations. Learning science involves learning how science is done, not just what science has found, and so nearly every introductory college science course has an associated laboratory component. The value of these labs, however, has often been called into question, particularly when considering concerns about the associated space, time, equipment, and personnel needs.

Journal
Active Learning in College Science: The Case for Evidence-Based Practice
Date Published
Group (Lab)
Natasha Holmes Group

Using the Ecology and Evolution-Measuring Achievement and Progression in Science assessment to measure student thinking across the Four-Dimensional Ecology Education framework

Cornell Affiliated Author(s)
Author
M.K. Smith
C. Walsh
N.G. Holmes
M.M. Summers
Abstract

The newly developed Four-Dimensional Ecology Education (4DEE) framework, produced by the Ecological Society of America, provides updated guidance for undergraduate instruction. To help instructors align their courses to this framework and assess student progress toward its goals, we have recoded the comprehensive programmatic assessment Ecology and Evolution-Measuring Achievement and Progression in Science (EcoEvo-MAPS) and reanalyzed a national dataset of over 2000 undergraduate student responses.

Journal
Ecosphere
Date Published
Funding Source
1322364
1323010
DUE 1322556
1808008199
Group (Lab)
Natasha Holmes Group

A re-examination of the fundamental parameters approach to calibration of the Curiosity rover alpha particle X-ray spectrometer

Cornell Affiliated Author(s)
Author
J.L. Campbell
D.D. Thomson
E.L. Flannigan
N.G. Holmes
D.W. Tesselaar
S. VanBommel
Abstract

In terrestrial instruments for X-ray emission analysis (e.g. X-ray fluorescence, electron microprobe) the angle of excitation and the angle of characteristic X-ray emission by samples are typically well-defined. This is not the case for the Mars rovers’ alpha particle X-ray spectrometers, necessitating use of “effective” angles in any fundamental parameters approach to spectrum fitting and derivation of element concentrations.

Journal
Nuclear Instruments and Methods in Physics Research, Section B: Beam Interactions with Materials and Atoms
Date Published
Funding Source
9F007-051332
9F052-110786
Group (Lab)
Natasha Holmes Group

Operationalizing the AAPT Learning Goals for the Lab

Cornell Affiliated Author(s)
Author
N.G. Holmes
E.M. Smith
Abstract

Calls for reform to instructional labs mean many instructors and departments are facing the daunting task of identifying goals for their introductory lab courses. Fortunately, the American Association of Physics Teachers (AAPT) released a set of recommendations for learning goals for the lab to support lab redevelopment. Here we outline the process we have undergone to identify a set of learning goals for the labs that operationalize those provided by the AAPT.

Journal
Physics Teacher
Date Published
Group (Lab)
Natasha Holmes Group

Exploring bias in mechanical engineering students’ perceptions of classmates

Cornell Affiliated Author(s)
Author
S. Salehi
N.G. Holmes
C. Wieman
Abstract

Gender disparity in science, technology, engineering, and math (STEM) fields is an ongoing challenge. Gender bias is one of the possible mechanisms leading to such disparities and has been extensively studied. Previous work showed that there was a gender bias in how students perceived the competence of their peers in undergraduate biology courses. We examined whether there was a similar gender bias in a mechanical engineering course. We conducted the study in two offerings of the course, which used different instructional practices.

Journal
PLoS ONE
Date Published