Publications
Methods for trustworthy application of Large Language Models in PER
Within physics education research (PER), a growing body of literature investigates using natural language processing machine learning algorithms to apply coding schemes to student writing. The aspiration is that this form of measurement may be more efficient and consistent than similar measurements made with human analysis, allowing larger and broader data sets to be analyzed. In our work, we are harnessing recent innovations in Large Language Models (LLMs) such as BERT and LLaMA to learn complex coding scheme rules.
What topics of peer interactions correlate with student performance in physics courses?
Who and what gets recognized in peer recognition
Method to assess the trustworthiness of machine coding at scale
Context affects student thinking about sources of uncertainty in classical and quantum mechanics
Measurement uncertainty is an important topic in the undergraduate laboratory curriculum. Previous research on student thinking about experimental measurement uncertainty has focused primarily on introductory-level students' procedural reasoning about data collection and interpretation. In this paper, we extended this prior work to study upper-level students' thinking about sources of measurement uncertainty across experimental contexts, with a particular focus on classical and quantum mechanics contexts.
Comparing introductory and beyond-introductory students' reasoning about uncertainty
This paper is part of the Focused Collection on Instructional labs: Improving traditions and new directions.] Uncertainty is an important concept in physics laboratory instruction. However, little work has examined how students reason about uncertainty beyond the introductory (intro) level. In this work we aimed to compare intro and beyond-intro students' ideas about uncertainty.
Instructing nontraditional physics labs: Toward responsiveness to student epistemic framing
[This paper is part of the Focused Collection on Instructional labs: Improving traditions and new directions.] Research on nontraditional laboratory (lab) activities in physics shows that students often expect to verify predetermined results, as takes place in traditional lab activities. This understanding of what is taking place, or epistemic framing, may impact students' behaviors in the lab, either productively or unproductively.
Comparing introductory and beyond-introductory students reasoning about uncertainty
Uncertainty is an important concept in physics laboratory instruction. However, little work has examined how students reason about uncertainty beyond the introductory (intro) level. In this work we aimed to compare intro and beyond-intro students’ ideas about uncertainty. We administered a survey to students at 10 different universities with questions probing procedural reasoning about measurement, student-identified sources of uncertainty, and predictive reasoning about data distributions.
Instructing nontraditional physics labs: Toward responsiveness to student epistemic framing
This paper is part of the Focused Collection on Instructional labs: Improving traditions and new directions.] Research on nontraditional laboratory (lab) activities in physics shows that students often expect to verify predetermined results, as takes place in traditional lab activities. This understanding of what is taking place, or epistemic framing, may impact students’ behaviors in the lab, either productively or unproductively.
New perspectives on student reasoning about measurement uncertainty: More or better data
Uncertainty is an important and fundamental concept in physics education. Students are often first exposed to uncertainty in introductory labs, expand their knowledge across lab courses, and then are introduced to quantum mechanical uncertainty in upper-division courses. This study is part of a larger project evaluating student thinking about uncertainty across these contexts.