We present the development and validation of a new assessment tool, the Moon Phases Concept Inventory for Middle School (MPCI-MS), a concept inventory about the phases of the moon targeting students aged 10 to 14 years old. Items in the questionnaire are based on a careful examination of the concept domain of phases of the moon, ideas and concepts necessary to understand the mechanism of lunar phases, as chosen by a panel of seven professional astronomers. Questions and multiple-choice answers were tested for readability with 5th grade students, tested for reading level, and submitted to a second panel of professional astronomers to check for face and construct validity of the items. The MPCI-MS was tested with $N=296$ students from grade 5 in elementary school to secondary 2 ($M_{\mathrm{age}}=10.2$ to 14.1). One item about global perspective on lunar phases had to be removed because of poor psychometric properties. The revised MPCI-MS has a post-test Cronbach alpha score of 0.786 and good overall psychometric properties: the mean difficulty index for the MPCI-MS pretest is 0.47, and 0.61 for the post-test; mean point-biserial correlation (post-test) is 0.376. Test-retest without instruction at one-week interval showed high test-retest reliability [$M_{\mathrm{pre}}=13.696$, $M_{\mathrm{post}}=14.523$; $t(45)=1.315$, $p=0.192$]. We conclude that the MPCI-MS is a reliable and valid instrument that can discriminate between novices and experts, and can be used to assess 10 to 14 year-old students’ learning gains on the topic of lunar phases. The final version of MPCI-MS is a 19-item instrument, including two new questions about eclipses, that takes between 15 and 25 min for students to complete.

Is physics education research based on a representative sample of students? To answer this question we skimmed physics education research papers from three journals for the years 1970–2015 looking for the number of research subjects, the course the subjects were enrolled in, and the institution where the research was conducted. We combined this data with demographics data about these institutions to compile a profile of physics education research subjects, and compared the demographics of this population to those of all students taking physics in the United States. Our results suggest that physics education research subjects, as a whole, are better prepared mathematically and are from a narrow and unrepresentative subset of our intended target physics student populations. For this reason, findings from research may not be as generalizable to all student populations as we have previously assumed.

Much work in physics education research (PER) characterizes faculty teaching practice in terms of whether faculty use specific named PER-based teaching methods, either with fidelity or with adaptation; we call this research paradigm the “teaching-method-centered paradigm.” However, most faculty do not frame their teaching in terms of which particular named methods they use, but rather in terms of their own ideas and values, suggesting that the teaching-method-centered paradigm misses key features of faculty teaching. These key features include the productive ideas that faculty have about student learning and faculty agency around teaching. We present three case studies of faculty talking about their teaching, and analyze them in terms of two theoretical frameworks: a framework of teaching principles (How Learning Works) and a framework of faculty agency (self-determination theory). We show that these frameworks well characterize key features of faculty teaching practices and agency, and can be combined in a new paradigm for modeling faculty teaching which we call an “asset-based agentic paradigm.” We therefore encourage physics education researchers to move beyond the teaching-method-centered paradigm and think about faculty teaching using an asset-based agentic paradigm.

We present the findings of a pilot plan of active learning implemented in introductory physics in a Chilean public university. The model is research based as it considered a literature review for adequate selection and design of activities consistent with the levels of students’ reasoning skills. The level of scientific reasoning is positively correlated to student success. By contrast to a control group of students following traditional lectures, we observed a significant reduction in failure rate for students that do not yet possess formal scientific reasoning. This profile of students being the majority, we conclude that implementing active learning is particularly suited to the first year of higher education in the context of a developing country. It fits the particularities of student profile and typical classroom size, leading to learning improvement and reduction of academic risk, as well as being financially sound.

The Colorado Learning Attitudes about Science Survey (CLASS) is an instrument which is widely used in physics education to characterize students’ attitudes toward physics and learning physics and compare them with those of experts. While CLASS has been extensively validated for use in the context of higher education institutions in the United States, there has been less information about its use with European students. We have studied the structural, content, and substantive aspects of validity of CLASS by first doing a confirmatory factor analysis of $N=642$ sets of student answers from the University of Helsinki, Finland. The students represented a culturally and demographically different subset of university physics students than in previous studies. The confirmatory factor analysis used a 3-factor, 15-item factor structure as a starting point and the resulting factor structure was similar to the original. Just minor modifications were needed for fit parameters to be in the acceptable range. We explored the differences by student interviews and consultation of experts. With the exception of one item, they supported the new 14-item, 3-factor structure. The results show that the interpretations made from CLASS results are mostly transferable, and CLASS remains a useful instrument for a wide variety of populations.

Concept inventories (CIs) are commonly used in pre-post instruction to study student conceptual change. For consistency in assessment interpretation, a CI’s assessment construct is desired to maintain invariance across different test times. In this study, the longitudinal measurement invariance (LMI) analysis under the confirmatory factor analysis framework was used to examine the stability of the factor structure between pretest and post-test of two commonly used CIs, i.e., the Force Concept Inventory (FCI) and Conceptual Survey of Electricity and Magnetism (CSEM). A number of existing and modified models were examined in this paper. The results confirmed that all factor models of the FCI fitted well with both pre- and post-test data. For CSEM, acceptable fits were obtained with a reduced version of the CI. When reliability analysis was performed for the factors of these models, most modified models were found to be more reliable than the existing models. The modified models were further tested in LMI analysis, in which a sequence of models with increasingly restrictive parameter constraints was examined. For the FCI, LMI analysis demonstrated the existence of partial strict invariance, i.e., common factor structures, factor loadings, and item thresholds, and equally observed residual variances for all the items except items 2 and 29. For the CSEM, after excluding 10 items, a reduced version was found to hold the strict invariance criteria. These findings reveal that changes in scores of the whole FCI and the reduced CSEM can be attributed to changes in the latent constructs measured by the CIs, which confirms these two CIs as reliable instruments to study students’ conceptual change over time in introductory physics courses.

At universities where introductory physics labs are taught by graduate student teaching assistants (TAs), there is a need for specialized professional development for those TAs. This paper presents a specific instantiation of a model for lab TA professional development that uses a combination of cognitive apprenticeship and expectancy-value theories as its framework. We describe how our model was implemented in the lab TA professional development program, which included reflections, role playing, and other pedagogical activities offered through weekly meetings. Our evaluation included an analysis of TA writing and interactions with students alongside informal observations and interviews. We discuss the importance of accounting for TAs’ interest and self-efficacy development in teaching the labs, as well as the challenge of motivating TAs who have very low initial levels of interest in supporting student learning. We find that many TAs in our lab TA professional development program demonstrated an improvement in TA performance in supporting student learning. Given that the professional development activities require only a modest investment of time, these positive results suggest that the model of lab TA professional development may be usefully adopted and adapted at other institutions where introductory labs are led by graduate student TAs.

Assessments are usually thought of as ways for instructors to get information from students. In this work, we flip this perspective and explore how assessments communicate information to students. Specifically, we consider how assessments may provide information about what faculty and/or researchers think it means to know and do physics, i.e., their epistemologies. Using data from students completing assessment questions during one-on-one think aloud interviews, we explore how assessment features did (or did not) impact student engagement with the assessment problems. We analyze video recordings and transcripts to infer the epistemological framings and resources students use while completing introductory-level physics problems. Students’ framings tended to be fairly stable, but when shifts occurred, they were triggered by a shift in epistemological resource, which can be activated by assessment feature. This work extends existing work on epistemological framing into the realm of assessment and allows us to consider the effects of assessments on our students’ understanding of physics teaching and learning.

We present the development and validation of a construct map addressing introductory quantum mechanics topics at the high school level, as a subset of a larger learning progression on quantum mechanics. Topics include energy quantization, photon absorption and emission, the Heisenberg uncertainty principle, atom stability, orbitals, wave function, and electronic properties of materials. To validate the hypothesized construct map, we designed a multiple-choice questionnaire and a 14-h teaching-learning sequence (TLS) designed in strict relation with the levels of the construct map. Twenty-three classes of Italian students (ages 17–18, $N=408$) were involved in the study: about half ($N=200$) were exposed to the TLS, while $N=208$ students received a typical textbook instruction on the same topics targeted by the construct map. Data were analyzed using a 1D Rasch model. Results show that the proposed construct map consistently describes the increasing abilities of students when exposed to instruction. In particular, when exposed to the TLS activities, students more likely move towards the upper levels of the construct map. Findings have implications for instruction designed to support students’ learning in quantum mechanics at the high school level.

Students’ ability to assess their own knowledge is an important skill in science education. However, students often overestimate their actual performances. In such cases, overconfidence bias arises. Previous studies in physics education have shown that overconfidence bias concerns mainly content areas, such as Newtonian mechanics, where misconceptions are strongly held by students. However, how the received instruction and the levels of understanding of a given topic influence overconfidence bias is yet to be proved. In this paper, we address this issue choosing as content area introductory quantum mechanics (QM). Overall, 408 high school students were involved in the study and randomly assigned to two experimental groups. One group received a textbook-based instruction about introductory QM, whereas the other one received instruction on the same topics through an innovative guided inquiry teaching-learning sequence (TLS), which included also potential pedagogical countermeasures for overconfidence bias. Students of both experimental groups completed a multiple-choice questionnaire and indicated for each item the degree of their confidence in the given answer using a 5-point Likert scale. The overconfidence bias was quantitatively defined and evaluated at person level using a 1D Rasch model. Progress in knowledge about the targeted topics was modeled according to a construct map validated in a previous paper. Results show that, for the whole sample, the overconfidence bias decreased as students progressed along the levels of the construct map. However, findings indicate that students of the TLS group achieved a significantly higher accuracy and a better confidence calibration, while the textbook group exhibited a lower performance and a significantly greater overconfidence bias. Implications for research into overconfidence bias in physics education are briefly discussed.

We have used an unsupervised machine learning method called latent Dirichlet allocation (LDA) to thematically analyze all papers published in the Physics Education Research Conference Proceedings between 2001 and 2018. By looking at co-occurrences of words across the data corpus, this technique has allowed us to identify ten distinct themes or “topics” that have seen varying levels of prevalence in physics education research (PER) over time and to rate the distribution of these topics within each paper. Our analysis suggests that although all identified topics have seen sustained interest over time, PER has also seen several waves of increased interest in certain topics, beginning with initial interest in qualitative, theory-building studies of student understanding, which gave way to a focus on problem solving in the late 2000s. Since 2010 the field has seen a shift toward more sociocultural views of teaching and learning with a particular focus on communities of practice, student identities, and institutional change. Based on these results, we suggest that unsupervised text analysis techniques like LDA may hold promise for providing quantitative, independent, and replicable analyses of educational research literature.

Physics education research (PER) has long used concept inventories to investigate student learning over time and to compare performance across various student subpopulations. PER has traditionally used normalized gain to explore these questions but has begun to use established methods from other fields, including Cohen’s $d$, multiple linear regression, and linear mixed effects models. The choice of analysis method for examining student learning gains in PER is a current subject of debate. We synthesize this debate here by focusing on the research questions and interpretations that can be drawn using various statistical tools. We focus particularly on how results can be interpreted through an equity lens and what questions can and cannot be answered using different methods. Our results demonstrate the importance of clearly defining a research question and using appropriate tools to answer that question.

The cyclic format of the undergraduate physics curriculum depends on students’ ability to recall and utilize material covered in prior courses in order to reliably build on that knowledge in later courses. However, there is evidence to suggest that people often do not retain all, or even most, of what they learned previously. How much information is retained appears to be dependent on the individuals’ approach to learning as well as the style of instruction. In particular, there is evidence to suggest that active engagement techniques in the classroom can improve students’ retention of the material over time. Here, we report the findings of a longitudinal investigation of students’ retention of conceptual understanding as measured by the Force and Motion Conceptual Evaluation (FMCE) following a first-semester, calculus-based introductory physics course, which features significant active engagement in both lecture and recitation. By administering the FMCE at the end of a first-semester physics course and again at the beginning of the subsequent second-semester physics course, we examine students’ knowledge retention over time periods ranging from 1 to 15 months. We find that the shift in students’ FMCE scores between these two courses is positive but corresponds to a small effect size, indicating that students retained effectively all of their conceptual learning (as measured by the FMCE). This finding largely persists even as the length of the gap between the two courses increases. We also find that, when breaking out students’ performance on individual questions, the majority of students maintain their score on individual questions. Averaged over all questions, roughly a fifth of the students switched their answers from right to wrong or wrong to right on any given item.

An increasing number of introductory physics courses are seeking to incorporate “authentic practices,” and a large area of focus in this trend is the incorporation of computational problems into the curriculum. These problems offer students an opportunity to engage with the programming practices and numerical problem-solving methods used by physicists. Understanding how instructors approach teaching such problems is essential for improving instruction and problem design. We conducted a phenomenographic study using semistructured interviews with undergraduate learning assistants in a problem-based introductory mechanics course that incorporates several computational problems. The learning assistants’ prior involvement as students, along with their relatively fewer experiences with programming and physics compared to the faculty instructors, give them a unique perspective on teaching in the course. We present here the results of our analysis: the identification of four approaches that learning assistants make take to teaching computational problems in this course. These approaches, programming focus, learning physics via computation focus, computation as a tool focus, and shifting perceptions of learning focus, provide a lens for understanding the different ways learning assistants perceive computation, the degree to which they take up course-intended learning goals surrounding computation, the factors that may impact the approaches they take, and how we might affect their approaches through training and support.

This study examines whether including more contextual information in data analysis could improve our ability to identify the relation between students’ online learning behavior and overall performance in an introductory physics course. We created four linear regression models correlating students’ pass-fail events in a sequence of online learning modules with their normalized total course score. Each model takes into account an additional level of contextual information than the previous one, such as student learning strategy and duration of assessment attempts. Each of the latter three models is also accompanied by a visual representation of students’ interaction states on each learning module. We found that the best performing model is the one that includes the most contextual information, including instruction condition, internal condition, and learning strategy. The model shows that while most students failed on the most challenging learning module, those with normal learning behavior are more likely to obtain higher total course scores, whereas students who resorted to guessing on the assessments of subsequent modules tended to receive lower total scores. Our results suggest that considering more contextual information related to each event can be an effective method to improve the quality of learning analytics, leading to more accurate and actionable recommendations for instructors.

For several decades, scholars have studied the role of cooperation and its outcomes in educational contexts. Yet we lack a complete understanding of how different instructional strategies impact the relationship between cooperation and learning. In this paper we present results from a field experiment with 82 first-year students in an introductory physics course showing how different instructional strategies led to different social configurations in the classroom and to differences in individual academic performance. Surprisingly, we found that students who actively sought out information from multiple peers were less likely to perform well on well-structured problems as compared to those who did not seek help, whereas, for ill-structured (real-world-like) problems, this effect depended on the features of the learning environment. We observed that good performance on ill- and well-structured problems was sensitive to different social network configurations. In a highly clustered network (which contains redundant information), students performed better on well-structured problems than ill-structured problems. By contrast, students with access to network structural holes (which enable access to more diverse information) performed ill-structured problems better than well-structured problems. Finally, ill-structured problems promoted creative thinking, provided that instructors guided the problem-solving process and motivated students to engage in the appropriate cognitive demands these problems entailed. Our results suggest that teaching and instructional strategies play an important role in cooperative learning; therefore, educators implementing cooperative learning methods have to accompany them with adequate instructional strategy.

We report the results of a survey applied to students and professionals in the area of physics in Brazil, pursuing to draw a portrait of the composition of this community in terms of the social markers of difference age, race, ethnicity, geographical origin, sex, gender, sexual orientation, and disabilities. The main goal was to quantify the representativeness of different groups in the community and to detect motivations and difficulties encountered by each group throughout their studies and career. This survey was open to the members of the Brazilian Physics Society from July to September 2018. Our outcomes reveal that (i) the Brazilian physicists community is poorly diverse even in comparison with the population composition, (ii) the main obstacle to pursue the career is socioeconomic vulnerability, and (iii) harassment is high in our society, being more pronounced among women. We hope that these results will be useful to scientific and educational institutions to develop different strategies and policies to change this current situation.

We conducted a study with introductory and upper-division level physics students in a Mexican and a Spanish university to learn how students recognize the main characteristics of the electric field in three of its more widely used representations, namely, algebraic notation, vector field plot, and electric field lines, and how the students do conversions of them. The students’ abilities to recognize the three representations of the electric field and do conversions gave insight into their understanding of this concept. We used the theory of registers of semiotic representations as a framework to analyze the data. Our results showed that the direction of the conversion is an essential factor in determining the students’ success in performing conversions of electrical field representations. We found close synergy between the vector field plot and the algebraic notation of the electric field. However, we found that the conversions that involve electric field lines do not present synergy. The electric field lines representation is especially difficult for students, both as a source and as a target representation, specifically, the interpretation and representation of the magnitude of the field through the density of field lines. We recommend that teachers and researchers of electricity and magnetism be more conscious of the difficulties that some conversion tasks may present to their students. We specifically invite instructors to be attentive to how they approach the representation of electric field lines and be explicit when performing conversions that involve electric field lines.

Circular motion is embedded in many circus tricks, and is also one of the most challenging topics for both students and teachers. Previous studies have identified several misconceptions about circular motion, and especially about the forces that act upon a rotating object. A commonly used demonstration of circular motion laws by physics teachers is spinning a bucket full of water in the vertical plane further explaining why the water did not spill out when the bucket was upside down. One of the central misconceptions regarding circular motion is the existence of so-called centrifugal force: Students mistakenly believe that when an object spins in a circular path, there is real force acting on the object in the radial direction pulling it out of the path. Thus, one of the most frequently observed naïve explanations is that the gravity force mg is compensated by the centrifugal force on the top of the circular trajectory and thus, water does not spill down. In the present study we decided to change the context of the problem from a usual physics class demonstration to a relatively unusual informal environment of a circus show and investigate the spectators’ ideas regarding circular motion in this context. Thus, the goal of the present study is to examine the concepts of a heteroaged population regarding circular motion phenomenon provided in the context of a circus number as expressed in focus-group interviews following the number.

Finland is known worldwide for their strong K–12 education system and robust gender equality across their nation. However, these facts have not translated into strong representation of women in physics degree attainment and the workforce. This study seeks to understand the motivations and consideration to leave of university physics students in Finland, with a specific focus on gender. Undergraduate students’ aspiration to attend graduate school and graduate students’ aspiration for an academic career were also assessed. This study uses a survey instrument distributed to Finnish physics students at 5 of the 9 nationwide programs. The responses ($N=329$) indicate that anxiety increases a students’ consideration to leave and that women report higher anxiety and lower self-efficacy in their pursuit of a physics degree than men. Women were also more likely to report being extrinsically motivated to pursue physics than men. Positive intrinsic motivation and self-efficacy predicted the aspiration of graduate school for undergraduates, while only gender predicted interest in academic careers by men and nonacademic careers for women.