[This paper is part of the Focused Collection on Astronomy Education Research.] One goal for a scientifically literate citizenry would be for learners to appreciate when the Earth came to be and where it resides in the Universe. Understanding the Earth’s formation in time in both a sociohistorical and scientific sense allows us to place humanity within the larger context of our existence in the Universe. This article considers prior research from cognitive science, psychology, history, and Earth and space science education to inform a new research agenda in astronomy education. While there exists prior research related to learner’s ideas of time and the Earth’s location, research on how to help students develop a coherent model of the Earth’s place in space and time in the Universe is still lacking. We highlight a set of preliminary findings from a pilot study that is part of this new agenda, which is focused on students’ ideas on how to connect the Earth’s formation with prior events in the Universe.

Research on the test structure of the Force Concept Inventory (FCI) has largely been performed with exploratory methods such as factor analysis and cluster analysis. Multidimensional Item Response Theory (MIRT) provides an alternative to traditional exploratory factor analysis which allows statistical testing to identify the optimal number of factors. Application of MIRT to a sample of $N=4716$ FCI post-tests identified a 9-factor solution as optimal. Additional analysis showed that a substantial part of the identified factor structure resulted from the practice of using problem blocks and from pairs of similar questions. Applying MIRT to a reduced set of FCI items removing blocked items and repeated items produced a 6-factor solution; however, the factors still had little relation the general structure of Newtonian mechanics. A theoretical model of the FCI was constructed from expert solutions and fit to the FCI by constraining the MIRT parameter matrix to the theoretical model. Variations on the theoretical model were then explored to identify an optimal model. The optimal model supported the differentiation of Newton’s 1st and 2nd law; of one-dimensional and three-dimensional kinematics; and of the principle of the addition of forces from Newton’s 2nd law. The model suggested by the authors of the FCI was also fit; the optimal MIRT model was statistically superior.

To prepare physics students for future careers, educators need to understand the skills and other factors necessary for entry and success on the job. Often these insights are based on CEOs, HR personnel, and managers, who provide broad perspectives regarding successful attributes of new hires. However, such insights are often more general and disconnected from specific jobs than insights gained from entry-level employees who recently transitioned from school to work. Using in-depth descriptive summaries and thematic analysis from interviews with six recently hired technicians and engineers in the field of optics, we explored factors that influenced their entry and success on the job. Six themes arose: documentation, computational skills, specialized learning, question asking, tinkering skills, and navigating cultural differences. We discuss the implications of these themes in both their value to employees as well as integration into the physics curriculum.

The reliability and validity of inventories should be verified in multiple ways. Although the epistemological beliefs about the physical science survey (EBAPS) has been deemed to be reliable and valid by the authors, the axes or factor structure proposed by the authors has not been independently checked. Using data from a study sample we discussed in previous publications, we performed exploratory factor analysis on 1,258 post-test EBAPS surveys. The students in the sample were from an introductory Astronomy course at a mid-sized western university. Inspection suggested the use of either a three-factor model or a five-factor model. Each of the factors is interpreted and discussed, and the factors are compared to the axes proposed by the authors of the EBAPS. We find that the five-factor model extrapolated from our data partially overlaps with the model put forth by the authors of the EBAPS, and that many of the questions did not load onto any factors.

This paper is inspired by the widely accepted need to develop critical thinking in physics students and teachers. More specifically, it is focused on the development of a critical attitude in prospective physics teachers. The question of a possible interplay between the development of conceptual comprehension and that of a critical attitude prompted us to conduct a series of investigations with teachers at the end of their preparation. The goal of this paper is to provide a synthesis of five previously published papers on this topic in order to inform discussion about teacher preparation. Each investigation is centered on a particular aspect of physics, and all are based on in-depth interviews with different participants. We focus on prospective teachers’ “intellectual dynamics,” that is, the way their comprehension of nonobvious topics and their critical attitudes evolve during these interviews, taking into account metacognitive and affective aspects such as intellectual satisfaction and self-esteem. We characterize several types of intellectual dynamics: “early critique,” “delayed critique,” “unstable critique,” and “expert anesthesia” and provide information on their frequency. An overall conclusion is that in this type of context, that is, a guided intellectual pathway of about an hour, the development of conceptual comprehension and critical attitude are most often deeply entangled. We discuss the implications of these results for future research and we advocate new objectives and strategies for physics teachers’ preparation.

Studies on physics identity are appearing more frequently and often responding to increased awareness of the underrepresentation of students of color in physics. In our broader research, we focus our efforts on understanding how racial identity and physics identity are negotiated throughout the experiences of Black physicists. In this paper, we present a Critical Physics Identity framework that can be used to examine racialized physics identity and demonstrate the utility of this framework by analyzing interviews with four physicists. Our framework draws from prior constructs of physics identity and racialized identity and provides operational definitions of six interacting dimensions. In this paper, we present the operationalized constructs, demonstrate how we use these constructs to code narrative data, as well as outline three methods of analysis that may be applied to study systems and structures and their influences on the experiences of Black students.

The lack of an engaging pedagogy and the highly competitive atmosphere in introductory science courses tend to discourage students from pursuing science, technology, engineering, and mathematics (STEM) majors. Once in a STEM field, academic and social integration has been long thought to be important for students’ persistence. Yet, it is rarely investigated. In particular, the relative impact of in-class and out-of-class interactions remains an open issue. Here, we demonstrate that, surprisingly, for students whose grades fall in the “middle of the pack,” the out-of-class network is the most significant predictor of persistence. To do so, we use logistic regression combined with Akaike’s information criterion to assess in- and out-of-class networks, grades, and other factors. For students with grades at the very top (and bottom), final grade, unsurprisingly, is the best predictor of persistence—these students are likely already committed (or simply restricted from continuing) so they persist (or drop out). For intermediate grades, though, only out-of-class closeness—a measure of one’s immersion in the network—helps predict persistence. This does not negate the need for in-class ties. However, it suggests that, in this cohort, only students that get past the convenient in-class interactions and start forming strong bonds outside of class are or become committed to their studies. Since many students are lost through attrition, our results suggest practical routes for increasing students’ persistence in STEM majors.

Because of its abstract nature, Albert Einstein’s theory of general relativity is rarely present in school physics curricula. Although the educational community has started to investigate ways of bringing general relativity to classrooms, field-tested educational material is rare. Employing the model of educational reconstruction, we present a collaborative online learning environment that was introduced to final year students (18–19 years old) in six Norwegian upper secondary physics classrooms. Design-based research methods guided the development of the learning resources, which were based on a sociocultural view of learning and a historical-philosophical approach to teaching general relativity. To characterize students’ learning from and interaction with the learning environment we analyzed focus group interviews and students’ oral and written responses to assigned problems and discussion tasks. Our findings show how design choices on different levels can support or hinder understanding of general relativity, leading to the formulation of design principles that help to foster qualitative understanding and encourage collaborative learning. The results indicate that upper secondary students can obtain a qualitative understanding of general relativity when provided with appropriately designed learning resources and sufficient scaffolding of learning through interaction with teacher and peers.

Evidence from psychology, cognitive science, and neuroscience suggests that cognition and emotions are coupled. Education researchers have also documented correlations between emotions (such as joy, anxiety, fear, curiosity, boredom) and academic performance. Nonetheless, most research on students’ reasoning and conceptual change within the learning sciences and physics and science education research has not attended to the role of learners’ emotions in describing or modeling the fine timescale dynamics of their conceptual reasoning. The few studies that integrate emotions into models of learners’ cognition have mostly done so at a coarse grain size. In this study, toward the long-term goal of incorporating emotions into models of in-the-moment cognitive dynamics, we present a case study of Judy, an undergraduate electrical engineering and physics major. We show that shifts in the intensity of a fine-grained aspect of Judy’s emotions, her annoyance at conceptual homework problems, co-occur with shifts in her epistemological stance toward differentiating knowledge about and the practical utility of real circuits and idealized circuit models. We then argue for the plausibility of a cognitive model in which Judy’s emotions and epistemological stances mutually affect each other. We end with discussions on how models of learners’ cognition that incorporate their emotions are generative for instructional purposes and research on learning.

Encouraged by positive clinical results at the University of Illinois, mastery-style homework was integrated into a large semester-long preparatory physics course via an online homework system that used narrated animated video solutions as correctives. This paper discusses the impact and evolution of the homework in its first two years. The first iteration revealed that students were frustrated and did not engage with the system in an effective way. Intending to reduce that frustration and quell negative behavior, the mastery requirement was relaxed, transfer between versions was reduced, and the addition of a direct discussion with students about the homework were implemented in its second year. The results showed that details of implementation can substantially affect students’ behavior; large and statistically significant effects were observed as a reduction in frustration (with self-identified “frustrated” students dropping from 60% in 2014 to 30% in 2015) and improvement in performance (average student mastery rate of 59% to 69%).

Research into teacher learning and practice over the last three decades shows that the teachers of a specific subject need to possess knowledge that is different from the knowledge of other content experts. Yet this specialized version of content knowledge that teachers need to plan instruction, respond to student ideas, and assess student understanding in real time is a theoretically elusive construct. It is crucial for the fields of precollege teacher preparation, teacher professional education, and postsecondary faculty professional development to (a) clarify the construct that underlies this specialized content knowledge, (b) operationalize it in some domain, (c) measure it in both static contexts and as it is enacted in the classroom, and (d) correlate its presence with “richness” of classroom instruction and its effect on student learning. This paper documents a piece of a multiyear, multi-institutional effort to investigate points (a)–(d) in the domain of energy in the first high school physics course. In particular, we describe the framework that we developed to clarify content knowledge for teaching in the context of high school energy learning. We then outline the process through which we developed, tested, and refined a “paper-and-pencil” assessment administered on a computer and discuss the substantive and psychometric features of several items based on a field test of the final form of the assessment. We choose to discuss these items for a dual purpose: to illustrate the application of our general framework and to present performance findings from a sample of 362 practicing high school teachers of physics.

A generally agreed upon tenant of the physics teaching community is the centrality of subject-specific expertise in effective teaching. However, studies which assess the content knowledge of incoming K–12 physics teachers in the U.S. have not yet been reported. Similarly lacking are studies on if or how the demographic makeup of aspiring physics educators is different from previously reported analyses of the actual high school physics teaching workforce. Here we present findings about the demographics and subject knowledge of prospective high school physics teachers using data from Praxis physics subject assessments administered between 2006 and 2016. Our analysis reveals significant variations in exam participation and performance between men and women, as well as those with different undergraduate majors and academic performance over the past decade. Findings from this work inform understandings and decisions about the quality, recruitment, and preparation of the high school physics teaching workforce.

When considering performing an Introductory Physics for Life Sciences course transformation for one’s own institution, life science majors’ achievement goals are a necessary consideration to ensure the pedagogical transformation will be effective. However, achievement goals are rarely an explicit consideration in physics education research topics such as metacognition. We investigate a sample population of 218 students in a first-semester introductory algebra-based physics course, drawn from 14 laboratory sections within six semesters of course sections, to determine the influence of achievement goals on life science majors’ attitudes towards physics. Learning orientations that, respectively, pertain to mastery goals and performance goals, in addition to a learning orientation that does not report a performance goal, were recorded from students in the specific context of learning a problem-solving framework during an in-class exercise. Students’ learning orientations, defined within the context of students’ self-reported statements in the specific context of a problem-solving-related research-based course implementation, are compared to pre-post results on physics problem-solving items in a well-established attitudinal survey instrument, in order to establish the categories’ validity. In addition, mastery-related and performance-related orientations appear to extend to overall pre-post attitudinal shifts, but not to force and motion concepts or to overall course grade, within the scope of an introductory physics course. There also appears to be differentiation regarding overall course performance within health science majors, but not within biology majors, in terms of learning orientations; however, health science majors generally appear to fare less well on all measurements in the study than do biology majors, regardless of learning orientations.

In 1995, Huffman and Heller used exploratory factor analysis to draw into question the factors of the Force Concept Inventory (FCI). Since then several papers have been published examining the factors of the FCI on larger sets of student responses and understandable factors were extracted as a result. However, none of these proposed factor models have been verified to not be unique to their original sample through the use of independent sets of data. This paper seeks to confirm the factor models proposed by Scott et al. in 2012, and Hestenes et al. in 1992, as well as another expert model proposed within this study through the use of confirmatory factor analysis (CFA) and a sample of 20 822 postinstruction student responses to the FCI. Upon application of CFA using the full sample, all three models were found to fit the data with acceptable global fit statistics. However, when CFA was performed using these models on smaller sample sizes the models proposed by Scott et al. and Eaton and Willoughby were found to be far more stable than the model proposed by Hestenes et al. The goodness of fit of these models to the data suggests that the FCI can be scored on factors that are not unique to a single class. These scores could then be used to comment on how instruction methods effect the performance of students along a single factor and more in-depth analyses of curriculum changes may be possible as a result.

Assessing student learning is a cornerstone of educational practice. Standardized assessments have played a significant role in the development of instruction, curricula, and educational spaces in college physics. However, the use of these assessments to evaluate student learning is only productive if they continue to align with our learning goals. Recently, there have been calls to elevate the process of science (“scientific practices”) to the same level of importance and emphasis as the concepts of physics (“core ideas” and “crosscutting concepts”). We use the recently developed Three-Dimensional Learning Assessment Protocol to investigate how well the most commonly used standardized assessments in introductory physics (i.e., concept inventories) align with this modern understanding of physics education’s learning goals. We find that many of the questions on concept inventories do elicit evidence of student understanding of core ideas, but do not have the potential to elicit evidence of scientific practices or crosscutting concepts. Furthermore, we find that the individual scientific practices and crosscutting concepts that are assessed using these tools are limited to a select few. We discuss the implications that these findings have on designing and testing curricula and instruction both in the past and for the future.

As part of a research study on student reasoning in quantum mechanics, we examine students’ use of ontologies, or the way students’ categorically organize entities they are reasoning about. In analyzing three episodes of focus group discussions with modern physics students, we present evidence of the dynamic nature of ontologies, and refine prior theoretical frameworks for thinking about dynamic ontologies. We find that in a given reasoning episode ontologies can be dynamic in construction (referring to when the reasoner constructs the ontologies) or application (referring to which ontologies are applied in a given reasoning episode). In our data, we see instances of students flexibly switching back and forth between parallel stable structures as well as constructing and negotiating new ontologies in the moment. Methodologically, we use a collective conceptual blending framework as an analytic tool for capturing student reasoning in groups. In this research, we value the messiness of student reasoning and argue that reasoning in a tentative manner can be productive for students learning quantum mechanics. As such, we shift away from a binary view of student learning which sees students as either having the correct answer or not.

We investigated physics students’ epistemological views on measurements and validity of experimental results. The roles of experiments in physics have been underemphasized in previous research on students’ personal epistemology, and there is a need for a broader view of personal epistemology that incorporates experiments. An epistemological framework incorporating the structure, methodology, and validity of scientific knowledge guided the development of an open-ended survey. The survey was administered to students in algebra-based and calculus-based introductory physics courses, upper-division physics labs, and physics Ph.D. students. Within our sample, we identified several differences in students’ ideas about validity and uncertainty in measurement. The majority of introductory students justified the validity of results through agreement with theory or with results from others. Alternatively, Ph.D. students frequently justified the validity of results based on the quality of the experimental process and repeatability of results. When asked about the role of uncertainty analysis, introductory students tended to focus on the representational roles (e.g., describing imperfections, data variability, and human mistakes). However, advanced students focused on the inferential roles of uncertainty analysis (e.g., quantifying reliability, making comparisons, and guiding refinements). The findings suggest that lab courses could emphasize a variety of approaches to establish validity, such as by valuing documentation of the experimental process when evaluating the quality of student work. In order to emphasize the role of uncertainty in an authentic way, labs could provide opportunities to iterate, make repeated comparisons, and make decisions based on those comparisons.

A critical component of scientific reasoning is the consideration of alternative explanations. Recognizing that decades of cognitive psychology research have demonstrated that relative cognitive accessibility, or “what comes to mind,” strongly affects how people reason in a given context, we articulate a simple “cognitive accessibility rule”, namely that alternative explanations are considered less frequently when an explanation with relatively high accessibility is offered first. In a series of four experiments, we test the cognitive accessibility rule in the context of consideration of alternative explanations for six physical scenarios commonly found in introductory physics curricula. First, we administer free recall and recognition tasks to operationally establish and distinguish between the relative accessibility and availability of common explanations for the physical scenarios. Then, we offer either high or low accessibility explanations for the physical scenarios and determine the extent to which students consider alternatives to the given explanations. We find two main results consistent across algebra- and calculus-based university level introductory physics students for multiple answer formats. First, we find evidence that, at least for some contexts, most explanatory factors are cognitively available to students but not cognitively accessible. Second, we empirically verify the cognitive accessibility rule and demonstrate that the rule is strongly predictive, accounting for up to 70% of the variance of the average student consideration of alternative explanations across scenarios. Overall, we find that cognitive accessibility can help to explain biases in the consideration of alternatives in reasoning about simple physical scenarios, and these findings lend support to the growing number of science education studies demonstrating that tasks relevant to science education curricula often involve rapid, automatic, and potentially predictable processes and outcomes.