[This paper is part of the Focused Collection on Curriculum Development: Theory into Design.] When we examined student responses to questions about the direction of the static friction force in various situations, we both had strong ideas about how to write a tutorial to promote deeper understanding. But our ideas were quite different. In this theoretical paper, we present the two contrasting tutorials and show how their differences can be traced to different theoretical orientations toward cognition and learning. We do not claim that one tutorial—or the theoretical framework loosely associated with it—is superior. Instead, we hope to illustrate two claims. One, we show in detail how curriculum designers’ cognitive “theories” (frameworks), even if largely tacit during the act of creation, shape the resulting tutorials. Two, we show how, at least for us, articulating and discussing our respective theoretical orientations and their influence on our tutorial writing enables a rethinking of long-standing tutorial-writing habits. We argue that instructional intuition—shaped by explicit and tacit theoretical assumptions—functions well in guiding the design of curriculum, as our contrasting tutorials illustrate; but more systematic attention to the underlying theoretical assumptions can productively inform refinements.

[This paper is part of the Focused Collection on Curriculum Development: Theory into Design.] The communities of practice framework has become an essential framework for understanding identity development both in physics education research (PER) and in science, technology, engineering, and mathematics, more broadly. However, the use of communities of practice as a learning theory that informs curriculum design is significantly less prevalent within the PER community. One possible reason for this is that communities of practice as a theory originated in professional environments and it subsequently moved towards a framework that is centered around informing management practices. Some significant interpretations and negotiations need to be completed in order to apply and to design for communities of practice in the classroom environment. In this paper, we outline an introductory physics course called Projects and Practices in Physics (P-Cubed) that was designed using the communities of practice as a guiding framework. We present the curriculum decisions that focus specifically on the adaption process from professional practice to the classroom context along with the theoretical underpinnings of the curriculum design decisions that went into the development of the P-Cubed classroom.

[This paper is part of the Focused Collection on Curriculum Development: Theory into Design.] This paper proposes the rethinking of the division of labor between physics education research curriculum developers and classroom instructors. Historically, both curriculum developers and instructors have taken responsibility for fostering students’ conceptual development, epistemological development, and other learning goals related to physics content knowledge and practices or process skills. By contrast, responsibility for fostering productive group dynamics has been taken up almost entirely by instructors. Tutorial and lab developers structure their materials to be used in small groups, but have not generally designed, tested, and refined their materials to minimize problematic group dynamics. In this paper, we argue that the written tutorial can and should do more to prevent negative group dynamics from arising. To make this claim plausible, we describe an example from our own experience. While revising a tutorial, we noticed some problematic dynamics emerging; one of the students was unfairly blamed for a simulation-setting mistake and was later left out of a conversation. We came up with hypotheses about factors that might have contributed to those dynamics. A few of those factors, we argue, could be addressed in part through tutorial revision. While acknowledging that instructors will always have more capacity and hence more responsibility than curriculum writers to foster productive group dynamics, we call for tutorial writers, during the testing and revision of their materials, to monitor how the tutorial impacts team dynamics and to be transparent (in publications and presentations) about how they modified the tutorial to address problematic dynamics they observed.

[This paper is part of the Focused Collection on Curriculum Development: Theory into Design.] We discuss the theoretical underpinnings that informed the considerations and decisions that shaped the design of a curriculum unit entitled “Electromagnetic radiation—principles, applications, and decisions”. This unit is part (45 h) of the compulsory general science requirement for the Israeli high school matriculation curriculum in science for students who choose not to major in any scientific discipline. Its goal is to develop scientific literacy rather than expertise. During the problematizing phase that preceded the design we identified two challenges presented by the formal goal of the unit and its target audience: (i) how to foster meaningful engagement on the part of diverse groups of “outsiders to science” with complex scientific content such as electromagnetic radiation, (ii) how to translate scientific and engineering findings related to a complex phenomenon such as electromagnetic radiation, which emerge within a context of specialized knowledge and vocabulary, into lay language without corrupting their meaning. The first section of this article explores these questions through a theoretical discussion of (i) relevance, personal relevance, and meaningfulness; (ii) the implications of pursuing personal relevance on the meaning ascribed to scientific literacy of nonscientists, and the ways to support its development in school; and (iii) the ways in which personal relevance comes to bear on the choice of content and explanatory means. We then illustrate how these theoretical principles and insights were translated into curriculum design.

[This paper is part of the Focused Collection on Curriculum Development: Theory into Design.] Research in physics education has contributed substantively to improvements in the learning and teaching of university physics by informing the development of research-based instructional materials for physics courses. Reports on the design of these materials have tended to focus on overall improvements in student performance, while the role of theory in informing the development, refinement, and assessment of the materials is often not clearly articulated. In this article, we illustrate how dual-process theories of reasoning and decision making have guided the ongoing development, testing, and analysis of an instructional intervention, implemented at three different institutions, designed to build consistency in student reasoning about the application of Newton’s 2nd law to objects at rest. By employing constructs from cognitive science associated with dual-process theories of reasoning (such as mindware and cognitive reflection), we were able not only to examine the overall improvement in student performance but also to investigate the impact of the intervention on two aspects of productive reasoning—mindware and cognitive reflection. Our analysis showed that the intervention strengthened students’ mindware such that students were able to apply it as a criterion while checking the validity of their intuitive responses. Moreover, logistic regression revealed that the success of our intervention was mediated by the students’ cognitive reflection skills. Indeed, for students with comparable mindware, those who demonstrated a weaker tendency toward cognitive reflection were less likely to initiate conflict detection and therefore never had the opportunity to utilize their mindware. We believe that this kind of integrated, theory-driven approach to intervention design and testing represents an important first step in efforts to both account for and leverage domain-general reasoning phenomena in the learning and teaching of physics.

[This paper is part of the Focused Collection on Curriculum Development: Theory into Design.] This manuscript discusses how learning theories have been applied to shape multiple aspects of the design of curricular activities combining interactive computer simulations and University of Washington style tutorials (so-called simulation-tutorials). When considering the curriculum goals (what to teach), we drew on theories of representational competence and learning with multiple representations. When considering how to teach, we drew on theories of constructivism and sketching to learn, leveraging the advantages of sketching as a constructive process that requires students to make their current understanding explicit in visual form, to make specific choices in order to make their ideas concrete, and to organize information to support deep processing. When considering when and why to sketch, we drew upon theories of representational competence, learning with multiple representations and inventing to prepare for future learning to describe six distinct purposes of sketching both prior to and while working with the simulation. This is illustrated by presenting specific sketching tasks to show how theory informed the design and the sequencing of the tasks. We followed a design-based research method, working at two institutions in two countries and with multiple cohorts of students to understand, and where necessary improve, the design of these activities, primarily basing our decisions on the sketches that students had created. The key message of this research is that the design and sequencing of sketching tasks needs to be carefully matched to the pedagogical rationale and that theory can shape these decisions in many ways.

[This paper is part of the Focused Collection on Curriculum Development: Theory into Design.] Our investigation of 353 faculty-produced multiple-choice Think-Pair-Share questions leads to key insights into faculty members’ ideas about the discipline representations and intellectual tasks that could engage learners on key topics in physics and astronomy. The results of this work illustrate that, for many topics, there is a lack of variety in the representations featured, intellectual tasks posed, and levels of complexity fostered by the questions faculty develop. These efforts motivated and informed the development of two frameworks: (i) a curriculum characterization framework that allows us to systematically code active learning strategies in terms of the discipline representations, intellectual tasks, and reasoning complexity that an activity offers the learner, and (ii) a curriculum development framework that guides the development of activities deliberately focused on increasing learners’ discipline fluency. We analyze the faculty-produced Think-Pair-Share questions with our curriculum characterization framework, then apply our curriculum development framework to generate (i) fluency-inspiring questions, a more pedagogically powerful extension of a well-established instructional strategy, and (ii) Student Representation Tasks, a brand new type of instructional activity in astronomy that shifts the responsibility for generating appropriate representations onto the learners. We explicitly unpack and provide examples of fluency-inspiring questions and Student Representation Tasks, detailing their usage of pedagogical discipline representations coupled with novel question and activity formats.

Public engagement is an important component of the operation of many physics organizations, such as physics departments. However, comparatively little work has been done to systematize the study of pedagogical approaches in these informal environments, which may contain unique affordances and challenges compared to formal settings. A 2016 study took an important step toward a comprehensive understanding of pedagogy in informal environments by developing a model articulating three so-called “modes of pedagogy,” utilizing cultural-historical activity theory to categorize pedagogy of volunteer instructors. To build upon this model, we have conducted a more thorough study at a University of Colorado Boulder-based informal physics education program, following similar methods but expanding upon the methodology to generate more robust insights into instructors’ pedagogy. The study has produced three major results. First, we have broadly corroborated the findings of the 2016 study, observing similar distributions of enacted pedagogical preferences among our volunteer instructors. Second, we have expanded upon recommendations in the 2016 study for methods of instructor preparation; specifically, we find that presemester training is insufficient to effect a lasting change in instructors’ enacted pedagogy. Third, we have refined the pedagogical modes model presented in that work, moving away from a categorical articulation of the modes in favor of a model where instructors’ pedagogy is characterized by combinations of traits and mediated by their overarching objectives for students. These two novel additions to the pedagogical modes framework allow for a more nuanced and comprehensive characterization of the pedagogical techniques used by instructors in informal learning environments, improving both our understanding of the methods of informal pedagogy and our ability to prepare instructors to succeed.

Scientific abilities rubrics developed at Rutgers University are an assessment and self-assessment tool. They consist of tables, each representing a broad scientific ability (for example, “to collect and analyze data”), the listing of subabilities (for example, “independent and dependent variables are identified”) and the criteria to assess to which degree the subability has been developed. We introduced scientific abilities rubrics to assess student work in the project laboratory, a project-based course where groups of students solve open-ended experimental physics problems. They submit a report in the form of a web page, which is evaluated and returned to the students with feedback on what needs to be improved. These iterations are repeated until the report is deemed acceptable. We present our experience with the rubrics, and the development of a new rubric for the web report. We show that the introduction of the rubrics reduced the workload of the graders, while increasing the quality of the reports. Based on these results we conclude that using scientific abilities rubrics is a very efficient way of assessing experimental project-based work. We also present an analysis of which abilities, assessed by the rubrics, appear to be the most difficult to develop.

Young children, students, and adults may have alternative ideas about the motion of the Sun and stars as we observe them in the sky. However, a good understanding of this apparent motion is essential as a starting point to study more advanced astronomical concepts, especially when these include astronomical observations. In this paper, we describe the development and validation of the apparent motion of Sun and stars (AMoSS) test, which can measure to what extent students have insight into the apparent motion of the Sun and stars. We propose a framework that allows one to compare students’ understanding of the specific aspects of these apparent motions in relation to the time of the day, time of the year, and the observer’s latitude. For each of these aspects, we designed test items for both the Sun and the symmetric apparent motion aspect of the stars. The reliability and validity of the test are established by analyzing answers of both secondary school and university students and by presenting the questions to a panel of experts. We report on the design and validation process and present the final version of the test.

Much work has been done to characterize the reasoning of students as they solve mathematics-intensive problems and characterizing differences in expert and novice problem solving. In this work, we characterize the problem-solving strategies in a classroom setting of “transitioning novices,” students who have completed an introductory physics course and have learned some problem-solving strategies, but are far from expertlike in their reasoning. We find that students mostly use intermediate strategies that reflect an understanding of specific relationships between quantities, such as analyzing the units of an expression, to reason about mathematical expressions. Few students use more sophisticated strategies like checking limits, which require students to run mental simulations to predict how a system will behave as different physical variables are changed. The teaching of more advanced strategies like limit checking will require careful scaffolding of the cognitive complexity, as students generally do not succeed when simply told to check limits. This is supported by the findings of Lin and Singh [Phys. Rev. Phys. Educ. Res. 7, 020104 (2011)] that careful scaffolding is needed to help students solve more complex problems. In this particular group, students were able to successfully analyze the dimensions of an expression and compute component forces and torques to check if their answer made sense. Our results show that there is a need to recognize and teach these intermediary strategies to enable more novice students to check their answers and encourage students to become more expertlike.

Previous studies have demonstrated that students have difficulties in applying the wave model of light to explain single-slit diffraction and double-slit interference patterns. In this study, we investigated if students could recognize typical interference and diffraction patterns at all. Eye movements of high-school students were measured while they were identifying patterns produced by monochromatic light on a double slit, single slit, and diffraction grating, and by white light on a diffraction grating. Most students had difficulties with recognizing double-slit interference pattern and diffraction grating pattern of monochromatic light. Identification of the single-slit diffraction pattern was easier probably due to its distinguishable central maximum. The easiest task for students was recognizing the diffraction pattern of white light on an optical grating. Eye-tracking data suggested that even students who incorrectly answered this question were aware that the diffraction grating separates white light into colors. Additionally, eye tracking revealed that students who identified patterns correctly attended more the correct pattern than other options, thus corroborating previous findings. Overall, the results indicate that the recognition of interference and diffraction patterns is quite demanding for students, suggesting that more attention should be paid to observing and understanding basic wave optics phenomena.

Racial or ethnic isolation may negatively impact physics graduate students’ academic and professional experience. An interview study with 16 doctoral students who were considered to be particularly at risk of such isolation found that (i) the students interviewed are mostly not the only member of their racial or ethnic group in their programs; (ii) students have diverse perceptions of who they consider to be part of their racial or ethnic group, such that their unique perspectives need to be taken into account by programs that wish to support them; and (iii) students report negative racial experiences in their programs, such as bias, expectations of service, family and financial difficulties, and political threats. Overall, these findings present both challenges and opportunities for supporting Black and Latinx physics graduate students in ways that are meaningful to them.

Quantum sensing, quantum networking and communication, and quantum computing have attracted significant attention recently, as these quantum technologies could offer significant advantages over existing technologies. In order to accelerate the commercialization of these quantum technologies, the workforce must be equipped with the necessary skills. Through a qualitative study of the quantum industry, in a series of interviews with 21 U.S. companies carried out in Fall 2019, we describe the types of activities being carried out in the quantum industry, profile the types of jobs that exist, and describe the skills valued across the quantum industry, as well as in each type of job. The current routes into the quantum industry are detailed, providing a picture of the current role of higher education in training the quantum workforce. Finally, we present the training and hiring challenges the quantum industry is facing and how higher education may optimize the important role it is currently playing.

Machine learning algorithms have recently been used to predict students’ performance in an introductory physics class. The prediction model classified students as those likely to receive an A or B or students likely to receive a grade of C, D, F or withdraw from the class. Early prediction could better allow the direction of educational interventions and the allocation of educational resources. However, the performance metrics used in that study become unreliable when used to classify whether a student would receive an A, B, or C (the ABC outcome) or if they would receive a D, F or withdraw (W) from the class (the DFW outcome) because the outcome is substantially unbalanced with between 10% to 20% of the students receiving a D, F, or W. This work presents techniques to adjust the prediction models and alternate model performance metrics more appropriate for unbalanced outcome variables. These techniques were applied to three samples drawn from introductory mechanics classes at two institutions ($N=7184$, 1683, and 926). Applying the same methods as the earlier study produced a classifier that was very inaccurate, classifying only 16% of the DFW cases correctly; tuning the model increased the DFW classification accuracy to 43%. Using a combination of institutional and in-class data improved DFW accuracy to 53% by the second week of class. As in the prior study, demographic variables such as gender, underrepresented minority status, first-generation college student status, and low socioeconomic status were not important variables in the final prediction models.

This study uses positional analysis to describe the student interaction networks in four research-based introductory physics curricula. Positional analysis is a technique for simplifying the structure of a network into blocks of actors whose connections are more similar to each other than to the rest of the network. This method describes social structure in a way that is comparable between networks of different sizes and densities and can show large-scale patterns such as hierarchy among positions. We detail one positional analysis method and apply it to class sections of Peer Instruction, SCALE-UP, ISLE, and Minnesota Model context-rich problems. At the level of detail shown in the blockmodels, most of the curricula are more alike than different, showing a late-term tendency to form coherent subgroups that communicate actively among themselves but have few interposition links. Initial position assignments tend to change from beginning to end of the term, but in cases where the initial assignment is stable, those students appear to become more connected to each other and to the largest network component. These trends in position structure and stability may be network signatures of active learning classes, but wider data collection is needed to investigate.

We present the analysis of the planetarium usage survey (PLUS), a two-part, mixed-methods initial study investigating planetarium use in the U.S. by undergraduate learners. Seventy-seven planetariums situated on college or university campuses within the U.S. completed an online survey during the fall of 2018 with 11 of those participating in online or phone interviews during the summer of 2019. Planetarium representatives described how their facilities were being used, types of subject materials that were being taught, what content styles are used, and how often learners are attending lessons in the planetarium. Results suggest that undergraduate learners in a planetarium environment are primarily novice, non-STEM (science, technology, engineering, and mathematics) majoring students, learning principally astronomy content, receiving instruction from a live presenter approximately once per month within a given course, for the purpose of receiving visualization-based scaffolding. Audience response systems like iClickers do not appear to be in widespread use in collegiate planetariums, and presented subject matter shows greater variety in planetariums with digital projector capacity as opposed to those with only analog projectors. Refinements to PLUS and future research plans are described.

We investigate the effects of guided group work sessions on graduate student performance on a quantum mechanics assessment. Data from a single large Midwestern university were taken over a five-year period, during which guided group work sessions were offered to accompany the graduate-level quantum mechanics course. Students were pre- and post-tested using a set of mostly conceptual items that we call the graduate quantum mechanics assessment. The reliability and validity of this assessment are addressed. A mixed linear model is used to analyze the dependence of post-test scores on factors such as group work attendance, pretest scores, GRE Physics scores, and others. We find a statistically significant effect of group work attendance on post-pre gains, specifically that attendance of one 60-min group work session improves performance on a related post-test item by 6.4%, administered 2–10 weeks after the session. We discuss the lack of a randomized control group and address possible confounding effects such as student self-selection, and attitudinal and motivational factors. Overall, the results of this study indicate that guided group work sessions at the graduate level can be feasible and effective. We note preliminary observations of differences in group interactions and classroom logistics compared to group work at the undergraduate level.