We describe Module Analysis for Multiple Choice Responses (MAMCR), a new methodology for carrying out network analysis on responses to multiple choice assessments. This method is used to identify modules of non-normative responses which can then be interpreted as an alternative to factor analysis. MAMCR allows us to identify conceptual modules that are present in student responses that are more specific than the broad categorization of questions that is possible with factor analysis and to incorporate non-normative responses. Thus, this method may prove to have greater utility in helping to modify instruction. In MAMCR the responses to a multiple choice assessment are first treated as a bipartite, student X response, network which is then projected into a response X response network. We then use data reduction and community detection techniques to identify modules of non-normative responses. To illustrate the utility of the method we have analyzed one cohort of postinstruction Force Concept Inventory (FCI) responses. From this analysis, we find nine modules which we then interpret. The first three modules include the following: Impetus Force, More Force Yields More Results, and Force as Competition or Undistinguished Velocity and Acceleration. This method has a variety of potential uses particularly to help classroom instructors in using multiple choice assessments as diagnostic instruments beyond the Force Concept Inventory.

Model analysis provides a mechanism for representing student learning as measured by standard multiple-choice surveys. The model plot contains information regarding both how likely students in a particular class are to choose the correct answer and how likely they are to choose an answer consistent with a well-documented conceptual model. Unfortunately, Bao’s original presentation of the model plot did not include a way to represent uncertainty in these measurements. I present details of a method to add error bars to model plots by expanding the work of Sommer and Lindell. I also provide a template for generating model plots with error bars.

The existence of gender differences in student performance on conceptual assessments and their responses to attitudinal assessments has been repeatedly demonstrated. This difference is often present in students’ preinstruction responses and persists in their postinstruction responses. However, one area in which the presence of gender differences has not been extensively explored is undergraduate laboratory courses. For example, one of the few laboratory focused research-based assessments, the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS), has not been tested for the existence of gender differences in students’ responses. Here, we utilize a national data set of responses to the E-CLASS to determine if they demonstrate significant gender differences. We also investigate how these differences vary along multiple student and course demographic slices, including course level (first-year vs beyond-first-year) and major (physics vs nonphysics). We observe a gender gap in pre- and postinstruction E-CLASS scores in the aggregate data both for the overall score and for most items individually. However, for some subpopulations (e.g., beyond-first-year students) the size or even existence of the gender gap depends on another dimension (e.g., student major). We also find that for all groups the gap in postinstruction scores vanishes or is greatly reduced when controlling for preinstruction scores, course level, and student major.

In experimental physics, lab notebooks play an essential role in the research process. For all of the ubiquity of lab notebooks, little formal attention has been paid to addressing what is considered “best practice” for scientific documentation and how researchers come to learn these practices in experimental physics. Using interviews with practicing researchers, namely, physics graduate students, we explore the different experiences researchers had in learning how to effectively use a notebook for scientific documentation. We find that very few of those interviewed thought that their undergraduate lab classes successfully taught them the benefit of maintaining a lab notebook. Most described training in lab notebook use as either ineffective or outright missing from their undergraduate lab course experience. Furthermore, a large majority of those interviewed explained that they did not receive any formal training in maintaining a lab notebook during their graduate school experience and received little to no feedback from their advisors on these records. Many of the interviewees describe learning the purpose of, and how to maintain, these kinds of lab records only after having a period of trial and error, having already started doing research in their graduate program. Despite the central role of scientific documentation in the research enterprise, these physics graduate students did not gain skills in documentation through formal instruction, but rather through informal hands-on practice.

This paper describes the second year of a multi-year study on the implementation of Peer Instruction and PeerWise-inspired pedagogies in a physics methods course in a teacher education program at a large research university in Western Canada. In the first year of this study, Peer Instruction was implemented consistently in the physics methods course and teacher candidates were asked to submit five conceptual multiple-choice questions as a final assignment. In the second year of the study we incorporated PeerWise online tool to facilitate teacher candidates’ design of conceptual questions by allowing them to provide and receive feedback from their peers, and consequently improve their questions. We have found that as a result of this collaboration teacher candidates improved their pedagogical content knowledge as measured by the rubric developed for the study.

A lock-in amplifier is a versatile instrument frequently used in physics research. However, many students struggle with the basic operating principles of a lock-in amplifier which can lead to a variety of difficulties. To improve students’ understanding, we have been developing and evaluating a research-based tutorial which makes use of a computer simulation of a lock-in amplifier. The tutorial is based on a field-tested approach in which students realize their difficulties after predicting the outcome of simulated experiments involving a lock-in amplifier and check their predictions using the simulated lock-in amplifier. Then, the tutorial provides guidance and strives to help students develop a coherent understanding of the basics of a lock-in amplifier. The tutorial development involved interviews with physics faculty members and graduate students and iteration of many versions of the tutorial with professors and graduate students. The student difficulties with lock-in amplifiers and the development and evaluation of the research-based tutorial to help students develop a functional understanding of this device are discussed.

Through the transformation of undergraduate STEM courses, the Colorado Learning Assistant Program recruits and prepares talented STEM majors for careers in teaching by providing them with early, sustained teaching experiences. The research reported here compares teaching practices of K-12 teachers who served as learning assistants (LAs) as undergraduates to colleagues that were certified through the same teacher certification program but did not serve as LAs. Observations of teacher practices revealed that former LAs used significantly more reformed teaching practices than their colleagues, especially in their first year of teaching. These results suggest the LA Program serves as a valuable supplement to traditional teacher certification programs.

Interactive engagement-based (IE) physics classes have the potential to invigorate and motivate students, but students may resist or oppose the pedagogy. Understanding the major influences on student satisfaction is a key to successful implementation of such courses. In this study, we note that one of the major differences between IE and traditional physics classes lies in the interpersonal relationships between the instructor and students. Therefore, we introduce the interpersonal communication constructs of instructor credibility and facework as possible frameworks for understanding how instructors and students navigate the new space of interactions. By interpreting survey data ($N=161$ respondents in eight sections of an IE introductory algebra-based physics course), we found both frameworks to be useful in explaining variance in student ratings of their satisfaction in the course, although we are unable to distinguish at this point whether instructor credibility acts as a mediating variable between facework and course satisfaction.

The Modeling Instruction (MI) approach to introductory physics manifests significant increases in student conceptual understanding and attitudes toward physics. In light of these findings, we investigated changes in student self-efficacy while considering the construct’s contribution to the career-decision making process. Students in the Fall 2014 and 2015 MI courses at Florida International University exhibited a decrease on each of the sources of self-efficacy and overall self-efficacy ($N=147$) as measured by the Sources of Self-Efficacy in Science Courses-Physics (SOSESC-P) survey. This held true regardless of student gender or ethnic group. Given the highly interactive nature of the MI course and the drops observed on the SOSESC-P, we chose to further explore students’ changes in self-efficacy as a function of three centrality measures (i.e., relational positions in the classroom social network): inDegree, outDegree, and PageRank. We collected social network data by periodically asking students to list the names of peers with whom they had meaningful interactions. While controlling for PRE scores on the SOSESC-P, bootstrapped linear regressions revealed post-self-efficacy scores to be predicted by PageRank centrality. When disaggregated by the sources of self-efficacy, PageRank centrality was shown to be directly related to students’ sense of mastery experiences. InDegree was associated with verbal persuasion experiences, and outDegree with both verbal persuasion and vicarious learning experiences. We posit that analysis of social networks in active learning classrooms helps to reveal nuances in self-efficacy development.

Teaching assistants (TAs) that lead reformed recitations and labs must understand and buy into the design of the course and the research-based instructional strategies that the course requires in order to create high-fidelity implementations. We present a model that outlines possible influences on TAs’ buy-in and their in-class actions coupled with a method, using a Real-time Instructor Observation Tool-based [E. A. West et al. Phys. Rev. ST Phys. Educ. Res. 9, 010109 (2013)] exercise, to measure the effect of these influences that is not only quicker than interviews but also allows one to quantify these effects. We use this method to measure the influences on six graduate TAs teaching algebra-based introductory mechanics and electricity and magnetism recitations and labs (“mini studios”) at the University of Central Florida. The results from the exercise are confirmed by interview responses from the TAs. We find a relatively high degree of buy-in to the design of the course, yet this is not reflected in the TAs’ actions. The TAs’ actions appear to be most influenced by student responses and expectations which do not align with the design of the course. Our study examines the effect of three influences shown in our model, and we argue that our method could be easily adapted to examine additional influences.

In a recent study, the 30-question Force Concept Inventory (FCI) was theoretically split into two 14-question “half-length” tests (HFCIs) covering the same set of concepts and producing mean scores that can be equated to those of the original FCI. The HFCIs require less administration time and reduce test-retest issues when different versions are used in pre-post testing. This study experimentally evaluates the practical validity and measurement uncertainty of the HFCIs with three different college student populations. Measured mean scores on each HFCI were within $\sim 3\%$ of each other at every university. Measured mean score differences between the HFCI and FCI were also within $\sim 3\%$. These differences are less than the value of a single question on the 30-question FCI and are not statistically significant. The overall results suggest that, in conditions similar to this study, the HFCIs can be used as alternatives to the full-length FCI when total scores or score gains are the measurement goals.

Laboratories are an important part of science and engineering education, especially in the field of electronics. Yet very little research into the benefits of such labs to student learning exists. In particular, it is not well known what students do and, even more importantly, think during electronics laboratories. Therefore, we conducted a study based on video observation of second year students at 3 university campuses in Belgium during a traditional lab on first order $RC$ filters. In this laboratory, students spent the majority of their time performing measurements, while very little time was spent processing or discussing the results. This in turn resulted in hardly any time spent talking about content knowledge. Based on those observations, a new laboratory was designed that includes a preparation with a virtual oscilloscope, a black box approach during the lab session itself, and a form of quick reporting at the end of the lab. This adjusted laboratory was evaluated using the same methodology and was more successful in the sense that the students spent less time gathering measurements and more time processing and analyzing them, resulting in more content-based discussion.

[This paper is part of the Focused Collection on Gender in Physics.] This article analyzes masculinity and experimental practices within three different physics communities. This work is premised on the understanding that the discipline of physics is not only dominated by men, but also is laden with masculine connotations on a symbolical level, and that this limited and limiting construction of physics has made it difficult for many women to find a place in the discipline. Consequently, we argue that in order to further the understanding of gender dynamics within physics communities and enrich the current understandings about the lack of women in physics, perspectives from masculinity studies are crucial. The article draws on three different ethnographic case studies dealing with undergraduate students, graduate students, and research scientists.

[This paper is part of the Focused Collection on Gender in Physics.] Sexism occurs when men are believed to be superior to women, and is thought to be one of the reasons for women’s underrepresentation in physics and astronomy. The issue of sexism in physics and astronomy has not been thoroughly explored in the physics education literature and there is currently no clear language for discussing sexism in the field. This article seeks to begin a conversation on sexism in physics and astronomy and offer a starting point for language to discuss sexism in research groups and departments. Interviews with 21 women in graduate physics and astronomy programs are analyzed for their individual experiences of sexism. Although a subset of women did not report experiencing sexual discrimination, the majority experienced subtle insults and slights known as microaggressions. Other participants also experienced more traditional hostile sexism in the form of sexual harassment, gender role stereotypes, and overt discouragement. These results indicate the existence of sexism in the current culture of physics and astronomy, as well as the importance departments must put on eliminating it and educating students about sexism and microaggressions.

[This paper is part of the Focused Collection on Gender in Physics.] Active-learning approaches to teaching introductory physics have been found to improve student learning and affective gains on short-term outcomes [S. Freeman et al., Proc. Natl. Acad. Sci. U.S.A. 111, 8410 (2014)]; however, whether or not the benefits of active learning impact women to the same degree as men has been a point of concern [A. Madsen, S. B. McKagan, and E. C. Sayre, Phys. Rev. ST Phys. Educ. Res. 9, 020121 (2013)]. Further, the long-term impacts of active-learning experiences are also understudied. At Florida International University, a Hispanic-majority institution, we have implemented Modeling Instruction (MI) and the Integrated Science Learning Environment (ISLE) in introductory physics classes for the past decade. In this empirical paper, we report on a longitudinal investigation of student performance and persistence in upper level physics courses after having previously experienced MI or ISLE in their introductory physics courses, and disaggregate students by gender. Using survival analysis methods, we find women who declare physics as a major are more likely than men to graduate with a physics degree. Women are also just as likely as men to pass through the upper division courses, with the highest failure risk for both men and women occurring in the first semester of upper-division course taking. These results reinforce the need to expand considerations of performance outcomes to be longitudinal to measure the effectiveness of the entire physics experience.

[This paper is part of the Focused Collection on Gender in Physics.] This study examined the perceptions of 6th grade middle school students regarding physics and physics-related careers. The overarching goal of this work was to understand similarities and differences between girls’ and boys’ perceptions surrounding physics and physics-related careers as part of a long-term effort to increase female interest and representation in this particular field of science. A theoretical framework based on the literature of girl-friendly and integrated STEM instructional strategies guided this work to understand how instructional strategies may influence and relate to students’ perceptions. This convergent parallel mixed-methods study used a survey and focus group interviews to understand similarities and differences between girls’ and boys’ perceptions. Our findings indicate very few differences between girls and boys, but show that boys are more interested in the physics-related career of engineering. While girls are just as interested in science class as their male counterparts, they highly value the social aspect that often accompanies hands-on group activities. These findings shed light on how K-12 science reform efforts might help to increase the number of women pursuing careers related to physics.

[This paper is part of the Focused Collection on Gender in Physics.] This article synthesizes sociopsychological theories and empirical research to establish a framework for exploring causal pathways and targeted interventions for the low representation of women in post-secondary physics. The rationale for this article is based upon disproportionate representation among undergraduate physics majors in the United States; women earned only 19.7% of physics undergraduate degrees in 2012. This disparity has been attributed to a variety of factors, including unwelcoming classroom atmospheres, low confidence and self-efficacy, and few female role models in physics academic communities. Recent empirical studies have suggested gender disparities in physics and related STEM fields may be more amenable to social cognitive interventions than previously thought. Social psychologists have found that women improved physics self-concept when adopting a malleable view of intelligence, when they received support and encouragement from family and teachers, and when they experienced interactive learning techniques in communal environments. By exploring research-based evidence for strategies to support women in physics, precollege and university faculty and administrators may apply social cognitive constructs to improve the representation of women in the field.

[This paper is part of the Focused Collection on Gender in Physics.] Positive self-assessment of ability in the quantitative domains is considered critical for student participation in science, technology, engineering, and mathematics field studies. The present study investigated associations of gender compatibility (gender typicality and contentedness) and math-gender stereotypes with self-concepts in math and physics. Statistical analysis of survey data was based on a sample of 170 male and female high school science students matched on propensity scores based on age and past GPA scores in math. Results of MANCOVA analyses indicated that the combination of high personal gender compatibility with low endorsement of math-gender stereotypes was associated with low gender differentials in math and physics self-concepts whereas the combination of high personal gender compatibility with high endorsement of math-gender stereotypes was associated with high gender differentials in math and physics self-concepts. These results contribute to the recent theoretical and empirical work on antecedents to the math and physics identities critical to achieving gender equity in STEM fields.

[This paper is part of the Focused Collection on Gender in Physics.] In this article, we draw on previous reports from physics, science education, and women’s studies to propose a more nuanced treatment of gender in physics education research (PER). A growing body of PER examines gender differences in participation, performance, and attitudes toward physics. We have three critiques of this work: (i) it does not question whether the achievements of men are the most appropriate standard, (ii) individual experiences and student identities are undervalued, and (iii) the binary model of gender is not questioned. Driven by these critiques, we propose a conception of gender that is more up to date with other fields and discuss gender as performance as an extended example. We also discuss work on the intersection of identities [e.g., gender with race and ethnicity, socioeconomic status, lesbian, gay, bisexual, and transgender (LGBT) status], much of which has been conducted outside of physics. Within PER, some studies examine the intersection of gender and race, and identify the lack of a single identity as a key challenge of “belonging” in physics. Acknowledging this complexity enables us to further critique what we term a binary gender deficit model. This framework, which is implicit in much of the gender-based PER, casts gender as a fixed binary trait and suggests that women are deficient in characteristics necessary to succeed. Alternative models of gender allow a greater range and fluidity of gender identities, and highlight deficiencies in data that exclude women’s experiences. We suggest new investigations that diverge from this expanded gender framework in PER.