Previous research [Lorenzo et al., Am. J. Phys. 74, 118 (2006)] demonstrated that the difference in performance between male and female students can be reduced and even eliminated, in consistent fashion, by using interactive engagement techniques in the introductory physics classroom. The present paper describes similar studies in a different, large research university and finds that the use of interactive engagement techniques does not necessarily reduce the gender gap. Furthermore, in the environments studied, there is a gap in learning gains between male and female students $(p<0.01)$ whether partially or fully interactive classroom techniques are used. Our findings suggest that engaging students in interactive educational environments is not sufficient to reduce the gender gap, and we find instances where despite significant learning gains by all students, the gender gap is increased. There is indication that there are both student and instructor effects that impact the gender gap, which are the subjects of ongoing studies.

Preinstruction SAT scores and normalized gains $\left(G\right)$ on the force concept inventory (FCI) were examined for individual students in interactive engagement (IE) courses in introductory mechanics at one high school $(N=335)$ and one university $(N=292)$, and strong, positive correlations were found for both populations ($r=0.57$ and $r=0.46$, respectively). These correlations are likely due to the importance of cognitive skills and abstract reasoning in learning physics. The larger correlation coefficient for the high school population may be a result of the much shorter time interval between taking the SAT and studying mechanics, because the SAT may provide a more current measure of abilities when high school students begin the study of mechanics than it does for college students, who begin mechanics years after the test is taken. In prior research a strong correlation between FCI $G$ and scores on Lawson’s Classroom Test of Scientific Reasoning for students from the same two schools was observed. Our results suggest that, when interpreting class average normalized FCI gains and comparing different classes, it is important to take into account the variation of students’ cognitive skills, as measured either by the SAT or by Lawson’s test. While Lawson’s test is not commonly given to students in most introductory mechanics courses, SAT scores provide a readily available alternative means of taking account of students’ reasoning abilities. Knowing the students’ cognitive level before instruction also allows one to alter instruction or to use an intervention designed to improve students’ cognitive level.

This paper introduces a theory about the role of language in learning physics. The theory is developed in the context of physics students and physicists talking and writing about the subject of quantum mechanics. We found that physicists’ language encodes different varieties of analogical models through the use of grammar and conceptual metaphor. We hypothesize that students categorize concepts into ontological categories based on the grammatical structure of physicists’ language. We also hypothesize that students overextend and misapply conceptual metaphors in physicists’ speech and writing. Using our theory, we will show how, in some cases, we can explain student difficulties in quantum mechanics as difficulties with language.

We present results from a comparative study of student understanding for students who attended recitation classes that used different teaching methods. Student volunteers from our introductory calculus-based physics course attended a special recitation class that was taught using one of four different teaching methods. A total of 272 students were divided into approximately equal groups for each method. Students in each class were taught the same topic, “Changes in Energy and Momentum,” from Tutorials in Introductory Physics. The different teaching methods varied in the amount of student and teacher engagement. Student understanding was evaluated through pre- and post-tests. Our results demonstrate the importance of the instructor’s role in teaching recitation classes. The most effective teaching method was for students working in cooperative learning groups with the instructors questioning the groups using Socratic dialogue. In addition, we investigated student preferences for modes of instruction through an open-ended survey. Our results provide guidance and evidence for the teaching methods that should be emphasized in training course instructors.

We present and describe the development of a framework for assessing or categorizing instructional practices and related conceptions in the context of introductory physics instruction. The purpose of the framework is for articulating practices and conceptions of individual instructors or of curricula. It was developed based on the research literature and interviews with physics faculty and contains ideas with widespread acceptance as well as some outside mainstream rhetoric. We provide an example of how this framework can be applied by using it to categorize aspects of three well-known research-based curricula. The results of this categorization highlight areas that are common in research-based curricular designs and other areas that are less embraced but worthy of consideration.

The force concept inventory and a 10-question context-modified test were given to 647 students enrolled in introductory physics classes at the University of Arkansas. Context changes had an effect ranging from $-3\%$ to 10% on the individual questions. The average student score on the ten transformed questions was 3% higher than the average student score on the corresponding 10 force concept inventory questions. Therefore, the effect of contextual changes on the total of the 10 questions is not sufficient to affect normal use of the force concept inventory as a diagnostic instrument.

An important result of physics education research is that students’ learning and success in a course is correlated with their beliefs, attitudes, and expectations regarding physics. However, it is hard to assess these beliefs for individual students, and traditional survey instruments such as the Maryland Physics Expectations Survey (MPEX) are intended to evaluate the impact of one or more semesters of instruction on an overall class and improve teaching. In this study, we investigate the possibility of using the analysis of online student discussion behavior as an indicator of an individual student’s approach to physics. These discussions are not tainted by the effects of self-reporting, and are gathered in authentic nonresearch settings, where students attempt to solve problems in the way that they believe is most efficient and appropriate. We calculate the correlation of both MPEX and student discussions with different measures of student learning, and find that on an individual base, student discussions are a stronger predictor of success than MPEX outcomes.

At the University of Maryland we videotaped several semesters of tutorials as part of a large research project. A particular research task required us to locate examples of students calling the teaching assistants (TAs) over for assistance with a physics question. To our surprise, examples of this kind of interaction were difficult to find. We undertook a systematic study of TA-student interactions in tutorial: In particular, how are the interactions initiated? Do the students call the TA over for help with a particular issue, does the TA stop by spontaneously, or does the worksheet require a discussion with the TA at that point? The initiation of the interaction is of particular interest because it provides evidence of the motivation for and purpose of the interaction. This paper presents the results of that systematic investigation. We discovered that the majority of student-TA interactions in tutorial are initiated by teaching assistants, confirmed our initial observation that relatively few interactions are initiated by students, and found, further, that even fewer interactions are worksheet initiated. Perhaps most importantly, we found that our sense of who initiates tutorial interactions—based on extensive but informal observations—is not necessarily accurate. We need systematic investigations to uncover the reality of our classroom experiences.

Coordination class theory is used to explain college students’ judgments about animated depictions of moving objects. diSessa’s coordination class theory models a “concept” as a complex knowledge system that can reliably determine a particular type of information in widely varying situations. In the experiment described here, fifty individually interviewed college students judged the realism of two sets of computer animations depicting balls rolling on a pair of tracks. The judgments of students from an introductory physics class were strongly affected by the number of balls depicted (one or two), but the judgments of students from an educational psychology class were not. Coordination analysis of interview transcripts supports the interpretation that physics students’ developing physics knowledge led them to consistently miss or ignore some observations that the other students consistently paid attention to. The analysis highlights the context sensitivity and potential fragility of coordination systems, and leads to the conclusion that students’ developing knowledge systems might not necessarily result in consistently improving performance.

How can one increase the awareness of teachers to the existence and importance of knowledge gained through physics education research (PER) and provide them with capabilities to use it? How can one enrich teachers’ physics knowledge and the related pedagogical content knowledge of topics singled out by PER? In this paper we describe a professional development model that attempts to respond to these needs. We report on a study of the model’s implementation in a program for 22 high-school experienced physics teachers. In this program teachers (in teams of 5-6) developed during a year and a half (about $330\mathrm{h}$), several lessons (minimodules) dealing with a topic identified as problematic by PER. The teachers employed a systematic research-based approach and used PER findings. The program consisted of three stages, each culminating with a miniconference: 1. Defining teaching and/or learning goals based on content analysis and diagnosis of students’ prior knowledge. 2. Designing the lessons using PER-based instructional strategies. 3. Performing a small-scale research study that accompanies the development process and publishing the results. We describe a case study of one of the groups and bring evidence that demonstrates how the workshop advanced: (a) Teachers’ awareness of deficiencies in their own knowledge of physics and pedagogy, and their perceptions about their students’ knowledge; (b) teachers’ knowledge of physics and physics pedagogy; (c) a systematic research-based approach to the design of lessons; (d) the formation of a community of practice; and (e) acquaintance with central findings of PER. There was a clear effect on teachers’ practice in the context of the study as indicated by the materials brought to the workshop. The teachers also reported that they continued to use the insights gained, mainly in the topics that were investigated by themselves and by their peers.

We introduce resource graphs, a representation of linked ideas used when reasoning about specific contexts in physics. Our model is consistent with previous descriptions of coordination classes and resources. It represents mesoscopic scales that are neither knowledge-in-pieces nor large-scale concepts. We use resource graphs to describe several forms of conceptual change: incremental, cascade, wholesale, and dual construction. For each, we give evidence from the physics education research literature to show examples of each form of conceptual change. Where possible, we compare our representation to models used by other researchers. Building on our representation, we analyze another form of conceptual change, differentiation, and suggest several experimental studies that would help understand the differences between reform-based curricula.

We report on the development of students’ ideas of probability and probability density in a University of Maine laboratory-based general education physics course called Intuitive Quantum Physics. Students in the course are generally math phobic with unfavorable expectations about the nature of physics and their ability to do it. We describe a set of activities used to teach concepts of probability and probability density. Rudimentary knowledge of mechanics is needed for one activity, but otherwise the material requires no additional preparation. Extensions of the activities include relating probability density to potential energy graphs for certain “touchstone” examples. Students have difficulties learning the target concepts, such as comparing the ratio of time in a region to total time in all regions. Instead, they often focus on edge effects, pattern match to previously studied situations, reason about necessary but incomplete macroscopic elements of the system, use the gambler’s fallacy, and use expectations about ensemble results rather than expectation values to predict future events. We map the development of their thinking to provide examples of problems rather than evidence of a curriculum’s success.

The paper introduces a set of formative assessment tasks and rubrics that were developed for use in an introductory physics instruction to help students acquire and self-assess various scientific process abilities. We will describe the rubrics, tasks, and the student outcomes in courses where the tasks and rubrics were used.

The reliability and validity of professionally written multiple-choice exams have been extensively studied for exams such as the SAT, graduate record examination, and the force concept inventory. Much of the success of these multiple-choice exams is attributed to the careful construction of each question, as well as each response. In this study, the reliability and validity of scores from multiple-choice exams written for and administered in the large introductory physics courses at the University of Illinois, Urbana-Champaign were investigated. The reliability of exam scores over the course of a semester results in approximately a 3% uncertainty in students’ total semester exam score. This semester test score uncertainty yields an uncertainty in the students’ assigned letter grade that is less than $\frac{1}{3}$ of a letter grade. To study the validity of exam scores, a subset of students were ranked independently based on their multiple-choice score, graded explanations, and student interviews. The ranking of these students based on their multiple-choice score was found to be consistent with the ranking assigned by physics instructors based on the students’ written explanations ($r>0.94$ at the 95% confidence level) and oral interviews $(r={0.94}_{-0.09}^{+0.06})$.

Previous studies have demonstrated that analogies can promote student learning in physics and can be productively taught to students to support their learning, under certain conditions. We build on these studies to explore the use of analogy by students in a large introductory college physics course. In the first large-scale study of its kind, we demonstrate that different analogies can lead to varied student reasoning. When different analogies were used to teach electromagnetic (EM) waves, we found that students explicitly mapped characteristics either of waves on strings or sound waves to EM waves, depending upon which analogy students were taught. We extend these results by investigating how students use analogies. Our findings suggest that representational format plays a key role in the use of analogy.

Recent papers document that student problem-solving competence varies (often strongly) with representational format, and that there are significant differences between the effects that traditional and reform-based instructional environments have on these competences [Kohl and Finkelstein, Phys. Rev. ST Phys. Educ. Res. 1, 010104 (2005); Kohl and Finkelstein, Phys. Rev. ST Phys. Educ. Res. 2, 010102 (2006)]. These studies focused on large-lecture introductory physics courses, and included aggregate data on student performance on quizzes and homeworks. In this paper, we complement previous papers with finer-grained in-depth problem-solving interviews. In 16 interviews of students drawn from these classes, we investigate in more detail how and when student problem-solving performance varies with problem representation (verbal, mathematical, graphical, or pictorial). We find that student strategy often varies with representation, and that in this environment students who show more strategy variation tend to perform more poorly. We also verify that student performance depends sensitively on the particular combination of representation, topic, and student prior knowledge. Finally, we confirm that students have generally robust opinions of their representational skills, and that these opinions correlate poorly with their actual performances.

The Brief Electricity and Magnetism Assessment (BEMA), developed by Chabay and Sherwood, was designed to assess student understanding of basic electricity and magnetism concepts covered in college-level calculus-based introductory physics courses. To evaluate the reliability and discriminatory power of this assessment tool, we performed statistical tests focusing both on item analyses (item difficulty index, item discrimination index, and item point biserial coefficient) and on the entire test (test reliability and Ferguson’s delta). The results indicate that BEMA is a reliable assessment tool.

This study investigates the effect of computer animation on assessment and the conditions under which animation may improve or hinder assessment of conceptual understanding in physics. An instrument was developed by replacing static pictures and descriptions of motion with computer animations on the Force Concept Inventory, a commonly used pencil and paper test. Both quantitative and qualitative data were collected. The animated and static versions of the test were given to students and the results were statistically analyzed. Think-aloud interviews were also conducted to provide additional insight into the statistical findings. We found that good verbal skills tended to increase performance on the static version but not on the animated version of the test. In general, students had a better understanding of the intent of the question when viewing an animation and gave an answer that was more indicative of their actual understanding, as reflected in separate interviews. In some situations this led students to the correct answer and in others it did not. Overall, we found that animation can improve assessment under some conditions by increasing the validity of the instrument.

Decades of education research have shown that students can simultaneously possess alternate knowledge frameworks and that the development and use of such knowledge are context dependent. As a result of extensive qualitative research, standardized multiple-choice tests such as Force Concept Inventory and Force-Motion Concept Evaluation tests provide instructors tools to probe their students’ conceptual knowledge of physics. However, many existing quantitative analysis methods often focus on a binary question of whether a student answers a question correctly or not. This greatly limits the capacity of using the standardized multiple-choice tests in assessing students’ alternative knowledge. In addition, the context dependence issue, which suggests that a student may apply the correct knowledge in some situations and revert to use alternative types of knowledge in others, is often treated as random noise in current analyses. In this paper, we present a model analysis, which applies qualitative research to establish a quantitative representation framework. With this method, students’ alternative knowledge and the probabilities for students to use such knowledge in a range of equivalent contexts can be quantitatively assessed. This provides a way to analyze research-based multiple choice questions, which can generate much richer information than what is available from score-based analysis.

In a recent study we showed that physics students’ problem-solving performance can depend strongly on problem representation, and that giving students a choice of problem representation can have a significant impact on their performance [P. B. Kohl and N. D. Finklestein, Phys. Rev. ST. Phys. Educ. Res. 1, 010104 (2005)] In this paper, we continue that study in an attempt to separate the effect of instructional technique from the effect of content area. We determine that students in a reform-style introductory physics course are learning a broader set of representational skills than those in a more traditional course. We also analyze the representations used in each course studied and find that the reformed course makes use of a richer set of representations than the traditional course and also makes more frequent use of multiple representations. We infer that this difference in instruction is the source of the broader student skills. These results provide insight into how macrolevel features of a course can influence student skills, complementary to the microlevel picture provided by the first study.