During the Fall of 2008 we designed and administered a web survey to collect information about pedagogical knowledge and practices of physics faculty. The survey was completed by a representative sample of 722 physics faculty across the United States (a 50.3% response rate). This paper presents results of one part of the survey where faculty were asked to rate their level of knowledge and use of 24 Research-Based Instructional Strategies (RBIS) that are applicable to an introductory quantitative physics course. Almost all faculty (87.1%) indicated familiarity with one or more RBIS and approximately half of faculty (48.1%) said that they currently use at least one RBIS. Results also indicate that faculty rarely use RBIS as recommended by the developer, but instead commonly make significant modifications.

The increasing ease of video recording offers new opportunities to create richly detailed records of classroom activities. These recordings, in turn, call for research methodologies that balance generalizability with interpretive validity. This paper shares methodology for two practices of video analysis: (1) gaining insight into specific brief classroom episodes and (2) developing and applying a systematic observational protocol for a relatively large corpus of video data. These two aspects of analytic practice are illustrated in the context of a particular research interest but are intended to serve as general suggestions.

The performance of over 2000 students in introductory calculus-based electromagnetism (E&M) courses at four large research universities was measured using the Brief Electricity and Magnetism Assessment (BEMA). Two different curricula were used at these universities: a traditional E&M curriculum and the Matter & Interactions (M&I) curriculum. At each university, postinstruction BEMA test averages were significantly higher for the M&I curriculum than for the traditional curriculum. The differences in post-test averages cannot be explained by differences in variables such as preinstruction BEMA scores, grade point average, or SAT Reasoning Test (SAT) scores. BEMA performance on categories of items organized by subtopic was also compared at one of the universities; M&I averages were significantly higher in each topic. The results suggest that the M&I curriculum is more effective than the traditional curriculum at teaching E&M concepts to students, possibly because the learning progression in M&I reorganizes and augments the traditional sequence of topics, for example, by increasing early emphasis on the vector field concept and by emphasizing the effects of fields on matter at the microscopic level.

Common forms of testing of student understanding of science content can be misleading about their understanding of the nature of scientific thinking. Observational astronomy integrated with related ideas of force and motion is a rich context to explore the correlation between student content knowledge and student understanding of the scientific thinking about that content. In this paper, we describe this correlation in detail with a focus on a question about the relative motion of the Sun and the Earth. We find that high achieving high school students throughout New York City struggle with what constitutes scientific justification and thought processes, but can improve these skills tremendously in an inquiry-oriented summer astronomy-physics program.

This paper introduces five commonly used approaches to analyzing multiple-choice test data. They are classical test theory, factor analysis, cluster analysis, item response theory, and model analysis. Brief descriptions of the goals and algorithms of these approaches are provided, together with examples illustrating their applications in physics education research. We minimize mathematics, instead placing emphasis on data interpretation using these approaches.

The Colorado Learning Attitudes about Science Survey (CLASS) has been widely acknowledged as a useful measure of student cognitive attitudes about science and learning. The initial University of Colorado validation study included only 20% non-Caucasian student populations. In this Brief Report we extend their validation to include a predominately under-represented minority population. We validated the CLASS instrument at Florida International University, a Hispanic-serving institution, by interviewing students in introductory physics classes using a semistructured protocol, examining students’ responses on the CLASS item statements, and comparing them to the items’ intended meaning. We find that in our predominately Hispanic population, 94% of the students’ interview responses indicate that the students interpret the CLASS items correctly, and thus the CLASS is a valid instrument. We also identify one potentially problematic item in the instrument which one third of the students interviewed consistently misinterpreted.

Most students struggle when faced with complex and open-ended tasks because the strategies taught in schools and universities simply require finding and applying the correct formulae or strategy to answer well-structured, algorithmic problems. For students to develop their ability to solve ill-structured problems, they must first believe that standardized procedural approaches will not always be sufficient for solving engineering and scientific challenges. In this paper we document the range of beliefs university students have about problem solving. Students enrolled in a physics course submitted a written reflection both at the start and the end of the course on how they solve problems. We coded approximately 500 of these reflections for the presence of different problem-solving approaches. At the start of the semester over 50% of the students mention in written reflections that they use Rolodex equation matching, i.e., they solve problems by searching for equations that have the same variables as the knowns and unknowns. We then describe the extent to which students’ beliefs about physics problem solving change by the end of a semester-long course that emphasized problem solving via context-rich, multifaceted problems. The frequency of strategies such as the Rolodex method reduces only slightly by the end of the semester. However, there is an increase in students describing more expansive strategies within their reflections. In particular there is a large increase in describing the use of diagrams, and thinking about concepts first.

While educational reforms in introductory physics are becoming more widespread, how these reforms are implemented is less well understood. This paper examines the variation in faculty practices surrounding the implementation of educational reform in introductory physics courses. Through observations of classroom practice, we find that professors’ actual practices differ strikingly. We present a framework for describing and capturing instructional choices and resulting variations in enacted practices for faculty who are implementing Peer Instruction. Based on our observations, there are a variety of scientific practices that are supported and modeled in the use of Peer Instruction. In all of the classrooms studied, students were found trying out and applying new physical concepts and discussing physics with their peers. However, there were large discrepancies in students’ opportunities to engage in formulating and asking questions, evaluating the correctness and completeness of problem solutions, interacting with physicists, identifying themselves as sources of solutions, explanations, or answers, and communicating scientific ideas in a public arena. Case studies of six professors demonstrate how these variations in classroom practices, in aggregate, create different classroom norms, such as the relative emphasis on student sense-making vs answer-making during Peer Instruction.

We introduce a linguistic framework through which one can interpret systematically students’ understanding of and reasoning about force and motion. Some researchers have suggested that students have robust misconceptions or alternative frameworks grounded in everyday experience. Others have pointed out the inconsistency of students’ responses and presented a phenomenological explanation for what is observed, namely, knowledge in pieces. We wish to present a view that builds on and unifies aspects of this prior research. Our argument is that many students’ difficulties with force and motion are primarily due to a combination of linguistic and ontological difficulties. It is possible that students are primarily engaged in trying to define and categorize the meaning of the term “force” as spoken about by physicists. We found that this process of negotiation of meaning is remarkably similar to that engaged in by physicists in history. In this paper we will describe a study of the historical record that reveals an analogous process of meaning negotiation, spanning multiple centuries. Using methods from cognitive linguistics and systemic functional grammar, we will present an analysis of the force and motion literature, focusing on prior studies with interview data. We will then discuss the implications of our findings for physics instruction.

Among the most surprising findings in Physics Education Research is the lack of positive results on attitudinal measures, such as Colorado Learning Attitudes about Science Survey (CLASS) and Maryland Physics Expectations Survey (MPEX). The uniformity with which physics teaching manages to negatively shift attitudes toward physics learning is striking. Strategies which have been shown to improve conceptual learning, such as interactive engagement and studio-format classes, provide more authentic science experiences for students; yet do not seem to be sufficient to produce positive attitudinal results. Florida International University’s Physics Education Research Group has implemented Modeling Instruction in University Physics classes as part of an overall effort toward building a research and learning community. Modeling Instruction is explicitly designed to engage students in scientific practices that include model building, validation, and revision. Results from a preinstruction/postinstruction CLASS measurement show attitudinal improvements through both semesters of an introductory physics sequence, as well as over the entire two-course sequence. In this Brief Report, we report positive shifts from the CLASS in one section of a modeling-based introductory physics sequence, for both mechanics $\left(N=22\right)$ and electricity and magnetism $\left(N=23\right)$. Using the CLASS results and follow up interviews, we examine how these results reflect on modeling instruction and the unique student community and population at FIU.

The paper reports on how educational research informed and supported both the process of refinement of introductory physics laboratory instruction and student development of scientific abilities. In particular we focus on how the action research approach paradigm combined with instructional approaches such as scaffolding and formative assessment can be used to design the learning environment, investigate student learning, revise curriculum materials, and conduct subsequent assessment. As the result of the above efforts we found improvement in students’ scientific abilities over the course of three years. We suggest that the process used to improve the curriculum under study can be extended to many instructional innovations.

Physics education literature recommends using multiple representations to help students understand concepts and solve problems. However, there is little research concerning why students use the representations and whether those who use them are more successful. This study addresses these questions using free-body diagrams (diagrammatic representations used in problems involving forces) as a type of representation. We conducted a two-year quantitative and qualitative study of students’ use of free-body diagrams while solving physics problems. We found that when students are in a course that consistently emphasizes the use of free-body diagrams, the majority of them do use diagrams on their own to help solve exam problems even when they receive no credit for drawing the diagrams. We also found that students who draw diagrams correctly are significantly more successful in obtaining the right answer for the problem. Lastly, we interviewed students to uncover their reasons for using free-body diagrams. We found that high achieving students used the diagrams to help solve the problems and as a tool to evaluate their work while low achieving students only used representations as aids in the problem-solving process.

The two genders make different use of being allowed multiple tries to solve online homework problems: male students frequently attempt to immediately solve the problem, while female students are more likely to first interact with peers and teaching assistants before entering answers. More male than female students state that they use the multiple allowed attempts to enter “random stuff,” while more female than male students state that the multiple attempts allow them to explore their own problem solving approaches without worrying or being stressed out by grades.

Introductory undergraduate courses in classical physics stress a perspective that can be characterized as realist; from this perspective, all physical properties of a classical system can be simultaneously specified and thus determined at all future times. Such a perspective can be problematic for introductory quantum physics students, who must develop new perspectives in order to properly interpret what it means to have knowledge of quantum systems. We document this evolution in student thinking in part through pre- and post-instruction evaluations using the Colorado Learning Attitudes about Science Survey. We further characterize variations in student epistemic and ontological commitments by examining responses to two essay questions, coupled with responses to supplemental quantum attitude statements. We find that, after instruction in modern physics, many students are still exhibiting a realist perspective in contexts where a quantum-mechanical perspective is needed. We further find that this effect can be significantly influenced by instruction, where we observe variations for courses with differing learning goals. We also note that students generally do not employ either a realist or a quantum perspective in a consistent manner.

In this paper we compare and contrast student’s pretest/post-test performance on the Halloun-Hestenes force concept inventory (FCI) to the Thornton-Sokoloff force and motion conceptual evaluation (FMCE). Both tests are multiple-choice assessment instruments whose results are used to characterize how well a first term, introductory physics course promotes conceptual understanding. However, the two exams have slightly different content domains, as well as different representational formats; hence, one exam or the other might better fit the interests of a given instructor or researcher. To begin the comparison, we outline how to determine a single-number score for the FMCE and present ranges of normalized gains on this exam. We then compare scores on the FCI and the FMCE for approximately 2000 students enrolled in the Studio Physics course at Rensselaer Polytechnic Institute over a period of eight years (1998–2006) that encompassed significant evolution of the course and many different instructors. We found that the mean score on the FCI is significantly higher than the mean score on the FMCE, however there is a very strong relationship between scores on the two exams. The slope of a best fit line drawn through FCI versus FMCE data is approximately 0.54, and the correlation coefficient is approximately $r=0.78$, for preinstructional and postinstructional testings combined. In spite of this strong relationship, the assessments measure different normalized gains under identical circumstances. Additionally, students who scored well on one exam did not necessarily score well on the other. We use this discrepancy to uncover some subtle, but important, differences between the exams. We also present ranges of normalized gains for the FMCE in a variety of instructional settings.

We report the results of an analysis of the Texas Assessment of Knowledge and Skills (TAKS) designed to determine whether the TAKS is a valid indicator of whether students know and can do physics at the level necessary for success in future coursework, STEM careers, and life in a technological society. We categorized science items from the 2003 and 2004 10th and 11th grade TAKS by content area(s) covered, knowledge and skills required to select the correct answer, and overall quality. We also analyzed a 5000 student sample of item-level results from the 2004 11th grade exam, performing full-information factor analysis, calculating classical test indices, and determining each item's response curve using item response theory. Triangulation of our results revealed strengths and weaknesses of the different methods of analysis. The TAKS was found to be only weakly indicative of physics preparation and we make recommendations for increasing the validity of standardized physics testing.

Students in introductory physics courses are likely to have views about physics that differ from those of experts. However, students who continue to study physics eventually become experts themselves. Presumably these students either possess or develop more expertlike views. To investigate this process, the views of introductory physics students majoring in physics are compared with the views of introductory physics students majoring in engineering. In addition, the views of physics majors are assessed at various stages of degree progress. The Colorado learning attitudes about science survey is used to evaluate students’ views about physics, and students’ overall survey scores and responses to individual survey items are analyzed. Beginning physics majors are significantly more expertlike than nonmajors in introductory physics courses, and this high level of sophistication is consistent for most of undergraduate study.

A common format for assessment of learning is pretesting and post-testing. In this study, we collect student test data several times per week throughout a course, allowing for the measurement of the changes in student knowledge with a time resolution on the order of a few days. To avoid the possibility of test-retest effects, separate and quasirandom subpopulations of students are tested on a variety of tasks. We report on data taken in a calculus-based introductory E&M class populated primarily by engineering majors. Unsurprisingly for a traditional introductory course, there is little change in many conceptual questions. However, the data suggest that some student performance peaks and decays rapidly during a quarter, a pattern consistent with memory research yet unmeasurable by pretesting and post-testing. In addition, it appears that some course topics can interfere with prior knowledge, decreasing performance on questions related to earlier topics in the course.