Session S3: Topics in Physics Education Research

Metacognitive gimmicks and their use by upper level physics students

We report on the initial phases of a study of three particular metacognitive gimmicks that upper-level physics students can use as a tool in their problem-solving kit, namely: checking units for consistency, discerning whether limiting cases match physical intuition, and computing numerical values for reasonable-ness. Students in a one semester Griffiths electromagnetism course at a small private urban university campus are asked to respond to explicit prompts that encourage adopting these three methods for checking answers to physics problems, especially those problems for which an algebraic expression is part of the final answer. We explore how, and to what extent, these students adopt these gimmicks, as well as the time development of their use. While the term ``gimmick'' carries with it some pejorative baggage, we feel it describes the essential nature of the pedagogical idea adequately in that it gets attention, is easy for the students to remember, and represents, albeit perhaps in a surface way, some key ideas about which professional physicists care (see ``Thinking like a physicist: A multi-semester case study of junior-level electricity and magnetism,'' by S. V. Chasteen, S. J. Pollock, R. E. Pepper, and K. K. Perkins, Am. J. Phys. \textbf{80}, 923 (2012), for example).   

Understanding Female Students' Physics Identity Development

While the gender gap in physics participation is a known problem, practical strategies that may improve the situation are not well understood. As physics education researchers, we draw on evidence to help inform us of what may or may not be working. To this end, physics identity has proven to be a useful framework for understanding and predicting participation in physics. Drawing on data from national surveys of college students, case studies in physics classes, and surveys of undergraduate women in physics, we identify strategies that are predictive of female students' physics identity development from their high school and undergraduate physics experiences. These findings will be discussed as well as future directions for using this research to increase the recruitment of women to physics-related careers.   

Situated Self-efficacy in Introductory Physics Students

Within the general university environment, students’ perceived self-efficacy has been widely studied and findings suggest it plays a role in student success. The current research adapted a self-efficacy survey, from the ``Self-Efficacy for Learning Performance'' subscale of the Motivated Learning Strategies Questionnaire and administered it to the introductory, calculus-based physics classes ($N$=1005) over the fall 2015 and spring 2016 semesters. This assessment measured students’ self-efficacy in domains including the physics class, other science and mathematics classes, and their intended future career. The effect of gender was explored with the only significant gender difference ($p<.001$) existing within the physics domain. A hierarchical linear regression analysis indicated that this gender difference was not explained by a student’s performance which was measured by test average. However, a mediation analysis showed that students’ overall academic self-efficacy, measured by their math and science self-efficacy, acts as a mediator for the effect of test average on self-efficacy towards the physics class domain. This mediation effect was significant for both female ($p<.01$) and male students ($p<.001$); however, it was more pronounced for male students.   

Using a psychometric lens to examine gender differences on the FCI

Multiple research studies show that there appears to be an inherent difference between male and female students' performance on the Force Concept Inventory (FCI). Unlike these studies, we chose to create two different samples, one with only female students and the other with only male students, to reduce the effects of the gender-imbalance inherent in a single sample of all physics students. Using a psychometric lens, we evaluate the differences between the male and female students' performance on the FCI. We utilized classical test theory to flag 13 items on the FCI that were poorly functioning for female students. Notably, most of these items were not flagged when the dataset was aggregated across genders. In the next stage of the research, we utilized Item Response Theory (IRT) to discover if the remaining 17 items on the FCI are also poorly functioning for female students. By eliminating the poorly functioning items on the FCI, we further examined the gender difference of the Force Concept Inventory.   

The Effect of Prior Knowledge and Gender on Physics Achievement

Gender differences on the Conceptual Survey in Electricity and Magnetism (CSEM) have been extensively studied. Ten semesters ($N$=1621) of CSEM data is presented showing male students outperform female students on the CSEM posttest by $5\%$ ($p<.001$). Male students also outperform female students on qualitative in-semester test questions by $3\%$ ($p=.004$), but no significant difference between male and female students was found on quantitative test questions. Male students enter the class with superior prior preparation in the subject and score $4\%$ higher on the CSEM pretest ($p<.001$). If the sample is restricted to students with little prior knowledge who answer no more than 8 of the 32 questions correctly ($N$=822), male and female differences on the CSEM and qualitative test questions cease to be significant. This suggests no intrinsic gender bias exists in the CSEM itself and that gender differences are the result of prior preparation measured by CSEM pretest score. Gender differences between male and female students increase with pretest score. Regression analyses are presented to further explore interactions between preparation, gender, and achievement.   

Examining Student Attitudes in Introductory Physics via the Math Attitude and Expectations Survey (MAX)

Student often face difficulties with using math in science, and this exploratory project seeks to address the underlying mechanisms that lead to these difficulties. This mixed-methods project includes the creation of two novel assessment surveys, the Mathematical Epistemic Games Survey (MEGS) and the Math Attitude and Expectations Survey (MAX). The MAX, a 30-question Likert-scale survey, focuses on the attitudes towards using mathematics of the students in a reformed introductory physics course for the life sciences (IPLS) which is part of the National Experiment in Undergraduate Education (NEXUS/Physics) developed at the University of Maryland (UMD). Preliminary results from the MAX are discussed with specific attention given to students' attitudes towards math and physics, opinions about interdisciplinarity, and the usefulness of physics in academic settings as well as in professional biological research and modern medicine settings.   

Professional development workshops for physics education research

Physics education research holds the promise of satisfying expectations of both scholarship, which is increasing at teaching-centric institutions, and teaching effectiveness, a concern at all institutions. Additionally, junior physics education researchers seek more diverse training in research methods and theories. Emerging education researchers need support as they develop their research programs and expand their theoretical and methodological expertise, and they benefit from the guidance of knowledgable peers and near-peers. Our two-part professional development model combines intensive in-person workshops with long-term remote activities. During a two-week in-person workshop, emerging and established education researchers work closely together to develop research questions, learn appropriate analytic techniques, and collect a corpus of data appropriate to their research questions. Afterwards, they meet biweekly in a distributed, mentored research group to share analyses and develop their ideas into publishable papers. In this talk, we discuss this model for professional development and show results from one three-year implementation in the IMPRESS program at the Rochester Institute of Technology.   

GRAD-MAP: A Physics and Astronomy Diversity Initiative at the University of Maryland

Graduate Resources for Advancing Diversity with Maryland's Astronomy and Physics (GRAD-MAP) builds connections with mid-Atlantic HBCUs, Minority-Serving Institutions (MSIs), and community colleges using seminars, forums, and workshops to foster a diverse community: undergraduates prepared to succeed in graduate school, inclusion-minded graduate student mentors, and faculty versed in the experiences of students at MSIs. In its fourth year, GRAD-MAP remains a graduate-student-powered initiative with a four-pronged approach: 1) Fall Collaborative Seminars, 2) Winter Workshop, 3) Spring Symposium, and 4) Summer Scholars Program. This coherent programming allows GRAD-MAP to do more than just increase the number of minority students or simply shuffle around students who already are, or would be, active in research. GRAD-MAP is committed to identifying students who are underserved or overlooked by the traditional academic pipeline. Our goal is not only to get them on the path to be successful undergraduate researchers and eventual graduate applicants, but also to make substantial, sustainable efforts toward a more inclusive climate in physics and astronomy. We will describe the key elements of our program, highlight successes and lessons learned, and describe formal evaluation currently underway with the intent that GRAD-MAP could serve as a model for other universities committed to diversity and inclusion.   

Towards an understanding of graduate admissions practices in physics

The APS bridge program works to improve the participation of students from traditionally under-represented groups in graduate physics. Related to this, we have undertaken research to improve our understanding of graduate admissions practices from the point of view of both students and faculty. Previously, we collected data on admission practices from over 75\% of PhD-granting physics departments in the U.S., which highlighted the role of various criteria (including the GRE) in the admissions decisions faculty make, and identified the efforts (or lack thereof) made to recruit students from traditionally under-represented backgrounds. Currently, we are conducting a parallel study of upper division undergraduate physics majors to investigate their post-graduation career intentions, their perceptions of graduate admissions and perceived barriers to admissions, and to understand how undergraduate experiences influence students' career interests. Lastly, we are also studying, in depth, students who have been connected to physics bridge programs, to understand post-admission experiences and the enculturation process in physics departments. In this talk, we report on the collective results of these research efforts to date.