Student population
The data presented here were gathered as a case study to provide a rich characterization of student thinking at a single institution (
24). During the Fall semester of 2019, we distributed an e-mail invitation for our study over the biology majors listserv at a large public midwestern university with very high research activity. We had an initial pool of 12 interested students; however, only 9 followed-up for interviews. The only selection criteria was having declared a biology major. The class standing of students within our sample was three sophomores, three juniors, and three seniors. The biology majors of our nine students were the following: one Genetics; one Ecology, Evolution, and Environmental Biology; three Neurobiology and Physiology; and four General Biology. As biology majors, all participants had taken the same set of introductory biology courses, which covered topics relevant to our study. Additionally, in their second year, all biology majors take a cell biology and genetics course providing them with additional, more in-depth opportunities to learn topics relevant to this study. While three of our participants were enrolled in the cell biology course at the time of the interview and had not yet taken the genetics course, we did not observe a difference in their explanations and knowledge network features. None of the students had previously taken a microbiology class, but one student was currently enrolled in the institution’s Introduction to Microbiology course. This student was three-quarters of the way through the semester; however, this did not give them an advantage in our study context. Due to the small sample size of this qualitative research study, we were not able to pursue analyses related to student demographics and performance on interview tasks.
This research study was approved under institutional review board 1806020745.
Data collection
We conducted semistructured, think-aloud interviews (
25) in a small private office on the university campus. Sessions were audio-recorded and lasted between 30 and 90 min. All students were compensated with a $20.00 Amazon gift card for their time and travel. During the Spring and Fall semesters of 2018, we piloted the interview protocol with seven General Biology major students (five juniors and two seniors) to determine if the questions were eliciting responses that gave insights into their thinking. Responses were not notably different from those in the current study; thus, we feel confident that the students in the pilot provided us with valuable insights to refine our protocol. We also integrated feedback from four experts not directly involved in our research study (three science, technology, engineering, and math education researchers and one biology educator).
Data collected during the interviews were part of a larger study on students’ knowledge integration and mechanistic reasoning within various biological contexts. At the beginning of the interview, students first defined what we are calling subsystems. We use the term subsystem, as it is descriptive of a component of a larger system (
4). These subsystems were the following: gene regulation, cell-cell communication, and phenotypic expression. Students reviewed basic definitions of the subsystems and described relationships between the three subsystems in an open context. The purpose of these tasks was to activate and establish the students’ baseline knowledge of the three subsystems and then to provide textbook definitions to help ensure students were not constrained by potential gaps in their knowledge, which may have limited their ability to engage in the rest of the interview. These specific subsystems were chosen since they are integral features of biofilm development but are also relevant and transferable across many biological contexts. A full description of the methods and data from the open context portion of the interview will be reported elsewhere (submitted for publication). Here, we report on student responses to questions posed in the context of biofilms (see Appendix S1 in the supplemental material).
First, we showed participants a model depicting biofilm development and an accompanying short, descriptive paragraph (
Fig. 1). This model and figure caption were designed in 2017 based on the biofilm literature (
12,
26–35) and reviewed by two microbiology faculty members. The short figure description given to all participants also provided a foundation for student reasoning during the interview. After orienting students to the figure, the interviewer then asked general questions about what the participants saw in the figure and what entities or players they thought may be involved in the transition point between initial attachment and irreversible attachment (
Fig. 1). This then led to the question, “Describe to me how the transition point from initial attachment to irreversible attachment occurs,” which we intentionally framed using how language to prompt mechanistic explanations (
2,
19,
20). It was the responses to this question that formed the data set reported here. If necessary, the interviewer also prompted the participant to think about the previous players they named and to phrase their answer as a sequence of events. At this point in the interview, it was expected that the students had sufficiently reflected on the subsystems and would be primed to incorporate the subsystems into their explanation of the transition point (
36,
37).
Analysis
Audio recordings from the interviews were transcribed verbatim, and students’ explanations of the transition point were analyzed using inductive and deductive coding (
23), mechanistic reasoning (
2), and the theory of knowledge integration (
22). To aid in the analysis, we composed a normative mechanism of how
Pseudomonas aeruginosa bacterial cells transition from initial attachment to irreversible attachment based on relevant and highly cited biofilm literature (
12,
26–35). However, this mechanistic description was detailed beyond what would be expected of students (e.g., specific genes and protein names) (Appendix S2). Our expectation was for students to apply their knowledge from cell biology and genetics—which we cued earlier in the interview—to reason through the transition point. As we were not interested in revealing and analyzing specific microbiological knowledge, we generated a simplified version of the mechanism (
Fig. 2A).
We first sought to create mechanistic models that represented the students’ verbal descriptions of the transition point. Deductive coding of our normative mechanism revealed that cell-cell communication, gene regulation, and three different bacterial phenotypes (i.e., cell aggregation, flagellum loss, and production of matrix) were relevant to this specific transition point (
Fig. 2B). Using these three subsystems as pillars, we then leveraged knowledge integration to detect linkages between the subsystems. We scanned the mechanism for descriptions or naming of the subsystems and the sequence of events connecting the subsystems. We then drew an arrow connection between subsystem names to represent these interactions that occur during the transition point (
Fig. 2C). We repeated this coding process to generate mechanistic models of the student data.
Using knowledge integration and mechanistic reasoning as analytical frameworks, we examined students’ mechanistic models for (i) correctness of connections, (ii) nature of connections, (iii) correctness of ideas, and (iv) nature of ideas. These dimensions were chosen because knowledge must be sorted and connected correctly to integrate into knowledge networks and have qualitative attributes of mechanistic reasoning to support application and transfer of knowledge networks to different contexts. Each dimension is described in detail below, and their codebooks can be found in Appendix S3.
To evaluate (i) correctness of connections, we compared the normative mechanistic model to the students’ models and identified alignment of connection types. Each of the connections was also evaluated for (ii) nature of the connections by analyzing the ways in which the students described how the subsystems are linked, guided by the literature (
2,
38,
39) and previous work (submitted).
For (iii) correctness of ideas, we examined the normative mechanism for knowledge elements relevant to the transition point and identified the following features: nine entities (see Appendix S3), three bacterial phenotypes, cell-cell communication mechanics, and gene regulation mechanics. We expected students to use these specific entities along with cell-cell communication and gene regulation mechanics to explain how the three visible phenotypes of cell aggregation, flagellum loss, and production of matrix occur. We decided that for a thing to count as an entity, it must meet one of the following criteria: (i) the entity engages in an activity (an action or a change occurring over space and time) (
2); (ii) the entity is being acted upon by another entity during an interaction (
3); or (iii) properties (such as structural attributes, spatial relations, orientations, or state) are described for an entity (
2) (
Fig. 2B).
To analyze (iv) nature of ideas, we evaluated descriptions of the level of organization of players (
3) and the localization of processes (
3,
5,
21) using a previously written codebook (submitted). During iterative refinement of the codebook against the data, we chose to characterize the “players” as opposed to “entities” to gain a holistic view of the level of organization in the students’ explanations. Machamer and colleagues (
2) defined entities as the things that engage in activities and/or have described properties. However, because this was not common in students’ responses, we report on the overall players instead.
Lastly, we performed a knowledge integration analysis in which we categorized students’ explanations on a continuum of fragmented to integrated biological ideas, drawing on Southard and colleagues’ theoretical model (
39). We holistically used all of the previous analyses (weighed equally) to evaluate the alignment of students’ explanations to the normative mechanism and subsequently characterize the integration of students’ knowledge.