Evidence of student learning
Based on analysis of the pre- and post-lesson assessment, we observed that students’ knowledge of the learning objectives significantly increased after completing the lesson. Students achieved higher scores on a post-lesson quiz (Supplemental Material S3. Lesson Assessment—Q1-5) assessing their knowledge of the learning objectives, and this effect was statistically significant (
Fig. 2,
n = 100,
t(99) = 8.62,
P < 0.001). Students’ scores increased by an average of 22.4% (1.12 points of 5 points total) from 2.30 (SD
= 0.99) to 3.42 (SD = 1.10) out of 5. Overall, 76% of students’ scores increased on the post-lesson assessment, with only 15% of students scoring lower and 9% experiencing no score change relative to the pre-lesson assessment (
Fig. 3). Student performance improved on questions corresponding to all three of the learning objectives (Supplemental Material S5. Supplemental Figures—Fig. S2). These differences were statistically significant for all assessment questions (
Table 2).
One class section was disrupted due to a fire alarm, so these students were unable to interact with the 3D models. However, they were introduced to the concepts of bacterial cell size, diffusion, surface-area-to-volume ratio, and active transport during a previous lecture. This unplanned situation provides an opportunity to assess the role of our 3D models in improving student learning. Students who completed the lesson experienced more improvement between the pre- and post-lesson assessments (
M = 1.12, SD = 1.30,
n = 100) than their peers whose class was canceled (
M = −0.047, SD = 1.24,
n = 17), and this difference was statistically significant [
t(115) = 3.57,
P = 0.002]. Although these data represent a small, non-random sample, which is subject to potentially confounding variables, it suggests that the lesson, including interaction with the 3D models, promotes greater student learning compared to only experiencing the lecture covering topics from the lesson (Supplemental Material S5. Supplemental Figures—Fig. S1). This conclusion is in general agreement with prior work that shows active learning strategies increase students learning relative to lecturing alone (
29).
Students were also assessed on concepts from the lesson via a series of true or false questions included on the midterm exam that was administered about a month after the lesson (Supplemental Material S3. Lesson Assessment—MQ1). Students who completed the lesson performed slightly better on these questions on average scoring 3.05 (
n = 98, SD = 0.83) compared to 2.85 (
n = 84, SD = 0.74) out of 4, but this difference was not statistically significant at a 95% confidence level [
t(180) = 1.77,
P = 0.08]. Using a true or false format enables students to answer multiple questions more quickly, thereby allowing assessment of a broader range of content in a short time (
30). However, the students have a 50% chance of guessing the correct answer. This high probability of students guessing correctly may, in part, explain the lack of difference in performance on the midterm questions between students who completed and did not complete the lesson. Although the difference in overall score on the midterm questions was not significant, a significantly greater number of students who completed the lesson answered a question about the quantity of ribosomes in a bacterial cell correctly on the midterm exam compared to their peers who did not complete the lesson (Supplemental Material S3. Lesson Assessment—MQ1B,
P = 0.01). This result suggests that students who participated in the lesson may have obtained and retained a greater understanding of the relative size and quantity of ribosomes found in a typical bacterial cell. A summary of the student performance data from the midterm assessment questions can be found in Supplemental Material S5. Supplemental Figures—Table S1.
The overall increase in student performance after completing the lesson was accompanied by a significant improvement in student confidence in their knowledge of these concepts. After completing the lesson, students indicated significantly higher levels of confidence across all three learning objectives (Supplemental Material S3. Lesson Assessment—SQ1,
n = 100,
P < 0.001,
Fig. 4). A summary of the changes in student confidence and the corresponding statistics can be found in Supplemental Material S5. Supplemental Figures—Table S2. The greatest increase in confidence was observed for LO-2, suggesting that calculating surface-area-to-volume ratios of cells during the lesson helped students feel more confident about this skill.
In addition to evaluating student performance and confidence, we asked students to share reflections about their experiences using diagrams and models in the past and in this lesson. In the pre-lesson assessment, students were asked to reflect on models and images they had seen in past courses in an open-ended question (Supplemental Material S3. Lesson Assessment—SQ2). A prevalent theme in these responses was that students felt many images and models shown in biology courses are misleading about cell size or are not drawn to scale. Of the students who mentioned cell size or scale in their response, approximately 82% (42 of 51) of them indicated that cell size or scale was inaccurately represented or not specified in the models or diagrams they had seen previously, indicating cell size and scale may often be overlooked in biology courses and textbooks. In their responses, several students mentioned that bacterial cells and eukaryotic cells are often implied to be similar sizes in side-by-side drawings. For example, one student wrote, “The models or drawings of cells that I have seen in other courses have often not accurately represented the relative sizes of real cells and their organelles. For example, often prokaryotic and eukaryotic cells will be compared side by side without any representation of their difference in size.”
The models used in our lesson address this common misrepresentation, and students demonstrated increased knowledge about cell size by performing better on assessment questions about cell size after completing the lesson (
Table 2). In addition, students felt more confident in their knowledge of the relative sizes of eukaryotic and bacterial cells (LO-2) and rated their confidence on average as 4.10 on a five-point scale (SD = 0.72), an increase of 0.99 points between the pre- and post-lesson timepoints [
Fig. 4,
t(99) = 9.52,
P < 0.001].
Students were asked to share their thoughts about the models used in this lesson in an open-ended question on the post-lesson assessment (Supplemental Material S3. Lesson Assessment—SQ6). Many of the responses highlighted that the models filled a gap in their knowledge. For example, one student wrote, “I found the models to be extremely helpful, as previously I thought of all cells (eukaryotic and prokaryotic) as just small. It can be hard to conceptualize how different ‘small’ can be, but I think that scaling the cells up helped me to better understand.”
Student responses were coded as positive, negative, or mixed as described in the “Suggestions for determining student learning” section. Overall, students responded positively to the models, with 72.7% of the responses being coded as positive and 24.2% being coded as mixed (n = 99). These data suggest that the students perceived the 3D models as a positive aspect of this lesson, highlighting that 3D models may be a strategy worthy of further evaluation for its potential to increase student satisfaction with their biology coursework in other contexts.
Student perceptions of their learning were also positive. When asked to indicate the extent to which the lesson helped them learn concepts related to each of the learning objectives, most students rated the lesson either a four or five on a five-point scale (Supplemental Material S3. Lesson Assessment—SQ4), with average student ratings of 4.38 (SD = 0.80), 4.15 (SD = 0.94), and 4.37 (SD = 0.76) for LO-1, LO-2, and LO-3, respectively (Supplemental Material S5. Supplemental Figures—Fig. S3, n = 100). These findings were also supported by student responses to an open-ended question asking them to evaluate how the lesson helped them learn the concepts outlined in the learning objectives (Supplemental Material S3. Lesson Assessment—SQ6). Student responses indicated ways in which the lesson and models helped them understand all three of the learning objectives. Several of the responses specifically pointed out that the 3D models helped them better understand biological processes (LO-3), such as one student who wrote, “The imagery of the 3D printed models in relation to SA [surface area]:V [volume] ratio and efficiency of diffusion helped me understand the importance of SA:V ratio in biological processes. The [T. namibiensis] mechanism of compensating for a low SA:V ratio also helped me better understand this.”
The results from our pre- and post-lesson assessment highlight that this lesson, including interacting with 3D cell models, promotes increased student knowledge of and confidence in the lesson learning objectives. In addition, students felt that the lesson helped them learn the concepts and generally reflected positively on their experience interacting with the 3D cell models. Together these data support that our lesson achieves its learning objectives and provides an effective strategy for teaching students about cell size and diffusion.