INTRODUCTION
Although the term “citizen science” can be flexibly applied due to an absence of an agreed international definition (
1), citizen science, typically involves collaborative research between scientists and non-scientists, i.e., the “citizen scientists” (
2). Citizen science has been used to date to carry out studies across a range of disciplines (
3), e.g., for wildlife surveys, such as birdwatching (
4), medicine in projects like “PatientsLikeMe” (
5), and in food fermentation projects such as “Ferme Pekes” (
6) and the “Global Sourdough Project” (
7). Interest in citizen science has increased, as reflected by the number of associated studies and publications (
8). It is worth noting the growing number of guidelines aiming to establish the best practice principles for citizen science, including the European Citizen Science Association (CSA)’s “Ten Principles of Citizen Science” (
9). However, at present, there are few recommendations derived from quantitative and qualitative assessments, coupled with personalized accounts from citizen scientists actively involved in a project, with a consistent level of participation. One clear advantage of citizen science relates to the synergistic relationship between participants and researchers, encouraging scientific openness (
1). A number of additional benefits can be availed of by researchers by involving participants who can provide a greater quantity and/or quality of samples and/or data than would be possible for a small number of professional scientists in a research setting (
10). Citizen science also provides unique opportunities to communicate with the general public, aiding in the identification of gaps in public knowledge and key research questions. For example, in the Global Sourdough Project (
https://robdunnlab.com/projects/sourdough/), the community-scientist network of bakers provided 500 sourdough starters from 4 continents and personalized accounts from over 1,000 people concerning the origin, culinary practices, and distinct flavors of their own sourdoughs. The results of the sourdough study further informed consumer/producers of the factors influencing the microbial diversity of sourdough, dispelling widespread assumptions that the geographical location of the sourdough was a primary influencer of diversity (
7). While the Global Sourdough Project revealed similarities and differences in the microbial composition of different examples of a specific fermented food, an alternative question that can be addressed through citizen science relates to the extent to which a single common-source fermentation-associated community can change when disseminated to participants. Notably, in this regard, milk kefir and water kefir are examples of fermented foods that are accessible to the general population due to their ease of production, low-cost production, and history of safe consumption (
11) and are suited to microbiology-related citizen science projects. In particular, the starting point of the fermentation, the symbiotic communities of bacteria and yeasts contained within an exopolysaccharide matrix, referred to as kefir “grains” (
11), produce a wide variety of fermented beverages with different characteristics (
12–14) and can be easily shared with numerous participants.
Here, we describe Kefir4All, a kefir-focused citizen science project during which citizen scientists took part in scientific learning and discussion while performing fermentations and recording observations in a household environment. We use survey data collected throughout the course of the project to measure the initial interest in the project and to track that interest as the project progressed. We also examine the impact of outreach activities, for example, in maintaining continuous participation, a recognized limiting factor for projects of this nature (
15), and most importantly, we examine the educational impact of taking part in a citizen science project from the participant’s perspective (
15).
DISCUSSION
The benefits of citizen science to education systems and wider society are being actively investigated by international citizen science associations (
29). However, previous citizen science projects applied in school settings have already established that a high level of participation is found to have greater impacts on learning outcomes (
30). In Kefir4All, we conducted a citizen science project involving 123 citizen scientists in which scientific learnings and practices were applied in formal and informal learning environments (
31). The project provided science education and learning in formal environments, by providing workshops facilitating the integration of the project into the scientific curriculum of the schools involved and in informal environments, by supporting the citizen scientist to carry out repeat fermentations in private households for up to 21 weeks (
Fig. 1).
In Kefir4All, we circulated the Workshop Survey at the end of the introductory workshop to determine the public’s background knowledge and perceptions of as well as interest in microbiology and fermented foods (Fig. S1). The survey results revealed a general lack of knowledge (Fig. S1C and E;
Fig. 2E and F) relating to both topics. Often, individuals who expressed a neutral interest in the project provided personalized comments to the question “What did you like and dislike about microbiology?” such as “I’m curious about it and feel like this project will be great to learn more,” “I just don’t know enough about it at the moment,” and “I guess it’s not really talked about so I don’t have an opinion on it, but it’d be nice to learn something new.” The Workshop Survey also revealed the approaches that were most commonly used by members of the public to access scientific information, with “YouTube” and “school” being considerably more popular than “news channels” and “books” (Fig. S1I). Interestingly, from the personalized comments provided in relation to the workshop, one responder noted, “Well for one it was engaging, and it sounded just like the YouTube videos I watch, so it was fun and enjoyable.” These combined results, including the personalized comments of citizen scientists, suggest that an absence of knowledge is one of the primary limiting factors impacting interest in scientific disciplines and highlights the importance of YouTube and school settings as key sources of scientific information (Fig. S1I). The Evaluation Survey was then used to determine self-reported improvements in interest and general knowledge concerning microbiology and fermentation, among the participating citizen scientists as a result of taking part in the project (
Fig. 8) (
32). Here, we show that taking part in the project and, to a lesser extent, attending a workshop can greatly influence public perception, interest, and general scientific knowledge (Fig. S1J;
Fig. 2 and 8A through H, O, and P). This pattern was consistent with the positive feedback received in other citizen science projects such as Symbiosis in the soil (
32). Indeed, we received numerous comments from citizen scientists such as “The information that the microbiologists had talked to us about has created an interest in the subject for me.” Furthermore, many citizen scientists and teachers reported benefits in terms of improved scientific knowledge, vocabulary, and interest as well as a desire to be part of further citizen science projects (
Fig. 8A through H, O, and P), even among those with relatively less interest in the topic.
Unfortunately, perhaps as a result of recruiting on the basis of good faith alone, a number of the citizen scientists who were originally recruited did not contribute significantly to the project, with 35 non-fermenters and 34 rare fermenters (
Fig. 3A), representing 56% of the total participants. It is worth noting that evaluation surveys were only completed by citizen scientists who completed the study and regularly engaged with the project, and thus it was not possible to get further insights into the low rate of participation by some individuals. However, from the personalized comments about the project, one teacher noted, “I’d like to pitch it to only certain students as many of ours didn’t engage well unfortunately.” Such comments, when taken together with the low rate of participation by some individuals, highlight the potential benefits of working within research networks and/or having a community structure with successful citizen scientists and their schools/groups to ensure recruitment of citizen scientists who are likely to complete the project and are particularly applicable as many participants and teachers in Kefir4All expressed an interest in partaking in future citizen science studies (
Fig. 8O and P). A number of such research networks are currently available, including the US-based Citizen Science Association the European Citizen Science Association, and the Australian Citizen Science Association (
8,
33), which may present a better alternative for participant recruitment compared to the good faith approach applied in Kefir4All (
4). One potential mitigating factor, in terms of recruiting in good faith for future projects, may be to recruit smaller groups, as recruitment as part of larger groups positively correlated with a greater frequency of non-fermenters and rare fermenters. From the personalized comments about the project, one teacher noted when asked about what they disliked about the project, “Trying to keep students motivated—should not have selected so many.” Smaller groups may facilitate direct participation and the requirement for less supervision time for the teacher involved, while still ensuring the development of new connections between participants and citizen science. Alternatively, a practical learning activity could be introduced during the workshop to assess the citizen scientist’s interest in the project; indeed, such an activity was one of the areas of potential improvement proposed in the Workshop survey. A learning activity could include dividing the workshop attendees into groups, who would then be asked to produce different fermented foods, explain their food, and discuss the similarities and differences between the different fermented foods.
We noted a high degree of initial participation, which is likely a reflection of the initial enthusiasm of participants in taking part in a citizen science project following interactions with the Kefir4All team (
Fig. 3C and D and 8A and B). However, after week 5, the participants began to show signs of diminished interest (
Fig. 3C and D). Indeed, one of the main points of dislike raised by some participants during the Evaluation Survey was the project length and level of participation required. We therefore recommend that, where possible, citizen science projects attempt to design their project within a 6-week range to ensure maximum interest or to incorporate engagement activities to ensure a longer lasting project. When asked what citizen scientists liked about the project, one of the main points related to the satisfaction derived from contributing to scientific research. This was reflected in comments such as “knowing my involvement was being used for research—it was interesting,” “opportunity to show family members some scientific research,” and “being part of a large citizen science project—a first for me.” Another point of success was the requirement to make observations and to use fermentation equipment. During the study, many citizen scientists reported an appeal in seeing different fermentation characteristics over time, with comments such as “The equipment was all supplied, and it was great standard and new! I liked seeing how the kefir was different each time,” “I enjoyed observing any changes. I liked using the equipment we received such as the thermometer and pH strips,” and “I liked the repetitiveness of doing the fermentations as the time it took up was little and often so it wasn’t stressful. I also liked gathering the information each time and seeing if it was different or the same as usual.” Indeed, in their closing comments, many participants noted that they had tried and/or had read about a number of different approaches to improve grain growth such as “I left the milk longer to try for more grains” and “I read up on some ways to have a more stable environment for kefir growth (like adding some lemon drops).”
The incorporation of engagement activities in the project contributed to continued participation while also providing further opportunities for further education of the participants through career talks and data interpretation skills (through the graphical displays presented in the weekly leader board) (
Fig. 4), and individualized citizen science reports (
Fig. 5). A number of responders highlighted that prior to the expanded array of engagement activities, the project had begun to become repetitive by virtue of the fermentation process having become routine. One teacher questioned at week 5 “Is there any further information from the project that we can show the students involved to keep them motivated?” While the outreach activities helped to maintain continuous participation in the project, they resulted in minimal changes to the number of fermentations recorded and samples provided (
Fig. 3C and D). Some teachers communicated that the sharing of results generated from their personalized kefir metagenomic data sets during the project would have had a very positive impact with respect to ensuring continual participation, and a citizen scientist noted that the project would have been improved if “Results were provided during the project, to help keep me motivated.” Therefore, future citizen science projects of this type should design the project structure to enable the sharing of data (
Fig. 5; Supplementary Reports 1 and 2) during the earlier stages of the project and not at the end, as was done in Kefir4All (as time was needed for DNA extraction, sequencing, and data analysis). If data sharing is not possible within the timeframe of the project, derivatives of the “Which Variables Matter?” lesson module developed and utilized in the Wild Sourdough project (
34) could be explored. The Wild Sourdough project aimed to study patterns of change within sourdough by asking citizen scientists to produce sourdough under varying conditions, and the lesson module represents a graphing exercise where citizen scientists can explore which conditions influence their sourdough. Recommendations discussed in this manuscript that are derived from the challenges encountered, and/or from feedback from participants, can help shape and improve guidelines for future projects and highlight the importance of communication between researchers and participants.
One clear advantage of citizen science from a researcher’s perspective is the capacity for such a project to produce an extensive database, containing information such as observations, measurements, samples, and/or assessments collected or produced by citizen scientists (
35). A number of previous citizen science projects have reported conflicting results in terms of sample quality (
36) with, in some instances, concerns over the reliability and quality of data, (
10) while, in other cases, the results provided by the citizen scientists were comparable with those provided by professionals (
37–39). Here, while reliability differed between participants, a comparison, using hierarchical clustering, between the newly generated data and that from previous kefir studies performed by professional researchers highlighted a similar level of diversity between data sources at the compositional level (
Fig. 7B). Furthermore, the data sources in Kefir4All had clear advantages in terms of associated metadata and a time series structure, which would have been difficult to reproduce at the same scale through a traditional laboratory-based approach. This citizen science project, with its time series design, enabled the unique opportunity to assess the milk kefir and water kefir microbiome in terms of long-term stability, potential strain-level evolution, and adaption to the different environments (different households and different fermentation practices), including resilience of the grains to the introduction of environmental microbes. Another benefit to the researchers is the sense of having contributing to public education and receiving feedback such as “Thank you for having me as a citizen scientist, it was so fun—definitely solidifying the area of chemistry/biochemistry for my future work area.”
Overall, our results further highlight the value of schools as hubs for citizen science projects. From a researcher’s perspective, schools can act as central hubs to train, re-visit, collect samples, and communicate with citizen scientists, thereby reducing logistical concerns. As outlined by Roche et al., some citizen science projects do not incorporate suitable flexibility in their experimental design to enable a smooth integration in school curricula (
31). Here, we show that teachers involved in the project can often incorporate a leadership role maintaining continuous participation and can provide guidance and/or play an active role in shaping the project structure to suit their school and their students (
31). However, further developments are still needed for schools to reach their optimal potential in citizen science. Possible further developments that should be considered include grants and/or other funding opportunities to establish and maintain a citizen science infrastructure within a school system such as a citizen science club, which will reduce the reliance of recruiting in “good faith” and promote meaningful participation of schools in scientific research. Ultimately, citizen science projects in a school setting provide an opportunity to improve scientific research, extend the current scientific curriculum, and represent a unique opportunity to communicate scientific principles while sharing and discussing personalized results, providing a participant with an individualized practical insight into how science is conducted in the real world (
40).
ACKNOWLEDGMENTS
We thank all of the citizen scientists involved in this Kefir4All project, without whom this project would not have been possible. We thank members of the Vision 1 laboratory, Teagasc for advice, helpful discussions, and critical review of the manuscript.
This research was funded by the European Union’s Horizon 2020 research and innovation programme, under the MASTER project (grant number 818368), by Science Foundation Ireland (SFI) under grant number SFI/12/RC/2273_P2 (APC Microbiome Ireland SFI Research Centre), by SFI together with the Irish Department of Agriculture, Food and the Marine under grant number SFI/16/RC/3835 (VistaMilk SFI Research Centre). Research in the Cotter laboratory is also funded by Enterprise Ireland and industry in the Food for Health Ireland (FHI)−3 project, under grant number TC/2018/0025. We support inclusive, diverse, and equitable conduct of research.
L.H.W., S.B., and P.D.C. conceived and/or designed the study. L.H.W. and S.B. constructed the surveys. L.H.W., S.B., M.C., E.F., and A.S. designed and conducted the outreach activities. L.H.W, S.B., and J.G.P.M. collected samples and extracted DNA. S.B. and J.G.P.M performed library preparation. F.C. conducted sequencing. L.H.W. conducted analysis of survey and high-throughput sequencing data. L.H.W. wrote the manuscript with contributions from M.C., S.B., P.W.O.T., and P.D.C. L.H.W., M.C., S.B., P.W.O.T., and P.D.C supervised the project.