research papers
Training undergraduate research assistants with an outcome-oriented and skill-based mentoring strategy
aDepartment of Physics and Astronomy, Brigham Young University, Provo, Utah, USA
*Correspondence e-mail: dennis.dellacorte@byu.edu, adam_bennion@byu.edu
Effective mentoring of undergraduate students is a growing requirement for the promotion of faculty at many universities. It is often challenging for young investigators to define a successful mentoring strategy, partially due to the absence of a broadly accepted definition of what mentoring should entail. To overcome this, an outcome-oriented mentoring framework was developed and used with more than 25 students over three years. It was found that a systematic mentoring approach can help students quickly realize their scientific potential and result in meaningful contributions to science. This report especially shows how the Critical Assessment of Protein Structure Prediction (CASP14) challenge was used to amplify student research efforts. As a result of this challenge, multiple publications, presentations and scholarships were awarded to the participating students. The mentoring framework continues to see much success in allowing undergraduate students, including students from underrepresented groups, to foster scientific talent and make meaningful contributions to the scientific community.
Keywords: mentoring; undergraduates; CASP; protein structure prediction; deep learning.
1. Introduction
An increasing number of universities expect faculty to enrich the undergraduate curriculum by providing meaningful research opportunities for enrolled students. Recent reports indicate that mentoring relationships have many direct benefits (Gee & Popper, 2017; Gee, 2019). Marshall and coworkers state that mentored students acquired benefits in relational knowledge, self-awareness and career development (Marshall et al., 2021). Goodman-Wilson claims that mentoring relationships can be indicative of students' psychological challenges, such as depression or social anxiety, therefore providing opportunities to identify struggling students (Goodman-Wilson, 2021). Morales and coworkers found that mentoring can also be an effective tool to support diverse students (Morales et al., 2021).
It is surprising that despite the large amount of evidence for positive mentoring results, little can be found in the published literature on effective research mentoring of undergraduate students. Further, reviews found as many as 50 different definitions and limited progress in building a consensus in definition, theory and methods for mentoring in general (Gershenfeld, 2014). In the absence of a common definition of mentoring, we follow the suggestion of Koch and coworkers and define a mentoring strategy based on the goals that mentoring is supposed to achieve (Koch & Johnson, 2000). We hypothesize that a skill-focused mentoring program will enable meaningful research outcomes.
The relationship between student and faculty is frequently called mentoring, with the supervisor taking the role of a trusted advisor or mentor and the student that of a learning protégé or mentee. While the origins of the term `mentoring' go back to the Greek hero Odysseus, who entrusted his son Telemachus to a wise counselor named Mentor, the modern definition of this term is still under debate (Koch & Johnson, 2000). Some of the common elements found in successful mentoring programs reportedly include matching, preparation, interaction and evaluation (Gannon & Maher, 2012).
In a thoughtful summary of the progress of student mentoring, Gonzales argues that the boundaries between graduate and undergraduate research are becoming blurred as the US research university evolves (González, 2001). This is driven by the needs of a knowledge-based global economy, where students with research experience show an increased ability to adapt quickly to new situations and to solve difficult problems.
Adding research requirements to undergraduate experiences carries an inherent risk of distracting students from core class objectives. However, Heager and Fresquez found that students mentored in research had significantly higher cumulative grade point averages and similar graduation rates as a matched set of peers (Haeger & Fresquez, 2016). Johnson and coworkers discussed the significant costs associated with an effective mentoring program for faculty in terms of time devoted to mentoring, expenditure of emotional energy and relationship-induced stress (Johnson et al., 2015). Johnson and coworkers further warn that time spent mentoring may result in increased risk of faculty burnout, decreased productivity and difficulty with promotion milestones.
It is apparent that the current literature applauds the efforts of faculty members who elect to be mentors and identifies many benefits for the mentored students; however, the reported risks for these faculty members could carry severe implications. Given the pressures of an early scientific career and a ticking tenure clock, the increasing mentoring expectations for young faculty members can appear overwhelmingly stressful. Nevertheless, if the outcomes of a mentoring strategy are aligned with the goals of mentor and mentee, success and deep satisfaction can result. We are of the opinion that the mentoring relationship between faculty members at research universities and undergraduates involved in their research programs is a key differentiator between failed and successful mentoring. To support this, the objective of the mentoring strategy presented here is to develop students into collaborators and not only to advise them on course material or study/career plans.
The current literature provides little evidence that research-based mentoring offers long-term benefits to either mentors or mentees. While general classroom and social mentoring is frequently a subject of discussion, little is known about effective ways to use mentoring for the integration of undergraduates into research programs. This report sets out to provide a unique perspective on the relationship between a faculty member and a team of undergraduates. We provide a case study that highlights an outcome-oriented skill-based mentoring (OOSBM) strategy that can be adapted at other institutes and evaluate the efficacy of this strategy through a retrospective analysis covering two years. We claim that an OOSBM strategy can help undergraduate students to rapidly assess their research potential and to contribute meaningfully to their scientific discipline. This in turn increases the productivity of the mentor's laboratory and thereby supports the achievement of other academic goals.
2. Framework
2.1. Outcome-oriented skill-based undergraduate mentoring strategy
We propose a novel outcome-oriented and skill-based mentoring (OOSBM) strategy as visually summarized in Fig. 1. Aspects of this strategy first emerged naturally in the Della Corte Laboratory at Brigham Young University (BYU) and were later formalized into this reusable framework. Each phase serves as a meaningful training round but also as a filter to rapidly identify students with research aptitude. The aim is to enable undergraduates to obtain rich research experience comparable to that of graduate programs to best prepare them for industrial and academic careers after graduation. It is aligned with the academic age of a student in a typical four-year bachelors' program in the US: freshman, sophomore, junior and senior. Students may start with the onboarding phase at any point in their program, but the earlier that they enter the further they can proceed. For this model to work, students are expected to work weekly between ten and 20 hours in the Winter and Fall semesters and between 20 and 40 hours in the Spring and Summer semesters. These hours typically do not contribute to the credit hours taken towards a program but are extracurricular. However, some programs allow students to take some research credit as an elective and this option is encouraged where available.
Study plans in various STEM departments across the US suggest that most programs limit the exposure of undergraduates to research to the last one or two semesters of their degree, sometimes in conjunction with a senior thesis (Trosset & Weisler, 2018). This is unfortunate, as students are barely able to comprehend scientific literature and perform simple tasks in research projects after completion of this phase. While publications with undergraduate co-authors are sometimes the results of such limited research mentoring, first-author undergraduate papers are nearly impossible. The OOSBM strategy proposes that starting students out earlier could allow them the necessary time to build on their onboarding knowledge and design their own projects.
The onboarding phase has the goal of letting students contribute to a scientific publication. It is important for students to see early on where research should lead and teaming them up with a more senior student in the laboratory is often beneficial. The typical task for students in this stage is a systematic literature review, either for a project proposal, review paper or introduction/discussion section. The OOSBM strategy builds on this by asking undergraduates to conduct a more substantial literature search (for example reading between 100 and 150 research papers). We believe that this will differentiate research-oriented students from laboratory tourists (i.e. students who will make a significant contribution compared with those who are more interested in seeing the sights of your laboratory group), who typically drop out of the group within the first semester. Ideally, students are awarded a paid research position at this stage to offset social differences. Other activities at this stage could involve taking a scientific writing course, learning how to prepare scientific figures and running basic analysis on data sets provided by collaborators or group members. A student who has successfully contributed to a publication and has developed the necessary literature comprehension is then tasked to write their own research proposal.
Within the design phase of a project, students use the literature review that they developed during the onboarding phase to formulate a hypothesis for original follow-up work. Building on the methods that they are now acquainted with, they can choose the experimental setup most suitable to test their hypothesis and initiate first proofs of principle. In this phase, their responsibilities are comparable to that of a masters student in a typical graduate program, as they prepare and defend a prospectus at a weekly group meeting, create a project plan and prepare for leading the implementation efforts.
Within the project lead phase, students could team up with other undergraduates for small aspects of the work (such as running specific simulations or training machine-learning networks), but overall they would assume the role of a project lead and secure a first authorship. We expect that most students would not be likely to make it through this stage before graduation, but if successful they could come out of their undergraduate studies with two to three publications and substantial independence in conducting research.
Those students that started early enough and showed exceptional talent (the top 5%) can progress to the fourth level of a mentor. This is a PhD-like experience where they start to train and lead a set of other undergraduates (who are typically at levels 1 and 2) on a variety of projects. They would also support the PI in the process of writing grants and may manage to gain co-authorships on multiple papers.
2.2. Elements of research projects conducive to the success of novel mentoring strategy
While working with over 25 undergraduate research assistants over the course of three years, we found that some projects are more conducive than others in reaching the objectives of an OOSMB strategy. In our program, successful undergraduates have been able to graduate with over five publications and secured high-profile scholarships and grants for graduate school (for examples of review papers, see Section 4.2). While each scientific discipline has their own challenges and benefits, we suggest that the following criteria be considered as a way to evaluate new projects for suitability as undergraduate-driven research projects.
2.2.1. Accessible literature
Students should be able to easily identify the most relevant articles for their project. Having access to recent review articles, specific journals or special editions devoted to the question that they are setting out to research provides invaluable insights. Students learn not only subject-matter expertise, but can also learn patterns of successful publications in their respective field. Good authors are great readers; therefore, providing students with the best literature in the field is critical for success. In addition, frequent conversations in the team (either during group meetings or via electronic communication tools such as Slack, Discord or Microsoft Teams) are essential to help new laboratory members to identify relevant literature.
2.2.2. Clear problem definitions
Unexperienced researchers often struggle with the formulation of a testable hypothesis. Some established research fields feature existent well defined problems. Tackling a problem with a history provides students with meaningful context and often allows them to grasp the importance of their work more clearly than an offshoot explorational project would.
2.2.3. Crisp timelines
Students battle with conflicting priorities, especially during testing-heavy semesters and due to increasingly complex personal lives (for example, many undergraduates at BYU marry young and frequently have children before graduation). Selecting projects with externally forced timelines can counteract the tendency to procrastinate. While this can also put more stress on students, it is a valuable lesson for future projects, when external stakeholders will require results independent of personal challenges.
2.2.4. Plannable
Occasionally, ad hoc projects can be highly rewarding, but for undergraduates a project plan is most essential. If students do not know what is expected by when, they can easily get lost or sidetracked in details or distractions. Creating an aligned Gantt chart and having frequent meetings are important. However, if external factors mandate a plan it tends to be easier to motivate students than internal deadlines would.
2.2.5. An active research community for networking
Publishing a paper can be very rewarding, but discussing it with other professionals leaves the greatest impact on a student's self-perception. Access to focused conferences or interaction with a network of collaborators/partners is an essential criterion for students seeking to find their role in the scientific community.
2.2.6. Potential for high impact
A project without future impact has limited meaning to a student. While certain foundational questions are often of great interest to a seasoned researcher, the minute details are often illusive to the untrained student. Especially for motivation in a large research group, it is important for a student to be able to explain the importance of their respective project in clear and brisk terms. The future employability of students also benefits when they can deliver elevator pitches about their work.
3. Case-study description
3.1. Host institute
Brigham Young University is an R2 research university (i.e. a university with high research activity) focusing on undergraduate education. The Della Corte Laboratory is part of the Physics and Astronomy department and hosts the interdisciplinary Consortium of Within this consortium, students from Physics, Chemistry, Biology, Computer Science and Engineering collaborate on diverse projects involving drug discovery and laboratory informatics. The Della Corte Laboratory was started in October 2018 and currently hosts two affiliate faculty members, three graduate students and 15 undergraduate students. In total, over 30 undergraduates have been mentored within this laboratory. This report focuses on the four students mentored in context of the CASP14 challenge.
3.2. Participants
For this report, a team of four undergraduate students was mentored for over three years according to the OOSBM method in the context of a community challenge. Table 1 provides details of the students involved. This report focuses on the specific mentoring opportunity offered by community challenges. While all students in the group are mentored according to the described framework, this report focuses on those that participated in CASP14. The research team from whom data were collected are also authors of this article and no written consent for their inclusion was required.
|
3.3. Description of community challenges
We believe that community challenges per definition check off most of the criteria outlined previously. These communities are typically organized around well established research questions, have their own conferences or proceeding reports and host experiments that often follow plannable patterns. We provide an overview of some of the community challenges in computational biology in Table 2 (Boutros et al., 2014). Similar lists can be found for various other disciplines.
|
We selected the CASP challenge as a testing ground for our OOSBM strategy. The CASP challenge is a highly visible community event and has been held at regular intervals every two years since 1994, with the most recent iteration, CASP14, finishing in December 2020 (Pereira et al., 2021). The aim of this challenge is to benchmark methods that can be used to predict the folded structure of proteins and related objectives from limited information, such as amino-acid sequences. For this, a set of experimentally solved (but not yet published) protein structures are shared by laboratories with the assessment center. CASP then releases, over a period of multiple months, information about these structures, called prediction targets. A large community, often over 100 registered groups, has a limited time window to make predictions, after which they share the results back for assessment. In a concluding conference, typically in December of the same year, the results of the different experiments are shared, and selected groups present their methods. The following year, a special issue in the journal Proteins is dedicated to reports from the best-performing groups and general experimental assessments.
3.4. Data sources and analysis
To better understand the structure and perceived outcomes of our mentoring program, we collected data in the form of participant and group laboratory journals, project calendars and semi-structured interviews of the laboratory group members (see Table 3; Weiss, 1995). We used the project calendars and laboratory journals to catalog how often the group met, the purpose of each meeting (for example data analysis, progress updates, social) and to obtain a sense of the productivity and timeliness of the group's progress. We also used semi-structured interviews to understand the perspectives of the participants. Dr Bennion (a science education researcher in the Department of Physics at BYU) wrote the protocol (see supporting information) and conducted the interviews. The interviews were conducted in person when possible and over Zoom when necessary. We recorded the interviews and transcribed them for coding purposes. We interviewed each participant of the laboratory group that participated in CASP. Because this is a self-study (all of the participants are authors of the paper) no formal consent was required.
|
In our analysis, we organized the data from the interviews into several categories (for example Skills and Outcomes, Why Do Research, Contributions etc.). Within these general categories, we developed themes through open coding (Maxwell, 2012), a process that involved finding patterns based on the comments of the respondents and refining these themes into codes by the trends found across the data (see Tables 4 and 5 for descriptions and examples of each theme). To test the legitimacy of the coding, we presented the themes to the participants to check our interpretation of the interviews. We used the laboratory journals and project calendars to construct timelines for the project. Data from these analyses are presented in the findings below.
|
|
4. Case-study results
4.1. Results from applying the mentoring strategy to CASP for the participants
Analysis of the interviews conducted with the project participants allowed the identification of specific skills that the participants claimed to have developed. The four students are co-authors on one, three, four and five articles published while students at BYU, and all presented posters or gave talks at international conferences. We list recurring themes with concrete examples from the interview in Table 4. Besides the necessary technical and literacy skills, we observed that students pointed out the development of communication, networking and project-planning skills. As the challenge posed external deadlines the resulting stress levels were occasionally difficult for the students to manage. This became apparent during daily early morning meetings, where some students would either not show up or be rather agitated. We also found that the CASP conference enabled the presentations and interactions of the students with the domain experts that was hoped for. We find that students report the development of various skills that agree with the objectives defined in the OOSBM strategy.
4.2. Preparing for, executing and evaluating the CASP14 challenge
The timeline of the CASP14 challenge is displayed in Fig. 2 and mapped against the proposed OOSBM strategy. In late 2018, our team began the onboarding phase by attending the CASP13 conference and collecting relevant literature. After about six months, we understood the best methods in the field and designed new approaches based on them (Billings et al., 2019, 2021; Stern et al., 2021). Before the official CASP14 challenge began, the assessment center launched a community-wide experiment to help with the of COVID-19-related proteins (Kryshtafovych et al., 2021). This presented itself as an excellent opportunity to test the data pipeline and submission scripts for our group.
The real CASP14 challenge began in May 2020 with the release of the first protein sequence. We made predictions for all targets in the Free Modeling, et al., 2021). The three undergraduates who were responsible for running the predictions worked contracts of between 20 and 40 h per week. Each morning, we met at 8 a.m. through Zoom to go over all the various targets and tracked progress in a multi-stage pipeline on a Google sheet. Sometimes these discussions would take only a few minutes, but at times multiple challenging targets would require us to spend hours going over the details.
Contact, Distance and Experimentally Assisted test categories (for detailed definitions, see KinchA remote conference in December 2020 marked the end of the CASP14 experiment. At this conference, each participant from the Della Corte Laboratory presented posters on the methods that they had used during the experiment and others developed afterwards (Morris et al., 2020a,b, 2021). We were also invited to contribute to the Roundtable discussion and students held related presentations at a variety of other conferences (Morris, 2021). The networking opportunities with leaders in the field from both academia and industry proved very valuable to the students and helped them to realize their scientific potential.
Within the . A detailed description of our protocol and its strengths and weaknesses will be reported in a separate manuscript.
category, we were one of only three laboratories that on average improved the predicted protein structures. The goal of the section in CASP is to improve a good protein structure prediction further. These improvements are often very small, as shown for a set of targets in Fig. 34.3. Evaluating the suitability of the CASP community challenge as an undergraduate research project
The undergraduates appreciated leveraging community challenges for several reasons. Table 5 outlines the benefits that they discussed in their interviews as themes or conditions that can generally be applied by other research groups who are seeking to engage their undergraduates in a similar way. We note that the specific features, as mentioned by the students, align very well with the above-defined criteria for ideal undergraduate projects. In particular, the commentary on how the challenge helped the students to understand their scientific potential and to plan out their careers is deemed to be a great success of the OOSBM strategy.
5. Discussion and conclusions
Given the large differences between existing mentoring definitions (Gershenfeld, 2014) and the absence of a well established scheme for mentoring undergraduate research assistants, we proposed a novel OOSBM strategy and tested it over the course of three years in the context of the CASP community challenge. The mentoring relationship between the students and faculty has shown multiple direct benefits, as suggested elsewhere (Gee & Popper, 2017; Gee, 2019). We particularly agree with Marshall and coworkers, and find that the students achieved a greater degree of self-awareness and career development as they understood their potential as researchers and their specific research areas better (Marshall et al., 2021; Mello et al., 2017). In this project and in other mentoring activities since, we have found evidence for the claims of Morales and coworkers that research mentoring can overcome challenges for diverse student groups (for example gender, culture, ethnicity) by giving them a common objective that unifies (Morales et al., 2021). The successfully mentored research students all hold very high grade point averages and have been able to maintain graduation timelines, as also reported by Haeger & Fresquez (2016).
Contrary to the emotional, time and productivity cost reported by Johnson and coworkers, our OOSBM strategy has proven highly rewarding for the faculty member involved; it fostered deep friendships on a personal plane as well as resulting in an increased number of published articles on a professional level (Johnson et al., 2015). This might be partially due to the conducive environment for undergraduate research at BYU, where student salaries were paid by college funds, or the generally lower tenure requirements compared with some R1 schools (i.e. doctoral universities with very high research activity) in terms of the impact factor of published articles and/or the size of secured external grants. However, following González (2001) and realizing that the boundaries between graduate and undergraduate research are becoming blurred in US research universities, we anticipate that research laboratories at R1 institutes can also access the benefits of the OOSBM strategy. Creating paid undergraduate research opportunities is also a powerful lever to overcome socioeconomic differences that might otherwise force some highly gifted students to pursue employment outside the university.
Undergraduate research mentoring is expected to remain a growing responsibility for instructors at many universities and we found that it requires conscientious planning to be successful. Our proposed strategy can help undergraduates to quickly explore their scientific aptitude. The point-based evidence from applying the strategy to CASP suggests that meaningful undergraduate mentoring can be personally and professionally rewarding to mentors and mentees. We found that community challenges provide a strong framework for meaningful undergraduate research projects.
We suggest that community challenges such as CASP can provide the following benefits.
|
We caution that some aspects of community challenges also bear an intrinsic risk, as expressed by one of our participants during the interview:
I think if [the competition] is the only thing the science is being developed for, that could be less helpful because if you don't do well … I don't know quite how the students would feel about it … if it's solely developed for the competition.
We agree that while CASP was in general a successful event for our students, other groups with less success might have lost their motivation. Nevertheless, we consider this to be an ideal preparation for industry projects, which are frequently accompanied by high stress levels and subject to unexpected changes or abrupt terminations.
The key is to help students look beyond the competition and to help them realize after the event how much personal growth occurred during it, regardless of the overall outcome obtained by the group. Allowing personal feedback and reflection after an undergraduate project is an essential part of the learning experience, especially for students that are used to measuring their academic value solely by numeric scales such as grade point averages. We found that a small party with a nice dinner at a local restaurant provided a great closure event.
We recommend principal investigators interested in involving undergraduates to use a systematic model, such as the OOSBM strategy introduced here. It provides clear guidance to the mentor and mentee, and is focused on producing outcomes of benefit for students and faculty alike. Further, we encourage institutions to consider using available funds more proactively in support of undergraduate research assistants; they tend to cost a lot less than graduate students but can yield comparable results. Finally, while the OOSBM strategy could be effective outside events such as CASP, we encourage researchers to explore community challenges in their respective fields as they have been identified as ideal testing grounds for novel mentoring models.
In summary, well mentored undergraduate research opportunities, such as CASP, challenge students to grow outside their comfort zone. These opportunities do not need to fit into a specific program of study but are suggested to be extracurricular, with similar benefits to those discussed by Mello et al. (2021). In our case, the methods developed by the students contributed to one category at the top of the field. Associated publications and network access helped the students see their value as researchers and contributors. Especially for underrepresented groups, such as females and minorities, this early exposure to meaningful research can help them realize their potential and lead to a successful scientific career [for example, three female laboratory members have been awarded with the prestigious Goldwater scholarship (Kettler & Puryear, 2021) in 2020, 2021 and 2022]. Using a systematic mentoring strategy such as the OOSBM strategy can provide a framework to enhance undergraduate education to the next level.
Supporting information
Interview protocol. DOI: https://doi.org/10.1107/S2059798322005861/ai5005sup1.pdf
Acknowledgements
DDC thanks the College of Physical and Mathematical Sciences at BYU for start-up and undergraduate funds. All authors thank the Office of Research Computing at BYU for access to compute resources. Author contributions are as follows. DDC developed the strategy and mentored the students. CM, WMB and BH prepared and executed the CASP experiment. JS and AJ contributed to the CASP conference and related publications. AB performed the post-experiment interviews and analysis. All authors contributed to the writing of this article.
References
Billings, W. M., Hedelius, B., Millecam, T., Wingate, D. & Della Corte, D. (2019). bioRxiv, 830273. Google Scholar
Billings, W. M., Morris, C. J. & Della Corte, D. (2021). Sci. Rep. 11, 8039. CrossRef PubMed Google Scholar
Boutros, P. C., Margolin, A. A., Stuart, J. M., Califano, A. & Stolovitzky, G. (2014). Genome Biol. 15, 462. CrossRef PubMed Google Scholar
Gannon, J. M. & Maher, A. (2012). Educ. Train. 54, 440–455. CrossRef Google Scholar
Gee, K. L. (2019). Proc. Meet. Acoust. 39, 025002. CrossRef Google Scholar
Gee, K. L. & Popper, A. N. (2017). Acoust. Today, 13, 27–35. Google Scholar
Gershenfeld, S. (2014). Rev. Educ. Res. 84, 365–391. CrossRef Google Scholar
González, C. (2001). Science, 293, 1624–1626. PubMed Google Scholar
Goodman-Wilson, M. (2021). Mentor. Tutoring, 29, 328–348. Google Scholar
Haeger, H. & Fresquez, C. (2016). CBE Life Sci. Educ. 15, ar36. Google Scholar
Johnson, W. B., Behling, L. L., Miller, P. & Vandermaas-Peeler, M. (2015). Mentor. Tutoring, 23, 441–453. CrossRef Google Scholar
Kettler, T. & Puryear, J. S. (2021). Specialized Schools for High-Ability Learners, edited by B. MacFarlane, pp. 177–187. New York: Routledge. Google Scholar
Kinch, L. N., Schaeffer, R. D., Kryshtafovych, A. & Grishin, N. V. (2021). Proteins, 89, 1618–1632. CrossRef CAS PubMed Google Scholar
Koch, C. & Johnson, W. B. (2000). Counc. Undergrad. Res. Q. 19, 172–175. Google Scholar
Kryshtafovych, A., Moult, J., Billings, W. M., Della Corte, D., Fidelis, K., Kwon, S., Olechnovič, K., Seok, C., Venclovas, Č., Won, J. & CASP-COVID participants (2021). Proteins, 89, 1987–1996. CrossRef CAS PubMed Google Scholar
Marshall, M., Dobbs-Oates, J., Kunberger, T. & Greene, J. (2021). Mentor. Tutoring, 29, 89–109. CrossRef Google Scholar
Maxwell, J. A. (2012). Qualitative Research Design: An Interactive Approach, 3rd ed. Los Angeles: SAGE. Google Scholar
Mello, L. V., Tregilgas, L., Cowley, G., Gupta, A., Makki, F., Jhutty, A. & Shanmugasundram, A. (2017). High. Educ. Pedagogies, 2, 43–57. CrossRef Google Scholar
Mello, L. V., Varga-Atkins, T. & Edwards, S. W. (2021). FEBS Open Bio, 11, 1524–1536. CrossRef PubMed Google Scholar
Morales, D. X., Grineski, S. E. & Collins, T. W. (2021). Stud. High. Educ. 46, 423–436. CrossRef Google Scholar
Morris, C. J., Billings, W. M. & Della Corte, D. (2020a). CASP14 Virtual Conference. Google Scholar
Morris, C. J., Billings, W. M. & Della Corte, D. (2020b). CASP14 Virtual Symposium. Google Scholar
Morris, C. J., Billings, W. M. & Della Corte, D. (2021). ASBMB PDB50 Symposium. Google Scholar
Pereira, J., Simpkin, A. J., Hartmann, M. D., Rigden, D. J., Keegan, R. M. & Lupas, A. N. (2021). Proteins, 89, 1687–1699. Web of Science CrossRef CAS PubMed Google Scholar
Stern, J., Hedelius, B., Fisher, O., Billings, W. M. & Della Corte, D. (2021). Int. J. Mol. Sci. 22, 12835. CrossRef PubMed Google Scholar
Trosset, C. & Weisler, S. (2018). Chang. Mag. High. Learn. 50, 47–53. CrossRef Google Scholar
Weiss, R. S. (1995). Learning From Strangers: The Art and Method of Qualitative Interview Studies. New York: Simon & Schuster. Google Scholar
This is an open-access article distributed under the terms of the Creative Commons Attribution (CC-BY) Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original authors and source are cited.