Undergraduate Research Experiences Grow Career-Ready Transferable Skills

Undergraduate Research Experiences Grow Career-Ready Transferable Skills

Recommended Citation: Gunnels, Charles W., Jaclyn Chastain, Shawn Brunelle, Anna Carlin, Thomas M. Cimarusti, Mary Crone-Romanovski, Richard W. Coughlin, Carolyn Culbertson, Jason Elek, April Felton, Shawn Felton, Debra A. Giambo, Katie Johnson, Shawn Keller, Dawn Kirby, Santiago Luaces, Derek Lura, Peter Reuter, Tunde Szecsi, Rachel Tait-Ripperdan, Scott Vanselow, Judy Wynekoop, Hulya Julie Yazici, Melodie H. Eichbauer . 2024. Undergraduate Research Experiences Grow Career-Ready Transferable Skills. Scholarship and Practice of Undergraduate Research 8 (1): 15-25. https://doi.org/10.18833/spur/8/1/1


Transferable skills, namely critical thinking, communication, problem solving, and adaptability, serve as the bedrock of a successful and fulfilling career. Employers increasingly demand candidates with career-ready skills in addition to technical competencies. Therefore, institutions of higher education have increasingly fostered academic environments that couple holistic learning with career preparation (National Association of Colleges and Employers 2022). However, the ability of higher education institutions to provide students with material value has been met with increasing skepticism by graduates, employers, and society. For example, a recent report in the Chronicle of Higher Education found that only 24 percent of graduates felt that their undergraduate experience provided significant value (Kelderman 2023). In addition, perceptions about the value of higher education have become increasingly politicized in the United States (Parker 2019). In a time of public scrutiny regarding student loans, tuition, and job prospects, universities must be accountable if they wish to serve the best interests of students and society.

Undergraduate research experiences may be expected to develop career-ready transferable skills as well as, if not better than, other high-impact practices (Ashcroft, Blatti, and Jaramillo 2020; Chadha and Nicholls 2006; Hernandez et al. 2018). To promote the development of transferable skills, Florida Gulf Coast University (FGCU) implemented an institution-wide quality enhancement plan (QEP) called FGCUScholars: Think, Discover, Write in 2015 that worked with departments to integrate undergraduate research and scholarship across the university to improve students’ critical thinking, information literacy, and written communication (Gunnels et al. 2020). Although some course-embedded undergraduate research experiences (CUREs) and extensive opportunities for individual faculty-mentored research were in place before 2015, implementation of FGCUScholars started the coordinated effort to integrate research skills across the four-year curriculum and diverse majors. The transferable skills associated with FGCUScholars were identified based on an internal assessment and feedback from employers and graduate programs. Although FGCU graduates were seen as proficient in disciplinary and content knowledge, stakeholders indicated that students needed to improve their ability to (a) engage in critical thinking and complex problem solving; (b) conduct research and use evidence-based analysis; and (c) express themselves professionally through high-level writing. To enhance these skills, academic departments were required to scaffold learning competencies, from general education through capstone courses. Although academic majors were encouraged to develop research skills throughout the curriculum and students to engage in research-oriented capstones, some departments used case studies, internship and service-learning experiences, or academic reflections (in which fourth-year students gave thought to their experiences and learning over the previous four years) for their capstones. The variety of capstone formats allowed comparisons of skill levels across types.

To learn how undergraduate research experiences affected the expression of transferable skills over time and relative to other learning experiences, the critical thinking, information literacy, and written communication skills of fourth-year undergraduates who participated in a research-oriented capstone were first compared with those of first-year students and then with fourth-year students who undertook different capstone experiences. If undergraduate research experiences enhanced transferable skills positively, fourth-year students who engaged in research would be expected to demonstrate higher skill levels than first-year students and fourth-year undergraduates who completed alternative capstone experiences.

Methods

FGCU, established in 1997, is a public, regional, comprehensive university serving the academic, research, and workforce needs of Southwest Florida. By 2020, the institution enrolled over 15,000 students, 85 percent of whom were undergraduates (Florida Gulf Coast University 2023). During the FGCUScholars initiative, FGCU employed about 500 full-time faculty members and offered 52 undergraduate majors, with additional graduate degrees.

To understand how undergraduate research experiences affected career-ready transferable skills, the university conducted an annual university-wide assessment of students’ written artifacts based on seven proficiencies modified from the AACU VALUE (Validated Assessment of Undergraduate Education) rubrics (Association of American Colleges and Universities 2009). Critical thinking was assessed based on content development, analysis, and synthesis; information literacy according to students’ proper identification and effective use of evidence; and written communication by audience, disciplinary conventions, and syntax and mechanics (Table 1).

University-wide assessments took place at the end of each academic year between 2015 and 2020 (Szecsi et al. 2019). To ensure broad representation across the university, majors were organized into eight academic units that reflected disciplinary differences among the five colleges (business, education, engineering, health and human services, humanities, natural sciences and mathematics, social science, and visual and performing arts). During the spring semester, all majors were solicited to participate in the annual assessment with the goal of including at least one representative major from each academic unit (Table 2). All artifacts were assessed for majors with less than eight graduating four-year students, excluding student submissions that were set aside for norming. For larger majors, a random sample of artifacts were assessed relative to the size of the major, with a greater number of artifacts assessed from large-size majors than medium-size majors. In addition, approximately 6 percent of the final essays produced by first-year students in a second semester writing class (approximately 115 artifacts per year) were selected at random for assessment.

Faculty participation in the annual assessments was inclusive and voluntary; every assessment included multiple representatives from each of the eight academic units and the university library. The assessment began with a norming session, at which faculty agreed on the language described in the assessment rubric, learned about format differences among artifacts, gained understanding of disciplinary-specific distinctions, and worked toward conformity so that individual assessments reflected standards established by the group. Artifacts for norming were selected randomly and not assessed. Faculty then read, evaluated, and scored artifacts for each of the seven assessed criteria on a four-point scale (Table 1), with each artifact being read and evaluated by at least two assessors. A third and potentially fourth assessor were required if disagreement (< 85 percent agreement) among the first pair of assessors occurred. For each artifact, the average score was calculated for the seven assessed criteria and then a total average was computed to measure overall learning gains.

All statistical analyses were conducted with R (R Core Team 2023). Permutated analyses of variance (ANOVAs) were used to compare assessment results across academic levels (first-year vs. fourth-year students), capstone experiences (research, internship, case study, or academic reflection) and assessment years (years 1 to 5 of the QEP). Because permutated tests evaluate measured patterns relative to N iterations of random redistributions of the same data set, only the p value, degrees of freedom, and number of iterations that were required to resolve the p values were reported. ANOVA permutation tests with a maximum of 10,000 iterations were executed with the lmPerm package in R (Wheeler and Torchiano 2016). Significance levels were set at an alpha of .05. Visualizations of assessment results were created with the ggplot2 package (Wickham 2016).

Results

Demographics

Thirty-three of the 52 undergraduate majors submitted artifacts from their capstone during the five-year QEP (Table 2); the first-year writing program submitted assessment artifacts every year. By the final year of the QEP, artifacts from 576 first-year students and 702 graduating fourth-year students were assessed. Although the QEP focused on using undergraduate research experiences to improve transferable skills, students completed different capstone experiences depending on their major (undergraduate research, 69.1 percent, N = 485; case studies, 20.1 percent, N = 144; internship/service learning, 5.1 percent, N = 36; and academic reflection: 5.3 percent, N = 37).

Fourth-Year Students

Throughout the FGCUScholars initiative, fourth-year students who participated in undergraduate research capstone experiences showed higher-quality transferable skills in their critical thinking, information literacy, and written communication than first-year students and fourth-year students who completed alternative capstones. Fourth-year students who participated in undergraduate research showed 40.7 percent higher overall learning gains than comparable first-year students (Figure 1A, df = 1, 989; iterations = 10,000; p < .001). Moreover, fourth-year students who completed undergraduate research capstones displayed greater skill levels than fourth-year students who participated in alternative capstones (Figure 1B, df = 1, 711; iterations = 10,000; p < .001), showing on average 15.1 percent higher scores. Undergraduate research students showed the highest scores (22.6 percent) relative to students who completed case study capstones; 8.6 percent higher than students who completed academic reflections; and 2.2 percent higher than internship and service learning students. Among the assessed criteria, research students showed the highest relative scores in critical thinking (content development 14.7 percent; conclusion 11.4 percent) and information literacy (identification, 19.6 percent; effective use, 14.2 percent) compared to fourth-year students who completed alternative capstone experiences (Figure 1C).

Undergraduate Research Students

Repeated exposure to classes that integrated research skills appeared to cultivate students’ critical thinking, information literacy, and written communication. For example, research students in the fifth year of the study showed the highest overall scores (Figure 1D, df = 4, 493; iterations = 10,000; p < 0.001), scoring 21.2 percent higher than fourth-year research students in the first year of the QEP. Students in year 1 of the QEP only experienced the research-based capstone. As FGCUScholars progressed, students in the fourth and fifth years of the QEP received research skill training in their first-year writing course and in at least two additional classes within their major before the capstone. By the fifth year of FGCUScholars, graduating research students showed the highest levels in information literacy skills (identification, 27.8 percent; effective use, 30.8 percent), followed by critical thinking (content development, 24.5 percent; conclusion, 19.3 percent) and written communication skills (context; 15.6 percent; disciplinary conventions, 18.9 percent; syntax and mechanics, 12.7 percent) relative to research students who participated in only a research capstone in year 1 of the QEP (Figure 1E).

Special Cases

During the initiative, several cases shed light on why undergraduate research students may have shown higher career-ready transferable skills. When students completing a particular major had the choice of pursuing a research-based or internship-based capstone, research students showed higher overall skill levels than the internship students (Figure 2A, df = 1, 14; iterations = 2458; p = .039), displaying 28.1 percent higher skills. Of note, research students were required to use primary and secondary sources, which was optional for internship students. The role of information literacy was highlighted by differences among students who completed academic reflections for their capstone. In one group, the use of primary and secondary academic sources was optional (i.e., optional resource), whereas it was required for the other group. Students who completed academic reflections that required sources scored 78.2 percent higher levels than optional resource reflections (Figure 2B, df = 1, 35; iterations = 10,000; p < 0.001). Students who completed required academic reflections with sources demonstrated higher critical thinking (content development 154.2 percent; conclusion 90.6 percent) and written communication skills (context 62.9 percent; disciplinary conventions 69.8 percent; syntax and mechanics 38 percent), in addition to information literacy (identification 164.2 percent; effective use 142.3 percent) than students who produced optional resource reflections.

Discussion

FGCUScholars serves as a reminder that higher education enhances students’ overall learning and growth in ways that also support career and job readiness, with undergraduate research having a significant impact on the ability of students to utilize high-level transferable skills. These skills are vital to reflective thinking, that is, the ability to identify background assumptions and presuppositions that may influence and distort conceptions of truth and knowledge (Laursen et al. 2010; Moore and Parker 2021). Engaging in research requires students to continuously refine their hypotheses, processes, and conclusions. According to the often-cited Delphi Report, “The ideal critical thinker is habitually inquisitive, well-informed, trustful of reason, open-minded, flexible, fair-minded in evaluation, honest in facing personal biases, prudent in making judgments, willing to reconsider, clear about issues, orderly in complex matters, diligent in seeking relevant information, reasonable in the selection of criteria, focused in inquiry, and persistent in seeking results which are as precise as the subject and circumstances of inquiry permit” (Facione 1990). The results of FGCUScholars demonstrate how undergraduate research contributes to shaping critical thinkers and thoughtful communicators.

As shown in this study, pedagogies that include undergraduate research experiences build fundamental cognitive and transferable skills that students can use in their professional and personal lives. Findings of the study also showed that research-oriented transferable skills are not only associated with science and engineering, but also with social sciences, humanities, and business. For example, dialogs in these disciplines have centered on the importance of developing career-ready transferable skills in response to workforce needs (Brodhead and Rowe 2013). Beginning with first-year writing courses and continuing through capstone projects, humanities and social sciences FGCUScholars develop and reinforce skills most desired by employers throughout the curriculum (Figure 1D). Students learn to, and continually practice, thinking about problems, evaluating primary and secondary texts, and communicating findings (Figure 2B and 2C). When this was implemented across disciplines, students benefited tremendously. As shown in this study, engaging undergraduates in research is more than an apprenticeship for future scholars: it prepares the next generation of public and private sector employees to delve deeper, find new connections, and help construct a better world.

More research is required to establish long-term benefits associated with these findings. Future research should include external validation of these results, such as annual income and career advancement after graduation, as well as longitudinal assessments of individual students to confirm how these skills develop over time. Nonetheless, these results inform current debates regarding the value of an undergraduate education within the United States. Although concerns about the future of higher education persist, pronouncements of its demise and death are “greatly exaggerated.” Return on investment for education following graduation has increased (Webber 2022), and employer attitudes about higher education have improved (Flaherty and Rogowski 2021). Paying closer attention to the benefits associated with traditional higher education practices, including research-oriented undergraduate learning, can help inform national conversations about higher education that have, in recent times, relied on untested rhetoric. Supporting institutional and societal goals, undergraduate research experiences are a valuable form of experiential learning that benefit students professionally and academically, and merit further administrative support.

Data Availability

Raw data are not publicly available. Results come from annual campus-wide assessments and adhere to FERPA (Family Educational Rights and Privacy Act) guidelines. Prior to analysis, the examined data were anonymized. Anonymous data can be provided by the corresponding author upon request.

Institutional Review Board

S2021-51 was deemed exempt, category C.F.R. 45 Part 46.104(d)(3)(i)(A).

Conflicts of Interest

The authors have no conflicts of interest to declare.

Acknowledgments

The authors would like to thank the faculty, staff, administrators, and students at Florida Gulf Coast University who helped them make FGCUScholars such a resounding success. The authors could not have accomplished this work without their sustained support and dedication. They also wish to thank the SPUR editors and three anonymous reviewers. Their insights and suggestions made this a stronger article.

References

Ashcroft, Jared, Jillian Blatti, and Veronica Jaramillo. 2020. “Early Career Undergraduate Research As a Meaningful Academic Experience in Which Students Develop Professional Workforce Skills: A Community College Perspective.” In Integrating Professional Skills into Undergraduate Chemistry Curricula, edited by Kelly Y. Neiles, Pamela S. Mertz, and Justin Fair, 281–299. American Chemical Society. doi: 10.1021/bk-2020-1365.ch016

Association of American Colleges and Universities. 2009. “Inquiry and Analysis VALUE Rubric.” https://www.aacu.org/initiatives/value-initiative/value-rubrics/value-rubrics-inquiryand-analysis

Brodhead, Richard H., and John W. Rowe. 2013. The Heart of the Matter: The Humanities and Social Sciences for a Vibrant, Competitive, and Secure Nation. Cambridge, MA: American Academy of Arts and Sciences.

Chadha, Deesha, and Gill Nicholls. 2006. “Teaching Transferable Skills to Undergraduate Engineering Students: Recognizing the Value of Embedded and Bolt-on Approaches.” International Journal of Engineering Education 22: 116–122.

Facione, Peter. 1990. “Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction.” Delphi Report. California Academic Press. https://www.qcc.cuny.edu/socialSciences/ppecorino/CT-Expert-Report.pdf

Flaherty, Thomas M., and Ronald Rogowski. 2021. “Rising Inequality as a Threat to the Liberal International Order.” International Organization 75: 495–523. doi: 10.1017/S0020818321000163

Florida Gulf Coast University (FGCU). 2023. “Headcount Enrollment, Fall 2023.” https://public.tableau.com/views/FGCU_IR_Facts_0/HeadcountEnrollment?:embed=y&:showVizHome=no&:display_count=yes

Gunnels, Charles W., Anna Carlin, Derek Lura, Judy Wynekoop, Jaclyn Chastain, Jason Elek, Katie Johnson, et al. 2020. “QEP Impact Report: FGCUScholars: Think, Discover, Write; Enhancing the Culture of Inquiry from Composition to Capstone at Florida Gulf Coast University.” Southern Association of Colleges and Schools. doi: 10.13140/RG.2.2.32592.69127

Hernandez, Paul R., Anna Woodcock, Mica Estrada, and Paul W. Schultz. 2018. “Undergraduate Research Experiences Broaden Diversity in the Scientific Workforce.” BioScience 68: 204–211.

Kelderman, Eric. 2023. “What the Public Really Thinks about Higher Education.” Chronicle of Higher Education. https://www.chronicle.com/article/what-the-public-really-thinks-abouthigher-education

Laursen, Sandra, Anne-Barrie B. Hunter, Elaine Seymour, Heather Thiry, and Ginger Melton. 2010. Undergraduate Research in the Sciences: Engaging Students in Real Science. Hoboken, NJ: Jossey-Bass.

Moore, Brooke N., and Richard Parker. 2021. Critical Thinking. 13th ed. New York: McGraw-Hill.

National Association of Colleges and Employers (NACE). 2022. Development and Validation of the NACE Career Readiness Competencies. https://www.naceweb.org/uploadedFiles/files/2022/resources/2022-nace-career-readiness-developmentand-validation.pdf

Parker, Kim. 2019. “The Growing Partisan Divide in Views of Higher Education.” Pew Research Center. https://www.pewresearch.org/social-trends/2019/08/19/the-growing-partisandivide-in-views-of-higher-education-2

R Core Team. 2023. “The R Project for Statistical Computing.” The R Foundation. https://www.R-project.org

Szecsi, Tunde, Charles Gunnels, Jackie Greene, Vickie Johnston, and Elia Vazquez-Montilla. 2019. “Teaching and Evaluating Skills for Undergraduate Research in the Teacher Education Program.” Scholarship and Practice of Undergraduate Research 3(1): 20–29. doi: 10.18833/spur/3/1/5

Webber, Douglas. 2022. “Decomposing Changes in Higher Education: Return on Investment Over Time. FEDS Notes. Board of Governors of the Federal Reserve System. doi: 10.17016/2380-7172.3155

Wheeler, Robert, and Marco Torchiano. 2016. “lmPerm: Permutation Tests for Linear Models.” R package version 2.1.0. doi: 10.32614/CRAN.package.lmPerm

Wickham, Hadley. 2016. ggplot2: Elegant Graphics for Data Analysis. New York: Springer-Verlag.

Charles W. Gunnels IV

Florida Gulf Coast University, cgunnels@fgcu.edu

Charles Gunnels is a professor and chair of biology at Florida Gulf Coast University (FGCU). He teaches animal behavior and biological statistics in R and leads study abroad trips to Caribbean and South America countries. His scientific research focuses on human-animal interactions in urban habitats. In his scholarship of teaching and learning work, he examines how undergraduate research affects student learning gains.

Jaclyn Chastain is a coordinator for academic curriculum and support at FGCU. Chastain has a psychology BA with a management minor and an MA in educational leadership with a concentration in higher education from FGCU. She has been working in higher education for the past seven years, with most of her experience relating to quality enhancement planning, student research, special student populations, and curriculum development. Chastain is currently working on her doctorate degree in education.

Shawn Brunelle is a biology masters student at FGCU. He has been with FGCU since 2013, completing his undergraduate degree in 2018. Brunelle conducts research investigating the flowering genetics of Melaleuca, while also working as an educator, teaching several biology lab courses.

Anna Carlin is an associate librarian at FGCU. At the university library, Carlin has been a subject librarian, designer of instructional materials and tutorials, and manager of media production studios. Carlin served as the information literacy leader on the development and implementation teams that steered FGCUScholars.

Thomas M. Cimarusti is a professor of music history and program coordinator for the BA degree in music at FGCU. As a recipient of numerous grants and teaching awards, Cimarusti works with undergraduate students on various research topics concerning the musical activities of the nineteenth-century religious cult, the Koreshan Unity. His students have presented papers at the National Conference of Undergraduate Research and regional meetings of the American Musicological Society.

Richard W. Coughlin is an associate professor of political science at FGCU, where he teaches courses in political theory, international relations, and comparative politics. His research focuses on Mexican and US political development.

Mary Crone-Romanovski is an associate professor in the Department of Language and Literature at FGCU, where she teaches courses in British literature and culture (1660–1830). Her current research examines representations of the material world in eighteenth-century novels by women. Her publications include articles in Studies in Eighteenth-Century Culture and XVIII: New Perspectives on the Eighteenth Century as well as a book chapter in Gender and Space in Britain, 1660–1820.

Carolyn Culbertson is a professor of philosophy at FGCU. She specializes in the philosophy of language and philosophical hermeneutics. She is the author of Words Underway: Continental Philosophy of Language (Rowman and Littlefield International, 2019) and Gadamer and the Social Turn in Epistemology (SUNY Press, forthcoming).

Jason Elek teaches writing at FGCU, writes and records music, plays soccer, and kayaks through the mangrove tunnels of Southwest Florida. The rest of his time is spent chasing around his three young children.

April Felton is an assistant professor in the School of Nursing. Before entering the academy in 2019, she was a neonatal nurse practitioner. Felton teaches in the undergraduate nursing program, including child health nursing and introduction to professional nursing. Her scholarly interests include acquisition of skills by nursing students and innovative teaching practices utilizing simulation.

Shawn D. Felton is the dean in the Marieb College of Health and Human Services at FGCU. Felton returned to FGCU in August 2019 and served as the department chair of health sciences. Felton is engaged in research activities regarding musculoskeletal diagnostic ultrasound, lower extremity biomechanics and EMG activity, simulation in allied health care education, and implementation of micro-badges and digital credentials.

Debra A. Giambo is a professor of English for speakers of other languages in the College of Education. She also is an Honors Faculty Fellow, a member of the Honors Executive Board, and a Global Engagement Fellow at FGCU. Research interests include effective instructional practices for English learners, culturally responsive teacher preparation, English learner literacy, advocacy for English learners, field experience–based research, service learning and study-away experiences, and engaging undergraduate students in research.

Katie Johnson has enjoyed teaching math to others since middle school and is interested in anything that encourages more people (especially underrepresented groups) to study mathematics. She is a professor of mathematics and also coordinates the learning assistant program at FGCU. When not working, Johnson enjoys traveling, reading, cooking, yoga, and playing with her two young children.

Shawn Keller is an assistant professor in the Department of Justice Studies at FGCU. His research is in criminal justice from a biosocial perspective, examining the role epigenetics has on criminal and deviant behavior. He also pursues an interest in the use of future technologies to protect the public: facial recognition, 3D evidence presentation, 3D printing and gun control laws, body cameras with AI assistance, and use of personal and surveillance drones.

Dawn Kirby is associate provost for academic programs and curriculum development. An educator with extensive experience in teaching and administration in public and private universities, she has directed graduate dissertations, written curriculum, directed a National Writing Project site, and served in numerous administrative roles. She is a strong advocate for the value of a liberal arts education and for developing and mentoring students as leaders. Kirby has been a tenured professor since 2003.

Santiago Luaces studies wildlife biology and has a BS in biology and an MS in environmental science. His research has focused on the population ecology of the Florida burrowing owl and the effects of urbanization on their distribution. Luaces is currently working on his EDD, focusing on issues of equity in undergraduate research. He hopes to continue helping students engage in research throughout his career.

Derek Lura is dedicated to student success, which he facilitates though a combination of didactic, dialectic, hands-on, and project-based experiences. He believes that a diversity of techniques are required to teach students with different skills, mindsets, and foundational knowledge. Lura’s research focuses on prosthetic and rehabilitation devices and techniques. He also is engaged in a variety of other projects and uses research a means to facilitate engagement and learning with students outside the classroom.

Peter Reuter, retired, was an associate professor in the Department of Rehabilitation Sciences. He loved teaching undergraduate and graduate courses and inspired students to push themselves to success when challenged. Over the last ten years, Reuter has worked with 30 undergraduate and graduate students on research projects. Students have presented posters at regional, national, and international conferences and have been coauthors of peer-reviewed articles.

Rachel Tait-Ripperdan holds master’s degrees in library and information science and in history. She is an associate liaison librarian at FGCU, specializing in teaching information literacy skills to history, language and literature, communication, and philosophy students.

Tunde Szecsi is professor and program coordinator for the elementary education program at FGCU. She holds master’s degrees in Hungarian, Russian, and English language and literature from Hungary and a PhD in early childhood education from University at Buffalo. She teaches courses in elementary and early education and English for speakers of other languages. Szecsi’s research interests include multicultural education, culturally responsive teacher preparation, humane education, and heritage language maintenance.

Scott Vanselow is an instructor in the School of Entrepreneurship at FGCU, where he teaches entrepreneurship, innovation, and computer science. He also helps to lead and train student participants in the learning assistant program at FGCU. Vanselow earned his MS in computer information systems at FGCU.

Judy Wynekoop is a professor of information systems at FGCU. Before entering academia, she worked as an internal auditor in the retail sector and as a criminal investigator for the federal government. Her research has encompassed individual and team performance in systems development and use, as well as pedagogy in information systems.

Hulya Julie Yazici is currently a full professor of analytics and supply chain management at FGCU. She received her MSc and PhD in engineering management from Missouri University of Science and Technology. She worked with the manufacturing and mining industry in North America and Europe for a decade. She has been in academia for over 30 years, with a dedicated focus on critical thinking, multidisciplinary learning, and scholarship.

Melodie Eichbauer is interim director of the Office of Scholarly Innovation and Student Research and a professor of medieval history, specializing in legal and ecclesiastical history from c. 1000 to c. 1500 CE. She works to ensure that all students have easy access to undergraduate scholarship. Eichbauer believes that research enables student scholars to shape their version of an impactful life, a life in which their scholarly experiences will make a difference in the world around them.

A Scoping Review: Literature on Undergraduate Research and Career Readiness

A Scoping Review: Literature on Undergraduate Research and Career Readiness

Recommended Citation: MacDonald, Amanda B., Jeanne Mekolichick, Eric E. Hall, Kristin Picardo, Rosalie Richards 2024. Scoping Review: Literature on Undergraduate Research and Career Readiness. Scholarship and Practice of Undergraduate Research 8 (1): 3-14. https://doi.org/10.18833/spur/8/1/2


In recent years, the national narrative on the value of higher education has shifted. Americans are losing faith in an undergraduate degree and its worth as a vehicle for social mobility and a public good. Gallup poll data from 2015 shows that 57 percent of respondents indicated they had a “great deal” or “quite a lot” of confidence in higher education, compared to 48 percent in 2018 and 36 percent in 2023 (Jones 2024). Employers in the United States also are losing confidence in the value of a undergraduate degree. The 2021 report, “How College Contributes to Workforce Success,ˮ commissioned by the American Association of Colleges and Universities (AAC&U), shows a decrease in employer confidence in higher education dropping from 49 percent in 2018 to 41 percent in 2020 (Finley 2021). Given these data points, the value of higher education is unclear to a growing group of the public and employers.

With an eye on these trends, in 2019 the Council on Undergraduate Research (CUR) released a white paper, “Undergraduate Research: A Road Map for Meeting Future National Needs and Competing in a World of Change” (Altman et al. 2019) that argued for undergraduate research, scholarship, and creative inquiry (URSCI) experiences as a powerful tool for achieving workforce needs. The authors here use both the more inclusive phrase “undergraduate research, scholarship, and creative inquiry” reflective of the breadth of scholarly and creative activities across disciplines, as well as the more truncated “undergraduate research” more commonly found in the literature. The concise phrase, undergraduate research, is meant to be inclusive of scholarly and creative endeavors as well.

Supporting this position, another data point from the 2021 AAC&U’s How College Contributes to Workforce Success report (Finley 2021) shares that 85 percent of employers surveyed were more likely or somewhat more likely to consider hiring a candidate who had a mentored research experience. Considering these documents together begs the question: What elements of the URSCI experience contribute to workplace readiness and are recognized by prospective employers?

The National Association of Colleges and Employers’ (NACE) annual job outlook survey collects information on the skills employers seek in new undergraduates. Using these data, in 2021 NACE updated their list of career readiness competencies that students need to enter and thrive in today’s work environment. Eight competencies emerged: critical thinking, teamwork, communication, professionalism, career and self-development, leadership, technology, and equity and inclusion (NACE 2024). These competencies represent demonstrated outcomes of student participation in URSCI experiences. Mekolichick (2021) articulates the alignment in a NACE Journal article to assist career center professionals in highlighting the value of undergraduate research (UR) experiences for the workplace. Mekolichick (2023) later elucidates this in the 2023 CUR position paper, “Recognizing Undergraduate Research, Scholarship, and Creative Inquiry as a Career-Readiness Tool,” aimed at helping faculty intentionally identify these competencies for themselves and their students.

Specifically, URSCI experiences are found to enhance student learning, including growth in communication skills, critical thinking and teamwork, a greater understanding of the research process, technical skills, and data analysis competencies (see, for example, Brownell and Swaner 2010; Lopatto 2004; Osborn and Karukstis 2009). In addition, the literature consistently reports student improvement in related dispositions and social psychological constructs, including confidence, ability to work independently and overcome obstacles, increases in self-efficacy, cultivation of a professional identity, clarification of career path, leadership, and professionalism (see, for example, Hunter, Laursen, and Seymour 2007; Osborn and Karukstis 2009; Seymour et al. 2004). In sum, research clearly demonstrates the overlap between the benefits of URSCI and the career readiness competencies identified by employers. However, given public sentiment on the ability of higher education to achieve workforce needs, there is a disconnect between the documented career readiness skills gained in URSCI experiences and the translation of these experiences to the world of work.

CUR recognized this gap and charged a board working group (2021–2023) to advance this work. At the conclusion of their work in 2023, an implementation work group on undergraduate research and career readiness was established. As work began, the group recognized a need to learn more about the state of the literature. To date, there has not been a thorough review of the extent to which URSCI experiences have intentionally included career preparation in the United States. Taking into account the value shift regarding higher education and the foundational skills desired by employers described above, a scoping review was conducted to systematically map what the literature reveals about what faculty, programs, and institutions are intentionally providing to successfully bridge this articulation gap. This scoping review aimed to answer the question: What intentional career readiness competency programming are faculty, programs, and higher education institutions delivering and assessing in undergraduate research, scholarship, and creative inquiry experiences to help students become career ready?

Methods

The protocol was drafted according to the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P; Moher et al. 2015) and was published retrospectively at VTechWorks. The research methodology in this review was based on the JBI methodologies for scoping reviews as described in the JBI Manual for Evidence Synthesis (Aromataris and Munn 2020). This article follows the guidance of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR; Tricco et al. 2018).

Eligibility

For inclusion in this review, studies needed to contain at least one NACE competency and an associated assessment of the competency. Publication types included peer-reviewed journal articles, books, book chapters, news articles, white papers, and reports that were housed in the databases or Google Scholar. It is important to note that additional inclusion and exclusion criteria were added at the full-text screening stage. See criteria that begin with “During the full-text screening.” Additionally, there were studies excluded during the full-text screening process that conducted assessments of undergraduate research experiences after a program concluded and included a career readiness evaluation but lacked either an intentional career readiness objective or an associated assessment. The aim of this review was not to prove that undergraduate research experiences prepare students to be career ready, but rather to map researched approaches that faculty, programs, and institutions have successfully piloted to bridge the noted articulation gap.

Inclusion criteria included:

  • Any undergraduate research program in a higher education context; all two- to four-year accredited institutions, including community colleges and public and private schools
  • Undergraduate research, industry-based research, research internships, scholarship, or creative inquiry OR
    • Mention of UR as defined by CUR (“a mentored investigation or creative inquiry conducted by undergraduates that seeks to make a scholarly or artistic contribution to knowledge”; CUR 2024) OR
    • Formal UR experience that is mentored, describing student researchers as receiving one-on-one training, research experience, or co-creation of knowledge, scholarship, or creative works
    • CUREs (course-based undergraduate research experiences) or capstone courses that align with CUR definition of UR
  • Career readiness as defined by NACE (“a foundation from which to demonstrate requisite core competencies that broadly prepare the college educated for success in the workplace and lifelong career management”; NACE 2024) OR
    • NACE competencies (“career and self-development, communication, critical thinking, equity and inclusion, leadership, professionalism, teamwork, technology”; NACE 2024) OR
    • Industry-based research experience, industry internships with research, employment, professional skills, workplace skills, workplace preparation
  • UR, scholarship, or creative inquiry in any discipline, conducted within the United States. Publications can be published by an outlet (e.g., journal).
  • No date limits.
  • During the full-text screening, the primary goal of the study must include a career readiness intervention regarding one or more NACE competencies (whether explicitly named as NACE or not) with an associated assessment or outcome that is described and designed to measure student mastery of the competency or competencies. Language should state the goal of preparing students for the world of work with a NACE competency—whether explicitly named as NACE or not—that includes an intervention and associated assessment designed to measure student mastery of the NACE competency.

Exclusion criteria included:

  • Graduate students of graduate school programs. Middle school or high school students. Except if undergraduate research (etc.) programs or initiatives (as defined in Inclusion) also are included and data or descriptions of interest are (or can be) disaggregated.
  • Undergraduate courses with research components only (CUREs or capstone courses that align with CUR definition of UR meet inclusion criteria).
  • UR programs hosted by companies outside of higher education institutions (e.g., NASA).
  • Outside of the 50 United States; territories of the United States are excluded.
  • Publication types excluded are conference proceedings, conference abstracts, opinion pieces, editorials, and reports that can only be purchased from associations.
  • During the full-text screening, the primary goal of the study does not include a career readiness intervention regarding one or more NACE competencies (whether explicitly named as NACE or not) with an associated assessment or outcome that is described OR the associated assessment or outcome is mentioned but not described. Studies that include surveys or assessments gathering student feedback on how a UR experience prepared them for their career without a career readiness intervention regarding one or more NACE competencies will be excluded.

Sources

A total of 5 databases were searched in December 2023, and Google Scholar was searched in January 2024. Bibliographic databases were selected to be either non–discipline specific or discipline-specific as related to the research question. An education database was selected to account for interventions taking place in higher education institutions, and a business database was included given the relationship of the outcome with career readiness and the world of work. The following databases were searched:

  • Academic Search Complete (1980s–)
  • Business Search Complete (1980s–)
  • Education Research Complete (1865–)
  • Scopus (1800s–)
  • Web of Science (1900–)
  • Google Scholar (first 204 results)

Search

The search strategy was developed by a librarian on the team, with testing and revisions developed from team discussions. The final search strategy was peer reviewed following the Peer Review of Electronic Search Strategies (PRESS) 2015 Guideline Statement (McGowan et al. 2016) by two librarians outside of this study, both of whom had experience as systematic review coauthors or with evidence synthesis methods. Revisions were made based on their recommendations. The final search strategy used for Scopus was as follows:

TITLE-ABS-KEY ( ( ( undergrad* ) W/3 ( scholarship OR creativ* OR research* ) ) AND ( nace OR “national association of colleges and employers” OR (( career* OR job OR jobs OR profession* OR work* OR employ* OR occupation* ) W/3 ( readiness OR ready OR development* OR competen* OR skill* OR prepar* ) ) ) )

All searches were conducted utilizing the title, abstract, and author keywords fields within each database. Filters such as language, publication date, or publication type were not used during the search.

Selection

Covidence was the software tool used for the project (Covidence 2023). To initiate the study, pilot assessments were conducted at the start of each stage of the review process (i.e., title and abstract screening, full-text screening, and data extraction). During the title and abstract screening, 50 studies were reviewed for the pilot by the team, and conflicts were discussed and resolved before completing the screening for this stage. During the full-text screening pilot, 25 articles were reviewed. The team noted a high rate of conflicts during the full-text screening pilot, discussed the conflicts, and decided to add additional inclusion and exclusion criteria specifically for this round. To resolve the conflicts, the team repeated the full-text screening stage of the pilot with the revised criteria. During the data extraction stage, key characteristics or pieces of information from the studies were extracted in a structured way. Five studies were screened during the pilot by the team, and conflicts were discussed and resolved before completing the extraction phase. For all stages of the review process, two team members screened each study. All conflicts were discussed and resolved by consensus.

Data

Data were extracted on publication characteristics (reference identification number, journal title, study title, lead author, and year of publication), study characteristics (type of institution, aims/purpose, sample size, and discipline of students), career readiness aspect (NACE competency or skill and associated career readiness intervention), and career readiness assessment (how was it assessed, outcomes of the assessment, and any practices or recommendations the authors wished to share).

Synthesis

During the extraction phase, the team chose the method of copying and pasting relevant information into the form directly from the studies. As a result, there were lengthy responses on the form. Some responses were significantly trimmed during the data cleaning and visualization process to make Table 1 easier to read.

Results

Selection

A total of 2518 studies were imported into Covidence. In all, 888 duplicate items were identified by Covidence prior to study selection. Twelve duplicate items were identified and removed manually during the screening processes of the review. The title and abstract screening included 1618 studies, and 1328 studies were excluded. In total, 290 studies were assessed during the full-text screening. The full-text screening excluded 264 studies for the following reasons: 184 did not include a career-readiness intervention with an associated assessment or outcome; 39 were conference proceedings or abstracts, opinion pieces, editorials, or costly reports; 20 took place outside of the United States; 12 were courses with a research paper or project but not a CURE; 6 were research programs for graduate, middle school, or high school students or may have included undergraduate students but data did not differentiate status, and 3 were undergraduate research programs hosted by companies. There were 26 studies remaining that were deemed eligible for this review (see Figure 1).

Characteristics

The data extracted and charted for this review are showcased in Table 1. Each study’s lead author, year of publication, journal title, discipline(s) of students, type of institution, NACE competency or skill, career readiness intervention(s), and assessment strategy are displayed. The table has been sorted first by year, newest to oldest, then alphabetically by lead author’s last name, and finally by discipline.

Results

For this scoping review 26 articles were identified that met all the inclusion criteria (see Table 1). Figure 2 displays the relevant data charted for each part of the review question and objectives. For example, regarding the “intentional career readiness competency” portion of the research question, the career readiness interview was extracted from each study for data charting (see Figure 2).

Description

Eighteen of the 26 articles identified were published since 2020, suggesting that the focus on career readiness is a recent phenomenon. The primary journals that have published this work are the Scholarship and Practice of Undergraduate Research (n = 5) and the Journal of STEM Education (n = 2). The remaining publications were single articles from a variety of journals. Approximately 81 percent of articles focused on traditional STEM disciplines. Nineteen of the studies occurred primarily at four-year public institutions.

Of the 26 studies evaluated, 21 focused on career and self-development, and 13 targeted communication. Professionalism (n = 6), teamwork (n = 5), and critical thinking (n = 4) comprised the next frequency level of competencies addressed. The competencies least addressed were leadership (n = 1), technology (n = 0), and equity and inclusion (n = 0). Interventions implemented for the purpose of developing career competencies were primarily professional or career development workshops and activities (n = 16), followed by mentorship (n = 10) and skills development (n = 8). Unique interventions included conference participation (n = 4) and team-based research (n = 3). One study used an identity development intervention. When examining assessment methods, surveys (n = 24) were the primary mechanism for gathering data. However, a few studies employed focus groups (n = 4) and reflective assignments (n = 3), with single studies using interviews, assignments, or rubrics.

Discussion

Summary

Of the 26 studies examined, the majority described competency outcomes at large four-year public institutions. Only five represented private institutions with a few (three) partnering with public universities. Only 8 percent of the studies identified minority-serving institutions as partners (Marsh et al. 2016; Roberts et al. 2023). Not surprisingly, approximately 85 percent of the studies reported engagement in recognized STEM disciplines, offering large scope for non-STEM disciplines to assess career readiness resulting from research and creative inquiry.

Evidence clearly demonstrates that among the commonly addressed NACE competencies, research programs have focused primarily on developing career and self-development competency (n = 21) to help students consider how their research experiences can support their future goals. However, critical competencies such as communication skills (n = 13), professionalism (n = 6), teamwork (n = 5), and critical thinking (n = 4) lag significantly.

Although there has been almost no intentional focus on leadership (n = 1), technology (n = 0), or equity and inclusion (n = 0), most of the examined studies measured growth of only one or possibly two competencies. Since development of different competencies may not be mutually exclusive, a more holistic approach may be warranted. It will be important for future studies and interventions to carefully consider how to specifically integrate, build, and evaluate growth of multiple career readiness skills, such as those reported by McClure-Brenchley, Picardo, and Overton-Healy (2020) and Mackiewicz et al. (2023).

The most common interventions involved professional or career development workshops, seminars, and related activities as supplementary components to the undergraduate research experience. These often took the form of consultations on how to prepare for graduate school or other forms of career exploration (e.g., Magana et al. 2023) and opportunities for students to build their professional networks (e.g., Adedokun et al. 2012). Intentional mentoring for career clarification was ranked as the second-most frequent intervention. The finding regarding mentoring for career development was not surprising, as research indicates that high-quality mentoring results in the greatest gains for both student and mentor (Shanahan et al. 2015; Vandermaas-Peeler, Miller, and Moore 2018). Mekolichick (2023) noted how “mentors can infuse the associated sample behaviors within their undergraduate research, scholarship and creative inquiry projects in visible, transparent, and consumable ways for our students to recognize the relevancy, value and leave with the language and ability to tell their URSCI stories” (1). In addition, the salient practices framework of undergraduate research mentoring (Shanahan et al. 2015) provides a useful scaffolding for mentors as they help build students’ career competencies. This framework identifies practices that align well with NACE competencies. For example, dissemination of research results aligns with communication, and building a community of scholars aligns with teamwork. The third most common interventions targeted skill development, which often focused on building communication skills (e.g., Charlevoix et al. 2022). A unique intervention approach was improvisation workshops (Phelps et al. 2021). Whatever the type of intervention or skill, what was clear from these studies was the need for research programs to collaborate with faculty and staff who have the expertise to build career readiness competencies.

An overwhelming majority of the studies used a self-reporting survey to assess gains in competencies. Often surveys were created for the study or were a modified version of other surveys, including EvaluateUR (Grinberg and Singer 2021), the Undergraduate Research Student Self-Assessment (URSSA; Ethnography and Evaluation Research 2009; Weston and Laursen 2015), and the Survey of Undergraduate Research Experiences (Lopatto 2004, 2009). As noted, a distinct limitation was that these surveys were not designed to assess gains in several NACE competencies. Rather, most focused on research skills that were linked to competencies such as communication, critical thinking, and career and self-development. Two studies used a mixed-methods approach to assessment, and others employed focus groups, interviews, or other reflections or assignments to demonstrate different competencies. The gap in holistic assessment of student career readiness creates a unique opportunity for the design of specific methodologies to assess the roles of UR experiences in advancing the NACE competencies.

Limitations

This scoping review was conducted as part of a Council on Undergraduate Research working group focused on undergraduate research and career readiness. The group concluded that a scoping review would help members better understand the status of career readiness work in UR programs, and where opportunities lie. The research question, objectives, and decisions made aligned with the timeline required by the group. Some forms of gray literature were excluded by eligibility criteria for types of evidence. These included reports that were not included in databases searched but available for purchase at a high cost on association websites; white papers not indexed in the searched databases or Google Scholar; and all conference proceedings, as some proceedings were only published abstracts and the timeline did not allow for contacting authors for the full-text articles. Reference lists of key studies were not scanned for additional items. Hand searching of websites such as NACE and CUR was not conducted. The data charting form was developed to extract information directly related to the research question and also to inform the group’s work in aspects beyond the scope of the research question and objectives. In a future systematic literature review on this topic, researchers should consider crafting broader eligibility criteria and creating a more detailed extraction form to uncover evidence of career readiness competencies that are discussed but not associated with assessments. Use of the NACE competencies and associated assessments is not currently standard in undergraduate research assessment and evaluation practices. Therefore, data charting this type of information was a challenge. At times decisions were made by consensus to exclude articles that appeared to align with the eligibility criteria and potentially valuable to answering the research question, but lacked specificity.

Conclusions

This scoping review demonstrates that there is room to assess and promote the utilization of UR as a tool for career readiness. The recent release of the Mekolichick (2023) position paper should be the impetus for research projects and associated assessments to employ the NACE competencies to measure growth in the career readiness of undergraduate research students. The 2023 call and findings from this study identify the need for urgent action. More intentional, inclusive pedagogies are required to make more transparent the diverse career readiness competencies derived from UR experiences.

Overall, the findings indicate that there is a strong dependence on the URSCI experience itself as a mechanism to develop and sharpen career readiness competencies, without intentionally identifying and assessing specific elements of the URSCI experience that cultivate career readiness competencies in undergraduate students. The current reliance on the URSCI experience without intentional identification and assessment of workplace competencies in an objective way that documents learning is no longer a sufficient approach to best support student success, particularly given the increasing focus on workforce readiness within and beyond the academy. Design and implementation must entail purposeful alignment of the UR experience with desired competency, performance, and behavior outcomes. To the extent that one measures what one values, this gap in assessment of career readiness competencies gained through the URSCI experience calls attention to the lack of focus on their importance. UR leadership is falling short of demonstrating how the URSCI experience contributes to career readiness.

To better serve undergraduate students, more clearly articulate the value of URSCI, and more visibly support community workforce needs, action is called for. Four steps are presented to get started. First, familiarization with the NACE career readiness competencies; choose one competency as a focus for growth in the next URSCI project. Second, identify one learning outcome associated with a UR experience that aligns with the selected competency and review the sample behaviors. Third, make one change to existing project documents, syllabi, student manuals, assignments, etc., that explicitly names the career readiness competency developed. Refer to articles referenced here or the CUR position paper (Mekolichick 2023) for ideas. Finally, using the NACE sample behaviors as a guide, consider developing student and faculty assessments to identify proficiency (NACE 2024). If one competency is already identified and assessed, consider adding additional competencies and sharing the results publicly. The CUR UR as a Career Readiness Tool work group continues, exploring resources and materials needed to support faculty and institutions. Mentors and higher education leaders advancing URSCI are called on to meet this challenge in service to undergraduate students, higher education institutions, and their communities.

Funding

No funding supported this scoping review.

Data Availability

The protocol and associated data, including search strategies, data extraction form, and data exported following the extraction, are available at VTechWorks (https://hdl.handle.net/10919/118669).

Institutional Review Board

IRB was not required for this research.

Conflicts of Interest

The authors have no conflicts of interest to declare.

Acknowledgments

The authors are grateful to C. Cozette Comer and Virginia Pannabecker for providing methodological guidance and feedback throughout this review, peer review of the search strategy, and software training.

References

Adedokun, Omolola A., Dake Zhang, Loran Carleton Parker, Ann Bessenbacher, Amy Childress, and Wilella Daniels Burgess. 2012. “Understanding How Undergraduate Research Experiences Influence Student Aspirations for Research Careers and Graduate Education.” Journal of College Science Teaching 42(1): 82.

Alm, Cecilia O., and Reynold Bailey. 2022. “Scientific Skills, Identity, and Career Aspiration Development from Early Research Experiences in Computer Science.” Journal of Computational Science Education 13(1): 2–16. doi: 10.22369/issn.2153-4136/13/1/1

Altman, Joanne D., Tsu-Ming Chiang, Christian S. Hamann, Huda Makhluf, Virginia Peterson, and Sara E. Orel. 2019. “Undergraduate Research: A Road Map for Meeting Future National Needs and Competing in a World of Change.” CUR White Paper no. 1. Washington, DC: Council on Undergraduate Research.

Aromataris, Edoardo, and Zachary Munn (Eds.). 2020. JBI Manual for Evidence Synthesis. JBI Collaboration. doi: 10.46658/JBIMES-20-01

Brownell, Jayne E., and Lynn E. Swaner. 2010. Five High-Impact Practices: Research on Learning Outcomes, Completion, and Quality. Washington, DC: Association of American Colleges and Universities.

Charlevoix, Donna J., Aisha R. Morris, Kelsey Russo-Nixon, and Heather Thiry. 2022. “Engaging Two-Year College Students in Geoscience: Summer Pre-REU Internships and Professional Development to Prepare Students for Participation in Research.” Journal of Geoscience Education 70: 323–338. doi: 10.1080/10899995.2021.1977770

Council on Undergraduate Research (CUR). 2024. “What Is CUR’s Definition of Undergraduate Research?” https://www.cur.org/about/what-is-undergraduate-research

Covidence. 2023. “The World’s #1 Systematic Review Tool.” Accessed October 17, 2024. www.covidence.org

Dillon, Heather E. 2020. “Development of a Mentoring Course-Based Undergraduate Research Experience (M-CURE).” Scholarship and Practice of Undergraduate Research 3(4): 26–34. doi: 10.18833/spur/3/4/7

Ethnography and Evaluation Research, Research and Innovation Office. 2009. “Evaluation Tools: Undergraduate Research Student Self-Assessment (URSSA).” University of Colorado at Boulder. https://www.colorado.edu/eer/research-areas/undergraduateresearch/evaluation-tools-undergraduate-research-student-self

Finley, Ashley. 2021. How College Contributes to Workforce Success: Employer Views on What Matters Most. Washington, DC: Association of American Colleges and Universities.

Fuchs, Jonathan, Aminta Kouyate, Liz Kroboth, and Willi McFarland. 2016. “Growing the Pipeline of Diverse HIV Investigators: The Impact of Mentored Research Experiences to Engage Underrepresented Minority Students.” AIDS and Behavior 20: 249–257. doi: 10.1007/s10461-016-1392-z

Grinberg, Ilya, and Jill Singer. 2021. “ETAC-ABET and EvaluateUR-CURE: Findings from Combining Two Assessment Approaches as Indicators of Student-Learning Outcomes.” In 2021 ASEE Virtual Annual Conference Content Access Proceedings, 37098. ASEE Virtual Annual Conference. doi: 10.18260/1-2–37098

Gueorguieva, Petia, Sayantani Ghosh, Ashlie Martini, and Jennifer Lu. 2020. “MACES Undergraduate Research Fellowship Program: Integrating Research and Education.” Journal of STEM Education: Innovations and Research 21(2): 42–48.

Hirsch, Penny L., Joan A. W. Linsenmeier, H. David Smith, and Joan M. T. Walker. 2005. “Enhancing Core Competency Learning in an Integrated Summer Research Experience for Bioengineers.” Journal of Engineering Education 94: 391–401. doi:10.1002/j.2168-9830.2005.tb00867.x

Hunter, Anne-Barrie, Sandra L. Laursen, and Elaine Seymour. 2007. “Becoming a Scientist: The Role of Undergraduate Research in Students’ Cognitive, Personal, and Professional Development.” Science Education 91: 36–74. doi: 10.1002/sce.20173

Hwang, Jihee, and Corbin Franklin. 2023. “Course-Based Undergraduate Research in Human Resource Development: A Case Study.” Advances in Developing Human Resources 25: 45–56. doi: 10.1177/15234223221138567

Jones, Jeffrey M. 2024. “U.S. Confidence in Higher Education Now Closely Divided,” Gallup. https://news.gallup.com/poll/646880/confidence-higher-education-closely-divided.aspx.

Kistner, Kelly, Erin M. Sparck, Amy Liu, Hannah Whang Sayson, Marc Levis-Fitzgerald, and Whitney Arnold. 2021. “Academic and Professional Preparedness: Outcomes of Undergraduate Research in the Humanities, Arts, and Social Sciences.” Scholarship and Practice of Undergraduate Research 4(4): 3–9. doi: 10.18833/spur/4/4/1

Larasatie, Pipiet, Kathy Young, Arijit Sinha, and Eric Hansen. 2021. “‘A Taste of Graduate School without Really Fully Committing to It’: The Undergraduate Experiential Learning Project at Oregon State University.” Wood and Fiber Science 53: 281–293.

Lindsay, Ana Cristina. 2022. “Avancemos! Building Partnerships between Academia and Underserved Latinx Communities to Address Health Disparities through a Faculty-Mentored Undergraduate Research Program.” Health Promotion Practice 23: 569–576. doi: 10.1177/152483992095

Lopatto, David. 2004. “Survey of Undergraduate Research Experiences (SURE): First Findings.” Cell Biology Education 3: 270–277. doi: 10.1187/cbe.04-07-0045

Lopatto, David. 2007. “Undergraduate Research Experiences Support Science Career Decisions and Active Learning.” CBE—Life Sciences Education 6: 297–306. doi: 10.1187/cbe.07-06-0039

Mackiewicz, Marilyn Rampersad, Kathryn N. Hosbein, Dawn Mason, and Ramya Ajjarapu. 2022. “Integrating Scientific Growth and Professional Development Skills in Research Environments to Aid in the Persistence of Marginalized Students.” Journal of Chemical Education 100: 199–208. doi: 10.1021/acs.jchemed.2c00633

Magana, Alejandra J., Aparajita Jaiswal, Aasakiran Madamanchi, Loran C. Parker, Ellen Gundlach, and Mark D. Ward. 2021. “Characterizing the Psychosocial Effects of Participating in a Year-Long Residential Research-Oriented Learning Community.” Current Psychology 42: 1–18. doi: 10.1007/s12144-021-01612-y

Marsh, L. E., F. M. Hashem, C. P. Cotton, A. L. Allen, B. Min, M. Clarke, and F. Eivazi. 2016. “Research Internships: A Useful Experience for Honing Soft and Disciplinary Skills of Agricultural Majors.” NACTA Journal 60: 379–384.

Mastronardi, Marialice, Maura Borrego, Nathan Choe, and Risa Hartman. 2021. “The Impact of Undergraduate Research Experiences on Participants’ Career Decisions.” Journal of STEM Education: Innovations and Research 22(2): 75–82.

McClure-Brenchley, Kimberly J., Kristin Picardo, and Julia Overton-Healy. 2020. “Beyond Learning: Leveraging Undergraduate Research into Marketable Workforce Skills.” Scholarship and Practice of Undergraduate Research 3(3): 28–35. doi: 10.18833/spur/3/3/10

McGowan, Jessie, Margaret Sampson, Douglas M. Salzwedel, Elise Cogo, Vicki Foerster, and Carol Lefebvre. 2016. “PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement.” Journal of Clinical Epidemiology 75: 40–46. doi: 10.1016/j.jclinepi.2016.01.021

McMahon, Tracey R., Emily R. Griese, and DenYelle Baete Kenyon. 2019. “Cultivating Native American Scientists: An Application of an Indigenous Model to an Undergraduate Research Experience.” Cultural Studies of Science Education 14: 77–110. doi: 10.1007/s11422-017-9850-0

Mekolichick, Jeanne. 2021. “Mapping the Impacts of Undergraduate Research, Scholarship, and Creative Inquiry Experiences to the NACE Career Readiness Competencies.” NACE Journal. https://www.naceweb.org/career-readiness/competencies/mapping-the-impacts-of-undergraduate-research-scholarshipand-creative-inquiry-experiences-to-the-nace-career-readinesscompetencies

Mekolichick, Jeanne. 2023. “Recognizing Undergraduate Research, Scholarship, and Creative Inquiry as a Career-Readiness Tool.” Position paper. Washington, DC: Council on Undergraduate Research.

Moher, David, Larissa Shamseer, Mike Clarke, Davina Ghersi, Alessandro Liberati, Mark Petticrew, Paul Shekelle, Lesley A. Stewart, and Prisma-P Group. 2015. “Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMAP) 2015 Statement.” Systematic Reviews 4: 1–9. https://rdcu.be/dFLtd

National Association of Colleges and Employers (NACE). 2024. “What Is Career Readiness?” NACE. https://www.naceweb.org/career-readiness/competencies/career-readiness-defined

Osborn, Jeffery M., and Kerry K. Karukstis. 2009. “The Benefits of Undergraduate Research, Scholarship, and Creative Activity.” In Broadening Participation in Undergraduate Research: Fostering Excellence and Enhancing the Impact, ed. M. Boyd and J. Wesemann, 41–53. Washington, DC: Council on Undergraduate Research.

Overbay, Amy, Owen Duckworth, and Joshua L. Heitman. 2023. “The BESST REU: Promoting Soil Science Learning and Shifts in Attitudes toward Science.” Journal of Natural Resources and Life Sciences Education 52: 1–12. doi: 10.1002/nse2.20100

Phelps, Marianne, Catrina White, Lin Xiang, and Hollie I. Swanson. 2021. “Improvisation As a Teaching Tool for Improving Oral Communication Skills in Premedical and Pre-Biomedical Graduate Students.” Journal of Medical Education and Curricular Development 8: 1–7. doi: 10.1177/23821205211006411

Posillico, Caitlin, Sarah Stilwell, Jacqueline Quigley, Crystal Carr, Sara Chadwick, Cindy Lustig, and Priti Shah. 2023. “Extending the Reach of the STARs (Students Tackling Advanced Research).” Teaching of Psychology 50: 433–440. doi: 10.1177/0098628321105602

Richard, Jacques C., and So Yoon Yoon. 2021. “Three-Year Study of the Impact of a Research Experience Program in Aerospace Engineering on Undergraduate Students.” Scholarship and Practice of Undergraduate Research 4(4): 23–32. doi: 10.18833/spur/4/4/5

Richard, Jacques C., and So Yoon Yoon. 2023. “Impact of Engineering Research Experience Programs on Domestic and International Undergraduate Students.” Scholarship and Practice of Undergraduate Research 6(3): 29–47. doi: 10.18833/spur/6/3/6

Roberts, Lindsay R., Criss J. Ririe, Marcella J. Myers, Joshua D. Guggenheimer, and Katherine A. Campbell. 2023. “For Aging Research and Equity: Lessons Learned in Undergraduate Research Education.” International Journal of Aging and Human Development 96: 91–105. doi: 10.1177/00914150221109918

Salto, Lorena M., Matt L. Riggs, Daisy Delgado De Leon, Carlos A. Casiano, and Marino De Leon. 2014. “Underrepresented Minority High School and College Students Report STEM-Pipeline Sustaining Gains after Participating in the Loma Linda University Summer Health Disparities Research Program.” PLOS ONE 9(9): 1–13. doi: 10.1371/journal.pone.0108497

Seymour, Elaine, Anne-Barrie Hunter, Sandra L. Laursen, and Tracee DeAntoni. 2004. “Establishing the Benefits of Research Experiences for Undergraduates: First Findings from a Three-Year Study.” Science Education 88: 493–534. doi: 10.1002/sce.10131

Shanahan, Jenny Olin, Elizabeth Ackley-Holbrook, Eric Hall, Kearsley Stewart, and Helen Walkington. 2015. “Ten Salient Practices of Undergraduate Research Mentors: A Review of the Literature.” Mentoring and Tutoring: Partnership in Learning 23: 359–376. doi: 10.1080/13611267.2015.1126162

Sturner, Kelly K., Pamela Bishop, and Suzanne M. Lenhart. 2017. “Developing Collaboration Skills in Team Undergraduate Research Experiences.” PRIMUS 27: 370–388. doi: 10.1080/10511970.2016.1188432

Tricco, Andrea C., Erin Lillie, Wasifa Zarin, Kelly K. O’Brien, Heather Colquhoun, Danielle Levac, David Moher, et al. 2018. “PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation.” Annals of Internal Medicine 169: 467–473. doi: 10.7326/M18-0850

Vandermaas-Peeler, Maureen, Paul C. Miller, and Jessie L. Moore (Eds.). 2018. Excellence in Mentoring Undergraduate Research. Washington, DC: Council on Undergraduate Research.

Weston, Timothy J., and Sandra L. Laursen. 2015. “The Undergraduate Research Student Self-Assessment (URSSA): Validation for Use in Program Evaluation.” CBE–Life Sciences Education 14(3): ar33. doi: 10.1187/cbe.14-11-0206

Zier, Karen, and Lisa D. Coplit. 2009. “Introducing INSPIRE: A Scholarly Component in Undergraduate Medical Education.” Mount Sinai Journal of Medicine 76: 387–391. doi: 10.1002/msj.20121

Amanda B. MacDonald

Virginia Tech, abmacdon@vt.edu

Amanda B. MacDonald is an associate professor and the undergraduate research services coordinator for university libraries at Virginia Tech. Her work focuses on creating openly accessible resources to support students and faculty engaging with formal undergraduate research experiences. MacDonald coordinates the Advanced Research Skills Program and is deeply involved in the university’s Undergraduate Research Excellence Program. She previously served as the undergraduate research librarian at Louisiana State University.

Jeanne Mekolichick is associate provost of research, faculty success, and strategic initiatives and professor of sociology at Radford University. She provides strategic leadership and direction for the research and creative scholarship enterprise, online education, faculty success, experiential learning, career services, and strategic initiatives. Mekolichick is a workshop facilitator, consultant, and program reviewer. Her work has been funded for mission-central efforts, including inclusive excellence initiatives, community-based research, undergraduate research, and career readiness.

Kristin Picardo is the assistant provost in the Office of Sponsored Programs, professor of biology, and founding director of the Center for Student Research and Creative Work at St. John Fisher University. She has published with undergraduate research students working in her bacteriology lab, is a former representative of the CUR Biology Division, and served as principal investigator on a track-1 National Science Foundation S-STEM grant.

Eric Hall is professor of exercise science and director of undergraduate research at Elon University. He is interested in the influence of undergraduate research mentorship on student and faculty development. Hall has coauthored 100 research articles, 10 book chapters, and is coeditor of one book. He has received awards for his mentorship and scholarship, including the 2022 Health Sciences Innovative Mentor Award from the Council on Undergraduate Research.

Rosalie A. Richards is associate provost for faculty development and professor of chemistry and education at Stetson University. She is responsible for the vision and strategic leadership of faculty development and support. Richards is a nationally recognized leader in undergraduate research, faculty development, STEM education, equity, and intercultural competence. She has published widely on these areas in higher education and serves frequently as a consultant to universities and other undergraduate institutions.

Integrating a DEI Focus in a CURE Development Model Across STEM Departments

Integrating a DEI Focus in a CURE Development Model Across STEM Departments

Recommended Citation: Norman, Leann, Laura Gough, Matthew Hemm, Jacqueline Doyle, Kelly Elkins, Brian Jara, Rommel Miranda. 2024. Integrating a DEI Focus in a CURE Development Model Across STEM Departments. Scholarship and Practice of Undergraduate Research 7 (4): 61-72. https://doi.org/10.18833/spur/7/4/2


Multiple studies show that undergraduate student participation in research promotes student achievement and persistence in their academic career (Bauer and Bennett 2003; Hernandez et al. 2018; Lopatto 2004, 2007; Thiry et al. 2012). Under a traditional “apprenticeship” system, students conduct research in a faculty member’s laboratory. In many cases, these opportunities disproportionately go to students who early on express a desire to conduct research, have superior grades, and may be already familiar with research being conducted at the university (Bangera and Browell 2014). There is a substantial disadvantage to pursuing research for students who transfer from other institutions, struggle during their transition to higher education, have significant jobs or family responsibilities, are unaware of research opportunities and the advantages to engaging in research, or are from historically underrepresented groups in STEM fields (Estrada et al. 2011; Maton and Hrabowski 2004). This system therefore can be inherently exclusive.

From the faculty perspective, mentoring undergraduates in their research programs also comes with substantial barriers and costs (e.g., Ferguson 2023; Johnson et al. 2015, Morrison et al. 2019). This may be particularly challenging at institutions that are not R1, where faculty rarely have postdoctoral scholars or PhD students to assist with undergraduate student mentoring. In these situations, the faculty member must often devote considerable time to training and supporting the undergraduates who may only participate in the research for a year or two, in stark contrast with a PhD student who could be assisting with the faculty’s research for much longer. In addition, depending on the institution, mentoring undergraduates may not be valued for promotion and tenure (Ferguson 2023). These barriers to faculty mentoring undergraduates contribute to an unequal playing field for students seeking out research opportunities, particularly those who may not have a stellar academic record or are unwilling to approach an instructor directly due to cultural norms, inexperience, or insecurity.

One high-impact pedagogical approach that is successful at engaging large numbers of students in research and may avoid some of the issues discussed above comprises course-based undergraduate research experience (CURE) classes (e.g., Auchincloss et al. 2014; Bhattacharyya et al. 2020; Shaffer et al. 2010). CUREs also are a mechanism for increasing opportunities for students who are traditionally underrepresented in research, because a CURE may be taken as part of a student’s required courses rather than an add-on, which an independent research (IR) opportunity might be considered. A recent study shows that participation in CUREs may decrease (although not eliminate) the achievement gap between historically underrepresented minority and majority students (Theobald et al. 2020). As many undergraduate institutions introduce diversity, equity, and inclusion (DEI) programming, coupling CURE support with professional development for faculty in DEI issues may help institutions change the academic environment and become more inclusive.

Although an abundance of evidence demonstrates that CUREs can result in student benefits as a high-impact practice comparable to IR opportunities (Corwin, Graham, and Dolan 2015; Olimpo, Fisher, and DeChenne-Peters 2016; Rowland et al. 2012; Shaffer et al. 2010; Shapiro et al. 2015), recent attention has been placed on understanding the faculty experience and associated barriers to implementation of CUREs (DeChenne-Peters and Scheuerman 2022; Govindan, Pickett, and Riggs 2020; Shortlidge, Bangera, and Brownell 2017). Not surprisingly, reported faculty experiences differ based on the specific CURE content, institution and class size, and available support systems (DeChenne-Peters and Scheuerman 2022); however, commonalities among challenges faced while implementing CUREs exist (DeChenne-Peters and Scheuerman 2022; Govindan et al. 2020; Lopatto et al. 2014; Shortlidge et al. 2017). Govindan et al. (2020) reviewed perceived barriers and proposed solutions based on experiences learned through various CURE implementations. The barriers discussed included cost, workload/scale, measurements of success, and faculty and institutional resistance, all of which may have equity implications if they prevent engaging more diverse undergraduates in research.

The commonality in barriers to CURE development and implementation suggest a need for professional development (PD) for faculty considering CURE teaching. Networked CUREs, in which one research project is conducted at multiple institutions, can overcome some of these obstacles by providing centralized support to CURE instructors (e.g., Connors et al. 2021; Genné-Bacon, Wilks, and Bascom-Slack 2018; Hanauer et al. 2022; Lopatto et al. 2014). Similarly, many STEM faculty wish to adopt active learning and inclusive techniques in their classes, but without appropriate PD and infrastructure that set aside time for this work, the barrier to such changes is quite high (e.g., Kennedy et al. 2022). This paper describes a PD program created to support faculty members in DEI and the development of STEM CUREs by supporting their learning about inclusive approaches and CURE pedagogy and how to integrate the two. Core components of the PD program, evolution of PD based on faculty feedback, and current efforts to sustain CURE development without external funding are reviewed.

Overview

The Towson University Research Enhancement Program (TU REP) was created with support from the Howard Hughes Medical Institute (HHMI) through their Inclusive Excellence (IE) program. HHMI’s IE program goal is for institutions to increase “capacity for inclusion of all students in science.” Although individual projects took different approaches, all were tasked with improving their DEI culture, which in most cases meant helping faculty become more inclusive in their teaching and mentoring. The central focus of TU REP was to provide PD to assist STEM faculty in developing CUREs and to help faculty understand their own personal biases and learn new pedagogical approaches to including all students in their classrooms. Faculty PD was a critical aspect of this grant because PD can help faculty learn and implement new pedagogical techniques, including inclusive strategies (e.g., Biswas et al. 2022; O’Leary et al. 2020), particularly when using a professional learning community or communities of practice approach (e.g., Gehrke and Kezar 2018; Kezar, Gehrke, and Bernstein-Sierra 2017), as done here. At the time of funding, three faculty in biology were teaching CUREs, with the first one developed with funding from a National Science Foundation (NSF) CAREER award. A PD program was assembled that incorporated the expertise of those already teaching CUREs and colleagues in several departments and offices at TU. Partnering with the newly created Office of Inclusion and Institutional Equity (OIIE) to incorporate DEI training into faculty PD ensured that faculty had the space and time to consider how CUREs are inherently inclusive and how their approach to students could better support success of all their students.

Cohort-Based PD

A cohort-based PD model was implemented to encourage community and collaboration throughout faculty development of CUREs. Faculty from across the Fisher College of Science and Mathematics (FCSM) were recruited to participate in a yearlong faculty cohort through visits to faculty meetings and an FCSM-wide email that included a link to an application form. Interested faculty completed a simple proposal to apply to the program. Each faculty participant, in consultation with their department chair, could choose either one month of summer salary or a one course (3 credit hour) release during the academic year. In addition, funding was provided for new equipment needed to teach the course, as well as supplies for consumables, field trips, and other course activities. Finally, travel funds also were provided for faculty to attend conferences and HHMI IE meetings.

PD Structure and Activities

Although consistently focused on CURE development and DEI training, PD evolved over the five years of the grant as project leadership learned how to better meet the needs of the faculty in each cohort, as more faculty completed the PD, and as the situational context changed, including teaching fully online during the COVID pandemic. Exit surveys and informal feedback informed these changes. The monthly meetings followed a pattern, although the exact topics within a session changed over time (Table 1). For example, given that most STEM faculty had not received formal pedagogical training, various topics were included for different cohorts. In the first two cohorts, TU experts developed PD sessions that reflected on the nature of science and general science pedagogy. Faculty input indicated that these topics were too general and redundant with their prior knowledge. However, a guest expert who ran a session on backward design and designing assessments to align with student learning outcomes was appreciated by cohorts 2 through 5, as faculty could see how these tools would assist them not only with CUREs but with all their classes.

All PD series included multiple opportunities to learn about CUREs, particularly from peers who had already taught CUREs. The value of sharing experiences led to the development of faculty “spotlight” sessions, during which one faculty member who had already developed and taught a CURE gave a presentation of their course, including aspects they planned to change in the future and tips for handling challenges that arose throughout the semester. As the cohorts progressed, more faculty were available to discuss their courses, providing a broader array of subjects and issues. In addition, most PD sessions included discussion of readings about CUREs in general as well as examples of CUREs from specific disciplines (Table 1; e.g., Auchincloss et al. 2014, Clark, Ricciardo, and Weaver 2016; Kortz and van der Hoeven Kraft 2016; Shortlidge and Brownell 2016). Over time, themes emerged that the leadership team could ensure were discussed with each cohort, such as how much time to devote early in the semester to training students in techniques, assessment strategies and weights, and how much writing to require of students. At the end of the PD, faculty presented their CURE course plans to past and present cohort faculty, including how they were addressing the five CURE components identified by Auchincloss et al. (2014).

Along with CURE pedagogy, the PD sessions included DEI components. For cohort 1, an external speaker conducted one workshop regarding identity and bias. Beginning with cohort 2, when in-house expertise was available from OIIE, the first two PD sessions provided extensive DEI training in microaggressions, equity and equality, implicit bias, and inclusive teaching strategies. It was particularly important for faculty to reflect on their own privilege and identities, because Towson University faculty diversity does not match the diversity of the students. At the time there was no other comparable faculty training offered at TU, and TU REP provided an opportunity for OIIE staff to explore how to help faculty reflect on their own biases in the context of PD directed at developing pedagogy. In addition, these interactions created opportunities for faculty to promote DEI training, because TU REP faculty reached out to their department chairs to request additional department-specific training.

Peer learning, mentoring, and reflection became more important over the course of the five years as more faculty were trained and could serve as mentors. This became acute when PD was online during the COVID-19 pandemic. Faculty in that cohort indicated to TU REP leadership that they felt they were not being prepared to teach their courses the following year. It was identified that the allotted Zoom time inadvertently limited opportunities for informal interactions related to PD. These peer interactions extended beyond the institution when the June PD each year consisted of a regional meeting with three other HHMI-funded IE projects. These meetings incorporated PD regarding DEI issues in STEM as well as progress reports and discussion of challenges. Discussions with faculty outside of TU helped faculty embrace an inclusive mindset.

Program Outcomes

Over the course of five years of funding, 25 CUREs were developed or modified by 35 faculty members across all five departments of FCSM (Figure 1). These CUREs spanned topics such as behavioral neuroscience, cancer prevention, experimental mathematics, next-generation sequencing in forensic science, protein engineering, bio-innovation, and species discovery. CURE development was shaped by both internal and external influences. For example, a substantial number of molecular biology CUREs have been offered at TU (Figure 1). This likely stems from the national dominance of molecular biology CUREs (Buchanan and Fisher 2022) and associated published resources (external), and the demand for molecular biology lab courses in TU’s biology department (internal).

CURE Faculty

CUREs were taught by tenure-track, tenured, and instructional faculty (Figure 1). The percentage of tenure-track or tenured faculty who participated in TU REP was highest in biology (~55 percent) and lowest in computer and information sciences (3 percent). As of spring 2023, 17 of 24 research-active tenure-track or tenured faculty in biology, 4 of 16 instructional faculty in biology, and 6 of 16 research-active chemistry faculty in their second year or higher were teaching CUREs. Many of the tenure-track and tenured faculty described student projects in CUREs that explored new research avenues and techniques, which they subsequently adopted in their own labs. In addition, as a result of teaching CUREs, faculty published pedagogical papers (e.g., Cheng 2022; Miranda et al. 2023; Oufiero 2019).

Instructional faculty, such as clinical assistant professors and lecturers at TU (Figure 1), generally do not have research expectations built into their workload and are not provided with start-up funds or research space. However, many instructional faculty hold PhDs and are interested in continuing to engage in the research process. CUREs provided an important opportunity for these faculty to mentor undergraduates, generate data, collaborate with research-active faculty toward publications, or publish their own pedagogical paper (e.g., Norman 2023).

CURE Students

From fall 2017 until spring 2023, almost 1400 students participated in CUREs at TU, although enrollment varied substantially among departments (Figure 2). In biology, the department in which most CUREs were developed, three times as many students participated in research through CUREs as conducted IR in faculty labs during this period (Table 2, Figure 2). This represented a substantial increase in the number of students engaging in research. Incorporating CURE courses into the framework of the biology major also allowed for better participation of the student body as a whole in authentic research, when compared with students in more traditional IR faculty labs (Table 2).

Classroom Support

Funding to pay undergraduate learning assistants (ULAs) hourly for approximately six hours per week was offered to all interested faculty. Faculty instructors ideally found ULAs who had already taken their CURE or a CURE in a similar discipline, but also relied on referrals from other faculty classes or laboratories. ULAs supported faculty in a variety of ways both inside and outside of the classroom, with specific responsibilities varying based on the course and instructor. Some responsibilities included animal care, preparing reagents, cell culture maintenance, organizing and maintaining equipment, demonstrating experimental procedures, and developing computer code. In all cases, ULAs served as peer mentors to students currently taking the CURE and were present during lab and class time to answer student questions. In total, 21 faculty members (60 percent) taught at least one semester with a ULA.

Anticipated Challenges

Govindan et al. (2020) published a list of anticipated challenges to faculty developing their own CUREs (also see Shortlidge et al. 2017). Within the TU REP funding period, external funds helped address several of these (Table 3). However, many of these challenges could be met without external funding, depending on partnerships available within the institution, including those at the department level, college level, FCSM level, and in other offices (e.g., student affairs, DEI office). Hopefully this paper will provide faculty and administrators who intend to develop CUREs guidance to overcoming some of these challenges.

Cost

Several of the challenges center on cost. Some CUREs cost much more than others to run (e.g., forensic chemistry, cell or molecular biology). At TU, laboratory classes have class fees, however these often do not cover the cost of CURE activities. One approach to reducing costs was to have equipment in the CURE labs that also was used for research, because other funds were available to purchase research equipment. Leveraging internal and external funding sources to ensure equipment is available for CURE students can bring costs down and may allow CURE students to use equipment “in the lab” rather than in a teaching lab, further enhancing their experience as novice researchers. At the departmental level, scheduling courses to balance expensive CUREs that may require funding support with less costly CUREs has been helpful. The most affordable CUREs are those that are in silico, in which the cost is usually limited to access to a particular data set. A field ecology CURE offered in biology is also relatively inexpensive, because most of the cost is for field trip expenses and some consumables each semester. Additional approaches to reducing costs include incorporating publicly available data sets (e.g., Avramovska and Rokop 2023) and developing collaborations and partnerships with external stakeholders (Table 3). Although grant funds were initially used to pay ULAs, these costs are now being met by the Office of Undergraduate Research and Creative Inquiry (OURCI), because the ULAs are supporting research efforts in the courses while gaining more research experience themselves. Similar funding may be available at other institutions. Alternatively, some undergraduate institutions allow ULAs to participate in the role for course credit, which comes at essentially no cost to the department.

Faculty Workload

A commonly reported challenge when developing CUREs (or any new pedagogical approach) is not having the time needed to develop (or teach) a new course (Brownell and Tanner 2012; Lopatto et al. 2014; Shortlidge et al. 2017). This may be particularly challenging if CUREs are new to a department or are not seen as contributing to the instructor’s scholarship. Although the grant helped compensate faculty by funding a summer stipend or course buyout, a more affordable option of workload compensation may be course release or allocating more workload units to a CURE in recognition of the additional time required. In addition, CUREs can be included in faculty onload teaching, whereas IR may not be counted toward teaching load. Faculty workload can also be balanced by building CUREs from previously framed courses to replace a traditional cookbook lab approach. In addition, the use of ULAs in the classroom has proven to be a valuable resource for managing faculty workloads during CURE implementation because they help answer student questions both during and outside of class.

Institutional Resistance

Some faculty or departments may anticipate institutional resistance when developing CUREs. Given the increasing publicity around CUREs, there are now multiple resources available for faculty to share with administrators to explain how CUREs benefit students and faculty (e.g., Rowland et al. 2012; Shaffer et al. 2010; Shapiro et al. 2015). Networked CUREs might help open the door to developing CUREs by demonstrating the feasibility and effectiveness of this approach (e.g., Connors et al. 2021, Hanauer et al. 2022). Fortunately, there was no resistance from the university administration at TU; instead various offices supported these efforts. In fact, CUREs align well with university-wide DEI efforts and are supported because of this by several administrators. However, incorporating DEI into PD may not be permissible at public institutions in some states, so justification for a CURE PD program could be placed solely on the improvement in retention of STEM students associated with CUREs.

If a university strives to increase its research profile, CUREs can be seen as an important contribution to scholarship efforts; this has happened at TU—CUREs are now integrated with planning by OURCI. Two faculty in biology successfully earned grants from the NSF and the National Institutes of Health, with CUREs as an integral part of their proposed research and scholarship demonstrating additional benefits to the institution. Involving institutional stakeholders and outside departments in CURE activities, such as university-wide poster sessions, has allowed for more exposure of the TU REP program. Faculty, staff, and administrators from other parts of the university have become more familiar with the program and participating students.

Student Resistance

Students may also be resistant to enrolling in CUREs, particularly if they require extensive time; in general, TU CUREs meet for six hours each week. As mentioned, student enrollment in biology was facilitated by requiring a CURE for major requirements or as elective credit. Student enrollment was lower in CUREs in departments where the classes did not fulfill graduation requirements. Student poster sessions have also proven to be an important recruitment event, as students not enrolled in CUREs stop by to see the posters, and instructors regularly advertise the courses to their students and advisees. If students are learning about research opportunities as they proceed through their major, a CURE may be most appealing to them because of the available course credit. Furthermore, students are attracted to the project-based grading and semester vs. standard weekly lab reports.

Faculty Resistance

Another key challenge to developing CUREs is faculty resistance, which can come from many directions. As mentioned, with the publicity that CUREs are gaining nationally, there are numerous resources available to help faculty consider a CURE and reduce any associated fears (e.g., Science Education Resource Center n.d.). Exposure to a networked CURE or hearing about a CURE at a conference may help faculty consider this option. Faculty workload concerns can be addressed as previously described.

For TU REP faculty, the grant provided funding and time for faculty to develop their courses and was an incentive for participating in PD. Although CUREs started with the cell and molecular biology faculty, others learned from their experiences to develop courses in other subjects (Figure 1); the challenges were often similar despite the subject matter being different. In some cases, however, challenges were quite different, such as establishing a field ecology course that required vehicles, field gear, and permits to conduct the research. As new faculty join FCSM since the grant has ended, they now ask about teaching CUREs because it has become so common in biology.

Shortlidge et al. (2017) surveyed faculty who had developed independent CUREs and identified the uncertainty of research as a theme that also contributed to faculty resistance. The risk of spending an entire semester trying to effectively generate data and then failing to do so can affect faculty willingness to develop a CURE. In TU REP, having faculty already teaching the courses willingly share their own challenging experiences has helped new faculty understand the challenges but also emphasized the benefits, and may have helped overcome this concern. In fact, at a university like TU, where few departments have PhD and postdoctoral students, many faculty embraced the possibility of bringing their scholarship into the classroom. TU REP faculty have noted that students in their CUREs have helped generate new ideas or normalized the use of a new technique, moving their scholarship forward even when the data generated in the course were not publishable.

Implementation and Sustainability

Moving forward with curriculum changes after funding ended has forced the identification of ways to sustain much of the work that successfully supported faculty in developing CUREs. This section describes activities that leverage existing resources and partners at TU to help expand CURE offerings across FCSM and into new colleges of the institution. For a more detailed description and analysis of faculty perspectives, also see Gough et al. (forthcoming).

CURE Community of Practice

The importance of a faculty community of CURE developers and instructors emerged as one of the most critical aspects of PD. As discussed, during the COVID-19 pandemic, two key differences between online and in-person PD were noticeable: the lack of mealtime for informal interactions and the way in which Zoom made having one-on-one conversations following a group discussion difficult. The importance of these interactions is aligned with recent research on faculty experiences in networked CUREs (DeChenne-Peters and Scheuerman 2022) and participation in communities of practice (CoP) that emphasize the crucial role that personal interactions play in faculty engagement and continuing involvement in new practices when departments or undergraduate institutions are undergoing reform (e.g., Kezar et al. 2017; Gehrke and Kezar 2018). In fall 2022, a CURE CoP was developed with support from the Towson University Faculty Center of Excellence (FACET) to meet two goals: to continue to provide opportunities for peer interactions among TU REP faculty, and to create programming for faculty new to CUREs to learn more about them. Support from a university teaching and learning center for a CoP can include space outside of departments for meetings, invited speakers, technology support in the form of a Blackboard or Canvas site, peer-to-peer mentoring, and funding for food for meetings. TU REP faculty continue to participate in this CoP as speakers, panelists, and participants. In addition, several TU CURE instructors have contributed to the CURE community outside of the university by sharing their course details on CUREnet (Science Education Resource Center n.d.) and publishing their specific CURE development experiences in relevant journals (e.g., Cheng 2022; Norman 2023; Oufiero 2019). In addition, support from an office of undergraduate research embracing CUREs as an important research approach can provide resources and publicity.

Intentional DEI Efforts

The development and implementation of CUREs within TU REP have contributed to both increased faculty participation in DEI PD and increased participation of students from diverse backgrounds in authentic research. TU REP faculty have commented that their involvement in the program caused them to consider inclusive approaches in all their courses and laboratories. For example, several TU REP faculty began incorporating research by scientists from traditionally underrepresented groups in their CUREs and other classes as a result of discussion of this approach during PD. The integration of DEI issues into PD as a high impact practice was relatively straightforward, ensuring that DEI issues were central to program activities.

Partnership with OIIE and focus on DEI during PD led to additional IE activities by TU REP faculty that would likely not have occurred otherwise. For example, TU REP faculty helped lead a DEI task force at FCSM to assess the status of DEI issues and compile a list of recommendations for an incoming dean. One TU REP faculty member has been working to make undergraduate research grants within FCSM more accessible to students with lower GPAs, and similar efforts have been underway in several different arenas to ensure that transfer students have the same opportunities as first-year full-time students. These unplanned TU REP outcomes have occurred as faculty becomes more aware of DEI issues and begins to engage in these topics on committees, in department meetings, and at university activities in ways that will benefit the entire university community.

Logistical and Financial Support

With the end of HHMI funding, collaboration with institutional partners is allowing for new CURE development, although at a slower pace than during the grant period. This strategy may help institutions new to CUREs as well, depending on their mission. For example, once the OURCI director began discussing CUREs across campus as a form of undergraduate research, funds were able to be directed toward ULAs and course supplies for current and future CUREs. FACET provides support for the CURE CoP and also is funding a CURE FACET fellow who is offering one-on-one consultation to faculty designing CUREs, connecting the CURE faculty with OURCI support, and helping lead the CoP. As of December 2023, a new CURE development program is being created with four faculty from colleges outside of FCSM based on support from OURCI, FACET, and TU REP faculty. Similar collaborative efforts may be possible at other institutions internally. Institutions also may take advantage of collaborators nationally (such as CUREnet).

Conclusions

CUREs are established high-impact practices that can benefit students in many ways, including by providing opportunities for research for more students, and particularly students from underrepresented groups. CUREs also can be incredibly rewarding for faculty. TU REP faculty comment that they enjoy being able to facilitate research projects within the structure of a formal class, they are gratified to lead 16 to 20 students through research during a semester, and they are excited to implement more inclusive strategies in their classes. Faculty research programs benefit when students ask new questions or generate intriguing data, on which faculty can follow up in their own laboratories. In addition, CUREs provide an opportunity for instructional faculty to engage in the research enterprise if they are interested in doing so. Research papers coauthored by CURE students demonstrate how CUREs can concretely contribute to faculty scholarship (e.g., VanOrsdel et al. 2018).

Although it can be challenging to develop and implement CUREs, CURE-focused PD and development of a CoP can help overcome these barriers and sustain changes in both CURE and DEI pedagogical approaches. As CUREs continue to gain popularity, more examples can be brought forward as potential ways to engage faculty and students in research in the classroom. Creating a system for peer support, engaging with potential partners within an institution, educating faculty about inclusive approaches, and allowing for some flexibility in workload have helped transform the curriculum. Many of these practices are eased with additional funding, but many of them also can be implemented with cooperation from university administration.

Data Availability

The data, critical questions used in scripts, and instruments underlying this study are available within the text.

COI Statement

There are no conflicts of interest to declare.

Institutional or Ethical Review Board

Approval not required because the research did not involve human or animal subjects or samples.

Acknowledgments

LN, LG, and MH wrote the manuscript with contributions from JD, KE, BJ, and RM. The authors thank all the Towson University Research Enhancement Program faculty for their engagement in this project and their willingness to teach CUREs, as well as Trudymae Agboka for key support throughout the project. Mary Stapleton, Trish Westermann, and Alexei Kolesnikov have been critical allies in carrying out and sustaining this work. This program is supported by the Howard Hughes Medical Institute Inclusive Excellence award to Towson University.

References

Auchincloss, Lisa Corwin, Sandra L. Laursen, Janet L. Branchaw, Kevin Eagan, Mark Graham, David I. Hanauer, Gwendolyn Lawrie, et al. 2014. “Assessment of Course-Based Undergraduate Research Experiences: A Meeting Report.” CBE–Life Sciences Education 13: 29–40. doi: 10.1187/cbe.14-01-0004

Avramovska, Ognenka, and Megan E. Rokop. 2023. “A Low-Cost Cure for CUREs: An Undergraduate Microbiology Course Engaging Students in Authentic Research Using Publicly Available Datasets.” Biochemistry and Molecular Biology Education 52: 106–116. doi: 10.1002/bmb.21793

Bangera, Gita, and Sarah E. Brownell. 2014. “Course-Based Undergraduate Research Experiences Can Make Scientific Research More Inclusive.” CBE–Life Sciences Education 13: 602–606. doi: 10.1187/cbe.14-06-0099

Bauer, Karen W., and Joan S. Bennett. 2003. “Alumni Perceptions Used to Assess Undergraduate Research Experience.” Journal of Higher Education 74: 210–230. doi: 10.1353/jhe.2003.0011

Bhattacharyya, Prajukit, Catherine W. M. Chan, Rocio R. Duchesne, Aditi Ghosh, Steven N. Girard, and Jonah J. Ralston. 2020. “Course-Based Research: A Vehicle for Broadening Access to Undergraduate Research in the Twenty-First Century.” Scholarship and Practice of Undergraduate Research 3(3): 14–27. doi: 10.18833/spur/3/3/7

Biswas, Sreyasi, Rocio Benabentos, Eric Brewe, Geoff Potvin, Julian Edward, Marcy Kravec, and Laird Kramer. 2022. “Institutionalizing Evidence-Based STEM Reform through Faculty Professional Development and Support Structures.” International Journal of STEM Education 9: ar36. doi: 10.1186/s40594-022-00353-z

Brownell, Sara E., and Kimberly D. Tanner. 2012. “Barriers to Faculty Pedagogical Change: Lack of Training, Time, Incentives, and . . . Tensions with Professional Identity?” CBE–Life Sciences Education 11: 339–346. doi: 10.1187/cbe.12-09-0163

Buchanan Alaina J., and Ginger R. Fisher. 2022. “Current Status and Implementation of Science Practices in Course-Based Undergraduate Research Experiences (CUREs): A Systematic Literature Review.” CBE–Life Sciences Education 21(4): ar83. doi: 10.1187/cbe.22-04-0069

Cheng, Diana. 2022. “Problem Solving for Teachers: Action Research in a Cross-Listed Undergraduate and Graduate Course.” Mathematics Enthusiast 19: 833–859. doi: 10.54870/1551-3440.1581

Clark, Ted M., Rebecca Ricciardo, and Tyler Weaver. 2016. “Transitioning from Expository Laboratory Experiments to Course-Based Undergraduate Research in General Chemistry.” Journal of Chemical Education 93: 56–63. doi: 10.1021/acs.jchemed.5b00371

Connors, Patrice K., Hayley C. Lanier, Liesl P. Erb, Johanna Varner, Laurie Dizney, Elizabeth A. Flaherty, Jennifer M. Duggan, Christopher J. Yahnke, and John D. Hanson. 2021. “Connected While Distant: Networking CUREs across Classrooms to Create Community and Empower Students.” Integrative and Comparative Biology 61: 934–943. doi: 10.1093/icb/icab146

Corwin, Lisa A., Mark J. Graham, and Erin L. Dolan. 2015. “Modeling Course-Based Undergraduate Research Experiences: An Agenda for Future Research and Evaluation.” CBE–Life Sciences Education 14(1): es1. doi: 10.1187/cbe.14-10-0167

DeChenne-Peters, S. E., and N. L. Scheuerman. 2022. “Faculty Experiences during the Implementation of an Introductory Biology Course-Based Undergraduate Research Experience (CURE).” CBE–Life Sciences Education 21(4): ar70. doi: 10.1187/cbe.21-06-0154

Estrada, Mica, Anna Woodcock, Paul R. Hernandez, and P. Wesley Schultz. 2011. “Toward a Model of Social Influence That Explains Minority Student Integration into the Scientific Community.” Journal of Educational Psychology 103: 206–222. doi: 10.1037/a0020743

Ferguson, Carinna. 2023. “Systematic Review of Outcomes for Faculty Mentors in Undergraduate Research.” Scholarship and Practice of Undergraduate Research 7(1): 25–34. doi: 10.18833/spur/7/1/5

Gehrke, Sean, and Adrianna Kezar. 2018. “Perceived Outcomes Associated with Engagement in and Design of Faculty Communities of Practice Focused on STEM Reform.” Research in Higher Education 60: 844-869. doi: 10.1007/s11162-018-9534-y

Genné-Bacon, Elizabeth A., Jessica Wilks, and Carol Bascom-Slack. 2020. “Uncovering Factors Influencing Instructors’ Decision Process When Considering Implementation of a Course-Based Research Experience.” CBE–Life Sciences Education 19(2). doi: 10.1187/cbe.19-10-0208

Gough, Laura, Rommel Miranda, Matthew Hemm, and Leann Norman “Evaluation of Faculty Change when Developing CUREs Through an Inclusive Lens.” CBE–Life Sciences Education (forthcoming).

Govindan, Brinda, Sarah Pickett, and Blake Riggs. 2020. “Fear of the CURE: A Beginner’s Guide to Overcoming Barriers in Creating a Course-Based Undergraduate Research Experience.” Journal of Microbiology and Biology Education 21(2): 21.2.48. doi: 10.1128/jmbe.v21i2.2109

Hanauer, David I., Mark J. Graham, Rachel J. Arnold, Mary A. Ayuk, Mitchell F. Balish, Andrea R. Beyer, Kristen A. Butela, et al. 2022. “Instructional Models for Course-Based Research Experience (CRE) Teaching.” CBE–Life Sciences Education 21(1). doi: 10.1187/cbe.21-03-0057

Hernandez, Paul R., Anna Woodcock, Mica Estrada, and P. Wesley Schultz. 2018. “Undergraduate Research Experiences Broaden Diversity in the Scientific Workforce.” BioScience 68: 204–211. doi: 10.1093/biosci/bix163

Johnson, W. Brad, Laura L. Behling, Paul Miller, and Maureen Vandermaas-Peeler. 2015. “Undergraduate Research Mentoring: Obstacles and Opportunities.” Mentoring & Tutoring: Partnership in Learning. 23: 441–453. doi: 10.1080/13611267.2015.1126167

Kennedy, Sarah A., Amy M. Balija, Christopher Bibeau, Timothy J. Fuhrer, Lissa A. Huston, Milcah S. Jackson, Kimberly T. Lane, et al. 2022. “Faculty Professional Development on Inclusive Pedagogy Yields Chemistry Curriculum Transformation, Equity Awareness, and Community.” Journal of Chemical Education 99: 291–300. doi: 10.1021/acs.jchemed.1c00414

Kezar, Adrianna, Sean Gehrke, and Samantha Bernstein-Sierra. 2017. “Designing for Success in STEM Communities of Practice: Philosophy and Personal Interactions.” Review of Higher Education 40: 217–244. doi: 10.1353/rhe.2017.0002

Kortz, Karen M., and Katrien J. van der Hoeven Kraft. 2016. “Geoscience Education Research Project: Student Benefits and Effective Design of a Course-Based Undergraduate Research Experience.” Journal of Geoscience Education 64: 24–36. doi: 10.5408/15-11.1

Lopatto, David. 2004. “Survey of Undergraduate Research Experiences (SURE): First Findings.” Cell Biology Education 3: 270–277. doi: 10.1187/cbe.04-07-0045

Lopatto, David. 2007. “Undergraduate Research Experiences Support Science Career Decisions and Active Learning.” CBE–Life Sciences Education 6: 297–306. doi: 10.1187/cbe.07-06-0039

Lopatto, David, Charles Hauser, Christopher J. Jones, Don Paetkau, Vidya Chandrasekaran, David Dunbar, Christy MacKinnon, et al. 2014. “A Central Support System Can Facilitate Implementation and Sustainability of a Classroom-Based Undergraduate Research Experience (CURE) in Genomics.” CBE–Life Sciences Education 13: 711–723. doi: 10.1187/cbe.13-10-0200

Maton, Kenneth I., and Freeman A. Hrabowski III. 2004. “Increasing the Number of African American PhDs in the Sciences and Engineering: A Strengths-Based Approach.” American Psychologist 59: 547–556. doi: 10.1037/0003-066X.59.6.547

Miranda, Rommel J., Cheryl Warren, Kathryn McDougal, Steven Kimble, Joseph Sanchez, Leann Norman, Virginia Anderson, and Matthew Hemm. 2023. “Identifying New Small Proteins through a Molecular Biology Course-Based Undergraduate Research Experience Laboratory Class.” Biochemistry and Molecular Biology Education 51: 574–585. doi: 10.1002/bmb.21764

Morrison, Janet, John F. Barthell, Anne Boettcher, David Bowne, Cheryl Nixon, Karen K. Resendes, and Juliane Strauss-Soukup. 2019. “Recognizing and Valuing the Mentoring of Undergraduate Research, Scholarship, and Creative Activity by Faculty Members: Workload, Tenure, Promotion and Award Systems.” CUR White Paper 2. Council on Undergraduate Research.

Norman, Leann. 2023. “Development and Implementation of a Bio-innovation Focused Course-Based Research Experience for Undergraduate Students.” Biomedical Engineering Education 3: 225–233. doi: 10.1007/s43683-022-00099-8

O’Leary, Erin Sanders, Casey Shapiro, Shannon Toma, Hannah Whang Sayson, Marc Levis-Fitzgerald, Tracy Johnson, and Victoria L. Sork. 2020. “Creating Inclusive Classrooms by Engaging STEM Faculty in Culturally Responsive Teaching Workshops.” International Journal of STEM Education 7: ar32. doi: 10.1186/s40594-020-00230-7

Olimpo, Jeffrey T., Ginger R. Fisher, and Sue Ellen DeChenne-Peters. 2016. “Development and Evaluation of the Tigriopus Course-Based Undergraduate Research Experience: Impacts on Students’ Content Knowledge, Attitudes, and Motivation in a Majors Introductory Biology Course.” CBE–Life Sciences Education 15(4): ar72. doi: 10.1187/cbe.15-11-0228

Oufiero, Christopher E. 2019. “The Organismal Form and Function Lab-Course: A New CURE for a Lack of Authentic Research Experiences in Organismal Biology.” Integrative Organismal Biology 1(1): obz021. doi: 10.1093/iob/obz021

Rowland, Susan L., Gwen A. Lawrie, James B. Y. H. Behrendorff, and Elizabeth M. J. Gillam. 2012. “Is the Undergraduate Research Experience (URE) Always Best? The Power of Choice in a Bifurcated Practical Stream for a Large Introductory Biochemistry Class.” Biochemistry and Molecular Biology Education 40: 46–62. doi: 10.1002/bmb.20576

Science Education Resource Center at Carleton College. n.d. “CURE Collection.” CUREnet: Course-Based Undergraduate Research Experiences. Accessed July 11, 2023. https://serc.carleton.edu/curenet/collection.html

Shaffer, Christopher D., Consuelo Alvarez, Cheryl Bailey, Daron Barnard, Satish Bhalla, Chitra Chandrasekaran, Vidya Chandrasekaran, et al. 2010. “The Genomics Education Partnership: Successful Integration of Research into Laboratory Classes at a Diverse Group of Undergraduate Institutions.” CBE–Life Sciences Education 9: 55–69. doi: 10.1187/09-11-0087

Shapiro, Casey, Jordan Moberg-Parker, Shannon Toma, Carlos Ayon, Hilary Zimmerman, Elizabeth A. Roth-Johnson, Stephen P. Hancock, Marc Levis-Fitzgerald, and Erin R. Sanders. 2015. “Comparing the Impact of Course-Based and Apprentice-Based Research Experiences in a Life Science Laboratory Curriculum.” Journal of Microbiology and Biology Education 16: 186–197. doi: 10.1128/jmbe.v16i2.1045

Shortlidge, Erin E., Gita Bangera, and Sara E. Brownell. 2017. “Each to Their Own CURE: Faculty Who Teach Course-Based Undergraduate Research Experiences Report Why You Too Should Teach a CURE.” Journal of Microbiology and Biology Education 18(2). doi: 10.1128/jmbe.v18i2.1260

Shortlidge, Erin E., and Sara E. Brownell. 2016. “How to Assess Your CURE: A Practical Guide for Instructors of Course-Based Undergraduate Research Experiences.” Journal of Microbiology and Biology Education. 17: 399–408. doi: 10.1128/jmbe.v17i3.1103

Theobald, Elli J., Mariah J. Hill, Elisa Tran, Sweta Agrawal, E. Nicole Arroyo, Shawn Behling, Nyasha Chambwe, et al. 2020. “Active Learning Narrows Achievement Gaps for Underrepresented Students in Undergraduate Science, Technology, Engineering and Math.” PNAS 117: 6476–6483. doi: 10.1073/pnas.1916903117

Thiry, Heather, Timothy J. Weston, Sandra L. Laursen, and Anne-Barrie Hunter. 2012. “The Benefits of Multi-Year Research Experiences: Differences in Novice and Experienced Students’ Reported Gains from Undergraduate Research.” CBE–Life Sciences Education 11: 260–272. doi: 10.1187/cbe.11-11-0098

VanOrsdel, Caitlin E., John P. Kelly, Brittany N. Burke, Christina D. Lein, Christopher E. Oufiero, Joseph F. Sanchez, Larry E. Wimmers, et al. 2018. “Identifying New Small Proteins in Escherichia coli.” Proteomics 18: 1700064. doi: 10.1002/pmic.201700064

Leann Norman

Towson University, lnorman@towson.edu

Leann Norman is a lecturer in the Department of Biology at Towson University (TU). She earned her BS at Wagner College and a PhD in bioengineering from the University of Maryland, College Park. Her research interests include genetics, bioengineering, entrepreneurship, and course related undergraduate research experience (CURE) pedagogy. As a member of the fourth TU Research Enhancement Program (REP) cohort, Norman designed a CURE on the topic of bio-innovation.

Laura Gough is professor and chair of the Department of Biology at Towson University. She earned an ScB at Brown University and a PhD in plant biology from Louisiana State University. Gough’s research interests focus on the plant ecology of wetlands, particularly tundra ecosystems. She has engaged in many professional development activities around diversity, equity, inclusion, and justice in STEM in her role as department chair and as program director of TU REP.

Matthew Hemm is an associate professor in the Department of Biology at Towson University. He earned a BS at the College of William and Mary and a PhD in biochemistry from Purdue University. His research interests include identifying and characterizing small proteins and providing authentic research experiences for students. Hemm designed a CURE based on the identification of small proteins in the bacterium Escherichia coli and served as assistant director of TU REP.

Jacqueline Doyle is an associate professor in the Department of Biology at Towson University. She earned her BA at the College of Wooster, MS from Murray State University, and PhD in ecology and evolutionary biology from Purdue University. Doyle’s research interests include molecular ecology, conservation, and population genetics. She teaches a CURE on molecular techniques in ecology, evolution, and conservation, is a member of the second TU REP cohort, and serves on the leadership team.

Kelly Elkins is a professor in the Department of Chemistry at Towson University. She earned her bachelor’s degree in biology and chemistry from Keene State College and MA and PhD degrees in chemistry from Clark University. She is an expert in forensic science and the author of several books. Elkins serves on the TU REP leadership team and mentors faculty on the scholarship of teaching and learning. In the second TU REP cohort, she developed an advanced sequencing methods CURE.

Brian Jara serves as director of inclusive excellence education and support at Towson University, overseeing and executing a university-wide plan for training, education, professional development, and resources on diversity, equity, inclusion, accessibility, and belonging for staff, faculty, and students. Jara earned a BA at Johns Hopkins University and MEd at Pennsylvania State University. He consulted with the TU REP leadership team and delivered some of the professional development sessions.

Rommel Miranda is a professor in the Department of Physics, Astronomy, and Geosciences at Towson University. He earned BS and MS degrees at Loyola University and his EdD in science education at Morgan State University. His areas of expertise include scientist-educator partnerships, STEM education, STEM outreach programs, and science teacher professional development. Miranda served as the professional development facilitator and part of the leadership team for TU REP.

Creating a Biology “Studio” to Promote Undergraduate Research

Creating a Biology “Studio” to Promote Undergraduate Research

3rd World Congress on Undergraduate Research, University of Warwick, UK

3rd World Congress on Undergraduate Research, University of Warwick, UK

Recommended Citation: Gibson, Caroline, Emma Barker, Jane Bryan. 2024. 3rd World Congress on Undergraduate Research, University of Warwick, UK. Scholarship and Practice of Undergraduate Research 7 (3): 26-33. https://doi.org/10.18833/spur/7/3/7


The University of Warwick, located in Coventry, England, is a major research institution with an acknowledged reputation for excellence in teaching and learning, innovation and links with business and industry (University of Warwick 2023a). In 2019, staff in the Institute for Advanced Teaching and Learning (IATL) at the university, an institution known for innovative, creative, and sector-leading student research initiatives, submitted a proposal to be the first UK institution to host the World Congress on Undergraduate Research (WorldCUR).

The WorldCUR was first conceived by a group of academics during the 2014 meeting of the National Conference for Undergraduate Research in the United States, with a goal of ‘bringing together faculty mentors, students, and staff with a focus on building lasting international collaboration’ (Rivera et al. 2018, 55). The first World Congress was hosted by Qatar University in 2016 and was supported by the Council on Undergraduate Research in the United States, which provided a link to its conference submissions platform and suggested panelists and moderators. The Congress was also supported by the Australasian Council for Undergraduate Research, which consulted throughout, and the British Conference of Undergraduate Research (BCUR) which drafted the Congress themes, provided abstract review, and developed the Congress schedule, among other roles (Rivera et al. 2018, 56). The University of Oldenburg successfully applied to be the next hosts for the event and the second World Congress took place there in 2019.

Warwick’s proposal aimed to bring WorldCUR together with the BCUR, to cross-pollinate each event with valuable aspects of the other. Anticipated advantages of this cross-pollination included bringing an existing national network and over a decade of pedagogic and conference organizing experience and adding to it elements of the first two WorldCUR events, including the complementary conference sessions and themed sessions, and the chance to bring new cultural and international perspectives from students around the world. BCUR originated in 2011 at the University of Central Lancashire, UK, and a group of institutions with a focus on undergraduate research support BCUR via representatives on the Executive Committee. BCUR is hosted annually by universities around the UK. Warwick staff have been involved with BCUR since its inception, as part of its Executive Committee and hosting the conference in 2012 and had been interested in submitting a proposal to host the conference for a second time. The decision to submit a joint hosting proposal for WorldCUR and BCUR was influenced by the strength of bringing an existing national conference together with a new international event, rather than competing with it. It was felt that, although there might be organizational challenges in hosting two large events together, overall, it would be advantageous to bring an existing structure and cohort of staff and students from BCUR to the joint events, and hosting concurrently would mean that students didn’t have to make a choice between attending a national or international conference in the UK in 2023.

Warwick’s proposal to host WorldCUR responded to the criteria circulated by the Alliance for Global Undergraduate Research (AGUR) steering committee, a committee formed for the oversight of WorldCUR, and reflected on Warwick’s position as a sector-leading institution in undergraduate research. It also foregrounded the IATL, where the conference organizing team was primarily based, and its status as a cross-faculty department with links throughout the university. The proposal highlighted IATL staff’s strong history of leading Warwick’s own undergraduate research programs and innovations, including conceiving of and hosting the International Conference of Undergraduate Research (ICUR) (University of Warwick 2023b), a video-linked conference bringing together student researchers from a range of participating institutions, and establishing the publication of Reinvention: an International Journal of Undergraduate Research in 2007 (University of Warwick 2023c). Supporting a wide spectrum of students to apply to and attend WorldCUR-BCUR was prioritized. A suite of synchronous and asynchronous training opportunities, developed, organized and presented by the organizing team was proposed, and covered topics from abstract writing through to advice on attending conferences and writing presentations, to be offered at varied times to accommodate students in different time zones. IATL’s vision for WorldCUR and BCUR was one of critical interdisciplinarity, internationalization and innovation, aligning to Warwick’s institutional priorities, as well as emphasizing a commitment to co-creation by centering students at the heart of the organizing team. While ICUR virtually connects around 400-600 students from specific participating institutions from six continents around the world, bringing the WorldCUR to Warwick would give valuable experience of hosting an international in-person event to the IATL team and inform the continued development of our own hybrid event.

Warwick’s hosting of WorldCUR-BCUR was focused on diversity, in terms of the global scope of attendees representing a variety of institutions and countries, presentation styles and disciplines. These strategic aims hoped to give a broad spectrum of undergraduate students a meaningful experience and a new understanding of research culture and their place within it.

The Organizing Team

The main organizing team consisted of five staff members, including a Project Support Officer whose role was solely focused on the event (University of Warwick 2023d). Three Student Directors for WorldCUR-BCUR were also recruited, selected from students who had already worked with the IATL team on student research activities, bringing a wealth of experience to the role. Input from one of IATL’s Co-Creation Officers, also an undergraduate student at Warwick, was also sought, to bring a different student perspective and support the orientation program (University of Warwick 2023d). Additional support for the event was provided by IATL staff members, including the administration of the travel fund and website development. Before the event, a large team of around forty student volunteers from Warwick were recruited and trained to fill roles as session chairs, room stewards, and registration and information assistants. Applying students were asked to provide information about their previous experience of student-oriented support roles and their attendance at international events, as well as what appealed to them about the role.

Impact of the Pandemic

With plans for the joint WorldCUR-BCUR event to take place in the spring of 2022, preparations were underway when the global COVID-19 pandemic struck in early 2020. The pandemic had an enormous impact on the planning, organization and timing of the events. A decision was made in summer of 2021, in conjunction with the AGUR steering committee and the BCUR Executive, to postpone the events by one year, to April 2023. This was primarily to allow equity of access to the conference for delegates from countries with different pandemic experiences and responses, and to attempt to deliver an in-person event. Even once that decision had been made, conversations continued regarding whether it would be possible to hold WorldCUR and BCUR in-person or if all, or part, of the conferences would have to be online. Key to these discussions were the increasing frequency and familiarity with online events across the globe, as well as the complexities of delivering hybrid events.

As deadlines approached, it was decided that WorldCUR and BCUR would be hosted as two fully in-person events. Having spent months studying and working at home, the many benefits of interacting in person had been starkly highlighted. Stakeholders in the events felt that a significant appetite for in-person attendance had been building. The Call for Abstracts was pushed to August 2022, to give time for work and travel restrictions to begin to resolve in most countries. However, there was still a great deal of uncertainty as to whether delegates would be able or willing to travel, and on the financial impact of the pandemic on institutions’ ability to fund student participation. The organizing team pressed ahead, aware that IATL was ideally placed to pivot to a hybrid event delivery should the international situation alter, using their decade of experience in delivering ICUR – the institution’s own video-linked international undergraduate research conference.

Abstract Submission and Acceptance

The call for abstracts launch, hosted on the Oxford Abstracts platform, was delayed for as long as possible, opening in July 2022, to confirm that the decision to host an in-person event was feasible and to try to ensure equity of access. While the abstract submission window was held open long enough to try to ensure that the delays due to the pandemic didn’t negatively affect diversity, equity, and inclusion regarding who was able to apply to present their work at the event, the timeline for the abstract acceptance process was much shorter than had originally been planned. Abstract submission closed in November 2022, and the first round of abstract reviews were completed before the end of the calendar year, which put additional pressure on the organizing team. The call for abstracts was sent via a variety of channels, including to institutions where attendees at previous World Congresses had worked or studied, to relevant staff at large research institutions around the world, as well as embassies and NGOs, in an effort to circulate it as widely as possible. It invited students to submit an abstract specifically to WorldCUR or BCUR, or for consideration for both conferences. The submission process was derived from the format used for ICUR, which was designed to challenge undergraduates to consider their research work from an interdisciplinary and international perspective, and to construct an abstract accessible to an educated, but non-specialist audience (University of Warwick 2023e).

Over 750 submissions were received in total across the two conferences from 714 students (Table 1), demonstrating a renewed confidence in attending in-person events.

Those applying for either WorldCUR only or jointly to WorldCUR-BCUR were assessed via a double-blind peer review process, with participating reviewers being undergraduates, university faculty and staff from around the world. A call for reviewers was circulated to those who had served as reviewers for previous World Congresses and more widely. Interested undergraduate students were required to attend a training session on reviewing abstracts, hosted on Microsoft Teams, at which attendance by faculty/staff was desirable but not essential.

Abstracts were evaluated using a rubric that considered the effectiveness of conveying the research question, context, methodology, impacts, and overall presentation. Each abstract underwent review by both a student and a staff/faculty member. Abstracts from oversubscribed areas (primarily the United States and United Kingdom) were assessed by three reviewers. Full details of the abstract assessment rubric are available on the IATL website (University of Warwick 2023e).

Abstracts for WorldCUR were accepted based on a composite score from reviewers, while also considering the need for balanced representation across regions and disciplines. The submission deadline for BCUR was extended to align with its regular annual timeline. Some low-scoring WorldCUR applicants were offered a chance to revise and resubmit their abstracts following additional support from the organizing team, particularly where their abstract might represent the only submission from their country or disciplinary area. Abstract writing workshops were made available via MS Teams meetings, with timings designed to be accessible for students in different time zones.

Crucially, the University of Warwick followed previous WorldCUR precedents by allocating funds for delegates from low-middle income countries (as defined by the Organization for Economic Co-Operation and Development [OECD]). In the abstract acceptance process, a key focus was identifying top-scoring submissions from delegates studying in these specified countries. They were eligible to apply for the WorldCUR travel fund, provided by University of Warwick central funding, the International Office, academic departments and IATL itself. A total of 35 students received the opportunity to attend the conference through the travel fund from 15 countries, resulting in 30 presenters from 13 countries eventually obtaining visas and traveling to the event. The countries students attended from were Nigeria, Kazakhstan, Kyrgyzstan, Egypt, Ghana, Columbia, Uganda, Malawi, Kenya, Thailand, India, Nepal and South Africa. Unfortunately, five students selected for travel fund sponsorship could not attend due to rejected visa applications and they subsequently participated remotely. All accepted delegates were given comprehensive information about the need to hold a current passport and to apply for visa entry to the United Kingdom to attend the event. Letters of support were available on request through the Oxford Abstracts registration platform. Each individual application was dependent on both the individual’s country of residence and country of birth, as well as the associated visa requirements of the UK’s government. A small number of prospective delegates, including the previously mentioned travel fund applicants, were unable to obtain entry visas, for a variety of reasons, including a lack of clarity or errors when completing forms, international sanctions against their country of origin, or failure to meet required deadlines. In general, students expressed excitement regarding the process of obtaining passports and visas for international travel, particularly after such a long period of isolation.

WorldCUR-BCUR 2023

The joint WorldCUR-BCUR events took place between April 3-6, 2023, at the University of Warwick campus. The date selection was influenced by the pandemic, as rescheduling a year later limited venue and accommodation options. This posed challenges, including scheduling events around major religious holidays. The organizing team addressed these challenges by collaborating with Warwick’s multidenominational chaplaincy, which welcomed delegates during the events, offering venues and opportunities for religious observance or celebration. Over 700 delegates from across the world attended across the two events (see Tables 2 and 3).

A map on the IATL website indicates the countries represented by delegates (University of Warwick 2023e), with WorldCUR delegates mostly attending for all three days of presentations from April 4-5, 2023 and BCUR delegates choosing to attend from April 5-6, 2023 or a single day if they preferred. WorldCUR and BCUR had separate spoken presentation sessions arranged in parallel streams across each day, in their own separate venues in proximity on the Warwick campus. Large joint poster sessions, as well as a joint keynote and closing plenary brought all the WorldCUR and BCUR delegates together, and were hosted in the Warwick Arts Centre, where all delegates also came together for catering and additional events such as a Next Steps Fair.

Delegates arriving for WorldCUR on the 3rd April were invited to attend orientation activities to local areas of interest, as well as a welcome reception that evening. Orientation trips took delegates to local places of interest, including Warwick Castle, Stratford-upon-Avon, and Coventry Cathedral. A varied social program was devised and accessible to all delegates throughout the event to ensure attendees felt welcome and supported in the UK, recognizing many delegates were visiting for the first time and that pandemic travel restrictions had kept so many at home for so long. Events included games, e-sports, mixers and a movie screening, alongside the opportunity to attend the formal conference dinner on 5th April.

The joint WorldCUR-BCUR keynote speaker was Professor Sir David Spiegelhalter, a renowned academic, who spoke about communicating complex knowledge to nonspecialist audiences. The joint closing plenary was chaired by Dr. David Metcalfe, a Warwick alumnus who shared his experiences as an undergraduate researcher and then chaired an Alumni Panel comprised of former University of Warwick students, who discussed undergraduate research and the impact it had had on them during and after university.

Student Presentations were organized by seven conference themes, Sustainability, Health, Power, Data, Create, The Future, Community. Full details of each theme can be found on the IATL website (University of Warwick 2023f). Delegates were encouraged to select themes they felt applied to their research when submitting their abstracts, and, taking that into account, a theme for each presentation was then allocated by a staff and student team at Warwick. This meant that spoken sessions brought together presentations from different disciplines under the same chosen theme to encourage interdisciplinary discussion. Overall presentation numbers for each theme are listed in Table 4, as a percentage of total presentations given at each event.

Replicating a successful aspect of the Oldenburg conference, separate ‘Theme Sessions’ were created to bring together all student presenters allocated to each theme. In these larger sessions, hosted by a staff delegate alongside a student organizing team member, delegates were given the chance to interact with other researchers in their theme area and discuss areas of similarity and divergence. Delegates also had the chance to contribute to a Padlet created for each Theme Session, with prompt questions provided. A Padlet is essentially an online wall of post-it notes – a resource that allows all participants to contribute comments, questions, resources and links in one easily accessible page.

A significant development for WorldCUR 2023 was the International Student Research Projects (ISRPs), a new pilot program, bringing together students from several institutions to complete joint research projects in the months before the Congress (University of Warwick 2023g). The students were recruited by members of the AGUR steering committee, from their own institutions, in order that the pilot could be more easily monitored and managed, resulting in student researchers from different universities and countries being formed into seven interdisciplinary, international teams. Each team was supported by two co-supervisors – one an established academic and one a postgraduate doctoral student – and met regularly online. The innovative ISRP model enabled students to undertake international research projects and build international connections and intercultural awareness despite restrictions to their mobility in the lead up to the Congress caused by the COVID-19 pandemic. The projects developed the skills of student researchers and novice postgraduate supervisors, as well as giving them experience to take into employment or further academic endeavors. The students within each ISRP were then invited to present their work together at WorldCUR. The pilot program included sixteen students from the US and the UK and serves as a model for larger scale implementation at future congresses.

Impacts and Outcomes

Of the 302 student presenters at WorldCUR, 24 percent responded to the event evaluation survey. The survey was based on previous evaluations the IATL team had carried out into student research activities. It included a focus on the connections made by students during the event, the impact on delegates’ academic confidence and identity, and the influence of the event on students’ plans to continue their academic journey beyond their undergraduate degree.

Overall responses indicated that delegates derived many positive outcomes from their participation. 100 percent of respondents indicated that attending the Congress had added value to their overall university experience and 96 percent said they would recommend it to another undergraduate student. Comments included “All in all it was an incredibly valuable experience, one every aspiring researcher should have” and that the best aspect of WorldCUR was “being able to share my research with a large and diverse range of people… it made me so confident in my research projects and has made me believe that I can achieve great things even at a young age.”

Feedback from student delegates in the evaluation survey seems to support the decision to hold the event in-person, giving delegates the chance to interact with like-minded students from around the world, and experience international interactions and different cultures. Delegates highlighted the greater potential impact on attendees when meeting face-to-face in comments such as “in-person conferences allow you to make direct connections and physical interactions with others that you just cannot online.” Benefits such as the ability to network and to fully immerse oneself in the real-world experience also featured in delegate comments, “in-person is 10 times more experiential and effective…[allowing] me to set aside time to network and focus on the conference as a whole” and “in-person is superior…you get to interact with other people and truly dedicate time to it instead of dividing your attention between the conference and other things.” While only 17 percent of respondents were traveling outside of their home country for the first time, almost half of respondents were experiencing their first visit to the UK. Many commented that the opportunity to travel to a different country was “exciting,” “a life-changing experience” and that the conference was “a transformative experience that I wouldn’t have been able to gain anywhere else.” How much these responses were influenced by delegates’ pandemic experiences is difficult to know, but, again, the feedback seems to vindicate the decision to hold the conferences in person.

Exposure to different cultures and countries of origin during in-person networking was highlighted as a key feature, including that “meeting intelligent and innovative international students was by far the highlight of my experience,” as well as the opportunity to interact with people “from diverse academic and social backgrounds” and “learning about similarities and differences in lifestyle and research.” Many delegates also commented on how they were exposed to a different culture of academia and were able to compare and contrast to their own experience of learning at their home institutions, gaining a “broader perspective on worldwide academia,”enabling them to “compare the types of research done in other institutions… and [learn] how can I improve the research skills at our university” and to “witness how learning and research is done in international settings.”

The benefits of attending undergraduate research conferences have been described in various studies (Douglas et al. 2018, Kneale et al. 2016, Walkington et al. 2017), and a number of these benefits were underscored in the delegate feedback. The practical experience of attending a conference and how it developed skills that delegates did not have regular access to as part of their degree studies, for example: “my studies in Germany are more about learning than doing and the conference allowed me to experience academic practice” and that attending gave them “an overview of how the job of scholar looks like, what are the different tasks in those jobs.” 80 percent of respondents said they felt more connected to the research work in their departments after attending, with comments such as participating had “increased my interest in taking research and understanding the impact of research studies.” Additionally, 89 percent of respondents said that after attending WorldCUR they felt more like a researcher and part of the academic community, with one delegate saying that this new perception of themselves as a researcher was the best thing about the conference overall.

Crucially, forums for students to present their research to peers in the research community are an opportunity for undergraduates to build their confidence in a supportive and inclusive environment. 100 percent of WorldCUR respondents said that attending had increased their confidence to attend another conference in the future, while 96 percent said it had increased their confidence in presenting their work to others. Delegates highlighted that the conference was a “learning, sharing and a connection platform,” where “everyone is at the same level academically” and that participating encouraged them to talk about their research generally, and specifically to do this with both international and interdisciplinary audiences. These ideas were reflected in one delegate’s reasons for recommending WorldCUR to future attendees, “This experience has made me so confident in my research, public speaking skills, and has made me feel more connected with others. I think that WorldCUR is a great opportunity for those wanting to meet fellow undergraduate researchers and to expand their own experience and opportunities.”

Reflections from our Student Director Team

Co-creation with undergraduate students forms a crucial part of IATL’s pedagogy. As previously stated, several students were included in the core organizing team for WorldCUR-BCUR. Their reflections provide further insight into the impact of the joint conferences.

Student Director Elvire de Thomasson was struck by the opportunities the events presented for networking “I was very privileged to have been able to meet various students from all over the world, from Colombia, to the United States and even Kenya. I also learned a lot from the research that each participant presented, reminding me that diversity is what makes interdisciplinary research so beautiful.” Student Director Fernando Conde Nodal’s observations reflected these comments saying that “It showed me what research looks like (and how it’s communicated) across different disciplines and different communities… which I can now apply to my own research endeavors: from ideation, to methodology, to communication.”

IATL’s Co-Creation Officer, Alice Khimasia was struck by a particular comment from a parent of a presenter and reflected on how it seemed to sum up the aims of the events, “…they said, it is truly inter-cultural. This was a very significant comment, because contributors were welcomed from all over the world, given the stage and the microphone to share their diverse research projects on an international platform, all equally valid and esteemed. In that sense, Warwick was not inviting people to our space on our terms, but truly sharing our space with students invited to share on their terms.”

Next Steps and Future Events

During WorldCUR-BCUR, delegates were encouraged to visit the Next Steps Fair, where opportunities for further study at Warwick were showcased. In our evaluation survey, attending the conference motivated 75 percent of respondents to apply for a Masters or doctorate program and 61 percent said that attending had confirmed their interest in their field of study, while 44 percent strongly agreed that it helped clarify which field of study they would next like to pursue, statistics that are underscored by comments such as “ it definitely confirmed my heart to pursue further studies and academia,” with one delegate stating that the addition to their CV had already helped them to gain a place on their preferred Master’s program. Our website encouraged delegates to join an alumni group post-conference and highlighted postgraduate opportunities at Warwick (University of Warwick 2023h). At the conclusion of WorldCUR-BCUR, delegates were also encouraged to submit a research paper to Warwick’s journal, Reinvention in which a selection of papers will be peer reviewed and published, alongside the WorldCUR Book of Abstracts.

Conclusion

The hosting of the third World Congress of Undergraduate Research was influenced by the iterations of the event that had come before it, the University of Warwick’s and IATL’s strategic priorities for undergraduate research and education, and by the substantial impacts of the COVID-19 global pandemic. Key components of the previous World Congresses were carried forward into Warwick’s event, such as the thematic organization of the sessions, the support of delegates from mid-to-low-income countries and the orientation activities prior to the Congress opening. New elements of the conference were included that aligned with IATL’s strategic priorities, such as incorporating an extended abstract submission format and related review process, providing support and training sessions prior to the event and introducing the ISRP program. In our initial vision for the event, it was suggested that the event was likely to benefit from Warwick’s experience of hosting ICUR, with hybrid options offering accessibility to students unable to travel. However, the pandemic’s impact, and the resulting proliferation of online events, increased the value attributed to the in-person nature of the Congress. This led the organizers to limit the opportunity for hybrid presentations, because it was felt that the pandemic’s normalization of hybrid events would have resulted in a disproportionate amount of online attendance, affecting the conference experience for those who did travel. An additional emphasis was placed on elements of the Congress that supported delegates’ in-person experiences, including interactive complementary sessions, a full student-hosted social program, a high-profile keynote speaker, and opportunities for networking. The ability for students to travel to events such as the World Congress is always at risk of being impacted by a multitude of factors, however the experience of hosting the Congress as a fully in-person meeting, underscored the benefits of these types of opportunities for student collaboration and networking. Recommendations to future hosts of similar events would be to learn from the challenges and successes of others, but also to incorporate local initiatives, pedagogy and experience to make each event distinctive.

Data Availability

The data, critical questions used in the scripts, and instruments underlying this study are available within the text.

Institutional Review Board

Not required as the research did not involve human or animal subjects or samples.

Conflict of Interest

All authors declare that they have no conflicts of interest.

References

Douglas, Caroline., Yearsley, James., Scott, Graham. W., & Hubbard, Katharine. E. 2018. “The student thesis conference as a model for authentic and inclusive student research dissemination”. Higher Education Pedagogies 3(1): 331–353. doi:10.12973/ijem.6.2.285

Kneale, Pauline., Edwards-Jones, Andrew., Walkington, Helen., & Hill, Jennifer. 2016. “Evaluating undergraduate research conferences as vehicles for novice researcher development”. International Journal for Researcher Development 7(2): 159–177. doi:10.1108/IJRD-10-2015-0026

Rivera, Julio, Maher Khelifa, Bushra Abu Hamdah, Aisha Mohammed Al-Hamadi, and Emma S. Zdgiebloski. 2018. “A Global Conversation: Reflections from the First World Congress on Undergraduate Research.” SPUR 2(1): 55–59. doi:10.18833/spur/2/1/4

University of Warwick. 2023a. “Ranking”. Accessed December 21, 2023. https://warwick.ac.uk/about/profile/ranking.

University of Warwick. 2023b. ““ICUR Portal”. Accessed September 1, 2023. https://www.icurportal.com/

University of Warwick. 2023c. “Reinvention Journal”. Accessed August 7, 2023. App.alchemer.com/login/v1

University of Warwick. 2023d. “WorldCUR-BCUR Team”. Accessed January 12, 2024. https://warwick.ac.uk/fac/cross_fac/iatl/student-research/bcur_worldcur_2023/teampage/

University of Warwick. 2023e. “Delegate Processes”. Accessed August 4, 2023.  https://warwick.ac.uk/fac/cross_fac/iatl/studentresearch/bcur_worldcur_2023/teampage/

University of Warwick. 2023f. “Themes”. Accessed August 30, 2023. https://warwick.ac.uk/fac/cross_fac/iatl/student-research/bcur_worldcur_2023/themes/

University of Warwick. 2023g. “Programme Highlights”. Accessed August 7, 2023. https://warwick.ac.uk/fac/cross_fac/iatl/student-research/bcur_worldcur_2023/highlights/

University of Warwick. 2023h. ““Next Steps”. Accessed September 1, 2023. https://warwick.ac.uk/fac/cross_fac/iatl/studentresearch/bcur_worldcur_2023/next/

Walkington, Helen., Hill, Jennifer., & Kneale, Pauline. E. 2017. “Reciprocal elucidation: A student-led pedagogy in multidisciplinary undergraduate research conferences”. Higher Education Research and Development 36(2): 416–429. doi:10.1080/07294 360.2016.1208155

Caroline Gibson
University of Warwick, c.a.l.gibson@warwick.ac.uk

Caroline Gibson is Deputy Director in the Institute for Advanced Teaching and Learning at the University of Warwick. She has a strong interest in undergraduate research and is the co-designer and developer of the International Conference of Undergraduate Research and established Reinvention: an International Journal of Undergraduate Research in 2007. Caroline supports many diverse and innovative teaching and learning projects across the University of Warwick in areas such as internationalization, co-creation and interdisciplinarity.

Emma Baker began her career in book publishing and previously held positions at the Association for Jewish Studies, New York University Press, Cassell & Co, and Continuum Publishing (now Bloomsbury Academic), before joining the Institute for Advanced Teaching and Learning, University of Warwick in 2013. Since then, she has managed a variety of projects focusing on undergraduate research including the International Conference of Undergraduate Research and Reinvention: an International Journal of Undergraduate Research.

Jane Bryan is a Reader in Law at the University of Warwick, with a research interest in dialogue to empower and connect. Jane is the Academic Lead for Warwick University’s Community Values Education Program and a Foundation Fellow of the Warwick Higher Education Academy. She has also achieved Principal Fellowship of the Higher Education Academy (UK) (its highest award) for her strategic leadership in areas of teaching and student support, in particular student research.





2nd World Congress on Undergraduate Research, University of Oldenburg, Germany

2nd World Congress on Undergraduate Research, University of Oldenburg, Germany

Recommended Citation: Bugiacca, Vanessa Barbagiovanni, Annalena Karweik, Susanne Haberstroh. 2024. 2nd World Congress on Undergraduate Research, University of Oldenburg, Germany. Scholarship and Practice of Undergraduate Research 7 (3): 17-25. https://doi.org/10.18833/spur/7/3/8


Following the successful inaugural World Congress on Undergraduate Research (WorldCUR) in Doha, Qatar in November 2016, the second iteration of the World Congress took place at the Carl von Ossietzky University of Oldenburg in 2019. Located in the Northwest of Germany, the University of Oldenburg was founded in 1973, making it one of the younger higher education institutions in Germany. It has around 16,000 students and offers a  wide range of study programs, providing students with a variety of options for their academic pursuits. (University of Oldenburg n.d.b)

A key goal of the university is the seamless integration of research and teaching, a commitment that is prominently featured in its mission statement, emphasizing the importance of research-based learning in academic education.

The organizers of the 1st WorldCUR chose the University of Oldenburg because of its established focus on undergraduate research and its experience in hosting student conferences, without a formal application process for the 2nd WorldCUR. In addition, the size of the University of Oldenburg and Germany’s reputation as a safe environment for international students, as well as the university’s participation in the 1st WorldCUR in Doha, made it an ideal choice.

From May 23 to 25 in 2019, the University of Oldenburg welcomed well over four hundred international students and scholars who came together to celebrate undergraduate research, foster the exchange of ideas on pressing global issues of the 21st century, and cultivate professional networks. The event focused on the presentation of student research within six overarching themes.

The primary goal of the congress was to bring together students of different nationalities and research disciplines, and to harness this diversity as a collective force to address global challenges by fostering worldwide networks and jointly exploring and discussing ideas for solutions. This aligns with the findings of several studies that highlight the benefits of undergraduate research conference participation, including skill development and enhanced academic and professional growth. (Chris 2020; Hill, and Kneale 2017; Hill and Walkington, 2016; Kneale et al., 2016; Mabrouk 2009). These studies consistently affirm that undergraduate research conferences are key to increasing student engagement, providing active immersion in their fields of study, and strengthening connections within their academic and professional communities. In addition to the scholarly dissemination of diverse academic endeavors through oral presentations and poster presentations, the organizing committee curated a variety of exchange and networking opportunities throughout the congress to ensure an enriching experience for all participants. These activities included a carefully planned two-day social program with excursions to various venues in both northern Germany and the Netherlands. In addition, faculty members and coordinators were provided with numerous opportunities to engage, network, and showcase their respective academic institutions.

Recognizing the importance of ensuring broad participation by students from around the world, extensive support initiatives, both financial and otherwise like the travel grants and the “beds for brains” program, were initiated in a timely manner. The significant investment of energy and time in these efforts proved successful, enabling numerous students from low-income countries to attend the congress.

Setting the Stage: Preparing for the 2019 World Congress of Undergraduate Research

Preparing for the World Congress of Undergraduate Research was an extensive undertaking spanning 26 months from the university’s decision to host the event to the event itself. The core team based in the Presidential Department for Study Affairs, consisting of chair and chief organizer, had primary responsibility for the congress and most of its areas. In the last six months before the congress, four highly involved staff members joined the core team, supported by additional staff members.

The student team consisted of nine senior students who were recruited two years prior to the congress to allow high involvement and the development of expertise. These seniors were specifically recruited for and given responsibility in the areas of public relations, travel support, room planning, social program, and tools & technology. They also formed the Student Congress Committee representing student interests throughout the development and preparation process. Finally, just before the event, the seniors helped to recruit and train another 20 “junior” students to help run the congress. These junior students were involved in various activities during the congress, such as monitoring and coordinating procedures, assisting attendees at the registration desk, serving as guides during the social program, and helping to prepare sessions.

The committee of the 2nd World Congress on Undergraduate Research consisted of partners from the Council on Undergraduate Research (CUR), the British Conference of Undergraduate Research, the Australasian Conference of Undergraduate Research, and the previous host institution (Qatar University). The committee was involved in all major decisions regarding the planning of the congress and coordinated arrangements for the organization, schedule, and promotional activities, which was very helpful for the success of the event. At the congress in Oldenburg, the host University of Oldenburg congress leadership and these partners founded the “Alliance on Global Undergraduate Research,” which aims to promote undergraduate research worldwide and support future hosts of the WorldCUR.

The Call for Participation emphasized the importance of interdisciplinary dialogue by inviting undergraduate students to submit research papers and creative works from a wide range of disciplines in the sciences, humanities, and social sciences. Submissions were called for according to six overarching research themes, which were intensively discussed and agreed upon by the Congress Committee. These were similar, but not identical, to the themes chosen at the Doha Congress. The research themes were complemented by visual branding developed in-house by a member of the core team and a media designer from the department for press and communication. The key visuals included not only the individual research theme icons (see Figure 1) colored in different shades of blue to match the university’s corporate design, but also the logo for the 2nd WorldCUR (see University of Oldenburg. n.d.c). These images were used across all print media, the website, social media channels, and various merchandise products.

The international nature of the Congress was evident in the review process, where 400 submissions were reviewed by an international panel of experts from various disciplines. Each submission was reviewed by an expert and a non-specialist in the respective discipline to ensure both scholarly accuracy and accessibility to a wider audience.

The World Congress on Undergraduate Research: An Enriching and Diverse Experience

From May 23 to 25 2019, 467 guests from 98 universities and institutions were welcomed to the main campus of the University of Oldenburg at the Auditorium Center, where the congress took place. More specifically, the participants comprised 252 student presenters; 59 supervisors, coordinators, and faculty members; 97 guests, either students or faculty; and 13 special guests, i.e., representatives, committee, keynote speakers, and the host; as well as the 46 members of the organizing team, including 29 students. Students came from 35 countries and all continents except Antarctica.

The World Congress program was designed to provide a platform for presenting student research and facilitating professional exchange, while allowing ample time for networking and exploring the northwestern region of Germany. The program consisted of several components designed to meet the diverse needs and interests of participants. During the congress days, 215 presentations – 133 oral presentations and 82 posters – were given on the six research themes environment, global health, economy, communication, politics, and the world we create (see Figure 2). More than 100 academic disciplines were represented. (University of Oldenburg. 2019c).

The World Congress officially began with an opening ceremony, that featured for the first time the passing of the baton from the previous organizer, Qatar University, to the University of Oldenburg. The baton, engraved with the hosts of the first and second World Congresses, symbolized the continuity and collective effort of the global undergraduate research community.

Following the opening ceremony, Dr. Lujendra Ojha from John Hopkins University, United States, delivered an insightful keynote speech, “Grand Challenges Related to Resources Scarcity in the Future: Synopsis, Solutions, and Undergraduate Involvement” addressing an important future challenge. The second day, Dr. Sonia Fizek from Abertay University, United Kingdom, and Dr. Anne Dippel from the University of Jena, Germany, engaged the audience with their inspiring keynote, “Playful Research by Design: Why the World Needs Thinkers, Tinkerers, and Team Players.” Both keynotes were filmed and provided via the congress YouTube channel (WorldCUR 2019).

The centerpiece of the congress program were the student presentations focused on the six research themes delivered in panel, poster, and thematic sessions: First, each session of oral presentations featured three thematically complementary presentations which were followed by a dedicated 15-minute period for the audience to engage in discussion and direct questions to the presenters. At each session a faculty member (discussant) was present to provide a summary of the findings and contextualize them within the broader research landscape. Each oral session lasted 90 minutes, ensuring a comprehensive exploration of the research topics. In total there were 46 panel session containing 133 oral presentations.

In the two poster sessions, up to 40 students presented their research. These one-hour sessions created an atmosphere conducive to lively discussion and knowledge sharing.

At the conclusion of the congress, awards were distributed to recognize the exceptional quality of contributions across various research themes, applicable to both poster and oral presentations. Award winners came from Uganda, Argentina, Germany, Qatar, and the United States. The award selection was overseen by the six juries each consisting of three different members, including a faculty member, a student, and a committee member, ensuring a comprehensive evaluation from multiple perspectives. Up to five entries per theme were shortlisted based on stringent criteria outlined in the event’s rating scheme, encompassing relevance, theoretical depth, methodological soundness, understandability, clarity, presentation effectiveness, and audience engagement. These entries underwent an anonymous review by the juries to avoid bias and focus solely on content quality. Winners received a wooden trophy and 500€ funded by a regional foundation.

The thematic sessions were a highlight of the congress each with approximately 15 to 25 participants, providing a valuable platform for students to exchange ideas, engage in discussions, and foster collaborative projects. The sessions were announced and advertised prior to the congress but only open to student presenters. They were divided into groups based on their research interests, so that in total there were eight sessions, organized around the six research themes. The thematic sessions were hosted as well as facilitated by university teachers of the host institution. The results of these sessions were later shared via social media and presented at the closing ceremony, allowing all participants to benefit from the collective knowledge and insights generated.

Furthermore, undergraduate research coordinators and supervisors who accompanied the student presenters, were given the opportunity to share results, experiences and programs related to undergraduate research in a poster session with 20 posters dedicated to faculty and coordinators. The aim of this session was to promote international collaboration between colleagues who are involved in UR at their respective institutions worldwide.

At the Graduate Fair students could explore different Master’s programs offered by universities around the world.

The official program of the World Congress on Undergraduate Research concluded with a festive closing ceremony on May 25th, during which the previous days of the congress were reviewed by viewing video footage, closely examining and commenting on the graphic recordings of the thematic sessions, presenting awards for outstanding presentations, and honoring all those involved in the organization of the congress.

Social Program – Bringing People Together

In addition to focusing on intellectual endeavors, the Congress offered a social program that facilitated socializing opportunities, introduced participants to the cultural heritage of Northwest Germany and the Netherlands, and framed the official congress program. The social program included several pre- and post-conference tours and events that allowed participants to explore the region’s attractions. Excursions to Bremen, Groningen (Netherlands) and Papenburg (shipyard visit) provided insightful glimpses into the local culture. Furthermore, numerous tours within the city of Oldenburg, developed by both the student team and the city’s tourism office, provided opportunities for informal networking. Other informal networking opportunities, such as the Welcome Snack and Get Together, a mirror photo booth, called the Magic Networking Machine, and a Gallery for the photos taken, were organized over the course of the event. The World Congress concluded on a celebratory note with a grand party on the evening of May 25th, themed “98 Universities – one party.”

Through the social program, the Congress not only facilitated the dissemination of undergraduate research and interdisciplinary collaboration, but also fostered networking and cultural exploration.

Developing the World Congress on Undergraduate Research

The growing recognition of undergraduate research worldwide and the expanding importance of interdisciplinary and cross-cultural exchange of ideas were exemplified by the increased size and global participation at the 2nd World Congress compared to the inaugural edition in Doha which attracted about 200 participants from higher education institutions in 11 countries (Australia, United States, Europe, the Gulf region and the Middle Ease) (Rivera et al. 2018, 55). In this second edition, the congress grew significantly in the number of students and countries involved.

Another innovation of the conference was the introduction of support programs specifically aimed at facilitating the participation of students from low-income countries providing financial support. These programs played a crucial role in ensuring inclusivity and giving opportunities to students who otherwise would not have been able to attend. The Travel Support Program, supported by the University of Oldenburg and the Ministry for Science and Culture of Lower Saxony, enabled 60 students from low and middle-income countries to attend the conference by covering their transportation costs and congress fee. In this context a challenge was the timely issuance of travel visas, even with a travel grant. Not all participants who received a travel grant were able to attend the congress due to varying visa processing times.

Through the “Beds for Brains” program, in which students and faculty members from the University of Oldenburg offered free lodging to visiting participants were provided with free accommodation, strengthening intercultural connections, and promoting a sense of community. The university itself does not have any residences of its own, so that attendees had to stay in a hotel or other accommodation through the Tourism and Marketing Department of the City of Oldenburg, which had made a contingent of rooms available for this purpose, participants were able to book rooms at special rates. This information was communicated via various channels and was permanently available on the website (University of Oldenburg n.d.d).

For the first time students played a pivotal role in the development and organization of the World Congress, taking responsibility for various aspects of the program, including the social program. Their active involvement demonstrated the commitment and dedication of the student community in shaping and contributing to the success of the WorldCUR 2019.

To ensure comprehensive documentation, 19 video interviews were conducted with congress attendees to capture their perspectives and experiences during WorldCUR 2019. These interviews and other footage from the congress were compiled into a film (WorldCUR 2019b), providing a valuable record of the congress atmosphere, and further enriching the documentation process.

In addition, the event was supported and accompanied by a graphic recorder. Her drawings provide a unique form of documentation (for a detailed view of all graphic recordings see University of Oldenburg n.d.a). The graphic recorder attended several sessions for each research theme and captured the essence of the discussions and presentations on a large canvas in real time. These visuals were made available online. An animated version of the graphic recordings can be viewed on the 2nd World Congress YouTube channel, along with the other video content of the congress (WorldCUR2019 n.d).

Completing the Research Cycle – the Subsequent Publication

After the congress, participants had the opportunity to contribute to a special issue of “forsch!”, the Online Student Journal of the University of Oldenburg (Haberstroh and Bernhold 2021). Since its launch in 2015, this open-access online journal has served as a platform for students at the University of Oldenburg to publish their research findings.

Accepted submission formats included several options: research papers, research proposals, research posters accompanied by explanatory text, and experimental formats such as films or blogs paired with supporting text. Each submitted paper underwent an initial review and was then forwarded to subject experts for a more comprehensive review. A notable challenge was finding appropriate reviewers who were willing to take on the task. In addition to the student papers, the issue also includes reports from each session of the congress, mostly written by sessions discussants. This not only enabled the students to experience a complete research cycle culminating in publication, but also ensured thorough documentation of the congress sessions, thereby fostering accessibility and transparency.

Evaluation Results and Participant Feedback

The evaluation results and participant feedback from the 2nd World Congress on Undergraduate Research shed light on various aspects of the event such as organizational matters, the congress program, activities, and resources, as well as the personal experience (University of Oldenburg 2019d). Participants were also given the opportunity to provide unsolicited comments and suggestions. A total of 100 attendees participated, and the overall evaluation results were very positive, indicating a remarkable level of satisfaction among attendees.

An overwhelming 97 percent agreed/fully agreed that the team was always available for questions and support, indicating effective and responsive support throughout the event. In addition, all respondents agreed that the team was approachable, friendly, and willing to help, demonstrating the welcoming and supportive environment created by the organizers.

Evaluation of the Congress program, activities, and resources revealed generally positive responses (see Figure 3), with notable satisfaction levels for printed materials such as the congress booklet (99 percent) and the abstract book (93 percent). The congress booklet contained not only the congress schedule in detail, but also a lot of information about different aspects of the program and other useful information for participants (University of Oldenburg 2019b) while the abstract book featured abstracts of all presentations (University of Oldenburg 2019a). The congress website and the social media channels, including Facebook, Twitter and Instagram, were each rated as valuable/very valuable by 85 percent of attendees. A great deal of information was provided via social media prior to the congress, and these channels were an important means of communication during the event as well. Networking was supported by various measures, such as the Magic Networking Machine, and were considered valuable/very valuable by 79 percent. It was not only a way to capture memories in the form of images but was also used as a form of social networking and enjoyment at the conference.

In terms of funding, participants reported various sources of support (see Figure 4) for their congress attendance. The majority of respondents (51) received financial support from their home university or institution, while 29 student presenters benefited from the Travel Support Program offered by the University of Oldenburg and the State of Lower Saxony. Private funding accounted for 21 individuals, one respondent relied on a scholarship, and five relied on other means to finance their attendance.

The “Beds for Brains” program, which was designed to provide housing for participants, involved 25 individuals. All respondents who participated in this program rated the accommodations provided and the experience as good/very good, indicating a high level of satisfaction with this initiative.

Participants were asked to evaluate their personal experience and the impact of the congress on their development (see Figure 5). All respondents agreed/fully agreed that they felt able to meet the requirements of the congress and that the congress increased their confidence in presenting their research in public (95 percent). Similarly, 92 percent agreed/fully agreed that the congress increased their confidence in expressing their opinions about other research projects. In addition, 87 percent of respondents agreed/fully agreed that the congress provided them with new perspectives on their own research topic. In terms of future aspirations, 82 percent agreed/fully agreed that the Congress increased their interest in pursuing a professional career in research. The Congress was very effective in facilitating interaction among participants, with 92 percent agreeing/fully agreeing that they were able to exchange ideas about their research with fellow students, colleagues, and other researchers. In addition, 72 percent agreed/fully agreed that they made contacts for future research projects during the congress. The congress was praised for its pleasant atmosphere, with all respondents agreeing with this statement. Participants acknowledged the impact of the congress on their perception of themselves as researchers (90 percent) and on their research and careers (95 percent). Overall, all respondents agreed/fully agreed that they would recommend the congress to other students.

Critical Comments

The organizing team acknowledged the critical comments received from attendees, which were highly appreciated for their constructive nature. Feedback included suggestions for improving the clarity of the website, improving the food experience at the congress party, addressing concerns about the crowded and short duration of the poster sessions, facilitating student access to the faculty poster session, optimizing the length of the opening and closing ceremonies, ensuring transparency in the awards process, addressing the perceived excess of “giveaways” e.g., lanyards or notebooks, and exploring options such as an online abstract book or mobile app for comprehensive information. Thematic sessions received both positive feedback, with attendees considering them the best part of the congress, and negative feedback regarding the sessions perceived as too strictly structured. Participants expressed a desire for more networking opportunities for faculty and coordinators, and inquired about the possibility of sharing contact information for student presenters. While the atmosphere of the congress was generally praised, some attendees felt that networking at the event felt forced. The social program, especially the day tours, received positive feedback for its integration into the official program. A third of the respondents felt that there was sometimes too little information provided on certain topics in advance. This feedback highlights the importance of comprehensive and timely communication to ensure that attendees are well informed and prepared for the event.

The evaluation results and participant feedback provided valuable insights for improving future iterations of the World Congress on Undergraduate Research. The constructive criticism received was appreciated and will be considered to improve various aspects of the Congress, ensuring an even more enriching experience for participants.

Conclusion

The 2nd World Congress witnessed significant growth in both the number of students participating and the countries represented. A notable innovation was the introduction of support programs tailored to facilitate the engagement of students from low-income countries. This furthered the goal of the Congress to bring together students of different nationalities and research disciplines. At the same time, this diversity served as a collective force to address global challenges – the second goal of the congress – through the cultivation of global networks and the collaborative exploration and discussion of potential solutions.

Students played a central role in the event’s development and organization, particularly taking the lead in various aspects of the program, including the social program. This active involvement underscored the commitment and dedication of the student community in shaping and contributing to the success of the 2nd World Congress on Undergraduate Research. This was continued by the 3rd World Congress.

The review of the experiences and the results of the evaluation led to the meticulous preparation of a comprehensive 29-page document that served as a valuable resource for the subsequent organizers of the 3rd World Congress on Undergraduate Research. This document provides detailed recommendations derived from lessons learned in planning and executing the 2nd World Congress components, including insights into the implementation of social programs, the necessity of travel support programs, the effectiveness of the “Beds for Brains” initiative, the pivotal role of an engaged student team, the importance of cultivating a reliable network of scientists, and the strategic use of early promotional tactics and social media activation. This documentation will be further developed by future hosts of the congress to continuously facilitate the organization of the event and improve the experience of future attendees.

Several major organizational priorities utilized at the 2nd World Congress were adapted by the 3rd World Congress. Timely communication of important information (e.g., congress schedule) was even more important than we had anticipated and was improved for the third edition. The visual presentation of the event and of the research themes, which was provided by the organizing team itself in Oldenburg, has played an important role in students’ identification with the event and their contribution. For the third WorldCUR in Warwick, this aspect was given much more attention and very appealing logos and icons were developed for the congress and the research themes.

Also, the success of the thematic sessions was developed into the International Student Research Projects (ISRP), which brought together students from various institutions to work virtually on joint research projects prior to the congress.

Finally, the approach of supporting students from low-income countries was continued, although this was much more difficult during the pandemic than in 2019. As a result, the third edition was even more diverse than the second, despite the after-effects of the pandemic (e.g., less support for students from their own universities), which the event still had to manage.

Data Availability

The data used in this paper are openly available to the public at World CUR2019 Evaluation Detailed Results: https://uol.de/fileadmin/user_upload/lehre/flif/WCUR2019/WorldCUR2019_Evaluation_Results.pdf?v=1563892945.

Institutional or Ethical Review Board

The article deals with the ideas behind the second iteration of the World Congress on Undergraduate Research, the challenges in organizing it, and the results of the evaluation of the congress, and does not include research involving human subjects.

Conflict of Interest Statement

All authors declare that they have no conflicts of interest.

References

Haberstroh, Susanne, and Pelle Bernhold, eds. 2021. “WorldCUR 2019”. Special Issue, forsch! no. 1 (December 2021) Accessed August 15, 2023. https://ojs.uni-oldenburg.de/journals/ojs1/ojs/index.php/forsch/issue/view/1

Hill, Jennifer, and Helen Walkington. 2016. “Developing Graduate Attributes through Participation in Undergraduate Research Conferences.” Journal of Geography in Higher Education 40: 222–237. doi: 10.1080/03098265.2016.1140128

Kneale, Pauline, Andrew Jones, Helen Walkington, and Jennifer Hill. 2016. “Evaluating Undergraduate Research Conferences as Vehicles for Novice Researcher Development.” International Journal for Researcher Development 7: 159–177. doi: 10.1108/ijrd-10-2015-0026

Little, Chris. 2020. “Undergraduate research as a student engagement springboard: Exploring the longer-term reported benefits of participation in a research conference.” Educational Research 62 (2): 229–245. doi: 10.1080/00131881.2020.1747360

Mabrouk, Patricia Ann. 2009. “Survey Study Investigating the Significance of Conference Participation to Undergraduate Research Students.” Journal of Chemical Education 86: 1335–1340. doi: 10.1021/ed086p1335

Rivera, Julio, Maher Khelifa, Bushra Abu Hamdah, Aisha Mohammed Al-Hamadi, and Emma S. Zdgiebloski. 2018. “A Global Conversation: Reflections from the First World Congress on Undergraduate Research.” SPUR 2(1): 55–59. doi:10.18833/spur/2/1/4.

University of Oldenburg. n.d.a. “Congress Impressions”. Accessed August 22, 2023. https://uol.de/en/worldcur2019/congress-impressions

University of Oldenburg. n.d.b. “Profile of the university”. Accessed August 28, 2023. https://uol.de/en/outline

University of Oldenburg. n.d.c. “Research Themes”. Accessed March 10, 2023. https://uol.de/en/worldcur2019/archiveworldcur2019/research-themes

University of Oldenburg. n.d.d. “Travel & Visa”. Accessed March 10, 2023. https://uol.de/en/worldcur2019/archiveworldcur2019/travel-visa

University of Oldenburg. 2019a. “Abstract Book.” Accessed August 15, 2023. https://uol.de/fileadmin/user_upload/lehre/flif/WCUR2019/World_CUR_2019_-_Abstract_Book.pdf?v=1558710988

University of Oldenburg. 2019b. “Congress Booklet.” Accessed August 15, 2023. https://uol.de/fileadmin/user_upload/lehre/flif/WCUR2019/World_CUR_2019_-_Congress_Booklet.pdf?v=1557762931

University of Oldenburg. 2019c. “Looking Back. Congress Impressions and Facts.” Accessed August 15, 2023. https://uol.de/fileadmin/user_upload/lehre/flif/WCUR2019/World_CUR_2019-Retrospect_web.pdf?v=1571934354

University of Oldenburg. 2019d. “World CUR2019 Evaluation Detailed Results”. Accessed August 15, 2023. https://uol.de/fileadmin/user_upload/lehre/flif/WCUR2019/WorldCUR2019_Evaluation_Results.pdf?v=1563892945

WorldCUR2019. n.d. Accessed August 15, 2023. https://www.youtube.com/@WorldCUR

WorldCUR. 2019. “WorldCUR2019.” Accessed October 21, 2019. https://www.youtube.com/watch?v=IAqKIkUc6A8&t=1s

Vanessa Barbagiovanni Bugiacca

University of Oldenburg, vanessa.barbagiovanni.bugiacca@uni-oldenburg.de

Vanessa Barbagiovanni Bugiacca is a member of the editorial staff of forsch!, the online student journal of the University of Oldenburg (Germany). As a member of the congress team for the 2nd World Congress on Undergraduate Research, hosted by the University of Oldenburg in 2019, she was responsible for the preparation of the conference proceedings and subsequent publications. She holds an MA in Cultural Studies and a BA in English and Cultural Studies, both from the University of Oldenburg.

Annalena Karweik has been coordinator of the research-based learning grant program, based at the Presidential Department for Study Affairs of the University of Oldenburg (Germany), since 2021. The program includes grants for instructional and student research projects, as well as funding for participation in conferences or material costs for implementing student projects. In 2019, she was a member of the congress team for the 2nd World Congress on Undergraduate Research, held at the University of Oldenburg.

Susanne Haberstroh is deputy head of the Presidential Department for Study Affairs at the University of Oldenburg (Germany), where she is responsible for the implementation of research-based learning with a focus on the publication of student research results. She is the initiator of the annual German Student Conferences, which took place for the first time in Oldenburg in 2016. In 2019, she hosted the 2nd World Congress on Undergraduate Research at the University of Oldenburg.

Connecting the World through Undergraduate Research

Connecting the World through Undergraduate Research

Recommended Citation: Khelifa, Maher. 2024. Connecting the World through Undergraduate Research. Scholarship and Practice of Undergraduate Research 7 (3): 12-16. https://doi.org/10.18833/spur/7/3/5


About WorldCUR

WorldCUR is an international congress held every three years since 2016 in different parts of the world. So far, three WorldCUR editions have been organized; the First WorldCUR was held at Qatar University, Qatar in 2016, the Second took place at the University of Oldenburg, Germany in 2019, and the Third was held at the University of Warwick, UK in 2023 (one year behind schedule because of the Covid-19 pandemic).

WorldCUR aims to promote student research globally by bringing together undergraduates to celebrate their research engagement and to share their research discoveries. It seeks to provide undergraduates with collaborative research opportunities on themes representing significant challenges facing the global community across many different fields of inquiry. In three WorldCUR iterations, students from around the world came to share their research findings on select congress topics. They discussed in thematic sessions global issues and proposed future collaborative research agendas to address such matters (University of Oldenburg 2019; University of Warwick 2023). An essential WorldCUR aim is to offer undergraduates occasions to develop friendships, professional networks and research partnerships, and to enjoy the social and cultural sides of the event. WorldCUR also offers mentors, professionals and association members a chance to connect and to engage in a global dialogue with an aim to share knowledge and best practices and to generate collaboratively ideas that promote student research globally.

Internationalization of Undergraduate Research and the World Congress

National Undergraduate Research Councils were instrumental in the promotion of student research scholarship. The Council on Undergraduate Research (CUR), founded in 1978, played a pioneering role in promoting and advancing an academic interest in student research. The National Conference on Undergraduate Research (NCUR), established in 1987, continues to showcase student research prowess annually. CUR and NCUR were initially two separate organizations, but the two officially joined and NCUR became part of CUR in 2010, so it is not, as a conference, equivalent to the other councils. Since CUR was the first Council, it has been inspirational in the establishment of both the British Conference of Undergraduate Research (BCUR) in 2011 and the Australasian Conference of Undergraduate Research (ACUR) in 2012.

These organizations have markedly influenced student research development within their respective borders as demonstrated through annual national student research conferences and sizeable membership enrollment (for more information about CUR, BCUR and ACUR, please refer to the following sites: https://www.cur.org/, https://bcur.org.uk/, https://www.acur.org.au/). They also have led the advancement of undergraduate research internationally. When these councils recognized the need to disseminate the value of student research scholarship globally and to promote its benefits worldwide, they joined forces to stage three World Congresses and establish the Alliance for Global Undergraduate Research (AGUR) in 2019. Figure 1 provides a historical overview of the creation of the different organizations.

The vision for staging an international student research conference began to take shape in 2001 during “The Undergraduate Students Research Symposia” at Zayed University, United Arab Emirates. However, the first discussions of an international event took place in 2010 with CUR executive leadership during the CUR Undergraduate Research Institute in Tampa, Florida in 2010. The idea was to bring together students and research mentors from all over the world to highlight the value of student research. Attending further CUR Institutes and NCUR conferences offered additional opportunities to discuss and develop the idea further. While the story of how the First World Congress came about has been well documented, (note -Rivera et al., 2018), it is important to acknowledge here that the most significant discussions were held during the April 2014 NCUR conference in Lexington, Kentucky, with Dr. Elizabeth Ambos, CUR Executive Officer; Dr. Maher Khelifa, Professor of Psychology, Qatar University; Dr. Julio Rivera, CUR President; and Dr. Stuart Hampton-Reeves, BCUR President. Following these preliminary talks, follow up emails and videoconference calls were regularly held with this core leadership group to shape the vision for the First WorldCUR. Dr. Angela Brew, ACUR Chair, joined the group in the early phases of the discussions. The WorldCUR Steering Committee was thus formed, and monthly conference calls were held until the First World Congress took place in November 2016. During the first meetings, the nature and scope of the event were considered, namely congress vs. conference. Given the global nature of the projected scientific gathering, the broader range of themes and topics to be covered, and the diverse nature of the targeted audience, the Steering Committee opted for congress rather than conference appellation. Following the event, the WorldCUR Steering Committee continued to meet to evaluate the impact of the Congress and to prepare the Second WorldCUR in Germany. Dr. Denise Wood, ACUR Vice-Chair represented ACUR at the First WorldCUR and in subsequent WorldCUR Steering Committee meetings.

The Doha Declaration: A Collaborative Vision for the Promotion of Undergraduate Research

In November 2016, Qatar University, CUR, BCUR, and ACUR organized the inaugural WorldCUR and signed the “Doha Declaration”. This Declaration was a partnership framework that led to the creation of AGUR in May 2019, an alliance for the advancement of global undergraduate research.

The “Internationalization” of student research scholarship was the driving impetus for the Doha Declaration. It broadly anticipated AGUR’s mission to “nurture and help coordinate the internationalization of undergraduate research, to facilitate the creation of new undergraduate research bodies, and to host periodic World Congresses around the world.” As it continues to develop, AGUR endeavors to stage more WorldCUR events in different parts of the world and to pursue its projected most significant role that of promoting student research globally.

Three WorldCUR Editions: A Global Undergraduate Research Presence

The First WorldCUR was held at Qatar University from November 13-16, 2016. More than 200 students, scholars, and administrators representing 12 countries, 4 continents and 56 institutions attended the event. Also in attendance were high-level representatives of CUR, BCUR, and ACUR, and a representative of the National Science Foundation, a US agency that funds fundamental research and education. The Congress offered an opportunity for undergraduate students from Australia, the Americas, Europe, the Gulf region, and the Middle East to share their research discoveries (Rivera et al. 2018). The Congress was also a forum for Councils’ delegates, faculty, and administrators from around the world to share their experiences, best practices and to work together to generate ideas for the promotion of student research globally. These encounters created a real momentum for the Congress and culminated in the historic signing of the “Doha Declaration. The First WorldCUR was also historic for planting the seed for the development of a global undergraduate research movement and the later creation of AGUR. During this Congress, the Steering Committee also approved the hosting of the Second WorldCUR by the University of Oldenburg, Germany in 2019.

In the Second WorldCUR, the momentum created by the inaugural event was noticeable with the documented significant increase in attendance of delegates and the number of oral and poster presentations (467 delegates, 252 students representing 35 countries and 98 universities). The event included 133 oral presentations and 82 poster presentations (University of Oldenburg 2019). During the Congress, the WorldCUR Steering Committee met to elect a board for the newly created “Alliance for Global Undergraduate Research.”

Building on the success of the two previous Congresses, the Third WorldCUR was jointly organized by WorldCUR and BCUR leadership and took place at the University of Warwick, UK from April 3-6, 2023. The event saw a growth in the number of participating universities and student presentations, as shown in Figure 2. It counted 440 delegates representing 101 institutions and 33 countries and included 260 presentations including spoken, exhibition, performance and poster presentations (University of Warwick 2023). The Third WorldCUR also pursued an innovative “International Student Research Projects” initiative by bringing together students based in various continents prior to the Congress to work collaboratively on a project from one of the Congress themes under the supervision of a faculty mentor. These students shared their research findings and experiences at the event.

WorldCUR, as AGUR’s flagship conference, succeeded this far to create a strong and sustained momentum for the internationalization of undergraduate research. A new request for proposals to host the Fourth WorldCUR is in progress, and AGUR looks forward to staging another global celebration of student research findings.

The Alliance for Global Undergraduate Research

The First WorldCUR was an initial effort to internationalize student research scholarship. For the first time, CUR, BCUR, and ACUR worked together with Qatar University to initiate beyond-ones-own-border reflections about student research development and promotion. These regional councils together played a historic role in creating AGUR as an international body to drive the effort of disseminating undergraduate research beyond their own geographic boundaries. The main aims of the Alliance were to promote student research globally and to connect the world through undergraduate research. During the Second WorldCUR, AGUR adopted the following important short and long-term objectives:

  1. to promote undergraduate research globally,
  2. to foster student research collaborations and partnerships around the globe,
  3. to disseminate international best practices in undergraduate research and to encourage student research scholarship,
  4. to offer summer research institutes around the globe for student research engagement,
  5. to help fund student research projects on a competitive basis,
  6. to help fund student conference attendance on a merit basis, especially students from low-and middle-income countries,
  7. to publish a student research journal,
  8. to create professional development opportunities for faculty, and
  9. to create an international network of mentors for student researchers.

Spreading the value of undergraduate research internationally is thus a core goal and a main AGUR mission. Recognizing the benefits of students’ research involvement, AGUR will endeavor to extend these formative experiences to the highest number of students around the globe.

WorldCUR Impact

Throughout its first three editions, WorldCUR sought to support the internationalization of undergraduate research and created real momenta for a sustainable global undergraduate research movement. WorldCUR reached the following goals:

  1. created occasions for undergraduate researchers to share, learn and excel through research discoveries,
  2. prompted the next generation of scholars to begin to address some of the most pressing challenges the world faces and to open scientific diaglogues for knowledge sharing and exchange,
  3. empowered undergraduate students to create international research collaborations and international connections and networks,
  4. encouraged future scientists and scholars to travel abroad out of their comfort zones, to share and learn not only about research findings but also about other people and cultures,
  5. enlarged students’ cultural experiences and awareness and removed few myths and prejudices along the way,
  6. brought mentors and key administrators together from all over the world to share research expertise and best practices.

As the literature on undergraduate student conference participation shows (Hill and Walkington 2016; Kneale et al. 2016; Mabrouk 2009; Spronken-Smith et al. 2013; Walkington, Hill, and Kneale 2017), similarly WorldCUR student participants reported many positive take-aways from their research engagement (see Khelifa 2019; Rivera et al. 2018; University of Oldenburg 2019; University of Warwick 2023). Student informal reflections (Montana State University 2016; Qatar University 2023; University of Toledo News 2016) as well as their post-WorldCUR survey responses conveyed very encouraging feedback. In general, students reported gaining in self-confidence, a heighten ability to take risks, and to connect with people from other countries. A Third WorldCUR participant captured the transformative research experience best: “Beyond the presentation I did, I connected to more new people across different disciplines and places. Connections that am very sure are for a life time and of mutual benefit. I was challenged in many ways. Listening to amazing work undergraduates are doing across the world, I was energized to do much more.” (University of Warwick 2023).

Future Perspectives

The success of the three WorldCUR iterations have so far positioned AGUR to create global undergraduate research connections for students, faculty mentors, and administrators. However, AGUR still has challenges to address in moving from a steering committee to a larger association in fulfilling its promise as a global alliance to advance undergraduate research. This will require determining its structure and member requirements, addressing organizational legal and procedural issues, and establishing an official website presence. Presently, AGUR is preparing a new call for proposals for the hosting of the next WorldCUR that will feature a new worldwide celebration of undergraduate research.

Data Availability Statement

The data, critical questions used in scripts, and instruments underlying this study are available within the text. These data were also derived from sources in the public domain [University of Oldenburg. 2019. “Looking Back Congress Impressions and Facts”, https://uol.de/fileadmin/user_upload/lehre/flif/WCUR2019/World_CUR_2019-Retrospect_web.pdf?v=1571934354; University of Warwick. 2023. “The International Conference of Undergraduate Research, https://warwick.ac.uk/fac/cross_fac/iatl/studentresearch/bcur_worldcur_2023/].

Institutional or Ethics Review Board Statement

Not required, the research did not involve human or animal participants.

Conflict of Interest Statement

The author declares having no conflicts of interest.

References

Hill, Jennifer, and Helen Walkington. 2016. “Developing Graduate Attributes through Participation in Undergraduate Research Conferences.” Journal of Geography in Higher Education 40: 222–237. doi: 10.1080/03098265.2016.1140128

Khelifa, Maher. 2019. “Qatar University Students Attend the Second World Congress on Undergraduate Research.” Qatar University Research Magazine 12: 28-30.

Kneale, Pauline, Andrew Jones, Helen Walkington, and Jennifer Hill. 2016. “Evaluating Undergraduate Research Conferences as Vehicles for Novice Researcher Development.” International Journal for Researcher Development 7: 159–177. doi: 10.1108/ijrd-10-2015-0026

Mabrouk, Patricia Ann. 2009. “Survey Study Investigating the Significance of Conference Participation to Undergraduate Research Students.” Journal of Chemical Education 86: 1335–1340. doi: 10.1021/ed086p1335

Montana State University. 2016. “Recent MSU graduate to present at World Congress on Undergraduate Research in Qatar.” Accessed December 3, 2016. https://www.montana.edu/news/16320/recent-msu-graduate-to-present-at-world-congress-on-undergraduate-researchin-qatar

Qatar University. 2023. “QU’s College of Medicine Students Participate in the World Congress on Undergraduate Research 2023” Accessed 1/11/2023. https://www.qu.edu.qa/sites/en_US/about/newsroom/CMED/QU%E2%80%99s-College-of-Medicine-Students-Participate-in-the-World-Congress-on-Undergraduate-Research-2023

Spronken-Smith, Rachel, Jason Brodeur, Tara Kajaks, Martin Luck, Paula Myatt, An Verburgh, Helen Walkington, and Brad Wuetherick. 2013. “Completing the Research Cycle: A Framework for Promoting Dissemination of Undergraduate Research and Inquiry.” Teaching and Learning Inquiry 1: 105–118. doi:10.2979/teachlearninqu.1.2.105

Rivera, Julio, Maher Khelifa, Bushra Abu Hamdah, Aisha Mohammed Al-Hamadi, and Emma S. Zdgiebloski. 2018. “A Global Conversation: Reflections from the First World Congress on Undergraduate Research.” SPUR 2(1): 55–59.

University of Oldenburg. 2019. “Looking Back Congress Impressions and Facts”. Accessed September 3, 2023. https://uol.de/fileadmin/user_upload/lehre/flif/WCUR2019/World_CUR_2019-Retrospect_web.pdf?v=1571934354

University of Warwick. 2023. “The International Conference of Undergraduate Research”. Accessed September 3, 2023. https://warwick.ac.uk/fac/cross_fac/iatl/student-research/bcur_worldcur_2023/

University of Toledo News (UTNews). 2016. “Undergraduate Student Presents Cancer Research at Global Conference.” Accessed November 21, 2016. http://utnews.utoledo.edu/index.php/11-14-2016/undergraduate-student-presents-cancerresearch-at-global-conference Billau, Christine. 2016.

Maher Khelifa
Qatar University, Maher.khelifa@qu.edu.qa

Maher Khelifa is an associate professor at Qatar University. He holds an MS and a Ph.D. from the University of Kansas. He served as assistant dean of the College of Family Sciences, Chair of the Department of Social and Behavioral Sciences, Chair of the Undergraduate Research Scholars Program, Head of the Department of Social Sciences, and Chair of Qatar University Undergraduate Student Research Committee. Maher is currently the Chair of the Alliance for Global Undergraduate Research.

Undergraduate Research in Humanities, Arts, and Social Sciences: Helping Students Navigate Uncertainty and Build Community through a Structured Cohort-Based Program

Undergraduate Research in Humanities, Arts, and Social Sciences: Helping Students Navigate Uncertainty and Build Community through a Structured Cohort-Based Program

Recommended Citation: Toven-Lindsey, Brit, Erin M. Sparck, Kelly Kistner, Jacquelyn Ardam, Whitney Arnold. 2023. Undergraduate Research in Humanities, Arts, and Social Sciences: Helping Students Navigate Uncertainty and Build Community through a Structured Cohort-Based Program. Scholarship and Practice of Undergraduate Research 7 (2): 15-24. https://doi.org/10.18833/spur/7/2/2


Undergraduate research experiences are an important component of an undergraduate education for many students and can have wide-ranging benefits, including gaining new knowledge about the scientific method and research procedures (Craney et al. 2011; Kistner et al. 2021); critical thinking skills (Brownell et al. 2015); persistence in their undergraduate major (Craney et al. 2011); and entry into graduate school (Wilson et al. 2018). These benefits are particularly important for students from minority groups who have often been excluded from these high-impact and immersive learning opportunities (Estrada, Hernandez, and Schultz 2018; Hernandez et al. 2018). Additionally, undergraduate research participation has been shown to support students’ identity development (Palmer et al. 2015; Robnett, Chemers, and Zurbriggen 2015) and sense of belonging on campus (Miller, Williams, and Silberstein 2019).

Yet the literature on benefits of undergraduate research has been primarily focused on students in science, technology, engineering, and math (STEM) fields, leaving a gap in knowledge about research programs focused specifically on the needs of students in humanities, arts, and social sciences (HASS; Craney et al. 2011; Haeger et al. 2020). Whereas undergraduate research in STEM fields is often highly structured and guided by faculty and graduate mentors, students’ independent research experiences in HASS fields can be more variable, with differing amounts of oversight, structure, and training (Craney et al. 2011). Further, there may be limited incentives for faculty across disciplines to dedicate time and energy to mentoring undergraduate researchers (Becker 2020; Webber, Nelson Laird, and BrckaLorenz 2013), indicating a need for institutional resources and support.

In this study the authors examine student learning experiences in the Undergraduate Research Fellows and Scholars Programs (URFP and URSP, hereafter referred to as URP) at the University of California Los Angeles (UCLA), which supports students performing a multiquarter research or creative project each year under the mentorship of a faculty member on campus. Previous research on URP highlights numerous learning and career outcomes. Students report that these programs advance their critical thinking and problem-solving skills, professionalism, and written and oral communication skills (Kistner et al. 2021), and that they help students develop faculty mentorship and peer networks (Arnold et al. forthcoming).

Structured programs like URP create more standardized pathways to research and in turn increase access to research opportunities for diverse groups of students, but further study is needed to examine how students conceptualize their learning and advancement as researchers during their undergraduate years. To build upon previous findings and contribute to the literature on programs for students conducting research in HASS fields, this study aimed to better understand student experiences in URP and how structured research programs help students build confidence in their research skills and connections to the community of scholars in their field.

Literature

Participation in undergraduate research provides students with opportunities to learn about the disciplinary norms and the ways of thinking and practices in a particular field (Barker 2009; Hall et al. 2021; Hunter, Laursen, and Seymour 2007). Students participating in guided research gain confidence, critical thinking and technical skills, and clarification of their future career aspirations (Hunter et al. 2007; Thiry, Laursen, and Hunter 2011); have the chance to see faculty model a particular version of learning and inquiry (Palmer et al. 2015; Palmer et al. 2018); and gain methodological and technical proficiency in their field (Feldman, Divoll, and Rogan-Klyve 2013). Yet, although many outcomes of undergraduate research benefit students across disciplines, there are differences in student goals and needs.

In their study of cross-disciplinary perspectives of undergraduate research, Craney and colleagues (2011) found that students in social sciences and humanities highly valued producing papers and publications as a primary outcome of their research experience, whereas students in STEM fields were more likely to value gains in specific technical skills. Further, students in HASS fields were more likely to pursue a research project that interested them than STEM students, and they also were more likely to be conducting research on their own and not together with their peers (Craney et al., 2011).

These findings point to the unique needs and interests of students conducting research in HASS fields, and the importance of considering the role of academic discipline in designing undergraduate research programs. Further, students can often feel disconnected from the research activities of their university (Palmer et al. 2015) and face barriers to accessing hands-on learning experiences. As a large, public research-intensive institution with a diverse student population, UCLA provides opportunities for many students to engage in cutting-edge research. Yet, accessing undergraduate research experiences can be challenging when one considers the wide range of academic programs and complex network of research activities. Students may lack the research capital (defined as “the economic, social, and cultural capital that influence students’ paths to engaging in undergraduate research”; Cooper, Cala, and Brownell 2021, 4) to navigate these unfamiliar pathways at undergraduate institutions (Ovink and Veazey 2011).

To broaden access and help students navigate the research process, many campuses have developed undergraduate research centers and programs, with the majority focused primarily on (and established to support) STEM students. Well-structured research programs have been shown to support retention of minority students in STEM, in particular, and to help increase a sense of belonging through components such as faculty mentoring and early exposure to research (Carter, Mandell, and Maton 2009; Chang et al. 2014; Sellami et al. 2021). In a study of the McNair Scholars Program focused on the experiences of 13 Black students, Clayton, Breeden, and Davis (2023) found that participation in undergraduate research helped students, most of whom were in HASS majors, build confidence capital through hands-on research and exploring graduate school opportunities, sharing their research at conferences and meetings, and building a network of mentors and peers. Further, faculty mentorship was an important component of students’ growth as scholars and of building confidence to navigate academic spaces and graduate school applications (Clayton et al. 2023). Many of these programs are highly structured and guide small cohorts of students through the process of accessing and participating in undergraduate research. Undergraduate research centers and programs like URP can help broaden participation and combat perceptions about the exclusivity of research by offering more direct and accessible pathways into a wider range of undergraduate research experiences (Haeger et al. 2021).

Methods

Research Setting

UCLA is a highly selective research-intensive university in southern California that enrolls more than 6,000 first-year students and 3,500 transfer students each year. Approximately 30 percent of incoming first-year students and 34 percent of incoming transfer students in fall 2022 were students from minority racial and ethnic groups, and 27 percent and 43 percent of these groups, respectively, were first-generation undergraduate students. UCLA is a research-intensive institution, and many undergraduates participate in guided research experiences. According to data from the UCLA College Senior Survey (UCLA 2023) collected from 2014 to 2022 (N = 50,829), around 30 percent of respondents, regardless of major, assisted faculty with research on a voluntary basis (these experiences may offer students course credit), and 47 percent collaborated with peers on a course-based research project. Although these numbers do not capture the full range of research engagement, it does indicate that research is an important component of UCLA students’ undergraduate experience.

Undergraduate Research Fellows and Scholars Program

The UCLA Undergraduate Research Center for Humanities, Arts, and Social Sciences (URC-HASS) was established in 1998 with a primary mission of promoting, developing, and celebrating undergraduate student research and creative inquiry, while also enhancing undergraduate education and preparing students for careers in all areas. URC-HASS supports students with a wide range of programs and services, including research courses and resources, campus-wide events and programming, and scholarships. One set of programs, the Undergraduate Research Fellows and Scholars Programs, provides financial support for students to do multiquarter research or creative projects under the mentorship of a UCLA faculty member.

Students in both programs enroll in a research contract course for credit with their faculty mentor, receive a scholarship, and present their work during the annual Undergraduate Research Week. Students in the Undergraduate Research Fellows Program additionally participate in a research and professional development course taught by faculty in URC-HASS. Through these and other activities, students receive guidance from URC-HASS graduate research mentors and build community with their peers. The Undergraduate Research Scholars program is reserved for more advanced students (third- and fourth-year students) who are completing a comprehensive independent research project, honors thesis, or capstone. Although these students do not enroll in the research and professional development course, they can still meet with graduate mentors, participate in workshops, and present during the campus research week. Hereafter, data from these programs will be combined, and they will be referred to as the Undergraduate Research Programs (URP).

Data Collection and Analysis

This study draws on data from numerous sources to better understand the experiences of students who participated in URP from 2015 to 2022 (N = 483). To better understand the landscape of undergraduate experiences at UCLA, this study includes participating students’ responses to the Senior Survey (N = 208). Specifically, coded data from open-ended responses to the question: “What was your most meaningful learning experience at UCLA?” were analyzed. Additionally, all students participating in URP were invited to complete a survey at the beginning and end of the program (N = 431 matched responses). Table 1 provides an overview of select student background characteristics for all URP students and those who completed the pre- and post-surveys, including gender, transfer student status, and identification as a member of a minority racial/ethnic group.

All students participating in URP are invited to complete a survey about their experiences at the beginning and end of the program. Although the survey is designed to capture shifts in student perceptions and attitudes about research during the program, students do enter these programs with varying levels of experience with conducting research. Select survey questions were included for analysis, including those focused on students’ individual research projects, the research community at UCLA, and specific components of URP, as well as open-ended responses to the question: “What has been most helpful about [URP]?” (N = 403; see Table 2). Finally, students in the 2021–2022 cohorts of URP submitted reflection memos (N = 54) focused on their experiences in the program and conducting their research projects.

Program surveys were analyzed using descriptive statistics and paired samples t tests of significance in SPSS. Students’ open-ended responses and reflection memos were analyzed using Dedoose qualitative coding software. Thematic analysis of reflection memos and open-ended questions was guided by existing literature on outcomes of undergraduate research, including skill development, faculty mentorship, barriers to engagement, and identity development (e.g., Craney et al. 2011; Kistner et al. 2021; Palmer et al. 2015). Researchers began coding with these a priori themes, and student comments also produced emergent themes, such as a sense of ownership and agency related to their research projects (Maxwell 2013; Saldaña 2013). Codes were developed and tested by multiple researchers in an iterative process across multiple terms for open-ended responses to establish a final codebook.

Findings

Structure, Peer Networks, and Support for Research

Paired samples t tests for pre- and post-survey responses indicated that students received needed support and resources in URP to successfully conduct their research projects (see Table 3). Specifically, the majority of students reported that the resources and tools provided by URP helped them with their research project (mean = 4.28, SD = 0.78 at post; p < .001) and that they learned new research skills as part of the program (mean = 4.34, SD = 0.81 at post; p < .001). Students also reported that participating in URP contributed to their interest in research (mean = 4.25, SD = 0.92 at post; p < .001). Additional mean score comparisons by gender, race/ethnicity, and transfer status did not result in significant differences between groups.

Students’ open-ended responses about those features of URP that were most helpful further illuminated these findings (N = 403; see Table 4). The most prominent themes about helpful aspects of the program included: (1) the structure, guidance, and accountability of URP (173 coded excerpts); (2) program funding and course credit give students the flexibility to focus on their research project (109 coded excerpts); (3) support and community from peers (93 coded excerpts); (4) mentorship and guidance from graduate mentors and program staff (75 coded excerpts); and (5) the positive environment and supportive culture of the program in general (69 coded excerpts).

Regarding the overall structure and accountability that the program offered, one student commented, “[URP] has given me a clear direction as to how I can initiate and execute a research project.” Another said, “The most helpful aspect has been the structure and encouragement—I don’t think I would have initiated this student project without the program’s existence.” URP offered students different options for formal programming and structure to meet their needs, from weekly class meetings that introduced students to best practices and campus resources for research to drop-in workshops and mentor check-ins for more advanced students, and these findings indicated that all students benefited from the ongoing support and accountability built into these programs.

Program funding was also crucial for many students. As one student put it, “As a first-generation low-income student I have always had to work … [URP] gave me the opportunity to focus on research and decrease[d] financial stressors.” The structure and stipend of URP helped students gain new skills, stay on track, and focus their energy in ways that pushed their research projects forward.

Scholarly Community

Building connections and a sense of belonging in the research community is an important outcome of undergraduate research experiences (e.g., Museus, Yi, and Saelua 2017; Palmer et al. 2015). Analysis of responses to program surveys at the beginning and end of URP indicated that students made significant gains in their identity as members of the research community at UCLA during the program. As Table 5 indicates, students reported significant gains in (1) their feelings about being a valued member of the UCLA research community; (2) developing a sense of community with faculty and peers; and (3) presenting at academic conferences and/or publishing in an academic journal, all as a result of their participation in URC. Additionally, students indicated that one of the reasons they chose to conduct research in URP was because they saw their peers engaged in research (pre-survey mean = 2.994, post-survey mean = 3.186; p < .001).

Two of the major themes that emerged from the analysis of reflection memos (N = 54) were students’ (1) sense of agency and ownership of their research projects (N = 33 participants); and (2) sense of belonging in the community of scholars at UCLA (N = 29 participants; see Table 6). More than 20 percent of students (N = 12) addressed both of these themes in their reflections, indicating that a strong sense of ownership of their research project also may have contributed to their sense of belonging in the research community. As one transfer student majoring in art said, “What feels most rewarding is having the support and encouragement to ask questions that deeply matter to me . . . the kind of total autonomy to choose a topic and my level of personal investment is creating a different kind of experience.” Another student majoring in psychology stated, “[URP] has also allowed me to gain a better understanding of my place at UCLA as a researcher … Being a transfer student, I started to have imposter syndrome and was worried about how I would fit in at UCLA … Being a part of [URP] showed me that I belong here and faculty members see my worth.” As these comments illustrate, having the opportunity to design and conduct their own projects helped students not only develop technical skills, but also confidence in their abilities and identity as a researcher.

Academic Journey

Nearly all students who participated in URP completed the UCLA College Senior Survey, and 208 commented on their most meaningful learning experiences. Nearly 40 percent of students talked about undergraduate research as one of these important learning experiences (N = 81). About their experience in URP, one student commented, “I am able to learn research skills and gain opportunities to get in touch with the research community, which motivates me to continue doing research in the future and to pursue a higher degree in psychology.” Another said, “My most meaningful experience was meeting my current graduate mentor and having the opportunity to participate in research programs to present my research at various conferences. It was something I never imagined I would do.” As these students indicated, being involved in research as an undergraduate offered students a chance to gain new skills and knowledge, and to build confidence in their abilities.

Responses to the URP program survey indicated that students felt a sense of ownership and connection to their research projects. In the post-survey, 95.6 percent of students agreed or strongly agreed that their research project built on their academic interests (N = 424); 91.2 percent indicated that they had initiated and designed their project (N = 416); and 93.7 percent said that their project exposed them to new areas of intellectual curiosity (N = 420).

Analysis of student reflection memos indicated that participating in URP helped them build skills that were relevant not only to their research projects but to their academic journey more broadly. Specifically, two major themes related to students’ skill development included: (1) gains in specific research skills such as data analysis and reviewing literature and sources (N = 54 coded excerpts); and (2) time management (N = 43 coded excerpts). With regard to gaining new research skills, one student who was majoring in human biology and society commented, “I had a very cookie-cutter understanding of research as this structured way of knowing . . . I now understand that conducting my own research is a two-way street that allows me to reverse and revisit my thoughts to strengthen my work.” Another transfer student majoring in psychology reported, “Thanks to this class I was able to make informed adjustments to my research and improve upon the method.” Students also talked about the ways that being part of URP helped them improve their time management skills. Developing these skills helped them successfully complete their research projects, and students also described their relevance for other courses and graduate school and career planning.

Discussion

Our findings indicate that, by offering a wide range of programs and services that aim to meet students’ needs at different stages in their academic journey, URC-HASS is helping students build confidence in their abilities as researchers and gain a greater sense of connection to the community of scholars at UCLA. Feeling connected to their academic discipline and institution has been shown to support student success and engagement (Museus et al. 2017). Further, URP has been shown to help students develop confidence in their skills as researchers, including critical thinking and problem solving, professionalism, and communication (Kistner et al. 2021).

Both survey and reflection data indicate that having a sense of ownership and agency related to their research project was an important component of the URP experience for many students, which aligns with the structure of undergraduate research in HASS fields in which students initiate independent projects and seek out a faculty mentor. These findings are similar to those of previous research on supporting student motivation and engagement in academic tasks associated with mastery goals, individual choice, and connecting to students’ interests (e.g., Cavagnetto et al. 2020; Crowe and Boe 2019; Trevino and DeFreitas 2014). They also point to differences between undergraduate research experiences in HASS and STEM fields that warrant further exploration.

Reflection data also indicates that the sense of ownership and the ability to complete their own research study influenced students’ shifting attitudes about their membership in the research community at UCLA. Even though students faced challenges with data collection and analysis and the solitary nature of conducting an independent research project, URP facilitated consistent mentorship from staff in URC-HASS and encouraged greater communication with their faculty adviser. Building relationships with faculty mentors has been shown to positively influence students’ feelings of acceptance and belonging on campus (Miller et al. 2019). These mentor relationships help students gain knowledge about research procedures and norms in their field and as well help them build confidence in their research skills and competencies (Davis and Jones 2020; Hunter et al. 2007).

Students conducting research in HASS fields benefited from the structure, accountability, mentorship, and community offered by URP. For students who are often engaged in more independent research projects of their own design, URP offers needed training in developing skills and strategies for time management and project planning, communicating with mentors, and finding campus resources, all of which help students successfully complete their projects. Further research is needed to better understand the unique experiences of students from different racial groups, transfer students, first-generation undergraduate students, and students across disciplinary groups.

Students also built strong relationships with mentors and peers through regular interactions and meetings, and by sharing their projects during Undergraduate Research Week. These findings are in line with previous research indicating that cohort-based research programs support students in connecting with faculty and peers and build confidence for pursuing research and graduate school (Clayton et al. 2023; Eagan et al. 2013). Nevertheless, more research is needed to understand the relationship between students and their faculty mentors, and how the structure and training offered by URP helps support faculty mentors in HASS fields. With limited incentives and support for faculty mentors and greater variability in project methods and students’ preparation to conduct research in these fields, research programs like URP serve an important role in guiding students through the research process and helping them cultivate strong working relationships with their faculty mentors (Davis et al. 2020).

Finally, the findings indicated that by offering outreach, training, and funding for research, URC-HASS is broadening participation in undergraduate research. Comments from transfer students, in particular, who are less likely to participate in undergraduate research (Chamely-Wiik et al. 2021), about their experience getting connected to URP and conducting an independent study highlight the benefits of structured research programs and funding that can be accessed by all students.

Implications

Through ongoing assessment efforts, leadership in URC-HASS have gained insights about student experiences with the wide range of research programs offered by the center and have made efforts to continually improve the URP for all students. Best practices for designing undergraduate research programs that provide structure beyond the faculty-student mentorship dyad might include: (1) offering skills-based workshops on topics such as communicating with your mentor, collecting sources, time management, giving oral presentations, and applying to graduate school; (2) research-related assignments such as annotated bibliographies and abstracts with regular due dates; and (3) creating opportunities to present work in progress (e.g., colloquiums, workshops) as well as students’ final research projects (e.g., Undergraduate Research Week). Importantly, using a cohort-based model, as URP does, helps to encourage peer support and networking opportunities, as do mentorship and individualized support from staff and graduate students leading the program. Finally, offering funding for research programs in which students will be doing original research helps to broaden access, particularly for lower-income and first-generation undergraduate students, and offers students greater flexibility and time to focus on their projects.

Conclusion

Investing resources in programs such as those offered by URC-HASS is a worthwhile pursuit that can help create consistency in mentorship, preparation, and accountability for students and streamline the training of research skills that support faculty mentors. Tailoring these efforts to the needs of HASS students helps them build confidence, a sense of ownership, and a connection to the research community, creating a richer undergraduate experience.

Institutional Review Board

All research protocols involving human subjects were reviewed and approved by the Institutional Review Board at the University of California Los Angeles (#18-001292).

Conflict of Interest

The authors declare that they have no conflicts of interest.

Data Availability

The data underlying this study are not publicly available due to the procedures for data collection approved in the UCLA IRB protocol for this study.

References

Arnold, Whitney, Kelly Kistner, Erin M. Sparck, and Marc Levis-Fitzgerald. Forthcoming. “Academic Growth and Professional Development through Undergraduate Humanities Research.” Profession.

Barker, Lecia. 2009. “Student and Faculty Perceptions of Undergraduate Research Experiences in Computing.” ACM Transactions on Computing Education 9(1): 1–28.

Becker, Megan. 2020. “Importing the Laboratory Model to the Social Sciences: Prospects for Improving Mentoring of Undergraduate Researchers.” Journal of Political Science Education 16: 212–224.

Brownell, Sara E., Daria S. Hekmat-Scafe, Veena Singla, Patricia Chandler Seawell, Jamie F. Conklin Imam, Sarah L. Eddy, Tim Stearns, and Martha S. Cyert. 2015. “A High-Enrollment Course-Based Undergraduate Research Experience Improves Student Conceptions of Scientific Thinking and Ability to Interpret Data.” CBE–Life Sciences Education 14(2): ar 21.

Carter, Frances D., Marvin Mandell, and Kenneth I. Maton. 2009. “The Influence of On-Campus, Academic Year Undergraduate Research on STEM PhD Outcomes: Evidence from the Meyerhoff Scholarship Program.” Educational Evaluation and Policy Analysis 31: 441–462.

Chamely-Wiik, Donna, Evelyn Frazier, Daniel Meeroff, Jordan Merritt, Jodiene Johnson, William R. Kwochka, Alison I. Morrison-Shetlar, Michael Aldarondo-Jeffries, and Kimberly R. Schneider. 2021. “Undergraduate Research Communities for Transfer Students: A Retention Model Based on Factors That Most Influence Student Success.” Journal of the Scholarship of Teaching and Learning 21(1).

Chang, Mitchell J., Jessica Sharkness, Sylvia Hurtado, and Christopher B. Newman. 2014. “What Matters in College for Retaining Aspiring Scientists and Engineers from Underrepresented Racial Groups.” Journal of Research in Science Teaching 51: 555–580.

Clayton, Ashley B., Roshaunda L. Breeden, and Tiffany J. Davis. 2023. “‘My Entire Support System for Graduate School’: Black Students’ Experiences in a McNair Scholars Program.” Journal of College Student Retention: Research, Theory & Practice. doi: 10.1177/15210251231182683

Cooper, Katelyn M., Jacqueline M. Cala, and Sara E. Brownell. 2021. “Cultural Capital in Undergraduate Research: An Exploration of How Biology Students Operationalize Knowledge to Access Research Experiences at a Large, Public Research–Intensive Institution.” International Journal of STEM Education 8: 1–17.

Craney, Chris, Tara McKay, April Mazzeo, Janet Morris, Cheryl Prigodich, and Robert De Groot. 2011. “Cross-Discipline Perceptions of the Undergraduate Research Experience.” Journal of Higher Education 82: 92–113.

Crowe, Jessica, and Austin Boe. 2019. “Integrating Undergraduate Research into Social Science Curriculum: Benefits and Challenges of Two Models.” Education Sciences 9: 296.

Davis, Shannon N., Pamela W. Garner, Rebecca M. Jones, and Duhita Mahatmya. 2020. “The Role of Perceived Support and Local Culture in Undergraduate Research Mentoring by Underrepresented Minority Faculty Members: Findings from a Multi-Institutional Research Collaboration.” Mentoring & Tutoring: Partnership in Learning 28: 176–188.

Davis, Shannon N., and Rebecca M. Jones. 2020. “The Genesis, Evolution, and Influence of Undergraduate Research Mentoring Relationships.” International Journal for the Scholarship of Teaching and Learning 14(1): ar 6.

Eagan, M. Kevin Jr, Sylvia Hurtado, Mitchell J. Chang, Gina A. Garcia, Felisha A. Herrera, and Juan C. Garibay. 2013. “Making a Difference in Science Education: The Impact of Undergraduate Research Programs.” American Educational Research Journal 50: 683–713.

Estrada, Mica, Paul R. Hernandez, and P. Wesley Schultz. 2018. “A Longitudinal Study of How Quality Mentorship and Research Experience Integrate Underrepresented Minorities into STEM Careers.” CBE–Life Sciences Education 17(1): ar 9.

Feldman, Allan, Kent A. Divoll, and Allyson Rogan-Klyve. 2013. “Becoming Researchers: The Participation of Undergraduate and Graduate Students in Scientific Research Groups.” Science Education 97: 218–243.

Haeger, Heather, John E. Banks, Camille Smith, and Monique Armstrong-Land. 2020. “What We Know and What We Need to Know about Undergraduate Research.” Scholarship and Practice of Undergraduate Research 3(4): 62–69.

Haeger, Heather, Corin White, Shantel Martinez, and Selena Velasquez. 2021. “Creating More Inclusive Research Environments for Undergraduates.” Journal of the Scholarship of Teaching and Learning 21(1).

Hall, Eric, Elizabeth Bailey, Simon Higgins, Caroline Ketcham, Svetlana Nepocatych, and Matthew Wittstein. 2021. “Application of the Salient Practices Framework for Undergraduate Research Mentoring in Virtual Environments.” Journal of Microbiology and Biology Education 22(1): 22.1.92. doi: 10.1128/jmbe.v22i1.2287

Hernandez, Paul R., Anna Woodcock, Mica Estrada, and P. Wesley Schultz. 2018. “Undergraduate Research Experiences Broaden Diversity in the Scientific Workforce.” BioScience 68: 204–211.

Hunter, Anne-Barrie, Sandra L. Laursen, and Elaine Seymour. 2007. “Becoming a Scientist: The Role of Undergraduate Research in Students’ Cognitive, Personal, and Professional Development.” Science Education 91: 36–74.

Kistner, Kelly, Erin M. Sparck, Amy Liu, Hannah Whang Sayson, Marc Levis-Fitzgerald, and Whitney Arnold. 2021. “Academic and Professional Preparedness: Outcomes of Undergraduate Research in the Humanities, Arts, and Social Sciences.” Scholarship and Practice of Undergraduate Research 4(4): 3–9.

Kistner, Kelly, Erin Sparck, Brit Toven-Lindsey, Marc Levis-Fitzgerald, and Whitney Arnold. 2023. “Undergraduate Research in the Humanities, Arts, and Social Sciences: Alumni Personal and Professional Outcomes.” Poster presentation at 2023 AAC&U Conference on General Education, Pedagogy, and Assessment, New Orleans, LA.

Maxwell, Joseph A. 2013. Qualitative Research Design: An Interactive Approach. 3rd ed. Thousand Oaks, CA: Sage.

Miller, Angie L., Latosha M. Williams, and Samantha M. Silberstein. 2019. “Found My Place: The Importance of Faculty Relationships for Seniors’ Sense of Belonging.” Higher Education Research & Development 38: 594–608.

Museus, Samuel D., Varaxy Yi, and Natasha Saelua. 2017. “The Impact of Culturally Engaging Campus Environments on Sense of Belonging.” Review of Higher Education 40: 187–215.

Ovink, Sarah M., and Brian D. Veazey. 2011. “More Than ‘Getting Us Through’: A Case Study in Cultural Capital Enrichment of Underrepresented Minority Undergraduates.” Research in Higher Education 52: 370–394.

Palmer, Ruth J., Andrea N. Hunt, Michael Neal, and Brad Wuetherick. 2015. “Mentoring, Undergraduate Research, and Identity Development: A Conceptual Review and Research Agenda.” Mentoring & Tutoring: Partnership in Learning 23: 411–426.

Palmer, Ruth J., Andrea N. Hunt, Michael R. Neal, and Brad Wuetherick. 2018. “The Influence of Mentored Undergraduate Research on Students’ Identity Development.” Scholarship and Practice of Undergraduate Research 2(2): 4–14.

Robnett, Rachael D., Martin M. Chemers, and Eileen L. Zurbriggen. 2015. “Longitudinal Associations among Undergraduates’ Research Experience, Self-Efficacy, and Identity.” Journal of Research in Science Teaching 52: 847–867.

Saldaña, J. 2013. The Coding Manual for Qualitative Researchers. 2nd ed. Thousand Oaks, CA: Sage.

Sellami, Nadia, Brit Toven-Lindsey, Marc Levis-Fitzgerald, Paul H. Barber, and Tama Hasson. 2021. “A Unique and Scalable Model for Increasing Research Engagement, STEM Persistence, and Entry into Doctoral Programs.” CBE–Life Sciences Education 20(1): ar 11.

Thiry, Heather, Sandra L. Laursen, and Anne-Barrie Hunter. 2011. “What Experiences Help Students Become Scientists? A Comparative Study of Research and Other Sources of Personal and Professional Gains for STEM Undergraduates. Journal of Higher Education 82: 357–388.

Trevino, Naomi Noel, and Stacie Craft DeFreitas. 2014. “The Relationship between Intrinsic Motivation and Academic Achievement for First Generation Latino College Students.” Social Psychology of Education 17: 293–306.

University of California Los Angeles (UCLA). 2023. “The UCLA College of Letters and Science Reflecting on the UCLA Experience.” UCLA College Senior Survey. https://www.college.ucla.edu/seniorsurvey

Webber, Karen L., Thomas F. Nelson Laird, and Allison M. BrckaLorenz. 2013. “Student and Faculty Member Engagement in Undergraduate Research.” Research in Higher Education 54: 227–249.

Wilson, Alan E., Jenna L. Pollock, Ian Billick, Carmen Domingo, Edna G. Fernandez-Figueroa, Eric S. Nagy, Todd D. Steury, and Adam Summers. 2018. “Assessing Science Training Programs: Structured Undergraduate Research Programs Make a Difference.” BioScience 68: 529–534.

Brit Toven-Lindsey
University of California Los Angeles,
btovenlindsey@teaching.ucla.edu

Brit Toven-Lindsey is a postdoctoral scholar at the Center for Educational Assessment at UCLA. She earned her PhD in education from the UCLA School of Education and Information Studies. Toven-Lindsey’s research interests focus on giving voice to the diverse experiences of learners and educators, and the ways that more inclusive and equitable pedagogical approaches, campus policies, and learning environments can support student achievement, learning, and persistence.

Erin Sparck is a postdoctoral scholar at the Center for Educational Assessment at UCLA. Sparck received her PhD in psychology from UCLA. Her research interests focus on the application of cognitive psychology to educational practice, including how to improve learning through effective testing and how to improve learners’ metacognitive awareness of effective study.

Kelly Kistner is the assistant director of the Undergraduate Research Center for Humanities, Arts, and Social Sciences at UCLA. She earned her PhD in sociology from the University of Washington in Seattle. Her research and publications have centered on the history and sociology of knowledge production. Kistner oversees the Research Revealed Program and Aleph Undergraduate Research Journal. She also is involved in the center’s planning, outreach, and assessment activities.

Jacquelyn Ardam is the director of the Undergraduate Research Center for Humanities, Arts, and Social Sciences at UCLA. She holds a PhD in English from UCLA and is the author of Avidly Reads Poetry (NYU Press, 2022). Her writing on literature, art, pedagogy, and culture has been published in a number of academic and public venues. At UCLA, Ardam is particularly interested in increasing the accessibility of undergraduate research experiences and creating entry-level programs for new researchers across the humanities, arts, and social sciences.

Marc Levis-Fitzgerald heads the UCLA Center for Educational Assessment, staffed by researchers with backgrounds in education, sociology, psychology, and chemistry. He received a PhD in higher education at UCLA. Levis-Fitzgerald’s research interests include curriculum reform and evaluation, student and faculty development and institutional transformation. He is particularly interested in documenting the experiences of undergraduate and graduate students and directs the development and implementation of the UCLA Senior Survey.

Whitney Arnold is an assistant professor of comparative literature and medicine at UCLA. She served as the director of the Undergraduate Research Center for Humanities, Arts, and Social Sciences at UCLA from 2013 to 2022 Arnold’s research and publications focus on self-narratives and autobiographical texts, narratives of health and illness, theories of self-representation, and literary history.

Quantitative Methods in the Assessment of Undergraduate Research, Scholarship, and Creative Inquiry

Quantitative Methods in the Assessment of Undergraduate Research, Scholarship, and Creative Inquiry

Recommended Citation: Lopatto, David. 2023. Quantitative Methods in the Assessment of Undergraduate Research, Scholarship, and Creative Inquiry. Scholarship and Practice of Undergraduate Research 7 (2): 5-12. https://doi.org/10.18833/spur/7/2/3


SPUR represents the philosophy of the Council on Undergraduate Research (CUR) to support and promote high-quality mentored undergraduate research, scholarship, and creative inquiry. Readers of SPUR approach the journal hoping to find model programs, good ideas, and the characteristics or causes of successful undergraduate research programs. The dual goals of SPUR, according to LaPlant (2017), are to “stimulate the rigorous assessment of undergraduate research initiatives and programs” and “that SPUR will encourage best practices and models of undergraduate research” (3) Consideration of these goals leads to two views of the use of quantitative methods. Whereas rigorous assessment evokes ideas concerning statistical comparison and control of confounding variables to clarify a theory of undergraduate research, scholarship, and creative inquiry (URSCI) and its effects on student behavior, finding model programs suggests that programs may be emulated across institutions by educators who are free to change support factors to facilitate the program’s success. In the first case the goal is generalizability; in the second the goal is transferability.

The focus of this commentary is on the use of quantitative research methods in the understanding and assessment of undergraduate research, scholarship, and creative inquiry. The Council on Undergraduate Research has a broad definition of undergraduate research (a mentored investigation or creative inquiry conducted by undergraduates that seeks to make a scholarly or artistic contribution to knowledge), meant to include all scholarly disciplines and interdisciplines. It is necessary to acknowledge that disciplinary pluralism implies epistemological pluralism. The assessment of some undergraduate research programs may rely on the qualitative methods suitable for the nature of the program. For example, Naepi and Airini (2019) described the Knowledge Makers program used to mentor Indigenous researchers and evaluated the impact of the program through e-portfolios and student reflections without the use of quantitative data. Zhen (2020) described a program for teaching chefs to be researchers and presented a summary of successful projects as well as a sample of visual evidence (a photograph) in support of the program’s effectiveness. The observations regarding quantitative methods that follow are not intended to privilege quantitative methods over other epistemologies.

Finding model (exemplary) programs suggests that the authors of many of this journal’s reports are advocating causes (the URSCI mission) as well as investigating causes. CUR’s mission attracts the interest of teacher-scholars whose strategic aim is not one of complete disinterest or impartiality. They want the promise of undergraduate research to succeed. SPUR reports are often composed by mentors, instructors, and program directors who have a stake in the success of their program and the broader mission of CUR. The challenge is to practice impartiality when analyzing undergraduate research programs, and it is in this endeavor that quantitative methods may help. Quantitative methodology comprises conventions for best practices that enhance credibility, such as rules applying to the size and scope of an adequate sample and decision rules for what constitutes “statistical significance.” The promise of quantitative methods is that they permit tactics for evaluation that are objective employed by teacher-scholars who have objectives.

Although textbooks about quantitative methods suggest that a research plan should precede the selection of appropriate measures, it appears that educational researchers rely on available measures of program effectiveness such as student grade point average (GPA), graduation rates, or completion rates. The advantages and disadvantages of these measures are familiar. Institutional measures such as the GPA are routinely collected, and archives are readily available. Although most researchers recognize that grade point averages comprise a heterogeneous mix of course selection, degree of difficulty, and other confounds, the archive continues to be employed in assessment and evaluation (Brown et al. 2020; Nicols-Grinenko et al. 2017; Sell, Naginey, and Stanton 2018). In this selection of a measure, familiarity breeds contentment. Reliance on one imperfect measure is a risky method; however, there is a remedy. The methodology of multioperationalism (Cook and Campbell 1979; Webb et al. 1981) suggests that multiple measures may align to support the argument for the benefits of an URSCI program. Therefore analyzing the GPA and another measure such as student survey responses may strengthen the argument for program effectiveness.

Research Questions

The dual targets of CUR’s mission suggest dual research goals. Consistent with the rigorous assessment of undergraduate research initiatives, Haeger et al. (2020) suggest that the key research question for the study of URSCI is to explicate the causal relationship between URSCI and the various outcomes that have been attributed to the experience (e.g., Lopatto 2004). Haeger et al. observe that quantifying the effects of URSCI has been a challenge, writing that “the majority of research measuring the impact of undergraduate research relies on indirect measures or correlations between outcomes and participation” (67) SPUR also promotes the sharing of models of undergraduate research, inviting the transfer of a model program to new settings even though the underlying causal model is not known. Causal models and model programs are not the same and may afford different sorts of quantitative analysis.

Simplicity

When deploying quantitative methods for purposes of describing or evaluating URSCI, it is tempting to bring to bear the full persuasive impact of sophisticated methods used to uncover latent variables, account for more multiple factors and their interactions, and seek an elusive generalizability of the pedagogy’s effects. There is value in choosing a more modest approach. Experienced researchers caution us that “less is more.” Cohen (1990), writing about psychology, advocated simplicity in research designs, citing the problems that accompany complexity, including poor statistical power (the probability of finding an effect if it exists) and the increase in misleading conclusions of statistical significance when the number of tests increases. Kass et al. (2016) included “keep it simple” in their advice regarding effective statistical practice in computational biology. They wrote, “the principle of parsimony can be a trusted guide: start with simple approaches and only add complexity as needed, and then only add as little as seems essential” (4) Abelson (1995) wrote, “Data analysis should not be pointlessly formal. It should make an interesting claim . . . and do so by intelligent interpretation of appropriate evidence from empirical measurements or observations.” In support of interesting claims authors often use familiar quantitative methods even if the disciplinary focus of the undergraduate research program is complex. For example, the SPUR issue for summer 2019 highlighted programs that featured undergraduate research experiences using big data (large databases and data visualization). None of the featured programs employed big data techniques to evaluate the program’s outcomes. Some reports favored descriptive statistics (Killion, Page, and Yu 2019; Lukes et al. 2019). Others favored descriptions of the program’s development or evolution without quantitative evaluation (Nelson, Yusef, and Cooper 2019). It may be that even as URSCI programs grow to embrace contemporary topics such as machine learning, digital humanities, and artificial intelligence the quantitative methods by which the programs are assessed remain relatively simple. Simple analyses include the t test, which was intended for samples smaller than 30 when comparing a treatment group to a comparison group; as well there is a version for pretest-posttest comparisons. Some reports (e.g., McLaughlin, Patel, and Slee 2020) employ nonparametric statistics that do not demand normally distributed data. Faced with small samples of less than 30, some reports acknowledge the difficulty of inferential comparisons and report only descriptive statistics (Dillon 2020; Spronken-Smith et al. 2018). For these small groups visual representation of data is helpful. If a cohort of students engaging in program is very small, then it may be important to note the reasons for any student who fails to benefit or who drops out of the program. These reasons may be exogenous to the program, such as illness, family crises, etc., and so may not influence the argument for the program’s effectiveness.

Description

Quantitative data are the most common form of reporting the results of programs described in SPUR and other journals; however, the reliance on data does not compel inferential testing or model building. Instead, numerical data can be used as “mere description” (Gerring 2012), providing a more precise account of outcomes than qualitative summaries. If a study reports that student program participants average grades of 3.7, most readers know implicitly that the common GPA scale ranges from 0 to 4, and that 3.7 is a successful grade. Deming (1953) distinguished between surveys that were enumerative (asking how much) and surveys that were analytic (asking why). Enumerative surveys may be adequate for evaluating the effectiveness of a program by reporting graduation rates or attrition rates, vouching for the success of the program but falling short of specifying the specific cause of the success (Cartwright 2007). In some studies mere description is adequate for illustrating an effect. For example, Grindle et al. (2021) used descriptive counts and percentages to illustrate the result of in a study of passive research involvement.

Cohen (1990) noted that simplicity of describing data suggests the use of graphs and diagrams that may aid in presenting a program outcome. The use of figures may efficiently represent descriptive data, and is a common practice in this journal (Barney 2017; Brooks et al. 2019; Garrett et al. 2021; Gold, Atkins, and McNeal 2021; Kuan and Sedlacek 2022; Szecsi et al. 2019). Tufte (1983) outlined the characteristics of graphical excellence, including graphs that serve the clear purpose of description, which encourage the viewer to think about substance, and encourage comparisons between different pieces of data.

Validity

Readers expect the assessment of an URSCI program to be valid. There are many adjectives to be placed before validity, and inevitably three types occur. The first is the validity of the instruments employed to measure outcomes. The second has to do with the internal logic of the program and how that program produces results (internal validity). Finally, the question of the generalizability or transferability of the program arises (external validity).

We expect the creators of instruments to present some evidence of the instrument’s validity by showing that the instrument is in agreement with other methods used to measure the same outcome (Campbell and Fiske 1959). Once the instrument’s trustworthiness is established, the use of the instrument by subsequent researchers often relies on the reputation of the instrument’s original validation. There is often not enough data or time to revisit techniques for validation of the instrument in every study. This trust in the instrument is normal; work proceeds slowly if the research instrument has to be revalidated each time. The concern arises when the new users of the instrument invoke a “mutatis mutandis” approach, that is, making necessary changes in the original instrument so that it fits the new project without affecting the main constructs measured by the instrument. The presumption is that the original instrument is robust, preserving its validity despite alterations. A perusal of the reports published in SPUR suggests that authors often use research instruments created by other researchers. Examples include the SURE survey (Survey of Undergraduate Research Experiences; Lopatto 2004); URSSA (Undergraduate Research Student Self-Assessment; Hunter et al. 2009); and the OSCAR Student Survey (Foster and Usher 2018). Items from these established surveys are occasionally revised to suit the context. Are there credible procedures for changing an instrument while claiming that it retains its essential meaning? The credibility of the instrument can be supported by response process validity, which involves the review of the survey items by subject matter experts, and cognitive interviewing of potential respondents to determine if respondents understood the intended meaning of the survey items. These procedures may or may not lend themselves to quantitative analysis, but they improve the validity of the modified instrument.

The effectiveness of the program, called internal validity, is “the degree to which an experiment is methodologically sound and confound-free” (Goodwin and Goodwin 2017, 148). The validity question reduces to the confidence we have that the URSCI program causes the changes in the students’ behaviors. Traditionally, the gold standard for causal assertions is the true experiment, or randomized controlled trial. Randomized controlled trials are rare in studies of undergraduate research and creativity. Randomized controlled trials rely on the researcher’s control of participant assignment to treatment and comparison groups as the basis for making a causal assertion that the program caused changes in the participant’s behavior. In the absence of randomized controlled trials design features for a causal assertion, researchers use a variety of tactics. Some involve the creation of a nonequivalent comparison group that serves as a proxy for a genuine control group. Nicols-Grinenko et al. (2017) utilized their institution’s undergraduate population as a comparison group for students who participated in undergraduate research. After describing an initiative to build a culture of undergraduate research at their institution, they tracked undergraduate research participants and compared the participants graduation rates and grade point averages to all undergraduate contemporaries. They found higher graduation rates and grade point averages for undergraduate research participants compared to the general student population. Several researchers use a pretest as the comparison group for posttest data. Beer et al. (2019) used both between-groups and pretest-posttest data to argue for the effectiveness of a peer research consultant program. The results showed increments in desirable skills from pretest to posttest based on t tests. Ashcroft et al. (2021) employed pre- and post-ratings of gains in the understanding of research and related items and found several significant Wilcoxon test results in the favorable direction. Tian et al. (2022) reported on the success of inquiry-based learning in China. They found significant gains on self-report items from the SURE survey (Lopatto 2004), although the choice of inferential test was unclear. Several of these reports chose to analyze items on a survey separately, leading to the concern that piecemeal testing may result in false positives (type 1 errors).

Matching and pretest-posttest designs are efforts to preserve the internal validity of the assessment in the absence of experimental control. The objective is a generalizable result. The most ambitious attempts to substitute statistical control for experimental control involve forms of multiple regression models.

Models

The term model can be used to describe a “particular aspect of a given theory” (Fried 2020) or a program to be emulated. In the model as theory, the undergraduate research program is described for replication with adherence to the original method, that is, the program is generalizable. The model as theory suggests that the reader will see a SPUR report that describes an outcome for a sample (usually of undergraduate students) that will generalize to a population. Because URSCI programs seldom follow the formula for assertions of generalization, namely, randomly selecting student participants from the student population and randomly assigning students to treatment and control groups (see Haeger et al. 2020), researchers exploring the nature of undergraduate research employ various statistical methods as a substitute for randomization. The goal is to estimate the main effects of the program to build a theory of URSCI. Student participants in these programs tend to be diverse and so confound the main effects of the program. How do researchers attempt to account for student differences? Some analyses of undergraduate research (UR) include attempts at matching non–randomly assigned program participants with nonparticipants. These analyses employ a range of techniques from simple matching to advanced regression analysis to examine whether student characteristics moderated the program outcome. Rodenbusch et al. (2016), for example, reported that regression analysis of race/ethnicity, gender, and first-generation undergraduate status yielded no significant relation to program success. Galli and Bahamonde (2018) matched UR students and comparison groups on grade point average at time of program admission. Whittinghill et al. (2019) reported an analysis of 10 years of data concerning the effect of UR on graduate rates, grade point average, and entrance into graduate programs. They used propensity matching (Rosenbaum and Rubin 1983) to create a quasi-control group for comparison with the outcomes for UR researchers. Brouhle and Graham (2022) employed a probit regression model to account for possible confounding variables affecting undergraduate research students and a comparison group of nonresearchers. The technique allowed the researchers to argue that differential outcomes, such as the superior grade point averages of the undergraduate research students, were not based on a confounding variable. Sell, Naginey, and Stanton (2018) compared the grade point averages of students with research experience with those who did not, for both contemporary students and graduates. For graduates, propensity matching was used to form a matched comparison group to the undergraduate research group. The analysis, which matched the groups on eight variables including gender and first-generation undergraduate status, found significantly higher grade point averages for research students.

Large-scale programs, or programs that consolidate data over several years, recognize that the student is a heterogenous variable, that is, within the student sample there are many subsamples. These subsamples may be classified by race, ethnicity, gender, or culture. Large-scale programs intend to benefit all students, so quantitative methods are employed to show how well the program results in a general main effect. Some large-scale programs test for differences between student subsamples on a quantitative measure and simply report that no differences were found (Shaffer et al. 2014). Others use sophisticated modeling to eliminate the influence of possible confounds. Hanauer et al. (2017) examined the impact of the SEA-PHAGES undergraduate research program in biology on student success while accounting for a variety of student characteristics. They reported equally positive outcomes for students with diverse economic backgrounds, academic performance, gender, and ethnicity. The intent of these approaches is that they attempt to preserve the idea of the general reference population, that demographic and economic identities of students are confounding variables that may be removed from the analysis statistically, revealing a main effect of URSCI on the general reference population of undergraduate students.

The third use of validity is external validity, usually defined as the degree to which research findings generalize to other populations, settings, or times. The usual argument is that the results drawn from a sample generalize to a reference population. The construct of the reference population to which studies generalize has been questioned by awareness of how WEIRD (Western, educated, industrialized, rich, and democratic) cultural participants in psychological research skew the results away from generalizability (American Psychological Association 2010). Reports published in SPUR seem cognizant of the need to address multiple student populations, an approach sometimes termed culturally responsive assessment (Baker and Henning 2022). Pursuing the goal of generalizability encourages analysts to control confounding variables such as student ethnicity or gender. Pursuing the goal of transferability encourages the consideration of these variables as support factors that are not neutralized but optimized to promote student success. Following Cartwright and Hardie (2012), researchers should be free to optimize support factors rather than to suppress confounding variables. Support factors are “other members of the team of causes” that optimize success. For example, reported successes for undergraduate research in genomics (Lopatto et al. 2008) originated at an institution known for high student selectivity and good financial resources. Reported success of the same program at community colleges (Croonquist et al. 2023) required the recognition that many support factors of the community college programs differed from those in the early reports. Further examples of diverse yet effective programs may be found in the SPUR special issue published in summer 2018, which highlighted culturally relevant programs (Boudreau et al. 2018; Puniwai-Ganoot et al. 2018) that reported effectiveness without claiming to be replications of a standard method. Each program deployed a package of support factors to optimize the program’s success. Whereas studies in pursuit of generalizable results set aside variables such as gender, ethnicity, and socioeconomic status, culturally relevant programs foreground these variables and employ the necessary support factors to facilitate the program’s, and the student’s, success. SPUR reports often suggest model programs that may be emulated (Dickter et al. 2018; Follmer et al. 2017; Foster and Usher 2018; Gilbertson et al. 2021; Gould 2018). The approach makes sense, given that SPUR is a trading post of ideas across academic disciplines and interdisciplines.

SPUR and its parent organization CUR value diversity and equity. Equity is typically taken to mean that different students need adjustments to correct for imbalances and obstacles to success. Equity is a support factor. Equity adjustments imply that students are not replicates of each other. The challenge, then, is to find measures of program effectiveness that includes the individual differences of student participants. For this purpose, it is necessary to reimagine a common distinction in assessment research between direct and indirect measures of student behavior. Direct measures of student learning are said to include tests of knowledge such as exams and quizzes. Indirect measures of student learning include quantitative self-reports found in surveys. Although the multioperational approach to assessment (Cook and Campbell 1979) recommends the use of both measures rather than relying on one, direct measures have been enshrined as superior to student self-reported measures. Within URSCI programs the privileged status of direct measures needs to be interrogated, given that many programs encourage students to create unique products, artifacts, or scholarly reports. The interrogation may proceed in this way: Indirect measure of student behavior, that is, self-reported quantitative ratings, seem to cast the student as an audience to some instructional performance. The self-report is often anonymous, preventing the appreciation of the role of the student’s identity in their experience. In undergraduate research, scholarship, and creative inquiry the student is an active participant (but see Grindle et al. 2021). Their experience is necessarily interpreted through the lens of their personal identity. URSCI experiences may modify or enlarge the student’s identity with respect to professionalism or joining a community of scholars (Palmer et al. 2018). Rigorous statistical modeling treats aspects of identity as confounding variables that need to be partitioned from the main effect of URSCI so that a generalizable treatment effect may be uncovered. Standard quantitative methods such as analysis of variance or multiple linear regression treat the interaction of the independent variable and the student’s identity as an isolatable, additive, and linear component of the experience. If the goal of the assessment is not, however, a generalization from the student sample to a unitary reference population, then we may become interested in the student’s identity as a support factor for the program’s success. The joint effect of a program and the student’s identity is not an interaction but an intersection. The individual differences of the students become a focus of assessment, and the student’s survey data evolves from indirect measure to direct measure. Self-report becomes self-disclosure. Self-disclosure offers the most direct measure of the student’s URSCI experience. The challenge going forward is to optimize the use of quantitative methods to find precise descriptors of student outcomes while preserving the individual differences in student success.

The continuing challenge for faculty and staff who administer undergraduate research programs will be the nearly compulsory assessment of student learning and attitude. The work may seem challenging to program faculty and staff who do not regularly employ quantitative methods. Consulting the myriad online courses, websites, and videos concerning statistics may be off-putting. A less abrasive introduction to quantitative methods may be sources such as Statistics Done Wrong (Reinhart 2015) or Statistics As Principled Argument (Abelson 1995), books that address common problems of quantitative decision-making without elaborate formulas. Similarly, The Craft of Research (Booth et al. 2016), although it does not cover statistical analysis, has a useful chapter on communicating evidence visually. For readers wishing to tutor themselves in statistical techniques there are Statistics Unplugged (Caldwell 2013) and Statistics for the Terrified (Kranzler 2003). For issues concerning quasi-experimental design and threats to validity, Cook and Campbell (1979) remains a standard text.

Encouraging best practices includes encouraging the practitioner. The ongoing explorations in programs for undergraduate research, scholarship, and creative inquiry will best be sustained if they are beneficial to the student and the mentor. Quantitative methods may provide a perspective through which the benefits may be discerned. The construction of this perspective and the picture that emerges provide a shared journey for all participants.

Conflict of Interest

The author has no conflict of interest.

IRB Statement

Not applicable.

Data Availability

Not applicable.

References

Abelson, Robert P. 1995. Statistics As Principled Argument. Hillsdale, NJ: Lawrence Erlbaum.

American Psychological Association. 2010. “Are Your Findings ‘WEIRD’?” Monitor on Psychology 41(5): 11. Accessed July 17, 2023. https://www.apa.org/monitor/2010/05/weird

Ashcroft, Jared, Veronica Jaramillo, Jillian Blatti, Shu-Sha Angie Guan, Amber Bui, Veronica Villasenor, Alina Adamian, et al. 2021. “BUILDing Equity in STEM: A Collaborative Undergraduate Research Program to Increase Achievement of Underserved Community College Students.” Scholarship and Practice of Undergraduate Research 4(3): 47–58. doi: 10.18833/spur/4/3/11

Baker, Gianina R., and Gavin W. Henning. 2022. “Current State of Scholarship on Assessment.” In Reframing Assessment to Center Equity: Theories, Models, and Practices, ed. Gavin Henning, Gianina R. Baker, Natasha A. Jankowski, Anne E. Lundquist, and Erick Montenegro, 57–79. Sterling, VA: Stylus.

Barney, Christopher C. 2017. “An Analysis of Funding for the NSF REU Site Program in Biology from 1987 to 2014.” Scholarship and Practice of Undergraduate Research 1(1): 11–19. doi: 10.18833/spur/1/1/1

Beer, Francisca, Christina M. Hassija, Arturo Covarrubias-Paniagua, and Jeffrey M. Thompson. 2019. “A Peer Research Consultant Program: Feasibility and Outcomes.” Scholarship and Practice of Undergraduate Research 2(3): 4–13. doi: 10.18833/spur/2/3/4

Booth, Wayne C., Gregory G. Colomb, Joseph M. Williams, Joseph Bizup, and William T. Fitzgerald. 2016. The Craft of Research. 4th ed. Chicago: University of Chicago Press.

Boudreau, Kristin, David DiBiasio, and Zoe Reidinger. 2018. “Undergraduate Research and the Difference It Makes for LGBTQ+ Students.” Scholarship and Practice of Undergraduate Research 1(4): 46–47. doi: 10.18833/spur/1/4/1

Brooks, Andrea Wilcox, Jane Hammons, Joseph Nolan, Sally Dufek, and Morgan Wynn. 2019. “The Purpose of Research: What Undergraduate Students Say.” Scholarship and Practice of Undergraduate Research 3(1): 39–47. doi: 10.18833/spur/3/1/7

Brouhle, Keith, and Brad Graham. 2022. ”The Impact of Undergraduate Research Experiences on Graduate Degree Attainment across Academic Divisions.” Scholarship and Practice of Undergraduate Research 6(1): 32–42.

Brown, Daniel A., Nina B. Wright, Sylvia T. Gonzales, Nicholas E. Weimer, and Julio G. Soto. 2020. “An Undergraduate Research Approach That Increased Student Success at a Hispanic-Serving Institution (HSI): The SURE Program at Texas State University.” Scholarship and Practice of Undergraduate Research 4(1): 52–62. doi: 10.18833/spur/4/1/18

Caldwell, Sally. 2013. Statistics Unplugged. 4th ed. Belmont, CA: Wadsworth, Cengage Learning.

Campbell, Donald T., and Donald W. Fiske. 1959. “Convergent and Discriminant Validation by the Multitrait-Multimethod Matrix.” Psychological Bulletin 56: 81105.

Cartwright, Nancy. 2007. Hunting Causes and Using Them: Approaches in Philosophy and Economics. Cambridge, UK: Cambridge University Press.

Cartwright, Nancy, and Jeremy Hardie. 2012. Evidence-Based Policy: A Practical Guide to Doing It Better. Oxford, UK: Oxford University Press.

Cohen, Jacob. 1990. “Things I Have Learned (So Far).” American Psychologist 45: 13041312.

Cook, Thomas D., and Donald T. Campbell. 1979. Quasi-Experimentation: Design and Analysis Issues for Field Settings. Boston: Houghton Mifflin.

Croonquist, Paula, Virginia Falkenberg, Natalie Minkovsky, Alexa Sawa, Matthew Skerritt, Maire K. Sustacek, Raffaella Diotti, et al. 2023. “The Genomics Education Partnership: First Findings on Genomics Research in Community Colleges.” Scholarship and Practice of Undergraduate Research 6(3): 1728. doi: 10.18833/spur/6/3/1

Deming, W. Edward. 1953. “On the Distinction between Enumerative and Analytic Surveys.” Journal of the American Statistical Association 48: 244–255.

Dickter, Cheryl L., Anne H. Charity Hudley, Hannah A. Franz, and Ebony A. Lambert. 2018. “Faculty Change from Within: The Creation of the WMSURE Program.” Scholarship and Practice of Undergraduate Research 2(1): 24–32. doi: 10.18833/spur/2/1/6

Dillon, Heather E. 2020. “Development of a Mentoring Course-Based Undergraduate Research Experience (M-CURE).” Scholarship and Practice of Undergraduate Research 3(4): 26–34. doi: 10.18833/spur/3/4/7

Follmer, D. Jake, Sarah Zappe, Esther Gomez, and Manish Kumar. 2017. “Student Outcomes from Undergraduate Programs: Comparing Models of Research Experiences for Undergraduates (REUs).” Scholarship and Practice of Undergraduate Research 1(1): 20–27. doi: 10.18833/spur/1/1/5

Foster, Stephanie L., and Bethany M. Usher. 2018. “Comparing Two Models of Undergraduate Research Using the OSCAR Student Survey.” Scholarship and Practice of Undergraduate Research 1(3): 30–39. doi: 10.18833/spur/1/3/6

Fried, Eiko I. 2020. “Theories and Models: What They Are, What They Are For, and What They Are About.” Psychological Inquiry 31: 336–344. doi: 10.1080/1047840X.2020.1854011

Galli, Dominique M., and Rafael Bahamonde. 2018. “Assessing IUPUI’s Diversity Scholars Research Program: Lessons Learned.” Scholarship and Practice of Undergraduate Research 1(4): 12–17. doi: 10.18833/spur/1/4/10

Garrett, Arnell, Frances D. Carter-Johnson, Susan M. Natali, John D. Schade, and Robert M. Holmes. 2021. “A Model Interdisciplinary Collaboration to Engage and Mentor Underrepresented Minority Students in Lived Arctic and Climate Science Research Experiences.” Scholarship and Practice of Undergraduate Research 5(1): 16–26. doi: 10.18833/spur/5/1/4

Gerring, John. 2012. “Mere Description.” British Journal of Political Science 42: 721–746.

Gilbertson, Lynn, Jeannine Rowe, Yeongmin Kim, Catherine W. M. Chan, Naomi Schemm, and Michael Unhoch. 2021. “An Online Training Program to Enhance Novice Researchers’ Knowledge and Skills.” Scholarship and Practice of Undergraduate Research 4(4): 33–41. doi: 10.18833/spur/4/4/4

Gold, A. U., Rachel Atkins, and Karen S. McNeal. 2021. “Undergraduates’ Graph Interpretation and Scientific Paper Reading Shift from Novice- to Expert-Like as a Result of Participation in a Summer Research Experience: A Case Study.” Scholarship and Practice of Undergraduate Research 5(2): 8–19. doi: 10.18833/spur/5/2/2

Goodwin, Kerri A., and C. James Goodwin. 2017. Research in Psychology: Methods and Design. Las Vegas, NV: Wiley.

Gould, Laurie. 2018. “Introduction: Models of Undergraduate Research Mentoring.” Scholarship and Practice of Undergraduate Research 2(1): 2–3. doi: 10.18833/spur/2/1/10

Grindle, Nicholas, Stefanie Anyadi, Amanda Cain, Alastair McClelland, Paul Northrop, Rebecca Payne, and Sara Wingate Gray. 2021. “Re-Evaluating Passive Research Involvement in the Undergraduate Curriculum.” Scholarship and Practice of Undergraduate Research 5(1):52–58. doi: 10.18833/spur/5/1/12

Haeger, Heather, John E. Banks, Camille Smith, and Monique Armstrong-Land. 2020. “What We Know and What We Need to Know about Undergraduate Research.” Scholarship and Practice of Undergraduate Research 3(4): 62–69. doi: 10.18833/spur/3/4/4

Hanauer, David I., Mark J. Graham, SEA-PHAGES, Laura Betancur, Aiyana Bobrownicki, Steven G. Cresawn, Rebecca A. Garlena, et al. 2017. “An Inclusive Research Education Community (iREC): Impact of the SEA-PHAGES Program on Research Outcomes and Student Learning.” Proceedings of the National Academy of Sciences 114: 13531–13536. doi: 10.1073/pnas.1718188115

Hunter, Anne-Barrie, Timothy Weston, Sandra L. Laursen, and Heather Thiry. 2009. “URSSA: Evaluating Student Gains From Undergraduate Research in the Sciences.” CUR Quarterly 29(3): 15–19.

Kass, Robert E., Brian S. Caffo, Marie Davidian, Xiao-Li Meng, Bin Yu, and Nancy Reid. 2016. “Ten Simple Rules for Effective Statistical Practice.” PLOS Computational Biology 12(6): e1004961. doi: 10.1371/journal.pcbi.1004961

Killion, Patrick J., Ian B. Page, and Victoria Yu. 2019. “Big-Data Analysis and Visualization as Research Methods for a Large-Scale Undergraduate Research Program at a Research University.” Scholarship and Practice of Undergraduate Research 2(4): 14–22. doi: 10.18833/spur/2/4/7

Kranzler, John H. 2003. Statistics For The Terrified. 3rd ed. Upper Saddle River, NJ: Pearson Education.

Kuan, Jennifer, and Quentin C. Sedlacek. 2022. “Does It Matter If I Call It a CURE? Identity Development in Online Entrepreneurship Coursework.” Scholarship and Practice of Undergraduate Research 6(1): 2331. doi: 10.18833/spur/6/1/7

LaPlant, James T. 2017. “Welcome to the Inaugural Issue of SPUR.” Scholarship and Practice of Undergraduate Research 1(1): 3–4.

Lopatto, David. 2004. “Survey of Undergraduate Research Experiences (SURE): First Findings.” Cell Biology Education 3: 270–277. doi: 10.1187/cbe.04-07-0045

Lopatto, David, Consuelo Alvarez, Daron Barnard, Chitra Chandrasekaran, Hui-Min Chung, Charles Du, Todd Eckdahl, et al. 2008. “Genomics Education Partnership.” Science 322: 684–685. doi: 10.1126/science.1165351

Lukes, Laura A., Katherine Ryker, Camerian Millsaps, Rowan Lockwood, Mark D. Uhen, Christian George, Callan Bentley, and Peter Berquist. 2019. “Leveraging a Large Database to Increase Access to Undergraduate Research Experiences.” Scholarship and Practice of Undergraduate Research 2(4): 4–13. doi: 10.18833/spur/2/4/6

McLaughlin, Jacqueline S., Mit Patel, and Joshua B. Slee. 2020. “A CURE Using Cell Culture–Based Research Enhances Career-Ready Skills in Undergraduates.” Scholarship and Practice of Undergraduate Research 4(2): 49–61. doi: 10.18833/spur/4/2/15

Naepi, Sereana, and Airini. 2019. “Knowledge Makers: Indigenous Student Undergraduate Researchers and Research.” Scholarship and Practice of Undergraduate Research 2(3): 52–60. doi: 10.18833/spur/2/3/7

Nelson, Randy B., Kideste Mariam Yusef, and Adrienne Cooper. 2019. “Expanding Minds through Research: Juvenile Justice and Big Data.” Scholarship and Practice of Undergraduate Research 2(4): 30–36. doi: 10.18833/spur/2/4/10

Nicols-Grinenko, Annemarie, Rachel B. Verni, Jennifer M. Pipitone, Christin P. Bowman, and Vanya Quinones-Jenab. 2017. “Building a Culture of Undergraduate Research: A Case Study.” Scholarship and Practice of Undergraduate Research 1(2): 43–51. doi: 10.18833/spur/1/2/13

Palmer, Ruth J., Andrea N. Hunt, Michael R. Neal, and Brad Wuetherick. 2018. “The Influence of Mentored Undergraduate Research on Students’ Identity Development.” Scholarship and Practice of Undergraduate Research 2(2): 4–14. doi: 10.18833/spur/2/2/1

Puniwai-Ganoot, Noelani, Sharon Ziegler-Chong, Rebecca Ostertag, and Moana Ulu Ching. 2018. “Mentoring Pacific Island Students for Conservation Careers.” Scholarship and Practice of Undergraduate Research 1(4): 25–32. doi: 10.18833/spur/1/4/11

Reinhart, Alex. 2015. Statistics Done Wrong: The Woefully Complete Guide. San Francisco: No Starch Press.

Rodenbusch, Stacia E., Paul R. Hernandez, Sarah L. Simmons, and Erin L. Dolan. 2016. “Early Engagement in Course-Based Research Increases Graduation Rates and Completion of Science, Engineering, and Mathematics Degrees.” Cell Biology Education–Life Sciences Education 15(2): ar20. doi: 10.1187/cbe.16-03-0117

Rosenbaum, Paul R., and Donald B. Rubin. 1983. “The Central Role of the Propensity Score in Observational Studies for Causal Effects.” Biometrika 70: 41–55. doi: 10.1093/biomet/70.1.41

Sell, Andrea J., Angela Naginey, and Cathy Alexander Stanton. 2018. “The Impact of Undergraduate Research on Academic Success.” Scholarship and Practice of Undergraduate Research 1(3): 19–29. doi: 10.18833/spur/1/3/8

Shaffer, Christopher D., Consuelo J. Alvarez, April E. Bednarski, David Dunbar, Anya L. Goodman, Catherine Reinke, Anne G. Rosenwald, et al. 2014. “A Course-Based Research Experience: How Benefits Change with Increased Investment in Instructional Time.” Cell Biology Education–Life Sciences Education 13: 111–30. doi: 10.1187/ cbe-13-08-0152

Spronken-Smith, Rachel, Sally Sandover, Lee Partridge, Andy Leger, Tony Fawcett, and Liz Burd. 2018. “The Challenges of Going Global with Undergraduate Research: The Matariki Undergraduate Research Network.” Scholarship and Practice of Undergraduate Research 2(2): 64–72. doi: 10.18833/spur/2/2/8

Szecsi, Tunde, Charles Gunnels, Jackie Greene, Vickie Johnston, and Elia Vazquez-Montilla. 2019. “Teaching and Evaluating Skills for Undergraduate Research in the Teacher Education Program.” Scholarship and Practice of Undergraduate Research 3(1): 20–29. doi: 10.18833/spur/3/1/5

Tian, Jing, Yiheng Wang, Ghang Ren, and Yingzhe Lei. 2022. “Undergraduate Research and Inquiry-Based Learning in Geographical Information Science: A Case Study from China.” Scholarship and Practice of Undergraduate Research 5(4): 16–23. doi: 10.18833/spur/5/4/8

Tufte, Edward R. 1983. The Visual Display of Quantitative Information. Cheshire, CT: Graphics.

Webb, Eugene J., Donald T. Campbell, Richard D. Schwartz, Lee Sechrest, and Janet B. Grove. 1981. Nonreactive Measures in the Social Sciences. Boston: Houghton Mifflin.

Whittinghill, Jonathan C., Simeon P. Slovacek, Laura P. Flenoury, and Vivian Miu. 2019. “A 10-Year Study on the Efficacy of Biomedical Research Support Programs at a Public University.” Scholarship and Practice of Undergraduate Research 3(1): 30–38. doi: 10.18833/spur/3/1/3

Zhen, Willa. 2020. “Teaching Research Skills to Vocational Learners: Teaching Chefs to Research.” Scholarship and Practice of Undergraduate Research 4(2): 21–26. doi: 10.18833/spur/4/2/6

David Lopatto
Grinnell College
lopatto@grinnell.edu

David Lopatto is a professor of psychology and the Samuel R. and Marie-Louise Rosenthal Professor of Natural Science and Mathematics at Grinnell College. He is the former director of the Grinnell College Center for Teaching, Learning, and Assessment. He has been studying the features and benefits of undergraduate research experiences for many years, creating instruments, including the Survey of Undergraduate Research Experiences (SURE) and the Survey of Classroom Undergraduate Research Experiences (CURE), which may be found at https://sure.sites.grinnell.edu.

SUREbyts: Presenting Early-Year Undergraduate Students with Videos on Research Topics

SUREbyts: Presenting Early-Year Undergraduate Students with Videos on Research Topics

Recommended Citation: O’Leary, Ciarán, Gordon Cooke, Julie Dunne, Barry Ryan, Carla Surlis, Matt Smith, Emma Caraher, Claire Lennon, Evelyn Landers, Eileen O’Leary, Geraldine Dowling, Margaret McCallig, Anne Marie O’Brien, Josephine Treacy, and Valerie McCarthy. 2023. Title. Scholarship and Practice of Undergraduate Research 7 (1): 35-42. 

https://doi.org/10.18833/spur/7/1/1


Embedding research into the undergraduate curriculum has been shown to be a highly impactful pedagogical approach across all disciplinary areas (Walkington 2015). By engaging with structured research opportunities as part of their undergraduate studies, students are encouraged to creatively explore the topics being taught while also developing important disciplinary and transversal skills (Healey and Jenkins 2009). The opportunity for students to engage fully, or partially, with a research project and then present their findings at an undergraduate research conference or publish their findings in a journal has attracted substantial attention in recent decades, as evidenced by the proliferation of dissemination platforms for undergraduate research (Barker and Gibson 2022). These opportunities, however, tend to focus primarily on students at the latter end of their undergraduate studies. Despite this, there is increased attention in the literature on how undergraduate students at the earlier stages of their studies can become involved in, or exposed to, research projects (Shelby 2019; Wolkow et al. 2014). This article describes one project that shares this objective: the SUREbyts project.

The SUREbyts project allows first- and second-year undergraduate students to engage with research through a collection of video recordings in which experienced and early-stage researchers describe a problem, pose a question and possible solutions related to the problem, and then describe their research-informed view on the most appropriate solution. These videos, covering many of the prominent scientific disciplines, are freely available to all lecturers to use in class with their students under a Creative Commons BY-NC-ND 4.0 license. Suggested uses include integrating SUREbyts into a discussion regarding the topic of the video or using SUREbyts as part of a formative or summative assessment. Of the 294 students who responded to a survey about their engagement with SUREbyts, the majority reported that it had increased their interest in research in general, and their understanding of the work undertaken by researchers specifically. There are challenges, however, associated with this approach. Researchers often find it difficult to present their research in an accessible fashion, appropriate for early-stage undergraduate students. Creating an interesting and engaging video requires careful guidance and usually several design iterations. Additionally, lecturers require guidance on how to incorporate these videos meaningfully into their teaching, as misaligned use can result in a negative student learning experience.

The next sections describe the SUREbyts project in detail. The article concludes with a set of recommendations to institutions that are considering implementation of such a project using SUREbyts as a model. Institutions that do so will be well equipped to enhance the awareness of research among their first- and second-year students.

SUREbyts

The Science Undergraduate Research Experience (SURE) Network (O’Leary et al. 2021) launched the SUREbyts project in 2021 with the objective of enhancing research awareness at the early stages of undergraduate programs in the sciences in Ireland. Through SUREbyts, experienced researchers and postgraduate research students were invited to record a brief video (a SUREbyt) centered on a question related to their research. The videos were then made available on the website of the SURE Network (SURE Network 2021), from where both students and lecturers could access them. Lecturers were encouraged to use SUREbyts videos in class to help their students learn about the research that was taking place within their discipline.

Video was chosen as the medium for this project for a variety of reasons, including ensuring that the research that was taking place throughout the network could be showcased to all students; and enabling the content to be reviewed and edited in advance of its use to ensure that it meets the requirements of the project. Of most relevance for this article, the SURE Network has ambitions for the SUREbyts collection of resources and the SUREbyts model to be adopted by institutions beyond Ireland. The collection currently comprises 34 SUREbyts videos that are freely available for use under a BY-NC-ND 4.0 Creative Commons license. To better understand the impact of the SUREbyts model, the project team surveyed lecturers and students who had used the SUREbyts resources. Thirteen lecturers and 294 students replied to the online surveys. The feedback obtained, both positive and negative, shapes the remaining sections and provides guidance to others who wish to either contribute to, use, or replicate the SUREbyts model.

Format

A SUREbyt is a 10- to 12-minute video designed to provoke a discussion among students when played in class. In the video, students are informed about the research career and work of a research student or professional researcher at their own or another institution. The students are then presented with a question related to that work and three possible solutions. This can be thought of as the type of question that might be offered to an audience with a request for a show of hands on the most suitable answer. A break in the video then shows a countdown clock for two minutes, during which time students are encouraged to discuss the possible solutions with their nearest classmates. The second part of the video then presents the researcher’s own view on the best solution. Often, the researcher will explain that they have a preferred solution but that other researchers do not share their view. It is important that students are exposed to this type of discourse so that they appreciate that research does not always result in one, true answer, and that it is acceptable for researchers to hold diverse views based on their own findings.

In part 1 of the SUREbyt video, shown in Figure 1, the researcher introduces themself and their research and presents a question and possible solutions. In part 2, also shown in Figure 1, the researcher’s preferred solutions are presented and justified. Both parts are fully developed by the researcher, based on strict, but accessible, guidelines available through the SUREbyts website. The researcher then submits their videos to their institutional SUREbyts point of contact, as shown in Figure 2. The institutional point of contact reviews the video and may request edits or may liaise with the central coordinators of the SUREbyts project who review the videos for quality and adherence to the published guidelines. When complete, the researcher will submit both parts with a signed consent form to the project team. The two parts are then edited into the final format shown in Figure 1 by the SUREbyts project team. At this stage, a themed introduction and outro are added to bookend the videos, and a two-minute countdown clock is inserted between the two parts. Once finalized the SUREbyt video is published and categorized by discipline on the SURE Network website, where is it made available at a unique URL. Many videos are multidisciplinary and appear in multiple categories, helping alert students to the importance of research that transcends subject boundaries. The creator of a published SUREbyt video can apply for recognition with a digital badge issued by the SURE Network.

Collection

A primary metric of success for the SUREbyts project was the recruitment of 34 researchers from around Ireland, in all the SURE Network’s partner institutions, to create the videos. Of these, 19 were lecturers who were actively involved in research, and 15 were postgraduate research students. The mix of creators at different stages of their career meant that the full SUREbyts collection was representative of the diversity of experience that features in the research landscape. It also provided early-stage researchers and postgraduate students with a means of disseminating their research and enhancing both its engagement and impact, a common requirement of grant-awarding bodies. Equally important was the diversity of disciplinary areas, as shown in Table 1. Thirty-four SUREbyts videos were published, with several in multiple categories.

The project resulted in a collection of cutting-edge research videos addressing accessible, engaging topics and featuring questions that were designed for a novice audience. The most popular of the videos was titled Feeding Martian Colonies. In this SUREbyt video, the creator, a postgraduate student, explained her research background and project, which related to hydroponics. Following a four-minute description of her research, the researcher posed the question, “How are we going to feed Martian colonies?” and offered three solutions: (a) mix Martian soil with “human fertilizer” (urine and feces); (b) send constant resupply missions from Earth; (c) soil-less growth under controlled environment. At this point the video moves to a two-minute break so that viewers can consider the possible solutions, discussing them as appropriate with classmates. In the final part of the video, the researcher explained why the third option was her preferred solution and related this to her own current research. This SUREbyt video attracted approximately one-quarter of all the hits for the whole collection. Other popular videos cover a range of disciplinary areas. Titles include Pond Water, Endocrine-Disrupting Chemicals, Walking, Microbial Growth Strategies, and Tsunami.

Quality

The SUREbyts coordinators evaluated the quality of each of the SUREbyts videos against a set of technical requirements, a set of formatting requirements including the length of video, and the requirement for the video to be engaging for novice science students. Survey respondents subsequently helped further develop understanding of quality.

Survey feedback has suggested a diversity of quality among the videos and a dissatisfaction among students when the videos do not adhere fully to the guidelines. This is evidenced by one respondent’s comment about one of the videos that was almost 20 minutes in length.

I definitely felt some were of higher quality (the ones I used) than others—so it would be great if they were continually updated to give more choice. Students seemed to enjoy them but the group who watched the microplastics one felt it was too long—I really enjoyed this one in particular and so do not agree but thought this feedback may be useful (one student told me she increased the speed so that it was more watchable!).

Students also commented on the need for “simpler language and avoiding terminology” and that “there should not be much written text on the screen.” Students were frustrated by poor-quality recordings and the need to “improve the mic quality [because] some background noises could be heard and the audio was difficult to comprehend because of this.” There is a balance to be struck between the requirements set out for video creators, which may serve as barriers to their participation, and the requirement for high-quality videos.

Suggestions from survey respondents on how to improve the videos included the addition of subtitles to the videos and the inclusion of quizzes at the end of each video. The addition of subtitles is easily achieved through software automation and will be implemented for the next iteration of SUREbyts videos. The addition of quizzes was given consideration, but it was felt this would alter the purpose of the SUREbyt video, which is intended to focus on a single focal question in a classroom situation. Lecturers may decide to build quizzes related to the content of the video within the instructional context in which the video is used. It is important, however, that the overall burden on the creator of the video is kept to a minimum, as the success of SUREbyts is dependent upon the willingness of busy researchers and research students taking the time to develop accessible, engaging videos centered upon a carefully designed question.

What is clear is that students and lecturers have a very good sense of what constitutes good quality, and this is reflected in the popularity of certain videos. Popularity is driven, in the first instance, by the lecturer who decides on which video to use in their class, and how to use it.

Instruction

Lecturers in first- and second-year modules in SURE Network partner institutions were encouraged to use the SUREbyts resources as part of the learning design for their classes. As with the video creators, lecturers could apply to the SURE Network for a digital badge once they had incorporated SUREbyts into their classes.

A dedicated online session was arranged for lecturers to explore different ways in which the resources could be used on their courses. Of these approaches, which are described on the SURE Network website, the one that was adopted by the majority of lecturers was “class opener.” With this method, a lecturer commences a class by playing the SUREbyt video from start to finish. When the middle part of the video plays, students are asked to discuss the possible solutions with each other, which they do again after the video completes. The lecturer then relates the subject of the SUREbyt to the topic under discussion in that week’s class. Other approaches such as “class bridge,” in which the playing of the video is divided between sessions, were also adopted by some lecturers. Others innovated and developed their own approach to using the videos, such as this lecturer:

I used the videos in a slightly different way than what was perhaps intended. First, I used the videos at the start of the semester as an ice breaker. This enabled the students to initiate conversations with each other, and it was very effective—the noise from the conversations was very loud!

Based on survey responses, the perception of lecturers on the value of the SUREbyts videos was generally positive, but not universally so. Nine of the 13 lecturers surveyed (69 percent) felt that their students’ awareness of research was enhanced through their engagement with SUREbyts. Ten of the lecturers (77 percent) said that they would use the videos again, with seven of that group (54 percent) “very much” likely to do so. These lecturers identified how the videos they used were good triggers for discussion, with one lecturer commenting that:

The videos were perfectly pitched for first-year students who really engaged and considered the questions posed. The videos were great examples of real-world applications of computing research that were clearly presented at the right level for students.

However, other lecturers felt that the introduction of subject matter relating to postgraduate research was not appropriate for the early stages of first-year undergraduates. One lecturer responded in the survey with the following view:

For the vast majority of first-years in semester 1, which is the only time I teach these groups, they are not ready to start thinking about postgraduate research.

Another lecturer felt that the material presented was more appropriate for more experienced students, commenting that they “felt that second-year students responded better.” The same lecturer struggled to find time in their class for the use of the SUREbyts resources, and decided to “provide them with a list of videos and links to use in their own time.” The videos were designed to be used in class, and ideally for first- and second-year groups, so the feedback helped surface both an inconsistency in target level across different videos and a need to be aware of uses inconsistent with the design.

An overriding objective of SUREbyts is to increase the awareness of research as an activity, with a secondary objective being to raise disciplinary knowledge among students. Greater than 60 percent of the 294 students surveyed agreed that SUREbyts enhanced their understanding of the work of researchers (73 percent), their interest in research in their area (62 percent), and their interest in carrying out research in the future (65 percent). Fewer than this, although still a majority (54 percent), felt that they had an increased understanding of the topics they were studying in their program. Some student feedback was glowing in praise:

All of this information that I have gathered from her astounding video has allowed me to ponder the world of horticulture. I never expected to be interested in such topics however, through SUREbyt videos I am sure I will discover many new academic discoveries.

Other students, however, shared the view of some lecturers that the videos are more appropriate for later stage students:

As an introduction to new students who have no idea about computer science and are new to it, it is confusing, but for ones who have knowledge about the area it is an interesting and further opening to the subject matter of machine learning.

In general, feedback suggests that both lecturers and students recognized the value of the resources in starting in-class discussion, such as this lecturer:

For the module that I am teaching students need to create a technology solution (high-level prototype design) to address one or more of the SDGs (sustainable development goals), so these examples served as a great point of discussion on how we can design technology to address real-world problems and consider the needs of end users. This is a great resource that I will certainly use in future!

This highlights the importance of the resources being used as part of a facilitated session or class, rather than as a stand-alone web-based resource. The videos are designed to commence, or contribute to, a discussion, for which the role of the lecturer is essential.

Recommendations

The SUREbyts project developed an innovative format for brief videos intended to be used to introduce early-stage undergraduate students to real research projects that are taking place in higher education institutions. The project produced detailed guidelines for video creators and users. The project had a mixed but generally positive response from lecturers and students, as detailed in earlier sections. Based on the experience of running the project, the authors of this article present recommendations in the sections below to other institutions that may wish to adopt some or all aspects of the SUREbyts project.

Video Development

Researchers and research students tend to be time-poor but eager for recognition for their research. Research students should be advised on how the creation of videos for instruction can fulfill the dissemination requirements of their research grants, and help raise their profile. Lecturers and researchers should be made aware of how teaching of undergraduates can have benefits for active researchers (Feller 2018), and of how research and teaching can support each other (Ashrafa 2010). SUREbyts digital badges were made available to the creators and users of videos, although very few badges were applied for in practice.

Focus

Digital learning provides a means through which otherwise abstract or unknown concepts can be “illustrated and become tangible” (Kerres and Otto 2022, 701). The illustration of the concept, the question, and the possible solutions are central to the quality of the SUREbyts video. It is important to ensure that the creators of the videos are focused from the start on identifying and presenting a clear, easily understood question that will engage their audience in a meaningful discussion. All other aspects of the SUREbyts video will pivot around the question. In the pilot project described here, templates, detailed guidelines, and dedicated, local support were provided to help achieve this objective.

Interpersonal Support

The SUREbyts project benefited hugely from the support of the established SURE Network (O’Leary et al. 2021). As a nationwide network with representatives in institutions throughout Ireland, SURE was able to provide local support, encouragement, and guidance to video creators. This support was invaluable for encouraging participation in the project and subsequent usage of the videos.

Barriers

It is important that as many barriers to participation as possible are lowered or removed. Creators should not have to carry out extensive editing themselves; this should be provided as part of the final production process. Although guidelines are important and should be adhered to as much as possible, some flexibility should be afforded to the makers of the videos to be creative, within reason. Those videos that stray too far from what was expected, such as an excessively long video, will not be as attractive to students and lecturers.

Revise

During the SUREbyts project, it became evident that videos that did not reach a certain threshold of production quality, accessibility of the question, appropriateness of the language used, and content of the presentation would be ignored by lecturers and students. A large disparity in usage between the popular and unpopular videos showed the value of continually revising the videos with feedback until the appropriate quality is reached. Based on this outcome, the SUREbyts group has revised the guidelines to highlight this to future collaborators and content creators.

Lecturers

Lecturers require guidance on how to use the videos effectively. SUREbyts videos should enable students to experience what Pedaste (2022) describes as the orientation phase of research engagement: a “process of stimulating curiosity about a topic and addressing a learning challenge through stating a problem.” (151) For the SUREbyts project, a series of usage scenarios was presented to lecturers to encourage them to use the videos as part of a discussion with their classes. The videos are not intended to be used in the absence of an opportunity for peer discussion. Lecturers can be supported through dedicated training sessions, online resources, and, most valuable of all, case studies of effective use.

Conclusion

Based on feedback received, SUREbyts has proven effective at raising the profile of research among early-year undergraduate students in Ireland. The project team would welcome the adoption by others of the resources, format, or overall approach developed through the project. This article has provided guidance on how to do so. It is hoped that future users will learn from the successes of the SUREbyts project and avoid some of the challenging situations that emerged during the project.

Data Availability Statement

The research instruments used to collect data are available at https://sure-network.ie/surebyts/use. The following statements regarding the storage and availability of data were agreed to with the Technological University Dublin Research Ethics and Integrity Committee:

  • Data will be stored securely, and analysis will take place within the project team, possibly with the support of a small number of administrators external to the team.
  • All data collected will be deleted upon completion of the research, no later than one year following the collection of the data.

Ethical Review Board Statement

The Research Ethics and Integrity Committee of Technological University Dublin approved this project (REC-20-183) on October 11, 2021. This approval was noted and approved by the corresponding committee at each institution at which data were collected.

Conflict of Interest Statement

No conflict of interest to declare.

Acknowledgments

The authors would like to acknowledge the support of Ireland’s National Forum for the Enhancement of Teaching and Learning in Higher Education whose network and discipline fund supported the development of SUREbyts. The authors recognize the work undertaken by the creators of the SUREbyts videos to develop a comprehensive, cross-disciplinary resource that has contributed to the teaching, learning, and assessment of undergraduate students across Ireland, and thank all video creators for this work. The authors also acknowledge and thank the lecturers and students who used the SUREbyts videos and gave up their time to contribute to the data collection for this evaluation study. Finally, the authors acknowledge the SURE Network for its support in promoting the SUREbyts project.

References

Ashrafa, Syed Salman. 2010. “Borrowing a Little from Research to Enhance Undergraduate Teaching.” Procedia Social and Behavioral Sciences 2: 5507–5511.

Barker, Emma, and Caroline Gibson. 2022. “Dissemination in Undergraduate Research: Challenges and Opportunities.” In The Cambridge Handbook of Undergraduate Research, ed. Harald A. Mieg et al., 172–182. Cambridge, UK: Cambridge University Press.

Feller, Marla B. 2018. “The Value of Undergraduate Teaching for Research Scientists.” Neuron 99: 1113–1115. doi: 10.1016/j.neuron.2018.09.005

Healey, Mick, and Alan Jenkins. 2009. Developing Undergraduate Research and Inquiry. York, UK: Higher Education Academy.https://www.advance-he.ac.uk/knowledge-hub/developingundergraduate-research-and-inquiry

Kerres, Michael, and Daniel Otto. 2022. “Undergraduate Research in Digital Learning Environments.” In The Cambridge Handbook of Undergraduate Research, ed. Harald A. Mieg et al., 695–708. Cambridge, UK: Cambridge University Press.

O’Leary, Ciarán, Julie Dunne, Barry Ryan, Therese Montgomery, Anne Marie O’Brien, Cormac Quigley, Claire Lennon, et al. 2021. “Reflections on the Formation and Growth of the SURE Network: A National Disciplinary Network to Enhance Undergraduate Research in the Sciences.” Irish Journal of Academic Practice 9(1): article 7. doi: 10.21427/z3xx-dy28

Pedaste, Margus. 2022. “Inquiry Approach and Phases of Learning in Undergraduate Research.” In The Cambridge Handbook of Undergraduate Research, edited by Harald A. Mieg et al., 149–157. Cambridge, UK: Cambridge University Press.

Shelby, Shameka J. 2019. “A Course-Based Undergraduate Research Experience in Biochemistry That Is Suitable for Students with Various Levels of Preparedness.” Biochemistry and Molecular Biology Education 47: 220–227. doi: 10.1002/bmb.21227

SURE Network. 2021. SUREbyts (website). Accessed August 29, 2023. https://sure-network.ie/surebyts

Walkington, Helen. 2015. Students As Researchers: Supporting Undergraduate Research in the Disciplines in Higher Education. York, UK: Higher Education Academy. https://www.advancehe. ac.uk/knowledge-hub/students-researchers-supporting-undergraduate-research-disciplines-higher-education

Wolkow, Thomas D., Lisa T. Durrenberger, Michael A. Maynard, Kylie K. Harrall, and Lisa M. Hines. 2014. “A Comprehensive Faculty, Staff, and Student Training Program Enhances Student Perceptions of a Course-Based Research Experience at a Two-Year Institution.” Life Sciences Education, 13: 724–737. doi: 10.1187/cbe.14-03-0056

Ciarán O’Leary

Technological University Dublin, ciaran.oleary@tudublin.ie

Ciarán O’Leary is the head of learning development for the faculty of computing, digital, and data at Technological University Dublin. O’Leary has been a lecturer in computer science at Technological University Dublin since 2000. O’Leary’s research interests relate to the entanglement of digital technology with academic practice. O’Leary was the first chairperson of the Science Undergraduate Research Experience (SURE) Network from its establishment in 2016 to 2021, and was the project lead for the SUREbyts project.

Gordon Cooke is a lecturer in biological sciences and an active researcher. Cooke completed his PhD in 2004 at the Institute of Technology Tallaght before being appointed as a Newman Fellow at University College Dublin to undertake research into Barrett’s metaplasia. Cooke joined Technological University Dublin in 2016, where he established his own research group with interests in antimicrobial resistance and extracellular vesicles. Cooke also is actively involved in educational research about technology-enhanced learning, student retention, and student resilience.

Julie Dunne has a PhD in chemistry, an MA in higher education, and is a fellow of the Royal Society of Chemistry and a member of the Institute of Food Science and Technology, Ireland. After working in the pharmaceutical industry, Dunne joined Technological University Dublin in 2003 and is currently the head of the School of Food Science and Environmental Health. Dunne’s research interests include work-integrated learning, undergraduate research, education for sustainable development, green biocatalysis, and carbohydrate-based antimicrobials.

Barry Ryan is a biochemistry lecturer currently on secondment to lead the development of the educational model for Technological University Dublin. He promotes (co-) creation to empower and centralize all students across all levels within undergraduate curricula. Ryan is passionate about implementing research-informed teaching and supporting others to develop in this area. Ryan is concurrently a senior fellow of the Higher Education Academy, a National Forum Teaching and Learning research fellow, and a chartered science teacher.

Carla Surlis is an early-stage researcher and lecturer in molecular genetics, specializing in the area of small RNA interactions in human disease. Surlis is enthusiastic about using digital technologies to improve engagement in undergraduate teaching and learning.

Matt Smith is a senior lecturer in computing in the faculty of computing, digital, and data at Technological University Dublin. Smith’s research focuses on interactive multimedia and extended reality technologies, and its applications to support computer-supported learning. He leads the Digital Realities, Interaction and Virtual Environments research group.

Emma Caraher is a lecturer in biopharmaceutical sciences at the School of Chemical and BioPharmaceutical Sciences at Technological University Dublin. Caraher completed her PhD in 1998 at University College Dublin. Following this Caraher worked as a postdoctoral researcher at Ottawa Hospital Research Institute and Health Canada. She joined Technological University Dublin in 2003 and in 2008 secured a Science Foundation Ireland–funded Stokes lectureship. Caraher is program chair of applied biology, bioanalysis, and bioanalytical science.

Claire Lennon lectures on organic chemistry and spectroscopic characterization at the undergraduate and postgraduate levels. Lennon places a strong focus on embedding research in her teaching and across the undergraduate curriculum. Lennon has research interests in stereoselective organic synthesis aiming to develop novel green and sustainable methods, supervising PhD students in these areas. Lennon has been a member of the SURE Network since its inception in 2017.

Evelyn Landers is a lecturer in inorganic chemistry and analytical science. Landers coordinates the first year of seven programs across the departments of science and land sciences and is program leader for the common entry science program. Landers is the recipient of the Teaching Hero Award from the National Forum for the Enhancement of Teaching and Learning in Higher Education and the Union of Students in Ireland as well as a Higher Education Innovation award.

Eileen O’Leary holds a PhD in organic chemistry, a master’s degree in teaching and learning and a certificate in coaching and leadership. O’Leary is a member of the SURE Network and its Digital Badge Committee. O’Leary is seconded to the teaching and learning unit at Munster Technological University. She is leading the program Enabling Academic Transitions through Professional Development, aimed at encouraging new staff to take a reflective and student-centered approach to practice by incorporating active learning.

Geraldine Dowling’s research interests are in the fields of forensic science, chemistry education (universal design for learning, community-based learning, and problem-based learning pedagogies), analytical science, metabolomics, and nutrition science. Dowling held posts in various Irish government ISO17025-accredited laboratories for 12 years prior to entering academia. Dowling has trained staff and students in the revenue, customs, and toxicology fields as a forensic practitioner. She also undertakes consultancy and supervises postgraduate students.

Margaret McCallig is a lecturer in occupational safety and health with over 10 years of industry experience in the construction, engineering, medical device, and food manufacturing industries. McCallig holds a BSc in health and safety systems and an MSc for research in occupational hygiene from the University of Galway. McCallig Is currently pursuing a PhD in the area of physical stressors in neonatal intensive care units in Ireland.

Anne Marie O’Brien is a lecturer at the Technological University of the Shannon (TUS) and has been in academia since 2006. O’Brien has an MSc and PhD in toxicology and biochemistry and also holds a postgraduate diploma in learning and teaching. O’Brien chairs the European team-based learning (TBL) collaborative, the SURE Network TBL and Digital Badge Committee, and also is the chair of the TUS Digital Badge Committee.

Valerie McCarthy is a lecturer and program director for the BSc environmental bioscience program at Dundalk Institute of Technology (DkIT). McCarthy is director of the Centre for Freshwater and Environmental Studies at DkIT. McCarthy’s research interests include theoretical community and ecosystem ecology in freshwater systems, investigating the linkages between aquatic systems and their catchments. Her current projects focus on the use of high-frequency and remote-sensing technologies to monitor surface water.

Josephine Treacy is a lecturer at Technological University of the Shannon. Treacy’s qualifications include a graduate diploma in environmental chemistry, MSc in analytical chemistry, PhD in environmental analytical chemistry, diploma in field ecology from University College Cork (UCC), and MEd from Mary Immaculate College, Limerick. Treacy’s previous employment includes postdoctorate research at UCC and being an executive environmental technician with Cork County Council. Her research interests include analytical science, method development, education, and academic writing.