by KW Demes · 2019 · Cited by 3 — our framework for identifying, evaluating, and catalyzing research clusters and content/dam/sfu/vpresearch/pdfs/SRP/StrategicResearchPlan2016-2020.pdf.
95 KB – 15 Pages
PAGE – 1 ============
108 Demes, Murphy, Burt Catalyzing Clusters of Research Excellence: An Institutional Case Study Kyle W. Demes ˚e University of British Columbia Gail C. Murphy ˚e University of British Columbia Helen M. Burt ˚e University of British Columbia Abstract: Over the last decade, a wealth of empirical evidence has accumulated describing the merits of team-based, collaborative, and interdisciplinary research, including: increased productivity among researchers, greater citation impact, increased multi-sector engagement, and the generation of novel solutions to grand challenges. Funding agencies have accordingly increased the ˛equency of large-scale collaborative and partnered grant opportunities. However, institutional structures and processes can inadvertently limit team-based interdisciplinary research at universities. Research Clusters (which we de˚ne as interdisciplinary networks of researchers who organize to solve key challenges facing society) provide a ˇexible and adaptable mechanism to enable collaborative research across internal and external institutional boundaries. Versions of research clusters are now commonly a central theme in research strategic plans at universities, but there remain very few resources available to research administrators and leadership to support the development of their internal strategies and processes to support research clusters. Here, we describe our experiences developing and implementing initiatives to catalyze clusters of research excellence at the institutional level and reˇect on early successes and challenges. We share our ˛amework for identifying, evaluating, and catalyzing research clusters and provide speci˚c examples of internal processes and analytical tools that we have developed. Keywords: Institutional Strategy; Interdisciplinary Research; Research Clusters; Research Excellence; Research Facilitation Introduction Interdisciplinary collaboration among researchers generally increases productivity, generates higher impact work (Wutchy, Jones, & Uzzi, 2007), and results in the training of more collaborative researchers (Hampton & Parker, 2011). In light of the mounting evidence of the bene˜ts of collaborative research (e.g., Adler & Stewart, 2010; Beaver, 2004; Jones, Wutchy, & Uzzi, 2008; Lee & Bozeman, 2005), it is not surprising that collaboration is increasing across all research disciplines (Jones et al., 2008; Wutchy et al., 2007).
PAGE – 2 ============
109 Demes, Murphy, Burt Funding agencies and programs are following suit: because research clusters and teams generate high-impact knowledge and research that contribute to solving big open questions, the last 5-10 years has seen an increase in big-ticket research opportunities for team-science (Halliwell & Smith, 2011). Canadian examples include: Canada First Research Excellence Fund ($1.25B CAD since 2012; CFREF, 2017), Networks of Centres of Excellence ($560M CAD since 2012; NCE, 2017), Canada Foundation for Innovation (CFI team grants, $1B CAD since 2012; CFI, 2017), and dozens of intermediary team/partnership grants through other federal programs. Similar programs are found globally, e.g., NSF Engineering Research Centers (US), Centres of Research Excellence (Australia), and Horizon 2020 (European Union). In all of these granting programs, foundational components of the evaluation and selection process are the level of excellence of the individuals involved (i.e., traditional research metrics) and the strength and cohesion of the team (e.g., proven track-record of the group™s ability to work together as a team). ˚e Canadian NCE program even requires applicants to explicitly justify the synergies of the team that enable the award to have greater impacts than equivalent grants to individual researchers. ˚e role of institutions in these large-scale programs oˆen seems to be reduced to ensuring compliance, reporting, and providing matched funding for large team grants in the form of cash (e.g., Department, Faculty, and Central funds) and in-kind (administrative and reporting support, space, etc.) contributions. However, for the administration and leadership at an institution to enable faculty to facilitate the creation of truly transformative research programs and therefore to be more successful in these competitions, we need to proactively consider how to develop institutional practices that encourage the development and growth of such research clusters even before particular funding opportunities are known. A recent review of the bene˜ts for, and risks to, individual researchers participating in team grants (Canadian Academy of Health Sciences [CAHS], 2017) called for institutions to increase their support and recognition of team science participants. Indeed, establishing and supporting clusters of research excellence now commonly appears in institutional research strategic plans, in one form or another. However, despite a wealth of literature providing researchers with motivation to participate in team science and examples of previous successes (e.g., Adler & Stewart, 2010; Boardman & Ponomariov, 2014; Guise, Winter, Fiore, Regensteiner, & Nagel, 2017; Reichman, 2004; Stokols, Misra, Moser, Hall, & Taylor, 2008), minimal guidance is available to institutions on developing policies and processes to support the development of interdisciplinary clusters of research excellence. Over the last three years, we have piloted institutional support of the development of research clusters. In this paper, we suggest a framework for identifying, evaluating, and catalyzing clusters of research excellence. We describe and justify our approach, providing speci˜c examples of internal processes and analytical tools that we have implemented and end by discussing challenges and early successes of the program, summarizing lessons learned. We hope that this paper will be useful for other institutions and will spark further dialogue about the roles that institutional administration and leadership can play in supporting research clusters.
PAGE – 3 ============
110 Planning support for the development of research clusters Collaboration is a central theme in our institutional strategic plan (University of British Columbia, 2018) and enabling the development of collaborative research clusters is an identi˜ed core strategy. With this goal in mind, we set out to ˜rst understand baseline patterns in collaboration in interdisciplinary areas at the University, and then to identify any existing institutional barriers restricting collaborative approaches to research. In this section, we describe our approaches to those challenges and how these exercises were critical in designing our collaborative research support program. Scoping baseline collaboration in interdisciplinary research areas In larger institutions with thousands of faculty members, a lack of collaborative research initiatives might simply re˛ect a lack of awareness of other researchers working on related topics in other departments. To assess this issue, we analyzed the extent of pre-existing collaborations among researchers working on related topics and explored whether or not research clusters would develop organically around interdisciplinary topics following strategically designed networking opportunities. We chose four interdisciplinary research areas that had been identi˜ed by a recently established cross-faculty consortium whose mandate is to coordinate interdisciplinary health research and education: Indigenous Health, Mental Health, Ageing, and Diabetes: Lifestyle & Biology. First, we needed to identify researchers across the institution that could meaningfully contribute to research in the four interdisciplinary areas. We started by devising a series of descriptive terms that could be searched through our internal researcher indexing system to identify an initial list of researchers working in each area. For instance, in the case of mental health: fi mental fl OR fi psychological fl OR fi brain fl AND fi illness fl OR fi health fl OR fi wellbeing fl OR fi wellness fl; fipsychology fl; fipsychiatry fl. Examples of systems and databases to search when a centralized search function is not available include: institutional researcher webpages, supervisory records for research trainees, research funding and application tracking systems, ethics application databases, etc. Recognizing that even the most thorough search process misses key researchers (e.g., recent hires; researchers who use only technical words to describe their work; clinicians; digital ghosts), we distributed the draˆ list of potential researchers broadly among unit leaders to help identify any additional researchers. With a revised list of researchers relevant to each cluster, we were then able to gather evidence of existing research excellence and collaborative trends in each of the interdisciplinary areas, instead of by more traditional organizational units (i.e., faculty, department). To assess research activity and impact, we aggregated traditional research metrics on the individuals (e.g., research funding, major awards, publications, citation impact, media attention/reach). To inform which and how many researchers in the interdisciplinary areas had previously collaborated and whether patterns of collaboration were associated with institutional divisions (i.e., collaborations not happening across faculties), we assessed co-publications among the researchers identi˜ed. We used co-publications as a convenient proxy for collaboration because pairwise collaboration data can be mined freely from Web of Science or through third party paid soˆware. However, it is Demes, Murphy, Burt
PAGE – 4 ============
111Demes, Murphy, Burt important to note that publication metadata is not likely an accurate proxy in all ˜elds and will be most accurate in ˜elds where publications are the major research output. In circumstances where publications are not the primary research output, collaboration mapping exercises should be supplemented with appropriate data (e.g., co-supervised students, co-PI status on grants, or co-produced exhibits or performances). In the four interdisciplinary research areas that we surveyed, we found that 27-58% of the researchers identi˜ed had never collaborated with another researcher on the list (Table 1). Of the pre-existing collaborative links among researchers, only a minority (12-43%) crossed Faculty boundaries (Table 1). To elucidate the processes responsible for observed patterns in collaboration, explore whether signi˜cant interest in collaborative research existed, and solicit input on what sorts of institutional support would be needed to catalyze further collaborations, we invited all of the researchers identi˜ed to a collaborative research workshop for each of the four interdisciplinary areas. At these working sessions (attended by 22-55% of the researchers invited), we provided networking opportunities for researchers across the University, presented our baseline analyses of collaboration and research activities in the given research area, and discussed opportunities for and barriers inhibiting further collaborations. Participants unanimously expressed excitement towards new collaborations but emphasized that central support was needed to further develop collaborative research initiatives, in the form of seed grants, strategy support, partnership development, and government/community engagement. Interdisciplinary research theme Indigenous Health Mental Health AgeingDiabetes: Lifestyle & Biology Researchers identi˛ed 1108082166% without existing UBC collaborations27%58%32%50%% UBC collaborations across Faculties 12%37%43%31%% participating in research exchange 55%37%22%24%Table 1. Scoping Internal Collaborations In Four Sample Interdisciplinary Research Areas Designing support to increase collaboration Our initial scoping of collaborative research activity in the four interdisciplinary research themes revealed that many researchers had already collaborated in these interdisciplinary ˜elds in the absence of formal institutional initiatives, but also highlighted immense opportunity to support additional collaborations within and across faculties. To decide how best to support the development of collaborative research groups, we supplemented the feedback from the four working sessions with broader consultation within our research community (researchers and leadership across faculties) and an environmental scan of support programs at other institutions.
PAGE – 5 ============
112 Demes, Murphy, Burt Our initial environmental scan of comparator universities found that institutions vary in their de˜nition of interdisciplinary research clusters and consequently in their pathways to identifying and supporting institutionally recognized clusters of research excellence. Most universities de˜ne and organize research clusters by disciplines of institutional strength, determined internally or externally (e.g., Simon Fraser University, 2018), while others organize around institutionally identi˜ed Grand Challenges (e.g., University of California Los Angeles, 2018) or economic sectors (e.g., University of Toronto, 2018). However, we did not discover a single instance where University support for collaborative research was targeted at providing developmental support for grassroots initiatives and self-organizing research clusters. In spite of this apparent gap, our research community strongly advocated for such an approach and in the absence of model support programs to emulate, we created a novel support program. ˚rough on-going engagement with our internal research community, we settled on a more general (and discipline-agnostic) de˜nition of research clusters as interdisciplinary networks of researchers who organize to solve challenges facing society. Researchers comprising clusters should represent established leaders and rising stars in their areas of expertise working closely together as a unit on complex problems that oˆen transcend traditional departmental, institutional, or disciplinary boundaries. To develop structures and processes that would support the development of such broadly de˜ned research clusters, we described cluster support through a tiered development framework (Figure 1). Figure 1. Conceptual tiered framework for development of research teams from emerging clusters to global leaders, showing (on the leˆ) the characteristics of clusters at various developmental stages and (on the right) the catalytic activities needed to continue on a trajectory to becoming a world-leading research cluster. Our research cluster support initiative was designed to enable these catalytic activities.
PAGE – 6 ============
113 Demes, Murphy, Burt We ˜rst identi˜ed characteristics for each tier that should remain true for clusters working on any interdisciplinary research theme and the catalytic activities that would be needed to move from one developmental stage to the next. ˚e catalytic activities identi˜ed as essential to cluster development echo the types of support requested by the researchers at the four aforementioned collaborative research workshops. Many of these catalytic activities lie outside traditional academic research funding frameworks (e.g., multi-stakeholder partnership development), are not eligible costs in traditional funding models (e.g., hiring innovation development sta˙), and are not widely recognized in reviews of scholarly performance (e.g., community engagement). Without strategic planning and institutional resources supporting these catalytic activities, clusters are likely to maintain current research trajectories and run the risk of not advancing further. Our strategy for supporting the development of clusters of research excellence was therefore centered on supporting these activities. Implementing cluster support programs Securing funding for catalytic activities can limit cluster development when external grant opportunities for smaller, more ˛exible awards are not easily discoverable, require developed applications, and/or introduce signi˜cant time delays before cluster-catalyzing activities can occur. Furthermore, because the funding required for these activities does not include direct costs of research, we anticipated that relatively small awards could have large impacts on the clusters™ development. Balancing the desire to support the development of interdisciplinary research clusters with the recognition that our university cannot support all emerging research teams, we piloted an internal competition to provide small seed grants to self-organizing clusters: Grants for Catalyzing Research Clusters . In this section, we describe our approach to selecting which clusters to support and the rollout of our development support. Identifying and selecting clusters to support While institutions may have well-developed protocols for internal competitions, processes for selecting interdisciplinary research clusters have important nuances that require special attention. For instance, traditional research metrics vary across disciplines, and so aggregate metrics are not oˆen meaningful in the assessment of a single cluster or when comparing multiple clusters. Secondly, it may not be possible to quantify the relative contributions of cluster participants when the group includes a wide range of contributions (theoretical, system specialists, network connectors, etc.) and a variety of roles essential for the cluster™s functioning (e.g., leaders vs. coordinators vs. participants). Furthermore, cluster activities and goals should vary among teams, obviating direct comparison of goals and activities among clusters. Despite these challenges, an evaluation process is required to select which clusters to fund and to evaluate funded clusters over the course of their development. Our approach to evaluation of research clusters has been to focus on broadly-de˜ned criteria where clusters can construct their own cases for ˜t to criteria, using evidence relevant to their cluster.
PAGE – 8 ============
115 Assessing the cluster support program In the pilot year of the Grants for Catalyzing Research Clusters competition, we worked closely with clusters to provide guidance when necessary and to learn from the challenges and successes of individual clusters throughout their award period. Aˆer the ˜rst round of awards (12 months), we also formally assessed the development of individual clusters and the e˝cacy of the cluster support program by collecting and aggregating post-award reports. Here, we present our evaluation process, early outcomes of the cluster support initiative, and some re˛ections on the e˝cacy of the pilot phase of cluster support program. Evaluating clusters and early outcomes Because each cluster de˜ned its own goals and expected outcomes in their application to the competition, we based post-award evaluation of their development on their ability to meet self- identi˜ed goals. Clusters were given a post-award outcomes report comparing their proposed outcomes and actual outcomes, justifying deviations. ˚ey were also asked to re˛ect on their experiences and speci˜cally to elaborate on successes enabled by the cluster award and any challenges encountered in developing the research cluster. ˚is information was used internally to evaluate outcomes of the ˜nancial investment in the cluster pilot program (i.e., institutional reporting and accountability), to better understand the value of the program from the perspective of the researchers, and to identify opportunities for improvement in the cluster support program (i.e., changes to future competitions). ˚is post-award outcomes report is also attached to future cluster grant applications from the clusterŠin addition to their novel proposal being evaluated against the competition criteria, reviewers also rigorously evaluate how well outcomes of previous grants were met. Less than three years from the launch of our cluster support program, we have already observed impact on clusters and on our institution. At the cluster level, we have observed successful leveraging of GCRC funds with federal, industry, and charitable sources, increased collaborations across organizational units (e.g., Figure 2), the formation of new external partnerships, the creation of novel lines of inquiry, and (to our delight) researchers have reported an increased sense of community belonging and interest in collaborative activities. We view these bene˜ts to the clusters as bene˜ts to our institution, but additional institutional-level bene˜ts include: increased external funding, increased partnerships and community engagement, high return on investment for internal resources, expanded networking opportunities for trainees in clusters, increased communication and outreach, and early evidence of signi˜cant impact on research. Demes, Murphy, Burt
PAGE – 9 ============
116 Central provisioning of resources vs. providing cash While the catalytic activities each cluster undergoes ultimately depend on the goals and expected outcomes of the cluster, our initial competition revealed that most clusters share a few fundamental needs, including: communications support, coordination for networking activities, partnership development, funding intelligence, and strategic guidance from institutional leadership. ˚ese support needs can typically be best met (in terms of e˝ciency and quality) through the provision of centrally managed resources. In the second year of our cluster support program, we adopted a mixed support model that provides both institutional in-kind support and cash awards to help each cluster advance. Below, we describe support for developing clusters of research excellence that may be best met through central provisioning. Coordination . Research clusters universally require coordinated activities among cluster members, and with those activities comes increased administrative burden on the researchers. In emerging clusters, this may be limited to organizing quarterly or biannual collaborative working sessions with the larger group and regular meetings with cluster leaders. In these instances, support can be provided by institutional sta˙ who regularly organize meetings and events or graduate students involved in the cluster (who may have more bandwidth than faculty members for coordination). In established clusters, the coordination activities needed to keep the cluster running productively Demes, Murphy, Burt Figure 2. Chord diagram, showing collaborations among faculty members in an interdisciplinary research area (i.e., Language Sciences) across institutional divisions before and aˆer formation of a research cluster. ˚e pre-cluster diagram on the leˆ reveals that most collaborations (as co-authored manuscripts in SciVal) existed within faculties and only a few collaborations existed among faculties. ˚e diagram on the right depicts the pre-existing collaborations plus novels collaborations within and across faculties enabled by the formation of a research cluster (new collaborations are self-reported based on active research projects leading towards publication). ˚e total number of collaborations increased from 47 to 113 and the percentage of collaborations across faculty boundaries increased from 28% to 46%. Arts MedicineEducationScienceAppliedScienceArts MedicineEducationScienceAppliedScienceLanguage Sciences CollaborationsPre-catalytic activitiesPost-catalytic activities
PAGE – 10 ============
117 may require a full-time sta˙ member dedicated to, or hired by, the cluster. Communications . Developing and showcasing an internal and external narrative is crucial to the success of emerging clusters. Nearly every proposal we received in the ˜rst cluster competition requested funding to design and operate a web presence. Yet, it is unrealistic to expect an employee to work with each cluster separately: institutions will not likely have the resources to fund the development of multiple separate websites from scratch, and it is not generally sustainable to bring in a personal communications consultant for each cluster. Additionally, there is no guarantee that the web design and quality will match the institution™s standards. Instead, we provisioned the development of a web template for research clusters from our central IT department and supplied the template to the clusters, saving money and ensuring brand alignment. Our central communications teams then provide communications guidance and support during creation of the clusters™ websites and training of cluster members to support on-going maintenance. Partnership development . In large-scale federal competitions, partnerships across sectors are crucial because they ensure that downstream research users co-create research programs, further leverage funding investment, diversify funding sources, and facilitate knowledge mobilization and commercialization activities. For the same reasons, partnerships are essential to the sustainability of cluster activities. However, even the most highly collaborative researchers may work only in the academic sector. For some researchers that comes as a matter of personal preference, but for many others it may occur because of barriers (actual or perceived) limiting cross-sector exchange. Once clusters have identi˜ed their goals and challenges, we are able to connect them with sta˙ experienced in those areas, for instance: partnership development o˝cers (to help with partnership development, innovation plans, and knowledge mobilization pathways [e.g., Phipps, Jensen, Johnny, & Poetz, 2017]); Community Engagement Specialists (in situations where community engagement support is required); Research Funding Development O˝cers; and Government Relations O˝cers (when provincial or federal partnerships are key). Established clusters may eventually require their own Strategic Partnerships O˝cer, but centralized support can get most clusters through the ˜rst stages of partnership development (strategic planning and engagement). Cross-cluster exchanges and workshops . In the ˜rst phase of the cluster support program, we met with each of the teams to discuss individual goals and strategies to achieve them. ˚e individualized meetings were helpful in the early phase of the cluster support program, but required signi˜cant time investment from institutional leadership. General strategies began to emerge; for the most recently funded clusters, we instead hosted a workshop bringing together all of the clusters to collectively (1) set the vision for the cluster support program (2) share successes and lessons learned among clusters and (3) discuss the e˙ectiveness of and suggest improvements to the cluster support program. ˚e workshop still allowed for institutional leadership to help guide cluster development, but also provided the ˜rst venue for clusters to interact and learn from each other™s challenges and successes. In a post-workshop evaluation survey, participants unanimously supported the workshop model and have asked that we provide additional programming bringing clusters together to share knowledge in areas of relevance to all clusters (for example: partnership development, governance models, and knowledge mobilization). Demes, Murphy, Burt
PAGE – 11 ============
118 Top-down vs. bottom-up approaches Our institutional approach to supporting research clusters is to identify self-organizing clusters and support grassroots collaborative and interdisciplinary research teams. ˚rough bottom-up processes, natural leaders emerge and, in our early experiences, this is crucial for sustained cluster management and growth. Bottom-up approaches also allow creative linkages to develop that administration could never have imagined, and would never design, (e.g., a violinist and a climate data scientist) and these are the linkages that generate truly novel lines of inquiry. Bottom-up approaches may also have an added bene˜t of increased participation by trainees and graduate students (though still a preliminary observation, we speculate this may result from organic relationships among researchers). Finally, supporting self-organizing clusters does not require the extensive proactive background e˙orts by administration that top-down approaches do (see Scoping baseline collaboration in interdisciplinary research areas section above), and the onus of demonstrating research excellence and the merits of collaborative synergies can rest with the clusters themselves. On the other hand, by identifying and promoting areas of priority, an institution can bring additional opportunities and resources to researchers that might not occur without the institutional branding. For instance, facilitating the development of clusters around external priorities or funding opportunities where they are not organically developing otherwise can bring resources to the researchers and institutions that otherwise would not exist. In this scenario, we see the best role of administration as providing strategic support to help mobilize and support the development of clusters in a given research area. Speci˜cally, administration and leadership can assist with connecting researchers across departments/faculties (as described for the interdisciplinary health clusters above), provide examples of frameworks for collaborative research initiatives, help remove barriers to collaboration identi˜ed by researchers, and provide incentives to researchers who wish to develop a research cluster in the area of interest (e.g., GCRC competition). Following our e˙orts to bring together researchers from the four identi˜ed interdisciplinary themes, three of the groups submitted an application to the Grants for Catalyzing Research Clusters competitionŠtwo of these applications were successful and have started developing a cluster through our bottom-up support processes. Nonetheless, bottom-up approaches to organizing research clusters present their own challenges. Firstly, researchers are rarely incentivized, ˜nancially or through award recognition, to pursue cluster activities (Van Rijnsoever & Hessels, 2011). Consequently, researchers may choose to pursue activities that lead to immediate recognition (Landry & Amara, 1998) instead of activities required to organize and manage research clusters, which may be perceived as detracting from publications, grant writing, student training, etc. Secondly, securing the type of funding that researchers need to support cluster growth is frequently a challenge since most important cluster-organizing activities are generally not eligible costs in traditional research granting programs. Finally, the necessity to secure separate funding opportunities for cluster development may signi˜cantly delay cluster development (e.g., application processing times and constrained funding windows). Demes, Murphy, Burt
95 KB – 15 Pages