Introduction

Inter- and trans-disciplinary (ITD) research has expanded in recent decades and there is growing evidence that ITD research helps solve complex societal problems and achieve societal aspirations (Irwin et al. 2018; Frantzeskaki and Rok 2018). Interdisciplinary research integrates disciplinary knowledge to create new scientific understanding while transdisciplinary research also incorporates knowledge and participants from beyond science to engage in the research process and inform policy and practice (Lang et al. 2012; Buizer et al. 2015). Alongside the growth in ITD research and application, organizations are being established to foster ITD research and to train students for new ITD careers (Huutoniemi et al. 2010; James Jacob 2015). These organizations are helping to meet growing demands on universities and other research institutions to demonstrate meaningful impact in meeting complex societal and environmental concerns (Caves 2020).

Urgent sustainability challenges require ITD leadership. Future leaders can benefit from lessons learned (Reid and Mooney 2016; Annan-Diab and Molinari 2017). We assert that such lessons can benefit from diverse experience with both successes and failures of past and on-going ITD efforts. Despite progress in developing ITD research programs, young researchers are still confronted with traditional incentives that discourage ITD activities (Bark et al. 2016; Brister 2016). To succeed, new leaders should be trained to navigate the problem-oriented nature of ITD research and to transform academic and research institutions to encourage rather than discourage ITD approaches, which is especially crucial for the solution-orientated realms of sustainability (Liu et al. 2015; McDaniels and Skogsberg 2017; Gordon et al. 2019).

Lessons described in this paper are based on the thoughts, reflections, and experiences of 20 leaders of ITD organizations from nine countries (Palmer 2018) elicited and synthesized over several workshops. The objective is to advise leaders across various ITD fields and provide helpful justifications for universities, funders, and governments to support ITD initiatives. This is not a comprehensive ‘handbook’ on successful ITD leadership. Rather, it distills three lessons that current and future leaders of ITD initiatives should recognize and marshal resources to address: (i) the multiple pathways to successful programs; (ii) cultivation of appropriate leadership; and (iii) resources necessary for success.

Pathways to inter- and transdisciplinary sustainability organizations

Pathways to successful ITD organizations generally fall into two categories: some were created as ITD organizations by design (Box 1) while others evolved over time, often merging disciplinary units together (Box 2). The descriptions in Boxes 1 and 2, (along with Boxes 35) show how different organizations view themselves in relation to interdisciplinarity and/or transdisciplinarity and how they operationalize those approaches. Many of us started as disciplinary scientists and followed different paths to ITD, in the process creating a range of programs that approach sustainability challenges in various ways.

Both kinds of ITD organizations can benefit from a real-world focus. The leap from interdisciplinary to transdisciplinary programs can be accelerated by focusing on the public good or the needs of external partners (Fig. 1). Mission-oriented science requires the integration of multiple forms of knowledge and the expertise of end users. To mitigate poor air quality, for instance, requires the integrated expertise of many scientists and stakeholders to comprehend the dynamics of air quality, effects on humans and environment, and to build viable solutions, including atmospheric scientists, transportation modelers, public health officials, environmental economists, automotive engineers, and communication specialists. In the United States, federal transportation funds are tied to air quality, which incentivizes functioning ITD teams to address this as a public health and economic issue (https://www.fhwa.dot.gov/environment/air_quality/). This example shows the value of a problem-oriented and solution-oriented ITD approach with stakeholders connected to specific public good outcomes (Miller et al. 2014).

Fig. 1
figure 1

Two dimensions of integration involving scientific research. Scientific integration, represented on the vertical axis, moves from disciplinary focus, through inclusions of multiple disciplines in a study, to the integration of those multiple disciplines in question asking, methodology, conclusions, and application. The final step of scientific integration is defined by its linkage with societal and political needs. Transdisciplinarity requires that various kinds of participants or stakeholders, here signified by communities, decision makers, and formal authorities (shown here on the horizontal axis), must be involved in posing questions, aligning methods, and assessing outcomes. The move from disciplinary science through transdisciplinary scientific-social research and intervention has been defined by the US National Science Foundation as convergence science. Some scholars use the term convergence to refer to deep integration in the scientific sphere as well (e.g., Irwin et al. 2018)

ITD organizations are motivated in various ways. Several universities have developed ‘grand challenges’ to encourage ITD research, education, and partner engagement. These programs may be assembled across existing units within academic and research institutions or may bring together academic and mission-oriented partners. One example is Sustainable Los Angeles. Working across multiple colleges at UCLA, the university provided seed funds for research and education programs to help Los Angeles supply 100 percent renewable energy and 100 percent local water by 2050 while improving ecosystem health (Gold et al. 2015). The ambitious goals and long time horizon can inspire ITD collaboration because they address concerns that matter and have the potential of making a difference to the quality of life in a major city.

However, challenges do not have to be ‘grand’ to inspire ITD activities. Drawing more limited boundaries in space and time can encourage teams to tackle the inherently complex social–ecological–technical systems of sustainability challenges (Palmer et al. 2016) and short-term, smaller scale challenges can be equally energizing for researchers. Mitigating urban ‘food deserts’ is an example of a local need around which ITD researchers can band together for quick results, as food production in urban systems benefits from an ITD approach toward sustainability and social equity (Brinkley et al. 2017). For some researchers, the tangible, local, and immediate problems may be more motivating for ITD than global grand challenges. These fine-scaled ITD problems also allow flexibility, encouraging teams to form and reorganize according to the expertise needed rather than to maintain a persistent and potentially costly organization.

Rapid response to crises is another motivation for creating ITD projects and teams. Hurricane Sandy laid bare the inadequacies of New York City’s preparation for extreme weather events (Rosenzweig and Solecki 2014). Academic institutions and local and state governments responded with an integrated resilience plan that joined expertise from research institutions, local and state agencies, community organizations, and the private sector with the explicit mission of making the metro area more resilient to major storms. The New York City Mayor’s Office of Recovery and Resiliency was created in response to the devastating hurricane, which claimed 147 lives and caused $71 billion in damages (https://www.fema.gov/mat-results-hurricane-sandy). This office works closely with academics to develop and implement science-informed resiliency efforts to better prepare the city for future impacts of climate change. The ITD approach is reflected in the many dimensions of plans that go beyond physical infrastructure to include financial instruments, social vulnerability metrics, emergency planning with community organizations, and public health readiness. Advised by the New York City Panel on Climate Change, this office includes a scientific board that works in close partnership with the Center for Climate Systems Research within Columbia University's Earth Institute.

The variety of trajectories of ITD organizations suggests that a diverse roster of skills is needed for their leadership. Successful leaders must develop strategies and techniques for adapting to changing institutional situations and practical contexts. From our collective experiences, we summarize the skills below. In an earlier article (Gordon et al. 2019), we reviewed a broader range of skills involved in leading ITD organizations. Here we focus specifically on skills required for adapting to change, which is a major requirement for ITD organizations.

Cultivate appropriate leadership qualities and skills

Leaders of ITD organizations need the qualities that make any leader successful—creativity, humility, open-mindedness, long-term vision, and being a team player. In addition to these general qualities, ITD leaders require skills and attributes that are specific to inter- and trans-disciplinary interactions and that have the capacity to be transformative with real-world impacts. ITD leaders often must be more persuasive than other leaders to convince researchers to follow the unsettled and novel pathways of ITD research. Qualities that have been most transformative in our own journeys as leaders are the ability to create and foster: vision beyond status quo, collaborative leadership and partnerships, shared culture, communications to multiple audiences, appropriate monitoring and evaluation programs, and perseverance. It is important to note that these leadership qualities, skills, and attributes evolved over time. We did not begin our positions with each of these at hand; rather, as our roles and institutions grew, so did our leadership in these areas. Often, no individual has all of these qualities so it is also important to build a team that incorporates the full suite of these abilities.

Vision beyond status quo

Sustainability necessitates long-term vision that goes beyond the status quo (Matson et al. 2016). The complexity and scale of the challenges we confront require working and planning at time scales longer than the tenure of individual leaders. ITD leaders need the ability and creativity to see beyond existing conditions to imagine what is possible, what is needed, and how to get there, while integrating multiple stakeholder insights. We have operated in institutions that are sometimes slow to move and hesitant to change, yet we laid out strategic long-term plans that defied existing structures to facilitate the ITD goals we articulated. Ashoka Trust for Research in Ecology and the Environment (ATREE) in India provides an example of the vision and evolution required to move beyond the status quo (Box 3).

Collaborative leadership and partnerships

Leadership is a multidimensional process. It is important to know how to share leadership and to support the many roles required for sustainability work. Designated leaders must sometimes act as supporters, or as champions outside the organization. Appreciating and practicing different roles is a key cultural habit for leaders of ITD organizations. In some circumstances, ITD leaders must act as facilitators, ‘de-centering’ the role of academia to effectively prioritize the voices, concerns, and ideas of diverse stakeholders (Alonso-Yanez et al. 2019). Shared leadership may mirror necessities within ITD centers. Because of the multiplicity of leadership attributes, a team of more than one leader may be appropriate. The shared leadership model—as for example practiced by ZTG in TU Berlin and by the Wrigley Institute at ASU (Box 1)—also supports the idea of non-hierarchical working-structures, raising the credibility that partners outside of academia are fully accepted for their specific knowledge and perspectives.

Effective collaboration can catalyze problem analysis and address the broad range of elements that must be considered. Collaborative methods can be central for improving use of natural resources shared by society (Talley 2016) while also enhancing governance and accountability. Nevertheless, it is important to consider how and when to collaborate with partners. There is a tendency to want to partner with everyone who is interested, particularly in sustainability where the challenges are complex and sense of urgency is strong. However, in our experience, the most effective leaders have developed clear processes for assessing whether to partner and how to measure success of partnerships. There are transaction costs to engaging partners as every partnership is a decision to allocate time and money. If not done carefully, partnerships can drain resources, taking intellectual and financial capital from other more fruitful activities. Before engaging with partners, it is important to ask key questions: Are the partner’s objectives and proposed activity aligned with our strategy and operational plans? Can we establish and commit to a clear governance structure and resourcing? Is there enthusiasm from faculty and researchers? Is the proposed engagement intellectually interesting and impactful in the field? When the answers are yes, strong leaders invest to build participation, trust, excitement, and outcomes. Two examples of effective partner engagement are described in Box 4.

If an ITD organization identifies a strategic partner, it is important to engage them as much as possible from the beginning of the research process (Herrero et al. 2019). However, such participatory processes have challenges that need to be crystal clear to everyone from the outset, thereby avoiding frustrations from results that might not meet expectations (Stokols 2006; Disterheft et al. 2015). Clear articulation of the possible trade-offs between the scientific ideas and participatory methods is important to establish. A transparent set of scientific tools, visualized well across research phases, and a clear integration of different ways of expressing knowledge, including the follow-up of the results and the feedback to the stakeholders or to the practitioners, are of central importance (Mielke et al. 2017). Effective stakeholder engagement requires open access to data and knowledge so that key information is not restricted to the academic team members (Kondo et al. 2019). This approach provides informed options for decision processes while also using feedback from stakeholders to advance a specific research agenda. The development of the research or solution should be co-planned with stakeholders as this facilitates a way to effectively design and to measure outcomes. Determining outcomes with stakeholders increases the chance that results will be taken seriously and be implemented, while also incentivizing communities to help with gathering data (Heinzmann et al. 2019). However, lack of a concrete framework or model for carrying out a transdisciplinary sustainability project can increase potential for failure or reduce effectiveness of implementation (Smetschka and Gaube 2020). The risk associated with failing to meet anticipated objectives can be minimized by regularly revisiting goals and progress with all interested parties within an agreed upon evaluation framework (Williams and Robinson 2020; Turner and Baker 2020).

Shared culture

Because sustainability and ITD science are relatively new, attention to culture is crucial for future leaders (Longino 1990; Johnson and Xenos 2019). Culture includes norms and habits of mind that affect problem selection, research approaches, pathways of application (Pickett et al. 2007) and adapted solutions. Norms can limit or promote specific research and outcomes. Indeed, the traditional culture of science has promoted narrow disciplinary and academic outcomes (Capra 1983). Even tacitly adopting a familiar scientific culture may thwart the interdisciplinarity that sustainability requires.

Culture usually exists in the background, yet to succeed, leaders of ITD organizations must promote a new scientific culture that values and promoted ITD research and activities. They may have to guide their organizations through articulating and establishing new norms, finding ways to reward appropriate collaborative behaviors, and discouraging lapses into cultural norms of a narrow disciplinary past (Brown et al. 2019). Among the most significant cultural features supporting ITD success is a sharing attitude. This feature may be difficult for those trained in science as an individual, rule-based pursuit. In particular, the traditional idea that an individual researcher owns data can impede robust ITD research (Willig and Walker 2016). Consequently, sharing data in clear, well-documented, understandable formats is an important cultural norm for interdisciplinarity and transdisciplinarity.

Communications with multiple audiences

Communication is respectful listening coupled with clarity of exposition. Oral, written, quantitative, and visual modes may be combined in many ways. Conducive places for discussion, scheduled and serendipitous meetings, and access to multiple tools are all parts of effective communications in ITD organizations. Effective communication requires deep respect for other ways of knowing and social practices, especially as ITD endeavors engage increasingly diverse stakeholders. Because sustainability problems are complex, successful ITD leaders find it helpful to have a clear understanding of the logic of constituent or partner institutions and the incentives that drive stakeholders and find ways to mediate, resolve conflicts, and develop common ground priorities (Barrett et al. 2019).

Effective communication within the organization is also required to build and maintain networks uniting disciplinary expertise for ITD challenges. Communication with senior leadership of larger organizations that may host ITD centers is required to sustain buy-in while minimizing institutional friction. Leaders should adopt a variety of participation methods to integrate local expertise. Communication requires the ability to convene and engage across disciplines, to convince others, and understand how to excite researchers to participate in ITD when doing so is outside their norms (Box 5).

Appropriate monitoring and evaluation

Properly evaluating ITD research remains a challenge. It may be tempting to set over-ambitious goals. Failure to achieve such goals demotivates researchers, distances stakeholders, and disappoints funders and clients of ITD organizations. Some examples of overpromising include fundraising across too broad a scope of activities, with none funded adequately; trying to do too many things, which leads to ‘dropped balls’ and disappointed partners; priming junior faculty for leadership, when such positions are not available; and relying on students to produce deliverables, but not informing the funder that this necessarily includes an education component that differs from a consultancy. Back-up support also needs to be available if students fail to complete a project. Ambitious goals can be valuable in motivating innovative ITD work, but appropriate expectations need to be set from the beginning and revisited frequently with internal and external stakeholders. Establishing a flexible, dynamic evaluation and monitoring framework as close as possible to the beginning phases of programs can greatly assist the management of ITD programs, freeing up time for leaders to pursue other responsibilities. In addition to evaluating program outputs and outcomes, the framework should evaluate the effectiveness of ITD processes themselves so that learning and development can take place in ITD teams (Holzer et al. 2018).

Perseverance

As sustainability programs and ITD research inherently challenge the status quo, effective leaders must be able to articulate a shared strategy and persevere against a tendency to regress to traditional, disciplinary approaches. The normative, practical nature of sustainability, its breadth of concerns, and its shifting or inexact definitions can invite skepticism from established scientific disciplines. The tendency for scientists to believe their own disciplines have higher value than other disciplines can also fracture ITD programs. All of these dynamics are acute in the early days of ITD program development.

Leaders who persevere and continuously communicate the value and role of ITD programs and research provide time for skepticism to erode, for disciplinary scientists to develop empathy for other ways of knowing, and for the creation of shared research, education, and outreach products that demonstrate the value of ID and TD (Kelly et al. 2019). Examples from Columbia University’s Earth Institute, Arizona State University, and the University of Minnesota’s Institute on the Environment illustrate the necessary perseverance around the establishment of new structures and celebration of their achievements, whereas the example from Baltimore Ecosystem Study (BES) illustrates perseverance within team processes (Box 5).

Resources for success

Resources needed to enable success in positions of leadership within ITD organizations fall into five categories: (1) intellectual resources; (2) institutional policies; (3) financial resources; (4) physical infrastructure; and (5) governing boards. First, leaders need to build and sustain mechanisms for recognizing and engaging intellectual expertise outside the disciplinary academic discourse (Bammer et al. 2020). This includes engaging all partners—those within one’s home institution, other academics, and a broad array of stakeholders. Such engagement elicits new ideas, perspectives, and initiatives, contributing to the dynamism that is so important to ITD research. Tapping outside experts for short engagements through visiting appointments, internships, fellowships, post-docs, speakers, or program evaluators provides concentrated value and broadens reach and scope without the long-term budget commitments of adding permanent staff (Trimble and Plummer 2019).

Secure funding to support early career researchers, including doctoral students, post-doctoral fellows, and junior faculty is central for the longevity and success of ITD research. Many junior scholars, some trained in ITD, are attracted to the mission-oriented nature of ITD programs and institutes. They want to help solve sustainability problems and need roadmaps to consult. Traditional departmental training will not be sufficient to succeed in ITD scholarship without strong mentoring, explicit incentives to engage, and guidance on best practices. Graduate students and post-doctoral fellows should be given opportunities to share leadership, especially when their ITD training can facilitate multi-investigator and stakeholder projects that involve individuals with traditional, disciplinary training or single-issue agendas (Fam et al. 2020).

Second, leaders must be aware of the role of institutional infrastructure and how to foster policies that result in collaborative relationships, non-traditional outputs and outcomes, engagement with practitioners, celebration of ITD work, and career progression from recruitment to promotion. Columbia University’s Earth Institute, for example, developed practice-oriented guidelines for appointment and promotion for its research scientists, with explicit guidance on new metrics and criteria for activities outside the scope of traditional research and how to judge them. Spokespersons for ITD must not be seen as competing for funds within the organization but as adding value to existing programs. Linking ITD activities to the core culture of the institution can promote ITD work. As an example, courses co-taught by faculty from different disciplines or courses co-taught by tenured faculty and industry or non-profit professionals can lead to the co-production of novel approaches to solving topical, real-world problems.

Third, leaders need to operate based on the reality that many ITD research organizations are soft-money institutions. Long-term grants for ITD research are rare, so developing nimble ways to leverage limited budgets is critical. Experimenting with different seed funding for interaction and collaboration, such as those tied to specific outputs, can help expand into larger programs and broaden participation. Buying out faculty time or borrowing individuals for part of a year for leadership or collaborative activities can relieve constrained funding. Utilizing non-financial resources, such as staff time for proposal support, project management, or communications assistance, can also attract ITD participants from across and between institutions (Cundill et al. 2019).

However, it is important to be aware that proponents of disciplines may be openly hostile to ITD programs because they see them as direct competitors for funding. Attempts to compensate by ‘buying’ contributions from researchers in discipline-based departments are not always successful. Short-term income generation and time pressure are often achieved at the expense of longer term relationship building. Some organizations have found endowments to be key in allowing them to function, but maintaining a funding stream through endowments can bring its own challenges, depending on investment returns and broader economic conditions.

Fourth, the physical place and space of an ITD organization is vitally important. Co-location of scholars from different disciplines sparks serendipity—encouraging the hallway conversations and spontaneous brainstorming over coffee breaks—that inspires ITD work and reduces the need for formal meetings, seminars, and workshops (Lyall 2019). Where co-location is not possible, technology to engage distant partners electronically is an important aspect of the physical place. Co-location with external stakeholders can generate easy access to policymakers and facilitate the co-production of knowledge and solutions to real sustainability problems. One example is the Sustainable Cities Network, housed in the ASU Wrigley Institute, which brings together sustainability officers and other practitioners from municipalities and tribal governments from across the State of Arizona (https://sustainability.asu.edu/sustainable-cities/). The network identifies real-world sustainability problems as opportunities for research, education, and outreach. An example of an established ongoing program that resulted from this network is Project Cities, which links courses from across Arizona State University to solve specific community solutions, with monetary and other support from the participating cities (https://sustainability.asu.edu/project-cities/).

Finally, trustees, governing boards, or members of advisory bodies are important ITD resources. Supportive boards can advocate across their networks and help leaders motivate employees. However, if the Board is anchored in the past, represents legacy organizations, or is loyal to narrow disciplines, a leader must be steadfast in developing ITD strategy. Board members are often eminent leaders with large networks. However, their diversity and power require a subtle hand. They can be aloof, moderately engaged, or deeply involved depending on their defined responsibilities, individual interest, and how well the leader engages them. For example, leaders of Ashoka Trust for Research in Ecology & the Environment (https://www.atree.org/) have been deeply involved with board members as advisors, sounding boards, and fundraisers. Consequently, the organization has built a healthy endowment supporting core staff and functions. This endowment, partly gifted by the board, has allowed the institution to attract reputed faculty, take risks, and be innovative.

Conclusion: an inclusive framework for sustainability leadership

The work of ITD organizations is informed by theory and practice. Sustainability science has a rich and evolving canon and its work is equally motivated by practical concerns. Governments, non-governmental organizations, community groups reflecting different cultural backgrounds, and advocacy organizations all need ITD understanding of sustainability (Kates 2011).

The insights from our collective experience are tempered by the knowledge that the world is complex and rapidly changing. While we draw on diverse past trajectories, we acknowledge that the challenges of the future cannot be met based on past experience alone. The rapid proliferation of the coronavirus pandemic in early 2020 is a case in point. Surprises happen and ITD leaders need to be prepared to pivot, sometimes quickly, to meet changing priorities.

Our aggregate experience reflects many institutional contexts, practical motivations, and career paths. In addition, the variety of issues in sustainability we have addressed has exposed us to a wide range of approaches to education, research, engagement, and application. Our insights have also drawn on both our failures—addressed anonymously—and our successes, often summarized in the examples (Boxes 1–5). We hope this richness of experience can help those who will lead, or plan to organize, a transdisciplinary organization in the future. Our experience by no means reflect the full breadth of ITD challenges and successes, but the diversity of experiences represented in this group and the case studies we present in the boxes we believe has very real value.

The practical motivations of ITD work demand extensive consultation and stakeholder engagement. While an academic foundation is important, it is not enough for success. Indeed, the transdisciplinary practice of sustainability must be action-oriented, focusing on what people and institutions care about. ITD research and its implications must be understandable to all participants. Transparency, co-production of research and interventions, and communication that is effective for all stakeholders, are key attributes of the framework (Newton and Elliott 2016). At the same time, inter- and trans-disciplinary approaches provide opportunities for engaging diverse stakeholders and viewpoints, with the potential of increasing success of research to action by creating buy-in for a broad scope of participants (Belcher et al. 2019).

Inter- and transdisciplinary work must operate on various timeframes. Some participants may require near term actions, while other organizations may desire medium- to long-term outcomes. All participants should be aware and informed about the long-term implications of their sustainability decisions. Accordingly, inter- and transdisciplinary work must link multiple time scales.

Finally, the structures and practices of ITD work are not chiseled in stone. It must be possible to modify institutional goals and processes as needs change. Flexibility, a learning attitude, and open-mindedness focused on the future complete the framework for leadership of ITD organizations that can meet the challenges for a sustainable future.