1 Introduction

The Kyoto Protocol (KP) was adopted in 1997 in the hope of mitigating the issue of climate change and global warming. Despite being an ambitious international treaty aiming to reduce greenhouse gas (GHG) emissions to a safe level, it has received a high level of criticism regarding its design and skepticism regarding its effectiveness. For example, Copeland and Taylor (2005) suggest that re-examination of the KP is needed because trade theory was neglected in the design. In addition, Zhang and Wang (2011) find that the Clean Development Mechanism, which allows industrialized countries with KP commitments to reach their targets by using carbon offsets from developing countries, does not lead to a decrease in sulfur dioxide emissions. In contrast, several empirical studies show that the protocol has been successful in reducing carbon emissions in legally bound countries (Aichele and Felbermayr 2013a; Grunewald and Martinez-Zarzoso 2016; Maamoun 2019). However, some researches indicate that the decrease in GHG emissions is not necessarily a success, given evidence of carbon leakage (via trade of high carbon content goods) (Aichele and Felbermayr 2012, 2015). Further, Aichele and Felbermayr (2013b) demonstrate that the Kyoto commitments lead to a comparative disadvantage in manufacturing sectors, especially pollution-intensive ones. As a result, the overall picture of the influence of the KP remains unclear.

This paper investigates the effect of Kyoto commitments on trade in environmental goods (EGs). EGs are defined as products that can “measure, prevent, limit, minimize or correct environmental damage to water, air and soil, as well as problems related to waste noise and eco-systems" (OECD 1999). In short, EGs are regarded as products with environmentally beneficial characteristics. EGs are categorized into three groups: pollution management, cleaner technology and resource management. Products in the pollution management concentrate on cleaning the pollution, and are further divided into sub-categories based on the pollution target (e.g. air, waste, noise).Footnote 1 The remaining two groups, however, include products that reduce or prevent emissions and use resources more efficiently, for example solar panel.

Studies about the trade flow of environmentally friendly products is relatively scant in the literature. Although previous studies examine these products, they mainly focus on one aspect of EGs (e.g. energy, solar, and wind technology) and do not find causal evidence for the effect of the KP (Costantini and Crespi 2008; Miyamoto and Takeuchi 2018). In contrast to previous work, this paper studies the industry of EGs, yet restricts the examination to products relevant to the purpose of dealing with GHG emissions: air pollution control, environmental monitoring, cleaner technology, and renewable energy subgroups.Footnote 2 The statistics of trade of these products (displayed in Fig. 1) suggest that this market has experienced fast-paced growth, especially after 2000. The world trade of these products increased significantly in the early 2000s, which coincided with the ratification period of the KP. A closer examination of Fig. 2 shows that, during the ratification period from 2001 to 2004, the export growth of Kyoto countries outperformed that of non-Kyoto countries, while this trend was the reverse previously. From 2008, the export growth of the two groups performed fairly similarly. Therefore, this suggests that KP ratification plays a role in the export of EGs.Footnote 3

Fig. 1
figure 1

World trade of EGs during 1990–2012

Fig. 2
figure 2

EG export growth of Kyoto and non-Kyoto countries during 1991–2012

In this study, I follow Aichele and Felbermayr (2013b) and choose the unit of analysis as an exporter–importer pair. Using the bilateral trade of EGs, I apply the generalized synthetic control method (GSCM) of Xu (2017) to evaluate the causal effect of the KP on the bilateral export of EGs. In particular, I construct the counterfactual of trading pairs with Kyoto commitments and estimate the average treatment effect on the treated (ATT) on exports. My findings indicate that the protocol commitment leads to an average 29 to 30% increase in the exports of committed countries. The results are robust and consistent in a number of robustness checks. The paper further examines the top two exporters (Germany and Japan) individually and also reports positive effects of the KP on exports of these countries.

This paper contributes to the literature in two important ways. First, it is the first study to provide evidence for the EG trade effect of the KP. Export performance in EGs has been shown to improve after the ratification of the KP. This result aligns with the finding in Costantini and Crespi (2008) although it only suggests the correlation. Second, the paper applies the newly developed methodology, the GSCM, in the gravity model context to estimate the treatment effect on trade. The well-known approach to investigating the trade effect in the international trade literature is to use either the gravity model with fixed-effects or matching difference-in-difference (DID) (as in Aichele and Felbermayr (2013b)). Compared with the DID and synthetic control approach, the GSCM has two major advantages. First, based on the concept of the original synthetic control method (Abadie et al. 2010, 2015), the GSCM also constructs the counterfactual of the treated countries from the untreated ones, so that the treated and synthetic countries have similar outcomes in the pre-treatment periods. In this way, the synthetic control approach can overcome the difficulty of ensuring the validity of the “parallel assumption." Second, the GSCM integrates the synthetic control method and the interactive fixed-effect model by Bai (2009) to synthesize the counterfactual of the treated trading pairs. This allows the method to analyze multiple treated units simultaneously, instead of a one-by-one unit analysis, and provides classical standard errors for statistically significant inference.Footnote 4

My results have important policy implications. Since its first adoption, the KP has been a controversial topic. My results indicate that the KP could have a pro-green trade effect by improving the export performance of the committed countries in terms of EG production. Therefore, alongside findings on the effectiveness of the KP (Grunewald and Martinez-Zarzoso 2016; Maamoun 2019), my findings have implications regarding considering the participation of more countries in the KP, such as China and India, as well as potentially stronger commitments. Further, these findings offer hope to the future of international cooperation regarding environmental issues, such as the 2015 Paris Agreement.

The rest of this paper is presented as follows. Section 2 provides background information on the KP, industry of EG and a brief review of the relevant literature. Section 3 presents the framework and methodology, followed by the data description in Sect. 4. Section 5 discusses the results and robustness checks, while Sect. 6 concludes this paper.

2 Background

2.1 The Kyoto Protocol

The KP was adopted in 1997 as a commitment to reduce GHG emissions and an attempt to slow global warming and fight climate change. With the ratification of Russia and Canada in 2004, the KP entered into force in 2005. Although there are currently 192 parties to the protocol, only a group of countries listed in Annex B of the protocol are committed to legally binding targets.Footnote 5 According to Article 3, these countries agreed to reduce their GHG emissions to at least 5% below their 1990 levels in the first commitment period (2008 to 2012).Footnote 6Footnote 7 On December 21, 2012, the Doha Amendment to the KP was adopted. The amendment requires acceptance from at least 144 parties (excluding the European Union) for entry into force, yet this threshold was not achieved until October 2020.Footnote 8 This results in ambiguity of the validity of the KP beyond 2012, as well as the Doha Amendment.

In addition to domestic emission reductions as a mean of meeting carbon emission targets, the KP introduced three flexible market-based mechanisms: Clean Development Mechanism (CDM), Joint Implementation (JI), and Emissions Trading (ET). In terms of ET, countries can trade initial amount of permitted emissions. Regarding the other two mechanisms, they involve investment in emission reduction projects in host countries. In return, committed countries will earn emission reduction units, which can be counted towards meeting their Kyoto targets. The difference between JI and CDM is host country. In particular, under JI scheme, host country is another Annex B country while CDM focuses on non-Annex B countries, especially developing economies.

As with other IEAs, since its adoption, the KP has received criticism from experts because of free-rider issues. Specifically, legally binding targets are applied to a limited number of nations, while excluding other major polluting countries, such as China and India. Moreover, the term “legally binding" is ambiguous. Article 18 of the KP briefly mentions that consequences for any case of non-compliance shall be discussed and determined by the parties and “shall be adopted by means of an amendment to this Protocol" (United Nations 1998). Thus, no punishment is clearly stated. In terms of competitiveness, the Kyoto commitments mean increased environmental policy stringency, which is expected to lead to a comparative disadvantage for pollution-intensive industries in these Annex B countries.

2.2 Industry of Environmental Goods

Facing the deteriorating environmental issues, the Organization for Economic and Co-operation Development (OECD)/Eurostat Informal Working Group, in its meeting in 1995, identified a group of products and services that can provide promising solutions. They are named “environmental goods", which consist of “activities which produce goods and services to measure, prevent, limit, minimize or correct environmental damage to water, air and soil, as well as problems related to waste noise and eco-systems" (OECD 1999).

The Working Group divides EGs into three categories: pollution management, cleaner technologies and products, and resource management (OECD 1999). Of all three groups, the pollution management group accounts for the majority of EGs. Products in pollution management group are categorized into six sub-groups with a target to a pollution type: air pollution control, wastewater management, solid waste management, remediation and cleanup of soil and water, noise and vibration abatement, and monitoring, analysis & assessment. While the products in the pollution management group aim to solve current pollution issues and damage in many environmental dimensions (e.g., water, air, noise), products in the two remaining groups focus on limiting and preventing emission via clean technology and energy as well as ensure natural resource sustainability.

Although the definition given by OECD is well-known, there are also other definitions and lists of EGs proposed by other organizations (Sugathan 2013). In fact, classification and definition of EGs is not universally agreed. In this analysis, I use a combination of the OECD and APEC Early Voluntary Sector Liberalization (EVSL) initiative lists. However, I restrict my attention to only products in the air pollution control (sub-category of the pollution management group) and the renewable energy plant (sub-category of the resource management group) as they provide direct solution to the air pollution and global warming issue.

2.3 Pollution Haven Hypothesis

In the debate about the relationship between environmental regulation and competitiveness, the pollution haven hypothesis posits that high environmental standards drive the reallocation of pollution-intensive industries to countries with less stringent regulations. In the case of the KP, it is highly likely that countries with binding target would reduce the production and exports of emission-intensive goods. Instead, they would have higher incentive to import those products from non-committed countries, which results in carbon leakage. There are a number of studies supporting this hypothesis (Aichele and Felbermayr 2012, 2013b, 2015). It is found that Kyoto commitment leads to a 13 to 14 per cent reduction in Annex B countries’ exports, especially industries with high energy intensities (Aichele and Felbermayr 2013b). Similarly, by employing the gravity model and fixed-effects, Kim (2016) also reports supporting evidence for the negative effect of the KP on trade flows for G20 countries. Furthermore, there is an around 8 percent increase in the embodied carbon imports of the Annex B countries from non-Annex B countries, suggesting carbon leakage (Aichele and Felbermayr 2015).

In addition, this negative effect is documented in studies about other IEAs (Ederington et al. 2018; Besedeš et al. 2017). These two previous studies investigate all available IEAs and report a decrease in the trade of manufacturing sectors because of the ratification of IEAs. However, Ederington et al. (2018) further show that this effect is small and disappears in the long term. In fact, the decline in dirty-good exports is compensated for by an increase in exports of cleaner industries within the member countries. These studies suggest consistency in the competitiveness loss effect of IEAs in the manufacturing sectors. Yet the ambiguity of the impact persistence indicates that IEAs in general and the KP in particular might not necessarily lead to an overall negative effect on competitiveness.

Conversely, there are few studies on environmentally friendly products in the existing literature. Costantini and Crespi (2008) and Miyamoto and Takeuchi (2018) are the two most closely related studies for this paper. Focusing on the energy technology sector and 20 OECD members, Costantini and Crespi (2008) use the gravity model and demonstrate that environmental regulation is a significant source of comparative advantages.Footnote 9 Specifically, they provide evidence that the stringency of environmental regulations drives the export of renewable energy technology, using a number of proxies for environmental regulation.Footnote 10 While the effect of the KP is not directly considered in the research, the authors argue that they make implicit considerations of the role of the KP when studying the energy sectors, as the protocol provides an institutional framework favorable to technology diffusion.Footnote 11

Although Miyamoto and Takeuchi (2018) investigate the effect of technological development (proxied by patent application counts) on the trade flow of solar and wind technology, they also control for environmental policies, which are the KP and feed-in-tariff and renewable portfolio standard variables. The results indicate a strong positive correlation between the protocol and trade in solar and wind technology. Unfortunately, since the KP serves as a control variable in this study, the estimation of this variable coefficient cannot be interpreted as causal. As a result, it is essential to have an overview of the impact of the KP on exports of not only manufacturing products but also environmentally friendly ones.

3 Empirical Strategy

3.1 Framework

To evaluate the effect of the KP on trade in EGs, I follow Aichele and Felbermayr (2013b) and choose the unit of analysis of an exporter– importer pair (denoted p, henceforth). As argued by Aichele and Felbermayr (2013b), finding a control for a country pair is more feasible and credible than for a country (e.g. it is difficult to find a comparable unit with the U.S.A). Even though, in this case, I construct the counterfactual for the treated unit, the construction relies on the control group, which contains mostly less-developed countries. Therefore, using the country pair as the analysis unit is also more appropriate. By considering the country pair unit, I can generate the model to similar frameworks in causal inference, as noted in Xu (2017). The functional form is written as:

$$\begin{aligned} Y_{pt} = \alpha _{0} + \alpha _{pt} Kyoto_{pt} + \beta x_{pt}' + \lambda _{p}' f_{t} + \varepsilon _{pt} \end{aligned}$$
(1)

where \(Y_{pt}\) denotes the bilateral exports of an exporter– importer pair p in year t; \(Kyoto_{pt}\) is a dummy variable taking a value of 1 if the exporter of a country pair p has a Kyoto commitment in year t and 0 otherwise; \(x_{pt}\) is a (k × 1) vector of observed covariates, including the exporter’s and importer’s GDP and other bilateral gravity variables (i.e. regional trade agreement membership or common currency membership); \(\beta\) is a (k × 1) vector of parameters; \(\alpha _{pt}\) is the heterogeneous treatment effect on country pair p in year t; \(f_{t}\) is a (r × 1) vector of unobserved common factors; \(\lambda _{p}\) is a (r × 1) vector of unknown factor loadings;Footnote 12 and \(\varepsilon _{pt}\) represents unobserved idiosyncratic shocks for pair p in year t.

As argued by Almer and Winkler (2017), the treatment period of the KP is not very clear. Most countries ratified the protocol during 2002 to 2003, yet it did not enter into force until 2005.Footnote 13 However, according to the literature on the IEA, the ratification year can be considered the treatment period because, once countries ratify, they start making changes in their policies and implementation.Footnote 14 Therefore, I select the ratification year as the treatment period.

According to the functional form, \(\alpha _{pt}\) is the coefficient of interest, representing the treatment effect. Let \(Y_{pt}(1)\) and \(Y_{pt}(0)\) be the outcome for a country pair p in year t when \(Kyoto_{pt} = 1\) or \(Kyoto_{pt} = 0\), respectively. Therefore, the treatment effect on treated pair p in year t is expressed as:

$$\begin{aligned} \alpha _{pt} = Y_{pt}(1) - Y_{pt}(0), t > T_{0} \end{aligned}$$
(2)

3.2 Generalized Synthetic Control

3.2.1 Description

To assess the effect of the Kyoto commitment on the bilateral export of EGs, I employ the GSCM proposed by Xu (2017). This method is based on the idea of the synthetic control method, developed by Abadie et al. (2010, 2015), such that the treated counterfactuals are synthesized by using the pre-treatment outcomes of treated units as benchmarks to select weights for control units and using cross-sectional correlations between treated and control units. In addition, it integrates the interactive fixed-effects (IFE) model proposed by Bai (2009).

The GSCM has a number of advantages over the popular DID and synthetic control approach. First, similar to the synthetic control method, it overcomes the issue with “parallel trend" assumption of the DID identification, which cannot be valid in many cases. By minimizing the difference between the treated and synthetic counterfactual in the pre-treatment period, it makes the comparison between the treated and synthetic control units transparent. Second, this method allows the analysis of multiple treated units and multiple treatment time periods, while the original synthetic control method can only perform one-by-one analyses. This is particularly useful when there are so many country pairs being analyzed, and Australia and Croatia receive treatment later than other countries.Footnote 15 Third, it provides classical standard errors to infer statistical significance, whereas the synthetic control method relies on comparing the estimates with the placebo treatment effects.Footnote 16

However, the GSCM has three limitations that require researchers to be cautious during its application. First, since it is a data-driven approach, it is advised that the method should be applied to data with at least 10 pre-treatment periods and at least 40 control units (Xu 2017). Otherwise, the treatment effect will be biased. In this exercise, this should not be an issue, as the analysis period spans 1990 to 2012, with a treatment year of either 2002 or 2005. Further, the number of control country pairs is much larger than 40. Second, excessive extrapolation resulting from no common factor loadings between the treated and control units may provide misleading results. A recommended solution to this issue is to check the overlap of the estimated factor loadings of both treated and control units (Xu 2017). Third, the method cannot accommodate complex data-generating processes, such as dynamic relationships between treatment, covariates and outcome, structural breaks, and multiple times of treatment and variable treatment intensity. As can be seen in the framework, in this study, these issues do not exist. Specifically, while there are different ratification years (2001 to 2004) among the Annex B countries, 2002 is the year in which the majority ratified the KP. In addition, there is no great difference between the 2002 to 2004 treatment intensity among countries (Maamoun 2019). In conclusion, the GSCM is a suitable method for this study.

3.2.2 Estimation Strategy

As stated in Eq. (2), the main issue of the treatment effect estimation is the counterfactual \(Y_{pt}(0)\), which is not observed when the treated unit receives the treatment (i.e. the exporter ratifies the KP). Therefore, the core idea of the GSCM is to estimate the counterfactual of the treated pairs. Below is a brief description of the counterfactual estimation.Footnote 17

Assuming the number of country pairs is \(N = N_{tr} + N_{co}\), where \(N_{tr}\) and \(N_{co}\) are the number of treated and control units, respectively, the outcome of a pair from the control group can be written as:

$$\begin{aligned} Y_{pt} = X_{pt}' \beta + \lambda _{p}' f_{t} + \varepsilon _{pt} \end{aligned}$$

Thus, the outcome of the counterfactual after the combination of all control pairs is

$$\begin{aligned} Y_{co} = X_{co} \beta + F \Lambda _{co}' + \varepsilon _{co} \end{aligned}$$

where \(Y_{co}\) and \(\varepsilon _{co}\) are (T x \(N_{co}\)) matrices; \(X_{co}\) is a three-dimensional matrix (T x \(N_{co}\) x k); and \(\Lambda _{co}\) is a (\(N_{co}\) x r) matrix. There are two constraints required to identify \(\beta\), F, and \(\Lambda _{co}\): all factors are normalized and are orthogonal to each other.

The construction of the counterfactual \(\hat{Y_{pt}(0)}\) contains three steps. The first step is the estimation of an IFE model using only the control group data and obtaining \({\hat{\beta }}\), \({\hat{F}}\), and \(\hat{\Lambda _{co}}\):

$$\begin{aligned} ({\hat{\beta }}, {\hat{F}}, \hat{\Lambda _{co}}) = \mathop {{{\,\mathrm{argmin}\,}}}\nolimits _{{\tilde{\beta }} {\tilde{F}} \tilde{\Lambda _{co}}} \sum _{p \in C}^{} (Y_{p}-X_{p} {\tilde{\beta }} - {\tilde{F}} \tilde{\lambda _{p}})' (Y_{p} - X_{p} {\tilde{\beta }} - {\tilde{F}} \tilde{\lambda _{p}}) \end{aligned}$$

s.t. \(\tilde{F'} {\tilde{F}}/T=I_{r}\) and \(\tilde{\Lambda _{co}}' \tilde{\Lambda _{co}} =\) diagonal

In the second step, factor loadings for each treated unit are estimated by minimizing the mean squared error of the predicted treated outcome (MSPE) in pretreatment periods:

$$\begin{aligned} \hat{\lambda _{p}}& = \mathop {{{\,\mathrm{argmin}\,}}}\nolimits _{\tilde{\lambda _{p}}} (Y_{p}^{0} - X_{p}^{0} {\hat{\beta }} - \hat{F^{0} \tilde{\lambda _{p}}})' (Y_{p}^{0} - X_{p}^{0} {\hat{\beta }} - \hat{F^{0} \tilde{\lambda _{p}}})\\ & = (\hat{F^{0'}} \hat{F^{0}})^{-1} \hat{F^{0'}} (Y_{p}^{0} - X_{p}^{0} {\hat{\beta }}), p \in {\mathcal {T}} \end{aligned}$$

where \({\hat{\beta }}\) and \(\hat{F^{0}}\) are from the first-step estimation and the superscripts “0s" represent the pre-treatment periods, and \({\mathcal {T}}\) denotes the set of units in the treatment group. The third step is to calculate treated counterfactuals based on \({\hat{\beta }}\), \({\hat{F}}\), and \(\hat{\lambda _{p}}\):

$$\begin{aligned}&\hat{Y_{pt}^{0}} = x_{pt}' {\hat{\beta }} + \hat{\lambda _{p}}' \hat{f_{t}}\\&\quad p \in {\mathcal {T}}, t > T_{0} \end{aligned}$$

The \(ATT_{t}\) is hence estimated as \(\hat{ATT_{t}} = \frac{1}{N_{tr}} \sum _{i \in {\mathcal {T}}}^{} [Y_{pt}(1) - \hat{Y_{pt}(0)}]\) for \(t > T_{0}\).

4 Data

Bilateral EG trade data at the product level during the period 1990 to 2015 come from the UN Comtrade (2018) database.Footnote 18 However, the analysis period is restricted to 1990 to 2012. The first commitment period of the KP ended in 2012. After that, there was an amendment; however, this was not validated until October 2020 and it remains unclear whether the KP is still effective. As a result, I select 2012 as the end year of the analysis period. As stated in the introduction, this study includes products in the air pollution control, environmental monitoring, cleaner technology, and renewable energy subgroups. Together, these subgroups comprise 86 of 173 six-digit HS EGs listed in both the OECD list and APEC list. Information on the Annex B countries included in the dataset and their ratification years is available in Table 8.Footnote 19 The definitions and data sources of the other variables are provided in Table 9.

Table 1 provides insights of the key players in the export market of EGs. In particular, the US, Germany and Japan are the top exporters, accounting for 45% of world trade over the period 1990–2012. Besides, most countries in the list of top ten exporters are countries with Kyoto commitments. In fact, the top ten Annex B exporters export nearly half of the total world trade during the same period. With regards to imports, many Annex B countries are also among the top importers. However, it is worth noting that several top Annex-B importers are developing countries, especially China and Mexico. This observation will be discussed later in Mechanism section.

Table 1 Top 10 largest importers and exporters over the period 1990–2012

Many country pairs have missing values for a number of periods in the original data. As discussed previously, the method works well with a minimum of 10 years in the pre-treatment period. Therefore, I first restrict the dataset to country pairs with non-missing values for at least 20 years out of 26 years (the raw data are available from 1990–2015).Footnote 20 During the analysis, the dataset is restricted to the period 1990–2012. In addition, any pairs with fewer than 10 period observations are automatically dropped during the analysis. The final dataset consists of 136 exporters and 95 importers, representing 3,049 country pairs and a 23-year period from 1990 to 2012. Of these, 907 exporter– importer pairs commit to the KP, accounting for 29.7% total country pairs in the sample. The total nominal trade value of the final sample over the period 1990–2012 is 3,250 billion USD, which comprises more than 76% of total value in the original data.Footnote 21 In addition, exports from Kyoto countries in the final data value about 2,080 billion USD in total, which comprises roughly 85% of total values of exports from Annex B countries in the original data over the period 1990–2012.Footnote 22

As briefly discussed in Sect. 2, the Doha Amendment was adopted by the end of 2012, and the parties were required to ratify this amendment again. However, the number of parties submitting their instrument of acceptance did not meet the requirement (at least 144) until the end of 2020. Therefore, these issues might affect the consistency of the treatment (i.e. the Kyoto commitments) because of unobserved factors. Given that the methodology cannot accommodate complex data-generating processes (DGPs), extending the sample period beyond 2012 might result in biased estimation.Footnote 23

As previously discussed, there was a steady increase in the world trade of EGs during the early 2000s, which was the period in which most countries ratified the protocol (Fig. 1). Therefore, I expect a correlation between the Kyoto commitment and trade in EGs. Moreover, there was a difference in the change in bilateral trade level between the exports from Annex B and non-Annex B countries.

In addition, the descriptive statistics, in Table 2, demonstrate that the EG export value of the treated country pairs is larger than that of the control ones. Moreover, the pairs with Annex B countries as exporter have higher GDP and GDP per capita, use more energy, tend to participate in free trade agreements and the EU, and are more likely to use the common currency. There is not a significant difference in the tendency to be a WTO member between two groups.

Table 2 Summary Statistics

5 Results and Discussion

5.1 Main Results

Table 3 presents the baseline results. Column (1) includes basic gravity variables as covariates, while Column (2) includes additional variables, such as the per-capita GDP of the exporter and importer, the energy intensity of the trading pairs,Footnote 24 and dummies for the European Union (EU) membership and WTO membership of the trading pair.Footnote 25 Additional variables are included to control endogeneity resulting from voluntary selection into the KP or non-random treatment. Countries with Kyoto commitments are chosen based on their previous industrialization, and could also strategically choose to ratify the KP to boost the reputation of their EG quality, or not ratify at all (e.g. the U.S.A). In theory, endogeneity should influence the counterfactual; thus, using the synthetic counterfactual should control part of the issue (Billmeier and Nannicini 2013). In addition, the unobservable confounders, capturing the inherent differences that potentially result from non-random treatment, could also alleviate the endogeneity. Nevertheless, to ensure the robustness of the results, I include additional covariates that could reflect the difference between the treated group and control group. These variables are chosen based on the arguments that could influence self-selection into the KP, as discussed in Aichele and Felbermayr (2013b).

However, the results of the two columns are very similar; thus, further analysis includes only the basic covariates. The cross-validation scheme finds one unobservable factor.Footnote 26 According to Xu (2017), the unobservable factors found are usually not interpretable. However, as the unobserved factor in these panel data represents the cross-section dependence, it exhibits the correlation among countries. A plot of the factor is displayed in Fig. 10. Thus, conditioning on the additive fixed-effects and unobservable factor, the results show that the Kyoto commitments result in a 29 to 30% increase in the export of EGs, compared with the scenario of “no Kyoto."

Table 3 The effect of KP on trade in environmental goods

Figure 3 presents the plot of treated and counterfactual averages and the dynamics of the estimated ATT. For each figure, the x-axis represents the time relative to treatment (i.e. time scaled to 0 at the time of treatment). The vertical line at time 0 demonstrates the start of the treatment. As can be seen, the treated and counterfactual averages match quite well in the pre-treatment period, and diverge once the treatment starts (i.e. countries ratify the KP). The estimated ATT plot exhibits a constant increase in the export of EGs following the ratification of the protocol.

Fig. 3
figure 3

Main result Notes. This figure plots estimated ATT (on the left) and trend of treated and counterfactual averages (on the right). Shaded areas are 95% confidence interval based on parametric bootstraps of 1000 times

It is worth noting that the results presented in this paper can only explain the impact on the intensive margin of trade although discussion on the extensive margin would be desirable to have a more complete overview of the Kyoto impact. The GSCM requires the bilateral trade data in the pre-treatment period (i.e. before ratification of the KP) to construct the synthetic control unit. As a result, the estimation can be done on existing trading pairs.

Moreover, it is important to note the coefficient of the exporter’s and importer’s GDP. I estimate a larger export elasticity with respect to the exporter’s GDP than with respect to the importer’s GDP, which is contrary to what is usually observed in most gravity trade studies. An explanation of this outcome is provided by Feenstra et al. (2001) in the case of trading differentiated goods, with this observation termed the “home-market effect" (Krugman 1980). As established in Feenstra et al. (2001), high demand for goods produced in a large country leads to more entry of firms and more product variety. Eventually, the product supply is greater than the demand in a larger country, so the exports of the differentiated goods exceed imports (i.e. positive net export).

In addition, the coefficient of free trade dummy is not statistically significant, although it is positive. This study focuses on a group of products, and trade liberalization of EGs is still under negotiation.Footnote 27 As noted in Sect. 2, the APEC 2012 Vladivostok Declaration is the most concrete international agreement on EG trade to date. However, this agreement also applies to a small number of EGs. Therefore, a strong correlation between free trade agreements and trade of EGs is not observed.

5.2 Robustness Checks

To ensure the robustness of my results, I perform several sensitivity analyses. The results of all robustness checks are presented in Table 4. The plots of treated and counterfactual averages and estimated ATT for each robustness check are presented in Figs. 4 and 5.

Table 4 Robustness check
Fig. 4
figure 4

Robustness checks. Notes. This figure plots estimated ATT (on the left) and trend of treated and counterfactual averages (on the right). Shaded areas are 95% confidence interval based on parametric bootstraps of 1000 times

Fig. 5
figure 5

Robustness checks (continued) Notes. This figure plots estimated ATT (on the left) and trend of treated and counterfactual averages (on the right). Blue (Grey) shaded areas are 95% (90%) confidence interval based on parametric bootstraps of 1000 times

Treatment period—Although most countries ratified the KP by 2003, it did not enter into force until 2005.Footnote 28 Several studies use the enforcement year as the treatment period, such as Maamoun (2019). Therefore, in the first robustness check, I change the treatment period to the enforcement year: 2007 for Australia and Croatia, and 2005 for all other countries. Despite the statistical significance, the ATT is reported as 18.5% in Column (1), which is smaller than the estimation in the main result.


Figure 4a exhibits the plots of treated and counterfactual average and estimated ATT. As can be seen, there is an increase in export even before the assigned treatment year. Therefore, by using the enforcement year as the treatment period, the estimated effect is much smaller than the baseline. This finding indicates that countries already prepared actions immediately after their ratification.


Period extension to 2015—Even though, after 2012, there was the Doha Amendment to the KP, but this amendment did not enter into force until October 2020. Therefore, one can argue that the KP should still be valid. Thus, I extend my analysis period to 2015, and the estimated ATT (0.422) is larger than the baseline result. This is expected, as it accounts for the additional years. This indicates that the effect of the KP could persist after its first commitment period. However, this interpretation must be applied with caution, as the confidence interval in the ATT plots, shown in Fig. 4b, is quite large when years beyond 2012 are considered.


Removal of trade to Kyoto countries—The analysis thus far is conducted on a sample including export to both Kyoto and non-Kyoto countries. However, there may be concern that the protocol could affect the imports of Annex B countries, thereby biasing the main results. Therefore, I restrict the sample to export to countries without Kyoto commitments only (i.e. only export from either Annex B or non-Annex B countries to non-Annex B countries).Footnote 29 The estimated ATT, in Column (3), is reported as 0.289, which is slightly smaller than the baseline results. This implies that the observed result above is not driven by the effect of KP on the import of Annex B countries.


Removal of exports from Eastern European countries, Russia, and Ukraine—Some countries, such as Eastern Europe, Russia and Ukraine, are known to have no obligations or limited real commitments in reducing the emissions. This raises a concern in understanding the true effect of the KP as well as the mechanism underlying the reported result. That is, the poor commitment by these countries could result in a reduced treatment effect with their inclusion in comparison with the effect with exclusion of them. Therefore, this part performs analysis that excludes exports from Eastern European countries (in this study, it includes Bulgaria, Czech Republic, Poland, and Romania), Russia, and Ukraine.

The plots show high similarity to the ones reported in the main result. The estimated ATT, reported in Column (4), has a slight change in magnitude (0.309). This is reasonable as Eastern European countries and Former Soviet Union countries comprise a small part of all treated countries in the analysis sample. However, the increase in magnitude confirms that inclusion of these countries leads to the estimation bias.


Trade of manufacture of computers, electrical and optical products included as an additional covariate—Although the country pairs fixed effect can capture many time-invariant characteristics, it is essential to test the robustness by controlling for other time-varying features. In the section of main results, I added additional variables such as the energy intensity, the WTO membership and EU membership. The result is quite robust and similar to the main one. In this part, I perform another robustness check by including trade in non-environmental and non- (or low) emission goods as a proxy for time-varying features. According to the statistics for EU 28 countries in 2013, manufacture of computer, electronic and optical products is the industry with the least emission intensity among all tradable ones.Footnote 30 As a result, I include trade value of this industry (in log) as one of the covariates.Footnote 31

The plots of this robustness check display a similar pre-treatment fit compared to most results. However, the shaded area in the post-treatment period is much larger. Despite a smaller magnitude (0.197), shown in Column (5), compared to the baseline result, the ATT remains statistically significant. Together, this indicates robustness of the results even when more time-varying characteristics are captured.


Trade of renewable energy products as dependent variable—The goal of the KP is to combat the climate change, which is driven by increasing concentration of greenhouse gas in the atmosphere. Thus, it makes sense that renewable energy products should be promoted more after the KP. However, this paper also includes pollution control products in the analysis, which may raise concern about the validity of this inclusion. While climate change and air pollution appear to be different problems, they are actually correlated with each other, according to UN Environment Programme.Footnote 32 For example, once landing on ice and snow, particular matter can darken them slightly and eventually result in less sunlight being reflected back into space. This would contribute to global warming.

Nevertheless, as renewable energy goods are usually perceived as key products in the battle against climate change, this part conducts one additional analysis on sample restricted to trade of renewable energy products. Estimation of this robustness check is presented in column (6) of Table 4. The corresponding plots of treated and countefactual average, and estimated ATT are demonstrated in Fig. 5b. The results show a positive and significant impact on trade of renewable energy products, and the magnitude of this effect is even larger (more than 60% relative to “no-Kyoto" scenario).


Canada as a treated country—Canada originally ratified the protocol, but then decided to withdraw at the end of 2012.Footnote 33 Given that the analysis period in this study runs from 1990 to 2012, Canada can still be regarded one of the Annex B countries.Footnote 34 Therefore, I now consider any trading pairs with Canada as an exporter as a “treated" country. The result is reported in Column (7) of Table 4. As can be seen, there is almost no difference in the estimated ATT (0.314) relative to the main results. Moreover, the plots, as demonstrated in Fig. 5c, are very similar to the baseline results. The results suggest that the reported effect is not affected by Canada’s membership status.


Sample period of 1992 to 2012—Given that a few countries retrospectively reported trade data using the 1992 HS before 1992, Column (8) estimates the sample for 1992 to 2012. In the previous analysis, the trade value in the first pre-treatment period is very low, which affects the synthesis of the counterfactuals. Thus, dropping the years 1990 and 1991 results in larger estimation, as shown in Column (8) of Table 4. Despite the larger value of the estimated ATT (roughly 37.5%), it is generally not much different from the baseline finding.


Exclusion of top exporters—The statistics show that the U.S.A and Germany are the top two exporters in the market of EGs. While both countries signed the agreement, the U.S.A never ratified the KP; thus, it is considered “untreated." It is possible that both countries could affect the estimated effect. Therefore, I re-conduct the analysis excluding either the U.S.A or Germany as the exporter from the sample. The results are reported in Columns (9) and (10) of Table 4. The graphs of synthetic counterfactuals and ATT over time can be found in Figs. 11 and 12.

The estimated ATT in both analyses are quite similar to each other and the main result (roughly 30% increase). This finding implies that the reported effect is not driven by the top exporters. Further, this also suggests that the GSCM performs well in developing suitable counterfactuals with the adjusted control group.

5.3 Case Study: Germany and Japan

Even though the model (1) contains unit and time fixed-effects, which can control for time-invariant characteristics of trading pairs and time trend, the difference between exporters (i.e. Annex B countries) and importers (i.e. non-Annex B countries, especially those less developed ones) over time can be the confounding factors leading to the significant coefficients reported above. Some robustness checks have also attempted to control for these time-variant features of trading pairs, but it might not capture all of them. Therefore, in this section, I study the impact of the KP on the total export values (i.e. exports to the whole world). In addition, to isolate effect of the KP on import, I conduct two separate analyses by restricting to two groups of data: export flows to Annex B countries and export flows to non-Annex B countries.

As displayed in Table 1, the values of exports of the top ten largest Annex B exporters comprise approximately half of the total world trade. Notably, of all ten countries, Germany and Japan are the two key players with the total values of exports accounting for about 27% of world trade. Therefore, I focus my analyses on Germany and Japan. Unlike the main analysis, I examine each country individually. The framework used to study the effect of the KP is very similar to model (1), but the unit of analysis is now at the country level.

$$\begin{aligned} Y_{it} = \gamma _{0} + \gamma _{it} Kyoto_{it} + \gamma _{1} X_{it}' + \lambda _{i}' f_{t} + \epsilon _{it} \end{aligned}$$
(3)

where \(Y_{it}\) is export value of a country i in year t to Annex B countries (or to non-Annex B countries); \(Kyoto_{it}\) is a dummy variable indicating whether country i has Kyoto commitment in year t. In the spirit of the gravity model, I include common variables in the vector of observed covariates \(X_{it}\): country i’s GDP, GDP per capita and population, energy intensity, and WTO membership dummy.Footnote 35

ATT plots and plots of treated versus synthetic unit are shown in Fig. 6. The plots demonstrate that the treated unit and its counterfactual barely match each other in the pre-treatment period, which proves how difficult it is to develop the suitable counterfactual using the trade data at the unilateral level. According to Abadie et al. (2015), SCM should only be used if there is a good pre-treatment fit. Therefore, no conclusion can be drawn regarding the effect of the KP on export flow using GSCM.

Fig. 6
figure 6

Effect of the KP on exports using GSCM. Notes. This figure plots yearly treatment effect (on the left) and trend of export values (in log) on treated countries (Germany and Japan) against its synthetic control (on the right) using GSCM. Shaded areas are 95% confidence interval based on parametric bootstrap of 1,000 times

In order to find the appropriate counterfactuals for Germany and Japan, I further employ another recently developed method, which is augmented SCM (ASCM) by Ben-Michael et al. (2021). The core concept of ASCM is still to develop a synthetic control unit that resembles the treated unit as closely as possible in the pre-treatment period. Unlike the classical SCM, ASCM augments ridge regression to relax the assumption that weights must be non-negative. Therefore, it allows a certain amount of extrapolation and eventually enhances the pre-treatment fit. Simultaneously, the ridge regression also penalizes over excessive extrapolation to avoid the danger of overfitting.Footnote 36 Besides, ASCM also provides statistical inference, which is a missing feature in the standard SCM. Both GSCM and ASCM are new developments in the growing literature on causal inference method. GSCM belongs to the branch of outcome modelling while ASCM is considered a hybrid method of matching and outcome modeling (Liu et al. 2020). To make the results comparable, I include the same variables used in the GSCM as the predictors in the ASCM. Yet I also include lagged value of the dependent variable, which is a common practice of the standard SCM. I includes average of lags of all pre-treatment periods as there is no agreed criteria to choose which pre-treatment outcome to be included (Ferman et al. 2020).

Following Almer and Winkler (2017), I first restrict the donor pool to high income and upper-middle income countries. In addition, Abadie (2021) suggests the co-movement of the outcome variable of interest across different units in the data is important to the success of finding the suitable synthetic control unit. The following countries are chosen to meet both criteria: Brazil, Canada, Ecuador, South Korea, Mexico, Malaysia, Saudia Arabia, Singapore and USA. For the analysis of sample restricted to the export flow to Annex B countries, Colombia, Jordan, Thailand, and Turkey are also included in the donor pool. Furthermore, the sample period is restricted to 1992–2012. The first reason lies at the fact that many countries did not report the trade until 1992. The inclusion of data before 1992 at this aggregate level (non-bilateral trade level) would cause misleading results. Second, the ridge SCM requires the panel data to be perfectly balanced, so restricting sample size from 1992 would result in more control units in the donor pool.

Plots of treated and synthetic control unit are shown in Fig. 7. In general, the treated unit and counterfactual unit match better in the analysis of export flow to Annex B countries. The ridge SCM fails to produce a synthetic control unit that fits Japan in the case of export flow to non-Annex B countries. The divergence of the treated unit and synthetic control unit suggests an effect of the KP on export flows to non-committed countries. Overall, the results indicate an increase in export of EGs in comparison with the “no-Kyoto" scenario.

Fig. 7
figure 7

Effect of the KP on exports using ridge SCM. Notes. This figure plots yearly treatment effect (on the left) and trend of export values (in log) on treated countries (Germany and Japan) against its synthetic control (on the right) using ridge SCM. Shaded areas are 95% confidence interval based on jackknife+ approach in Barber et al. (2021)

The dynamic treatment estimation, presented in Table 5, suggests that the KP significantly leads to an increase in export of Germany to both Annex B and non-Annex B countries. This positive and significant effect is also observed in the export flow of Japan to Annex B countries. In summary, I find that there is indeed a positive effect of the KP on exports of EGs from Germany and Japan.

Table 5 Yearly treatment effect on the treated countries (Germany and Japan)

5.4 Mechanism

As introduced earlier, the three Kyoto mechanisms are designed to help committed countries flexibly meet their emission reduction targets. The project-based mechanisms, JI and CDM, are also expected to promote sustainable development through technology transfer and investment as well as encourage developing countries to make contribution to emission reduction efforts.Footnote 37 An ex post analysis of the registered CDM projects shows a significant increase in technology transfers and diffusion between Annex B countries and developing countries (Dechezleprêtre et al. 2008).Footnote 38 The technology transfer occurs when “the technology used in the project is not available in the host country but must be imported" (Dechezleprêtre et al. 2008). Therefore, it is very likely that JI and CDM are the driving forces in the increase in exports of EGs.

According to the Kyoto mechanism design, CDM suggests the rise of exports of EGs from Annex B countries and imports of non-Annex B countries while JI could increase exports of EGs from some Annex B countries and imports of other Annex B countries. A comparison between the number of JI and CDM projects (327 versus 7,159 as of end of 2012) indicates that Annex B countries prefer conducting projects in developing countries.Footnote 39 This is reasonable as the cost of reducing emissions in developing countries is drastically smaller than that in other Annex B countries.

Statistics on CDM projects (registered until the end of 2012), presented in Table 6 show that the top five destinations for CDM projects are China, India, Brazil, Vietnam, and Mexico. Out of all registered projects, those conducted in China account for more than 50%. Meanwhile, nine out of ten committed countries that participate in these projects are among top ten exporters of the EGs. This suggests a correlation of CDM projects and exports of EGs.

Table 6 Top ten host countries for CDM projects and top ten Annex B countries participating in CDM projects

To further establish the link, I examine the impact of KP on exports to China, which is the biggest host country in CDM and the largest non-Annex B importers of EGs. In particular, I restrict the analysis to the exports flow to China only. This restriction reduces the number of countries in the donor pool to 17.Footnote 40 Therefore, it is not possible to use GSCM due to the requirement of a minimum of 40 units in the donor pool. Therefore, I apply ASCM to evaluate whether there is any effect of the KP on exports of EGs to China. The analyses are conducted for the top five exporters: Germany, Japan, United Kingdom, France and Italy. Results are presented in Table 6. Plots of treated and synthetic units and ATT plots are demonstrated in Fig. 8. Of five countries, only Germany, Japan and Italy have well-matched pre-treatment fits. Besides, estimated effects are positive and generally significant during the post-treatment period.

One final point regarding the mechanism is the heterogeneity of commitments under the KP. As discussed in one robustness check in Sect. 5.2, some countries such as Eastern Europe do not have sufficient additional efforts in emission reduction. In addition, inclusion of these countries results in a bias in estimated treatment effect. Besides, in the proposed mechanism, these countries might serve as host of JI projects, which could lead to opportunities to increase their imports of EGs. On the other hand, major exporters of EGs (e.g. top five countries examined above) are those with stronger emission reduction targets. Thus, the project-based mechanism in the KP is the driving force of the increase in exports, yet conditional on the stringency level of commitments.

Fig. 8
figure 8

Effect of the KP on exports to China using ridge SCM. Notes. This figure plots yearly treatment effect (on the left) and trend of export values (in log) of treated countries against its synthetic control (on the right) using ridge SCM. Shaded areas are 95% confidence interval based on jackknife+ approach in Barber et al. (2021)

5.5 Does the KP Lead to Carbon Leakage?

As we have seen that the KP results in an increase in exports of EGs, then it is also likely that the protocol discourages the production of emission-intensive goods. As discussed in Section 2.3, a number of studies have found evidence on the decline of export of pollution-intensive products or carbon leakage induced by the KP (Aichele and Felbermayr 2013b, 2015). Therefore, whether the KP leads to a reduction in exports of emission-intensive goods or induces carbon leakage is an important angle to re-explore given the new empirical strategy in this study.

To examine this issue, this paper conducts additional analyses evaluating the impact of the KP on exports of pollution-intensive goods and carbon content of trade. Following Paraschiv (2016), this paper uses the harmonized EORA26 world input-output table (it is a part of the EORA World MRIO project developed by Lenzen et al. (2012, 2013)) to construct a dataset on industry-level, bilateral exports.Footnote 41 The reason for employing this dataset lies at the availability of sectoral carbon dioxide emissions. Having information on carbon dioxide emission is advantageous as it allows the construction of industry-specific carbon dioxide intensities (calculated as a ratio of annual \(\hbox {CO}_{{2}}\) emissions to annual output) and the carbon content of exports (defined as a product of sectoral emission intensity and sectoral export flow). Hence, both export value and carbon content of exports are used as dependent variables in model (1).

The EORA26 dataset contains information on 14 service, 10 manufacturing and 2 primary sectors. To make the results comparable with Aichele and Felbermayr (2015), I follow Paraschiv (2016) and use two primary and 8 manufacturing sectors.Footnote 42 In addition, the data cover 189 exporters and 190 importers, but I restrict the sample size to be same as the data used in the main analysis for the purpose of comparison.Footnote 43 The EORA26 data are available over the period 1990–2015, but the analysis is again restricted to the period 1990 to 2012 to ensure consistency with the main result.

Summary statistics on sectoral export value and carbon content of exports are presented in Table 11. In terms of carbon dioxide content of exports, most manufacturing sectors have value greater than one. Industry of petroleum, chemical, and non-metallic mineral products and industry of textiles and wearing apparel are the top two sectors that embody the largest content of carbon in their exports. These two sectors are among the top “dirtiest" ones as classified by Shapiro (2020). According to Shapiro (2020), of all 10 industries, petroleum, chemical, and non-metallic mineral products has the highest carbon dioxide rate (in range of 0.93–1.12 tons/$), followed by metal products and textile and wearing apparel.Footnote 44 Besides, the treated group (i.e. pairs with Annex B countries as exporters) have larger export value compared to the un-treated group. At the same time, country pairs with Kyoto commitments tend to have lower emission intensity and lower carbon content of export than those without Kyoto commitments in most sectors. This observation implies that it is possible that the KP would result in carbon leakage. Nevertheless, the following analyses would reveal the causal evidence to confirm this hypothesis.

As the information on carbon content of exports is available for each industry, I perform both aggregate and sector-by-sector analyses.Footnote 45 The results are reported in Table 7. Figure 9 presents the plot of treated and counterfactual averages for all industries and two sectors: metal products and petroleum, chemical, and non-metallic mineral products. The plots on the left side use export value as the dependent variable while the ones on the right side show carbon content of export. As it can be seen, the treated and the synthetic control averages have very similar trend in the pre-treatment period, suggesting success of the method in synthesizing the counterfactuals of the treated pairs. The graphs for the remaining sectors are in Figs. 12 and 13. Generally, the method also works well in finding the synthetic controls regardless of sectors or dependent variables used (except using carbon content of exports in industry of fishing).

Table 7 The effect of the KP on exports and carbon content of exports

There is heterogeneity in the results across industries, but overall there is a decline in at least export values or the carbon content of exports, even in non-emission-intensive industries. The top three emission-intensive industries according to Shapiro (2020) (i.e. metal products, petroleum, chemical and non-metallic mineral products, and textiles & wearing apparel) experience the biggest reductions in carbon content of exports in comparison with the “no-Kyoto" scenario. The carbon content of exports in the remaining sectors also significantly decreases. The only exception is industry of transport equipment, which sees a small increase in CO2 exports. The similar results are also observed in export value, but a few sectors such as agriculture, fishing, and other manufacturing have a small (and mostly insignificant) increase in value of exports. In summary, there is evidence for carbon leakage in manufacturing sectors after ratification of the KP.

Fig. 9
figure 9

Effect of the KP on exports of pollution-intensive goods and carbon content

6 Conclusion

With the increasing intensity of global warming and climate change, sustainable economic growth has become the main focus of many policymakers. Hence, the concept of IEAs and particularly the KP still seems to be a promising solution. However, whether it is worth implementing again is a controversial topic. While many studies present pessimistic views about the effect of the KP on carbon leakage and competitiveness loss, this paper is the first to provide evidence of its pro-green trade effect. Using the GSCM, this study demonstrates that, following the enforcement of the protocol, countries with commitment increased their export of EGs by 29 to 30%. The paper also investigates two case studies, Germany and Japan, and find robust the positive effect of the KP on their exports. A possible mechanism for this finding lies at the CDM, one of flexible mechanisms under the KP. The implementation of carbon emission reduction projects induces technology transfer and diffusion.

The results presented in this paper indicate the KP has been successful in stimulating sustainable development through technology transfer. Together with the findings about the effectiveness of the KP, these results indicate that it is possible to be optimistic about the effort that the community has invested in the battle against carbon emissions. However, these successes are possible thanks to the stringency of commitments under the KP. Hence, the participation of more countries, additional commitments, and stronger commitments from countries should be considered in future efforts in fighting climate change.