1 Introduction

In a remarkable 180-degree turn from their long-standing traditions of secrecy, many central banks today regard their external communication as an important tool for achieving their policy goals. Today’s view is that communication can make monetary policy more effective by influencing expectations about monetary policy objectives and strategies, the economic outlook, and the (outlook for future) policy decisions (Blinder et al. 2008, 2017). Especially in a world in which key interest rates can hardly be lowered any further and new instruments to stimulate the economy are introduced, communication is seen as an important tool for influencing longer-term interest rates and yield curves. Hence, economists and central bankers nowadays agree that public perceptions about the stance of monetary policy is crucial for its effectiveness (de Haan and Sturm 2019).Footnote 1

Since its existence, the European Central Bank (ECB) has used its main refinancing rate as the primary instrument of monetary policy. The Great Financial Crisis of 2008/2009 and the subsequent euro area debt crisis have caused the ECB to move this rate to such low levels that lowering it further became more and more difficult. Consequently, the ECB has started to deploy unconventional policy tools like asset purchase programs (APP) and targeted funding of bank lending to businesses and households. The tools were accompanied by forward guidance and intended to address the risks of a too prolonged period of low inflation. Accordingly, the ECB had to change its monetary policy communication strategy (Praet 2013).Footnote 2

The introduction of unconventional policy instruments has been highly controversial, especially among German economists, exemplified by presidents of the Bundesbank. They have been notorious for their opposition to any program involving the purchase of government debt.Footnote 3 According to the fundamental monetarist dictum, “inflation is always and everywhere a monetary phenomenon” caused by an increase in the money supply in excess of real output (Friedman 1970). Ample evidence has identified a monetary overhang, especially when caused by financing governmental debts, as the cause of (hyper-) inflations (e.g., Bernholz 2015, ch. 5). On the other hand, a collapsing money supply still is considered as the main cause of the Great Depression, which led to deflation (Friedman and Schwartz 1963). Hence, the policies that lead to a huge increase in the money supply are still hotly debated. Bernholz (2015, p. 10) states that “during the crisis such a dramatic increase of the monetary base … took place as had formerly only been observed before high or hyperinflations. However, this time it happened without leading to inflation. On the other hand, broader money … saw no unusual increase during the financial crisis. This leads to problems, namely which type of money could be responsible for later inflation”. That controversy begs the question of how far markets perceived the actions of the ECB to be de- or inflationary.

Assessing the impact of those changes or summarizing the overall stance of monetary policy in such a different environment is challenging. To start with the latter, conventional monetary policy commonly is approximated by short-term policy interest rates (e.g., Mumtaz and Theophilopoulou 2017; Coibion et al. 2017). In unconventional times, the primary instrument is constrained by the effective lower bound, making the assessment of the stance of monetary policy infeasible. A common way of circumventing that problem is the use of so-called shadow rates (Krippner 2015; Wu and Xia 2016; Inui et al. 2017). The shadow rate is derived from yield curve data and has no binding lower bound. In normal times, it approximately equals the policy rate, whereas in effective lower bound environments, it may turn negative reflecting movements at the far end of the yield curve. Considering longer maturity interest rates is essential for assessing the monetary policy stance; the ECB’s unconventional tools like APP and forward guidance aim to influence exactly those rates. We follow Krippner (2013a, b, 2015) and measure the stance of monetary policy as interpreted by financial markets by using the Krippner shadow rate.

We want to gain insights into the extent to which financial markets react to the communication of the ECB. Further, we are interested in the relationship between communication and the expectations of professional forecasters.

Communication plays an extremely important role in the introduction and implementation of unconventional policy measures such as the quantitative easing (QE) programs. According to various studies, the strongest effects on asset prices can be felt precisely when such programs are announced. The expected consequences of the programs are therefore immediately reflected in asset prices. How the programs initially are “sold” could be a key factor in their success. Substantive evidence exists that ECB communication is able to reduce financial market variability (see, for instance, Coenen et al. 2017; Filardo and Hofmann 2014). Moreover, financial markets are able to predict monetary policy decisions better when communication is collegial, i.e., by conveying the majority view of the committee instead of members’ individualistic opinions (Ehrmann and Fratzscher 2013). A broad consensus also exists that forward guidance moves financial markets in the intended direction (Brand et al. 2010; Ehrmann and Fratzscher 2007; Galardo and Guerrieri 2017; Swanson 2017). That is also the case for the announcement of an APP, especially in the presence of forward guidance (Coenen et al. 2017). In line with the view that central banks manage expectations by using communication (Woodford 2001), a second strand of literature has investigated the influence of communication on inflation expectations and, eventually, inflation outcomes. Empirical results suggest that transparency reduces the volatility of expectations and inflation (van der Cruijsen and Demertzis 2007; Ullrich 2008).

Studies that quantify central bank communication differ in terms of the methodology applied. Some scholars measure communication by interpreting the tone of inter-meeting speeches (Ehrmann and Fratzscher 2007); others quantify the frequency of future-tense verbs in the first section of the introductory statement (Galardo and Guerrieri 2017). Coenen et al. (2017) consider the length of the introductory statement, compute a language complexity index and classify different types of forward guidance and APP announcements to estimate their individual effects. Other strategies include the use of money market data to build communication indicators (Brand et al. 2010).

Our empirical analysis uses a unique dataset encompassing almost 43,000 classified statements that stem from the introductory statements after each ECB Governing Council meeting in which monetary policy decisions were made. We rely on human coding to accurately distil the information conveyed. In contrast to other studies that quantify communication, that method allows us to build more thorough and reliable communication measures that are consistent across time. Each press release is dissected into statements that subsequently are classified according to their topical association, time reference and qualitative content. The last reflects the tone (“increase”, “stay the same”, or “decrease”), allowing for an economic interpretation of the impact on various variables. From the statement-level data, we construct indicators that reflect key subjects in the introductory statement: price stability aspects, the economy and monetary developments. To measure the change in the market’s interpretation of the stance of monetary policy, we compare the shadow rate the day after the Governing Council meeting to its value the day before. By concentrating on that short time window and furthermore controlling for, e.g., the previous shadow rate, the actual interest rate decision and its surprise component, the changes in expected and realized inflation, GDP and money (M3) growth, we intend to isolate the effects of the ECB’s communicated actions and outlook on the market interpretation of monetary policy. Additionally, we want to assess the impact of ECB communication on the market’s perspectives on exchange rates and inflation expectations. For that purpose, we consider the change in the nominal euro effective exchange rate and the change in inflation-indexed swap rates around ECB Governing Council meetings. In a second model, we analyze whether changes in professional forecasts, as measured by the consensus forecasts published by Consensus Economics, are related to the communicated assessments of the ECB Governing Council. We distinguish between expectations in inflation, GDP growth and M3 growth.

We find that ECB communication on the economy has been important in driving the shadow rate. This relationship appears stable over time, i.e., does not change across the different monetary policy phases we distinguish. When focusing on changes in the shadow rate, we therefore do not find evidence that communication has become more important. Communication on money is not immediately picked up by financial agents and thus not reflected in the shadow rate. Communication on money does appear to matter for inflation expectations as extracted from swap data. In our setup, exchange rates do not appear to be affected by ECB communication through its press releases. Its communication on price and in particular economic developments, however, does matter for the shadow rate. We find a significant, quantitatively important and stable impact of both on the assessment of financial market participants of the ECB’s monetary policy stance, as measured by the shadow rate.

Not only financial market participants, but also professional forecasters appear to be influenced by the messages conveyed in the ECB’s press releases. Messages related to the economy and price stability both impact changes in growth and inflation forecasts; those on money are related only to money growth forecasts. We thereby confirm the results already reported in Berger et al. (2011) that monetary developments in general appear to play only a minor role. The clear exception occurs during the period that covers both the Great Financial Crisis and the euro area crisis. During that period, actual increases in asset and security holdings related to monetary policy were associated with downward adjustments of growth forecasts; communication suggesting expansionary developments in the monetary sector coincided with downward forecasts in money growth rates. Hence, particularly during that crisis period these relationships appear to have been distorted.

The rest of the paper is structured as follows. We describe the different phases of monetary policy since the existence of the ECB in the next section. The data are introduced subsequently in Sect. 3. Section 4 presents the empirical results and Sect. 5 concludes.

2 Different phases of monetary policy

Since the start of its activities in 1999, the ECB has gone through various stages in its monetary policy operations. Clearly, policy was conducted in a different way before the onset of the Great Financial Crisis than it was afterwards. Those changes are documented in Fig. 1, which depicts the evolution of the asset side of the ECB’s balance sheet, the main refinancing rate and the shadow rate as a measure of the overall policy stance.Footnote 4

Fig. 1
figure 1

Source: ECB, Krippner

ECB’s balance sheet. Notes: SMPP Securities held for monetary policy purposes, MRO main refinancing operations, LTRO longer term refinancing operations, MLF Marginal lending facility.

Until the Great Financial Crisis, the shadow rate, in line with short-term money market rates, followed the path of the main refinancing rate closely. During that period, monetary policy was conducted almost exclusively by setting the three key ECB interest rates, which determined the path of money market rates. When the financial crisis hit, central banks around the world reacted in a consolidated fashion by providing an ample and stable supply of emergency liquidity to avoid a financial meltdown. They also cut policy rates decisively. Those efforts were most pronounced after the Lehman Brothers shock in September 2008. The ECB started to provide unlimited credit to banks at a fixed interest rate, an approach known as fixed-rate full allotment. Moreover, the maturity of refinancing operations was extended considerably and the range of eligible assets that could be used as collateral was expanded.

In 2010, the European Sovereign Debt crisis emerged, when the Greek fiscal situation deteriorated significantly and several other euro area countries subsequently became distressed. During the first stage of the crisis (until September 2012), the ECB bought a limited amount of troubled bonds under the Security Markets Program, but sterilized the effect on the monetary base using the Term Deposit facility. A policy of quantitative easing was not yet politically feasible. In contrast to other major central banks, the ECB started to raise rates in 2011, citing upside risks to price stability, which with the benefit of hindsight exacerbated the debt crisis unnecessarily. The shadow rate increased even before the official rate hikes, already indicating a more restrictive policy stance. When President Mario Draghi took over duties as ECB president in late 2011, policy reversed course. Monetary conditions were eased by two additional large liquidity-providing operations (VLTROs - very long-term refinancing operationsFootnote 5) and a later reversing of the interest rate hikes. Mario Draghi finally ended the debt crisis by giving his famous “Whatever it takes” speech on July 26, 2012, which was followed by the official announcement of the Outright Monetary Transactions (OMT) program that in principle allows the ECB to buy government bonds in unlimited quantity to avoid a self-reinforcing vicious feedback loop in sovereign bond markets. In fact, that particular program never was activated. Nevertheless, all of the foregoing measures led to a considerable easing of monetary conditions.

However, in 2013, the stance of monetary policy started to become more restrictive when banks repaid large fractions of money taken up under the VLTROs; the monetary base contracted significantly. The ECB began using explicit forward guidance in July 2013 when the ECB Governing Council said that it expected interest rates to remain low for an extended period of time. Significant worries about a continued downward trend in underlying inflation saw the ECB entering a new phase of monetary easing in June 2014. The Governing Council decided to introduce a negative rate on its deposit facility to overcome the zero lower bound problem, start new asset purchase programs for asset-backed securities (ABS) and covered bonds (CBPP) and to stop sterilizing asset purchases. In addition, the ECB introduced a facility to provide longer-term funding to banks for new loans, contingent on bank credit supply behavior, referred to as targeted longer-term refinancing operations (TLTRO).

Finally, in January 2015, as the last of the world’s major central banks, the ECB embarked on a large-scale asset purchase program (APP), which included sizable purchases of sovereign bonds. It was announced that the ECB would each month buy euro-area bonds from central governments, agencies and European institutions worth 60 billion euros. That program started in March 2015, and initially was supposed to last until September 2016. It was later extended in size and duration. Net purchases under the APP program finally ended in December 2018 and the ECB’s balance sheet then contained assets held for monetary policy purposes worth 2.6 trillion euros.

Hence, we can summarize that, until the financial crisis monetary policy was conducted primarily through changes in policy rates, while in recent years the effect of unconventional measures dominated. Broadly in line with the ECB (Constâncio 2018), we classify the monetary policy for the euro area into four phases. The first phase starts with the launch of the single currency and lasts until the revision of the monetary policy strategy in May 2003, when the weight of the monetary pillar and the “dominant role of money” were demoted, bringing the framework closer to the flexible inflation-targeting regime adopted by many other central banks around the world. Also, for purely technical reasons—we do not have expected inflation and growth rates for the euro area at large of a similar quality beforehand as we do afterward—we will ignore that period altogether in the rest of this paper.

The second phase spans from the revision of the monetary strategy to the outbreak of the Great Financial Crisis, i.e., the bankruptcy of Lehman Brothers in September 2008. The third phase then marks an abrupt change in euro area monetary policy. The fourth and final phase of monetary policy, the quantitative easing phase, starts in June 2014 with the announcement of the comprehensive package of expansionary measures described above.

3 Data

To summarize the overall stance of monetary policy, we use the shadow rate (SR) as developed by Krippner (2013a, b, 2015). Prior to the financial crisis in 2008, yield curve dynamics were often modelled using Gaussian affine term structure models (GATSM). One prominent downside of GATSMs is that they assign positive probabilities to negative interest rates. In other words, they do not account for the effective lower bound (ELB). Shadow models have become a popular tool to circumvent that problem. The shadow rate represents the short rate in a hypothetical cashless world. The difference between that hypothetical world and the real world is the opportunity to withdraw and store cash if interest rates turn negative. The feature is modelled by a put option, i.e., the right to exchange the shadow rate against the fixed ELB rate.Footnote 6 Hence, the short rate (\( R \)) is the sum of the shadow rate and the payoff from the put option: \( R = SR + max\left\{ {{\text{ELB}} - SR,0} \right\}. \) Consequently, whenever the shadow rate is (far) above the ELB, the option value becomes close to zero and the short rate coincides with the shadow rate. In contrast, in ELB environments, the SR may turn negative, reflecting movements at the long end of the yield curve.

In essence, Krippner’s shadow model estimates the observed yield curve and the shadow yield curve simultaneously. To obtain the shadow rate, one essentially slides along the shadow yield curve to the point at which the term to maturity is zero.

Figure 2 depicts changes in the estimated euro yield curve and the corresponding shadow yield curve between two specific dates. The top panel illustrates the change between September 2008 and March 2009. During that period, the main refinancing rate (MRR) was reduced from 4.25 to 1.5% in five steps. While the shadow rate on September 19, 2008, is almost identical to the MRR, it is substantially lower on March 19, 2009, reflecting the rising value of the put option in near-ELB environments. At the beginning of 2018 (bottom panel), when shorter maturity rates hit the ELB, the increase at the long end of the yield curve from January 19, 2018, until February 19, 2018, affects the entire shadow yield curve, including the shadow rate. Thus, the SR offers a comprehensive indicator of monetary policy’s stance across conventional and unconventional phases.

Fig. 2
figure 2

Euro Overnight Indexed Swaps (OIS) yield curve, estimated shadow yield curve, and shadow rate for specific dates prior to QE (top) and afterwards (bottom). Notes: The euro OIS rates are taken from Datastream. The shadow yield curve is estimated from 3- and 6-month, and 1, 2, …, 10 year euro OIS rates.

Krippner provides the shadow rate for the euro area on a daily basis, enabling us to assess the effect of policy decisions communicated by the ECB Governing Council on its meeting days.Footnote 7

Figure 1 shows the SR and the MRR as determined by the ECB Governing Council. Unsurprisingly, the SR and the MRR move closely together until the beginning of the European debt crisis. Both rates diverge sharply once the MRR enters the ELB environment. The contemporaneous correlation coefficient is 0.91.

We use real-time consensus forecasts as provided by Consensus Economics, Inc., to construct expected inflation, output growth and M3 growth series. The monthly survey includes estimates of prominent banks and forecast organizations on a range of variables such as future growth, inflation, interest rates and exchange rates. Each forecast is made for the current and the following year, enabling the construction of 12-month forecasts as a weighted average of both rates.Footnote 8 Since Consensus Economics did not publish forecasts for the euro area prior to January 2003, we restrict our estimation window to the 2003–2018 period.Footnote 9

To reflect the latest economic information available, we collect real-time observations on actual inflation, GDP growth and M3 growth from the Real Time Database published by the ECB in its Statistical Data Warehouse.Footnote 10 For all three variables, we must realize that the “euro area” is a moving concept in the sense that the introduction of that currency in Greece, Slovenia, Cyprus, Malta, Slovakia, Estonia, Latvia and Lithuania redefines the area that is covered by our data, thereby implying benchmark revisions. Regarding inflation, we use the different vintages that are available for monthly year-over-year growth rates in the overall Harmonised Index of Consumer Prices (HICP). As to be expected, those inflation statistics hardly ever are revised. The small revisions that do occur take place within the first couple of releases or are required by other smaller benchmark revisions.Footnote 11 GDP growth is calculated from the chain-linked volumes of quarterly Gross Domestic Product. In general, revisions to that variable tend to be larger and more frequent than those to the inflation variable. Revisions in monthly year-over-year growth in the monetary aggregate M3 are, on the other hand, more comparable to those in inflation.

The ECB’s most important channel of communication is the ECB president’s Introductory Statement following the Governing Council meeting (de Haan 2008). Roughly once a month, the ECB Governing Council meets to discuss and take monetary policy decisions, which are announced publicly at 13:45 (CET). The subsequent press conference held by the ECB’s president and vice president consists of two parts: a prepared Introductory Statement agreed upon on a word-by-word basis by all council members and a Questions & Answers session allowing journalists to address remaining questions. Beside the monetary policy decisions, the different sections of the Introductory Statement provide the ECB’s assessment of developments in areas such as the real economy, prices and monetary aggregates.

In order to quantify ECB communication, we use indicators that capture the key subjects of the Introductory Statement for monetary policy, i.e., the development of the real economy, prices and monetary aggregates. The statements by the ECB president are analyzed by the media research institute Media Tenor. A media analyst codes each statement (several statements can be found within one sentence) by assigning a broad as well as a specific topic association, a time reference and its qualitative content. The latter is classified numerically into “increase”, “stay the same”, or “decrease”. For instance, in the introductory statement from March 17, 2019, Mario Draghi said

Compared with the December 2016 Eurosystem staff macroeconomic projections, the outlook for real GDP growth has been revised upwards slightly in 2017 and 2018.

That sentence has been assigned to the broad topic “economy” and assessed to be an “increase”. Overall, we use 42,827 statements contained in 168 Introductory Statements, each of which contains, on average, 255 coded statements. Our three ECB communication indicators (price stability, economy and money) are, on average, constructed from 37.9, 19.2 and 24.3 coded statements, respectively. The constructed indicators are the normalized balances of up- and downward assessments (including the neutral ones) regarding the specific topic. Formally,

$$ indicator_{i,t} = \frac{{\# positive_{i, t} - \# negative_{i,t} }}{{\# positive_{i, t} + \# negative_{i,t} + \# neutral_{i,t} }}, $$

where \( i \in \) {price stability, economy, money}. Accordingly, all indicators range theoretically from minus one to plus one.,Footnote 12Footnote 13 Each of the panels in Fig. 3 plots the evolutions of the statements’ realized and expected counterparts, together with the respective communication indicator. Each data point reflects the information available at that particular moment in time. The resemblance between the communication indicators and their respective reference series clearly is visible.

Fig. 3
figure 3

Forecast, realized and communicated information on inflation, economic growth and money growth, 2003m5-2018m12. Notes: The forecast information is taken from Consensus Economics, Inc. The realized data are taken from the real-time database of the ECB’s Statistical Data Warehouse. The ECB communication data are extracted from ECB press releases.

In line with Bredin et al. (2010) and Fausch and Sigonius (2018), we use three-month Euribor future rates to construct the market’s surprise reaction to the change in the main refinancing rate. Bernoth and von Hagen (2004) show that Euribor future rates are unbiased and informationally efficient predictors of future spot rates. Consequently, we define the surprise component of the monetary policy decision by the change in the Euribor future rate from the end of the ECB Governing Council meeting day and the end of the previous day.Footnote 14

In order to control for the market’s reaction to the US jobless claims published each Thursday, we use the difference between actual unemployment compensation claims and the median expected claims polled by Reuters on the previous Monday as a surprise indicator (Coenen et al. 2017). Hence, a positive surprise means that more claims were filed than expected previously.

As a robustness check, we also want to examine the effect of ECB communication on other measures that reflect financial market expectations. For that purpose, we examine both exchange rates and a financial market measure of inflation expectations. We use the euro’s nominal effective exchange rate as published by the ECB to measure the foreign exchange market’s perception of the value of euro relative to foreign currencies.Footnote 15 Regarding inflation expectations, we use one-year euro inflation-linked swaps provided by Bloomberg on a daily basis, which have been available since 2004 (e.g., Grothe and Meyler 2015). An inflation swap is a derivative contract that entitles the buyer to earn a fixed interest rate in exchange for a floating rate. The floating rate is linked to an inflation index. The fixed inflation swap rate therefore represents the market’s inflationary expectation over a specific investment period. As in the case of the shadow rate, its daily frequency allows us to infer the immediate impacts of ECB communication on the change in market-based inflation expectations.

Table 1 reports summary statistics and contemporaneous correlation coefficients for all variables used. The largest contemporaneous correlations are found between the shadow rate and the main refinancing rate, between the expected and realized inflation rates and between expected and realized M3 growth rates.Footnote 16 The three different communication variables hardly are correlated with each other and, hence, appear to reflect substantially different informational contents of the ECB’s press releases.

Table 1 Summary statistics and contemporaneous correlation coefficients

In the empirical analyses below, we either move to the frequency at which press releases after ECB Governing Council meetings are issued, or to the monthly frequency at which consensus forecasts are published. In the first case, we will concentrate on the change in the shadow rate around the Governing Council meetings, i.e., the difference in the shadow rate between the day before and the day after the ECB Governing Council’s press conference. The analysis will be repeated for the change in the euro’s nominal effective exchange rate and the change in inflation expectations based on swaps.

Given the different monetary policy phases summarized in Sect. 2, we are interested not only in analyzing the impact of ECB communication during the full sample period, but also whether we can observe structural changes across those phases. In a first step, Table 2 reports the correlation coefficients between the change in the shadow rate, on the one hand, and the actual decided change in the main refinancing rate as well as the three communication indicators based on the ECB press releases, on the other hand.Footnote 17

Table 2 Correlation of the change in the shadow rate with the change in the ECB main refinancing rate and all three communication indicators

What catches the eye is that the largest correlation is between the ECB communication indicator reflecting price stability and the change in the shadow rate. However, that holds only for the last monetary policy phase we distinguish. Whereas Fig. 1 suggests a close link between the main refinancing rate and the shadow rate until the financial crisis. The correlation between the change in each of them is quite stable across the different phases. Overall, the ECB’s communicated assessment of the economic situation and outlook is most strongly correlated with changes in the shadow rate.

Another way in which we can split our sample is by comparing each interest rate decision with what would have been implied by a rule-based approach. Debate continues about the benefits of rule-based versus discretionary monetary policy. Following Cochrane et al. (2019), we construct a measure indicating whether the actual decision aligns with a (Taylor) rule-based policy and check whether the effect of communication on expectations depends on it. When the interest rate decision is in line with a Taylor rule, the correlation between the change in the MRR and the change in the SR is almost non-existent. The same conclusion, albeit to a much lesser extent, also applies to our surprise measure and the shadow rate. Apparently, market participants are more likely to have anticipated policy decisions that are consistent with a Taylor rule. Communication regarding the economy appears to be especially relevant when the ECB deviates from what a Taylor rule would have implied.

4 Results

4.1 Explaining the immediate impact on the shadow rate

In our first model, we want to explain the reactions of financial market participants as measured by changes in the shadow rate on both the decisions made by the ECB Governing Council and its communication. We use the change in the shadow rate between the day before and the day after the ECB Governing Council meetings that are followed by a press conference. By concentrating around those meeting days, we reduce the probability that developments other than the ECB’s explicit decisions and communication are driving the movements in the shadow rate.

The most general version of our model is summarized by

$$ \tilde{\Delta }s_{{t_{i} }} = \alpha s_{{t_{i} - 1}} + \beta ECB\;communciation_{{t_{i} }} + \gamma z_{{t_{i} }}^{market} + \delta z_{{t_{i} }}^{economy} + \varepsilon_{{t_{i} }} , $$

where \( t_{i} \) is the day of the i-th ECB Governing Council meeting in our sample, the dependent variable \( \tilde{\Delta }s_{{t_{i} }} = s_{{t_{i} + 1}} - s_{{t_{i} - 1}} \) denotes the change in the shadow rate the day before and the day after the \( i \)-th meeting, and \( z_{{t_{i} }}^{market} \) includes financial market control variables such as the decided and surprise change in the main refinancing rate as well as the surprise in US jobless claims. The economic control variable \( z_{{t_{i} }}^{economy} \) includes realized and expected twelve-month inflation rates, GDP growth and M3 growth. The variable \( ECB\;communication_{{t_{i} }} \) includes our three ECB communication measures on price stability, the economy and money, respectively. The exact timing of the model is illustrated in Figure A.1 in the online appendix.

The first column in Table 3 indeed reveals a positive and significant correlation between the decided change in the main refinancing rate and the movement of the shadow rate. Despite its significance, the size of the coefficient is at first glance small. Only 7% of the change in the main refinancing rate is reflected immediately in the shadow rate. That result is, however, not that surprising, given that most of the time markets are well prepared regarding upcoming interest rate decisions and, hence, most likely already have incorporated them in the shadow rate the day before the Governing Council meeting. The same conclusion also is supported by the next column showing that the shadow rate reacts much more strongly to the surprise component of the interest rate decision. When we use our three different communication measures to explain movements in the shadow rate, the results in column (3) show that, although all three have the expected positive signs, only that part of the press release that indicates the views of the ECB regarding the direction in which the real economy is evolving has a significant impact on the change of the shadow rate.Footnote 18 Comparing columns (1) and (3) highlights that the information revealed in the press release is more salient to the financial markets than the mere interest rate decision itself: albeit still small, the adjusted R2 more than doubles in size. Including the initial value of the shadow rate does not change things (column (4)). When we enter the decision and the surprise variable next to our communication measures, we still find an improvement in the adjusted R2 and, again, in our communication variables; only the one on the economy has a significant impact on the change in the shadow rate (column (5)).

Table 3 Explaining the change in the shadow rate around Governing Council meetings

In column (6), we add several other variables that might be related to the monetary policy decision and thereby perhaps to the change in the shadow rate. They include changes in professional forecasts, but also in releases of “hard” data regarding inflation, GDP growth and M3 growth since the previous Governing Council meeting. The only variable that helps to explain changes in the shadow rate further is the change in the expected GDP growth rate. When expected GDP growth picks up, the shadow rate tends to pick up as well. Entering expected GDP growth, however, does not change the significance of the coefficient capturing the impact of ECB communication on the economy. As to be expected, the size of the coefficient, however, is modestly reduced further. Once we incorporate the additional control variables, the actual interest rate decision no longer has a significant impact on the shadow rate.Footnote 19

In a next step and based upon the model’s full specification in column (6), we apply a general-to-specific methodology while keeping all communication variables on board.Footnote 20 The results are shown in column (7). The change in the consensus forecast of GDP growth and the interest rate surprise remain significant. In addition to the ECB’s communication on the economic situation and the outlook, communication on inflation now also has a positive and significant impact on the change in the shadow rate. That does not change if we no longer restrict the general-to-specific approach by including all communication variables (column (8)).Footnote 21

How important is the impact of ECB communication on the real economy?Footnote 22 A one standard deviation change in overall ECB communication leads roughly to a one-quarter standard deviation movement in the shadow rate. An effect of comparable magnitude is found for changes in expected GDP growth. A similar variation in the interest rate surprise leads to more than half of a standard deviation change in the shadow rate. Hence, only the interest surprise variable appears quantitatively more important than, in particular, the messages regarding price stability and the economy as contained in the ECB’s press releases.

How stable are the detected relationships across the different monetary policy phases identified in Sect. 2? To answer that question, we allow all variables identified in column (7) of Table 3 to differ in phases 3 and 4.Footnote 23 For that purpose, we introduce dummy variables reflecting each of those phases and interact them with all included variables. The regression results are displayed in Table 4. As the individual dummy and interaction coefficients for the communication variable suggest, and as is formally shown by p-values of joint F-tests on them, no statistical differences across the phases are found regarding any of the variables. In addition, when computing an overall Chow test, of which the p-value is shown in the last row in the left panel of Table 4, that conclusion does not change. Therefore, the shadow rate response seems remarkably stable over such different periods.

Table 4 Differences across phases or decision type

Complementary to our policy phases, we classify each ECB Governing Council meeting day into rule-based or not rule-based phases and then estimate a similar regression model with dummy interaction terms according to those classifications. We follow Cochrane et al. (2019) and Nikolsko-Rzhevskyy et al. (2014) and apply an adjusted Taylor rule that accounts for the zero lower bound on interest rates in order to allocate each policy decision to the two phases. Whenever the difference between the policy rate and the Taylor-rule-implied rate declines, a meeting is classified as rule-based; if the difference increases, it is classified as not rule-based. The results are presented in the right panel of Table 4. Looking at the individual coefficients across the two phases, we again do not find evidence of structural breaks. In addition, an overall Chow test (as reported in the last row of the right panel in Table 4) cannot reject the null hypothesis of no significant differences across them.

By focusing on the immediate impacts of the press release and monetary policy decision on the shadow rate, we have so far found significant, strong, stable and robust relationships between those aspects of the press release that interpret the real economy and price stability through the ECB’s eyes.

4.2 Do other financial market variables react to ECB Communication?

In an additional exercise, we swap the change in the shadow rate for the change in the nominal effective exchange rate and the change in market-based inflation expectations, respectively. The results are presented in Table 5. In a first regression, we include all ECB communication indicators and all control variables; we then use the same general-to-specific procedure as before. Regarding the change in the nominal effective exchange rate, we observe that none of the communication indicators has a significant impact. The only variables that affect the change in the nominal effective exchange rate significantly around ECB Governing Council meeting days turn out to be the decided change as well as the surprise in the MRR, along with expected M3 growth.

Table 5 Explaining changes in the exchange rate and market-based inflation expectations

However, ECB communication regarding money does have a positive and significant effect on the change in inflation expectations. In a quantitative sense, it has the strongest impact of all of the variables we consider. According to Table A.1 in the online appendix, which reports the standardized results of the general-to-specific approach, a one standard deviation change in the communication variable regarding money leads to approximately more than a fifth of a standard deviation change in inflation expectations. The surprise in US jobless claims as well as in expected M3 growth have negative and significant effects, albeit they are quantitatively less strong than that of our money-communication variable. Unsurprisingly, the expected twelve-month ahead inflation rate has a significant and positive impact on inflation expectations, although it also is quantitatively less strong than that of ECB communication regarding money.

We can conclude that while we do not find evidence that ECB communication affects exchange rates, ECB communication on monetary phenomena does affect inflation expectations based on swaps. At least in that market, participants consider ECB communication related to its monetary pillar to be indicative for future inflation. That exchange rates are unrelated to ECB communication is consistent with the claim of ECB officials that exchange rates are not an ECB policy target and are in general not commented on.

4.3 The impact on the expectations of professional forecasters

The above subsection provided evidence that financial market participants listen and react to what the ECB communicates. The shadow rate and inflation expectations react within a day to messages conveyed in the ECB’s press releases. In a next step, we investigate the extent to which professional forecasters are affected by both monetary policy decisions and the information contained in the associated press releases of the ECB. For that purpose, we look at changes in the twelve-month ahead consensus forecasts constructed from monthly forecast surveys published by Consensus Economics, Inc. In line with our communication indices, we concentrate on inflation, GDP growth and M3 growth projections for the euro area. As before, the sample starts in May 2003 and ends in December 2018.Footnote 24

A general version of our second model is given byFootnote 25

$$ \Delta \hat{x}_{{k,t_{j} }} = \alpha \hat{x}_{{t_{j - 1} }} + \beta ECB\;communciation_{{t_{j} }} + \gamma z_{{t_{j} }}^{ECB} + \delta z_{{t_{j} }}^{economy} + \varepsilon_{{t_{j} }} , $$

where \( t_{j} \) is the day of the \( j \)-th consensus forecast release date in our sample and the dependent variable \( \Delta \hat{x}_{{k,t_{j} }} = \hat{x}_{{k,t_{j} }} - \hat{x}_{{k,t_{j - 1} }} \) denotes the change of the twelve-month ahead consensus forecast of variable \( k \) between \( t_{j} \) and its previous release \( t_{j - 1} \).

We distinguish four sets of explanatory variables. The first set contains the consensus forecasts at the beginning of the period (\( \hat{x}_{{t_{j - 1} }} \)). We expect to see some mean reversion in our data, i.e., strong (weak) forecasts are likely subsequently to be reduced (increased).

The second set represent our communication variables. \( ECB\;communciation_{{t_{j} }} \) denotes the latest available version of our three communication variables prior to the \( j \)-th release of the consensus forecast. Our expectation is that statements suggesting improvements or deteriorations in the to-be-forecasted economic variable will lead forecasters to adjust their expectations for that particular variable in the same direction.

The third set includes variables associated with ECB actions (\( z_{{t_{j} }}^{ECB} \)). As in the previous section, we enter the change in the main refinancing rate and the interest rate surprise derived from money market futures at decision days. In addition, we include the realized change in total assets and securities on the ECB’s balance sheet that reflect monetary policy actions.Footnote 26,Footnote 27

The last variable group measures changes in our variables of interest as reported officially and available at the time of the consensus forecast (\( z_{{t_{j} }}^{economy} \)). It includes the latest version of realized inflation rates, GDP growth and M3 growth published prior to \( t_{j} \). We expect that official information released regarding the forecasted variables will influence the expectations of the professional forecasters.

Table 6 reports summary statistics for all variables just described. It reveals that the average inflation, economic growth and money growth forecasts in our sample hover around 1.6%, 1.2% and 4.7%, respectively. The changes in those forecasts are, on average, close to zero.

Table 6 Summary statistics of variables used in explaining changes in forecasts

Table 7 reports the results for three alternative specifications. The first column for each outcome variable includes all variables described and available. The second column contains the results from a simplified model where variable reduction is based on the same general-to-specific methodology as before. Finally, the three third columns are estimated jointly using the seemingly unrelated regression method. That method allows for a potential gain in efficiency, as the residuals across these three equations are likely to be correlated.Footnote 28

Table 7 Monetary policy and communication impact on professional forecasters’ expectations

The results of the first set of variables reveal that, in general, forecasts revert to the mean. Such reversion is most pronounced for GDP growth forecasts. For money growth, however, we hardly can reject the hypothesis that we are observing a random walk process. Furthermore, money growth forecasts appear unrelated to previous forecasts in inflation and GDP growth. According to the general-to-specific results, the same holds for inflation expectations. Previous GDP or money growth expectations are not associated with subsequent changes in inflation expectations. Changes in growth expectations are, on the other hand, also affected negatively by high inflation expectations at the previous consensus survey release.

The impact of the communication variables mostly is significant and qualitatively at least as important as that of the first set of variables. Whereas ECB communication related to money is helpful only in explaining changes in money growth forecasts, communication on price stability and the economy is significant in explaining both changes in inflation and growth expectations. As expected, communication regarding the course of the economy is more important in explaining growth than inflation forecasts. The same holds true for the importance of price-stability communication on inflation versus growth forecasts. As the standard deviations of both communication variables are of about the same magnitude, the relative sizes of the coefficient estimates can be compared directly.Footnote 29 Accordingly, when explaining inflation forecasts, the impact of communication on price stability is almost twice as large as that of communication on the economy, and vice versa.

The changes in the main refinancing rate and in the assets and securities linked directly to monetary policy are both robust in explaining forecast revisions of GDP growth and inflation. Neither of those two measures of actual policy implementation helps in explaining changes in money growth forecasts. Looking at the estimated signs of those variables reveals that a loosening of monetary policy is associated with both lower growth and inflation forecasts for the upcoming 12 months. Instead of boosting these outlooks, we find that professional forecasters rather interpret expansive policies as signs of deteriorating economic conditions. Note that the foregoing effects are conditional on the communicated assessment of the ECB and recently published hard data. Hence, even if we hold official data and ECB communication constant, actions that loosen monetary policy are associated with downward revisions of growth and inflation forecasts using a forecast horizon of 12 months.

Finally, it comes as no surprise that the release of official data drives forecast revisions in the same direction. The estimation results suggest, however, that only the data directly related to the variable forecasted has an impact on those forecasts, i.e., the realized inflation rate helps explain inflation forecasts, the GDP growth rate the GDP growth forecast and M3 growth the growth forecast for M3.

Taken together, the communication variable measuring price stability has the quantitatively largest impact on inflation forecasts. A one standard deviation change in that communication variable translates into more than a third of a standard deviation change in the inflation forecast. Although the impact of communication regarding the economy on the GDP growth forecast is even larger, at 0.4 standard deviations, both the initial forecasts and the change in the main refinancing rate are at least as important quantitatively. Our model can explain approximately half of the variation in changes in growth forecasts. Changes in money growth forecasts are much more difficult to model. The only three significant variables each have a quantitative impact of about 20% of a standard deviation triggered by a one standard deviation change (see Table A.2 in the online appendix). The resulting R2 merely is around 0.1.

How robust are those results across the three different monetary policy phases that we distinguish? In Table 8, we first report results that allow all ECB variables to differ across the phases. Subsequently, we apply the same general-to-specific methodology as before. At the bottom of the table, we report p-values of F-statistics testing the null hypothesis that the respective interaction terms are zero, implying no statistically significant differences across the monetary policy phases.

Table 8 Impact across different policy phases

In contrast to our first model in which we explained changes in the shadow rate and did not find any notable differences across these monetary policy phases, we now find that the ECB communication variables do have statistically different impacts across the phases when it comes to adjustments in consensus forecasts. In particular, communication related to the economy has a much stronger impact on both inflation and growth forecasts during the period starting with the Great Financial Crisis and ending before the quantitative easing phase in June 2014. After the ECB started to deploy its asset purchase program, money growth forecast revisions were associated strongly with the bank’s communicated assessments of the course of the economy. Whereas communication on money overall has a positive impact on money growth forecasts (see Table 7), the relationship was reversed during the Great Financial Crisis and the euro crisis period. In the same period, the actual increase in assets and securities for monetary policy purposes led to a decline in money growth forecasts. Both effects appear to have been temporary, as the counterintuitive relationships have disappeared with the onset of quantitative easing.

5 Conclusions

In this paper, we have studied one particular channel through which the European Central Bank (ECB) communicates with the external world: the press releases following ECB Governing Council meetings at which monetary policy decisions are made. Those press releases have been coded at the statement level and allow us to analyze the tones the ECB adopts on topics related to price stability, the real economy and monetary phenomena. Arguably, those three topics capture the monetary policy mandate of the ECB.

We have first looked into the impact those messages have on the financial market. For that we use the shadow rate as developed and published by Krippner (2013a, b), which reflects the assessment of financial market participants of the ECB’s overall monetary policy stance. By comparing the shadow rate the day before and the day after the ECB’s council meeting, we are confident that our results are driven by the actions of the ECB. Of the three topics identified and analyzed, we find a strong and robust impact of communication regarding the real economy and price stability on the shadow rate. Inflation expectations as measured by interest-rate swaps also appear to be affected by ECB communication on monetary developments. None of the established relationships appears to have changed significantly over time. Hence, the short-run reactions of financial market participants in setting interest rates or forming inflation expectations after a monetary policy decision and its communication by the ECB has remained remarkably stable over time.

In a next step, we have analyzed how professional forecasters, on average, change their inflation, GDP and money growth outlooks for the upcoming twelve months using data from Consensus Economics, Inc. We use the change in those consensus monthly forecasts, i.e., between consensus forecast releases. Given that longer time window, we can be less certain that we are indeed estimating a truly causal impact. We do, however, find that soft(er) information revealed by the press releases generally are related to consensus forecast adjustments. Overall, the information contained in that communication device appears to outperform actual monetary policy adjustments as measured by the change in the main refinancing rate and the assets and securities on the ECB’s balance sheet that are used for monetary policy purposes. Hence, again words seem to matter more than deeds.

In contrast to what we found for the shadow rate, professional forecasters did appear to have changed the ways in which they have interpreted the communication and decisions of the ECB. In particular, during the Great Financial Crisis and the euro area crisis, their behavior was different. To quite some extent, the relationship appears to have normalized again during the quantitative easing phase that started June 2014.