Introduction

Over the past decades, the asset class of real estate has increasingly left ‘Main Street’ and entered ‘Wall Street’. Real estate as the most important asset in the class of alternative investments has been securitized extensively during this time period. REITs are thereby the driving factor of an equity equivalent for stocks in the real estate sector. REITs – or listed real estate in general – overcome important challenges of investing in real estate markets, such as high transaction costs and time, high lot size, low liquidity, and information inefficiency, to name but a few. Substantial empirical work has been undertaken to shed light on the relationship between common stocks, listed real estate, and direct real estate (Ghysels et al. (2013) provide a comprehensive review of this literature). However, academics as well as practitioners are surprisingly divided in their opinion as to the fundamental driving factors behind the returns and risks of listed real estate investments. In line with a large part of the literature, the early study by Ross and Zisler (1991) finds that REITs co-move more closely with the stock market than with the real estate market.

Surprisingly, little research has been conducted to connect these findings in a theoretically rooted asset pricing framework, although a better understanding of this issue is of central importance for the literature. We give two recent examples from the literature to support this point. First, Ghysels et al. (2013) argue that REITs derive most of their income from real estate and thus provide a remarkably clean measure for testing real estate return predictability. Hence, econometric issues arising in forecasting regressions can largely be addressed. However, as the authors warn, if the risk and return characteristics of listed and direct real estate have different economic sources, results obtained from investigating the listed real estate market might not carry over to the direct real estate market. Second, following the arguments provided by Ang et al. (2013), determining the underlying risk factors of real estate assets is an important question for practitioners as well. Investors need a deeper understanding of the basic link between the different markets and influencing risk factors so that they know whether they are investing in real estate risk or stock market risk when they buy REIT shares – or to be more precise – to which extent they are exposing themselves to these risk factors.

This paper analyzes the joint stochastic properties of common stocks, listed real estate, and direct real estate, while providing a potential explanation of how a combination of risk factors might simultaneously drive the risk premia in all three markets. Our analysis proceeds as follows:

First, we investigate the empirical data as well as compare the return and risk characteristics of all three markets. We proxy common stocks with the Russell 3000 Index, listed real estate with the FTSE NAREIT Equity REIT Index, and direct real estate with the NCREIF NTBI Total Return Index. Our measure of direct real estate is a transaction-based index of the performance of real estate and is not subject to the appraisal smoothing bias (Ross and Zisler (1991) and Geltner (1993)). However, consistent with the literature, the NTBI moves with a time lag compared to REITs and is plagued with short-term noise at the quarterly time interval (Fisher et al. 2007). As a result, contemporaneous co-movement between direct real estate and listed real estate, as well as common stocks, is low. In contrast, measuring direct real estate returns with a lag of two quarters and sampling at an annual time interval, we find a significant correlation between direct real estate, listed real estate, and common stocks.

Second, after accounting for lagged movements in our measure of direct real estate returns, a principal component analysis reveals that two factors explain 94% of the variances of the three assets. The first is a common factor which loads almost equally on all three assets. We interpret this factor as evidence for the existence of a market-wide factor, i.e. business cycle risk, which affects all three assets. The second is a common stocks minus real estate assets factor. This factor loads positively on common stocks and negatively on listed real estate as well as direct real estate. We interpret this factor as the presence of two priced sources of risk in the data, namely stock market specific risk and real estate market specific risk, which show up as a long-short factor mimicking portfolio in the principal component analysis.

Third, we calibrate a simple asset pricing model which can replicate the observed empirical pattern and allows us to investigate the economic linkages between the stock market and the two real estate markets. This part is the main contribution of our paper. To the best of our knowledge, we are the first to quantitatively show to which extent REIT returns can be explained by a combination of risk factors in a structural model.

Motivated by the principal component analysis, our model has three sources of priced risk: business cycle risk, pure stock market risk, and pure real estate market risk. For a better understanding of potential linkages between the stock market and the real estate market, we apply two model specifications. In the first specification, there is a spillover channel from the stock market to listed real estate – which is not present in direct real estate. The second specification provides results for an idealized world in which listed real estate is exposed to exactly the same risk factors as direct real estate is.

We find that the model with stock market spillovers is closer to observed empirical characteristics of listed real estate than the model without spillovers is. It can replicate the descriptive statistics as well as the principal component analysis applied to the empirical data. However, due to the small sample nature of the empirical data, it is not possible to distinguish unambiguously between the two model specifications. In any case, the model allows us to dissect the risk premia of each of the three assets. For example, in the model specification with stock market spillovers, the expected listed real estate risk premium can be dissected into 36% stock market risk, 40% real estate risk, and 24% business cycle risk. Simply put, if we assume that listed real estate is exposed to additional risk factors, two thirds of the risk premium are still determined by the same sources of risk as for direct real estate. Therefore, our results show that listed real estate and direct real estate are likely to be driven (up to a large fraction) by common risk factors.

The remainder of this paper is organized as follows: In the next section, we give a short overview of the related literature. In “Empirical Data”, we describe the empirical data we used and their descriptive statistics. The principal component analysis reveals the major risk factors driving the returns of each of the three assets. In “Model”, we explain the risk sources of our structural model, the model calibration, and the simulation procedure. In “Results”, we discuss our results in two different model specifications: with and without spillover effect from the stock market. The last section concludes.

Literature

The reason for investments in real estate is motivated by the attractive portfolio attributes, in particular with regard to low cross-correlation with stocks, low downside risk, and high inflation hedge ability. Private and institutional investors are interested in the risk-minimizing effects on their stocks- and bonds-dominated portfolios. There is broad literature on the portfolio diversification potential with real estate in a mixed-asset portfolio: The first strand of literature is domestic-oriented with Firstenberg et al. (1988), MacGregor and Nanthakumaran (1992), Byrne and Lee (1995), and Byrne and Lee (2005). The later studies focus more on the international perspective with Ziobrowski and Curcio (1991), Newell and Worzala (1995), Eichholtz (1996), Chua (1999), Stevenson (2000), Hoesli et al. (2004), and Kroencke and Schindler (2012) among others. All of them conclude – however, to a different extent – that real estate can serve as a risk diversifier as well as a return enhancer in a multi-asset portfolio.

Most of the studies use appraisal-based or transaction-based indices to approximate the return-risk relationship of the real estate sector. For example, Hoesli et al. (2004) find an optimal allocation of real estate of between 15% and 25% in a multi-asset portfolio with real estate stocks and direct real estate by using real estate indices. Although an index approximation is appropriate for the stock and bond markets through the easy replication possibility or the growing exchange-traded product market, there is no such possibility for the real estate market. To generate a more realistic volatility, many authors unsmooth the appraisal-based real estate indices that they used. In their parametric portfolio approach, Plazzi et al. (2011) show allocation benefits of different property types in a real estate portfolio. However, most investors are not able to invest in such a large number of properties as is necessary for mimicking a whole real estate index.Footnote 1 Subsequently, investors have to circumvent this drawback with an indirect investment vehicle, such as REITs. But therefore, it must be found out to what extent and temporal lag REITs are driven by the same risk factors as private real estate. For example, Ling and Naranjo (2015) show that REIT returns react to fundamental factors more quickly than private market returns do. Ghysels et al. (2013) trace the origin of predictability for both return series.

Since the market capitalization surge of listed real estate, many papers have brought different results for the question of whether REITs are real estate or stocks. But none of them have used a structural asset pricing model in their investigation. The large majority of these studies is empirical, resorting particularly to correlation and / or co-integration analyzes. Among the first studies examining common risk factors for private real estate markets and REITs, Liu et al. (1990) and Liu and Mei (1992) use a market integration approach and conclude that both markets are integrated. Along the same lines, Mei and Lee (1994) identify a common risk factor for indirect real estate and REIT returns. Whereas Li and Wang (1995) are not able to confirm a common real estate factor, they but identify dividend yield, term premium, and default premium as the three major risk factors for REIT returns.

The early correlation-based studies, among them are Goetzmann and Ibbotson (1990) and Ross and Zisler (1991), detect a return-risk profile of REITs similar to that of small-cap stocks and a stronger relationship between listed real estate and the general stock market rather than between listed real estate and the underlying real estate market. Goetzmann and Ibbotson (1990) compare the time series of REITs with commingled real estate funds as representatives for direct real estate investments and find only low correlation as well as deviating mean returns and volatilities. Their comparison with the S&P 500 Index also reveals closer similarities between REITs and the stock market. Ross and Zisler (1991) as well as later studies, among them are Clayton and MacKinnon (2001), confirm these results. In contrast, Barkham and Geltner (1995), Eichholtz and Hartzell (1996), and Seiler et al. (1999) among others, discover that direct and listed real estate are increasingly influenced by the same factors, so that real estate companies proxy the direct real estate market quite well. Moreover, Anderson et al. (2005) show that the volatility of REITs cannot be explained by other asset classes such as equity, bonds, and direct real estate. Ling et al. (2000) use multi-risk factors, including macroeconomic and financial risk factors, in order to explain excess REIT returns. They find that macroeconomic risk factors are of minor importance.

Recent co-integration studies, e.g. Morawski et al. (2008), Yunus et al. (2012), Boudry et al. (2012), and Hoesli and Oikarinen (2012), basically imply that private direct real estate lags behind listed real estate and that both types of investment may deviate substantially from each other, especially in the short-run. The long-term perspective, on the other hand, shows that direct and listed real estate have similar risk-return characteristics (e.g. Pagliari et al. (2005)). This is believed to be due to differences in terms of liquidity and valuation, which converge over time. As for listed real estate, liquidity induces more volatile returns Barkham and Geltner (1995). The appraisal-based valuation of the direct real estate market has lower frequencies and adjusts to market developments after a temporal lag (e.g. Giliberto (1990)). Both effects decrease over time. A reason for the remaining difference between these two investment vehicles can be found in the leverage effect. Oikarinen et al. (2011), for instance, explain the disparity by the average leverage level of indirect real estate companies in the U.S. Clayton and MacKinnon (2003) find that the REIT market moved from being largely driven by the same factors as large-cap stocks in the 1970s and 1980s to being dominated by small-cap and real estate driven factors in the 1990s. Assuming that REITs and direct real estate are driven by common shocks in the long-run, Ang et al. (2013) show that both real estate vehicles display similar characteristics over a full real estate cycle by controlling for the different level of leverage and property type focus. Ghysels et al. (2013) also emphasize the common dependency of the different real estate return series on the same factors.

To sum up, previous findings are not able to identify common risk factors for stocks, listed real estate, and private real estate markets, which are stable over a long time or different approaches. Thus, we want to go a step back and are interested in analyzing common factors between common stocks, listed real estate, and direct real estate with a structural asset pricing approach. By introducing this new model for an old research question, we would like to extend the tool kit, which may also point toward new avenues for future research.

Empirical Data

Data

This section presents the empirical data for common stocks, listed real estate, and direct real estate. Preferably, long time series are available to discover the relationship between these three assets. As is well known, data for the direct real estate market are the major limitation in this context and allow for an analysis of the time horizon from 1985 to 2011. The movements in the direct real estate market are gathered from the NCREIF NTBI Total Return Index. Following the argumentation of Boudry et al. (2012), this index is best qualified to be consistent with the investment universe of the listed real estate market. Besides its assets matching with the comparative listed market, this transaction-based index shows a better approximation of the direct real estate market than an appraisal-based index would do. These data are obtained from NCREIF’s web page. For the listed real estate market, we use the FTSE NAREIT Equity REIT Index. This series includes all equity REITs not designated as timber or infrastructure REITs. These data are obtained from NAREIT’s web page.Footnote 2 As a proxy for the risk-free interest rate, we use the data of the one-year treasury bill rates on Robert Shiller’s web page.Footnote 3 To describe the properties of the stock market, we rely on the Russell 3000 Index. This series captures the returns of the largest 3,000 companies (based on total market capitalization) and represents around 98% of the investable U.S. equity market.Footnote 4 By using such a broad market index, we consider possible growth or market capitalization effects in returns. The returns are obtained from Thomson Financial Datastream.

Empirical Moments

Table 1 summarizes the empirical properties of common stocks, listed real estate, and direct real estate for the period from 1985 to 2011. The table provides results for data at quarterly as well as annual frequency. The annual frequency automatically filters short-term noise in the direct real estate data and also controls for the different transaction frequency among the quarters in the direct real estate market. Thus, we expect higher co-movement between direct real estate and the stock market, including listed real estate, at the annual frequency. We will focus our discussion on annual data; quarterly results are provided for completeness.

Table 1 Empirical moments

In line with the literature, we find lower average returns in excess of the one-year treasury bill for direct real estate (3.57%) compared to the listed real estate market (6.11%) and stocks (5.79%). Furthermore, not only the mean, but also the standard deviation is lower for the direct real estate market – 9.9% in comparison to 18.9% (listed real estate) and 17.5% (stocks). We do not observe lower return and risk for the direct real estate data due to the shortcomings of appraisal-based real estate indices – mostly influenced by the smoothing, temporal lag bias, and anchor effects of the appraisal process. These effects have no influence on our calculated average return, since we use a transaction-based index. First-order autocorrelation values are negative (− 0.16) at the quarterly frequency and positive (0.31) at the annual frequency. Both first-order autocorrelations are not statistically significant and are around zero within the 95% confidence interval. This finding contrasts with appraisal-based indices, which would have a highly significant positive correlation, and therefore, a high predictive power for the return.

Co-movements

In a first step, we investigate pair-wise correlations between the different markets to identify linkages between them. To account for the lagged movement of direct real estate documented in the literature even for transaction-based real estate indices (e.g. Ang et al. (2013)), we investigate correlations between the stock market and real estate returns with a lag of up to eight quarters, as shown in Fig. 1. In line with the literature, we consider a maximum length of the temporal lag of two years or eight quarters.

Fig. 1
figure 1

Cross-correlation functions. The figure shows the cross-correlations of excess returns between common stocks (STX), listed real estate (LRE), and direct real estate (DRE). The upper figure provides correlations for quarterly returns. The lower figure provides correlations for (non-overlapping) fourth-quarter to fourth-quarter annual returns, whereas we lag annual returns in quarterly steps. For example, at lag= 1, the figure shows the correlation between STX and DRE, where stock returns are measured from the fourth-quarter of year t to the fourth-quarter of year t + 1, and direct real estate returns are measured from the next first-quarter to the following first-quarter. Dashed lines correspond to 95% confidence intervals. The sample period is 1985-2011

At the quarterly frequency, the contemporaneous correlation between common stocks and listed real estate is about 0.60. In contrast, contemporaneous correlations between common stocks and direct real estate are close to zero using a quarterly time interval. Interestingly, up to two lags, correlations for lagged direct real estate tend to be larger. This could be driven by the methodology of the NTBI, as the hedonic value of its hedonic price model is lagged by two quarters prior to the current appreciation level.

At the annual time interval, we observe somewhat larger, but still low correlation between direct real estate and the other two assets when sampling them contemporaneously. We lag annual direct real estate returns using quarterly steps as well. More precisely, we begin with contemporaneous annual correlations which are computed from returns measured from the fourth quarter of year t to the fourth quarter of year t + 1. At the lag length equal to one quarter, stock market returns are still computed from the fourth quarter of year t to the fourth quarter of year t + 1, but direct real estate returns are now measured from the first quarter of year t + 1 to the first quarter of year t + 2. Notice that all annual returns are calculated non-overlappingly. Computing annual correlations with direct real estate lagged in quarterly steps accounts for the different transaction frequency among the quarters in direct real estate as well as for lags in transaction prices of direct real estate. When direct real estate returns are computed from the second quarter to the second quarter of the following year, the correlation between direct real estate and listed real estate is as large as 0.81, and the correlation between direct real estate and common stocks is 0.60. Regarding NPI appraisal data, we find the largest number of observations in the second calendar quarter, so that the income component of the NTBI is closer to the latest data of listed real estate and stock market in the second quarter than in the other three quarters. Also Fisher et al. (2004) report the values of the second quarter of each year in their analysis of the determinants of transaction frequency.

Principal Components

Table 2 provides the principal components of common stocks, listed real estate, and direct real estate by using the annual time interval. Direct real estate is lagged by two quarters, to account for transaction lags as described above, and such that we extract the maximum available correlation from the data.

Table 2 Principal components

The first principal component (PC1) is simply an average of all three assets and explains up to 79% of the assets’ variances. We gage from the PC1 that there is one common factor between all three assets which drives their co-movement. The second principal component (PC2) is long in common stocks, short in listed real estate, and short in direct real estate. Interestingly, the short lag of this factor, the real estate component, has a larger weight in direct real estate than in listed real estate. The common stocks minus real estate factor explains up to 15% of the assets’ variances.

Instead of a long-short portfolio factor, this factor can be interpreted without any loss of generality as two distinct (orthogonal) factors. The first one measures stock market specific risk, whereas the second measures real estate market specific risk. Accordingly, we will incorporate these two stock and real estate specific risk factors into our model.

Finally, the third principal component (PC3) is short in listed real estate and long in direct real estate and has no significant loading with respect to common stocks. This factor captures any remaining differences between listed and direct real estate, for example, different industry or geographical exposures of the two indices in the data. The PC3 only accounts for 6% of the assets’ variances, and therefore, we ignore this component in the following.

To sum up, the principal component analysis suggests that we need at least three factors to jointly model common stocks, listed real estate, and direct real estate. First, a factor which is common to all three assets. We think of this factor as a business cycle risk, or market-wide risk, which affects common stocks as well as both real estate assets. The second factor is pure stock market risk and the third factor is pure real estate market risk. In the following, we will present a simple model of how these three factors may drive the returns of all three assets.

Model

We want to know how the determinants for risk premia of common stocks, listed real estate, and direct real estate are related to each other in order to generate the empirically observed patterns discussed in the previous section. To this end, this section proposes a structural model for analyzing the joint driving forces behind the returns of the three relevant assets. The aim is to quantitatively account for the stochastic properties of common stocks, listed real estate, and direct real estate, while at the same time the model enables an investigation of economic linkages between the stock market and the real estate market. Our modeling approach closely follows that of Koijen et al. (2017), which we extend and adapt for real estate assets.Footnote 5 The model has three main ingredients – business cycle risk, assets’ characteristics, and the stochastic discount factor – which are discussed in the following subsections.

Market-wide Risk

The first ingredient of the model is the state variable, s t , which measures activity in the real economy and can be interpreted as a leading indicator of the business cycle. In this connection, higher economic activity is transformed into higher values of s t . With this factor, we summarize all dynamics between the state of the macroeconomy and the different assets’ characteristics. In line with the data, the state variable has a modest autoregressive persistence at annual frequency, so that it oscillates with the business cycle (see Koijen et al. (2017)). The shocks to the state variable, \(\epsilon _{t + 1}^{s}\), capture business cycle risk, or ‘market-wide’ risk, and are the first priced source of risk in the model.

Assets’ Characteristics

The second ingredient is a specification for the process of dividend growth (△dt+ 1i) of the aggregate common stock market (i = M) as well as of the listed real estate market (i = L) and rent growth of the direct real estate market (i = D). The real dividend growth of all three assets is described by the equation:

$$ \triangle d_{t + 1}^{i}=\gamma_{0i}+\gamma_{1i}s_{t}+\sigma_{mi}\epsilon_{t + 1}^{m}+\sigma_{di}\epsilon_{t + 1}^{d},\:\forall i=\left\{ M,\:L,\:D\right\}. $$
(1)

Aggregate stock market dividend shocks are captured by \(\epsilon _{t + 1}^{m}\) and are the second priced source of risk. Similarly, real estate market rent shocks are captured by \(\epsilon _{t + 1}^{d}\) and are the third priced source of risk. Thus, cash-flow growth of all three assets depends on the state of the economy (s t ), i.e. market-wide risk, and a combination of stock market shocks (𝜖t+ 1m) and real estate market shocks (𝜖t+ 1d). Notice that stock market shocks and real estate market shocks are defined orthogonal to market-wide risk (𝜖t+ 1s), comparable to the principal component analysis above. They capture shocks that only affect the stock market or the real estate market.

Direct real estate has no exposure to stock market shocks (σ m D = 0), and the stock market has no exposure to real estate market shocks (σ d M = 0). However, the stock market and direct real estate market are positively exposed to the business cycle and therefore market-wide risk (γ1M > 0, γ1D > 0). Dividends as well as rents are high in economic upturns and they are low in economic downturns. This channel introduces co-movement between the two assets during the business cycle.

Listed real estate is a financially leveraged claim on direct real estate traded on a stock exchange. In our model, we take into account that listed real estate is highly leveraged and assume a leverage factor of two – defined as the debt-to-equity ratio. The underlying idea behind this assumption is the fundamental relation between return on equity (ROE), return on asset (ROA), interest rate for debt (r D e b t ), and the leverage factor – measured by the ratio of debt (D) and equity (E) and formalized by: \(ROE=ROA+\frac {D}{E}(ROA-r_{Debt})\). Transposed to our analysis, the return of listed real estate (ROE) can be explained by the financially unleveraged return of direct real estateFootnote 6 (ROA) and financial leverage. The historical balance sheet data for listed real estate show an average leverage factor of 2.Footnote 7 Accordingly, listed real estate is exposed to real estate market risk twice as much as direct real estate, σ d L = 2 × σ d D . The same applies to the sensitivity to business cycle risk, γ1L = 2 × γ1D. Furthermore, listed real estate companies are value stocks (e.g. Clayton and MacKinnon (2001)). Koijen et al. (2017) show that value stocks are more sensitive to business cycle risk; therefore, we impose the restriction γ1L > γ1M on the model parameters.

We consider the possibility of a stock market spillover on the market for listed real estate, which can be generally captured by σ m L ≠ 0. Particularly, we consider the following two alternative model specifications:

$$\sigma_{mL}=\left\{\begin{array}{ll} \begin{array}{c} \sigma_{mM}/2\\ 0\end{array} & \begin{array}{l} Model\:1:\:with\:stock\:market\:spillovers ,\\ Model\:2:\:without\:stock\:market\:spillovers. \end{array}\end{array}\right. $$

In model 1, shocks in the stock market are directly transmitted to the listed real estate market by a factor of one half. In model 2, shocks in the stock market are not transmitted to the listed real estate market. Notice that also in model 2, the business cycle channel (γ1i) still connects both markets.

Stochastic Discount Factor

The last ingredient is a specification of the log stochastic discount factor (SDF), which summarizes the preferences of a marginal investor by:

$$ -m_{t + 1}=y+\Lambda^{\prime}\epsilon_{t + 1}, $$
(2)

where the vector \(\epsilon _{t + 1}=\left (\epsilon _{t + 1}^{s},\epsilon _{t + 1}^{m},\epsilon _{t + 1}^{d}\right )^{\prime }\) captures the shocks, and \(\tilde {y}=y-\frac {1}{2}{\Lambda }^{\prime }\Lambda \) is the real interest rate. Our SDF implies three positively priced sources of risk, which are summarized by the vector Λ = (Λ m d s ). The first element captures aggregate stock market risk (Λ m > 0), the second aggregate real estate market risk (Λ d > 0), and the third business cycle risk (Λ s > 0). The risk factor prices will mainly determine the model-implied average returns of our three assets, given the pre-specified processes of dividend growth, and they are also the free parameters of our model. Further technical details of the model are shown in the ??.

Parameter Values and Simulation Procedure

We follow a two-step procedure to calibrate our model. First, we choose the dividend parameters for common stocks and direct real estate to match the empirical properties of dividends and rents. For listed real estate dividend growth, we follow our theoretical parameter restrictions outlined above. Parameter values for the state variable (s t ) are directly adopted from Koijen et al. (2017).Footnote 8 Second, given the parameter values of the first step, we choose SDF risk prices, the parameter vector Λ, to generate model-implied risk premia which are close to the observed average returns of common stocks, listed real estate, and direct real estate. The exact parameter values are provided in the ??.

To simulate data of common stocks, listed real estate, and direct real estate, we simulate monthly data for 27 years, which we convert to annual observations. Returns for stocks and listed real estate are calculated using end-of-year index level observations. For direct real estate, we sum index levels of October, November, and December to an aggregated fourth-quarter index, since this procedure is more similar to the construction of direct real estate indices, which are available in empirical data. Finally, we calculate annual direct real estate returns based on the aggregated fourth-quarter index. (This approach will also induce a modest degree of serial correlation in simulated direct real estate data.) We repeat this procedure 10,000 times and compare the simulations to 27 years of empirical data with annual observations from 1985 to 2011. We compare our model to the data at an annual time interval, since the annual frequency automatically filters out seasonality as well as short-term noise of quarterly direct real estate data.

Results

This section confronts our structural model with the data. We provide results from simulated model-implied returns for common stocks, listed real estate, and direct real estate. We examine two model specifications: first, a model specification with spillovers from common stocks to listed real estate; and second, a model specification without such spillover effects.

Model Specification with Spillovers (Model 1)

Table 3 shows medians and the 90% confidence intervals of 10,000 simulated moments for returns of common stocks, listed real estate, and direct real estate. Each simulation covers 27 observations of annual data, the same size as the empirical data available. The model with spillovers from the stock market to listed real estate matches the mean, standard deviation, and autocorrelation of each of the three assets well. In Panel A, comparable to the empirical data, average returns and standard deviations are slightly larger for listed real estate compared to common stocks, and the first and second moment are much lower for direct real estate compared to listed real estate. Only the empirical autocorrelation of direct real estate (0.31) is marginally outside of the 90% confidence interval of simulated returns ([− 0.30, 0.30]).

Table 3 Simulated moments: model with spillovers

In Panel B, the parameter values for the model with spillovers generates a correlation between common stocks and listed real estate of 0.62 and a correlation coefficient between listed real estate and direct real estate of 0.87; similar to the data (the respective numbers are 0.64 and 0.81). However, the correlation between common stocks and direct real estate is only 0.27 in the model compared to 0.60 in the data. Compared to direct real estate, the stock market correlation of listed real estate is twice as large (0.62 vs. 0.27).

Panel C reports the principal component coefficients for the simulated data. We identify the almost identical pattern in the simulated data to that in the actual data. The first principal component is equally weighted among the three assets and explains the majority of the variance of the three assets, i.e. 73% in the simulation compared to 79% in the actual data. The second principal component is a common stocks minus real estate assets factor and explains 25% of the variance of the three assets, compared to 15% in the data. Also, the qualitative magnitude of the PC2 coefficients matches with the data: The coefficient on direct real estate is in absolute terms larger than the coefficient on listed real estate (− 0.55 vs. − 0.08). Intuitively in the model with spillover channel, direct real estate is a better measure of real estate risk than listed real estate is, which is reflected by these coefficients. The third principal component captures differences between listed and direct real estate and is only of marginal relevance in the simulation as well as in the data as discussed before.

Model Specification without Spillovers (Model 2)

Next, we switch off the stock market spillover channel from common stocks to listed real estate to see how our results change. As can be inferred from Panel A in Table 4, this model specification again matches the mean, standard deviation, and autocorrelation of each of the three assets well, i.e. the empirical moments are almost all within the 90% confidence interval of the simulated data. However, it turns out that it is more difficult to match average returns of listed real estate and direct real estate with the data, since listed and direct real estate returns are more closely linked to each other. To generate larger average returns of listed real estate compared to direct real estate, we need to increase the price of real estate risk (Λ d ), which in turn also increases average returns of direct real estate. Furthermore, the missing spillover channel reduces the standard deviation of simulated listed real estate returns and also reduces the correlation coefficient between common stocks and listed real estate to 0.27 (model 1: 0.62, empirical data: 0.64) in Panel B.

Table 4 Simulated moments: model without spillovers

Panel C shows that the first two principal components again identify an equally weighted factor among all three assets as well as a common stocks minus real estate assets factor, similar to model 1 and the data. One difference is that in the model without spillovers, the PC2 coefficients on direct real estate and listed real estate have now the same magnitude. This is sensible for model 2, as both real estate assets reflect real estate risk equally well.

Dissecting Risk Premia

A potential pitfall of the principal component analysis is that the factors we extract are mixtures of the ‘true’ underlying driving factors. For example, the first principal component (in the model as well as in the data) is basically an equally weighted portfolio of common stocks, listed real estate, and direct real estate; thus, it captures stock market risk, real estate market risk, and business cycle risk at the same time and is therefore difficult to interpret. Fortunately, we can exactly dissect average returns of the three assets with respect to the three factors by using our model.Footnote 9

As we show in Fig. 2, in the model with spillovers, the expected stock market premium is composed of 81% stock market risk and 19% business cycle risk. The expected direct real estate premium combines 62% real estate risk and 38% business cycle risk. Finally, the expected listed real estate premium can be split into 36% stock market risk, 40% real estate risk, and 24% business cycle risk.Footnote 10 In contrast, in the model without spillover effects, the expected listed real estate premium is now basically a leveraged claim on the same combination of risk factors as for direct real estate. The total risk premium of listed and direct real estate is composed of 73% real estate risk and 27% business cycle risk. Similar to the first model, the expected premium on common stocks comprises 80% stock market risk and 20% business cycle risk.

Fig. 2
figure 2

Dissecting risk premia. The figure dissects the model-implied expected risk premia of common stocks, listed real estate, and direct real estate in compensation for stock market risk, real estate market risk, and business cycle risk. Model 1 includes stock market spillovers, and model 2 does not include them

Clearly, in both models, the common risk factor (business cycle risk) is of minor importance for explaining average returns of the three factors compared to the stock market risk specific factor or the real estate market risk specific factor. The bottom line of this figure is that even if common stocks and real estate assets are explained by their first principal component to a large extent, as in the data and our model, their returns may be extensively driven by distinct factors.

Accounting for Lags in Transaction Prices

Figure 1 shows that transaction prices of direct real estate display a substantial lag of several quarters compared to listed real estate. So far, we have ignored this fact in our structural model. In this section, we propose a simple approach to incorporate the lag pattern in transaction prices. We assume that the measured return of direct real estate, \(\tilde {r}_{t}^{d}\), is a weighted average of true returns of direct real estate with some lag, \(r_{t-k}^{k}\):

$$ \tilde{r}_{t}^{d}=\sum\limits_{k=k1}^{K}r_{t-k}^{k}, $$
(3)

where the time interval is monthly. The idea here is that the price of a property is fixed at tk; however, it takes up to t until the transaction has been executed and incorporated into the transaction-based price index. Moreover, the exact time span between the time when the price of a property is fixed until the transaction has been executed might differ from property to property.Footnote 11 To account for this variation, we take a weighted average of lagged true direct real estate returns in our model from the past 8 to 3 months (k1 = 3, K = 8) and compute a lagged direct real estate return series, which we convert to a quarterly and annual time interval such that the series are comparable to the data. For the U.K. market, Crosby and McAllister (2004) and Bond et al. (2007) find an average time period from the marketing to the price agreement of 6.0 months, to the exchange of contracts of 8.7 months and to the period of completion of 9.4 months.Footnote 12 For the U.S. market, we assume similar marketing periods so that we vary the lag between the above mentioned lengths.

Figure 3 provides the cross-correlation function for the simulated lagged direct real estate returns, using the same procedure as applied in Fig. 1 for the empirical data. Our simple adjustment to account for lags in transaction prices of direct real estate can match the hump-shaped cross-correlation functions in the data well, in particular at an annual time interval. At the quarterly time interval, the simulated data show larger correlation compared to the empirical data. This finding, again, is likely to be explained by seasonality and short-term noise in quarterly direct real estate data.

Fig. 3
figure 3

Cross-correlation functions of simulated data. The figure shows the cross-correlations of simulated (model 1, with spillovers) excess returns between common stocks (STX), listed real estate (LRE), and direct real estate (DRE)

Conclusion

We propose a structural asset pricing model to disentangle the relationships between common stocks, listed real estate, and direct real estate market. In line with a principal component analysis of the empirical data, the model has three sources of risk, which we identify as: market-wide risk (or business cycle risk), stock market specific risk, and real estate market specific risk. The model can replicate several empirical properties of all three assets. A specification which includes a medium-sized spillover channel from common stocks to listed real estate – which is not present in direct real estate – is closest to the data and exhibits that the expected listed real estate risk premium can be dissected into 36% stock market risk, 40% real estate risk, and 24% business cycle risk. However, also a model in which listed and direct real estate are exposed to exactly the same risk factors is not rejected by the data. Our results show that listed real estate and direct real estate are likely to be driven up to a large fraction by common risk factors. We hope that our approach and results will point toward new avenues for future research into the relationship between different risk factors for listed and direct real estate. The influence of more risk factors, higher frequency, different time periods as well as different spillover specifications for different market periods is an area requiring further studies.