Introduction

Investors have increasingly considered corporate social responsibility (CSR) activities when making investment decisions (Elliott et al. 2014). In response, many firms have started to issue standalone CSR reports.Footnote 1 While providing extensive information about CSR activities to investors (Simnett et al. 2009; Cohen and Simnett 2014; Casey and Grenier 2015), these reports bring significant capital market benefits to the firms (Lys et al. 2015). For instance, issuance of standalone CSR reports reduces cost of equity capital (Dhaliwal et al. 2011) and improves analyst forecast accuracy (Dhaliwal et al. 2012).

The information contained in CSR reports varies in amount and format due to the lack of an enforced CSR reporting framework (Perrini 2005; Holder-Webb et al. 2009; Ramanna 2013; Campopiano and De Massis 2015; Sethi et al. 2015).Footnote 2 In addition, the opportunistic incentives of managers to positively skew corporate information coupled with the voluntary nature of CSR reporting can hamper the credibility of CSR reports (Ramanna 2013; Mishra and Modi 2013). Consequently, firms face challenges in enhancing the credibility and thus capital market impact of their CSR reports (Hobson and Kachelmeier 2005; Holder-Webb et al. 2009; Simnett et al. 2009; Cohen and Simnett 2014; Chen et al. 2016).

In order to enhance the credibility and capital market impact of their CSR reports, firms can commit to high-quality financial reporting (Chen et al. 2016), perform effective CSR activities (Dawkins and Fraas 2011; Cho et al. 2006; Dhaliwal et al. 2011; Hummel and Schlick 2015), and seek assurance from independent CSR assurance providers (Perego and Kolk 2012; Casey and Grenier 2015; Cheng et al. 2015). In addition, can firms use the narratives in CSR reports to enhance credibility? It is not clear whether the narratives affect the credibility and capital market impact of CSR reports in addition to the already-established capital market benefits of the issuance of CSR reports (Dhaliwal et al. 2011, 2012). To provide insights into this, we construct a disclosure score based on CSR report narratives and examine how this score is associated with analysts’ forecast accuracy.

Information about firms’ CSR activities will be useful to analysts only if CSR activities affect firms’ financial performance. Through a meta-analysis of 127 studies, Margolis and Walsh (2003) document a positive link between CSR activities and firms’ financial performance. Recent studies have also documented how CSR activities are linked to financial performance. For example, firms with more CSR activities receive more favorable financing from banks (Goss and Roberts 2011); charitable contributions enhance sales growth (Lev et al. 2010); acquirers with more CSR activities perform better in their M&A deals (Deng et al. 2013); and CSR activities improve financial performance especially for innovative firms (Mishra 2015). In addition, CSR activities and disclosures motivate companies to improve their relationship with their stakeholders (Ioannou and Serafeim 2012; Christensen 2016).

The above evidence, which establishes the link between CSR activities and financial performance, suggests that analysts use information on CSR activities—especially credible CSR information—while forecasting firms’ performance. Consistent with this suggestion, CSR Europe, Deloitte, and EuroNext’s (2003) survey finds that half of the 400 mainstream mutual fund managers and analysts use CSR-related information in their investment and forecasting models. Similarly, Dhaliwal et al. (2012) document that analysts provide more accurate forecasts for issuers of CSR reports. We extend this finding by examining whether it is the mere act of issuing CSR reports or narratives in the CSR reports that help analysts improve their forecast.

Beyer et al. (2010, p. 312) suggest that “analyzing disclosures using natural language processing techniques seems most promising in creating meaningful disclosure quality measures for large samples.” Prior studies that use computer linguistic techniques find that various aspects of financial statement narratives such as pessimism, readability, length, numerical content, and horizon content are informative to users and/or associated with future performance (Li 2010a, b; Muslu et al. 2015). Capitalizing on these findings, we rank CSR reports higher if they include fewer optimistic and more pessimistic keywords; if they are easily readable; if they are longer; and if they have more numerical and horizon content. We then aggregate these aspects into a composite disclosure rank score. We hypothesize that reports with higher disclosure scores will be more useful to investors. Accordingly, we expect that analyst forecast accuracy increases with CSR disclosure scores. If, on the other hand, narratives in CSR disclosures are not credible or if analysts do not pay attention to the narratives but only to firms’ decision to issue CSR reports, then analyst forecast accuracy will not increase with CSR disclosure scores after controlling for firms’ decision to issue the CSR reports.

Our tests involve dividing firms with CSR reports into low, mid, and high disclosure score groups and treating firms without CSR reports as the benchmark. We then examine current year, one-year-ahead, and two-year-ahead average analyst earnings forecast accuracy across the groups, after controlling for published CSR performance scores and firm characteristics which may affect analyst forecasts as identified by Dhaliwal et al. (2012). We document the following results. First, the average analyst forecast accuracy is not statistically different between firms with low CSR disclosure scores and firms without CSR reports. Second, the average analyst forecast accuracy is significantly higher for firms with middle and high CSR disclosure scores than firms without CSR reports. Third, the average forecast accuracy is significantly higher for firms with high CSR disclosure scores than firms with low CSR disclosure scores. Overall, CSR reports with higher scores help analysts improve their forecasts.

We also distinguish between the first and subsequent CSR reports of a firm, because Dhaliwal et al. (2011) find that initiation of CSR reports is more likely to be linked to the capital market consequences. We find that the positive association between CSR disclosure score and analyst forecast accuracy is more pronounced for subsequent CSR reports than initial CSR reports. This finding suggests that firms build credibility over time through committing to a CSR reporting practices, and that investors and analysts do not simply react to CSR reports without considering firms’ long-term CSR reporting practices.

As a robustness check, we re-examine our findings after controlling for two publicly available CSR disclosure quality measures: Presence of Global Reporting Initiative (GRI) framework in CSR reports, and CSR reporting transparency ratings issued by Kinder, Lydenberg, and Domini Research and Analytics (KLD).Footnote 3, Footnote 4 Our narrative-based CSR disclosure score continues to have a significant and positive association with analyst forecast accuracy after controlling for these alternative measures. This is consistent with our score capturing CSR reporting properties that are beyond those observed by the CSR rating agencies.

Prior research argues that companies have their CSR reports audited to make them more credible to users (Simnett et al. 2009). Building upon this argument, we examine whether CSR reports that are audited complement or substitute for better disclosures. We find that the analyst forecast accuracy is positively associated with the interaction of audited CSR reports and CSR disclosure score. This suggests that external assurance of CSR reports complement the capital market impact of CSR disclosure score.

Our study extends research on reporting CSR activities through standalone reports (Simnett et al. 2009; Elliott et al. 2014; Dhaliwal et al. 2011, 2012; Casey and Grenier 2015; Campopiano and De Massis 2015; Sethi et al. 2015). We provide evidence that not only the decision to issue standalone CSR reports, but also the narrative of CSR reports (e.g., what is said and how it is said) affects market participants.

Second, the literature on corporate sustainability has long been interested in factors that affect the credibility and consequences of voluntary CSR disclosures (Ingram and Frazier 1980; Wiseman 1982). A potential weakness in the previous CSR reporting studies is the reliance on a dichotomous variable for whether or not a firm issues a CSR report. Consequently, these studies offer little insights about CSR reporting quality. To our knowledge, our study is the first that uses a disclosure score based on the content of standalone CSR reports.Footnote 5 In addition, our CSR reporting quality measure offers guidelines for companies toward improving the quality and ultimately the impact of their reports. This finding is important, given that the external assurance of CSR reporting, which is another mechanism to improve the credibility of CSR disclosures, remains relatively uncommon in the many parts of the world including the U.S. (Holder-Webb et al. 2009; Simnett et al. 2009; Perego and Kolk 2012).

Hypothesis Development

The primary objective of this study is to examine how CSR report narratives affect analyst forecasts. For this purpose, we use insights from prior studies on financial narratives.

Narratives in Financial Reports

One stream of research on financial narratives studies their information content. Kothari et al. (2009a) find that favorable (unfavorable) disclosures from firms, analysts, and press are associated with lower (higher) firm risk. Li (2010a) finds that tone of forward-looking statements in Management and Discussion Analysis (MD &A) section of 10-K and 10-Q reports reflects future performance. Feldman et al. (2010), Loughran and McDonald (2011), and Davis et al. (2012) show that investors react to the tone in 10-K reports, 10-Q reports, and earnings announcements, respectively. Collectively, optimistic and pessimistic tones in financial narratives reflect future performance. However, pessimistic tone more strongly reflects future performance and brings stronger investor reaction, suggesting that investors recognize firms’ opportunistic incentives. Managers have opportunistic incentives to affect stock prices, avoid regulatory and investor scrutiny, and negotiate debt and compensation contracts (Kothari et al. 2009b).

Another stream of research studies obfuscation incentives of managers. Managers can deflect attention from controversial or unacceptable information to desirable information (Elsbach and Sutton 1992). Firms that publish less readable financial reports have poor performance and less persistent profits (Li 2008). Less readable reports are also associated with higher stock return volatility, higher analyst forecast dispersion, and lower forecast accuracy (Lehavy et al. 2011; Loughran and McDonald 2014). Collectively, less readable financial reports are less informative.

One other stream of research studies the content of narratives (Bryan 1997). Hussainey et al. (2003), Schleicher et al. (2007), and Hussainey and Walker (2009) show that forward-looking MD &A disclosures in the U.K. are informative. Muslu et al. (2015) find that short-horizon MD&A disclosures help investors incorporate information on future performance into stock prices. Collectively, quantitative and future-oriented financial narratives are more informative.

Narratives in Financial Reports Versus CSR Reports

The financial reporting framework, which has developed over centuries, has three important characteristics (Ijiri 1965; Ramanna 2013). First, it discloses verifiable information, mitigating information asymmetry between managers and investors. Verifiability implies that information is auditable so that managers are held accountable for misstatements. Verifiability is also associated with conservatism, which implies that decreases in net assets have lower verification standards than increases in net assets, safeguarding investors from overly optimistic disclosures (Ball et al. 2000). Second, the financial statement reporting framework includes performance and position reports, which are collectively useful to investors (Ramanna 2013). Third, it matches managers’ actions to outcomes of the actions because the financial reporting framework is enforced through a combination of litigation, external audit, and regulatory oversight.

CSR reporting lacks these characteristics despite significant attempts to standardize and enforce CSR reporting and auditing framework (Ramanna 2013; Sethi et al. 2015). Firms have significant discretion in whether and how much CSR information to disclose as well as whether to have CSR reports audited.Footnote 6 Even when the reports are audited, the scope of the audit pertains typically to the process and not to the information content. Mishra and Modi (2013) show that firms emphasize the positive aspects and ignore the negative aspects of CSR performance. The opportunistic incentives of managers to positively skew CSR reporting coupled with the lack of an enforced CSR reporting framework have the potential to widen the information asymmetry between managers and investors about firms’ CSR activities and their financial consequences, rendering CSR reports useless to investors.

The potentially high information asymmetry about CSR activities highlights the importance of examining disclosure quality and information content of CSR reports.Footnote 7 GRI states: “A primary goal of reporting is to contribute to an ongoing stakeholder dialogue. Reports alone provide little value if they fail to inform stakeholders or support a dialogue that influences the decisions and behavior of both the reporting organization and its stakeholders” (GRI 2002, p. 9). Accordingly, our objective is to examine whether the narratives of CSR reports are informative to stakeholders and specifically stock investors. We measure the informativeness of CSR reports by improved forecast accuracy of analysts.

Empirical Expectations

Through CSR activities, companies contribute to economic development and improve the quality of life of the workforce, their families, the local community, and the society at large. In their meta-analyses, Orlitzky et al. (2003) and Margolis and Walsh (2003) document a positive association between CSR performance and financial performance. CSR activities enhance financial performance by improving brand image (Brown and Dacin 1997; Lev et al. 2010); attracting and motivating employees (Waddock and Graves 1997; Roberts and Dowling 2002; Edmans 2011); improving relations with regulators (Brown et al. 2006); improving relations with creditors (Goss and Roberts 2011; Cheng et al. 2013); and mitigating regulatory and operational risk (Starks 2009). The widely documented link between CSR performance and performance suggests that CSR disclosures provide useful information to investors (Werther and Chandler 2006). Accordingly, recent research documents that environmental disclosures are associated with significant capital market benefits such as reduced cost of equity capital (Plumlee et al. 2014) and higher share prices (Matsumura et al. 2014).

While Plumlee et al. (2014) and Matsumura et al. (2014) examine disclosures pertaining to a single CSR activity, i.e., environmental activities, Dhaliwal et al. (2011, 2012) examine the incidence of standalone CSR reports that report a wide range of CSR activities. Dhaliwal et al. (2011) find that firms initiating CSR reports achieve a lower cost of equity capital and lower analyst forecast errors when the disclosures could be supported by superior CSR activities. Similarly, Dhaliwal et al. (2012) find that the positive association between CSR reports and analyst forecast accuracy is stronger in countries with stronger stakeholder orientation, presumably because the presence of stronger complementary institutions lends credibility to CSR reporting. These findings suggest that the capital market benefits associated with standalone CSR reports are unlikely to be driven by the CSR report issuance decision alone.

From an information perspective, prior research of disclosures such as earnings announcements and Management, Discussion and Analysis (MD&A) section of annual reports shows that the optimistic and pessimistic tones and readability of disclosures are associated with future financial performance and short-term investor reaction (see discussion in “Narratives in Financial Reports” section above). The MD&A and earnings announcements are similar to the CSR standalone disclosures in that there are few standards for the narratives in these reports. For example, the Securities and Exchange Commission (SEC) has continually found MD&A’s to be deficient (SEC 1989, 2003; Garmong 2007). Even though the SEC’s review found MD&A’s to be deficient, research finds that the tone, readability, and content of such disclosures are indicative of disclosure quality (see Muslu et al. 2015). Similarly, we expect that firms with better CSR report disclosures (as measured in tone, readability, and content) reduce the information asymmetry between managers and investors. Consequently, using high-quality CSR disclosures, analysts must be able to better predict performance consequences of CSR activities, improving overall accuracy of their earnings forecasts.Footnote 8 This prediction is stated in the following hypothesis.

Hypothesis

Firms with better CSR report disclosures are associated with more accurate analyst forecasts.

There are a couple of noteworthy points regarding the hypothesis. First, the voluntary nature of CSR disclosures for standalone CSR reports provides the null hypothesis benchmark (see Ramanna 2013). If firms opportunistically provide information in CSR reports that are not credible and as such not informative, then these disclosures are unlikely to have any significant effect on analyst forecast accuracy (see Mishra and Modi 2013). In addition, if analysts only look for the incidence of the CSR report and do not read the content of the report, then the reports are not likely to be informative.

Second, we focus on analysts forecast accuracy as the proxy for capital market benefits, and not reduced forecast dispersion, because forecast dispersion likely captures a myriad of constructs—disagreements among investors, noise in analysts’ private signals, and noise in the analysts’ interpretation of public signals to name a few (Barron et al. 1998; Diether et al. 2002; Dische 2002; Barron et al. 2009). Note that our objective is to examine the impact of narratives in CSR reports and develop a disclosure score that can be replicated in large sample studies. Therefore, we focus on the most direct capital market consequence, i.e., forecast accuracy, which proxies for the reduction of information asymmetry between investors and firms.Footnote 9

Empirical Analysis

Sample

The sample consists of all firms with KLD ratings from 2000 to 2011. We follow Dhaliwal et al. (2011, 2012) and compile standalone CSR reports of the KLD-rated firms in the Corporate Register database, which is the leading repository of CSR reports worldwide. There are 24,020 annual observations from 4227 firms with KLD ratings; of these 2462 annual observations from 401 firms have standalone CSR reports.

Table 1, Panel A provides the annual distribution of the sample. The number of KLD-rated firms increased from 455 in 2000 to 2529 in 2011, attesting to stakeholders’ and firms’ growing emphasis on CSR activities in the U.S. Similarly, the number of KLD-rated firms with standalone CSR reports increased from 34 in 2000 to 393 in 2011. The percentage of KLD-rated firms that issue CSR reports is 7% in 2000 and increases to 16% in 2011, suggesting growing importance of issuing CSR reports. Table 1, Panel B shows that firms that operate in chemicals and utilities industries are more likely to issue CSR reports. As such, we control for year and industry fixed effects in empirical analyses.

Table 1 Sample

CSR Report Disclosure Score

Using insights from the textual analysis of financial reports (as discussed in “Narratives in Financial Reports” section), we measure the disclosure score of narratives in the CSR reports using the following aspects:

1. Tone

Presentation of content changes users’ beliefs independent of content (Levin et al. 1998; Katz 2001; Morris et al. 2007). Optimistic (pessimistic) sentences are likely to pertain to positive (negative) aspects of CSR. Given managers’ opportunistic incentives to disclose positive aspects and ignore the negative aspects of CSR (Mishra and Modi 2013), firms that disclose the negative aspects are likely to be more transparent. In other words, CSR reports with more of negative aspects, i.e., pessimistic tone, will have higher disclosure quality; and CSR reports with more of positive aspects, i.e., optimistic tone, will have lower disclosure quality. This is consistent with empirical evidence that examines the narrative disclosures of earnings announcements (Davis and Tama-Sweet 2012). We measure the tone of CSR reports by using “financial negative” and “financial positive” word lists developed by Loughran and McDonald (2011).Footnote 10 Pessimistic tone RATIO_PES is calculated as the ratio of the number of financial negative words over total number of words in the report. Optimistic tone RATIO_OPT is calculated as the ratio of the number of financial positive words over total number of words in the report.

2. Readability

Firms can make disclosures less readable in order to hide poor performance (Li 2008). Again similar to the arguments with the tone of the CSR narratives, firms with more readable CSR reports are more transparent and are less likely to hide and obfuscate CSR activities. We use the Smog (Simple Measure of Gobbledygook) index developed by Harry McLaughlin, which indicates the number of years of formal education a reader of average intelligence needs to understand the report. Specifically, readability is computed as SMOG = 1.043 * [(number of polysyllables) * (30/(number of sentences))]1/2 + 3.129.Footnote 11

3. Length

CSR report length may indicate more information about CSR activity. Longer reports have more information than shorter reports (Li 2008). Accordingly, we use the number of words in the CSR report as the measure of length. However, the length of the report could also proxy for the complexity of CSR activities. Firms with more complex CSR activities are likely to have longer reports. Complexity of CSR activities is likely to reduce the informativeness of the CSR report (see Li 2008 for a similar argument and evidence for financial reports). In addition, firms that want to obfuscate its report could make the report lengthier (Loughran and McDonald 2014). To use report length as an aspect of disclosure quality, we filter out its complexity/obfuscation component. Specifically, we define RESWORDS as the residual from the regression of the CSR report length (log of the number of words in the report) on SMOG.

4. Numerical Content

Numerical and quantitative information is understood by users, i.e., investors/analysts, with stronger precision than narrative information (Lundholm et al. 2014). King et al. (1990) suggest that quantitative versus qualitative disclosures show the precision of managers’ beliefs about the future (also see Hughes and Pae 2004). Huang et al. (2013) find that investors react more when earnings press releases include numbers in their title. As such, we consider more quantitative/numerical information as being indicative of better CSR report disclosure quality. To measure numerical content, we define RATIO_NUM as the ratio of the number of Arabic numerals and quantitative words (e.g., first, second, half) over total number of words in the report.

5. Horizon Content

CSR information is likely to be more informative when it includes information about future trends and/or targets. Muslu et al. (2015) find that horizon content in forward-looking statements help investors predict future performance. Following Muslu et al. (2015), we measure horizon content of CSR disclosure by defining RATIO_ HOR as the ratio of the number of future years plus horizon references (e.g., 2 years, two years, short-term, and upcoming year) over total number of words in the report.

We rank RATIO_OPT, RATIO_PES, SMOG, RESWORDS, RATIO_NUM, and RATIO_ HOR into deciles, with RATIO_OPT and SMOG inverse ranked. We then aggregate the decile ranks into a composite measure of CSR disclosure score (DSCORE). CSR reports with fewer optimistic keywords, more pessimistic keywords, higher readability, more length net of complexity/obfuscation, more numerical content, and more horizon content have higher DSCORE. The decile ranking mitigates potential noise in measurement and enables a meaningful aggregation across the six aspects of disclosure.

Appendix 1 describes the textual analysis and computation of DSCORE. In general, firms with High (Low) DSCORE have consistently high (low) decile ranks in many of the six aspects of DSCORE. Table 2 compares the mean and median of the six aspects of DSCORE across the low, mid, and high DSCORE groups. As indicated by the positive correlations among the six aspects of DSCORE, each aspect increases, on average, moving from the low to the high DSCORE. Collectively, these results suggest that the six aspects of DSCORE capture a common construct of disclosure.

Table 2 Descriptive statistics

Table 2 also compares the mean and median KLD ratings and firm characteristics across the No-CSR-Report group and the DSCORE groups. Mean KLDSTRENGTH, which is the sum of KLD’s positive ratings for different CSR categories, are 0.86, 4.54, 5.99, and 6.12 for the No-CSR, low, mid, and high DSCORE groups, respectively.Footnote 12 Mean KLDCONCERN, which is the sum of KLD’s negative ratings for different CSR categories, are 1.33, 2.96, 3.70, and 4.11 for the No-CSR-Report, and low, mid, and high DSCORE groups, respectively. Moving from the low to the high DSCORE group, KLD Strength and Concern ratings increase by 35 and 39%, suggesting that better CSR report narratives are informative for favorable and unfavorable CSR information alike. DSCORE is also associated with various firm characteristics, indicating the importance of controlling for firm characteristics while testing the association between CSR report disclosures and analyst forecast accuracy.

Table 3, Panel A shows that the percentage of CSR reports classified as low, mid, and high DSCORE groups are relatively constant over time at around 45, 30, and 25%. Table 3, Panel B shows that wholesale and finance industries stand out as having a lower proportion of CSR reports with high DSCORE’s.

Table 3 Sample with low, mid, and high disclosure score

Research Design

We test whether higher CSR report disclosure score is associated with analyst forecast accuracy by augmenting Dhaliwal et al.’s (2012) model as below:

$$\begin{aligned} {\text{FERROR}}\left( {\text{X}} \right) & =\upbeta_{0} + \,\upbeta_{1} {\text{LowDSCORE}} + \,\upbeta_{2} {\text{MidDSCORE}} + \,\upbeta_{3} {\text{HighDSCORE}} \\ & \quad + \, \,\upbeta_{4} {\text{KLDSTRENGTH }} + \,\upbeta_{5} {\text{KLDCONCERN }} + \,\upbeta_{6} {\text{ANALYST }} + \,\upbeta_{7} {\text{SIZE}} \\ & \quad + \, \,\upbeta_{8} {\text{ROAVOL}} + \,\upbeta_{9} {\text{LOSS }} + \,\upbeta_{10} {\text{FHORIZON }} + \,\upbeta_{11} {\text{FFIN}} +\upbeta_{12} {\text{ASSURANCE }} + \,\upbeta_{13} {\text{LEV}} \\ & \quad + \,\upbeta_{14} {\text{ROA }} + \,\upbeta_{15} {\text{R}}\& {\text{D }} + \,\upbeta_{16} {\text{CAPX }} + \,\upbeta_{17} {\text{AGE }} +\upbeta_{18} {\text{MKTSHARE}} \\ & \quad + \,\upbeta_{19} {\text{MILLS }} +\upgamma{\text{ INDUSTRY }} + \,\updelta{\text{ YEAR }} + \,\upvarepsilon \\ \end{aligned}$$
(1)

FERROR(X) is the average absolute value of forecast errors scaled by the beginning of the year price and multiplied by 100. X has values of 0, 1, or 2, standing for current year, one-year ahead, and two-year ahead forecasts, respectively. The coefficient estimates for the low, mid, and high DSCORE groups capture the incremental effect of the respective CSR report disclosure score groups relative to companies with no CSR reports. We expect negative coefficient estimates that decrease with DSCORE. CSR performance ratings are often available to investors through third parties, such as KLD. In order to isolate the effect of DSCORE on analyst forecasts, we control for CSR performance ratings by including KLD Strength and Concern ratings in Eq. (1).

Equation (1) uses several control variables that are likely to confound the association between DSCORE and forecast accuracy (Hope 2003; Dhaliwal et al. 2012). Analyst following (ANALYST) proxies for stronger competition and higher incentives for analysts to enhance forecast accuracy (Lys and Soo 1995). We expect a negative coefficient estimate for ANALYST. Firm size (SIZE) proxies for a firm’s general information environment (Atiase 1985; Hope 2003). We expect a negative coefficient estimate for SIZE. Earnings volatility (ROAVOL) proxies for forecast difficulty (Dichev and Tang 2009). We expect a positive coefficient estimate for ROAVOL. Earnings of companies with accounting losses (LOSS) are difficult to predict (Hope 2003). We expect a positive coefficient estimate for LOSS. The median number of days between analyst forecasts and earnings announcements (FHORIZON) proxies for the amount of information available to analysts (O’Brien 1990). We expect a positive coefficient estimate for FHORIZON. FFIN is an indicator of financial opaqueness, which is one if scaled accruals of a firm are higher than the industry-year average (Bhattacharya et al. 2003; Dhaliwal et al. 2012). We expect a positive coefficient estimate for FFIN. We also control for an indicator for whether the CSR report is audited by an independent party (ASSURANCE). To the extent that CSR reports with external assurance are perceived by analysts to be more credible (Dhaliwal et al. 2011; Casey and Grenier 2015; Pflugrath et al. 2011), we expect a negative coefficient estimate for ASSURANCE.

Equation (1) also treats for self-selection, because CSR disclosures can only be observed in standalone CSR reports. Several factors—some unobservable—determine a firm’s decision to issue CSR reports. Equation (1) includes the inverse Mills ratio computed from the self-selection treatment in order to control for these unobservable factors (Dhaliwal et al. 2012). Equation (1) also includes all independent variables in the self-selection regression LEV, ROA, R&D, CAPX, AGE, and MKTSHARE—but exclude instrumental variables BLUE STATE, RELIGIOUS, DJINDEX, and GREEN. Appendix 3 describes the self-selection treatment in detail.Footnote 13 Finally, Eq. (1) includes industry and year-fixed effects, because CSR reports are concentrated in some industries and exhibit an overall time trend.Footnote 14 All variables in Eq. (1) are defined in Appendix 2.

Main Results

Table 4, Panel A compares the descriptive statistics for forecast errors across DSCORE groups. For the No-CSR-Report, and low, mid, and high DSCORE groups, the average FERROR(0) are 6.94, 2.90, 3.15, and 1.90%; the average FERROR(1) are 13.56, 6.23, 6.6, and 5.36%; and the average FERROR(2) are 18.41, 8.31, 8.53, and 7.25% of the share price, respectively. Forecast errors generally decrease with DSCORE. Moving from the low to the high DSCORE group, FERROR(0) decreases by 35%, FERROR(1) decreases by 14%, and FERROR(2) decreases by 13%. This trend provides preliminary support to our empirical prediction.

Table 4 CSR reporting disclosure score and analyst forecast accuracy

Table 4, Panel B reports results of estimating Eq. (1), after standard errors are adjusted for clustering by firm. Across columns, the coefficient estimates for MidDSCORE and HighDSCORE are negative and statistically significant. In other words, forecast errors decrease with DSCORE, consistent with Panel A. Moving from low to high DSCORE group reduces FERROR(0), FERROR(1), and FERROR(2) by 3.2, 5.1, and 6.4% of share price, respectively. These differences are statistically significant. The signs on the control variables are generally consistent with Dhaliwal et al. (2012). As expected, forecast errors increase with firm size, earnings volatility, loss status, and forecast horizon. At the same time, the coefficients for FFIN and ASSURANCE are not significant, and the coefficient for analyst following (ANALYST) is significantly positive. We attribute these differences with Dhaliwal et al. (2012) to the additional CSR-related variables in our model as well as differences in sample characteristics (for instance, Dhaliwal et al. use an international sample). We examine assurance and financial reporting narratives separately in the additional analysis section (see “Controlling for Financial Narratives” and “CSR Disclosure Score and CSR Assurance” sections). Inverse Mills ratio (MILLS) estimated from the first-stage probit model is significant, supporting the importance of controlling for unobservable factors arising from the selection problem. Unreported regression diagnostics show no evidence of multicollinearity, as variance inflation factors are lower than five.

Table 4, Panel C reports the results of estimating Eq. (1) using the continuous measure of DSCORE, rather than the low, mid, and high DSCORE indicators. In this specification, we include an indicator for issuing a CSR report (CSRREPORT), because DSCORE is inherently an interaction between issuing a CSR report and the disclosure score of that report. In the first column, we test the benchmark FERROR(0) model from Dhaliwal et al. (2012) without the DSCORE variable. Consistent with Dhaliwal et al. (2012), the coefficient on CSRREPORT is negative and significant. In the second column, we add our main test variable DSCORE, and the coefficient estimate for DSCORE is negative and significant, supporting our hypothesis. Interestingly, CSRREPORT is no more significant when we add DSCORE in Eq. (1). In columns 3 through 6, we repeat the analyses with FERROR(1) and FERROR(2), and find similar results.

Overall, findings in Table 4 suggest that firms issuing CSR reports with LowDSCORE do not necessarily improve analyst forecast accuracy relative to firms issuing no CSR reports. However, firms issuing CSR reports with mid and high DSCORE improve analyst forecast accuracy. The findings extends prior literature by showing that the CSR reporting quality plays an important role in affecting analyst forecasts in addition to the decision to issue CSR reports.

Additional Analysis

Components of CSR Report Disclosure Score

CSR reports vary in the components of the DSCORE. In the absence of theory on which components drive the CSR report informativeness, we empirically search for the major drivers of CSR report informativeness. Consistent with the prior analysis, we divide the six DSCORE components into high (i.e., upper quartile) and low (i.e., lower three quartiles) groups in order to address non-linear effect of these components on analyst forecasts. Consistent with our reverse ranking of RATIO_OPT and SMOG components while constructing the DSCORE, we multiply these two components by −1 before identifying the high and low groups.

Table 5, Panel A compares the descriptive statistics for forecast errors between the high and low component groups. For low and high RATIO_HOR groups, the average FERROR(0) is 2.73 and 2.89%; the average FERROR(1) is 6.56 and 5.24%; and the average FERROR(2) is 8.49 and 7.39% of the share price, respectively. In other words, analyst forecast errors generally decrease with RATIO_HOR. A similar pattern is observed in RATIO_PES, RATIO_OPT*(−1), and SMOG*(−1) components. RATIO_NUM and RESWORDS components, however, show the opposite pattern. For instance, for low and high RATIO_NUM groups, the average FERROR(0) is 2.24 and 4.02%; the average FERROR(1) is 4.88 and 9.26%; and the average FERROR(2) is 6.43 and 12.33% of the share price, respectively. The univariate statistics should be interpreted with caution, because other factors that are correlated with the disclosure score components could be driving the statistics.

Table 5 Components of CSR reporting disclosure score

Table 5, Panel B reports the results of estimating a modified version of Eq. (1) that replaces DSCORE with the low and high indicators of DSCORE’s components. For brevity, we only report results with FERROR(0) as the dependent variable. Largely consistent with the univariate comparisons in Panel A, we find the following results. First, the high group of RATIO_HOR, RATIO_PES, and SMOG*(−1) components are negatively associated with analyst forecast errors. Second, the low groups of RATIO_NUM, RESWORDS, and RATIO_OPT*(−1) components are negatively associated with analyst forecast errors, while the high group of these variables are not statistically significant. The difference across the high and low groups is not statistically significant at conventional levels for either of the six components. Overall, individual components of DSCORE appear to not affect analyst forecasts as much as their aggregation, DSCORE. The non-linear relationship between DSCORE and forecast errors also suggests that some components may be informative at levels higher than their highest quartile. We conclude that components of CSR disclosure score contribute to improved analyst forecast accuracy, but not in a linear fashion; and furthermore, considering the aggregate score appears to be more important.

First and Subsequent CSR Reports

In our study, we predict and show that analysts would react to higher quality narratives of CSR reporting. Accordingly, in this section, we examine whether the positive association between DSCORE and analyst forecast accuracy is different between the first and subsequent issuance of CSR reports. To investigate, we re-estimate Eq. (1) after replacing DSCORE indicators with first and subsequent DSCORE indicators (i.e., FirstLowDSCORE and SubsLowDSCORE; FirstMidDSCORE and SubsMidDSCORE; and FirstHighDSCORE and SubsHighDSCORE). There are 401 first CSR reports in the sample, out of which 58% are classified as FirstLowDSCORE and 17% are classified as FirstHighDSCORE.

Table 6 provides the results of the estimation. When compared to first CSR reports, forecasts errors are lower for subsequent CSR reports and especially those CSR reports in the mid and high DSCORE groups. This evidence suggests committing to a long-term disclosure strategy helps firms in building the credibility of CSR reporting over years.

Table 6 First and subsequent CSR reports

Incremental Effect of DSCORE Over GRI and KLD Transparency Measures

KLD rates a firm’s CSR disclosure quality using a Reporting Strength/Concern indicator. This rating is not focused on the CSR report narratives but on the overall CSR-related disclosures. In addition, many U.S. companies have increasingly issued their CSR reports following the GRI guidelines. A study conducted by the Governance & Accountability Institute shows that investors demand S&P 500 companies report CSR information under the GRI framework.Footnote 15 Thus, KLD reporting rating and GRI status both can proxy for CSR reporting quality. Nevertheless, developing an objective measure of CSR report disclosure is important for the following reasons. First, both KLD and GRI ratings are binary variables, and thus hold limited information about the disclosure quality of the CSR reports. Second, how KLD rates firms for CSR disclosure is not fully known. Third, GRI guidelines focus on the form but not substance of CSR disclosures. In contrast, our measure depends on the substance of the disclosures. Furthermore, it is transparent and thus can be refined by future research on different narratives.

In this section, we test whether DSCORE is significantly associated with analyst forecast accuracy after controlling for the KLD reporting ratings and GRI status. Table 7, Panel A presents how low, mid, and high DSCORE indicators correlate with indicators for companies following the GRI guidelines as well as indicators for companies with KLD-assigned reporting Strength and Concern ratings. We find that percentage of CSR reports that comply with the GRI guidelines are 16, 45, and 53% for the low, mid, and high DSCORE groups, respectively. That is, CSR reports that follow the GRI guidelines are also more likely to be classified as higher disclosure score by our substance-based measure. Similarly, percentage of CSR reports that have KLD-assigned reporting Strength (Concern) ratings are 22% (30%), 45% (24%), and 54% (27%) for the low, mid, and high DSCORE groups, respectively. That is, our CSR disclosure ratings correlate with the KLD reporting Strength and Concern ratings. Collectively, these univariate statistics provide additional validity to DSCORE.

Table 7 Alternative measures of DSCORE

Table 7, Panel B reports the results of Eq. (1) after adding the indicators for companies following the GRI guidelines as well as indicators for companies with KLD-assigned reporting Strength and Concern ratings. DSCORE is incrementally associated with analyst forecasts errors after controlling both GRI status and KLD-assigned reporting ratings. In fact, the coefficient estimates for these additional controls do not load significantly. Collectively, the results in Table 7 corroborate the effect of DSCORE on analyst forecast accuracy.

Controlling for Financial Narratives

We control for a company’s financial narratives using deciles of 10-K report optimism (10KOPT), pessimism (10KPES), readability (10KREADABLE), and length (10KLONG) in addition to other control variables in Eq. (1).Footnote 16 We do this because CSR report narratives may simply reflect the companies’ financial narratives and thus the findings above may be driven by informativeness of financial narratives. Inconsistent with this explanation, Table 8 shows that a significant and positive association between DSCORE and analyst forecast accuracy remains after controlling for the variables measuring a company’s financial narrative style.

Table 8 Controlling for characteristics of 10-K narratives

CSR Disclosure Score and CSR Assurance

Assurance of CSR reporting by independent organizations, while uncommon, reduces information asymmetry between companies and investors (Casey and Grenier 2015). Accordingly, we examine whether external assurance of CSR reports substitutes or complements disclosure quality. Specifically, we add to Eq. (1) the interaction of DSCORE and ASSURANCE. Table 9 reports the results of this estimation. Although the main effect of ASSURANCE does not load up in our earlier regression models (see Table 4, Panel B), the interaction is significantly negative. In other words, the positive effect of DSCORE on forecast accuracy is enhanced when the CSR report is also audited, suggesting that CSR disclosure quality and CSR assurance are complements to one another in improving analyst forecast accuracy.

Table 9 Incremental effect of assurance on analyst forecast accuracy

Conclusion

Unlike financial reporting, which is subject to a well-developed accountability framework, CSR reporting is largely voluntary and unregulated. Yet prior literature shows that issuance of standalone CSR reports is associated with capital market benefits such as lower cost of capital and analyst forecast accuracy (Dhaliwal et al. 2011, 2012). In this paper, we search for an explanation behind these findings. In particular, we ask whether capital market benefits come primarily because of the fact that companies disclose their CSR activities in a standalone CSR reports or because of the quality and credibility of their disclosures in their CSR reports.

We rate the quality of disclosures in standalone CSR reports using insights from the financial reporting literature that use computer linguistic techniques. We assign higher disclosure scores if CSR reports have fewer optimistic and more pessimistic keywords; if they are more easily readable; if they are longer; and if they have more numeric and horizon content. Our tests show that analyst forecast accuracy increases with CSR report disclosure scores. In addition, firms with low CSR report disclosure scores do not have better analyst forecast accuracy than firms without CSR reports. These findings highlight the importance of high-quality CSR report disclosures in comparison to simply issuing CSR reports.

Our paper uses objective criteria for analyzing CSR report narratives and takes a first step in developing a disclosure score for standalone CSR reports. Our analysis regarding the six individual components of the disclosure score shows that individual components are not statistically significantly associated with analyst forecast accuracy. While this suggests the importance of aggregating individual components of disclosure quality, future research can help to refine our disclosure score by either considering additional aspects of CSR report narratives and/or refining our linguistic measures, noting the importance of non-linearity as well as aggregation of the components. We believe that our measure of CSR disclosure quality has significant potential to summarize the narratives in other financial and non-financial contexts, and thus help regulatory efforts to make these disclosures more effective. For instance, the SEC has been reviewing overall disclosure requirements and considering ways to improve the disclosure regime for the benefit of both companies and investors since December 2013 (https://www.sec.gov/spotlight/disclosure-effectiveness.shtml).

We use computer linguistic methods that can be readily employed on larger samples with lower risk of subjective evaluations; nevertheless, the limitation of our approach is that the measure could introduce noise. Following a different track, Sethi et al. (2015) conduct a content analysis of CSR reports and score disclosure dimensions based on the level of details provided in the CSR report—the CSR-S Monitor.Footnote 17 We echo Sethi et al.’s (2015) suggestion that various methods will incrementally validate disclosure quality, given the significant variation in CSR reporting.