1 Introduction

Changing market and climatic conditions can be a threat to food security (Lobell et al. 2008; IPCC 2007; Peri 2017; Usman and Haile 2017), which are likely to be disproportionately felt among smallholder farming households in areas that already suffer high levels of hunger (Muller et al. 2011; Wheeler and von Braun 2013). The adaptive activitiesFootnote 1 that households undertake are thought to be an important means of coping with changing circumstances (e.g. Biggs et al. 2013). Accordingly, several studies have analyzed the determinants of these adaptation decisions in order for policymakers to facilitate adaptation and mitigate the losses arising, for instance, from climate impacts (e.g. Deressa et al. 2009, Bryan et al. 2009, Di Falco 2014, Chen et al. 2018). Typically, these papers attempt to identify elements of adaptive capacity, and find that household characteristics such as level of education, farm and non-farm income, wealth, access to information and credit, farming experience, as well as participation in government programs, are significant factors that influence farmers’ ability to undertake adaptive activities.

As smallholder farmers are already undertaking adaptive farm-level changes, it is important to understand how these types of adaptive behavior affect their welfare. Policymakers and development practitioners can use this information to target interventions to given contexts, and to assess whether policies aimed at incentivizing farmers to undertake adaptive activities are able to mitigate the anticipated losses arising from changing climatic and economic conditions.

Despite the importance of understanding the welfare impacts of adaptation, due to a number of difficulties, empirical evidence of how smallholder adaptation impacts welfare is scarce.Footnote 2 The objective of this paper is to investigate impacts of agricultural adaptation at the household level on food security, while addressing three types of difficulties.

First, estimates of how adaptation affects household welfare are plagued by empirical identification issues. In a typical (yet naïve) approach, the researcher would estimate a regression model using a welfare measure as a dependent variable, with an adaptation measure and a set of co-variates as independent variables. The challenge of such a regression is that adaptation is likely an endogenous variable. For instance, estimates could suffer from reverse causality because adaptation may influence welfare, but welfare may also influence adaptation. Therefore, there is a need to identify ways to consistently estimate the impacts of adaptation on welfare.

Our empirical strategy is to use an instrumental variable (IV) approach to address endogeneity of adaptation in welfare regressions. While numerous technology adoption papers have used IVs (e.g., Adekambi et al. 2009; Arellanes and Lee 2003; Dibba et al. 2017; Ogada et al. 2010), we are not aware of any IVs that have been developed for studying welfare effects of adaptation. Our method relies on the concept that information relevant to agricultural adaptation flows within a neighbor network. In order to identify an IV approach, we turn to a group of papers that find that neighbors in developing countries learn from each other and these interactions influence household behavior (Keil et al. 2017; Foster and Rosenzweig 1995; Ward and Pede 2014; Krishnan and Patnam 2014). The neighbor networks effects on farmers’ decisions suggest a set of instruments to address the endogeneity of adaptation in welfare regressions. Specifically, our instrumental variables are weighted averages of adaptation and human capital characteristics of neighbors, with weights inversely proportional to the physical distance between farms. Under-identification and over-identification statistical tests provide support for the validity of these instruments.

Second, most studies attempting to link adaptation to welfare are limited by data collected from local case studies, which provide little information regarding the generalizability of results. Our dataset contains socio-economic and agricultural practices information collected by Climate Change, Agriculture and Food Security (CCAFS) from more than five thousand households located in 15 developing countries in Africa, Asia, and Central America (CGIAR 2019). We use as our welfare measure the number of food secure days that households experience in a year, and we use the number of adaptive activities that households undertake as our measure of agricultural adaptation.Footnote 3 Moreover, the CCAFS dataset contains farm-level Global Positioning System coordinates that allow us to build the neighbor networks required in our IV approach. The dataset also allows us to estimate adaptation effects controlling for various co-variates, including levels of education, farm characteristics, financial factors, productive and non-productive assets, demographics, farming experience, and participation in government programs. Our estimations also control for varying crop mix and site-specific effects.

Third, though adaptation to climate change is currently a widespread concern, there are numerous types of changes that could be spurring adaptation. Within this context, there is the potential that the impact of adaptation on food security could vary depending on the type of change to which smallholders are responding. In our study, we employ data that indicate whether adaptive activities are undertaken in response to climate change, changes in market conditions, or both. This data allow us to investigate whether smallholders are able to use adaptation to better cope with some types of changes, rather than others.

Overall, we find that smallholder adaptation is welfare improving with respect to food security. Our estimates indicate that, on average, undertaking one additional adaptive activity leads to approximately 5 additional days of food security in a year, or put differently, adaptive activities are responsible for 16% of the food security of smallholders. The effect is robust to the specification of crop mix, varying models of network effects (i.e. varying approaches to calculate the spatial weights of our instrumental variables), and using weighted measurements of adaptation. We also show that spatially weighted network transformations of adaptation and human capital are well suited to estimate IV food security regressions, and that not correcting for the endogeneity of adaptation significantly underestimates impacts on food security benefits. Finally, we report empirical evidence suggesting that the food security impacts of adaptation are generally more effective in responding to changing market conditions than in responding to climate change.

This paper is organized as follows. Section 2 discusses the literature related to approaches for using observational data to estimate the impact of adaptation on welfare measures. Section 3 describes the sampling framework, the data, and the empirical model. Section 4 presents diagnostics tests for our IV approach, along with the model estimates. We offer some concluding remarks in section 5.

2 Related literature

A number of studies have examined the link between smallholder farmers’ adaptation activities and their welfare (e.g. Di Falco et al. 2011; Di Falco and Veronesi 2013). This section presents a discussion of this literature with a focus on the three challenges discussed above.

The first challenge is the endogeneity of adaptation in the estimation of welfare benefits. Scholars have adopted a number of approaches to address this difficulty. One group of papers employ switching regression approaches. For example, Di Falco and Veronesi (2013) use a multinomial endogenous switching regression model to estimate the effect of adaptation strategies on crop net revenues of farmers. These authors argue that both the decision to adapt and what strategy to use are endogenous as these factors may be influenced by unobservable characteristics and might, for example, lead to self-selection bias. Their approach consists of two stages. First, they use a multinomial selection to model farmers’ strategy choices from a (relatively small) set of possible strategies. Second, they estimate a net revenue model for each strategy in the choice set. They find that a combination of adaptation strategies is more effective than a single strategy in increasing crop revenues.

Several papers assume that farmers face a binary strategy set: to adapt or not to adapt. Di Falco et al. (2011) estimate a two-stage endogenous switching model and find that adaptation leads to significant increases in food productivity. In particular, they find that households who adapted would have produced 20% less if they did not adapt. Moreover, households who did not adapt would have produced 35% more if they had adapted. Huang et al. (2015) use a similar approach and show that households that implement farm-level changes in response to extreme weather events experience significant increases in yield. Using the same approach, Asfaw et al. (2012) find that adaptation in terms of adopting improved varieties generates a significant positive impact on consumption expenditures.

Other papers complement endogenous switching models with propensity score approaches. Khonje et al. (2015) examine welfare impacts of smallholder farmer adaptation using both a regression and propensity score matching (PSM). First they estimate a binary endogenous switching model. Second, they implement a PSM strategy as a robustness check. Their methods suggest that the adoption of improved maize varieties increases crop income, consumption expenditures, and food security. Shiferaw et al. (2014) use a similar approach, and in addition to endogenous switching regressions and PSM, they also use a two-step generalized propensity score (GPS) approach. The GPS approach differs from PSM in that it allows for varying intensities of treatment (e.g. varying adaptation levels as opposed to binary adaptation). Their GPS approach consists of two steps. They first estimate a GPS model to balance covariates, and follow this step with a regression model of the outcome (i.e. food consumption expenditures and a food security binary indicator) where treatment (adaptation) level is a right hand side variable. They find a positive relationship between intensity of adaptation (area devoted to improved wheat) and food security and consumption.

Most studies focus on a small set of farming changes. Di Falco and Veronesi (2013) focus on three types of changes (water strategies, changing crop varieties, and soil conservation) and their combinations, while Di Falco et al. (2011), Asfaw et al. (2012), and Huang et al. (2015) examine binary adaptation choice. In contrast, our approach allows us to explore the rich nature of our data to use information on 46 possible changes in farming practices (refer to section 3). Such a variety of adaptation strategies rules out the possibility of estimating multinomial choice models like in Di Falco and Veronesi (2013). In addition, as most households adopted at least one of the 46 possible strategies, the binary (to adapt or not) identification strategy used by Di Falco et al. (2011), Asfaw et al. (2012), and Huang et al. (2015) would be problematic with our data. For example, in our sample, all households from Ghana, Kenya, Niger, and Senegal adopted at least one new farming practice.

Also, note that the validity of PSM depends on the assumption that, controlling for the probability of adaptation, the outcome of interest (e.g. food security) and the adaptation status (adapted or not) are independent. The probability of adaptation is estimated using observable determinants, and therefore the matching approach controls for endogenous adaptation using observable heterogeneity, and is sensitive to selection based on unobservables. The literature refers to this assumption as the conditional independence assumption (CIA). As Angrist and Pischke (2009) explain, assuming consistency of matching estimators under the CIA is equivalent to assuming consistency of estimates from a regression of food security on adaptation and controls. Nevertheless, above we refer to this approach as the naïve regression because it is very likely that there are unobservable factors that are correlated to adaptation decisions, even after controlling for available co-variates. In fact, the attractiveness of the IV approach lies on offering a solution when the CIA is not reasonable. When a valid instrument is available, the IV approach is able to address multiple sources of endogeneity of adaptation.Footnote 4

While PSM uses binary adaptation status, the GPS method (Shiferaw et al. 2014) allows for varying adaptation levels. Nevertheless, the method relies on the same independency assumptions as the standard PSM methods. Moreover, Hirano and Imbens (2004) argue that the estimated coefficients from the second stage regression do not have a causal interpretation. This weakness would be problematic for us, as estimating the effect of adaptation intensity on food security is the primary goal of our paper. As a result, we develop an instrumental variable approach to address the endogeneity of adaptation and establish a causal relationship between farming practices changed and food security.

The second challenge is the limited spatial context of most studies. The findings reported by the papers above are based on case studies with localized data, and as a result, they often reflect a focus on a specific crop. Huang et al. (2015) focus on rice production of 1653 households in five rice producing provinces of China. The analysis of Khonje et al. (2015) is based on a sample of 810 households located in major maize growing areas of eastern Zambia. Shiferaw et al. (2014) examine 2017 smallholder wheat producers in the eight main wheat-growing agro-ecological zones of Ethiopia. Di Falco and Veronesi (2013) and Di Falco et al. (2011) study adaptation of 941 smallholder farmers in the Nile Basin of Ethiopia. The sampling of Asfaw et al. (2012) focus on chickpea and pigeonpea production among 700 households in the Shewa region in the central highlands of Ethiopia, and 613 households in four districts of Northern Tanzania. Finally, Shikuku et al. (2017) offer a wider investigation by focusing on East Africa; however, the work is limited to a sample of 500 households from the CCAFS dataset (a subset of the data that we employ here). In contrast, our large dataset with more than five thousand households allows us to investigate a broader link between smallholder farmer adaptation and food security in developing countries, while controlling for crop and site effects. To this end, our estimates use data on more than five thousand households located in 15 countries (see Table 1), which increases the external validity of our results.

Table 1 Distribution of the CCAFS data set sample across Regions, Country and Sites

The third challenge in the empirical estimation of impacts of adaptation is the possible dependence of welfare results to the reasons for adaptation. For example, welfare effects could depend on whether adaptation is spurred by changes in market conditions, or motivated by climate change. These differential effects could imply alternative policy approaches; say for example, if adaptation were effective in responding to changing market conditions, but not climate change. But, to our knowledge, there has been very little work on adaptation and welfare impacts in the context of market changes and climate change stimuli. Eakin et al. (2014) and Gandure et al. (2013) look at relative risk perceptions of market vs. climate change, and find that market changes were generally perceived as higher risks than climate change. But the focus of both of these studies was on risk perceptions, with little, if any, information on resulting adaptive behaviour. To our knowledge, only one study has considered both market and climate changes as reasons for change (Chen et al. 2018), and such information was used to explain adaptation rather than welfare impacts on households.

In summary, the literature review above discloses three primary contributions of our paper regarding estimating impacts of adaptation on household welfare. First, though a number of alternative approaches have been employed to address the potential endogeneity of adaptation, we are unaware of any studies that have used an IV approach. Our identification of an effective IV strategy provides an alternative approach for future studies. Second, our review discloses that studies that have addressed endogeneity concerns have been limited to localized sites or regions. To our knowledge, ours is the first study to investigate whether impacts of adaptation on welfare are generalizable over multiple countries, while addressing the endogeneity issue. Finally, we are unaware of any studies that have investigated whether the reason for changing farming practices has variable effects on household welfare. We investigate this by using a split sample approach to estimate reason dependent food security gains from adaptation.

3 Methods

3.1 Data

We use a rich dataset from the CCAFS research program collected in West Africa, East Africa, South Asia, and Central America.Footnote 5 Data were collected from late 2010 to late 2013 for the Africa and Asia sites, and in 2014 for the Central America sites.Footnote 6 Households were sampled from randomly located 10 × 10 km sampling blocks; 30x30km sites were selected in West Africa and Ethiopia due to low population densities. Within each block, 20 households in each of seven villages were randomly selected. The dataset contains information from 5314 households from 39 sites in 15 countries. Incomplete data for some of these households leave us with 5159 observations. Table 1 contains a more detailed description of our sample and its distribution across regions, countries, and sites. Kristjanson et al. (2010) contains more details on the sampling framework.

3.2 Empirical approach

We hypothesize that adaptation positively contributes to food security. To empirically investigate this relationship, we estimate the following regression model:

$$ {FS}_{is}={\alpha A}_{is}+{X}_{is}'\beta +{Z}_{is}'\gamma +{\lambda}_s+{\varepsilon}_{is} $$
(1)

where FSis is the number of food secure days (in a year) of household i in site s, A represents adaptation (number of farming practices changed), X are control variables, Z are crop dummies (used to control for variation in food security as a function of the household’s crop mix), λ is a site fixed effect, and ε is an idiosyncratic error term.Footnote 7 Our statistical tests allow for within site correlations by clustering standard errors at the site level.

The potential endogeneity of adaptation is a challenge for econometric identification. To address this challenge, we exploit the spatial information of households in our data. Literature shows that the spatial position of neighbors may influence the formation of networks, which in turn could affect adaptation decisions (e.g. Foster and Rosenzweig 1995). This observation suggests an IV approach for the identification of model (1). Our proposed set of instruments to identify welfare impacts are adaptation and human capital measures of a farmer’s neighbor, weighted by their spatial proximity. Let W represent a spatial weighting matrix. An element (i,j) of W captures the strength of the spatial correlation between households i and j. As a result, W can be thought of as a neighbor network where the strength of the link between two households is inversely proportional to their spatial distance. Specifically, W is a row normalized inverse distance matrix, with truncation at 10 km such that the influence of households beyond the truncation point is set to zero. This truncation allows for a simple specification of spatial effects, and the threshold of 10 km matches the dimensions of the sites for the vast majority of our sample.Footnote 8 Let X* denote the portion of X that captures education levels. Our set of instruments is WA and WX*, where WA is the spatially weighted average adaptation of farmers’ neighbors, and WX* is the spatially weighted average education of farmers’ neighbors.

Our instrumental variable identification strategy is inspired by the spatial econometrics literature where instruments are spatial lags of the right-hand side variables based on normalized weighting matrices (Kelejian and Prucha 1998; Lee 2003). The strength of these instruments depends on the strength of their correlation with adaptation. There are several reasons for a strong correlation between our spatial and human capital spillover instruments and adaptation. First, as mentioned above, empirical research suggests that adaptation of new technologies (e.g., high-yielding seed varieties) is influenced by the adaptation behavior of neighbors (Foster and Rosenzweig 1995). This result suggests that neighbor adaptation WA is correlated with own adaptation A. Second, adaptation-related learning happens primarily in local networks because neighbors and close farmers experience similar economic and climactic conditions and are likely to have relevant information about adaptation. Indeed, farmers’ networks have been shown to be more effective in influencing behavior than specialized extension services (Foster and Rosenzweig 1995; Conley and Udry 2010; Krishnan and Patnam 2014; Ward and Pede 2014). As a result, we expect the level of human capital of farmers’ networks WX* to be correlated with own adaptation A. Finally, the existence of human capital and adaptation spillovers is also in line with the fact that major adaptation programs (for example, the United Nations Climate Change program in Uganda)Footnote 9 focus on developing tools and enabling farmers to adapt, as opposed to other strategies with less spillover effects such as direct cash or food transfers. In addition to the economic arguments above, we use an F-test to statistically examine the correlation between our instruments and adaptation.

The validity of our instruments also relies on the assumption that neighbors’ adaptation and adaptive capacity (WA and WX*) are not correlated with the unobservable determinants of food security, and does not affect food security directly but only indirectly through adaptation levels A. Therefore, this assumption may not hold if, for example, adaptation generated higher wealth, enhanced welfare, and allowed individuals to systematically share this higher wealth with neighbors. This would create a link between own adaptation and neighbors food security, weakening our instruments. Note, however, that this triangulation is unlikely to be effective in poor rural regions of developing countries. The significant negative effect of household size on food security and other important adaptive constraints faced by poor households (e.g., Babatundea and Qaimb 2010) make it unlikely that direct transfers between neighbors are an effective means of providing food security, especially in the most vulnerable and food insecure regions of the world, represented in our sample. In addition to F-tests, we also use under-identification and over-identification tests to check the validity of our instruments.Footnote 10

Note that our approach is based on a linear model as opposed to a nonlinear count model. Our choice is motivated by difficulties in implementing instrumental variable strategies to nonlinear models. Instrumental variable approaches when directly applied to nonlinear models typically deliver inconsistent estimates. Wooldridge (2010) refers to this method as the ‘forbidden regression’. One estimation approach for nonlinear endogenous variable models is the control function approach. However, this approach is less reliable when the endogenous variable is not continuous, which is the case with our measure of adaptation. Deeper discussions of these issues are available in Lewbel et al. (2013), Lloyd-Smith et al. (2018), and Lloyd-Smith et al. (2019). In addition, maximum likelihood estimation of count models is inconsistent under heteroskedasticity of unknown form. These issues are mitigated by the specification of a linear regression model. Our GMM estimator is consistent and inference is based on robust standard errors clustered at the site level.

3.3 Variables

We measure welfare in terms of food security (i.e. FS from eq. 1). Households were asked to identify, for a typical year, periods when they tend to struggle to find sufficient food, or experience shortages to feed their families. We measure the number of days in a year the household does not experience shortage to feed the family and use this number to capture the food security of households. This measure has been used in the literature (e.g. Kristjanson et al. 2012) and follows the definition of Pinstrup-Andersen (2009) in which a household is food secure “if it has the ability to acquire the food needed by its members to be food secure” (p.6).Footnote 11 A summary of our variables, and their descriptive statistics, in Table 2 shows that on average, households in our sample experience 293 food secure days per year, with a standard deviation of approximately 84 days.

Table 2 Variable Descriptions and Descriptive statistics (n = 5159)

Our measure of adaptation (i.e. A from eq. 1) is based on responses of households regarding changes that were made in households’ farming activities within the past 10 years. Households were instructed to select all alternatives that would apply from a list of 46 farming practices (Table 3). To measure adaptation, we count the total number of changes to farming practices made by each household. Households responses for the questions about changes in farming practices were captured with binary indicators (e.g. response =1 for yes, “stopped using manure/compost”). Therefore, the mean values in the Table represent the proportion of the households in the sample that implemented the change.

Table 3 Activities and descriptive statistics associated with changes in farming practices (n = 5159)

In order to identify effects of adaptation on household welfare, it is also necessary to control for elements of adaptive capacity. Poor households in rural areas of developing countries face numerous economic constraints that help identify the adaptive capacity of households (e.g. Mendelsohn 2012). These determinants include variables that capture various socio-economic characteristics of households (see for example, Smit 2001, Yohe and Tol 2002, Feder et al. 1985). Our model includes controls for these socio-economic factors, as they may influence smallholder farmers’ welfare (i.e. X from eq. 1). The CCAFS survey provides us with a number of variables that capture human capital, access to information, financial and physical assets, farm and household characteristics, and farming and climate crises experience. The variables that we employ for each of these categories are described in Table 2.

We also include in our model controls for the types of crops that each household grows. Dummy variables for 10 crops (see Table 4) are included to control for possible differential effects of crop mix on food security (i.e. Z from eq. 1). These crops represent the most important crops of our sample as they are grown by at least 5% of our households. Our estimation also controls for local characteristics (e.g. weather) of each of the 39 sites shown in Table 1 (i.e. site fixed effects).

Table 4 Crop Summary Statistics (n = 5159)

Finally, we investigate differential effects of alternative stimuli for adaptation by segmenting our sample. In addition to asking households about their changing farming practices, farmers were also asked whether the changes were caused by climate variability and/or market conditions. We split our sample into four groups to estimate models targeting different motivators for changing farming practices. The first group contains 1036 households (20% of the sample) that did not adapt in response to climate or market; this is our baseline group whose adaptation was not in response to either of these two factors. The second group contains 483 households (9% of the sample) that adapted due to climate variability only. The third group has 1286 households (25% of the sample) that adapted due to market conditions only. Finally, the fourth group contains 2354 households (46% of the sample) whose agricultural adaptation was in response to both climate variability and market conditions. For each of these segments, we run separate models and compare the impacts of adaptation on food security.

4 Results

Table 5 shows the results of four estimated models, which explore potential differences in results of using instrumental variables and fixed effects. OLS1 is an ordinary least squares model that does not include instrumental variables or crop fixed effects. The OLS2 model adds crop fixed effects. The next two models employ the widely utilized two step generalized method of moments instrumental variable approach. IV/GMM1 includes instrumental variables, but not crop fixed effects, while IV/GMM2 adds crop fixed effects.

Table 5 Model Results

We begin with results of statistical tests regarding the validity of the instruments we employ in our IV/GMM models, presented in the bottom of Table 5. First, we test whether the instruments are correlated with the endogenous variable. The F statistic of the auxiliary regression of A on WA and WX* is equal to 979.18 (p < 0.001), which indicates that the correlation between the instruments and adaptation is statistically significant. Next, we use the Kleibergen-Paap test of under-identification to examine whether the excluded instruments (neighbors’ adaptation and education) are correlated with the endogenous variable (own adaptation) under the assumption of site-level clustering (Kleibergen and Paap 2006). Table 5 shows that we reject the null, that the equation is under-identified, with p < 0.05 in both instrumental variable models. Finally, we perform a test of over-identifying restrictions. The test uses Hansen’s J test statistic (Hansen 1982). It is based on the joint null hypothesis that the excluded instruments are uncorrelated with the error term of the food security regression, and that they are correctly excluded from the food security equation. If the test statistic is significant, the instruments may not be valid. We fail to reject the null hypothesis with p values of 0.16 and 0.17 for, respectively, the IV/GMM1 and IVGMM2 models. These results provide support that our proposed set of instruments is valid.

We now turn to the estimates of eq. 1. Our central concern is to quantify the impact of agricultural adaptation on food security, which is captured by our estimate of α in eq. 1. Our preferred (IV/GMM) estimates indicate a positive and statistically significant relationship between adaptation and food security. We find that one additional farming practice changed increases food security of smallholder farmers by 4.8 days. Interestingly, this effect does not depend on crop effects (i.e. the estimates of α in IV/GMM1 and IV/GMM2 are very similar). The IV/GMM estimates that account for the endogeneity of adaptation are approximately 4 times larger than estimates obtained through a standard OLS regression. This result underscores the importance of correcting for endogeneity when estimating the impacts of adaptation on welfare.

The magnitudes and significance of the control coefficients in Table 5 indicate that the results are generally robust across the four models. In particular, variables that increase food secure days, which are consistent across all specifications of the model, include having a bank account (approx. 11 more food secure days), having rental income (approx. 10 more food secure days), and having more non-productive assets (approx. 5 more food secure days for each asset). Conversely, variables that decrease food secure days include having more people in a household (approx. 1 less food secure day per additional person) and having faced a climate related crisis (approx. 14 less food secure days).

There are, however, two control variables whose coefficients are substantially different when the model is estimated with instrumental variables. First, whether a family has been farming in the same locality for 10 years is highly significant and large in the OLS models, while it is insignificant and much smaller in the IV/GMM models. Second, whether the farm has access to running water is also highly significant and large in the OLS models, but smaller and marginally significant when crop effects and instruments are used.

We further investigate the robustness of our IV/GMM models by running additional IV specifications. We are interesting in the sensitivity of results to two key aspects of the weighting matrix W; distance truncation and normalization. In Table 5, we defined neighbor networks as having potential impacts to a distance of 10 km. In addition to the 10 km truncation, the spatial weights of our IVs were based on row normalization of inverse distances. Both row and spectral normalizations are common in spatial analysis. While row normalization makes the row sum of the weights in W equal to 1, with spectral normalization the weighting matrix is normalized so that the largest eigenvalue of W is equal to 1. Table 6 shows results where we modify our instruments. Estimates reported in the first two columns keep row normalization but vary the spatial designations of neighbor networks (i.e. a 5 km truncation for IV/GMM3 and a 50 km truncation for IV/GMM4). Estimates of the last column use our standard 10 km truncation but the IVs are based on spectral weights.

Table 6 Robustness Checks Regarding Distance and Spatial Matrix Properties

Estimates of models IV/GMM3 and IV/GMM4 are similar to those IV/GMM estimates in Table 5. Moreover, across all of the distance truncations, the instrumental variables tests again provide evidence in favor of our spatial identification strategy. This suggests that our instrumental variable approach based on row normalized weights is not sensitive to the specification of spatial truncation. The final model, IV/GMM5, investigates whether spectral normalization of the weighting matrix influences the results. The IV/GMM5 model is estimated with 10 km truncation, so is comparable to the models IV/GMM1 and IV/GMM2. The estimate of the effect of adaptation on food security is larger in model IV/GMM5. In this model, the instrumental variables statistical tests offer mixed empirical support for the identification strategy (contrary to the case of row normalized instruments). Specifically, while we are not able to reject the null in the Hansen over-identification test (which is evidence in favor of the strategy as a rejection generates uncertainty on the validity of the instrumental variables), the Kleibergen-Paap under-identification test indicates that we cannot reject the null of no correlation between the instruments and the endogenous variable. We conclude that spatial effects based on row normalized spatial weights generate better instrumental variables for use in estimating welfare regressions.

Note that our approach is based on an adaptation measure that counts adaptive activities and implicitly assumes equal weights to each activity. Previous works warrant caution regarding this assumption (e.g. Below et al. 2012; Shikuku et al. 2017). As another robustness check, we estimate model IV/GMM2 using two different methods to incorporate activity weights. The first is to use principal component analysis to determine weights. Specifically, we implement a weighting scheme based on the first principal component (which explains 16% of the total variance) and measure adaptation as the weighted sum of adaptive activities. The second method computes a food security-based index where weights are given by the marginal contribution of each adaptive activity to food security. Specifically, we follow Shikuku et al. (2017) and regress our outcome variable, food secure days, on the set of activity indicators. The predicted level of food security is used as a weighted adaptation index. While regressions using these adaptation indices make the magnitudes of the effects not comparable to the estimates in Table 5, both methods confirm previous results; adaptation significantly increases food security.

Our estimates with IVs indicate that changing an additional farming practice increases food security, on average, by 4.8 days (see Table 5). For the mean household, that made approximately 9.8 farming practices changes (see Table 2), the effect of adaptation is approximately 47 additional days of food security in a year. These results imply that policies aimed at fostering smallholder farm agricultural adaptation can significantly improve the welfare of farmers.

We further explore our data by examining the effects of adaptation that is motivated by market conditions and climate change. Table 7 shows the average number of farming practices changed by each of the four segments of the sample; changes due to: i) neither reason (n = 1036), ii) both reasons (n = 2354), iii) climate reason only (n = 483), or iv) market reason only (n = 1286). Households in the baseline group (i.e. neither reason) changed approximately 2 farming practices while households that respond to climate and market conditions changed 13.5 practices. Interestingly, households that respond to climate (but not to market conditions) only adapt with approximately half as many activities as those that respond to the market (but not to climate variability).

Table 7 Average number of farming practices changed, by reason for adaptation

For each subsample, we estimate eq. 1 using instrumental variables based on row-normalized weighting matrices with 10 km truncation, and with site and crop fixed effects (i.e. the specification followed in model IV/GMM2). Table 8 shows, for each group, the estimate of the marginal effect of adaptation of food security (\( \hat{\alpha} \)) and its 95% confidence interval.Footnote 12 We estimate that an increase in one adaptive activity from the baseline group increases food security by 5.6 days; however this estimate is not statistically significant. The marginal effect estimate for the climate variability group is 4.4; however, again we cannot reject the null of no effect. Households that adapt due to market conditions increase their food security, on average, by 7.5 days per farming practice changed (p < 0.01). Similarly, those who adapt to both market conditions and climate variability increase their food security by 7.1 days per practice changed.Footnote 13 For the households that adapt with double motivation, the average contribution of adaptation to food security is an impressive 95.6 days (i.e., 7.09 per practice changed times 13.48 changes, on average). These households have, on average, 295.6 days of food security in a year; hence, agricultural adaptation provides 32% of their yearly food security.

Table 8 Marginal effect of adaptation on the number of food secure days, by reason for adaptation

5 Summary of contributions, limitations, and concluding remarks

This paper offers several contributions to the literature on the welfare impacts of adaptation. Overall, we find that adaptation, in terms of an additional farming practice changed, increases food security by approximately 5 days. For an average household that makes almost 10 adaptive changes, adaptation is responsible for approximately 47 more days of food security. Put differently, our results indicate that approximately 16% of the food security of smallholder farmers in our sample comes from their adaptive activities. Other factors that increase food security include having: a bank account, income from renting land or machinery, larger numbers of non-productive assets, running water, and 10 or more years of farming experience. Factors that decrease food security include larger household sizes, and having experienced a climate-related crisis in the last 5 years. Our finding, that adaptation is welfare improving, is in line with a number of empirical studies that address the endogeneity issue in analyzing the welfare impacts of adaptation at the household level (e.g. Di Falco et al. 2011; Di Falco and Veronesi 2013).

These results also reflect a number of more specific contributions of this study. First, our study employs spatial or neighbour network effects to construct instrumental variables to address endogeneity of adaptation in food security models. Our proposed set of instruments (that are validated by under-identification and over-identification tests) offers researchers an additional identification strategy to analyze the welfare impacts of adaptation. We also show the importance of correcting for endogeneity in adaptation, in that our IV/GMM estimates of impacts of adaptation on food security are up to 4 times larger than estimates derived from models that do not correct for endogenous adaptation. The larger impact of adaptation on number of food secure days, after instrumenting for adaptation, demonstrates the importance of addressing endogeneity. Our results show that ignoring this identification challenge can underestimate the welfare contribution of adaptation.

Second, while earlier work has focused on case studies or farmers living in localized geographical regions, this paper uses a dataset that contains information on more than five thousand households located across 3 continents (Africa, Asia, and Central America) and 15 countries (Bangladesh, Burkina Faso, Costa Rica, Ethiopia, Ghana, India, Kenya, Mali, Mozambique, Nepal, Nicaragua, Niger, Senegal, Tanzania, and Uganda). This dataset substantially enhances the external validity of our findings and allows us to provide robust and generalizable estimates of welfare impacts of household-level adaptation.

Third, we investigate whether the impact of adaptation on household welfare differs depending on whether adaptation is motivated by changes in market conditions or climate change. Results indicate that adaptation motivated by climate change alone does not significantly impact food security, while adaptation done in response to market conditions is welfare enhancing. When adaptation is done in response to both climate variability and market conditions, our results indicate that an additional farming practice changed increases food security by approximately 7 days, which, when extrapolated over an average of approximately 13 activities, leads to an average effect of 96 food secure days (or 32% of their food security). These results suggest that households have been more successful at adapting to changing market conditions than in responding to climate change. Therefore, as impacts of climate change increase, in addition to policy approaches designed to increase adaptive capacity, it may be necessary to design targeted interventions (e.g. irrigation schemes, information dissemination) that complement the adaptive capacities of households.

Despite the robustness of our results, some cautionary notes are in order. First and foremost, our study (like most adaptation studies) relies on data derived from recall regarding behavioral changes over long periods. An alternative approach could be to design a randomized control trial, or a natural (quasi) experiment, that would measure more immediate changes in behavior (e.g. Duflo et al. 2011). However, the implementation of such methods in 15 countries would be challenging, and a smaller sample would limit the external validity of these approaches. Though we believe that the breadth of our sample is a strength, this contribution comes at a cost of lower resolution. For example, understanding heterogeneity in results across geographic regions and types of farming systems would provide useful information for policy development. Though initial inquiries into regional differences in adaptive behaviour have been investigated (Chen et al. 2018) much more work is needed.

In assessing food security effects on adaptation, it is challenging to develop econometric approaches for identifying causal impacts, such as finding valid instrumental variables to control for endogeneity. Several studies have used detailed data on social networks, and used social learning variables as instruments in identifying causal impacts of agricultural innovations. Unfortunately, our dataset has no social networks information. Instead, our approach is to construct instruments based on neighbor networks as defined by GPS coordinates. The outcome of such an approach is a general network variable - one that includes social learning and other types of networks. In our developing country settings, networks can play several roles, from information exchange to borrowing and risk sharing. Our use of this general network variable as an IV is only valid to the extent that memberships in such networks do not directly influence food security. Otherwise, our results represent correlations rather than causations.

Our approach requires spatial information. We use Global Positioning System coordinates to calculate distances between households, which is needed to build the weighting matrices and hence the instrumental variables. This requirement limits the application of this approach to existing datasets that contain spatial markers. Given Global Positioning System technology, which makes it increasingly cheaper and easier to collect such information, we suggest that collecting these coordinates could become standard practice when applying survey instruments, not only for network analysis, but for other uses such as maintaining options of relocating households to collect panel data. We also have little information about how changing market conditions and adaptation affect food security. Changing market conditions could include new market opportunities for smallholders that may require adaptation. But changing market conditions could also imply more volatility and price risks that could cause smallholders to adapt by moving away from activities involved with volatile prices. Both of these circumstances might encourage adaptive activities, but could result in different impacts on the food security of households. Future research could unpack more specific scenarios regarding changing market conditions, and investigate how different types of responses lead to differences in food security. Understanding these behaviours in the context of climate change risks would provide valuable information for understanding local behaviour and policy design.

Overall, our findings support economic concepts of rational households, who can be effective in adapting to changing circumstances in ways that attempt to ameliorate negative changes, thereby improving welfare. But for some types of newly emerging threats, such as climate change, these abilities to adapt may need to be complemented with carefully designed interventions, as data indicate that historic adaptation has not been clearly welfare improving. With further research in this area, we are hopeful that governments will be in a better position to design policies that not only promote better adaptive capacity, but also complement such capacity with developments that better enable the effectiveness of adaptation.