Abstract
Municipal governments, often in collaboration with utilities, have implemented a range of energy efficiency programs to encourage homeowners and businesses to adopt energy efficiency upgrades. Energy efficiency holds promise to reduce energy consumption, reduce greenhouse gas emissions, improve public health, and reduce energy bills. However, these programs often suffer from poor participation and have typically had limited success. In this analysis, we use novel data to understand the relationship between social norms, pro-environmental identity, and household finances to understand program participation and retrofit decision-making. We find that the variables that predict retrofit decision-making do not explain a household’s initial decision to contact an energy efficiency program. We suggest that the processes that drive households to contact energy efficiency programs—a necessary first step in improving energy efficiency—are different from the processes that explain why households decide to upgrade their homes.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Dietz et al. (2009), estimated that a combination of behavioral change and adoption of energy efficient technologies in the home could reduce total U.S. emissions by 7%. A large body of research has considered why people upgrade their homes—rooftop solar PV systems are one example that has received considerable attention. Households adopt solar systems in part because of pressure from social norms and the perceived expectations of neighborhoods (Allcott, 2011; Curtius et al., 2018), financial considerations (Langheim et al., 2014), concern for the environment (Schelly, 2010), and interest in new technologies (Palm, 2020). We know comparatively less about decision-making regarding other types of home upgrades, especially those that are less conspicuous than home solar installations.
In this paper, we integrate diverse strands of literature to evaluate what drives households’ decisions to participate in energy efficiency programs and upgrade their home energy systems. Specifically, we ask how a combination of social norms, debt aversion, and pro-environmental identity (described further below) explain participation in a municipal energy efficiency program and, ultimately, household’s decisions to upgrade their homes.
Background
Social norms
Social norms are unwritten, informal rules that are typically taken for granted yet govern behavior within a given social context. Social norms are emergent and are not easily manipulated by researchers, but several studies have documented efforts to shift social norms around energy consumption (Idahosa & Akotey, 2021). One of the most high-profile efforts to influence social norms around energy consumption was the OPOWER experiment, in which households were provided an informational treatment about the energy consumption of homes similar to theirs (Allcott, 2011; Horne & Kennedy, 2021; Schultz et al., 2007). Informational treatments are meant to create social norms about energy consumption and have likely reduced energy usage (Abrahamse & Steg, 2013; Harries et al., 2013).
These types of social norms are typically called descriptive norms because they provide a description of the typical behavior of others. Descriptive social norms do not define a behavior as good or bad—rather, descriptive social norms simply refer to the prevalence of a behavior. The implicit assumption of descriptive norm interventions is that, at least with regard to energy practices, people will feel normative pressure to reduce their energy usage to align with their neighbors or similar households. That is, descriptive social norm interventions establish a benchmark for what is typical or normal (Cialdini, 2007; Gerber & Rogers, 2009).
Injunctive social norms are those that we are all expected to follow and will receive a punishment or sanction for violating said norm. That is, injunctive social norms are perceived social pressures to perform (or not perform) certain behaviors—and the perception that failure to comply will result in some type of social punishment. Complying is perceived to have some type of social reward. Perceived punishments or rewards can range from very minor or quite severe—for some injunctive norms, the reward is no more than a sense of approval or endorsements from neighbors or peers. Some scholars use the term “personal norms” to refer to an internalized feeling of moral obligation to perform a task (Kleinschafer et al., 2021; Shi et al., 2019; Van der Werff et al., 2019).
Social norms are emergent and change over time. For instance, social norms around rooftop solar shift as more homes in a neighborhood or region adopt rooftop solar—through peer effects, installing solar begins to be seen as a normal and desirable decision the more households that adopt (Curtius et al., 2018; Scheller et al., 2022). Social norms are related to some energy efficiency decisions, such as the intention to purchase energy efficiency light bulbs (Bergquist & Nilsson, 2019), electric vehicles (Coffman et al., 2017; Jansson et al., 2017; Tran et al., 2012), and energy efficient appliances (Dieu-Hang et al., 2017).
Pro-environmental identity
Being environmentally conscious and behaving accordingly is often rooted in identity. That is, some people see themselves as a person who cares about the environment and feel that is important to engage in behaviors with environmental benefits (Whitmarsh and O’Neill, 2010). This pro-environmental identity is likely rooted in values that are formed during childhood and adolescence and unlikely to shift substantially over the life course (Van der Werff et al., 2014; Wang et al., 2021; Zeiske et al., 2021).
Several studies, notably most of which have been conducted in Europe, have linked pro-environmental identity to energy conservation behaviors or the adoption of energy efficiency technologies. Tu et al. (2021) evaluated survey data from eight European nations and found that pro-environmental identity was associated with more positive perceptions of smart meter technologies. Pro-environmental identity increases intentions to purchase energy efficient lightbulbs, cars, and household appliances (Berman Caggiano et al., 2021). In a Swedish sample, pro-environmental identity was associated with interest in and participation in a smart meter technologies (Van der Werff & Steg, 2016) and, using data from the Netherlands, Van der Werff et al. (2013) report that pro-environmental identity is related to a range of environmental behaviors, including the purchase of energy efficient light bulbs (see also Carfora et al., 2017; Dermody et al., 2015; Grębosz-Krawczyk et al., 2021). In addition to behaviors, pro-environmental identity is linked to support for energy efficiency policies (Faure et al., 2022). We are aware of no studies that link pro-environmental identity to household energy efficiency in the U.S.
We extend this work in new directions. First, a large portion of the literature relies upon self-reported behavioral intentions, interest in energy efficiency technologies, or similar measures that may not necessarily align with actual behavior. Further, studies tend to concentrate on specific technologies (e.g., smart meters)—a drawback of this approach is that not all homes may be candidates for the same technology. We build upon prior work using survey data by using validated energy efficiency program participation data. In the next section, we describe several factors that are likely related to energy efficiency upgrade decisions and that were investigated in this work.
Awareness of consequences
Awareness of consequences is the recognition of the positive or negative impacts of performing or not performing a behavior (Ryan & Spash, 2012; Stern et al., 1993). Awareness of consequences implicitly involves an ascription of responsibility, in which the individual decision maker assumes that their action will have some impact (De Groot & Steg, 2008; Lorenzoni et al., 2007; Van der Werff et al., 2013).
The awareness of consequences construct has been widely studied, with very consistent results across studies conducted at different time periods, for different outcome variables, and in varying political and social contexts. These include energy conservation behaviors in China (Al Mamun et al., 2022), Tunisia (Ibtissem, 2010), Vietnam (Duong, 2023), Kuwait (Alomari, 2021), and the Netherlands (Abrahamse & Steg, 2009) and intention to purchase energy efficient appliances, electric cars, or install solar panels in multiple contexts (e.g., Awais et al., 2022; He & Zhan, 2018; Klöckner et al., 2013; Wittenberg et al., 2018; Zhao et al., 2019). We adapt vetted measures to capture awareness of consequences, described further below.
Debt aversion and household finances
Fundamentally, energy efficiency upgrades are financial decisions. Households invest in energy upgrades in part because they hope that it may reduce their utility bills or provide other savings, in addition to other motivations (Alipour et al., 2020; Klöckner et al., 2013; Palm, 2020). To pay for upgrades, households rely upon some combination of cash payments, loans, and rebates.
Using a sample from eight European countries, Schleich et al. (2021) find that debt aversion is negatively associated with retrofit decisions, net of a range of controls. Households that are averse to taking on additional debt are less likely to update their homes, but debt aversion does not provide a full picture of the financial status of a household. Extending this literature, we argue that households, even those of a similar income, may find themselves in very different financial situations with regard to savings and overall financial satisfaction. We extend the prior research on debt aversion by assessing a household’s financial status, particularly the nature of a household’s savings.
Methods
Data collection
The current research is part of a larger study evaluating energy efficiency decision-making with a focus on an energy efficiency program sponsored by the city of Fort Collins, CO. This program, called Epic Homes, was designed to guide households through the process of receiving an energy assessment (at no or reduced cost), to locating contractors and financing, to filing for any relevant rebates. After a professional audit, participating households were provided with a report that detailed potential improvements to their homes and associated energy saving estimates and included a list of vetted contractors and their contact information to perform the work. The program also aided with locating financing and filing for rebates. The city and its municipal utility advertised the program.
Fort Collins sits about 45 miles north of Denver, CO, in the Front Range metropolitan area that includes several other medium-sized cities (Fort Collins at 170,000 people, Loveland at 77,000, Wellington and Windsor with a combined population of 42,000). Fort Collins hosts a large public university, several hospitals, and a diverse array of firms of various sizes in the technology, engineering, and energy sectors. The city has an aggressive climate mitigation plan and has actively encouraged renewable energy and energy efficiency for several years. Our results may be most applicable to other cities with similar characteristics but may not be as applicable to highly different metropolitan areas (e.g., large cities in the Southern U.S.). Many of the studies that most inform our work were conducted in Europe, so applying similar constructs to the U.S. context is warranted.
After IRB approval, we implemented a mixed-mode (e.g., multiple types of data collection) strategy for data collection. The city of Fort Collins provided email addresses for program participants (n = 1683), 310 of which were duplicates, and 136 were undeliverable (we were only able to repair 3 of the undeliverable email addresses). To create a group of non-participants, we contracted with Marketing Systems Group (MSG), a provider of sampling services. MSG provided 3321 email addresses believed to be associated with Fort Collins addresses; of these, 89 were duplicates, and 269 were undeliverable. MSG explained that their internal procedures could filter out many renters. We hosted an online survey on the Qualtrics platform, and we screened all respondents for age (i.e., over 18 years) and residence in the city of Fort Collins.
Nine-hundred and seventy-four respondents began the email survey, although fifty did not proceed beyond the screening question—that is, they did not answer a single question and just clicked on the link. Another 13 were disqualified by the screening question. Like our experience conducting other studies in this region, a non-trivial portion of respondents (about 50) answered most of the questions in the main portion of the survey but skipped demographic questions. We next implemented a hybrid push-to-web/drop-off pick-up mode by distributing the survey link to households via a door hanger. The door hanger strategy produced very modest results (n = 33). For the final model of data collection, we conducted a mailing of 4329 push-to-web cards (n = 109). More details about the data collection can be found in Mayer and Carter (2023).
Some 600 respondents answered most of the questions, although the regression models below use slightly less data (n = 523). Using 911 as the number of surveys that respondents began (the total number of respondents who navigated to the survey minus those that did not answer the screening question or were not eligible), the completion rate was 65.8%. Using a highly restrictive response rate calculation (AAPOR 1), the response rate was 9.37%—this estimate is consistent with our other research in the region. AAPOR definition 1 assumes that all non-responders were eligible to complete the survey; there are other less restrictive ways to calculate response rates that would have produced a higher estimate.
In the next section, we present the variables used in our analysis. We conducted factor analysis on some items and discuss these procedures below. We then proceed to the results of binary logistic regression models for program participation and performing a retrofit and provide effect size measures in the form of average marginal effects.
Dependent variables
We use two different dependent variables. The first captures whether the household participated in the energy efficiency program—for this variable, participation is defined broadly as contacting the program and expressing interest in an energy efficiency upgrade. Administrative records provided by the city of Fort Collins indicated that 58% of our initial sample, or 456 households, participated in the program. However, due to missing data from incomplete surveys (as described above, many respondents did not navigate beyond the first question), the number of valid cases used in the regression models below is much lower. We asked respondents if they had received an energy assessment and report and followed up by asking if they had made any changes in their home based upon the report. Thus, our second dependent variable is an indicator of whether the household followed any of the recommendations of the report, where 0 = did not make any changes to their home, and 1 = made a retrofit. Tables 1 and 2 provide the distribution of these variables disaggregated by each predictor. Appendix Figs 2, 3, 4 and Tables 5, 6 and 7 shows the distribution of the key predictor variables and the associated factor analyses, when applicable.
Personal and social norms
To capture norms, we adapted a series of questions used by Abrahamse and Steg (2009) and many others (e.g., Fang et al., 2017; Gholamrezai et al., 2021; Groh & Ziegler, 2022). For social norms, we used the following questions: “Many of my relatives or friends would adopt or have already adopted solutions for improving the energy efficiency of their homes,” “Many of my neighbors would adopt or have already adopted solutions for improving the energy efficiency of their homes,” “Most of the people important to me would approve if I improve the energy efficiency of my home,” and “Most of my neighbors would approve if I improve the energy efficiency of my home.” These items use a 5-category Likert-type scale. For personal norms, we used the following question: “I feel good about myself if I invest in improving energy efficiency in my home.”
Next, we estimated a factor analysis on a polychoric correlation matrix using the iterated principal factors method for extraction. This produced a single factor solution with an eigenvalue of 2.614, with all variable loading in excess of 0.7 on the first factor—the first factor accounted for 79% of the inter-item variation (Appendix Table 5). Although these questions were meant to capture two distinct but related constructs—social norms and personal norms—the factor analysis implies that a single dimension underlies these items. We calculated a factor score that we use as a predictor in Model 2, Table 3, and Model 2, Table 4.
Pro-environmental identity
We use an established indicator of pro-environmental identity (Van der Werff et al., 2013; Wang et al., 2021) that has been adapted for studies of energy behaviors and decision-making (Tu et al., 2021). To evaluate the dimensionality of these items, we again turned to factor analysis using a polychoric correlation matrix and the iterated principal factors method for extraction (Holgado-Tello et al., 2010; Kiwanuka et al., 2022). The factor analysis produced an eigenvalue of 3.315 for the first factor, with all variables loading above 0.4, implying a single factor solution (Appendix Table 6). We use the resulting factor score as a predictor in the third model in Table 3 and 4.
Debt aversion
We borrow a series of questions from Schleich et al. (2021) to capture aversion to debt. Respondents were asked to rate if the following statements described them: “If I have debts, I like pay them as soon as possible,” “If I have debts, I prefer to delay paying them if possible, even if it means paying more in total,” “If I have debts, it makes me feel uncomfortable,” “If I have debts, it doesn’t bother me,” “I dislike borrowing money,” “I feel OK borrowing money for essential purchases e.g. Cars, appliances, mortgage, “I enjoy being able to borrow money to buy things I like, and to pay for things I cannot afford.”
Like our prior constructs, we estimated a polychoric correlation matrix and extracted factors using the iterated principal factors method with a varimax rotation. Our factor analysis suggested a two-factor solution, although the first item (“If I have debts, I like to pay them”) did not load strongly on any factor and the second to last item (“I feel OK borrowing money for essential purchases e.g. Cars, appliances, mortgage”) was the only variable that loaded on the third factor. Our results may diverge from Schleich et al. (2021) for a few reasons. First, they tallied the items and used Cronbach’s alpha to assess their inter-item reliability—factor analysis is a more flexible method of dimension reduction that sometimes reveals additional complexity. Further, Schleich et al., 2021 data comes from Sweden and our somewhat different results may reflect cultural differences between the U.S. and Sweden. We elected to retain two factors, the first of which corresponds to debt aversion, and the second of which responds to debt acceptance. These factor scores were used in Model 3, Table 3, and Model 3, Table 4.
Financial status
To gauge the financial status of households beyond their aversion or acceptance to debt, we also asked the following question: “Have you set aside emergency or rainy day funds that would cover your expenses for 3 months, in case of sickness, job loss, economic downturn, or other emergencies?”—respondents could answer “yes” or “no.”
We developed a few unique questions to further assess the ability of a household to pay for an energy retrofit. We asked: “Imagine that your home needs a $2000 repair to fix a problem. The problem is not an emergency but needed to keep your home in good working order and avoid future problems. How would you pay for this repair?” with the following response categories: “I would ask my landlord to do it,” “I would not make the repair,” “I would pay for it with savings,” “I would borrow money from friends or family,” “I would take out a loan,” “I would charge it to my credit card,” or an “other” category.Footnote 1 We recoded this variable into two categories (0 = all other categories, 1 = I would pay for it with savings).
We followed this question but specified that it was an emergency repair, using the same response categories: “Imagine that your home needs a $2000 emergency repair. How would you pay for this repair?” Again, we recoded this variable such that 0 = all other categories and 1 = savings. These predictors were used as predictors in Models 4 and 5 in Table 3 and 4.
Awareness of consequences
From prior research, we adopted an awareness of consequences scale tailored to energy (e.g., (De Groot & Steg, 2008; Ryan & Spash, 2012). Respondents answered the following questions using a give item Likert-type scale: “Using renewable energy is good for the environment,” “Improving the energy efficiency of my home is good for the environment,” and “Improving the energy efficiency of my home is good for the health of my family.” Our factor analysis of a polychoric correlation matrix strongly pointed to a single factor solution (eigenvalue = 2.352, 90% of variance accounted for, factor loadings all more than 0.8). We estimated an awareness of consequences factor score to use in our analysis. We entered this variable as a predictor in the seventh model for each outcome. In Table 1 and 2, we provide descriptive statistics for the variables, disaggregated by program participation (Table 1) and whether the home made a retrofit (Table 2).
Results
Both of our indicators are binary. Binary logistic regression is a well-established approach to model the effect of a series of predictors on a binary outcome. Our data presented an additional complication. Three constructs—pro-environmental identity, social norms, and awareness of consequences—were highly collinear (variance inflation factors (VIFs) and were 8.14, 12.12, and 27.58, respectively). We suspect that this degree of collinearity would bias our results towards the null, and perhaps mask important effects. We opt to estimate unique models for each one of these constructs and compare Akaike Information Criteria (AIC) and Bayesian Information Criteria (BIC) across models to determine which variable provides the best fit. We start with a “controls only” model, and then estimate models separately for social norms, debt aversion and acceptance, and awareness of consequences. We conclude with a series of robustness checks.Footnote 2
Table 3 provides the binary logistic regression results for the program participation outcome—that is, did the household contact the program, or not. We begin with Model 2, which adds social norms to the demographic variables from Model 1. Social norms are not statistically significant, and the AIC and BIC statistics are both larger, implying that the inclusion of the social norm factor score has worsened model fit. In Model 3, we drop social norms and add in the factor score for pro-environmental identity, which is not statistically significant and, according to the BIC statistic, has not improved model fit. In Model 4, we place pro-environmental identity with the factor scores for debt aversion and debt acceptance, which again are not statistically significant. In Model 5, we drop the indicators for debt aversion and debt acceptance and add the variables for rainy day funds and non-emergency repairs—as with prior predictors, these are not statistically significant. Model 6 replaces non-emergency repair with our variable for emergency repair. Consistent with prior models, it is not statistically significant. Finally, in Model 7, we add in the variable for awareness of consequences, which is not significant and, compared to Model 1, does not result in an improved AIC and BIC statistic.
Overall, our results imply that many known predictors of energy efficiency upgrade decisions or environmental behaviors do not predict whether the household contacted the energy efficiency program. There is a consistent effect of female sex wherein females are more apt to state that their household contacted the program, and in some models, there is evidence of differences between liberals and conservatives. We return to these findings in the discussion.
Table 4 provides the results of the binary logistic regression models for home retrofits—that is, did the household follow any of the guidelines of their energy audit report and make upgrades. In Model 2, we add the factor score for social norms to the demographics-only specification from Model 1 and find that it improves model fit (both the AIC and BIC have decreased), and it is statistically significant (b = − 0.378, p < 0.05). In Model 3, pro-environmental identity emerges as statistically significant, and the inclusion of this variable has decreased the AIC but increased the BIC over Model 1, providing mixed evidence of improved model fit. In Model 4, we add in the scales for debt aversion and debt acceptance, neither of which approach statistical significance. In the next model (Model 5), we drop these variables for the rainy-day funds and emergency funds indicators, which are also not statistically significant, and do not improve model fit over Model 1. Finally, we find a statistically significant effect of awareness of consequences in Model 7. Our survey also included questions about specific types of retrofits, we provide modelling results for these questions in Appendix 5.
Average marginal effects
Binary logistic regression models such as those we estimate in this analysis produce coefficients that are not readily interpretable. For this reason, many methodologists recommend using average marginal effects, probabilities, or similar statistics to render modelling results more intuitive (Brambor et al., 2006; Howell‐Moroney, 2023; Mood, 2010). In Fig. 1, we provide average marginal effects (AMEs) derived from the coefficients reported in Table 3 and 4. AMEs are advantageous because of their straightforward interpretation on the probability scale. For instance, the AME of − 0.085 for “Energy Saving Identity” under “Home Retrofits” indicates that the probability of performing a retrofit decreases by 0.085 (or 8.5 percentage points) for every one unit increase in the Energy Saving Identity scale. Notably, awareness of consequences has perhaps the most substantial effect on home retrofit decisions (AME = 0.15). Given that the awareness of consequences scale has a range of almost 4 (i.e., the difference between the highest and lowest score), the total effect could be as large as some 0.6. That is, the difference probability of performing a home retrofit between a person who had no awareness of consequences and one who had the highest awareness is roughly 0.6, implying that awareness of consequences is among the more powerful predictors.
Robustness checks
We also performed a series of robustness checks that we provide in appendices. Many of the predictors identified in the prior literature on energy efficiency and environmental behaviors were not statistically significant in our models, but our sample size is smaller than some other studies, some of which have thousands of observations. In Appendix Tables 8, 9 and 10 and Figs 6, 7, we provide a series of simulations wherein we doubled the size of our sample repeatedly and re-ran the models. We find that debt aversion, debt acceptance, and social norms become statistically significant predictors of program participation with more data, but pro-environmental identity does not become statistically significant even with vast increases in the number of cases. For retrofit decisions (i.e., the dependent variable used in Table 4), we find that a doubling of the sample size renders all predictors statistically significant. Thus, some of the divergence between our work and prior research occurs because those studies have used much larger samples and hence were able to detect statistical significance of the results.
As an additional robustness check, we conducted a multiverse analysis. The logic of this approach is that any researcher chooses to report one model that comes from a wide universe of potential model specifications. The multiverse approach involves estimating hundreds, sometimes even thousands, of alternative model specifications with different control variables, or even functional form transformations and higher order interaction terms. In our application, we re-estimated the models from Table 3 and 4 with varying combinations of predictors, and we plot the coefficients of the predictor of interest across model specifications. We also calculate the percentage of models in which the predictor of interest is statistically significant and wherein the sign of the coefficient has the same direction (i.e., positive or negative). Appendix Tables 8, 9 and 10 and Figs 6, 7, shows a relative robustness for the program participation results—the effects that are statistically significant are consistently so in the multiverse of models. For the retrofit decision, we find that social norms, pro-environmental identity, and awareness of consequences are uniquely robust and consistent predictors.
Discussion
The purpose of this paper was to extend prior research on energy efficiency program participation using several known predictors. We considered a comprehensive energy efficiency program for households in Fort Collins, CO, using original survey data.
We found that many well-documented predictors of environmental behaviors and energy efficiency upgrade decisions did not predict a household’s decision to make the initial contact with the program. Social norms, pro-environmental identity, awareness of consequences, and debt aversion had statistically null effects and did not improve model fit. Although we respect than many analysts would prefer to see large, statistically significant findings, our perspective is that these null results are informative (Abadie, 2020). The bulk of the literature considers outcomes such as the decision to install a specific home retrofit, and there is a related literature on environmental behaviors that employs similar constructs. However, there is much less work on the initial decision to contact and energy efficiency program. We suggest that this decision may be different enough from other decisions, such as the choice to upgrade a home, that it may require its own model. That is, the factors that predict contact with an energy efficiency program may not be the same as those that predict the likelihood of making a retrofit. Given that contacting a program is often the first step towards energy efficiency, more research on what drives homes to contact programs is warranted.
For instance, we found that social norms have a null effect (i.e., an effect that is not statistically significant) on the initial step of contacting the energy efficiency program. This null finding could have emerged because there is a cognitive disconnect between the program and energy efficiency and social norms in the minds of our respondents. Perhaps they did not recognize that it was a program that could address their concerns regarding energy efficiency, even if it was advertised as such. That is, although households may have faced some pressure from social norms to improve their energy efficiency, they may not have recognized that the Epic Homes program was a route to do so.
Or perhaps there were other barriers that kept households from contacting the programs that are simply not well understood at this point. Qualitative research with candidate households who elect not to participate should be conducted in the future.
The muted effects of our financial variables deserve further discussion. Energy efficiency upgrades involve cost–benefit calculations for households, and some households may need loans to pay for them. However, we found that debt aversion, debt acceptance, and our variables for savings had null effects in all our models, including those that were focused on whether the household follow any of the guidelines of their energy audit report and make upgrades. These effects may have been statistically significant in a larger sample (as we demonstrated in series of simulations wherein we doubled the size of our sample repeatedly and re-ran the models), but even so, the effect sizes are not large in practical terms (see Appendix Figs 2, 3, 4 and Tables 5, 6 and 7). We can only offer informed speculations on this surprising finding. For one, Fort Collins, CO, has relatively expensive housing stock and our sample skews more affluent—many of our respondents may have had significant home equity that could effectively fund upgrades. Perhaps for this reason, norms and identity variables tend to be more powerful influences while financial variables have less of an effect. Further, some research identifies a conflict between intrinsic (e.g., social norms and identity) motivations and extrinsic (i.e., cost savings) motivations for energy efficiency (Pellerano et al., 2017) and non-monetary incentives are likely stronger motivators of energy saving behaviors (Mi et al., 2021). Perhaps a similar dynamic was at play in our work, wherein our sample was more motivated by extrinsic factors and non-monetary concerns. Notably, pro-environmental identity also does not approach statistical significance, even at large sample sizes.
As with all research, the current study has both strengths and weaknesses. A strength of this study is the breadth of constructs that we were able to measure, and our usage of two different dependent variables provides a more complete picture of energy efficiency program participation. We employed several constructs that had mostly been used in European research and had not been applied to the U.S. We did not model how the upgrades that households chose to implement coincided with their reports or did not. That is, did households follow all the recommendations, or only some, and why did they choose some over others? These questions can be answered with follow up research.
Conclusion and policy implications
This study has multiple implications that should be of interest to policymakers. For one, we found that factors like social norms and pro-environmental identity do not meaningfully predict whether a household contacted the energy efficiency program. This implies that program promoters cannot rely heavily upon social norms or appealing to pro-environmental identity to encourage households to take the initial step of contacting the program, although these variables may be useful to encourage interested households to complete the program. One possibility to improve program participation is to connect candidate households—that is, homes that are in need of energy efficiency upgrades—to energy counseling services, rather than waiting for homes to contact energy efficiency programs (Murto et al., 2019).
Notes
Forty-eight respondents chose the “other” category, but those responses cannot be reduced into fewer categories in any logical way. Two stated that they would use a HELOC or home equity loan, some provided ambiguous responses (e.g., “I would work it out”) and one stated “none of your business.”.
We do not include race in our models because of the lack of variability in this data. A strong majority of the sample is white, in line with the demographics of Fort Collins, CO.
References
Abadie, A. (2020). Statistical nonsignificance in empirical economics. American Economic Review: Insights, 2(2), 193–208.
Abrahamse, W., & Steg, L. (2009). How do socio-demographic and psychological factors relate to households’ direct and indirect energy use and savings? Journal of Economic Psychology, 30(5), 711–720.
Abrahamse, W., & Steg, L. (2013). Social influence approaches to encourage resource conservation: A meta-analysis. Global Environmental Change, 23(6), 1773–1785.
Al Mamun, A., Hayat, N., Mohiuddin, M., Salameh, A. A., Ali, M. H., & Zainol, N. R. (2022). Modelling the significance of value-belief-norm theory in predicting workplace energy conservation behaviour. Frontiers in Energy Research, 10, 940595.
Alipour, M., Salim, H., Stewart, R. A., & Sahin, O. (2020). Predictors, taxonomy of predictors, and correlations of predictors with the decision behaviour of residential solar photovoltaics adoption: A review. Renewable and Sustainable Energy Reviews, 123, 109749.
Allcott, H. (2011). Social norms and energy conservation. Journal of Public Economics, 95(9–10), 1082–1095.
Alomari, M. M. (2021). Analysis of energy conservation behavior at the Kuwaiti academic buildings. International Journal of Energy Economics and Policy, 11, 219–232.
Awais, M., Fatima, T., & Awan, T. M. (2022). Assessing behavioral intentions of solar energy usage through value-belief-norm theory. Management of Environmental Quality: An International Journal, 33(6), 1329–1343.
Bergquist, M., & Nilsson, A. (2019). The DOs and DON’Ts in social norms: A descriptive don’t-norm increases conformity. Journal of Theoretical Social Psychology, 3(3), 158–166.
Berman Caggiano, H., Kumar, P., Shwom, R., Cuite, C., & Axsen, J. (2021). Explaining green technology purchases by US and Canadian households: The role of pro-environmental lifestyles, values, and environmental concern. Energy Efficiency, 14(5), 46.
Brambor, T., Clark, W. R., & Golder, M. (2006). Understanding interaction models: Improving empirical analyses. Political Analysis, 14(1), 63–82.
Carfora, V., Caso, D., Sparks, P., & Conner, M. (2017). Moderating effects of pro-environmental self-identity on pro-environmental intentions and behaviour: A multi-behaviour study. Journal of Environmental Psychology, 53, 92–99.
Cialdini, R. B. (2007). Descriptive social norms as underappreciated sources of social control. Psychometrika, 72(2), 263.
Coffman, M., Bernstein, P., & Wee, S. (2017). Electric vehicles revisited: A review of factors that affect adoption. Transport Reviews, 37(1), 79–93.
Curtius, H. C., Hille, S. L., Berger, C., Hahnel, U. J. J., & Wüstenhagen, R. (2018). Shotgun or snowball approach? Accelerating the diffusion of rooftop solar photovoltaics through peer effects and social norms. Energy Policy, 118, 596–602.
De Groot, J. I., & Steg, L. (2008). Value orientations to explain beliefs related to environmental significant behavior: How to measure egoistic, altruistic, and biospheric value orientations. Environment and Behavior, 40(3), 330–354.
Dermody, J., Hanmer-Lloyd, S., Koenig-Lewis, N., & Zhao, A. L. (2015). Advancing sustainable consumption in the UK and China: The mediating effect of pro-environmental self-identity. Journal of Marketing Management, 31(13–14), 1472–1502.
Dietz, T., Gardner, G. T., Gilligan, J., Stern, P. C., & Vandenbergh, M. P. (2009). Household actions can provide a behavioral wedge to rapidly reduce US carbon emissions. Proceedings of the National Academy of Sciences, 106(44), 18452–18456.
Dieu-Hang, T., Grafton, R. Q., Martínez-Espiñeira, R., & Garcia-Valiñas, M. (2017). Household adoption of energy and water-efficient appliances: An analysis of attitudes, labelling and complementary green behaviours in selected OECD countries. Journal of Environmental Management, 197, 140–150.
Duong, C. D. (2023). Using a unified model of TPB, NAM and SOBC to understand students’ energy-saving behaviors: Moderation role of group-level factors and media publicity. International Journal of Energy Sector Management, 18(1), 71–93.
Fang, W.-T., Ng, E., Wang, C.-M., & Hsu, M.-L. (2017). Normative beliefs, attitudes, and social norms: People reduce waste as an index of social relationships when spending leisure time. Sustainability, 9(10), 1696.
Faure, C., Guetlein, M.-C., Schleich, J., Tu, G., Whitmarsh, L., & Whittle, C. (2022). Household acceptability of energy efficiency policies in the European Union: Policy characteristics trade-offs and the role of trust in government and environmental identity. Ecological Economics, 192, 107267.
Frank, K. A., Maroulis, S. J., Duong, M. Q., & Kelcey, B. M. (2013). What would it take to change an inference? Using Rubin’s causal model to interpret the robustness of causal inferences. Educational Evaluation and Policy Analysis, 35(4), 437–460.
Frank, K. A., & Xu, R. (2017). KONFOUND: Stata module to quantify robustness of causal inferences.
Gatersleben, B., Murtagh, N., & Abrahamse, W. (2014). Values, identity and pro-environmental behaviour. Contemporary Social Science, 9(4), 374–392.
Gerber, A. S., & Rogers, T. (2009). Descriptive social norms and motivation to vote: Everybody’s voting and so should you. The Journal of Politics, 71(1), 178–191.
Gholamrezai, S., Aliabadi, V., & Ataei, P. (2021). Understanding the pro-environmental behavior among green poultry farmers: Application of behavioral theories (pp. 1–19). Development and Sustainability: Environment.
Grębosz-Krawczyk, M., Zakrzewska-Bielawska, A., & Flaszewska, S. (2021). From words to deeds: The impact of pro-environmental self-identity on green energy purchase intention. Energies, 14(18), 5732.
Groh, E. D., & Ziegler, A. (2022). On the relevance of values, norms, and economic preferences for electricity consumption. Ecological Economics, 192, 107264.
Harries, T., Rettie, R., Studley, M., Burchell, K., & Chambers, S. (2013). Is social norms marketing effective? A case study in domestic electricity consumption. European Journal of Marketing, 47(9), 1458–1475.
He, X., & Zhan, W. (2018). How to activate moral norm to adopt electric vehicles in China? An empirical study based on extended norm activation theory. Journal of Cleaner Production, 172, 3546–3556.
Holgado-Tello, F. P., Chacón-Moscoso, S., Barbero-García, I., & Vila-Abad, E. (2010). Polychoric versus Pearson correlations in exploratory and confirmatory factor analysis of ordinal variables. Quality & Quantity, 44(1), 153.
Horne, C., & Kennedy, E. H. (2021). Understanding the rebound: Normative evaluations of energy use in the United States. Environmental Sociology, 1–9.
Howell‐Moroney, M. (2023). Inconvenient truths about logistic regression and the remedy of marginal effects. Public Administration Review, puar.13786. https://doi.org/10.1111/puar.13786
Ibtissem, M. H. (2010). Application of value beliefs norms theory to the energy conservation behaviour. Journal of Sustainable Development, 3(2), 129.
Idahosa, L. O., & Akotey, J. O. (2021). A social constructionist approach to managing HVAC energy consumption using social norms–A randomised field experiment. Energy Policy, 154, 112293.
Jansson, J., Nordlund, A., & Westin, K. (2017). Examining drivers of sustainable consumption: The influence of norms and opinion leadership on electric vehicle adoption in Sweden. Journal of Cleaner Production, 154, 176–187.
Kiwanuka, F., Kopra, J., Sak-Dankosky, N., Nanyonga, R. C., & Kvist, T. (2022). Polychoric correlation with ordinal data in nursing research. Nursing Research, 71(6), 469–476.
Kleinschafer, J., Morrison, M., & Oczkowski, E. (2021). The relative importance of household norms for energy efficient behavior. International Journal of Consumer Studies, 45(5), 1117–1131. https://doi.org/10.1111/ijcs.12639
Klöckner, C. A., Nayum, A., & Mehmetoglu, M. (2013). Positive and negative spillover effects from electric car purchase to car use. Transportation Research Part d: Transport and Environment, 21, 32–38.
Langheim, R., Arreola, G., & Reese, C. (2014). Energy efficiency motivations and actions of California solar homeowners. Proceedings of the 2014 ACEEE Summer Study on Energy Efficiency in Buildings, 7, 147–59.
Lorenzoni, I., Nicholson-Cole, S., & Whitmarsh, L. (2007). Barriers perceived to engaging with climate change among the UK public and their policy implications. Global Environmental Change, 17(3–4), 445–459.
Mayer, A., & Carter, E. (2023). Web survey door hangers were ineffective in survey recruitment. Survey Practice, 16(1). https://www.surveypractice.org/article/89985-web-survey-door-hangers-were-ineffective-in-survey-recruitment. Accessed 26 February 2024
Mi, L., Gan, X., Sun, Y., Lv, T., Qiao, L., & Xu, T. (2021). Effects of monetary and nonmonetary interventions on energy conservation: A meta-analysis of experimental studies. Renewable and Sustainable Energy Reviews, 149, 111342.
Mood, C. (2010). Logistic regression: Why we cannot do what we think we can do, and what we can do about it. European Sociological Review, 26(1), 67–82.
Murto, P., Jalas, M., Juntunen, J., & Hyysalo, S. (2019). The difficult process of adopting a comprehensive energy retrofit in housing companies: Barriers posed by nascent markets and complicated calculability. Energy Policy, 132, 955–964.
Palm, A. (2020). Early adopters and their motives: Differences between earlier and later adopters of residential solar photovoltaics. Renewable and Sustainable Energy Reviews, 133, 110142.
Pellerano, J. A., Price, M. K., Puller, S. L., & Sánchez, G. E. (2017). Do extrinsic incentives undermine social norms? Evidence from a field experiment in energy conservation. Environmental and Resource Economics, 67, 413–428.
Ryan, A. M., & Spash, C. L. (2012). The awareness of consequences scale: An exploration, empirical analysis, and reinterpretation. Journal of Applied Social Psychology, 42(10), 2505–2540.
Scheller, F., Graupner, S., Edwards, J., Weinand, J., & Bruckner, T. (2022). Competent, trustworthy, and likeable? Exploring which peers influence photovoltaic adoption in Germany. Energy Research & Social Science, 91, 102755.
Schelly, C. (2010). Testing residential solar thermal adoption. Environment and Behavior, 42(2), 151–170.
Schleich, J., Faure, C., & Meissner, T. (2021). Adoption of retrofit measures among homeowners in EU countries: The effects of access to capital and debt aversion. Energy Policy, 149, 112025.
Schultz, P. W., Nolan, J. M., Cialdini, R. B., Goldstein, N. J., & Griskevicius, V. (2007). The constructive, destructive, and reconstructive power of social norms. Psychological Science, 18(5), 429–434.
Shi, D., Wang, L., & Wang, Z. (2019). What affects individual energy conservation behavior: Personal habits, external conditions or values? An empirical study based on a survey of college students. Energy Policy, 128, 150–161.
Stern, P. C., Dietz, T., & Kalof, L. (1993). Value orientations, gender, and environmental concern. Environment and Behavior, 25(5), 322–348.
Tran, M., Banister, D., Bishop, J. D., & McCulloch, M. D. (2012). Realizing the electric-vehicle revolution. Nature Climate Change, 2(5), 328–333.
Tu, G., Faure, C., Schleich, J., & Guetlein, M.-C. (2021). The heat is off! The role of technology attributes and individual attitudes in the diffusion of Smart thermostats–findings from a multi-country survey. Technological Forecasting and Social Change, 163, 120508.
Van der Werff, E., & Steg, L. (2016). The psychology of participation and interest in smart energy systems: Comparing the value-belief-norm theory and the value-identity-personal norm model. Energy Research & Social Science, 22, 107–114.
Van der Werff, E., Steg, L., & Keizer, K. (2013). It is a moral issue: The relationship between environmental self-identity, obligation-based intrinsic motivation and pro-environmental behaviour. Global Environmental Change, 23(5), 1258–1265.
Van der Werff, E., Steg, L., & Keizer, K. (2014). I am what I am, by looking past the present: The influence of biospheric values and past behavior on environmental self-identity. Environment and Behavior, 46(5), 626–657.
Van der Werff, E., Taufik, D., & Venhoeven, L. (2019). Pull the plug: How private commitment strategies can strengthen personal norms and promote energy-saving in the Netherlands. Energy Research & Social Science, 54, 26–33.
Wang, X., Van der Werff, E., Bouman, T., Harder, M. K., & Steg, L. (2021). I am vs. we are: how biospheric values and environmental identity of individuals and groups can influence pro-environmental behaviour. Frontiers in Psychology, 12, 618956.
Whitmarsh, L., & O’Neill, S. (2010). Green identity, green living? The role of pro-environmental self-identity in determining consistency across diverse pro-environmental behaviours. Journal of Environmental Psychology, 30(3), 305–314.
Wittenberg, I., Blöbaum, A., & Matthies, E. (2018). Environmental motivations for energy use in PV households: Proposal of a modified norm activation model for the specific context of PV households. Journal of Environmental Psychology, 55, 110–120.
Xu, R., Frank, K. A., Maroulis, S. J., & Rosenberg, J. M. (2019). konfound: Command to quantify robustness of causal inferences. The Stata Journal, 19(3), 523–550.
Zeiske, N., Venhoeven, L., Steg, L., & van der Werff, E. (2021). The normative route to a sustainable future: Examining children’s environmental values, identity and personal norms to conserve energy. Environment and Behavior, 53(10), 1118–1139.
Zhao, C., Zhang, M., & Wang, W. (2019). Exploring the influence of severe haze pollution on residents’ intention to purchase energy-saving appliances. Journal of Cleaner Production, 212, 1536–1543.
Funding
We thank the city of Fort Collins, the Bloomberg Foundation Mayors Challenge, and the JPB Foundation Harvard Environmental Health Fellowship for providing support for this research.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix 1. Descriptive statistics and factor analysis
Social norms
Pro-environmental identity
Debt aversion and debt acceptance
Appendix 2. Average marginal effects for specific retrofits
We also asked respondents to report on what upgrades they made to their home. Response categories included: rooftop solar, heating upgrades, air conditioning upgrades, window and door sealing, and insulation. The question also included and “other” category and the option for respondents to write their “other” retrofit into a text box. The responses for the “other” category were too different from each other to be grouped effectively and hence we did not use the data for the “other” response category.
We estimated a series of binary logistic regression models for each outcome, using the model specifications from Table 2 and 3 (that is, the same combination of predictor variables). For each model, we calculated average marginal effects for the predictor of interest, like our approach in the main text. We provide these average marginal effects in Fig. 5 above. Overall, our results imply that, for many specific retrofits, the predictors are not statistically significant and have substantively small effects. However, awareness of consequences does predict improvements in insulation and the adoption of rooftop solar.
Appendix 3. Robustness checks
As shown in our regression models, some variables that were statistically significant in other papers (using other data, of course) were not consistently statistically significant in our models. Yet, compared to some work, our sample sizes are smaller. For instance, pro-environmental identity was statistically significant in multiple papers (e.g., Gatersleben et al., 2014; Schleich et al., 2021; Whitmarsh and O’Neill, 2010). To determine if a difference in sample size explains the divergence between our work and prior research, we conducted a series of simulations wherein we increased the size of our dataset by duplicating observations and then re-running the models in Table 3 and 4 for both the participation and the retrofit dependent variables. Appendix Table 8 shows the results of these simulations. The simulations suggest that, for program participation, pro-environmental identity was not statistically significant even when the sample size is much larger. The null effect is robust to a larger sample size. On the other hand, our indicator for emergency repair would cross the alpha = 0.05 threshold at three times the current sample size (i.e., roughly 1800 cases) while the indicator for emergency repair would only become statistically significant at n*7. Overall, the simulations for program participation imply that our results may diverge from other studies because these studies used larger samples that contributed to smaller standard errors and smaller p values.
The second panel of the table shows sample size simulations for the retrofit outcome variable. For this variable, most of the predictors of interest were statistically significant, so the results of the simulations are perhaps less substantively interesting. Still, in the interest of transparency, we present these results.
Konfound analysis
Next, we turn to the konfound method. In the current application, konfound estimates the degree of measurement error (e.g., replaced with a case with no effect, or with an effect) that would be required to invalidate an inference—that is, to render a statistically significant effect non-significant (at alpha = 0.05) and to change a non-significant effect to statistically significant (Frank & Xu, 2017; Frank et al., 2013; Xu et al., 2019). Appendix Table 9 shows the percentage of cases that would have to be measured with error to change the inference. These estimates are derived from the regression models presented in Table 3 and 4.
For program participation, we find that social norms (which were not statistically significant) could become significant with a relatively small amount of measurement error, but the effect of pro-environmental identity could only be statistically significant if a strong majority of the cases were measured with error (83.34%)—a scenario that is dubious. The non-significant effect of rainy day funds is comparatively less robust (7.94%). Overall, the konfound analysis for program participation implies that some predictors are less robust than others, although most inferences would require a non-trivial amount of measurement error to change the inference.
For retrofits, social norms were statistically significant but not highly robust (11.01%) while pro-environmental identity was somewhat more robust (24.32%). Non-emergency repairs, which were not statistically significant, also exhibit a relatively low level of robustness to measurement error (14.18%) while awareness of consequences was slightly more robust (20.67%).
Multiverse analysis
Appendix Table 10 provides the percentage of multiverse models wherein the predictor of interest takes the same sign (i.e., positive or negative) and is statistically significant. As we noted in the main text, the nulls effects reported in Table 3 appear to be robust. That is, they do not change to non-null under alternative model specifications, and our reported models do not appear to be unusual outlier models wherein the effects are not statistically significant. Appendix Fig. 6 provides a graphical distribution of the multiverse of coefficients, and a dashed line to represent the coefficient reported in Table 3. Appendix Fig. 7 suggests that pro-environmental identity, social norms, and awareness of consequences are highly robust and exhibit strong sign stability. Further, most of the non-significant predictors from Table 4 are rarely significant in a multiverse of models.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Mayer, A., Carter, E. Social norms, pro-environmental identity, and finances: what motivates households to participate in energy efficiency programs?. Energy Efficiency 17, 30 (2024). https://doi.org/10.1007/s12053-024-10211-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s12053-024-10211-2