1 Background and introduction

The ongoing global crisis and the rising headwinds to growth and occupation have wiped out years of economic, financial and social progress for the entire world economy (ILO 2014). With the real GDP falling by 4% in 2009, industrial production dropped back to the levels of the 1990s, and there was a heavy price paid in terms of losses of jobs (Blanchard 2003), skills (Greenstone and Looney 2011), working hours and earnings (Eurofound 2012; De Beer 2012) in most EU Member States (European Commission 2013). Youth unemployment was 21.8%, and the total jobless rate was the highest since records began (Eurostat 2013).

The crisis is likely to leave deep traces on the economic performance of each country even though its impact on employment, income distribution and inequality (Tóth 2014) varies considerably by country, and within the same country, workers with varying levels of skills suffer with different intensity (Eurofound 2015). Many researchers have inspected the evolution over time and space of income inequality and how it plays out in alternative institutional contexts (Alesina and Rodrik 1994; Piketty 2003; Abel and Deitz 2012; Tóth 2014). Since the 1970s and after a lengthy period of stability, inequality in the United States has significantly grown along the entire income distribution (Juhn et al. 1993; DiNardo et al. 1996; Piketty and Saez 2003) giving rise to what Noah (2013) defines as the Great Divergence. Similar trends also appear in Europe as a whole. However, it is necessary to make specific evaluations for each country because the general growth of inequality has characterised the European States to different extents, timings, and intensities (Acemoglu 2002). Many drivers may be contributing to this trend in income inequality, which is particularly affected by the earnings from work (OECD 2015), and reflects the position of individuals in the labour market, their skills and opportunities, and the returns that they receive (Tóth 2014).

Despite the general feeling that inequalities are at a historic high either as a consequence of the recession or as the prime reason for the slow recovery (Stiglitz 2013), income inequality has increased markedly since the mid-1980s (European Parliament 2015; Krugman 2013) and has involved even the most egalitarian countries of Northern Europe (Blomgren and Kangas 2014; Fritzell et al. 2014; OECD 2011a; Tóth 2014). In this respect, at least three of the five headline goals of the Europe 2020 strategy for smart, sustainable and inclusive growth—employment rate (75% for 20- to 64-year-olds), education (reducing rates of early school leaving below 10% and increasing at least 40% of 30- to 34-year-olds completing third level) and poverty (lifting 20 million people out of poverty)—relate directly to employment, productivity and inequality, with a focus on the target of “new skills for new jobs” taking the idea of “more and better jobs” from the earlier Lisbon agenda.

Globalisation, institutional changes (Fortin and Lemieux 1997; Freeman 2008; Lemieux 2008), technological advances and their skills-biased effects on labour demand (Goldin and Katz 2008) are the primary forces behind the increase of income inequality and the reshaping of occupational structures (Autor et al. 1998; Acemoglu 2002; Acemoglu and Autor 2011; Eurofound 2014; Hurley et al. 2015; Zago 2015). Therefore, changes in income inequality may be contextualised as structural changes in employment composition, which give rise to alternative patterns of countries’ labour markets in terms of job polarisation, upgrading or downgrading of occupations. A common trait is the decline in jobs requiring middle levels of competences, which are the most affected by the shrinking of jobs opportunities (Spitz-Oener 2006; Goos et al. 2009; Acemoglu and Autor 2011; Fernández-Macías 2012; Castellano et al. 2017; Garofalo et al. 2017). More precisely, job polarisation consists of a relative expansion in the demand of jobs occupying the top and bottom of the skills hierarchy and shrinking of the jobs in the middle (Autor 2003; Goos and Manning 2007). The upgrading of occupations favours high-qualified activities, i.e., those that increase the share of employment with respect to low-and middle-skill jobs (Autor 2010). More rarely, low-skill jobs grow faster than the rest, leading to downgrading of occupations (Hurley et al. 2015).

Our research hypothesis aims to link the structural occupational shifts that have occurred in four countries of Western Europe (France, Germany, Italy, and the United Kingdom) to the changes in their wage distribution and inequality between 2005 and 2013. The choice of this time frame allows one to obtain clues about the socio-economic scenario that foreshadowed the global crisis, whose effects continue to be felt, and their role in affecting the structure of the country’s labour markets and patterns of wage inequality. More precisely, by ranking jobs according to skill level (low, middle-, and high-skill jobs), we explore first the type and direction (i.e., which jobs rose and which shrunk within each sub-group) of structural occupational changes, and then, we try to relate these shifts to the changes in wage distribution and inequality. For this purpose, in the realm of recentered influence function (RIF) models, the unconditional quantile regression (UQR) (Firpo et al. 2007, 2009; Fortin et al. 2011) enables us to understand the main wage determinants as well as the changes in their impact along the entire distribution. In fact, in addition to the within-group effect, UQR captures the between-group heterogeneity linked to the different sub-categories of employees based on their relative location along the wage distribution. This two-stage procedure also permits splitting the temporal changes in wage and wage inequality into composition and wage structure effects. The former captures the differences in wage (and wage inequality) due to the employees’ endowments; the latter explains why different groups of employees are rewarded differently for the same individual endowments. A residual part of the decomposition (interaction) considers the leverage produced by both effects simultaneously.

The paper is organised as follows. Section 2 presents an extensive comparative analysis based on the EU-SILC data with a focus on the shifts in the structure of occupations in the most representative wage quantiles. Section 3 addresses the methodological issues of UQR and Sect. 4 shows the data source and variables. The leading determinants of individual earnings and wage inequality at several points of the corresponding distributions are argued in Sect. 5. Discussions and policy recommendations are drawn in light of the main country’s labour-market characteristics in Sect. 6. Concluding remarks are presented in Sect. 7.

2 Exploring the changes in the employment structure

This section describes how the structure of employment changed in France, Germany, Italy, and the United Kingdom between 2005 and 2013 and explores how these shifts produced varying patterns in the labour market at the country level. For this purpose we use data from the European Union-Survey on Income and Living Conditions (EU-SILC, see Sect. 4).

The analysis focuses on employees (i.e., anyone who works for a public or private employer and receives compensation in the form of wage, salary, fee, payment by result or in kind), aged 16–64, irrespective of their activity sector, excluding those employed by military occupations. Someone who is working in a parent’s firm and receives a regular wage is classified as an employee, and in the case of multiple jobs, any worker who allocates the greatest number of hours usually worked in the wage-employment category is considered employee. In many countries, inequality starts in the labour market, and changes in the distribution of wages are the key factors behind recent inequality trends (ILO 2015). Excluding the self-employed can be misleading because it may hide the duality of the labour market and the differences in the inequality levels (Parker 2004). Nevertheless, the adverse effects of income under-reporting (i.e., the practice of declaring lower earnings than actually received, usually for income tax purposes), which affects the self-employed more than employees for institutional reasons (Rees and Shah 1986; Bettio and Verashchagina 2009; Hurst et al. 2014), the great diversity in personal characteristics and labour-market settings between employees and the self-employed, and not least, the high heterogeneity of self-employment (Parker 2004; Castellano and Punzo 2013), made us decide to restrict the analysis to employees (Castellano and Punzo 2016).

In each country, the three groups of workers (high-, middle-and low-skilled), are defined according to the level of expertise required to perform their specific job. Borrowing the Eurostat classification, the average level of education is selected as a measure of skills required. The potential distortion due to the presence of skill-mismatched workers (Sicherman 1991; Hartog 2000; Chevalier 2003; OECD 2011a) is of negligible interest with respect to the objective given the strong correlation between the current average levels of education and skills required to perform the job (Eurostat 2010) and the equally high correlation between the mean education level and the minimum skill requirements (Ashton and Green 1996; OECD 2001).Footnote 1 More specifically, jobs are defined according to the International Standard Classification of Occupations (ISCO-08) and are rank-ordered in line with the mean level of education in the three broad categories of high-, middle-, and low-skill jobs. Eurostat (2010) demonstrated the reliability and accuracy of this grouping by comparing the EU-SILC and US occupational classifications, according to which minor differences in rankings exist, which might not be important for the purpose of examining changes in the employment share over time.

Following Eurofound (2015), to evaluate the employment shifts between the starting and concluding period in greater detail in both qualitative and quantitative terms—that is, how many jobs and which occupations were modified over time—each group of high-, middle-and low-skilled workers is then defined for the main employment sub-categories (Tables 1, 2).

Table 1 Percent changes by occupation, 2005–2013, at the most representative quantiles—France and Germany.
Table 2 Percent changes by occupation, 2005–2013, at the most representative quantiles—Italy and the United Kingdom.

Figure 1 shows the percentage changes in employment shares between 2005 and 2013 for each of the three broad categories of employees by skill level in the four countries. To evaluate how differently the shifts in occupations were along the whole wage distribution, the percentage changes are also presented for the most representative quantiles (i.e., first and ninth deciles, first and third quartiles, and median). The results can be used to classify the four countries by the patterns of the labour market over time in terms of job polarisation and upgrading.

Fig. 1
figure 1

Source: own elaborations on EU-SILC data

Percentage changes in employment by skill levels, 2005–2013.

In France, the proportion of employees in high-qualification jobs increased along the wage distribution with a different intensity, mainly in the middle part, and the simultaneous shrinking of the low-and middle-skill qualifications, essentially from the median onwards, provides evidence of a labour-market structure characterised by upgrading of occupations within the selected period of time. However, at the lower quantiles of the distribution, the shares of low-and middle-skill workers remain substantially unchanged or, at least, slightly increased. As shown in Table 1, the growth in high-skill occupations is prevalent due to the increasing of technicians in each quantile, whereas corporate managers, teaching professionals, and, all the more so, professionals contribute to the upgrading mostly at the top of the wage distribution. At the bottom of the distribution, the increase in high-skill jobs is due to the increase in technicians. The decreasing trend of middle-skill activities, which is essentially due to clerks, is partly counterbalanced by the simultaneous and faster increase of managers of small enterprises at the middle and top of the wage distribution. In the sphere of low-skill activities, agricultural and machine operators are penalised the most, while other elementary occupations are constant, especially in the lower quantiles. Our results, which indicate upgrading of the occupational structure in France, partly reflect those of other studies. In particular, Acemoglu and Autor (2011), who rank occupations by wage level, classify the changes in the structure of the French labour market as an upgrading of occupations. The same Authors confirm for France one of the largest declines in middle-wage occupations in Europe, as already argued by Goos et al. (2009), in addition to a less-pronounced drop in low-paid activities in 1993–2006. Despite the rise of low-paid jobs in the pre-(1995–2006) and post-crisis periods (2008–2010) in France, Eurofound (2011) finds that growth in the top-paid jobs at the European level is mostly due to countries such as France where job destruction has been concentrated in middle-paid jobs.

In Germany, the middle-skill activities consistently decreased along the whole wage distribution; this decline, coupled with the growth at different paces in low-and high-skill activities throughout the distribution, drives the job polarisation in the German labour market. However, the increase in low-skill occupations is by far lower than the increase in high-skill jobs along the entire distribution. More precisely, professionals and technicians, on the one side, and machine operators on the other, are the sub-categories of workers that contribute most to the increasing job polarisation in Germany. The contraction of middle-skill jobs is primarily associated with the large decrease of clerks in the four countries involved in the analysis (Table 1). The pattern of job polarisation in Germany is quite consistent with the current literature (Goebel et al. 2010; Frick and Grabka 2008), which detects how mid-paid occupations have been decreasing in all periods since the 1990s (Fernández-Macías 2012). Acemoglu and Autor (2011) describe a polarised labour market in Germany, and novel evidence of job polarisation is also found by Senftleben-König and Wielandt (2014), even in the local labour markets. Similarly, Dustmann et al. (2009) and Spitz-Oener (2006) demonstrate that, in Germany, high-paid and high-skill occupations grew substantially over the 1980s and 1990s and that midrange jobs disappeared more quickly than those at the bottom end of labour market. Merz and Scherg (2014) find growing polarisation in Germany, especially in the decade 2001–2009, and give evidence of how the erosion of the middle class is receiving more attention in recent policy debate.

Based on the percentage changes by quantile (Fig. 1), it is evident that Italy experienced an outright deterioration in the employment structure, with a joint contraction of each of the three differently skilled categories of workers, with the exception of the high-skill jobs at the middle of the wage distribution. Indeed, in Italy, the proliferation of high-skill jobs only occurred between the first quartile and the median (due to increasing numbers of technicians and, marginally, teaching professionals), whereas more consistent decreases in both low-and middle-skill qualifications (with deeper decreases for agricultural and machine operators and clerks) occur along the entire distribution to a greater extent compared to France and the United Kingdom (Table 2). To conclude that there is a clear presence of upgrading in Italy, the number of employees in high-skill jobs would be significantly increased along the entire wage distribution and not just at the middle. Therefore, no clear conclusion can be made about the structure of the Italian labour market as a whole. In this respect, Eurofound (2011) sketches a hybrid pattern of the Italian labour market over the period 1995–2006 and downgrading over 2008–2010, which means that job destruction was greater in higher-paid jobs and lower-paid employment either grew or suffered relatively small declines. As argued by Eurofound (2014), this pattern continued into 2011–2013.

In the United Kingdom, middle-and low-skill jobs declined along the entire distribution, while middle-skill activities decreased rather uniformly throughout the quantiles, with substantial losses in the low-skill qualifications from the median onwards. However, a slight growth of low-skill activities occurred at the bottom of the wage distribution, denoting signals of polarisation of poorly paid jobs. The share of high-skilled employees consistently increased, mainly in the middle part of the wage distribution, indicating a labour market characterised by upgrading of occupations between 2005 and 2013 (Fig. 1). More precisely, teaching professionals and technicians, along the whole wage distribution, and professionals, at the top, contribute largely to the increasing high-skill qualifications. The contraction of middle-skill jobs is, once again, the result of the large decrease of clerks, while managers of small enterprises explain the middle and top of the wage distribution. All low-skill occupations decreased, except for machine operators and other elementary workers at the bottom (Table 2). In general, the UK labour market is characterised by upgrading of occupations, which seems partly in contrast with the literature that indicates the presence of job polarisation in the United Kingdom. Indeed, after research in the United States (Wright and Dwyer 2003; Autor et al. 2003), where the empirical evidence shows a gradual shift from upgrading to job polarisation (characterised by a steady hollowing out of middle-skill qualifications), studies concerning Great Britain were conducted. Despite the choice of median income (rather than the mean) as the parameter used to classify occupations in the United Kingdom, Goos and Manning (2007) obtain results that are substantially in line with those of the US market. Oesch and Rodriguez-Menés (2010) describe a slightly polarised pattern of occupational upgrading in Britain (Gallie 2004; Felstead et al. 2007), characterised by a stronger relative decline in the occupations in the middle than in those at the bottom. However, the patterns of occupation changes we outlined for Great Britain conform to the results of Oesch and Rodriguez-Menés (2010) over the years 1991–2008, who rank occupations into quintiles by median earnings, and some other studies covering different periods (OECD 2003; Eurofound 2008). The same Eurofound (2011) classifies the British labour market as hybrid polarisation/upgrading over the period 1995–2006.

A constant feature across countries is the substantial fall in jobs that have traditionally been held by middle-skill workers. This contrasts with the growth of high-skill jobs (except for Italy, where the latter also decreased) and the stagnation or decline in low-skill jobs, except for Germany, where low-skill activities also increased even though to a lower extent than the high-skill jobs. However, the strong expansion at the top of the occupational hierarchy and the parallel collapse in the middle classify the German labour market as polarised. Large variations exist in the short-term patterns of employment shifts across the other countries, with upgrading in France and the United Kingdom, at least in the time span designated for this analysis, and a more irregular pattern in Italy.

Differences in the changes over time in the occupational structure help to explain why the tendency towards upgrading rather than job polarisation is more or less clear in the four countries and why different dynamics in the patterns of the labour market may occur in different periods of time. Some cross-national parallels may be drawn. The first one concerns the decreasing employment share of clerks, whose relative job losses are distributed quite equally across quantiles and may be considered as the most responsible for the observed decline in middle-skilled employees. The second one is related to the decreasing shares of agricultural workers across countries, which indicates the stagnation of low-skill activities. In Germany, the decline of those activities, coupled with that of other elementary occupations, is counterbalanced by the strong increase in machine operators. A third similarity is the simultaneous decrease in corporate managers, with certain exceptions (i.e., France from the median onwards), and the consistent increase in technicians along the whole distribution.

3 Methodology

One of the main goals of the present paper is to understand the leading determinants of changes in earnings and wage inequality at several points of the corresponding distributions in each country. With this aim in mind, UQR (Firpo et al. 2009; Fortin et al. 2011) on log-wage is performed. This multistage technique belongs to RIF models (Firpo et al. 2007, 2011), which allow one to estimate the impact of each explanatory variable on the distributional statistics of interest (e.g., Gini index, variance and quantile) and to decompose the variation in the wage distribution over time into the composition and the wage structure effects.

RIF regression overcomes the two main limitations of the Oaxaca–Blinder method (Blinder 1973; Oaxaca 1973). First, the estimations of wage structure and composition effects can be misleading if the linear model is unspecified (Barsky et al. 2002); second, the contribution of each covariate to the wage structure is highly sensitive to the choice of the base group (Oaxaca and Ransom 1999; Gardeazabal and Ugidos 2004). Other decomposition procedures remove these disadvantages, e.g., the Juhn et al. (1991, 1993) method based on the distribution of residuals, the DiNardo et al. (1996) technique, which generates counterfactual earnings distributions using reweighting factors, and the quantile-based decomposition by Machado and Mata (2005). However, the main shortcoming of these methods is their inability to trace the contribution provided by each covariate to the composition effect when they are used to compute the decomposition of various distributional statistics (Firpo et al. 2007). Another aspect to consider is that the Oaxaca–Blinder method applies the decomposition only to the mean (Firpo et al. 2007), whereas RIF regression is well suited to the objective of this paper of analysing the changes of the wage distribution and inequality over time because it can obtain the decomposition for most of the distributional statistics. The quantile estimates the impact of changing the distribution of covariates on the marginal quantiles of the outcome variable (Firpo et al. 2009). This method is known as unconditional quantile regression (UQR) to distinguish it from the commonly used conditional quantile regression (Koenker and Bassett 1978; Koenker 2005). Both procedures share the ability to evaluate the impact of each covariate at different points in the wage distribution. However, one of the significant advantages of UQR is its ability to capture also the between-group effect, whereas the conditional quantile regression only addresses the within-group effect (where each group is represented by employees sharing the same values of covariates X, except for the explanatory variable). In brief, UQR can capture the between-group effect in addition to the within-group effect, which is linked to the contribution that each covariate has to the conditional mean of the dependent variable (log-wage, in this work) (Firpo et al. 2009). Taking into account these advantages, UQR is selected for this study.

Suppose that a sample of individuals is divided into two groups, 0 and 1. N1 and N0 are the number of units in each group, and the individuals are identified by the index i = 1,…, N. Y1i is the wage of worker i of group 1, and Y0i represents the wage that would be paid in group 0. An important aspect is that one can observe either Y1i or Y01, but not both, because individual i is only observed in one of two groups. Consequently, the observed wage Yi is defined as:

$$Y_{i} = Y_{1i} \cdot G_{i} + Y_{0i} \cdot \left( {1 - G_{i} } \right)$$
(1)

where Gi = 1 when worker i is observed in 2013, and Gi = 0 when the worker is observed in 2005.

In general, Yi can be written without imposing a specific functional form considering the wage determination function of observed components Xi and some unobserved components εi:

$$Y_{gi} = f_{g} \left( {X_{i, } \varepsilon_{i} } \right), \quad for\quad g = 0, 1$$
(2)

RIF regression replaces the dependent variable, Y, with the recentered influence function of the statistic of interest. Let v be the generic distributional statistic to study and IF the influence function (first-order directional derivate of v) introduced by Hampel (1974). The RIF regression is:

$$RIF\left( {Y;v} \right) = IF\left( {Y;v} \right) + v$$
(3)

The above expression can be written as:

$$E\left[ {\left. {RIF\left( {Y;v} \right)} \right|X} \right] = X\beta^{v}$$
(4)

where βv represents the marginal effect of X on v.

In the specific case of the quantiles of the unconditional distribution of the outcome variable, the RIF regression equation can be rewritten as:

$$RIF\left( {y;Q_{\tau } } \right) = Q_{\tau } + \frac{{\tau - {\text{II}}\left\{ {{\text{y}} \le Q_{\tau } } \right\}}}{{f_{y} \left( {Q_{\tau } } \right)}}$$
(5)

In this first step, the dependent variable Y is replaced by the estimated value of \(\widehat{RIF}\left( {Y_{i} ,Q_{\tau } } \right);\) the indicator variable \({\text{II}}\left\{ {{\text{y}} \le Q_{\tau } } \right\}\) allows one to include employees in a specific quantile where the outcome variable is smaller or equal to Qτ and to explain the determinants of the proportion of employees earning less than the threshold wage Qτ.

Once the RIF regression is performed for each period (Gi = 1; 0), the overall wage gap over time can be measured as follows:

$$\hat{\Delta }_{O}^{\tau } = \bar{X}_{1} \left( {\hat{\gamma }_{1,\tau } - \hat{\gamma }_{0,\tau } } \right) + \left( {\bar{X}_{1} - \bar{X}_{0} } \right)\hat{\gamma }_{0,\tau } = \hat{\Delta }_{S}^{\tau } + \hat{\Delta }_{X}^{\tau }$$
(6)

where the coefficient \(\hat{\gamma }_{g,\tau }\) is obtained from the following expression:

$$\hat{\gamma }_{g,\tau } = \left( {\mathop \sum \limits_{i \in G} X_{i} \cdot X_{i}^{T} } \right)^{ - 1} \mathop \sum \limits_{i \in G} \widehat{RIF}\left( {Y_{g,i} ;Q_{g,\tau } } \right)X_{i} ,\quad g = 0,1$$
(7)

In this way, the overall wage gap over time is decomposed into two components: wage structure (\((\hat{\Delta }_{S}^{\tau } )\) and composition effect \(\left( {\hat{\Delta }_{X}^{\tau } } \right)\). The first term corresponds to the effect on Qτ of a change from \(f_{1} \left( { \cdot , \cdot } \right)\) to \(f_{0} \left( { \cdot , \cdot } \right)\) while keeping the distribution of \(\left. {\left( {{\text{X}},\varepsilon } \right)} \right|G = 1\) constant. Conversely, the composition effect keeps the wage structure \(f_{0} \left( { \cdot , \cdot } \right)\) constant and measures the effect of changes from \(\left. {\left( {{\text{X}},\varepsilon } \right)} \right|G = 1\) to \(\left. {\left( {{\text{X}},\varepsilon } \right)} \right|G = 0\). However, the key term for decomposing the total wage gap is the counterfactual distributional statistic vc (Firpo et al. 2007),Footnote 2 which represents the distributional statistic that would have prevailed if workers observed in group 1 had the wage structure of group 0.

Using the counterfactual distribution, the above mentioned components can be rewritten as:

$$\hat{\Delta }_{S}^{\tau } = \bar{X}_{1} \left( {\hat{\gamma }_{1,\tau } - \hat{\gamma }_{0,\tau }^{C} } \right)\quad {\text{and}}\quad \hat{\Delta }_{X}^{\tau } = \left( {\bar{X}_{0}^{C} - \bar{X}_{0} } \right)\hat{\gamma }_{0,\tau }$$
(8)

To identify the parameters of the counterfactual distributions, three weighing functions (DiNardo et al. 1996; Firpo et al. 2007) are estimated through the following normalisation procedures:

$$\widehat{{\omega_{1}^{*} }}\left( {G_{i} } \right) = \frac{{\widehat{{w_{1} }}\left( {G_{i} } \right)}}{{\mathop \sum \nolimits_{j = 1}^{N} \widehat{{w_{1} }}\left( {G_{j} } \right)}} = \frac{{G_{i} }}{{N\hat{p}}};$$
(9)
$$\widehat{{\omega_{0}^{*} }}\left( {G_{i} } \right) = \frac{{\widehat{{w_{0} }}\left( {G_{i} } \right)}}{{\mathop \sum \nolimits_{j = 1}^{N} \widehat{{w_{0} }}\left( {G_{j} } \right)}} = \frac{{1 - G_{i} }}{{N\left( {1 - \hat{p}} \right)}};$$
(10)
$$\widehat{{\omega_{c}^{*} }}\left( {G_{i} ,X_{i} } \right) = \frac{{\widehat{{w_{c} }}\left( {G_{i} } \right)}}{{\mathop \sum \nolimits_{j = 1}^{N} \widehat{{w_{c} }}\left( {G_{j} } \right)}} = \frac{{\left( {1 - G_{i} } \right)\left( {\frac{{\hat{p}\left( {X_{i} } \right)}}{{1 - \hat{p}\left( {X_{i} } \right)}}} \right)}}{{\mathop \sum \nolimits_{j = 1}^{N} \left( {1 - G_{j} } \right)\left( {\frac{{\hat{p}\left( {X_{j} } \right)}}{{1 - \hat{p}\left( {X_{j} } \right)}}} \right)}}$$
(11)

where \(\hat{p} = N^{ - 1} \mathop \sum \nolimits_{i = 1}^{N} G_{i}\) and \(\hat{p}\left( \cdot \right)\) is an estimator of the true probability of being in group 1 given X. \(\widehat{{\omega_{1}^{*} }}\left( {G_{i} } \right)\) and \(\widehat{{\omega_{0}^{*} }}\left( {G_{i} } \right)\) transform features of the marginal distribution of Y into features of the conditional distribution of Y1 given G = 1 and of Y0 given G = 0. \(\widehat{{\omega_{c}^{*} }}\left( {G_{i} ,X_{i} } \right)\) is a function to estimate the counterfactual distribution of Y0 given G = 1.

Among the quantiles, the median \(\left( {q_{\tau } = \frac{1}{2}} \right)\) is a leading example:

$$RIF\left( {y;me} \right) = me + \frac{{\frac{1}{2} - {\text{II}}\left\{ {{\text{y}} \le {\text{me}}} \right\}}}{{f_{y} \left( {me} \right)}}$$
(12)

The decomposition of the overall gap follows the same steps. Indeed, the gaps are computed as:

$$\hat{\Delta }_{O}^{me} = \bar{X}_{1} \left( {\hat{\gamma }_{1,me} - \hat{\gamma }_{0,me} } \right) + \left( {\bar{X}_{1} - \bar{X}_{0} } \right)\hat{\gamma }_{0,me}$$
$$\hat{\Delta }_{S}^{me} = \bar{X}_{1} \left( {\hat{\gamma }_{1,me} - \hat{\gamma }_{0,me}^{C} } \right)$$
$$\hat{\Delta }_{X}^{me} = \left( {\bar{X}_{0}^{C} - \bar{X}_{0} } \right)\hat{\gamma }_{0,me}$$
(13)

The coefficients γ are estimated by replacing the dependent variable, Y, with the estimated value of \(\widehat{RIF}\left( {Y_{i} ;me} \right):\)

$$\hat{\gamma }_{g,me} = \left( {\mathop \sum \limits_{i \in G} \hat{\omega }_{g} \left( {G_{i} } \right)X_{i} X_{i}^{T} } \right)^{ - 1} \mathop \sum \limits_{i \in G} \hat{\omega }_{g} \left( {G_{i} } \right)\widehat{RIF}\left( {Y_{i} ;me_{g} } \right)X_{i} \quad g = 0,1$$
(14)
$$\hat{\gamma }_{c,me} = \left( {\mathop \sum \limits_{i \in G} \hat{\omega }_{C} \left( {G_{i} ,X_{i} } \right)X_{i} X_{i}^{T} } \right)^{ - 1} \mathop \sum \limits_{i \in G} \hat{\omega }_{C} \left( {G_{i} ,X_{i} } \right)\widehat{RIF}\left( {Y_{i} ;me_{C} } \right)X_{i}$$
(15)

4 Data and variables

Data are from the EU-SILC, which is currently the main European reference source for comparable socio-economic statistics at both the household and individual levels. In addition to a large set of personal socio-demographic and education information, the EU-SILC provides exhaustive and harmonised target data on employment status, type of occupation and activity sector, as well as on single-income components, taxes and contributions.

As described above, the changes in gross personal wages between 2005 and 2013 are evaluated by country using UQR. This methodology includes a preliminary step in which the marginal quantiles of log-wage are regressed on a set of individual characteristics, human capital, job background, and occupation type variables that potentially drive the observed wage at different points of the unconditional distribution. Table 3 shows more details on covariates. In addition, to perform a cross-country comparison in terms of wage inequality, the RIF regression of the Gini index on log-wage is also tested at different quantiles of the distribution on the same set of covariates.

Table 3 List of variables

The employees’ wage, which is composed of cash, near cash and non-cash salaries, is specified in the gross form (i.e., the total earnings from work received during the reference period, before any deductions for tax or social insurance contribution).Footnote 3 Various forms of income are related through various national fiscal regimes, and specifying wage in the gross form enables us to compare more countries, regardless of the complexity of their tax rules. Under a different approach (e.g., using net income), the comparison among France, Germany, Italy, and the United Kingdom would not be suitable because of the different fiscal regimes (e.g., the French fiscal system is typically household-based, whereas in Italy, it is more individual-based). Wages are adjusted for inflation to guarantee their comparability over time in real terms.

The choice of personal labour earnings is motivated by interest in explaining the determinants of wage-generating (and wage inequality) processes in the individual capacity to earn income, regardless of how resources are pooled, how individuals share them within their households or how individuals participate in the decision process (Beninger and Laisney 2002). The adoption of a similar approach to labour supply behaviour—one that is consistently supported by many authors (Becker 1991; Samuelson 1956)—results from this paper’s general aim to investigate personal earnings and wage inequalities in light of individuals’ capacity to succeed in the labour market. This model enables us to overcome the potential problems that result from an exaggerated emphasis on the household as the basic unit of decision rather than on individual wellbeing. Additionally, labour-market earnings are the main income source for most individuals and are therefore crucial drivers of household income inequality (Fremeaux and Piketty 2014).

5 The driving forces behind the wage distribution and inequality

The quantile perspective allows us to explore on the one hand the primary forces of wage (and wage inequality) and on the other hand to evaluate how they affect the different groups of employees. For ease of presentation, the estimates from the UQR of log-wage at different quantiles by country (Tables 8, 9, 10, 11) and for Gini on log-wage from separate RIF regressions by quantile and by country (Tables 12, 13, 14, 15) are shown in Appendix. The tables show the estimated coefficients at the 10th, 50th, and 90th percentiles, along with their standard errors. After having discussed the role played by personal characteristics, human capital and job background in this Section, we discuss how the different types of occupations contribute to determine wage levels (Sect. 5.1) and wage inequality (Sect. 5.2) compared with more elementary jobs.

In general, the results show the crucial roles of gender, education and work experience in determining personal wages and inequalities and draw attention to the economic status, type of contract and type of job held as driving forces. Focusing on individual-level determinants, it is worth noting that being a man, being married and enjoying good health play a significant role in employee earnings in nearly all the countries considered. In particular, the gender dimension is among the primary determinants of wage in each country and of wage inequality in Germany (2005) and Italy (2013), though no in France and the United Kingdom, where a different division of roles within couples and family-oriented or equal treatment policies provide women with different chances to reach leadership positions and thus better average salaries (Jenson and Sineau 2001; Lanquetin et al. 2000).

The estimates are also consistent with Mincerian models and their extensions (Mincer 1958, 1974; Becker 1962): differences in the levels of formal education and experience in the labour market affect personal earnings. In general, better education and more experience increase earnings and reduce inequalities. A major cause of earnings inequality is the lowest educated employees in each country, whereas the high-educated, who are normally also more skilled, are more oriented towards developing better careers and higher pay. Just as for formal education, work experience, which increases human capital accumulation throughout the life cycle, also increases personal earnings and lowers inequality. The negative sign of experience-squared on log-wage confirms the concavity of the earnings–experience relationship, according to which earnings tend to advance rapidly in the early years in the labour market, flatten in later years, and decline slightly thereafter.

Large wage differentials are associated with employment status and, above all, with different types of contract. Having a permanent contract and being a full-time employee are crucial to personal earnings; their effect is negatively sloped—it is smaller at the 90th than at the 10th percentile—and well-structured workers tend to increase wages for the low quantiles, where both the within-group and between-group effects are in the same direction (Firpo et al. 2009). Because part-time and temporary workers receive, on average, lower salaries with earnings trajectories that are less steep than their full-time and permanent counterparts, they contribute to increased wage inequality. Indeed, a high share of part-time and temporary employees affects the overall income distribution by increasing the weight of lower wages on the left side of the same distribution. In Germany, the rise of more precarious jobs became significant from 2003 onwards (Corneo et al. 2014) with the revisions of active labour-market policy carried out through the Hartz-reforms, which foresee, among other things, the deregulation of temporary employment and the creation of agencies to place people in work, even if it differs from their own profession, resulting in the broadening of minor occupations by means of social security exemption (Eichhorst and Marx 2011; Dlugosz et al. 2014). In Italy, the increasing share of temporary employees over time is also a potential result of deregulation undertaken since 1997 (e.g., Treu Package, Biagi Reform), which has sought to increase flexibility to new entries in the labour market but has increased the amount of fixed-term workers, primarily young people and women, with worse salaries and volatile employment. In France, the high minimum wage, which has continued to increase from 1980 to 2010, has helped decrease income inequality, while deregulation has led to the creation of a dual market with an increase in part-time work and short-term contracts. In the United Kingdom, the welfare reform “Universal Credit” has been a significant step forward in rationalising the benefit system and enhancing work incentives; nevertheless, the more flexible labour market has dampened the impact of the weak economy on layoffs and has significantly increased involuntary part-time work (André et al. 2013). In brief, although small numbers of working hours and fixed-term contracts worsen wage inequality, differences in the levels of earnings inequality between employment contracts must be explained in light of the different institutional landscapes and labour-market trends, in terms of flexibility and insecurity of employment conditions, across countries (McCall 2000).

5.1 How does occupation affect wage levels?

For occupation types scaled according to skill level, one of the most striking findings is that all professions contribute to improving wage levels (Figs. 2, 3, 4, 5). The regression coefficients for occupation show, in general, that the returns are larger for the high-and middle-skill occupations, while they decrease, or become statistically insignificant, as one moves towards the less-skilled workers, such as agricultural workers and machine operators. In particular, for 2013, in France, Germany and Italy, the beta coefficients for teaching professionals are insignificant at the top end of the wage distribution, and for Britain, they fall steeply. Technicians show similar monotonically declining patterns, and more marked differences in the beta coefficients between 2005 and 2013 are detected for Italy and the United Kingdom, i.e., the advantage of being a technician, in terms of wage remuneration, is increased in 2013, especially in the first half of the wage distribution. German and French corporate managers have a slightly U-shaped effect on their personal wage along the distribution, with high impact at the bottom and top and lower impact in the middle (Figs. 2, 3). However, a notable difference between the two countries results from the reverse in returns between 2005 and 2013: in Germany, remunerations at the first half of the wage distribution decreased over time, while they increased in France. In Italy, after a flat beta coefficient pattern until the third quartile, the coefficient rapidly grows without significant differences over time. For the Great Britain, the reverse in returns between the 2 years is clear from the median onwards, where beta coefficients are lower for 2013.

Fig. 2
figure 2

UQR coefficients on log-wage along the wage distribution (x-axis: τ-th ventile). France, 2005–2013

Fig. 3
figure 3

UQR coefficients on log-wage along the wage distribution (x-axis: τ-th ventile). Germany, 2005–2013

Fig. 4
figure 4

UQR coefficients on log-wage along the wage distribution (x-axis: τ-th ventile). Italy, 2005–2013

Fig. 5
figure 5

UQR coefficients on log-wage along the wage distribution (x-axis: τ-th ventile). The United Kingdom, 2005–2013

German managers of small enterprises have similar patterns as their corporate counterparts in the first half of the wage distribution; in France, the rewards of managers of small enterprises are improved in 2013 from the first quartile onwards, though they narrow at the 95th percentile. In the United Kingdom, gaps in rewards over time are wide, similar to in France, with two important differences: they increase from the first decile and continue growing, even at the top end of the wage distribution. For Italy, the contribution of managers of small enterprises to wage-generation processes follows a flat pattern until the third quartile, and then sharply increases in 2013. Among high-skill jobs, the ability of professionals to generate earnings has increased in each country, albeit with differences along quantiles. A common feature across countries is the monotonic decreasing trend of clerks, whose beta values tend to zero as one moves to the right side of the wage distribution, indicating a larger impact on the lower than higher quantiles. The monotonicity indicates that within-and between-group effects have the same direction of decreasing wage generation compared with elementary employees. For low-skilled activities, being an agricultural worker or machine operator has a stronger effect on the wage-generating process than being an elementary worker at the lower quantiles. The magnitude of the effect decreases in each country at the right side of the wage distribution, with insignificant beta values or values lower than zero at the top end. In other words, the advantage of being an agricultural worker or machine operator rather than an elementary worker becomes irrelevant as they move up the pay distribution.

Tables 4 and 5 show the overall differences in log-wages by country and their decomposition at most representative quantiles of distribution (10th, 50th and 90th quantile).

Table 4 UQR decomposition of log-wage. France and Germany, 2005–2013
Table 5 UQR decomposition of log-wage. Italy and the United Kingdom, 2005–2013

In France and Italy, real wages have grown between 2005 and 2013 even though with different patterns along the distributions. In both countries and along the whole distributions, the wage structure explains a higher share of the overall increase in real wages than the share due to the composition effect. In particular, for France, the growth of wages mainly occurred for the low-paid employees, which is potentially due to the relatively high minimum wage (approximately 60% of the overall full-time median wage) and the practice of protecting pay at the bottom of the labour market. In Italy, wage increases involve the bottom half of the distribution and become more stable thereafter even though the relative greatest wage growth concerns the high-paid employees.

As regards Germany, the analysis shows a small downward trend of wages in most quantiles, except for the increase in wages for the bottom 5% of employees. However, the wage gaps, which are not statistically significant in the second and third decile, tend to weaken from the bottom to the top of the distribution, denoting a stagnation of wages for the upper-middle earnings groups. The composition and wage structure effects contribute to wage gap at bottom end of the distribution in a similar way. From the first quartile onwards, wage structure has a greater influence on the downward wage variation: structural changes in the labour market play a major role in lowering wages of German workforce. In the middle part of the distribution, employees’ characteristics (composition effect) counterbalance the effect of these changes in the employment structure. From around the third quartile onwards, both components have a negative sign and contribute, with unequal intensity, to the wage decrease between 2005 and 2013.

In the United Kingdom, the wage level decreased especially in the first half of the distribution. It means that wage reductions have involved low-paid employees more intensively than their high-paid counterparts. This decline in wage levels along the whole distribution is mainly due to wage structure that contrasts the possible positive action of composition effect in the wage-generating process.

5.2 How does occupation affect wage inequality?

Focusing on the contribution of the different types of jobs to wage inequality (Figs. 6, 7, 8, 9; Tables 12, 13, 14, 15), all professions contribute to improving earnings inequality compared to more elementary jobs. In Germany, although managers (both corporate and small enterprises) and teaching professionals seem to aggravate existing earnings inequality at the lower quantiles in 2005, extensive wage inequality consistently affects the lowest rung of elementary occupations, likely due to the effect of Hartz reforms, which contribute to increased labour supply of low-skilled workers (Corneo et al. 2014). In France, almost all the high-and middle-skill employees improved their contribution to reducing inequality over time, except for teaching professionals in the central part of the distribution. In contrast, technicians and agricultural workers have a direct contribution to inequality in 2013, mainly in the low-wage quantiles. Similarly, in Italy, wage inequality enhancement becomes stronger from 2005 to 2013 for the middle-skill (clerks and service workers) and low-skill employees (machine operators) and high-skill technicians, especially in the first quartile of the wage distribution. However, from the median onwards, the same activities start to reduce wage inequality. In the United Kingdom, as for Italy, some professional categories increase their impact on earnings inequality over time. It is not possible to identify a common trend across occupations within each group of low-, middle-, and high-skill, but there are specific occupations—in particular, professionals (high-skill), clerks (middle-skill) and machine operators (low-skill)—that have a direct contribution to increasing inequality in the first quartile of the wage distribution. These results are substantially in line with Wolff and Zacharias (2013), who demonstrate that the growth of income inequality between 1989 and 2000 was mostly due to the increase in inequality among occupations. This large amount of wage inequality suggests that the huge income gap between some occupational groups (e.g., the capitalist class and everyone else) is one of the main forces behind increasing inequality because of the stronger instability of unskilled workers and clerks compared to individuals in intermediate or managerial positions (Fremeaux and Piketty 2014).

Fig. 6
figure 6

RIF-regression coefficients of Gini on log-wage along the wage distribution (x-axis: τ-th ventile). France, 2005–2013

Fig. 7
figure 7

RIF-regression coefficients of Gini on log-wage along the wage distribution (x-axis: τ-th ventile). Germany, 2005–2013

Fig. 8
figure 8

RIF-regression coefficients of Gini on log-wage along the wage distribution (x-axis: τ-th ventile). Italy, 2005–2013

Fig. 9
figure 9

RIF-regression coefficients of Gini on log-wage along the wage distribution (x-axis: τ-th ventile). The United Kingdom, 2005–2013

Tables 6 and 7 show the decomposition of changes in the Gini index between 2005 and 2013 in the four countries covered at the most representative quantiles. The overall Gini index declined slightly in both Germany (− 8.05%) and in France (− 9.54%). In Germany, the decreasing inequality involves the entire wage distribution: the wage structure is less strong than the composition effect until the first quartile, and then the latter remains the only component with a positive contribution to improving inequality (the wage structure becomes insignificant). In France, wage inequality reduction has involved the upper half of distribution and it is explained only by the composition effect (the wage structure effect is never significant).

Table 6 RIF decomposition of Gini log-wage by quantile. France and Germany, 2005–2013
Table 7 RIF decomposition of Gini on log-wage by quantile. Italy and the United Kingdom, 2005–2013

Italy is characterised by rising overall wage inequality along the entire distribution (22.40%), mainly for the very low-paid employees. The weak ability of the Italian labour market to transform individual endowments into better job opportunities and higher earnings is highlighted by the fact that the wage structure is the solely significant component of the inequality growth. In the United Kingdom, despite the rising overall wage inequality (2.51%), the low-and middle-paid employees experience decreasing levels of wage inequality over time. The increase in inequality is essentially due to the composition effect, which plays different roles based on the location of the employee along the distribution.

6 Discussion

The four countries share the crucial role of gender, education and work experience in determining wages and inequality, with economic status, type of contract and type of job held as the driving forces. In particular, gender is among the primary discriminants of wage, in favour of males in each country, and remains one of the driving forces of inequality in Germany and Italy. This indicates the need to enforce a gender-mainstreaming approach to support better sharing of family responsibilities and equal treatment of parental leave to fight gender-based stereotypes (Del Boca et al. 2009). Workers would be evaluated without gender bias to improve the opportunities of women aspiring to more attractive career prospects and to achieve higher managerial positions and thus better-remunerated jobs. In Britain, for example, the increasing participation of women in the labour market and the benefits accruing from the National Minimum Wage (Gosling and Lemieux 2004) have slowed the growth of inequality; however, the disparity in earnings within males remains one of the main factors that explain the changes in inequality (OECD 2011b).

Our results highlight the importance of job background characteristics. During the last years, national governments carried out many reforms with the aim to increase the flexibility of the labour market (e.g., French policies to weaken the labour-market rigidities, the Hartz reforms in Germany, the Treu Package and Biagi Reform in Italy, and Universal Credit in Britain). As a result, the number of employees with unsafe work contracts has grown. In fact, some of these reforms (e.g., the French labour market became more dual, with growing shares of flexible jobs) have stimulated the “casualisation” process of part of the workforce through the introduction of involuntary temporary and/or involuntary part-time employment with effects on wage levels and inequality.

Coherent to our results, which argue that permanent and full-time contracts increase wages for low-paid employees (and their effect becomes smaller as one moves to the top end of the wage distribution) and reduce inequality, it would be advisable to identify reforms aimed at improving the synergy between flexibility and security in the labour market. It means that some actions are needed (e.g., providing more protection for employees with fixed-term contracts and fewer hours worked) to balance the greater flexibility, as outlined in the country’s labour policies, and to achieve greater security in terms of well-structured jobs. The Kurzarbeit, implemented in Germany, is a good example of this kind of action. In fact, it has allowed the companies to maintain their qualified workforce in economically difficult times. In addition, through redeploying tasks and workloads among employees, it has helped to maintain and upgrade existing skills and to increase their internal flexibility. Another example is the Cassa Integrazione Guadagni in Italy, which put employees on full suspension from work. It improved external flexibility but failed to motivate workers to acquire new skills or to ensure the portability of the same skills to new occupations.

Constant attention to equal access to education and specific on-the-job training or lifelong learning, e.g., investments in individuals’ endowments, could help workers to upgrade their skills and reduce the risk that their earnings may erode, thereby exacerbating inequality. Coupled with more effective social security systems, which combine the provision of adequate income support with the need to facilitate labour-market mobility and transition, this could be one of the best ways to reduce the number of working poor, usually coinciding with low-skilled workers. In this field, the quantile approach explains the differences among the most vulnerable groups of employees and the way through which their characteristics affect both the within-and between-job pay dispersion. The same approach may also enable assessment of the impact of labour-market reforms promoting flexibility on wage inequality for differently remunerated sub-categories of employees, whose heterogeneous nature should be emphasised. Accordingly, appropriate policy responses vary.

Our results also show how workers’ skills (e.g., higher skills reduce wage inequality and increase wages) and employment opportunities run in parallel, which can help in defining policies to stimulate the country’s labour market in both the short-and long-term (OECD 2010). From a political perspective, if the immediate objective is a match between the current supply and demand for workers’ skills, the main challenge is in anticipating the transformations of industries that have a significant impact on job creation or job displacement and, therefore, the potential changes in demanding skills that could facilitate the implementation of policies. More precisely, measures have to be designed from a life cycle perspective with the aim of building up and improving individual skills and linking education to technical training to establish in advance the needs of enterprises and workers’ aspirations, even in times of economic difficulty. However, in Germany and the United Kingdom, where the wage structure plays a crucial role in the shrinking inequality on the left side of the wage distribution, our results suggest some success of reform policies, such as Hartz reforms and the National Minimum Wage, in reducing inequality within the most vulnerable groups of employees. In Italy, attempts to promote work flexibility and low-skill employment have not always lived up to their desired effects, mainly for the poorest employees.

7 Conclusions

This paper has been designed to investigate the determinants of wages and wage inequality in four developed countries in Western Europe—France, Germany, Italy, and the United Kingdom—during the years of the global economic crisis (2005–2013) in light of important shifts in the occupational structure of the countries’ labour market. The shrinking in the demand of jobs occupying the middle of the skills hierarchy, which is primarily associated with the large decrease of clerks, is shared by each country. This contraction has favoured those jobs at the top and the bottom of the skills hierarchy (defining a job polarisation pattern in Germany) or just those at the top (France and, to a lesser extent, the United Kingdom are characterised by upgrading of occupation). In Italy, the joint contraction of all type of occupations, irrespective of skill level required, sets out a not well-defined (hybrid) structure.

Our results show that the recent trends in wages and wage inequality are mixed across the four countries, and their dynamics at the top and bottom of the wage distribution are more diverse than in the middle. France and Germany showed decreasing patterns of wage inequality, despite having opposite changes in wages within the same timeframe; similarly, the United Kingdom and Italy had increasing patterns of wage inequality while maintaining opposite changes in wages.

The employment structure can explain a fraction of wage inequality, mainly at the top of the wage distributions, and confirm the role of the institutional, socio-economic and policy frameworks of each country. In France and Germany, whose labour markets shared well-defined structures, the upgrading of occupations and job polarisation had an equalising effect on the wage distribution; instead, the relative upgrading in the United Kingdom has only slowed inequality growth. In Italy, the more hybrid pattern of the labour market has contributed to raising the overall inequality through the joint contraction of each of three differently skilled categories of workers. Quantifying the two components of changes in wage levels and inequality, the labour market structure had a greater influence on generating variation in the real salary in all countries, whereas the employees’ characteristics mostly explained the variation in wage inequality, with different intensity along the distribution. Italy is the only country where the occupational structure significantly contributes to wage inequality.

The time interval (2005–2013) and the index (Gini), over which the occupational structures and wage inequality are evaluated, inevitably affect the results that remain valid in the context of the earnings of employees and cannot be extended to a general perspective of income inequality where other income components must be considered. These results form the basis to extend the analysis to a wider-ranging comparison across European countries, in which differences between employees and self-employed could be explored.