Skip to main content
Top
Published in: Social Indicators Research 3/2022

Open Access 30-04-2022 | Original Research

A Composite Indicator to Assess Sustainability of Agriculture in European Union Countries

Authors: Alessandro Magrini, Francesca Giambona

Published in: Social Indicators Research | Issue 3/2022

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Few studies have been conducted to assess agricultural sustainability in the European Union (EU), and all of them fail to provide a holistic view of sustainability in a relevant temporal horizon that could effectively support the design of policies. In this paper, a composite indicator is constructed based on the geometric aggregation of 12 basic indicators measured yearly in the period 2004–2020 (17 years) on all EU countries plus United Kingdom, with weights determined endogenously according to the Benefit of Doubt (BoD) approach. Our composite indicator has a two-level hierarchical structure accounting for the contributions of the economic, social and environmental dimensions of sustainability. In our results, Bulgaria, Croatia, Lithuania and Poland are the countries with the strongest growth rate of sustainability, while countries reaching the 90th percentile of the score in sustainability include Austria, Czechia, Estonia, France, Germany, Hungary, Latvia, Lithuania, Slovakia and Sweden. In overall, the social and the environmental dimensions have similar levels, while the level of the economic dimension is definitely higher. Interestingly, several countries with a high level of sustainability are characterized by a decline of the economic dimension, including Austria, Finland, Italy, Latvia and Slovakia. The reliability of our composite indicator is supported by the substantial agreement of sustainability scores with subsidies attributed by the Common Agricultural Policy (CAP). Therefore, our proposal represents a valuable resource not only to monitor the progress of EU member countries towards sustainability objectives, but also to refine the scheme for the attribution of CAP subsidies in order to stimulate specific sustainable dimensions.
Notes

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

1 Introduction

Nowadays, the agricultural sector is called to face in the front row the challenge of satisfying food demand of the rapidly increasing world population. For this reason, sustainability of agriculture has become a widely spread theme among international decision makers. Specifically, the Food and Agriculture Organization (FAO) has outlined five principles of sustainable agriculture: (i) increase of productivity, employment and value addition in food systems, (ii) protection and enhancement of natural resources, (iii) improvement of livelihoods and promotion of inclusive economic growth, (iv) enhancement of the resilience of people, communities and ecosystems, (v) adaptation of governance to new challenges (Food and Agriculture Organization 2014). Also, the concept of agricultural sustainability has been integrated into the objectives of the Common Agricultural Policy (CAP) of the European Union (EU), and has found a significant place in the EU scientific research program Horizon 2020 (European Commission 2011) and in the 2030 agenda for the Sustainable Development Goals (SDGs) of the United Nations (UN General Assembly 2015). However, despite the widely acknowledged importance of sustainable agriculture for economic systems around the world, consensus on how agricultural sustainability should be defined, pursued and measured is still far from being achieved (Zhang et al. 2021).
Several different tools have been developed to assess sustainability of agriculture in a holistic view, including RISE (Response-Inducing Sustainability Evaluation, Hani et al. 2003), SAFE (Sustainability Assessment of Farming and the Environment, Van Cauwenbergh et al. 2007), IDEA (Indicateur de Durabilité des Exploitations Agricoles, Zahm et al. 2008), SEAMLESS (System for Environmental and Agricultural Modelling Linking European Science and Society, Van Ittersuma et al. 2008), SAFA (Sustainability Assessment of Food and Agriculture, Food and Agriculture Organization 2013), PG (Public Goods, Gerrard et al. 2012), and the COSA method (Committee on Sustainability Assessment 2020). In these tools, agricultural sustainability is conceptualized into three main pillars (sustainable dimensions), which are measured through sets of indicators: (i) the economic dimension, pertaining to the efficient production of goods and services, (ii) the social dimension, concerning the improvement of conditions in rural areas, and (iii) the environmental dimension, referring to the management of natural resources.
Indicators are widely used in assessment tasks because they provide a quantitative and simplified view of specific phenomena. Therefore, in principle, even the assessment of sustainability may benefit from their employment. Unfortunately, indicators involve significant difficulties in the selection and aggregation processes, which are reflected by the wide variability in the methodology across existing tools for the assessment of agricultural sustainability (De Olde et al. 2016; Chopin et al. 2021). Several guidelines for the selection of indicators have been proposed in the literature, with emphasis on the principles of parsimony, sufficiency and availability (Latruffe et al. 2016; Talukder et al. 2020). However, existing assessment tools are still a long way from converging towards a common core set of indicators, raising doubts about the achievement of standardized tools with general validity and applicability (De Olde et al. 2016).
The selection of indicators is not the only step determining the validity of assessment tasks. In fact, once indicators are selected, the underlying information should be extracted, interpreted and communicated in an easily intelligible form to policy makers. Currently, there is no consensus among existing assessment tools whether the indicators should be aggregated or considered individually (Chopin et al. 2021). Aggregation of indicators into composite indicators (Organisation for Economic Co-Operation and Development 2008) is an appealing approach as it provides one or few synthetic measures of sustainability that ease comparisons across different systems. However, the construction of composite indicators is subjected to several arbitrary choices that may influence the final results, especially the aggregation method and the weighting scheme (Terzi et al. 2021). In order to reconcile the two approaches, some authors have suggested to employ both individual and aggregated indicators, where the former are used to analyse each system and the latter to make comparisons among systems (Bockstaller et al. 2008).
Issues of agricultural sustainability may differ across the various geographical scales, i.e., farms, regions and countries. Therefore, in order to achieve a holistic view of agricultural sustainability, the integration of different geographical scales is just as important as the integration of sustainable dimensions. Many policies, management programs and assessments targeting the conservation of ecosystems and well-being fail because they do not properly address such integration (Millennium Ecosystem Assessment 2005). Also, the temporal attribute has an important role, as it allows to assess not only the level, but also the trend of sustainability.
In this paper, we focus on the assessment of agricultural sustainability in the EU. In our review of the literature, we found a total of twelve studies: five conducted at farm level and seven conducted at country level. Surprisingly, all of these studies fail to provide a holistic view of agricultural sustainability in a relevant temporal horizon that could effectively support the design of policies. On one hand, all studies conducted at farm level cover all the three sustainable dimensions but rely on cross-sectional data. On the other hand, among studies conducted at country level, some cover only a subset of the sustainable dimensions, others focus on a small set of countries, still others rely on cross-sectional data. Studies conducted at farm level have the opportunity to directly adopt existing assessment methods, especially for what concerns the selection of indicators, and data can be collected through direct interviews. However, the results are difficult to generalize at higher geographical scales, thus they have limited relevance to policy makers. Instead, studies conducted at country level provide a more general information which is suited to international policy making, but computing the indicators suggested by existing assessment tools may be impracticable due to scarce availability, or even unavailability, of data at the national scale (see the set of indicators proposed by Talukder et al. 2020 based on the existing literature). Clearly, whichever the geographical scale, the problem of data unavailability is further emphasized when the temporal evolution is considered, thus justifying the small number of studies based on longitudinal data at both farm and country level.
This paper aims at filling the gap of existing empirical studies assessing sustainability of EU agriculture by achieving a holistic view in a relevant temporal horizon. A composite indicator is constructed based on the geometric aggregation of 12 basic indicators measured yearly in the period 2004–2020 (17 years) on all EU countries plus United Kingdom, with weights determined endogenously according to the Benefit of Doubt (BoD) approach (Cherchye et al. 2007; Zhou et al. 2010; Vidoli et al. 2015). Our composite indicator has a two-level hierarchical structure accounting for the contributions of the three sustainable dimensions. Geometric aggregation allows a small degree of compensation to reflect the fact that sustainable development is achieved only when all or most individual sustainability goals are pursued, while the BoD weighting scheme, which has never been applied in the assessment of agricultural sustainability in the EU, permits to infer the relative importance of each basic indicator and sustainable dimension in the achievement of sustainability without relying on subjective opinions.
This paper is structured as follows. In Sect. 2, the literature on the assessment of agricultural sustainability in the EU is reviewed. In Sect. 3, the selection of indicators and the data collection process are described. In Sect. 4, the methodology employed in the construction of the composite indicator is detailed. In Sect. 5, the results are presented and discussed, including the comparison with the attribution of CAP subsidies and the analysis of sensitivity to different aggregation methods and weighting schemes. Section 6 contains concluding remarks and purposes for future work.

2 Literature Review

The characteristics of existing studies assessing agricultural sustainability in the European Union (EU) are briefly reviewed in Table 1. We see that studies conducted at farm level (Gómez-Limón and Sanchez-Fernandez 2010; Majewski 2013; Ryan et al. 2016; Gaviglio et al. 2017) cover all the three sustainable dimensions, but they all rely on cross-sectional data and thus they disregard the temporal evolution of sustainability. Instead, among studies conducted at country level, some cover only a subset of the sustainable dimensions (Cristache et al. 2018; Czyzewski et al. 2020), others focus on a small set of countries (Radovanović and Lior 2017; Mili and Martínez-Vega 2019), still others rely on cross-sectional data (Nowak et al. 2019; Cataldo et al. 2020). The study in Magrini (2022) is the only exception covering all the three sustainable dimensions and considering a broad set of countries longitudinally, although the assessment is focused on the growth rate of sustainability and not on its level.
Table 1
Summary of the characteristics of existing studies assessing agricultural sustainability in the EU
Author (year)
Units of observation
Sustainable dimensions
Period of observation
Methodology
Gómez-Limón and Sanchez-Fernandez (2010)
349 farms in Spain
Economic, social, environmental (16 indicators)
Cross-sectional, 2008 data from questionnaires
One composite combining different aggregation methods (AA and GA) and weighting schemes (a priori and based on principal components)
Majewski (2013)
120 farms in Poland
Economic, social, environmental (56 indicators)
Cross-sectional, 2012 data
Three composites, one for each sustainable dimension, with AA and uniform weights
Ryan et al. (2016)
1000 farms in Ireland
Economic, social, environmental (14 indicators)
Cross-sectional, 2012 data from direct interviews
Three composites, one for each sustainable dimension, with AA and uniform weights
Gaviglio et al. (2017)
50 farms in Italy
Economic, social, environmental (42 indicators)
Cross-sectional, 2012 data from questionnaire
Composite based on the Agri-environmental Footprint Index (AFI, Purvis et al. 2009)
Radovanović and Lior (2017)
12 EU countries and Russia
Economic, environmental (20 indicators)
Cross-sectional, 2014 data
One composite with AA and a priori weights
Cristache et al. (2018)
29 European countries
Economic, environmental (9 indicators)
2009–2016, yearly data
Fixed effects regression to assess the impact of new technologies and organic farming on the value of agricultural production
Mili and Martínez-Vega (2019)
50 provinces of Spain
Economic, social, environmental (22 indicators)
Cross-sectional, mostly 2009 data
Three composites, one for each sustainable dimension, with AA and uniform weights
Nowak et al. (2019)
28 EU countries
Economic, social, environmental (25 indicators)
Cross-sectional, mostly 2016 data
One composite based on the TOPSIS method (Hwang and Yoon 1981)
Czyzewski et al. (2020)
25 EU countries
Environmental (7 indicators)
2004–2017, yearly data
Environmental sustainable value (ESV) method (Grzelak et al. 2019)
Cataldo et al. (2020)
28 European countries
Economic, social, environmental (16 Sustainable Development Goals)
Cross-sectional, mostly 2017 data
Two-level composite based on Partial Least Squares Path Modelling (PLS-PM)
Dabkiene et al. (2021)
1300 farms in Lithuania
Social, environmental (13 indicators)
Cross-sectional, 2017 data
Composite based on the Agri-environmental Footprint Index (AFI, Purvis et al. 2009)
Magrini (2022)
26 European countries
Economic, social, environmental (12 indicators)
2004–2018, yearly data
Group-based multivariate trajectory modelling (Nagin et al. 2018)
Unless otherwise stated, data consist of objective measures
AA: arithmetic aggregation, GA: geometric aggregation
The method of assessment differs across studies in Table 1, but the construction of composite indicators, employed by nine studies out of twelve, is the most common approach. In Gómez-Limón and Sanchez-Fernandez (2010), both arithmetic and geometric aggregation is considered and combined with weights based on prior judgements and on principal component analysis. In Majewski (2013), Ryan et al. (2016), and Mili and Martínez-Vega (2019), one composite is constructed for each sustainable dimension using arithmetic aggregation and uniform weights, i.e., admitting full compensation and attributing the same importance to each indicator. In Radovanović and Lior (2017), a composite is constructed using arithmetic aggregation and different weighting methods based on several scenarios. Multi-criteria decision analysis is adopted by three studies: the Agri-environmental Footprint Index (AFI, Purvis et al. 2009) is employed in Gaviglio et al. (2017) and in Dabkiene et al. (2021), while the method of similarity to the ideal solution (TOPSIS, Hwang and Yoon 1981) is applied by Nowak et al. (2019). In Cataldo et al. (2020), an innovative weighting method based on Partial Least Squares Path Modelling (PLS-PM) with second-order formative constructs is proposed. This method has the advantage to provide one weight for each indicator and each sustainable dimension, thus making the results easier to interpret, and to not require correlation among basic indicators. In Magrini (2022), EU countries are clustered according to common trends of sustainable objectives through group-based multivariate trajectory modelling (Nagin et al. 2018).
Arithmetic aggregation (weighted sum) and geometric aggregation (weighted product) are distinguished by the degree of compensation. Specifically, arithmetic aggregation admits full compensation, i.e., it allows to cancel a bad performance in a basic indicator through a performance of the same intensity but of opposite sign in another basic indicator. On the contrary, using geometric aggregation, the compensation of a bad performance in a basic indicator requires a good performance of higher intensity in other basic indicators. Although arithmetic aggregation is often preferred in the assessment of agricultural sustainability in the EU (see Table 1), we believe that the underlying assumption of full compensation is undesirable because sustainable development is achieved only when all or most individual sustainability goals are pursued. In this view, we believe that geometric aggregation is more suited to the assessment of sustainability due to its low degree of compensation, even if establishing the correct degree of compensation to assume remains challenging due to the lack of consensus on how agricultural sustainability should be defined, pursued and measured (Zhang et al. 2021).
As it can be noted from Table 1, existing studies assessing agricultural sustainability in the EU adopt different weighting methods. This variability reflects the existence of several different approaches without a widely accepted methodology. Essentially, weights can be set uniformly to give the same importance to each indicator and/or dimension, defined a priori with the help of experts’ and stakeholders’ opinions, or computed endogenously (i.e., empirically from data). A good review of weighting methods can be found in Organisation for Economic Co-Operation and Development (2008) and in Terzi et al. (2021). Uniform and a priori weighting are the most common schemes adopted by existing studies assessing sustainability of EU agriculture. Uniform weighting is easy to understand and replicate, but it cannot provide insights into the importance of indicators and may involve the risk of double weighting. The a priori definition of weights, commonly performed through multi-criteria decision analysis (see, for example, Talukder et al. 2018), represents the most transparent way to construct composite indicators, but it is potentially affected by bias due to scientific consensus or policy priorities, and it may be difficult or even impossible to be generalized across different geographical regions.
Several methods to determine the weights endogenously have been proposed to avoid sources of subjectivity. For instance, principal components and factorial analysis can be exploited to determine the weights based on empirical correlations. Although weights determined in this way can be interpreted as correlations with some underlying constructs, this approach have been criticized because the importance of indicators does not necessarily depend on their covariance structure. The Benefit of Doubt (BoD) approach (Cherchye et al. 2007; Zhou et al. 2010; Vidoli et al. 2015) is an alternative weighting method based on benchmarking arguments, i.e., weights are assigned in order to maximize the overall performance of units. Therefore, a unit with a relatively good (or bad) performance in a specific indicator indicates that such unit considers the underlying objective as more (or less) important to achieve a good overall performance. BoD weighting is superior to correlation-based schemes because it does not require indicators to be correlated and is unit invariant (Cooper et al. 2000, p. 39), thus normalization of indicators is not needed. However, it may attribute excessively low or high weights to indicators with the consequent risk of cancelling the contribute of some weak objectives. A commonly adopted solution to attenuate this inconvenient is the use of proportion constraints in order to bound the relative contribution of each indicator to the composite (Cherchye et al. 2007).
Although the BoD weighting scheme has not yet been adopted to assess agricultural sustainability in the EU, it has received a large popularity in the last two decades, as witnessed by several notable applications to a large variety of research fields, including human development (Despotis 2005), technological achievement (Cherchye et al. 2006), quality of life (Morais and Camanho 2011), internal market (Cherchye et al. 2007), competitiveness (Bowen and Moesen 2011), student evaluation (Rogge 2011), environmental performance (Zanella et al. 2011), digital access (Gaaloul and Khalfallah 2014), and health system evaluation (Lauer et al. 2004; Vidoli et al. 2015). In this view, the use of the BoD weighting scheme to assess sustainability of EU agriculture is definitely attracting.
Partially Ordered Sets (POSets) have been recently proposed as an alternative to composite indicators (Alaimo et al. 2021a, b; Fattore 2017). In essence, POSets can provide a (partial) order on the combinations of basic indicators’ values, thus aggregation is avoided. Although POSets overcome several limitations of composite indicators, they are designed for ordinal basic indicators and involve a computational complexity that is exponential in the number of indicators and of their categories. Therefore, we believe that POSets are not suited to the assessment of agricultural sustainability because, according to existing assessment tools, a large number of indicators should be considered and most of them are quantitative.

3 Selection of Indicators and Data Collection

The selection of indicators was based on guidelines outlined in Van Cauwenbergh et al. (2007). Although these guidelines have been published more than ten years ago as part of the SAFE assessment tool, they have inspired several recent assessment tools and have often been appreciated in some recent critical reviews (see, for example, Latruffe et al. 2016; De Olde et al. 2016; Talukder et al. 2020). Also, SAFE consists of a smaller set of objectives compared to most existing assessment tools, thus making possible to select indicators that can be computed at country level based on publicly released statistics.
Our procedure for selecting indicators and collecting data was the following. Firstly, we identified all the objectives suggested in Van Cauwenbergh et al. (2007) that could be measured by at least one indicator for which data are released by international institutions and organizations. Secondly, we selected a set of indicators and a temporal window as large as possible balancing representativeness of the three sustainable dimensions (economic, social and environmental dimensions) and availability of time series data. In the data collection process, we tolerated the occurrence of at most six missing values for each time series (one third), with no more than two consecutive missing values internally to the time series and no more than one missing value at the extremes.
The resulting dataset comprises twelve indicators: five for the economic, three for the social and four for the environmental dimension, measured yearly on all the 27 EU countries plus United Kingdom in the period 2004–2020 (17 years). Table 2 contains a brief description, objective and data source of the selected indicators, while a detailed description is provided in Sect. 3.1. Details on the imputation of missing values and on cointegration analysis are given in Sect. 3.2.
Table 2
Description, objective according to Van Cauwenbergh et al. (2007), and data source of the selected indicators
Economic dimension
Indicator
Description
Objective
Source
\(X_1\)
Total Factor Productivity (TFP) of agriculture (index 2015=100)
Agricultural activities are economically and technically efficient
International agricultural productivity (United States Department of Agriculture 2022).
\(X_2\)
Net capital stocks in agriculture (2015 US dollars) to gross value added of agriculture (2015 US dollars)
Land tenure arrangements are optimal
Faostat (Food and Agriculture Organization 2022): element 6192, item 22034
\(X_3\)
Ratio young/elderly for farm managers (number of managers with less than 35 years by 100 managers with 55 years and over)
Inter-generational continuation of farming activity is ensured
Common Monitoring and Evaluation Framework for the CAP 2014-2020 (European Commission 2020a): product code CTX_SEC_23_3
\(X_4\)
Real income of agricultural factors per paid annual work unit (index 2010=100)
Farm income is ensured
Eurostat database (European Commission 2022): product code AACT_EAA06 (indicator A)
\(X_5\)
Net entrepreneurial income of agriculture per unpaid annual work unit (index 2010=100)
Farm income is ensured
Eurostat database (European Commission 2022): product code AACT_EAA06 (indicator B)
Social dimension
Indicator
Description
Objective
Source
\(X_6\)
Median equivalised net income in rural areas (1000 euros purchasing power standard)
Equity is maintained or increased
Eurostat database (European Commission 2022): product code ILC_DI17
\(X_7\)
At-risk-of-poverty rate in rural areas (%)
Equity is maintained or increased
Eurostat database (European Commission 2022): product code ILC_LI43
\(X_8\)
Unemployment rate in rural areas (%)
Equity is maintained or increased
Eurostat database (European Commission 2022), code LFST_R_URGAU
Environmental dimension
Indicator
Description
Objective
Source
\(X_9\)
Production of renewable energy from agriculture (tonnes of oil equivalent per hectare of utilized agricultural area)
Energy flow is adequately buffered
Common Monitoring and Evaluation Framework for the CAP 2014–2020 (European Commission 2020a): product code CTX_ENV_43_1
\(X_{10}\)
Area under organic cultivation (share of utilized agricultural area, %)
Soil physical and chemical quality is maintained or increased
Faostat (Food and Agriculture Organization 2022): element 5110, items 6671 and 6610
\(X_{11}\)
Greenhouse gas emissions due to agriculture (million CO2 equivalent grams per hectare of utilized agricultural area)
Pollution levels are reduced
Faostat (Food and Agriculture Organization 2022): element 723113, item 1711
\(X_{12}\)
Gross nitrogen balance (tonnes of nutrient per hectare of utilized agricultural area)
Soil loss is minimized
Eurostat database (European Commission 2022): product code AEI_PR_GNB

3.1 Selected Indicators

The selected indicators for the economic dimension of agricultural sustainability cover the following objectives in Van Cauwenbergh et al. (2007):
  • “Agricultural activities are economically and technically efficient”, measured through the Total Factor Productivity (TFP) index of agriculture with base year 2015 computed by the United States Department of Agriculture (\(X_1\));
  • “Land tenure arrangements are optimal”, measured through the ratio of net capital stocks to gross value added (\(X_2\), source: Faostat);
  • “Inter-generational continuation of farming activity is ensured”, measured through the ratio young/elderly for farm managers (\(X_3\), source: Common Monitoring and Evaluation Framework for the CAP 2014–2020), where young managers are those with less than 25 years and elderly managers are those with more than 55 years;
  • “Farm income is ensured”, measured through the real income of agricultural factors per paid annual work unit (\(X_4\)) and the net entrepreneurial income of agriculture per unpaid annual work unit (\(X_5\)), both computed by Eurostat as indices with base year 2010.
Unfortunately, economic objectives outlined in Van Cauwenbergh et al. (2007) related to farmer’s training, market activities and dependency on external finance were disregarded due to data unavailability.
For what concerns the social dimension of agricultural sustainability, we covered the objective “Equity in the farm community is maintained or increased” in Van Cauwenbergh et al. (2007) through the following three indicators: median equivalised net income in rural areas (\(X_6\)), at-risk-of-poverty rate in rural areas (\(X_7\)) and unemployment rate in rural areas (\(X_8\)), all sourced to Eurostat. Unfortunately, we did not find reliable data on social objectives outlined in Van Cauwenbergh et al. (2007) related to food quality, integration, labour and health conditions. However, it is worth noting that indicator \(X_{\text {ENV},2}\) (area under organic cultivation) selected for the environmental dimension as described below, partially covers the provision of food of good quality. All the shortcomings in the coverage of the social dimension of agricultural sustainability were independent of our effort, in fact the lack of data on social indicators is widely recognized (Latruffe et al. 2016) and, to our knowledge, the three indicators that we selected are the only measures for which time series data referred to EU countries are publicly available.
The selected indicators for the environmental dimension of agricultural sustainability cover the following objectives in Van Cauwenbergh et al. (2007):
  • “Energy flow is adequately buffered”, measure through the production of renewable energy from agriculture (\(X_9\), source: Common Monitoring and Evaluation Framework for the CAP 2014–2020);
  • “Soil physical and chemical quality is maintained or increased”, measured through the area under organic cultivation (\(X_{10}\), source: Faostat);
  • “Pollution levels are reduced”, measured through greenhouse gas emissions due to agriculture (\(X_{11}\), source: Faostat);
  • “Soil loss is minimized”, measured through the gross nitrogen balance (\(X_{12}\), source: Eurostat).
Unfortunately, the measurement of the nutrient balance was limited to nitrogen because the time series for the other available nutrients (phosphorus and potassium) contain a large number of missing values. For the same reason, we disregarded environmental objectives outlined in Van Cauwenbergh et al. (2007) related to natural conservation, soil mass flux, water supply and ecosystem services.
Summary statistics of the selected indicators are shown in Table 3. From a first look to the data, it is apparent that the average annual changes in the period 2004–2020 across the considered EU countries are consistent with sustainability for most indicators. The ones with the highest change are the real income of agricultural factors per paid annual work unit (\(X_4\), \(+\)2.28%), the median equivalised net income in rural areas (\(X_6\), \(+\)3.14%) and the production of renewable energy from agriculture (\(X_9\), \(+\)19.85%). The huge growth rate of this last indicator is explainable by the commitment of EU countries to obtain 20% of its energy from renewable sources by 2020. The ratio young/elderly for farm managers (\(X_3\)) is the only indicator with an average annual change not consistent with sustainability (−2.84%).
Table 3
Summary statistics of the selected indicators in the period 2004–2020
Indicator
Min.
\(\text {Q}_1\)
Median
\(\text {Q}_3\)
Max.
Mean
SD
Annual %
\(X_1\)
61.4
90.6
97.1
101.1
126.6
95.8
10.1
\(+\)0.54
\(X_2\)
0.9
3.2
4.2
5.4
23.8
5.1
3.4
\(+\)1.25
\(X_3\)
1.7
7.7
10.3
17.3
51.6
13.9
10.1
−2.84
\(X_4\)
55.5
88.3
100.1
121.4
248.0
107.6
28.9
\(+\)2.28
\(X_5\)
33.4
85.6
100.3
135.5
411.3
116.0
49.7
\(+\)1.88
\(X_6\)
1.8
8.0
13.6
17.9
31.1
13.3
6.2
\(+\)3.14
\(X_7\)
1.9
5.2
7.3
10.5
28.8
8.5
4.8
−1.76
\(X_8\)
5.2
13.3
17.9
24.7
40.4
19.2
7.3
−0.30
\(X_9\)
0.2
19.9
58.6
115.7
1233.6
115.1
182.0
\(+\)19.85
\(X_{10}\)
0.0
2.6
5.0
7.9
25.3
6.2
5.0
\(+\)8.35
\(X_{11}\)
0.9
1.6
2.5
3.6
13.5
3.2
2.5
−0.39
\(X_{12}\)
11.0
33.8
46.9
79.7
270.9
66.5
52.0
−0.75
Min: minimum, \(\text {Q}_1\): first quartile, \(\text {Q}_3\): third quartile, Max: maximum, SD: standard deviation, Annual %: annual percentage change averaged across countries

3.2 Imputation of Missing Values and Cointegration Analysis

In the data collection process, we tolerated the occurrence of at most six missing values for each time series (one third), with no more than two consecutive missing values internally to the time series and no more than one missing value at the extremes. The only exception was represented by the ratio young/elderly for farm managers (\(X_3\)), which is systematically observed in 2005, 2007, 2010, 2013 and 2016, and missing otherwise. Given the regular pattern of observed values in the considered period (2004–2020) and the valuable and not substitutable information provided by this indicator, we decided to not exclude it from the analysis. It is worth remarking that half of the selected indicators have a missing value in 2020, specifically the agricultural TFP index (\(X_1\)), the ratio young/elderly for farm managers (\(X_3\)), and all the environmental indicators (\(X_9\), \(X_{10}\), \(X_{11}\) and \(X_{12}\)). However, this does not constitute a violation of the data collection criteria, and, moreover, the consideration of year 2020 allows our study to account for the most recent available information.
In order to obtain a complete dataset, we imputed missing values based on a Vector Auto-Regressive (VAR) model with fixed intercepts for countries. The procedure was the following. Firstly, we imputed missing values internally to the time series through linear interpolation. Secondly, we performed a graphical check of stationarity and noted that all the time series were definitely non-stationary, as confirmed by the ADF (Dickey and Fuller 1981) and KPSS (Kwiatkowski et al. 1992) tests. Therefore, we specified the VAR model on logarithmic returns to avoid spurious regression (Granger and Newbold 1974). Let \({\varvec{x}}_{i,t}=(x_{i,t,1},\ldots ,x_{i,t,p})'\) be the multivariate observation of the p indicators on country i at time t. The vector of logarithmic returns for country i at time t is:
$$\begin{aligned} {\varvec{z}}_{i,t}\equiv\varDelta \log {\varvec{x}}_{i,t}=(\varDelta \log x_{i,t,1},\ldots ,\varDelta \log x_{i,t,p})' \end{aligned}$$
(1)
where \(\varDelta \log x_{i,t,j}=\log x_{i,t,j}-\log x_{i,t-1,j}\), which approximates the relative change in the value of the j-th indicator with respect to the previous time point. The adopted VAR specification for a given lag length \(L\in \mathbb {N}^+\) was:
$$\begin{aligned} {\varvec{z}}_{i,t}={\varvec{\alpha }}_i+\sum _{l=1}^L\mathbf {B}_l {\varvec{z}}_{i,t-l}+{\varvec{u}}_{i,t} \end{aligned}$$
(2)
where:
$$\begin{aligned} \mathbf {B}_l=\begin{pmatrix} \beta _{1,1,l}&{}\beta _{1,2,l}&{}\ldots &{}\beta _{1,p,l}\\ \beta _{2,1,l}&{}\beta _{2,2,l}&{}\ldots &{}\beta _{2,p,l}\\ \cdots &{}\cdots &{}\ddots &{}\cdots \\ \beta _{p,1,l}&{}\beta _{p,2,l}&{}\ldots &{}\beta _{p,p,l}\\ \end{pmatrix} \end{aligned}$$
(3)
is the \(p\times p\) matrix of coefficients at lag l, \({\varvec{\alpha }}_i=(\alpha _{i,1},\ldots ,\alpha _{i,p})'\) is the p-dimensional vector of fixed intercepts for country i, and \({\varvec{u}}_{i,t}=(\varvec{u}_{i,t,1},\ldots,\varvec{u}_{i,t,p})'\) is the vector of random errors for country i at time t such that:
$$\begin{aligned}&\mathbb {E}({\varvec{u}}_{i,t})={\varvec{0}}\\& \mathbb {E}({\varvec{u}}_{i,t}{\varvec{u}}_{i,t}')=\Sigma \end{aligned}$$
(4)
Note that, since the VAR model in formula (2) is specified on logarithmic returns, the intercepts \({\varvec{\alpha }}_i\) represent the coefficients of linear deterministic trends.
The Expectation-Maximization (EM) algorithm (Dempster et al. 1977) was employed to compute the expected value of missing data for \(L=1,2,3,4\), and the imputation provided by the model with the minimum Bayesian information criterion was retained as the final one. The EM algorithm was implemented as follows:
0.
missing values are randomly initialized to obtain a complete dataset;
 
1.
(E-step) the VAR model in formula (2) is fitted to the complete dataset;
 
2.
(M-step) missing values are filled by their prediction based on the fitted model to obtain a new complete dataset;
 
3.
the procedure is iterated from step 1 until convergence of the likelihood.
 
All the computations were performed in R Core Team (2022) through a program developed by the authors. Among the different lag lengths under consideration (\(L=1,2,3,4\)), we found \(L=1\) as the optimal one.
Before constructing the composite indicator, we tested whether the time series of the selected indicators, after imputation of missing values, were cointegrated (Engle and Granger 1987). Cointegration ensures the existence of a long-term relationship among non-stationary time series, thus it is important to justify the multivariate analysis of the selected indicators. Since our data are structured as a panel, we tested cointegration according to Pedroni (1999). We found that, for half of the selected indicators, the majority among the eleven statistics proposed by Pedroni (1999) leaded to the rejection of the hypothesis of no cointegration. Instead, for the other half of the indicators, few or none of the statistics confirmed cointegration. This result appears satisfactory given the small length of the time series (17 time points), because cointegration tests are notoriously characterized by low power in small samples.

4 Methodology

Our composite indicator for agricultural sustainability in EU countries is based on the weighted product method (geometric aggregation of basic indicators), with weights determined endogenously according to the Benefit of Doubt (BoD) approach (Cherchye et al. 2007; Zhou et al. 2010; Vidoli et al. 2015). The BoD approach consists of selecting the weights by maximizing the score of each observation. The BoD weighting scheme is unit invariant, i.e., weights are adapted to the units of measurement of basic indicators (Cooper et al. 2000, p.39), thus normalization is not required. Nevertheless, basic indicators should have the same polarity, thus we preliminarily applied the reciprocal function to all indicators negatively correlated with sustainability, which include the at-risk-of-poverty rate in rural areas (\(X_7\)), the unemployment rate in rural areas (\(X_8\)), greenhouse gas emissions due to agriculture (\(X_{11}\)) and the gross nitrogen balance (\(X_{12}\)).
Let \(i=1,\ldots ,n\) denote the countries, \(j=1,\ldots ,p\) the basic indicators, and \(t=1,\ldots ,T\) the time points. Also, let \(x_{i,j,t}\) and \(w_{i,j,t}\) be, respectively, the measurement and the weight of the basic indicator \(X_j\) for country i at time t. The score in sustainability for country i at time t is defined as:
$$\begin{aligned} \text {SUS}_{i,t}=\prod _{j=1}^p x_{i,j,t}^{w_{i,j,t}} \end{aligned}$$
(5)
Since the basic indicators can be partitioned into the economic (ECO), social (SOC) and environmental (ENV) sustainable dimensions, the score in sustainability given by formula (5) can be decomposed into the product of the score in each sustainable dimension:
$$\begin{aligned} \text {SUS}_{i,t}&=\text {ECO}_{i,t}\cdot \text {SOC}_{i,t}\cdot \text {ENV}_{i,t}\\ \text {ECO}_{i,t}&=\prod _{j:X_j\in \text {ECO}} x_{i,j,t}^{w_{i,j,t}}\\ \text {ENV}_{i,t}&=\prod _{j:X_j\in \text {ENV}} x_{i,j,t}^{w_{i,j,t}}\\ \text {SOC}_{i,t}&=\prod _{j:X_j\in \text {SOC}} x_{i,j,t}^{w_{i,j,t}} \end{aligned}$$
(6)
For each pair (it), the weights \(w_{i,1,t},\ldots ,w_{i,j,t},\ldots ,w_{i,p,t}\) are determined by solving the following problem:
$$\begin{aligned}&\max \prod _{j=1}^{p} x_{i,j,t}^{w_{i,j,t}}\qquad \text {subjected to:}\\&\prod _{j=1}^p x_{k,j,l}^{w_{i,j,t}}\le {e} \qquad k=1,\ldots ,n;\qquad l=1,\ldots ,T\\&w_{i,j,t}\ge 0 \qquad j=1,\ldots ,p\\&\left( \prod _{j=1}^p I_{i,j,t}^{w_{i,j,t}}\right) ^{0.05}\le I_{i,j,t}^{w_{i,j,t}} \le \left( \prod _{j=1}^p I_{i,j,t}^{w_{i,j,t}}\right) ^{0.15}\qquad j=1,\ldots ,p \end{aligned}$$
(7)
The last constraint, which bounds between 5% and 15% the contribution of each basic indicator to the composite, is introduced to avoid excessively low or high weights.
Note that the logarithm of the composite indicator SUS in formula (5) is a linear combination of the logarithmic values of basic indicators:
$$\begin{aligned} \log \text {SUS}_{i,t}=\sum _{j=1}^p w_{i,j,t}\log x_{i,j,t} \end{aligned}$$
(8)
Therefore, the optimization problem in formula (7) becomes linear after logarithmic transformation of basic indicators. Precisely, for each pair (it), the weights \(w_{i,1,t},\ldots ,w_{i,j,t},\ldots ,w_{i,p,t}\) are determined by solving the following problem:
$$\begin{aligned}&\max \sum _{j=1}^{p} w_{i,j,t}\log x_{i,j,t}\qquad \text {subjected to:}\\&\sum _{j=1}^p w_{i,j,t}\log x_{k,j,l}\le 1 \qquad k=1,\ldots,n; \qquad l=1,\ldots ,T\\&w_{i,j,t}\ge 0\qquad j=1,\ldots ,p\\&0.05\le \frac{w_{i,j,t}\log x_{i,j,t}}{\sum _{j=1}^p w_{i,j,t} \log x_{i,j,t}}\le 0.15 \qquad j=1,\ldots ,p \end{aligned}$$
(9)
This optimization was performed in R Core Team (2022) through a program developed by the authors.
Note that, on the logarithmic scale, the contribution of each basic indicator to the composite can be expressed as a share:
$$\begin{aligned} r_{i,j,t}=\frac{w_{i,j,t}\log x_{i,j,t}}{\sum _{j=1}^p w_{i,j,t}\log x_{i,j,t}} \end{aligned}$$
(10)
We refer to \(r_{i,j,t}\) as the relative importance of the basic indicator \(X_j\) for country i at time t. Analogously, the relative importance of sustainable dimensions ECO, SOC and ENV for country i at time t can be computed as the ratio of the logarithmic score in each dimension to the logarithmic score in sustainability:
$$\begin{aligned} \begin{aligned} r_{i,\text {ECO},t}&=\frac{\log \text {ECO}_{i,t}}{\log \text {SUS}_{i,t}}=\frac{\sum _{j:X_j\in \text {ECO}} w_{i,j,t}\log x_{i,j,t}}{\sum _{j=1}^p w_{i,j,t}\log x_{i,j,t}}\\ r_{i,\text {SOC},t}&=\frac{\log \text {SOC}_{i,t}}{\log \text {SUS}_{i,t}}=\frac{\sum _{j:X_j\in \text {SOC}} w_{i,j,t}\log x_{i,j,t}}{\sum _{j=1}^p w_{i,j,t}\log x_{i,j,t}}\\ r_{i,\text {ENV},t}&=\frac{\log \text {ENV}_{i,t}}{\log \text {SUS}_{i,t}}=\frac{\sum _{j:X_j\in \text {ENV}} w_{i,j,t}\log x_{i,j,t}}{\sum _{j=1}^p w_{i,j,t}\log x_{i,j,t}} \end{aligned} \end{aligned}$$
(11)
In order to assess the change in time of the composite indicator SUS and of its components ECO, SOC and ENV, we adopt the mobility index proposed by Giambona and Vassallo (2014). Let \(\varDelta R_{i,t}=R_{i,t}-R_{i,t-1}\) be the first order difference in rank at year t for country i, and \(\varDelta S_{i,t}=S_{i,t}-S_{i,t-1}\) be the first order difference in score at year t for country i. The mobility index for country i is defined as:
$$\begin{aligned} \text {MI}_{i}=\sum _{t=1}^T \left( -\varDelta {R}_{i,t}\frac{|\varDelta {S_{i,t}}|}{\sum _{i=1}^T|\varDelta {S_{i,t}}|}\right) \end{aligned}$$
(12)
It can be noted that the mobility index for a country is the mean of first order changes in rank weighed by first order changes in score. Therefore, it accounts not only for the absolute change of the country, but also for its relative change with respect to the other countries. The mobility index for a country takes positive (or negative) value in case of increasing (or decreasing) relative performance in the considered period, while a null value indicates an overall stability of the performance.

5 Results and Discussion

In this section, we report and discuss the results of our composite indicator. Sections 5.1 and 5.2 focus, respectively, on the trajectories of sustainability and on the relative importance of sustainable dimensions and basic indicators. Section 5.3 provides a comparison with the results of existing studies, while Sect. 5.4 compares our results with subsidies attributed by the Common Agricultural Policy (CAP). Finally, Sect. 5.5 reports the analysis of the sensitivity to different aggregation methods and weighting schemes.

5.1 Trajectories of Sustainability

Figure 1 shows the trajectories of the composite indicator SUS (in red) and of its economic (ECO, in blue), social (SOC, in orange) and environmental (ENV, in green) components in the period 2004–2020. We see that the trend of sustainability is pretty stable or has a moderate growth rate for most countries, and that no country has a definitely decreasing trend of sustainability. Countries showing a trajectory of sustainability with strong growth rate include Bulgaria, Croatia, Lithuania and Poland. Among countries with a non-decreasing trajectory, those reaching the 90th percentile of the score in sustainability are Austria, Czechia, Estonia, France, Germany, Hungary, Latvia, Lithuania, Slovakia and Sweden. Cyprus, Malta and Netherlands show an irregular trajectory of sustainability, but with a non-decreasing trend in recent years. For what concerns sustainable dimensions, the social and the environmental ones have similar levels for most countries, while the level of the economic dimension is definitely higher for all countries. It can be noted that the trend of the economic dimension is decreasing for Austria (which is the country with the highest level of sustainability), Finland, Italy, Latvia and Slovakia. Also, Cyprus and Sweden show a decreasing trend of the social dimension, while Czechia is characterized by a decreasing trend of the environmental dimension.
Mobility indices can be inspected to get an in-depth insight into the trajectories of sustainability of EU countries. In fact, the mobility index accounts for the evolution of the performance of each country relatively to the other ones. Average scores and mobility indices are shown in Table 4 and displayed in Figures 2 and 3. From Figure 2, it can be noted that the countries with average score in sustainability (SUS) above the third quartile are Austria (AT), Slovakia (SK), Sweden (SE), Hungary (HU), France (FR) and Czechia (CZ), and all of them has a positive mobility index, implying an overall improvement of sustainability in the period 2004–2020, with the exception of Czechia for which the mobility index is negative. Therefore, Czechia requires attention in the near future to prevent a degradation of its level of sustainability. Instead, countries with average score in sustainability (SUS) below the first quartile include Luxembourg (LU), Ireland (IE), Croatia (HR), Belgium (BE), Cyprus (CY), Netherlands (NL) and Malta (MT). The inspection of the mobility index is of core importance to design policies in favour of these countries: if positive, like in the case of Ireland (IE), Croatia (HR) and Malta (MT), policy makers should pay attention to the maintenance of the current trend; if negative, like in the case of Belgium (BE), Cyprus (CY), Luxembourg (LU) and Netherlands (NL), interventions aimed at targeting specific weak sustainability objectives should be considered.
Table 4
Average score, average rank and mobility index by country in the period 2004–2020
Country
Average score
Average rank
Mobility index
SUS
ECO
SOC
ENV
SUS
ECO
SOC
ENV
SUS
ECO
SOC
ENV
Austria
2.691
1.714
1.230
1.288
1.1
6.9
15.7
11.6
\(+\)0.030
−5.805
\(+\)0.199
\(+\)5.316
Belgium
2.291
1.327
1.381
1.254
24.6
25.9
3.0
16.9
−0.100
−0.627
−0.308
\(+\)1.265
Bulgaria
2.426
1.614
1.144
1.313
18.5
10.1
27.4
10.4
\(+\)1.241
\(+\)1.215
\(+\)0.025
−0.187
Croatia
2.328
1.569
1.224
1.212
23.6
14.1
18.8
22.0
\(+\)0.462
\(+\)0.193
\(+\)0.280
−0.880
Cyprus
2.096
1.425
1.259
1.169
26.4
23.2
12.8
25.8
−0.226
\(+\)0.583
\(+\)0.728
−0.262
Czechia
2.544
1.472
1.323
1.309
8.3
20.9
6.1
10.0
−0.283
\(+\)0.500
−0.400
−0.559
Denmark
2.497
1.554
1.339
1.201
15.4
15.2
4.5
22.7
\(+\)0.997
\(+\)0.052
−0.518
\(+\)0.135
Estonia
2.539
1.514
1.181
1.424
9.2
17.5
22.4
2.4
\(+\)0.992
−0.515
\(+\)4.297
−1.167
Finland
2.542
1.580
1.264
1.276
8.6
12.3
12.2
12.5
\(+\)0.049
−1.137
\(+\)0.379
\(+\)0.880
France
2.553
1.671
1.263
1.210
6.8
4.6
11.6
19.4
\(+\)0.285
\(+\)0.273
\(+\)0.333
−0.051
Germany
2.540
1.508
1.294
1.303
9.4
18.6
7.9
9.8
\(+\)0.648
−0.277
−0.574
\(+\)3.834
Greece
2.467
1.514
1.243
1.311
18.3
18.9
15.9
10.1
−0.337
\(+\)0.107
−0.286
−0.041
Hungary
2.567
1.645
1.177
1.327
5.4
6.2
23.9
6.3
\(+\)0.401
−0.365
\(+\)0.129
\(+\)0.017
Ireland
2.409
1.614
1.246
1.197
21.9
10.6
15.1
23.3
\(+\)0.354
\(+\)0.060
\(+\)0.111
−0.400
Italy
2.494
1.605
1.257
1.238
15.5
10.6
14.5
17.9
−0.174
−0.533
−0.027
\(+\)1.519
Latvia
2.542
1.587
1.158
1.385
8.4
12.0
25.6
3.2
\(+\)0.298
−0.707
−0.195
\(+\)0.563
Lithuania
2.501
1.631
1.185
1.296
14.0
8.6
22.7
11.4
\(+\)1.934
\(+\)0.428
\(+\)0.754
\(+\)0.489
Luxembourg
2.413
1.440
1.407
1.193
22.3
22.1
2.3
25.3
−0.050
\(+\)0.679
−0.486
−0.037
Malta
1.848
1.261
1.225
1.176
27.2
26.5
14.5
21.5
\(+\)0.256
\(+\)0.262
\(+\)1.865
\(+\)2.387
Netherlands
2.070
1.237
1.372
1.221
26.9
27.6
3.8
19.3
−0.295
−0.169
\(+\)1.297
\(+\)0.931
Poland
2.477
1.698
1.182
1.236
17.6
4.5
23.5
19.1
\(+\)0.258
\(+\)0.328
\(+\)0.160
−1.877
Portugal
2.489
1.582
1.240
1.271
16.5
12.7
17.2
13.9
\(+\)0.279
\(+\)0.221
\(+\)0.372
−1.208
Romania
2.521
1.431
1.244
1.417
11.9
23.3
15.6
2.3
\(+\)1.138
−0.340
\(+\)1.858
−0.125
Slovakia
2.593
1.622
1.194
1.342
3.4
8.2
20.6
5.2
\(+\)1.240
−0.585
\(+\)1.478
\(+\)2.030
Slovenia
2.528
1.652
1.266
1.209
10.5
6.3
11.8
20.2
\(+\)0.122
−0.306
\(+\)0.233
\(+\)0.029
Spain
2.485
1.531
1.237
1.312
16.8
16.5
17.1
10.2
\(+\)0.018
\(+\)0.119
−0.048
\(+\)0.045
Sweden
2.579
1.571
1.267
1.302
3.5
12.4
11.1
11.2
\(+\)0.062
−1.397
−1.922
\(+\)2.864
United Kingdom
2.505
1.617
1.289
1.202
13.9
9.8
8.2
22.1
−0.096
\(+\)0.364
−0.774
−0.026
Figure 3 provides a comparison between average scores and mobility indices by sustainable dimension. Such comparison may help, on one hand, in supporting the design of policies in favour of countries with a low level of sustainability, and, on the other hand, in monitoring the importance that countries with a high level of sustainability attribute to the sustainable dimensions. For instance, we see that the most problematic dimension for Cyprus (CY) and Luxembourg (LU) is the environmental one (average score below the first quartile and negative mobility index), followed by the social dimension (average score above the third quartile but negative mobility index), while the economic dimension is characterized by a low average score but with positive mobility. Instead, the weakest dimension for Belgium (BE) and Netherlands (NL) is the economic one, characterized by low average score and negative mobility. The weak performance of Austria (AT) in the economic dimension despite the excellent performance in sustainability (SUS), previously deduced from Figure 1, is confirmed by the highest average score in the economic dimension (ECO) combined with the highest negative value of the mobility index (Figure 3, left panel).

5.2 Relative Importance of Sustainable Dimensions and Basic Indicators

Figure 4 displays the trend of the relative importance of sustainability dimensions by country in the period 2004–2020, while Tables 5 and 6 report, for each country, mean and average annual change of the relative importance of each sustainable dimension and basic indicator.
We see that the economic dimension has the highest relative importance with an average across countries equal to 42.9%, followed by the environmental dimension (23.8%) and by the social dimension (22.4%). The ranks of the relative importance of sustainable dimensions differ within countries, but it can be noted that the economic dimension is ranked first for all countries excepting Belgium and Netherlands, for which it is ranked second after the social dimension. Instead, the social dimension is ranked first only for Belgium and Netherlands, and the environmental dimension is never ranked first.
Table 5
Relative importance (%) of sustainable dimensions by country
Country
ECO
SOC
ENV
Austria
53.36 (−1.54)
20.55 (\(+\)0.66)
25.10 (\(+\)1.11)
Belgium
28.12 (−0.70)
32.20 (\(+\)0.60)
22.52 (\(+\)0.66)
Bulgaria
47.77 (\(+\)0.82)
13.48 (\(+\)0.19)
27.20 (\(+\)0.28)
Croatia
44.98 (\(+\)0.61)
20.16 (\(+\)0.30)
19.16 (\(+\)0.29)
Cyprus
35.36 (\(+\)0.21)
22.89 (\(+\)0.16)
15.58 (\(+\)0.09)
Czechia
38.60 (−0.03)
27.93 (\(+\)0.46)
26.84 (−0.20)
Denmark
44.02 (\(+\)0.15)
29.18 (\(+\)0.11)
18.30 (\(+\)0.07)
Estonia
41.34 (−0.20)
16.61 (\(+\)0.66)
35.22 (\(+\)0.02)
Finland
45.63 (−0.47)
23.40 (\(+\)0.21)
24.26 (\(+\)0.48)
France
51.35 (−0.05)
23.32 (\(+\)0.30)
19.02 (\(+\)0.10)
Germany
41.01 (−0.17)
25.79 (−0.08)
26.38 (\(+\)0.69)
Greece
41.47 (\(+\)0.10)
21.73 (−0.04)
27.08 (\(+\)0.02)
Hungary
49.75 (−0.22)
16.22 (\(+\)0.46)
28.27 (\(+\)0.10)
Ireland
47.83 (\(+\)0.34)
22.01 (\(+\)0.26)
18.01 (\(+\)0.15)
Italy
47.22 (−0.69)
22.84 (\(+\)0.05)
21.31 (\(+\)0.83)
Latvia
46.14 (−0.45)
14.69 (\(+\)0.24)
32.46 (\(+\)0.60)
Lithuania
48.83 (−0.19)
16.90 (\(+\)0.71)
25.88 (\(+\)0.24)
Luxembourg
36.38 (\(+\)0.75)
34.09 (−0.50)
17.62 (\(+\)0.06)
Malta
22.80 (\(+\)1.41)
19.94 (\(+\)1.50)
15.86 (\(+\)1.37)
Netherlands
21.20 (−0.47)
31.51 (\(+\)0.86)
19.87 (\(+\)0.70)
Poland
52.86 (\(+\)0.29)
16.65 (\(+\)0.44)
21.15 (−0.21)
Portugal
45.75 (\(+\)0.39)
21.53 (\(+\)0.29)
23.92 (−0.51)
Romania
35.80 (−0.38)
21.79 (\(+\)0.38)
34.86 (\(+\)0.39)
Slovakia
48.21 (−0.32)
17.66 (\(+\)0.44)
29.39 (\(+\)0.39)
Slovenia
50.20 (\(+\)0.28)
23.57 (−0.01)
18.96 (\(+\)0.07)
Spain
42.59 (\(+\)0.11)
21.28 (\(+\)0.09)
27.17 (\(+\)0.08)
Sweden
44.96 (\(+\)0.69)
23.63 (−1.05)
26.14 (\(+\)0.71)
United Kingdom
48.07 (\(+\)0.38)
25.39 (−0.25)
18.37 (\(+\)0.03)
(Overall)
42.91 (\(+\)0.02)
22.39 (\(+\)0.27)
23.78 (\(+\)0.31)
Values are means across the period 2004–2020 with average annual change within brackets. ECO: economic dimension, SOC: social dimension, ENV: environmental dimension, Overall: average across all countries
Among the considered basic indicators, the net entrepreneurial income of agriculture (\(X_5\), economic dimension) has the highest relative importance with an average across countries equal to 13.74%, followed by the TFP index of agriculture (\(X_1\), economic dimension, 12.59%), the median equivalised net income in rural areas (\(X_6\), social dimension, 11.35%), greenhouse gas emissions due to agriculture (\(X_{11}\), environmental dimension, 8.96%), and the real income of agricultural factors (\(X_4\), economic dimension, 8.88%). The other basic indicators have an average relative importance across countries between 5% and 8%, although the ranks of their relative importance differ significantly within countries and no definite patterns can be deduced.
Table 6
Relative importance (%) of basic indicators by country
Country
\(X_1\)
\(X_2\)
\(X_3\)
\(X_4\)
\(X_5\)
\(X_6\)
Austria
5.81 (−0.43)
14.36 (\(+\)0.00)
12.93 (−0.62)
9.37 (\(+\)0.00)
11.47 (−0.63)
8.87 (\(+\)0.00)
Belgium
9.80 (−0.63)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
9.27 (−0.46)
15.00 (\(+\)0.00)
Bulgaria
14.99 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
13.99 (\(+\)0.14)
15.00 (\(+\)0.00)
5.00 (\(+\)0.00)
Croatia
15.00 (\(+\)0.00)
6.67 (−0.20)
5.00 (\(+\)0.00)
11.78 (\(+\)0.15)
15.00 (\(+\)0.00)
13.90 (\(+\)0.00)
Cyprus
15.00 (\(+\)0.00)
7.35 (\(+\)0.00)
5.00 (\(+\)0.00)
5.59 (\(+\)0.00)
15.00 (\(+\)0.00)
15.00 (\(+\)0.00)
Czechia
10.30 (−0.63)
5.00 (\(+\)0.00)
5.12 (\(+\)0.00)
6.53 (\(+\)0.48)
14.41 (\(+\)0.00)
5.12 (\(+\)0.00)
Denmark
7.49 (\(+\)0.45)
14.31 (−0.45)
5.00 (\(+\)0.00)
6.89 (\(+\)0.62)
14.41 (−0.62)
13.64 (\(+\)0.58)
Estonia
12.74 (−0.43)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
7.86 (\(+\)0.00)
13.82 (\(+\)0.00)
5.85 (\(+\)0.63)
Finland
15.00 (\(+\)0.00)
5.00 (\(+\)0.00)
6.36 (−0.62)
8.29 (\(+\)0.00)
14.29 (\(+\)0.00)
14.79 (\(+\)0.17)
France
14.97 (\(+\)0.00)
5.00 (\(+\)0.00)
7.06 (−0.62)
13.37 (\(+\)0.36)
14.41 (\(+\)0.00)
13.88 (−0.36)
Germany
10.22 (−0.14)
8.26 (\(+\)0.00)
7.32 (−0.62)
7.16 (\(+\)0.00)
11.12 (\(+\)0.37)
14.41 (\(+\)0.00)
Greece
14.88 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
6.11 (\(+\)0.07)
14.96 (\(+\)0.00)
13.89 (−0.07)
Hungary
13.38 (−0.42)
9.62 (−0.49)
5.00 (\(+\)0.00)
9.85 (\(+\)0.49)
15.00 (\(+\)0.00)
5.00 (\(+\)0.00)
Ireland
15.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
14.45 (−0.08)
15.00 (\(+\)0.00)
14.21 (\(+\)0.16)
Italy
12.91 (−0.63)
7.13 (−0.26)
5.00 (\(+\)0.00)
11.67 (\(+\)0.04)
15.00 (\(+\)0.00)
15.00 (\(+\)0.00)
Latvia
12.61 (−0.49)
8.30 (−0.62)
5.00 (\(+\)0.00)
8.61 (\(+\)0.44)
15.00 (\(+\)0.00)
5.56 (\(+\)0.19)
Lithuania
13.56 (−0.63)
8.80 (−0.62)
5.00 (\(+\)0.00)
10.98 (\(+\)0.62)
15.00 (\(+\)0.00)
7.50 (\(+\)0.61)
Luxembourg
6.19 (\(+\)0.09)
13.24 (\(+\)0.62)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
11.81 (\(+\)0.00)
15.00 (\(+\)0.00)
Malta
13.82 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
11.47 (−0.63)
14.81 (\(+\)0.00)
Netherlands
6.76 (−0.62)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
7.94 (−0.63)
15.00 (\(+\)0.00)
Poland
15.00 (\(+\)0.00)
5.00 (\(+\)0.00)
12.65 (−0.63)
10.65 (\(+\)0.62)
15.00 (\(+\)0.00)
6.63 (\(+\)0.00)
Portugal
15.00 (\(+\)0.00)
5.13 (\(+\)0.00)
5.00 (\(+\)0.00)
10.02 (\(+\)0.33)
15.00 (\(+\)0.00)
12.53 (\(+\)0.61)
Romania
8.75 (−0.59)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
15.00 (\(+\)0.00)
5.00 (\(+\)0.00)
Slovakia
13.85 (−0.63)
11.05 (\(+\)0.00)
5.59 (\(+\)0.63)
7.14 (\(+\)0.00)
13.03 (−0.60)
7.08 (\(+\)0.00)
Slovenia
15.00 (\(+\)0.00)
5.11 (\(+\)0.00)
5.00 (\(+\)0.00)
14.01 (\(+\)0.11)
15.00 (\(+\)0.00)
14.55 (\(+\)0.00)
Spain
15.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
6.79 (−0.02)
15.00 (\(+\)0.00)
13.35 (\(+\)0.02)
Sweden
14.80 (\(+\)0.00)
5.47 (\(+\)0.00)
5.00 (\(+\)0.00)
9.21 (−0.04)
12.95 (\(+\)0.62)
12.98 (−0.59)
United Kingdom
14.57 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
13.33 (\(+\)0.00)
14.45 (\(+\)0.32)
14.33 (−0.35)
(Overall)
12.59 (−0.20)
6.96 (−0.07)
5.79 (−0.09)
8.88 (\(+\)0.16)
13.74 (−0.08)
11.35 (\(+\)0.06)
Country
\(X_7\)
\(X_8\)
\(X_9\)
\(X_{10}\)
\(X_{11}\)
\(X_{12}\)
Austria
5.69 (\(+\)0.00)
6.18 (\(+\)0.63)
7.86 (\(+\)0.54)
5.18 (\(+\)0.20)
6.52 (\(+\)0.32)
5.77 (\(+\)0.00)
Belgium
14.32 (\(+\)0.00)
9.55 (\(+\)0.46)
12.06 (\(+\)0.63)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
Bulgaria
5.25 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
15.00 (\(+\)0.00)
5.77 (−0.14)
Croatia
5.06 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
7.59 (\(+\)0.05)
5.00 (\(+\)0.00)
Cyprus
10.88 (\(+\)0.00)
5.00 (\(+\)0.00)
6.18 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
Czechia
9.77 (\(+\)0.42)
15.00 (\(+\)0.00)
7.48 (\(+\)0.00)
7.67 (\(+\)0.00)
8.58 (−0.27)
5.00 (\(+\)0.00)
Denmark
7.37 (−0.58)
10.90 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
Estonia
6.95 (−0.02)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
13.02 (\(+\)0.00)
13.12 (−0.61)
6.63 (\(+\)0.43)
Finland
5.00 (\(+\)0.00)
5.29 (\(+\)0.00)
9.19 (\(+\)0.43)
5.00 (\(+\)0.00)
6.78 (\(+\)0.02)
5.00 (\(+\)0.00)
France
5.06 (\(+\)0.00)
5.94 (\(+\)0.60)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.30 (\(+\)0.03)
5.00 (\(+\)0.00)
Germany
7.63 (\(+\)0.14)
5.63 (−0.37)
13.24 (\(+\)0.63)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
Greece
5.16 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
15.00 (\(+\)0.00)
5.00 (\(+\)0.00)
Hungary
7.15 (\(+\)0.42)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
15.00 (\(+\)0.00)
5.00 (\(+\)0.00)
Ireland
5.84 (−0.08)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.49 (\(+\)0.00)
Italy
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
6.38 (\(+\)0.63)
6.90 (\(+\)0.22)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
Latvia
5.18 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
9.46 (\(+\)0.63)
15.00 (\(+\)0.00)
5.28 (−0.13)
Lithuania
5.89 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
13.25 (\(+\)0.00)
5.01 (\(+\)0.01)
Luxembourg
14.25 (−0.09)
9.51 (−0.62)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
Malta
14.41 (\(+\)0.00)
5.00 (\(+\)0.00)
10.48 (\(+\)0.62)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
Netherlands
15.00 (\(+\)0.00)
13.24 (\(+\)0.62)
12.06 (\(+\)0.63)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
Poland
6.69 (\(+\)0.39)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
8.39 (−0.39)
5.00 (\(+\)0.00)
Portugal
6.07 (−0.33)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
11.25 (−0.61)
5.00 (\(+\)0.00)
Romania
13.56 (\(+\)0.32)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
15.00 (\(+\)0.00)
12.69 (\(+\)0.27)
Slovakia
5.59 (\(+\)0.00)
5.84 (\(+\)0.37)
5.27 (\(+\)0.00)
5.00 (\(+\)0.00)
14.79 (\(+\)0.00)
5.77 (\(+\)0.24)
Slovenia
5.33 (\(+\)0.04)
5.55 (−0.14)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.45 (\(+\)0.00)
5.00 (\(+\)0.00)
Spain
5.02 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.07 (\(+\)0.03)
14.78 (−0.03)
5.00 (\(+\)0.00)
Sweden
5.00 (\(+\)0.00)
7.02 (−0.63)
5.19 (\(+\)0.20)
7.37 (\(+\)0.63)
10.01 (−0.20)
5.00 (\(+\)0.00)
United Kingdom
8.09 (\(+\)0.03)
5.23 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
5.00 (\(+\)0.00)
(Overall)
7.72 (\(+\)0.02)
6.42 (\(+\)0.03)
6.44 (\(+\)0.15)
5.70 (\(+\)0.06)
8.96 (−0.06)
5.44 (\(+\)0.02)
Values are means across the period 2004–2020 with average annual change within brackets
Overall: average across all countries

5.3 Comparison with Existing Studies

Our findings are not properly comparable with those of existing studies, because our study is the first one in the literature performing a longitudinal assessment on all the three sustainable dimensions for an exhaustive number of countries. Among existing studies, the most suited for a comparison with our results are Nowak et al. (2019) and Cataldo et al. (2020), where all the three sustainable dimensions and a non-trivial number of countries is considered, although they rely on cross-sectional data.
In Nowak et al. (2019), a composite indicator is constructed based on 2016 data using the TOPSIS method (Hwang and Yoon 1981), leading to a top ten list including seven transition economies (Slovakia, Czechia, Bulgaria, Latvia, Lithuania, Estonia and Hungary) and only three developed countries (Spain, Luxembourg and Austria). This result is apparently in contrast with our composite indicator, but it can be explained by the focus on a single year, where the increasing performance in sustainability for transition countries, also highlighted by our findings, may have been particularly favourable. However, it is reasonable to think that the discrepancies between the findings of Nowak et al. (2019) and ours are mainly due to the fact that the TOPSIS method is based on multi-criteria decision analysis, and thus the weighting scheme differs substantially from the BoD one.
In Cataldo et al. (2020), Partial Least Squares Path Modelling (PLS-PM) with second-order formative constructs is exploited to construct a composite indicator based on 2017 data, leading to a higher weight for the economic dimension, followed by the social and the environmental dimensions. The disagreement between these findings and ours can be explained by a substantial difference in the considered indicators. In fact, the study of Cataldo et al. (2020) considers the system of indicators designed to monitor Sustainable Development Goals (SDGs), which includes measures mainly related to agriculture but not limited to agricultural sustainability. Unfortunately, the main objective of Cataldo et al. (2020) is to derive the weights of sustainable dimensions, thus the ranks of countries are not reported and a comparison with ours is not possible.

5.4 Comparison with CAP Subsidies

The results of our composite indicator can be exploited to explore the effectiveness of subsidies attributed by the Common Agricultural Policy (CAP). At this purpose, we accessed the Farm Accountancy Data Network (FADN, European Commission 2020b) and downloaded the data at country level on the following indicators: “Total subsidies, excluding on investments” (SE605), “Subsidies on investments” (SE406), “Environmental subsidies” (SE621), “Subsidies for less favourite areas” (SE622), and “Other rural development payments” (SE623). Total CAP subsidies were obtained by summing the indicators SE605 and SE406. Also, we distinguished CAP subsidies based on economic, social and environmental objectives: environmental subsidies are directly measured by the indicator SE621, while social subsidies were proxied by summing the indicators SE622 and SE623. Finally, subsidies targeting the economic dimension were obtained by subtraction from total CAP subsidies. All the data on CAP subsidies were divided by the utilized agricultural area (UAA) to allow comparisons among countries.
Table 7 reports the mobility index for scores and for CAP subsidies to utilized agricultural area (UAA) by country in the period 2004–2019 (data for year 2020 are not available in the FADN). The same mobility indices are compared in Figure 5, where it is apparent a substantial agreement between the score in sustainability (SUS) and total CAP subsidies, with few exceptions. Countries with an evident incoherence include Netherlands (NL), which shows an increase in CAP subsidies despite a decreased score in sustainability (second quadrant of Figure 5), and Austria (AT), Slovenia (SI) and Malta (MT), which show a decrease in CAP subsidies despite an increased score in sustainability (fourth quadrant of Figure 5).
Table 7
Mobility index for scores and for CAP subsidies to utilized agricultural area (UAA) by country in the period 2004–2019
Country
Scores
CAP subsidies to UAA
SUS
ECO
SOC
ENV
SUS
ECO
SOC
ENV
Austria
\(+\)0.030
−5.805
\(+\)1.996
\(+\)3.853
−0.015
\(+\)0.022
\(+\)0.005
−0.335
Belgium
−0.001
−0.491
−0.813
\(+\)1.261
\(+\)0.009
−0.012
\(+\)0.062
−0.008
Bulgaria
\(+\)1.241
\(+\)1.215
\(+\)0.025
−0.184
\(+\)0.037
\(+\)0.057
\(+\)0.010
\(+\)0.126
Croatia
\(+\)0.462
\(+\)0.193
\(+\)0.333
−0.990
\(+\)0.052
\(+\)0.042
\(+\)0.176
\(+\)0.065
Cyprus
−0.226
\(+\)0.594
\(+\)0.728
−0.262
−0.021
\(+\)0.155
\(+\)0.101
\(+\)0.568
Czechia
\(+\)0.044
−0.457
−0.400
\(+\)0.055
\(+\)0.102
\(+\)0.116
\(+\)0.223
\(+\)0.360
Denmark
\(+\)0.997
\(+\)0.902
−1.099
\(+\)0.136
\(+\)0.022
\(+\)0.000
−0.038
\(+\)0.011
Estonia
\(+\)1.103
−0.507
\(+\)3.730
−0.782
\(+\)0.128
\(+\)0.286
−0.770
−0.219
Finland
\(+\)0.049
−1.137
\(+\)0.379
\(+\)0.880
−0.002
−0.014
\(+\)0.014
−0.011
France
\(+\)0.272
\(+\)0.273
\(+\)0.409
−0.062
\(+\)0.000
−0.001
\(+\)0.006
−0.001
Germany
\(+\)0.971
\(+\)0.239
−0.658
\(+\)3.883
\(+\)0.002
\(+\)0.004
\(+\)0.001
−0.004
Greece
−0.357
\(+\)0.004
−0.286
−0.041
\(+\)0.002
\(+\)0.000
−0.002
\(+\)0.000
Hungary
\(+\)0.398
−0.389
\(+\)0.129
\(+\)0.017
\(+\)0.003
−0.002
\(+\)0.004
\(+\)0.026
Ireland
\(+\)0.354
\(+\)0.060
\(+\)0.104
−0.004
−0.004
−0.004
\(+\)0.000
−0.039
Italy
−0.239
−0.253
−0.034
\(+\)0.942
\(+\)0.000
−0.001
\(+\)0.002
−0.001
Latvia
\(+\)0.242
−0.698
−0.195
\(+\)0.569
\(+\)0.023
\(+\)0.018
−0.056
\(+\)0.094
Lithuania
\(+\)1.638
\(+\)0.404
\(+\)0.745
\(+\)0.489
\(+\)0.003
\(+\)0.025
−0.038
\(+\)0.050
Luxembourg
\(+\)0.027
\(+\)0.773
−0.486
−0.037
\(+\)0.339
\(+\)0.341
\(+\)0.121
\(+\)0.000
Malta
\(+\)0.256
\(+\)0.255
\(+\)1.865
\(+\)2.379
−0.726
−0.534
−0.715
\(+\)0.533
Netherlands
−0.295
−0.169
\(+\)1.343
\(+\)0.902
\(+\)0.024
\(+\)0.042
\(+\)0.068
−0.390
Poland
\(+\)0.236
\(+\)0.328
\(+\)0.160
−1.878
−0.001
−0.001
\(+\)0.003
−0.003
Portugal
\(+\)0.279
\(+\)0.217
\(+\)0.372
−1.182
−0.004
−0.004
−0.015
\(+\)0.017
Romania
\(+\)1.150
−0.340
\(+\)1.857
−0.125
\(+\)0.000
\(+\)0.000
−0.001
\(+\)0.000
Slovakia
\(+\)1.229
−2.544
\(+\)2.950
\(+\)2.388
\(+\)0.149
−0.020
\(+\)0.000
\(+\)0.063
Slovenia
\(+\)0.090
−0.322
\(+\)0.229
\(+\)0.029
−0.175
−0.009
−0.404
\(+\)0.030
Spain
\(+\)0.000
\(+\)0.119
−0.053
\(+\)0.048
\(+\)0.000
\(+\)0.000
\(+\)0.000
\(+\)0.002
Sweden
\(+\)0.058
−1.397
−1.922
\(+\)2.680
\(+\)0.004
\(+\)0.017
\(+\)0.141
−0.001
United Kingdom
−0.056
\(+\)0.372
−0.773
−0.025
−0.005
−0.004
−0.008
−0.002
Figure 6 provides a comparison between scores and CAP subsidies by sustainable dimension. Again, a substantial agreement is apparent for all the three sustainable dimensions with few exceptions. In particular, countries with an increase in CAP subsidies despite a decreased score in sustainability (second quadrant) include: Austria (AT), Czechia (CZ), Estonia (EE), Latvia (LV) and Netherlands (NL) for the economic dimension; Belgium (BE), Czechia (CZ), Luxembourg (LU) and Sweden (SE) for the social dimension; Bulgaria (BG), Cyprus (CY), Croatia (HR) and Portugal (PT) for the environmental dimension. Instead, countries with a decrease in CAP subsidies despite an increased score in sustainability (fourth quadrant) include: Malta (MT) for the economic dimension; Estonia (EE), Lithuania (LT), Malta (MT), Portugal (PT) and Slovenia (SI) for the social dimension; Austria (AT), Belgium (BE), Finland (FI) and Netherlands (NL) for the environmental dimension.
The substantial agreement between mobility indices of scores and mobility indices of CAP subsidies supports the reliability of our composite indicator. Therefore, it represents a valuable resource to refine the scheme for the attribution of CAP subsidies in order to stimulate specific sustainable dimensions.

5.5 Sensitivity Analysis

Sensitivity analysis is an important step to evaluate the robustness of the composite indicator with respect to alternative methodological choices, i.e., the selection of indicators, the normalization procedure, the aggregation method, and the weighting scheme (Terzi et al. 2021). Since we selected the basic indicators based on theory, guidelines in the literature and data availability, the robustness of our composite indicator with respect to the use of different basic indicators was not investigated. Also, since the BoD weighting scheme is unit invariant, we disregarded the effect of different normalization procedures and concentrated only on the comparison between different aggregation methods and weighting schemes. Specifically, we computed three alternative composite indicators: (i) arithmetic aggregation with BoD weights, (ii) geometric aggregation with uniform weighting, (iii) arithmetic aggregation with uniform weighting. In these alternative composite indicators, uniform weighting was obtained by setting the weights equal to the reciprocal of the variance of each basic indicator.
Table 8
Average ranks and mobility index for different weighting schemes (BoD: Benefit of Doubt, U: uniform) and aggregation methods (G: geometric, A: arithmetic). Uniform weighting is obtained by setting the weights equal to the reciprocal of the variance of each basic indicator
Country
G–BoD
A–BoD
G–U
A–U
Austria
1.1 (\(+\)0.030)
3.2 (\(+\)0.072)
1.9 (\(+\)0.086)
2.7 (\(+\)0.562)
Belgium
24.6 (−0.001)
22.5 (\(+\)0.530)
21.1 (\(+\)0.262)
20.8 (\(+\)0.244)
Bulgaria
18.5 (\(+\)1.241)
5.0 (−0.074)
15.6 (\(+\)2.651)
12.2 (−2.040)
Croatia
23.6 (\(+\)0.462)
27.0 (\(+\)0.489)
25.2 (\(+\)1.356)
25.8 (−0.282)
Cyprus
26.4 (−0.226)
13.0 (−1.157)
9.6 (−0.785)
26.0 (−0.095)
Czechia
8.3 (−0.283)
4.8 (\(+\)0.187)
5.7 (\(+\)0.295)
4.9 (\(+\)0.031)
Denmark
15.4 (\(+\)0.997)
9.7 (−0.430)
8.9 (−0.058)
9.9 (−0.076)
Estonia
9.2 (\(+\)0.992)
19.0 (\(+\)1.375)
20.1 (\(+\)1.684)
8.4 (\(+\)1.735)
Finland
8.6 (\(+\)0.049)
19.6 (−0.018)
15.2 (\(+\)0.243)
11.9 (\(+\)0.015)
France
6.8 (\(+\)0.285)
18.6 (\(+\)0.732)
12.4 (\(+\)0.176)
7.9 (\(+\)0.421)
Germany
9.4 (\(+\)0.648)
13.9 (\(+\)0.449)
10.6 (−0.433)
17.1 (−0.257)
Greece
18.3 (−0.337)
11.8 (−0.484)
23.3 (−0.369)
21.9 (−0.087)
Hungary
5.4 (\(+\)0.401)
9.6 (\(+\)0.351)
9.7 (\(+\)1.398)
9.6 (\(+\)0.040)
Ireland
21.9 (\(+\)0.354)
19.0 (\(+\)0.156)
13.8 (\(+\)0.046)
16.3 (\(+\)0.791)
Italy
15.5 (−0.174)
18.2 (\(+\)0.267)
10.5 (−0.503)
24.9 (\(+\)0.077)
Latvia
8.4 (\(+\)0.298)
15.1 (\(+\)1.263)
24.0 (\(+\)0.739)
11.3 (−0.875)
Lithuania
14.0 (\(+\)1.934)
25.4 (\(+\)4.903)
22.5 (\(+\)0.594)
15.2 (\(+\)1.817)
Luxembourg
22.3 (−0.050)
5.6 (\(+\)0.300)
7.6 (\(+\)0.448)
14.4 (−0.784)
Malta
27.2 (\(+\)0.256)
15.0 (\(+\)4.979)
20.3 (−0.781)
27.9 (\(+\)0.015)
Netherlands
26.9 (−0.295)
12.9 (\(+\)2.166)
17.1 (\(+\)0.490)
12.5 (\(+\)3.088)
Poland
17.6 (\(+\)0.258)
9.3 (\(+\)0.316)
16.6 (\(+\)1.798)
21.8 (\(+\)0.170)
Portugal
16.5 (\(+\)0.279)
26.4 (\(+\)0.249)
22.5 (\(+\)0.569)
19.6 (−0.004)
Romania
11.9 (\(+\)1.138)
6.8 (\(+\)0.517)
12.5 (−1.478)
1.4 (\(+\)0.029)
Slovakia
3.4 (\(+\)1.234)
5.2 (−0.001)
5.6 (\(+\)0.943)
6.9 (\(+\)2.017)
Slovenia
10.5 (\(+\)0.122)
21.2 (\(+\)0.574)
12.4 (\(+\)0.761)
10.1 (\(+\)0.009)
Spain
16.8 (\(+\)0.018)
14.4 (\(+\)1.076)
17.8 (\(+\)0.883)
22.0 (−0.077)
Sweden
3.5 (\(+\)0.062)
14.2 (\(+\)1.390)
9.3 (\(+\)1.411)
9.2 (−0.361)
United Kingdom
13.9 (−0.096)
19.6 (−0.633)
14.2 (−0.285)
13.3 (−0.090)
Table 8 shows average ranks and mobility indices for our composite indicator and the three alternative composites. We see that there is a substantial difference in the results when arithmetic aggregation is used in place of the geometric one (Spearman correlation equal to 0.326), while the difference is slighter when uniform weighting is employed in place of BoD with both geometric (Spearman correlation equal to 0.536) and arithmetic (Spearman correlation equal to 0.637) aggregation. Interestingly, composite indicators based on arithmetic aggregation (BoD versus uniform weighting) are the most dissimilar from each other (Spearman correlation equal to 0.399). This analysis highlights a clear dependence of the results from the aggregation method and the weighting scheme, confirming the core importance of methodological choices that, in this research, have been clearly motivated in favour of geometric aggregation with BoD weights.

6 Concluding Remarks

In this paper, we have emphasized that few studies have been conducted to assess agricultural sustainability in the European Union (EU), and all of them fail to provide a holistic view of sustainability in a relevant temporal horizon that could effectively support the design of policies. To fill this gap, we have proposed a composite indicator based on the geometric aggregation of 12 basic indicators measured yearly in the period 2004–2020 (17 years) on all EU countries plus United Kingdom, with weights determined endogenously according to the Benefit of Doubt (BoD) approach.
Our proposal is innovative with respect to existing studies because we considered: (i) all EU countries rather than a subset of them, (ii) a broad set of indicators (12 in total) to cover the economic, social and environmental dimensions of sustainability, (iii) longitudinal data over a long period (17 years). Also, the decomposition into the contributions of sustainable dimensions and the adoption of the BoD weighting scheme is novel in the assessment of agricultural sustainability in the EU.
The construction of composite indicators is subjected to several arbitrary choices that may influence the final results, especially the aggregation method and the weighting scheme. Therefore, we paid particular attention in motivating our methodological choices. On one hand, geometric aggregation was preferred to the arithmetic one because it allows a small degree of compensation to reflect the fact that sustainable development is achieved only when all or most individual sustainability goals are pursued. On the other hand, the BoD weighting scheme was selected because it permits to infer the relative importance of each basic indicator and sustainable dimension in the achievement of sustainability without relying on subjective opinions. The core importance of methodological choices, and thus of their motivation, was also confirmed by the sensitivity analysis conducted on our composite indicator.
A valuable resource employed to discuss our results is represented by the mobility index. The mobility index accounts for the evolution of the performance of each country relatively to the other ones, and not simply for each country separately. Therefore, it allows an in-depth insight into the trajectories of sustainability of the various countries. For this reason, we hope that our work encourages the developers of composite indicators for longitudinal data to use the mobility index in the discussion of their results.
In order to check the reliability of our composite indicator, we inspected the relationship between mobility indices of scores and mobility indices of subsidies attributed by the Common Agricultural Policy (CAP). Our findings highlighted a substantial agreement between the two, both in overall and by sustainable dimension. Therefore, our composite indicator represents a valuable resource not only to monitor the progress of EU member countries towards sustainability objectives, but also to refine the scheme for the attribution of CAP subsidies in order to stimulate specific sustainable dimensions.
The main critical point of our work relies in quality and availability of data, an issue affecting all multidimensional assessments due to the practical difficulty of collecting reliable measurements on a large number of indicators. The national scale and the longitudinal nature of our analysis entail further complications, because the only data sources are represented by international institutions and organizations, and available time series are typically short and may present a number of missing values. In this paper, missing values have been imputed based on a vector auto-regressive model with fixed intercepts. Our imputation procedure has good properties because the Expectation-Maximization (EM) algorithm was employed to compute the expected value of missing data. However, the limited length of the time series prevented us to effectively check the presence of cointegration, thus our methodology has room for improvement. At this purpose, we plan to integrate the EM algorithm within the BoD optimization and to recompute the composite indicator as future data become available.

Acknowledgements

The authors thank the anonymous reviewers for their careful reading of the article and for their constructive comments. The authors acknowledge the financial support provided by the “Dipartimenti Eccellenti 2018–2022” ministerial funds, Italy.

Declarations

Conflict of interest

The authors declare that they have no conflict of interest.
Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visithttp://​creativecommons.​org/​licenses/​by/​4.​0/​.

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Literature
go back to reference Cooper, W. W., Seiford, L. M., & Tone, K. (2000). Data envelopment analysis: A comprehensive text with models, applications, references and DEA-solver software. Dordrecht, DE: Kluwer Academic Publishers. Cooper, W. W., Seiford, L. M., & Tone, K. (2000). Data envelopment analysis: A comprehensive text with models, applications, references and DEA-solver software. Dordrecht, DE: Kluwer Academic Publishers.
go back to reference European Commission (2011). Horizon 2020: The framework programme for research and innovation. COM/2011/0808 final, 30th November 2011, Brussels, BE. European Commission (2011). Horizon 2020: The framework programme for research and innovation. COM/2011/0808 final, 30th November 2011, Brussels, BE.
go back to reference Fattore, M. (2017). Synthesis of indicators: The non-aggregative approach. In F. Maggino (Ed.), Complexity in society: From indicators construction to their synthesis (pp. 193–212). CH: Springer, Cham.CrossRef Fattore, M. (2017). Synthesis of indicators: The non-aggregative approach. In F. Maggino (Ed.), Complexity in society: From indicators construction to their synthesis (pp. 193–212). CH: Springer, Cham.CrossRef
go back to reference Hani, F., Braga, F. S., Stampfli, A., Keller, T., Fischer, M., & Porsche, H. (2003). RISE, a tool for holistic sustainability assessment at the farm level. International Food and Agribusiness Management Association, 6, 4. Hani, F., Braga, F. S., Stampfli, A., Keller, T., Fischer, M., & Porsche, H. (2003). RISE, a tool for holistic sustainability assessment at the farm level. International Food and Agribusiness Management Association, 6, 4.
go back to reference Latruffe, L., Diazabakana, A., Bockstaller, C., Desjeux, Y., Finn, J., Kelly, E., Ryan, M., & Uthes, S. (2016). Measurement of sustainability in agriculture: A review of indicators. Studies in Agricultural Economics, 11(8), 123–130. https://doi.org/10.7896/j.1624CrossRef Latruffe, L., Diazabakana, A., Bockstaller, C., Desjeux, Y., Finn, J., Kelly, E., Ryan, M., & Uthes, S. (2016). Measurement of sustainability in agriculture: A review of indicators. Studies in Agricultural Economics, 11(8), 123–130. https://​doi.​org/​10.​7896/​j.​1624CrossRef
go back to reference Terzi, S., Otoiu, A., Grimaccia, E., Mazziotta, M., & Pareto, A. (2021). Open issues in composite indicators. A starting point and a reference on some state-of-the-art issues. Rome: Roma TrE-Press. Terzi, S., Otoiu, A., Grimaccia, E., Mazziotta, M., & Pareto, A. (2021). Open issues in composite indicators. A starting point and a reference on some state-of-the-art issues. Rome: Roma TrE-Press.
go back to reference Zahm, F., Viaux, P., Vilain, L., Girardin, P., & Mouchet, C. (2008). Assessing farm sustainability with the IDEA method - from the concept of agriculture sustainability tocase studies on farms. Sustainable Development, 16(4), 271–281. https://doi.org/10.1002/sd.380CrossRef Zahm, F., Viaux, P., Vilain, L., Girardin, P., & Mouchet, C. (2008). Assessing farm sustainability with the IDEA method - from the concept of agriculture sustainability tocase studies on farms. Sustainable Development, 16(4), 271–281. https://​doi.​org/​10.​1002/​sd.​380CrossRef
go back to reference Zhang, X., Yao, G., Vishwakarma, S., Dalin, C., Komarek, A. M., Kanter, D. R., Davis, K. F., Pfeifer, K., Zhao, J., Zou, T., D’Odorico, P., Folberth, C., Galeana Rodriguez, F., Fanzo, J., Rosa, L., Dennison, W., Musumba, M., Heyman, A., & Davidson, E. A. (2021). Quantitative assessment of agricultural sustainability reveals divergent priorities among nations. One Earth, 4(9), 1262–1277. https://doi.org/10.1016/j.oneear.2021.08.015CrossRef Zhang, X., Yao, G., Vishwakarma, S., Dalin, C., Komarek, A. M., Kanter, D. R., Davis, K. F., Pfeifer, K., Zhao, J., Zou, T., D’Odorico, P., Folberth, C., Galeana Rodriguez, F., Fanzo, J., Rosa, L., Dennison, W., Musumba, M., Heyman, A., & Davidson, E. A. (2021). Quantitative assessment of agricultural sustainability reveals divergent priorities among nations. One Earth, 4(9), 1262–1277. https://​doi.​org/​10.​1016/​j.​oneear.​2021.​08.​015CrossRef
Metadata
Title
A Composite Indicator to Assess Sustainability of Agriculture in European Union Countries
Authors
Alessandro Magrini
Francesca Giambona
Publication date
30-04-2022
Publisher
Springer Netherlands
Published in
Social Indicators Research / Issue 3/2022
Print ISSN: 0303-8300
Electronic ISSN: 1573-0921
DOI
https://doi.org/10.1007/s11205-022-02925-6

Other articles of this Issue 3/2022

Social Indicators Research 3/2022 Go to the issue

Premium Partner