1. Introduction
Health is essential for sustainable human development, being not only a fundamental human right, but also an important factor in the economic evolution of a society and, therefore, it may be considered as an adequate measure of a nations’ progress toward reaching sustainable development. Health has a significant impact on the development of a nation by increasing productive employment, reducing medical expenses, and promoting social cohesion.
The healthcare systems in the European Union countries aim to provide quality health care to all individuals, and to ensure that the need for health care does not cause poverty or imply significant financial constraints. This is conducive to the well-being of people and to economic prosperity as it enhances labor market participation and productivity, which are essential elements for prolonging active life in the context of an aging society. At the same time, health systems are essential for achieving economic cohesion and social protection processes in Europe.
Even though health systems are different in terms of organization, applied policies and financial means, they are built on a range of common values, such as universality, access to good quality care, equity and solidarity. The challenges faced by European health systems are numerous, but in the current socio-economic context we can conclude on the following aspects: (1) the aging of Europe’s population, leading to a higher risk of developing chronic conditions, which increases the demand for health care and the fiscal pressure; (2) health professionals are unevenly distributed, which hampers some areas of care and negatively affects specific geographical areas; (3) the costs of innovative technologies and medicines are rising which constitutes an additional burden on the public finance systems; (4) access to healthcare is not distributed evenly, thus leading to inequalities in health outcomes at the society level. Obviously, in this frame, we must also introduce the idea of human and fiscal sustainability, as common values need to be guaranteed in the medium and long run [
1].
Sustainability involves the health system maintaining itself and adapting in a constantly changing economic, social and demographic context, making sure that limited resources (physical, financial and human) are being used efficiently and responsibly in order to permanently maintain or improve the health of the population as a whole and of each individual. A sustainable health system must be defined by at least three key elements: accessibility for each individual, mutual acceptance between patients and the medical staff, and adaptability, as health systems should be able to permanently adapt to the socio-economic and demographic changes, to new illnesses, to scientific discoveries and dynamic technologies, in order to remain viable. Practically, we could say that sustainability is a moving target in a rapidly changing health system that must adapt to the main challenges faced by society [
2].
One dimension through which the sustainability of health systems can be viewed is fiscal sustainability. The European Commission defines fiscal sustainability in general as the ability to maintain current policies without causing rising debt as a share of gross domestic product (GDP) [
3]. The issue of fiscal sustainability of healthcare systems has been brought to the fore in recent European Union (EU) debates, specifically in the light of the increasing need for adequate healthcare under the pressure of demographic drivers—especially aging and other non-demographic factors such as investments in technology and infrastructure, medical products and wages. Moreover, the debt levels of many EU countries, worsened by the economic and financial crisis of 2008, exert additional pressure on the fiscal sustainability of public finances in general, and also on health expenditure which is mainly funded from public sources. Therefore, fiscal sustainability should be regarded more as a constraint, rather than as a goal per se [
4].
In this context, the health policy of the European Union gained a new macroeconomic dimension following the recent introduction of the legislative framework for economic governance. This new dimension involves, among others, the analysis of budgets and financial commitments of the national governments in order to identify policies and factors that pose a threat to the sustainability of the health systems. The macroeconomic dimension of health concerns the individuals, institutions and resources of the healthcare sector, but also their impact on the fiscal level and implicitly on the economic level. New health policies at EU level have led to wide-ranging debates on funding arrangements, medical services delivery, and ensuring universal access to high quality medical services. Thus, the European Union is increasingly involved in analyzing and evaluating health policies, trying to identify, assess and address specific areas of interest.
Nevertheless, health systems in the European Union need extensive reforms in order to improve the provision of adequate, affordable and efficient health services to all citizens. It seems that traditional sources of funding for European healthcare services are insufficient and too expensive. Innovation is necessary in order to maintain health sustainability, especially since the idea of free, state-supported health services is deeply rooted in the minds of most Europeans. The new reforms are aimed at reducing the role of the state in providing health services and heading towards the private environment in order to introduce a competitive market element and avoid the collapse of state systems under pressure from aging populations, rising expenditures and high budget deficits.
In order to efficiently and correctly identify existing health system challenges, states need to carry out a comprehensive analysis of the sustainability of their health systems. Given that they are open systems, they need to be adaptable to changes, and in order to maintain high-quality standards, they must benefit from human, financial and informational resources [
5].
It is clear that a growing amount of resources (money, human resources, infrastructures, information, etc.) is being allocated for healthcare in the EU countries; these are measurable inputs which are translated within the system into outcomes. This process of transforming inputs into outputs is actually a policy tool which deals with efficiency, and the way it is done certainly contributes to the improved fiscal sustainability of health systems. The ability of each country to use combinations of resources and transpose them into health outcomes depends on many aspects, such as system design and institutional setup, but also on the economic and social condition of the country and the current performance level of the health system. Countries with similar levels of development and comparable health spending, register different health indicators. In countries where the outcomes of the health system are very low, any incremental spending has a notable influence, whereas in countries with outstanding health performance any additional investments are affected by decreasing marginal returns.
To sum up, any discussion on the fiscal sustainability of health systems should start from the measurable performances of health systems, and then relate performances with the resources spent to achieve them. Starting from such an analysis, states can then develop targeted policies and launch innovative health service projects to improve the sustainability of the system as a whole. Measuring health system performances is not very straightforward, and it has been widely accepted that it represents a multi-dimensional issue. Some effective tools in investigating the performance of a health system rely on the use of composite indicators that have the benefit of measuring performance by combining distinct health indicators into a single composite index. Given the increasing interest in using composite indicators to measure healthcare performance, we decided to explore both the economic and the methodological aspects involved in building such a complex index. Since the literature review on the health composite index developed for the 28 EU countries is rather scarce, we believe that our paper fills in this gap by providing new measurement solutions for EU health systems’ performances. It also provides methodological ways to explore the relationship between the performances of the healthcare systems in the EU countries and their fiscal sustainability.
The purpose of this paper consists, therefore, in measuring the health systems’ performances of the European Union countries by building up a comprehensive composite index, which will then be used as a tool in investigating the relationship between health performance and fiscal sustainability of health systems in these countries. A principal components analysis (PCA) methodology was applied for building the composite index through the use of most relevant health indicators provided by Eurostat and the Sustainable Development Knowledge Platform for which data was available. Various Sustainable Development Goals 3 indicators (SDG3) dedicated to ensuring healthy lives and promoting well-being for all at all ages are considered in the composite index, as these have become critical targets in the 2030 Agenda. The 2030 Agenda is a holistic plan of action over the next 12 years which aims at capitalizing and completing the Millennium Development Goals in crucial aspects regarding human beings and the planet, by addressing the economic, social and environmental dimensions of sustainable development. We discuss the fiscal sustainability of health systems by focusing on expenditures and sources of funding, whereas we explore the relationship with health performances through a multiple correspondence analysis (MCA) approach.
The structure of the paper is the following:
Section 2 is dedicated to the literature review in the field, while the methodology and data are described in
Section 3. The main results of the composite index together with the analysis of fiscal sustainability of health systems in the EU are tackled in
Section 4, while the last section is dedicated to the discussions, implications and the concluding remarks of the paper.
2. Literature Review
According to the main sustainable development goals, societies are committed to improve in the following interconnected areas: economic development (including extreme poverty alleviation), social inclusion, good governance and environmental sustainability. Health is obviously important as a fundamental human right, but it is also essential for the realization of these four pillars which are necessary for individual and social well-being. National goals for reaching economic growth can only be attained with a healthy population.
Numerous studies have focused on the link between health and growth. A very important component of a country’s economic development is people’s health. The relationship is not necessarily unidirectional: health determines development [
6], but economic development also leads to improvements in health [
7].
Some authors argue that an increase in government spending on health results in boosting economic growth [
8,
9]. Among other things, the authors suggest that the government should increase spending for the development of the health sector, because it increases productivity and growth. Similar results were obtained by [
10], who focused on the potential trade-off between health and other public services, as well as by [
11] who treated health as a form of capital, so that medical care is both a consumer good offering direct satisfaction and an investment good that generates indirect utility by increasing productivity, fewer sick leave days and higher wages. On the other hand, other authors [
12] found that the relationship is unidirectional: government spending on health has a very low impact on economic growth, and economic development has no impact at all on government spending.
The White Paper “Together for Health: A Strategic Approach for the EU 2008–2013” was the first community strategy on health, with the main objective to create a coherent framework at community level, underpinning member states’ actions [
13]. The document highlighted the central place of health in people’s lives and the need to find effective actions and policies for this key theme, with emphasis on the relationship between health and economic prosperity. In the same document, the experts drew attention to health spending that can be seen as an investment in the future, whereas the lack, insufficiency or inadequacy of investments in key health areas can entail further cost escalations. Therefore, a synergistic approach of the health issue has been proposed, integrating many sectors of activity and community policies, including regional and environmental policy, pharmaceutical and food regulation, health research and innovation policies, social security policies, policies on health and safety at work.
Currently, the EU member states are following the 2030 Agenda for sustainable development, representing a commitment from governments and the international community to improve health as a core factor for development. The Sustainable Development Goals (SDGs) define the priority areas for action set out in the 2030 Agenda, among which Objective 3—to ensure a healthy life and promote well-being for all at all ages.
One of the aims of SDG3 is universal health coverage (UHC), an essential goal for every nation to achieve fair and sustainable health outcomes and to increase the well-being of individuals and communities. A functional health system comprises resources, people and institutions, interconnected in order to maintain and improve the health of a population. Strengthening health systems is a way of progressing to UHC and ensures that the main goals of national health policies regarding quality, efficiency, equity, accountability, resilience and sustainability are incorporated in system performance [
14].
There are various health systems in the world and a large diversity within Europe as well. In several European countries, public spending for health is largely funded by government revenue. In other states, the health spending is financed mostly by social security funds. There is also private funding for healthcare, which mainly consists of household payments (direct payments or co-payment arrangements) and different schemes of private health insurance [
15].
Today, healthcare systems play a more important role in people’s lives than ever before. From a long-term sustainability perspective, the health system needs to have a conceptual framework that should comprise indicators such as: efficiency, availability, security, responsiveness, equity and effectiveness [
16]. The sustainability of the health system is largely based on the individual and on his decisions on health and prevention spending that are greatly influenced by the individual’s health and certainty about the future. In these circumstances, the economic behavior of the healthcare consumer is important to analyze especially because it is characterized by limited rationality [
17].
To help countries develop policies to increase efficiency, a first step is to quantify the effectiveness of national health systems and to analyze the factors that improve efficiency. Evaluating the performance of health systems is a challenging process that requires a multi-dimensional approach. According to the European Commission [
18], there are two key criteria for selecting the priority areas for comparison and evaluation: (1) the impact on three dimensions—health impact, economic impact, equity impact; and (2) methodological criteria related to the viability of the implementation or feasibility of measures meant to improve system performance.
In recent years there has been growing interest in building composite indicators to measure health system performance because of the benefit of combining disparate health indicators into a single composite index that could capture a multi-dimensional perspective of the entire process. Among the first studies in this area, we mention Murray and Frenk who proposed in 2000 a conceptual framework to measure the performance of the health system [
19]. Since then, several studies have generally observed a wide variation between countries in the efficiency of achieving health objectives and also in the influence that economic and social status has on efficiency [
20,
21].
Amongst the most successful health composite indicators used around the globe there are: the Star rating system for the UK National Health System (NHS) providers, the United States Medicare index, the Canadian regional healthcare indicator and the health system performance index published by the World Health Organisation (WHO), to name just a few.
Each of these composite indicators has several particularities. For instance, the annual Star rating system of the NHS hospitals in the UK was based on a composite index for acute hospital general trusts, combining various four-point scale indicators on hospital cleanliness and waiting time, as well as information on the financial state of the trust [
22].
The United States Medicare state-level composite index was constructed by [
23,
24], based on a series of 22 Medicare quality indicators regarding the healthcare services (primarily in fee-for-service).
In Canada, the Institute for Health Information publishes annually several studies on regional health indicators [
25,
26]. Six main categories are considered in the index computation (outcomes, resources, prenatal care, efficiencies, community health and elderly services), while the set of weights assigned to the performance indicators are ‘based on expert opinion’.
Although these composite indicators could be seen as valuable tools in different policy making areas, some can be the subject of much debate. This is the case, for instance, of the composite index of health system performance published by the World Health Organisation in [
27]. It is mostly criticized because of the high heterogeneity between the 191 countries considered in the analysis when comparing the broad areas of health, financial fairness and responsiveness.
Several fiscal space analyses pointed out that in countries with low and medium incomes, where resources are scarce, improving the efficiency of health systems is becoming increasingly relevant in order to address the challenges of delivering effective health services and moving towards UHC [
28,
29].
A recent study examined the efficiency of national health systems based on longitudinal data at country level [
30]. The authors collected data on health expenditure per capita, infant mortality rate, mortality rate below 5 years and life expectancy for 173 countries for the period 2004–2011. Based on data envelopment analyses (DEA) the authors evaluated the efficiency of national health systems and using regression models they investigated the determinants of efficiency. The results indicated a large variation between countries regarding the efficiency of their national health systems, Africa having the lowest efficiency (67%), while Western Pacific countries the highest (86%). The study highlights the need to increase the efficiency of national health systems in order to meet the health needs of the population.
The same DEA approach was used to assess the efficiency of the health systems of 30 countries in Europe, with 3 output variables: infant mortality rate, life expectancy and life expectancy at birth, and three input variables: public health expenditures as a percentage of GDP, number of hospital beds, and number of doctors. The results indicated that alongside the developed countries also several developing countries were positioned on the efficiency frontier [
31].
In a recent comprehensive study, statistical methods were used to compile data and estimate the performance of 33 health-related SDGs for 188 countries between 1990 and 2015. Each indicator was rescaled between 0 and 100, with 0 the worst observed value between 1990 and 2015 and 100 the best observed value. In 2015, the median SDG index for health was 59.3 and varied widely between countries, from 85.5 in Iceland to 20.4 in the Central African Republic. Since 2000, significant progress has been made for indicators such as mortality under-5 years, neonatal mortality, and met need with modern contraception. Moderate improvements have been observed for indicators such as the incidence of HIV and tuberculosis, minimal changes in hepatitis B incidence, whereas excess child weight has increased considerably [
32].
At country level, studies generally focus on assessing hospital performance, these being the main healthcare centers. Performance analysis is an important way for hospitals to achieve greater efficiency in providing services to their clients. For China’s Hubei Province, some authors [
33] focused on evaluating the performance of non-profit public hospitals using the backpropagation Artificial Neural Network. The results of their study can be used as decision support for the development and reform of non-profit hospitals, as well as for improving the performance of care units. Other authors [
34] use a hybrid multiple criteria decision making (MCDM) approach in order to identify key performance indicators for hospital management. Their results consist of a complex set of cause and effect indicators connected by an influential relationship diagram and 7 performance indicators that can be used to gradually improve the health organizations’ efficiency.
The Italian Health Service was recently analyzed in a relational perspective using a Viable Systems Approach–Service Science (VSA–SS) approach, the study proposing an innovative methodology to assess the appropriateness of the healthcare service, indicating the need to develop the healthcare system in terms of efficiency, effectiveness and sustainability [
35].
Healthcare systems often face the paradox of limited resources and increasing demand for services. In these conditions, the question of the sustainability of the health system at a global level is being examined more frequently. However, although patient satisfaction is well-known to be an essential factor in the social dimension of healthcare sustainability, we should not neglect the aspects related to the satisfaction of healthcare professionals and the organizational efficiency of medical institutions measured mainly by the efficiency of the services they provide. Various indicators can be used for the measurement of the level of satisfaction perceived by the actors of the healthcare system [
36].
The American healthcare system can be a reference point for European health systems, given that the United States has already confronted with some of the current challenges that affect the sustainability of healthcare services. The key to achieving a sustainable healthcare system in the United States is represented by a set of reforms that targeted an unique and integrated service payment system, increased competition and surveillance, reduced fragmentation and regulation, the introduction of information technology into healthcare services, as well as the stimulation of medical professionals by introducing a differentiated assessment and payment system, education reform and innovation [
37].
Innovation is seen as a key element which can solve the main issue of global health systems—the demand for healthcare grows and funding sources are limited, taking into account that fiscal return may take years to reap its reward [
2]. Governments could identify new and innovative solutions to finance future health costs.
3. Methodology and Data
The first objective of this paper consists in building up a composite index that could measure the health system performances of the European Union countries. In general, a composite indicator is an aggregated index containing individual performance indicators. Secondly, the resulting Health Index will then become a powerful tool in investigating the fiscal sustainability of the health systems of the 28 EU countries in order to address some policy implications on this matter.
The use of composite indexes has brought arguments both in favor and against it, mainly related to methodological aspects. See
Table 1 for a critical summary list of pros and cons on the use of composite indexes.
On the one hand, composite indexes are used more to monitor performance and to rank institutions and organizations in economic and socio-political areas [
38,
39]. These indicators are integrating large amounts of information in a comprehensible format and, as such, they prove to be valuable tools in providing performance summary assessments in priority areas. Some of the advantages include: keeping the focus on important political issues, offering a more comprehensive performance assessment, and presenting an ‘overview’ that is easily observable.
Constructing composite indicators is not always straightforward in terms of methodological aspects which may raise several technical and economic challenges that can generate potential misinterpretations or wrongful manipulation techniques on the respective composite measures if not addressed properly.
More so, these challenges are not restricted to only technical aspects since the usage and the publishing of composite performance measures may have the potential to generate very different behavioral responses and, as such, a careful analysis process needs to be undertaken in regards to their creation and subsequent use.
Although composite indicators tend to become more intensively used as political tools in different policy areas, they can be affected by a series of methodological constraints. Therefore, when building a composite indicator, it is of extreme importance to apply a rigorous methodology and to follow a set of important steps in building the composite index. Among the most relevant aspects that require a careful judgement when building composite indicators are: the choice of health indicators, the transformation of the performance measurements of the initial indicators, as well as the method applied to combine and to assign specific weights to the initial data based on clear and rigorous decision rules. The assigned set of weights should reflect the societal preferences of the health system outputs.
Since there is no straight general rule on the precise steps required for building effective composite indicators, the following steps were selected from the international empirical works [
40,
41]—and applied in this study as being the most relevant ones:
Step 1. Defining the Purpose of the Composite Index
The first step consists in identifying the units to be addressed and the main purpose for building such a composite index. Thus, prior to choosing the health indicators to be included in the composite, we need to draw on the existing theoretical framework and establish the boundaries of the units considered in the assessment, together with the main aspects of performance we intend to measure [
41].
For the purpose of this paper we focus on building a composite index to measure the health systems performance of the 28 European Union countries. The analysis will cover the most recent year with available data for the set of countries considered.
Step 2. Selecting the Individual Health Indicators
Choosing the most relevant individual indicators to measure the health system performance for the EU countries is by far one of the most fundamental steps, where clear judgment becomes a requirement. The choice of the indicators is often a trade-off between data availability and the credibility of the composite index to accurately measure performance. It will be ideal to include in the composite a complete set of relevant indicators to form a credible image of the performance measurement composite based on the theoretical framework. However, most often there are data availability constraints that allow researchers only to partially capture the multi-dimensional aspects of health performance.
In this study, an initial set of 16 health indicators with available data for the 28 EU countries was collected, using the following data sources: Eurostat [
42] and the Sustainable Development Knowledge Platform [
43] respectively, which provides information on indicators of SDGs.
The purpose was to collect as many indicators as possible to best capture the performance of the health systems in the EU countries targeting, on the one hand, the indicators of the supply of medical services (such as number of doctors, nurses and midwives, dentists, physiotherapists and pharmacists; but also the population’s perception level for unmet medical examinations due to high cost); population-specific health status indicators (fertility rates, mortality rates, life expectancy); and labor market specific health indicators (such as the incidence rate of fatal accidents at work).
The choice of the self-reported unmet needs for the medical examination variable among the initial data set can be perceived as a health service satisfaction indicator directly related to individual-level cost concerns. For instance, the analysis of [
44] upon the propensity and perceived expensiveness of health examinations showed that attending health examinations is positively associated with the possession of health insurance and the absence of financial or temporal constraints. For the purpose of our paper, this indicator was selected to reveal insights upon the population’s perception upon the use of inappropriate charges for medical services.
The main indicators considered in building the composite Health Index are summarized in
Table 2, while a detailed description of them is presented in
Table A1 Appendix A. Among the 16 health indicators considered, seven of them are of particular relevance as belonging to the SDG3 (Ensuring healthy lives and to promote well-being for all at all ages) health indicators. The main targets for 2030 promoted by the Agenda 2030 for these indicators are summarized in
Table A2 Appendix A, according to the main social development goals.
The data collection process was a difficult one. For instance, initially all SDG3 indicators for all EU countries were considered for data collection, but because of data availability restrictions only seven indicators out of the 13 specific health targets were eventually selected. Moreover, in order to extend the initial data set of indicators we also considered several relevant health indicators provided by Eurostat to capture a better perspective of the medical services supply, as well as some health labor market particularities for which data was available for the same period for all countries.
It is widely recognized that one of the systems directly related to fiscal sustainability of the health systems is the labor market. Essentially this is supported by the fact that the labor market represents a significant source of health financing. A more accurate investigation of the linkage between these two systems reveals other important issues that should be taken into consideration when evaluating health care systems, such as occupational health or work-related fatalities. According to International Labor Organization (ILO), occupational diseases may contribute to the overall burden of disease as much as tuberculosis, HIV/AIDS and malaria taken together [
45]. Furthermore, safer and healthier workplaces are considered an important trigger of sustainable economic growth [
46]. Consequently, we have decided to include in our health index the indicator measuring fatal accidents at work. It represents only a part of the work related fatalities but it was the only available option provided by Eurostat with data available for all countries for the investigated period.
Our selection of health indicators was based on the relevant published literature, the data availability and in accordance to the main objective of the study, mainly to obtain a composite index that reflects the health system performance of the EU countries. Thus, the analysis was made for 2015, as being the most recent year with available data for the 28 EU countries.
The main advantage of using such an index is the storing of large amounts of information in one single value. Moreover, the composite index will allow for the identification of certain health related systemic problems that countries may have, and this will, in turn, point to the rethinking and reforming some of the adopted macroeconomic policies for those countries.
Step 3. Transforming the Individual Indicators
Prior to combining the individual indicators, we have to check for missing data and for possible transformations of the measured performance of individual indicators in order to allow any extra unit of attainment in a specific dimension to become of equal value at all levels of attainment.
The first aspect that has to be tackled at this step regards the missing data imputation problem. Since missing data often hinders the development of strong composite indicators, it has been recommended to treat them by using special techniques. In principle, there are several general methods of handling missing data, such as: deleting the case, single, or multiple imputations. In this study, a single value regression imputation technique was used to treat missing data as part of the analysis by attempting to impute values using linear regression to extrapolate the trend based on historical data collected from the 2000–2015-time horizon. However, two variables from our initial list had to be excluded from the analysis due to many missing values (physiotherapists per 100,000 inhabitants and pharmacies per 100,000 inhabitants).
The second issue concerns the use of multiple indicators measured in distinct units, which could be reflected into different weights in the composite index. In order to solve such a problem of mixing various units of measurement (such as %, number of persons or expenditure level), the initial data has to be transformed or standardized prior to being aggregated into the composite index.
Variables should also be normalized in order to avoid the presence of outliers or extreme values. In case indicators are characterized by a very skewed underlying distribution, logarithmic transformations could be used to normalize them [
38].
In general, there are several normalization methods, among which standardization (or z-scores) has the benefit of converting the initial indicators to a common scale, having a mean of 0 and a standard deviation of 1. This preliminary procedure was also applied in our study as it plays a significant role when checking the suitability of the initial data set and provides a better understanding of the possible implications of the methodological choices taken while building the composite index (such as weighting or applying an aggregation technique). From a technical point of view, this involves rescaling the original indicators by subtracting the mean and dividing by standard deviation. For a specific country c, the new value achieved by a specific indicator X will be computed by the formula:
where
is the sample mean of the indicator
X and
is the standard deviation of
X.
Step 4. Combining the Components Using a Decision Rule
The next step consists in deciding upon the best method to combine different dimensions of performance (that are measured on distinct scales) in a meaningful way. This is an important process that implies defining the set of weights assigned to the initial indicators and the methodology for aggregating the variables into a single composite index.
Without a rigorous methodology, such a composite index could hide important attribute values for certain dimensions, which could result in taking inefficient policy-making steps.
When computing a composite index, it is of extreme relevance to decide upon the best way all the information is weighted and aggregated. One simple approach in weighting the initial indicators that is often used in policing performance assessment consists in giving equal weight to all initial variables. This is the case when all performance dimensions are considered to be of similar relevance or when there is no information or statistical or empirical grounds for prioritizing the initial variables. Moreover, according to [
47] equal weights are generally appropriate only when the initial indicators are either uncorrelated or highly correlated, and less applicable when some are correlated and others are not.
Another approach suggests, however, the use of distinct weights in order to reflect the priority, reliability or some other characteristics of those indicators [
38]. The most common multivariate statistical techniques used in building such composite indicators are the PCA and factor analysis (FA). These methods are used to estimates weights for the initial indicators based on correlations between them.
In this study, principal components analysis was used in SPSS, which is essentially a method to reduce the dimensionality of the initial data set down to a small number of uncorrelated (orthogonal) factors called principal components. This statistical procedure allows a small number of principal components to account for much of the variance among the initial set of variables.
The lack of correlation between the principal components is a useful feature because it indicates that these components measure different statistical dimensions of the initial data. Each component is a weighted linear combination of the initial variables. Based on the correlation matrix or the covariance matrix, if the data has been standardized the eigenvalues are estimated and they give the weights for each principal component. The principal components are ranked decreasingly by the variation of the original variables, the first component corresponding to the largest variation. The second principal component which is uncorrelated with the first one corresponds to the maximum variation that is not contained in the first component, and so on.
This procedure has the advantage of being as objective as possible, since it will never rely on arbitrarily selected weights but will always show values that are obtained via statistical methods. In the formula of the composite index the variables that need to have a small contribution will be represented with a minus, so that the level of the health status can be represented with values as high as possible.
We are aware of the large variety of methodologies that could have served the purpose of building composite indicators. However, in this study we focused on the PCA method, as it is one of the most commonly used techniques in building composite indicators. In this sense, Jacobs, Smith and Goddard [
41] bring evidence of the use of PCA in several applications such as the internal market index for the EU countries to reduce the dimensionality of the initial data sets. Moreover, according to [
39] one benefit of a linear composite consists in the fact that transformation of the initial variables can ensure that the weights of the composite are kept valid across the range of observed performance. Additionally, in order to reduce dimensionality through non-linear extensions of PCA we need sufficiently large data sets. The size of our sample is not appropriate for proving non-linearity or for performing the validation procedures required by non-linear PCA (NPCA). In conclusion, the computational cost involved by NPCA cannot be justified in this context.
Step 5. Testing the Robustness of the Composite Index through Sensitivity Analysis
The last step in the process of building the composite index implies conducting a sensitivity analysis to test the robustness of the index. One possible way could be to examine the ranks and the final scores of the correlation coefficients while simulating multiple structures of the composite index with distinct choices of weights. Another useful addition to it could be to construct the confidence intervals around the composite index, as larger standard errors would lead to wider confidence intervals which signals less precision around the estimates.
The robustness of the composite index can also be tested through the use of different statistical tests that evaluate the quality of the PCA results. Such tests are the Kaiser–Meyer–Olkin (KMO) and the Bartlett’s test of sphericity. On the one hand, the KMO test evaluates the sampling adequacy, by comparing the magnitudes of the partial correlation coefficients to the magnitudes of the observed correlation coefficients. For values greater than 0.5, the test indicates that a factor analysis is appropriate to be applied [
48], even though the most reliable results of the PCA are to be expected when the test value is higher than 0.8, showing that there is a high factorability for the data sample.
On the other hand, the Bartlett’s test of sphericity checks for any redundancy between variables so that the individual indicators from the correlation matrix to be uncorrelated (i.e., the correlation matrix should be an identity matrix). The test is statistically significant if the associated probability of the test is less than 0.05.
In this paper we applied both KMO and the Barlett’s test in order to check the robustness of the index. We notice that the KMO test value is 0.740, suggesting that the sampling is adequate and the PCA is, indeed, appropriate. Regarding the Bartlett’s test of sphericity we notice that the test is statistically significant (approximate chi-square = 148.937), meaning that the correlation matrix is not an identity matrix and that variables are related and therefore suitable for structure detection.
5. Discussion, Implication and Conclusions
Balancing between growing need for adequate, affordable and efficient healthcare, which implies growing expenditure with the necessity of efficient spending of public finances will continue to be a difficult burden on EU governments in the years to come. Adequate and sustainable budgeting is one of the main goals of any healthcare system, being a key feature of good quality, accessible and affordable healthcare services. Nevertheless, there are different pathways towards this goal and each EU country may find its own way through a mix of policies regarding revenue generation and collection, reallocation of funds within the system, system design and institutional arrangements.
Given the recent increase of worldwide interest in the use of composite indicators for measuring healthcare performance, this paper explores both the economic and the methodological aspects involved in building such a complex index in order to quantify the health systems performance of the European Union countries. Principal components analysis was applied upon an initial set of 16 relevant health indicators provided by Eurostat and the Sustainable Development Knowledge Platform for which data was available. In order to capture the multi-dimensionality of the health systems performance problem we used indicators reflecting not only the supply of medical services, but also the population-specific health status indicators, as well as labor market specific health indicators.
The main benefit of the composite index consisted in the ability to offer a comprehensive performance assessment and to provide a clear ranking of the EU countries based on the performance of their health systems, focusing on objective criteria. The composite index then became a useful tool for exploring the correspondence between health performances and fiscal sustainability of health systems in these countries. The analysis was built on a MCA framework, a technique which allowed for simplified and suggestive visual representations helping us to raise some key discussions.
The main findings suggested that the countries characterized by high levels of healthcare expenditures as percentage of GDP, compared to average EU level, are commonly at the top of the Health Index. This means that they often have reduced mortality rates, a lower incidence of fatal work accidents and tuberculosis disease, higher fertility rates, a substantial supply of medical services expressed by the number of doctors. Furthermore, most of these countries are frequently above the EU average with respect to the duration of working life and health employment. Another finding underlined by our investigation shows that the health systems included within this category are characterized by a low diversification of the health funding sources, government schemes covering over 80% of the total health expenditures. These patterns suggest an efficiency of healthcare spending that could reduce the risks to long-term fiscal sustainability. Generally, our results are consistent with previous results obtained from a DEA approach developed in 2010 on European countries [
31].
It seems that countries which assign a lower than average share of their GDP to healthcare, relative to the EU average, find it harder to achieve outcomes comparable to countries with larger healthcare expenditures. Therefore, these countries usually score lower than the aforementioned ones, lagging behind EU levels with respect to the health status of the population and the supply of medical services. These results are in line with other findings that argue that the increase in health expenditure as a share of GDP lead to improvements in healthcare [
9]. Even if we notice a proximity to the weak diversification category, in this case, the association between the attributes of the health systems and the diversification of the funding mechanisms is not so precise. Consequently when the input depicts a low level, the distribution among different sources it is not so significant.
The empirical research on the EU member states provides a better understanding of the health system performance and fiscal sustainability. From a managerial point of view, this study provides a methodology for evaluating and ranking health system performances and some clues upon the health spending efficiency and policy implications. From an academic perspective, we propose a more circumspect and objective attitude towards the way health spending efficiency and health system performances can be tackled, thus opening the debate for further investigation.
We are aware, however, of the limitations of our study. Although composite indicators could be seen as valuable tools in different policy making areas, they can also be the subject of debate regarding the choice of initial indicators, as well as the method applied for weighting and aggregating. Proper comparisons with other health composite indicators from the international literature could provide a more complex sensitivity analysis of the proposed composite index. However, in the absence of similar characteristics in terms of initial data sets, country samples and time-frames, a comparison of such results might be biased and generate potential misinterpretations. Since the literature review indicated no proper comparison match to our composite index (developed for the year 2015 for the 28 EU countries), we believe we must be cautious when dealing with such issues and avoid further comparisons. Constructing composite indicators is not always a simple task and the linked methodological difficulties may raise several technical and economic challenges. In our case, a larger set of initial indicators would have been ideal for capturing a more holistic image of the health system performances. Further investigation on the propensity and perceived expensiveness of health examinations could also have been better tackled. The choice of initial indicators should, however, be seen as a trade-off between data availability and the relevance of the composite index in accurately measuring the performance of the EU health systems’ performance.
Regarding the methodological aspects, although the PCA methodology was tested for adequacy and found to be appropriate, we may still face the criticism that correlations might not necessarily reflect the real connections between the selected indicators and the phenomena under observation.
Finally, there is the issue concerning the choice of the country sample that includes both long-standing members and newer ones. Even though we are aware of the heterogeneity between data, we accept such biases in order to be able to conduct an investigation of health system performances at the EU level and to objectively provide a ranking between the EU member states using PCA. The results confirm that more developed countries tend to have better performing health systems, but the MCA revealed some particular cases of inefficiency given that both the expenditures and the human resources involved are high. Our findings provide additional arguments to support our choice of using such a country sample.
As future research, we are planning to further investigate the technical efficiency of EU health systems through specific non-parametric methodologies, such as the DEA technique, having the Composite Health Index as output and fiscal indicators as inputs to the model. We consider that building the composite health index represents a prerequisite step in the efficiency estimation framework. This statement is supported in the first place, by the so called “curse of dimensionality” translated into an upward bias of DEA efficiency scores when using a large number of input and/or output variables. Of course, an additional way of reducing this drawback will consist in extending the sample size by including other health systems in the analysis. This approach could have the benefit of allowing a more complex investigation of the efficiency of different health systems, by ranking them according to the capacity of maximizing their outputs given their inputs.