Next Article in Journal
Importance of Feedstock in a Small-Scale Agricultural Biogas Plant
Next Article in Special Issue
A Review of Data-Driven Approaches for Measurement and Verification Analysis of Building Energy Retrofits
Previous Article in Journal
Research on the Characteristics and Influencing Factors of Chinese Urban Households’ Electricity Consumption Efficiency
Previous Article in Special Issue
Performance Evaluation of a Nearly Zero-Energy Office Building in Temperate Oceanic Climate Based on Field Measurements
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Evaluation of the Quality of the Housing Environment Using Multi-Criteria Analysis That Includes Energy Efficiency: A Review

1
Institute of Civil Engineering, Warsaw University Life Sciences—SGGW, Nowoursynowska 159, 02 776 Warsaw, Poland
2
Faculty of Architecture, Wrocław University of Science and Technology, Bolesława Prusa 53/55, 50 317 Wrocław, Poland
3
Department of Applied and Landscape Ecology, Faculty of AgriSciences, Mendel University in Brno, Zemědělská 1, 613 00 Brno, Czech Republic
4
Department of Plant Biology, Faculty of AgriSciences, Mendel University in Brno, Zemědělská 1, 613 00 Brno, Czech Republic
*
Author to whom correspondence should be addressed.
Energies 2022, 15(20), 7750; https://doi.org/10.3390/en15207750
Submission received: 28 September 2022 / Revised: 13 October 2022 / Accepted: 18 October 2022 / Published: 20 October 2022
(This article belongs to the Special Issue Energy Efficiency of the Buildings)

Abstract

:
The quality of the housing environment (HE) is an important issue that has a direct impact on the life of inhabitants. Aiming for quality in residential architecture begins with a well-designed HE, with the designing process being a value that is difficult to evaluate. Nowadays, a well-designed HE takes into account the energy efficiency of a building. An appropriate degree of thermal comfort, which is required by inhabitants, needs to be considered at the design stage. Designers can use building certification programs and multi-criteria analysis to motivate investors to construct buildings in accordance with energy efficiency requirements. These systems respond to the needs of energy efficiency, thermal comfort, sustainable heating, and ventilation. Defining ways and methods to evaluate quality in architectural projects will allow the value of the HE to be improved. For this purpose, a multi-criteria analysis of five systems that can be used to evaluate HE quality and energy efficiency in a temperate climate was conducted: (1) Building For Life 12, (2) Home Quality Mark, (3) Housing Quality Indicators, (4) Système D’évaluation De Logements (Sel), and (5) NF Habitat-NF Habitat HQE. This analysis concerned information about the systems, their applicability in practice, and the applied assessment measures. The article shows that the quality of the HE consists of specific factors that can be distinguished and indicated by evaluation systems. As a result of the carried out assessment of the housing environment, 13 original categories of building assessment criteria were defined. The results of the conducted analysis indicated that it is possible to: (i) identify factors for the improvement of HE quality; (ii) prepare objective systems for the measurement of the HE; and (iii) use such systems in practice, e.g., in the design industry, real estates, and public administration. Moreover, the systems can be used in legal regulations for updating urban policies.

Graphical Abstract

1. Introduction

Residential architecture has a significant impact on the structure of today’s European cities. According to the statistics of the European Commission concerning the construction industry, housing construction accounts for 60% to 85% of new investments (depending on the country) Therefore, housing has a significant impact on people’s lives—we spend most of our time at home. Research conducted by the European Commission shows that we spend on average 90% of our time indoors [1], almost 68.7% of which is spent at home [2]. People sleep, rest after work, and meet family and friends—they satisfy the basic human needs described by Abraham Maslow in his “hierarchy of needs”. This is one of the reasons why the housing environment that we live in plays a significant role in our lives, which is also confirmed by Maslow [3]. The importance of the housing environment was discussed at the first Habitat conference concerning the human environment, which was held in Vancouver on 11 June 1976. In its declaration, it can be seen that “improving the quality of human life is the first and most important aim of any human settlement policy” [4]. Therefore, according to the authors, this is an important reason why the identification of measurable quality factors can increase the positive impact on the housing environment. Nowadays, a well-designed HE takes into account the energy efficiency of the building. In order to provide the inhabitants with an appropriate degree of thermal comfort, which is required by inhabitants, needs to be considered at the design stage. Designers can use building certification programs and multi-criteria analysis to motivate investors to construct buildings in accordance with energy efficiency requirements. These systems respond to the needs of energy efficiency, thermal comfort, sustainable heating, and ventilation. Defining ways and methods to evaluate quality in architectural projects will allow the value of the HE to be improved.

1.1. Energy Efficiency of the Housing Environment

The drastically increasing costs of energy consumption [5], a lack and limitation in the supply of energy resources during winter seasons, and the low quality of energy resources are all examples of reasons why homeowners and housing associations decide to improve the energy efficiency of existing buildings [6,7,8]. Improving the energy efficiency of residential buildings is an issue that is widely discussed in the professional and scientific community. This is due to the fact that housing environments are among the most commonly constructed buildings [9]. Research topics can be divided into two categories: (i) those related to the design and implementation of housing environments, with solutions that improve the energy efficiency of a building being taken into consideration; and (ii) those related to the retrofitting of the existing stock of housing environments [10].
Housing environments in which solutions that aim to reduce energy consumption are not included in the design and construction stage will be detrimental to the living conditions of residents [11]. Retrofitting buildings in order to improve energy efficiency, and the use of alternative renewable energy resources, will: (i) allow the cost of heating to be reduced; (ii) allow the cost of cooling to be reduced; (iii) allow thermal comfort in buildings to be improved [12]; and (iv) benefit the national energy saving demand strategy [12,13,14]. The authors of a research study on the motivations and barriers that investors face before improving the energy efficiency of retrofitted buildings identify factors that influence this, such as low direct benefits and long payback periods [15], postponing the decision to undertake construction work [16], and high initial investment costs [17].
There are more and more reasons to implement a systemic energy efficiency tool [18]. In a building that is optimized in terms of energy efficiency, it is possible to achieve up to a 90% reduction in operational primary energy [19]. However, it should be noted that despite negative forecasts, some investors are still not looking into the possibilities of improving the energy efficiency of their buildings. Due to this, the responsibility to educate building owners lies with the designers of housing environments. A very effective tool for this can be multi-criteria rating and certification systems [20]. These systems make the investor aware of what elements they should take care of in their investment if they want, for example, to reduce the costs of building maintenance.

1.2. Reasons for Measuring the Quality of Housing and Neighbourhoods

Arguments for implementing tools to assess residential architecture can be grouped into three categories: (i) socio-economic, (ii) educational, and (iii) environmental.
Socio-economic arguments: The main reason why countries such as the United Kingdom (U.K.) [21], Switzerland, and France have introduced rating systems for assessing the quality of housing environments is due to the need to improve the quality of life for inhabitants. Improvements are possible with regard to two areas: improving the built environment and improving sanitation facilities [22]. In the first of these areas, residential architecture has a significant impact on the physical structure of the human environment. This is due to its basic function of providing a “shelter” and a space in which inhabitants live, in turn making housing one of the most developed investments. The quality of these developments is a fundamental component in the assessment of the local physical environment, whereas well-designed residential architecture improves the built environment and has a significant role to play in terms of the quality of human life [23,24]. The second area refers to the health situation of inhabitants, in which both physical and mental health can be made better by improving living conditions (including sanitation) [25,26]. An indirect economic factor resulting from the improved quality of housing environments and the health of inhabitants is a true reduction in expenditure in hospitals, care facilities, or clinics [27]. In this way, mental [28] and physical health [29] improve without generating any costs that are related to social care (e.g., benefits from the state). Economic constraints also generate income for the economy, as inhabitants can spend less time on sick leave (in hospitals or rehabilitation) and more time doing their jobs, whereas students can participate in school activities. Another argument in favor of introducing a rating system for housing environments is that it can be used in the real estate market. This is due to the fact that it can be used by people who are looking for a dwelling to buy or rent, as well as by developers and sales-related companies [30]. An objective tool to measure the quality of residential architecture would work well in the real estate market because clients would be able to receive extensive information regarding their decision of whether to buy or rent a property. In addition, investors and planners would be able to use such a system to obtain clear information about which aspects related to the design of a building should be considered. This general system for investors will result in an improved built environment. The system would also be applicable for decision makers in public authorities who deal with affordable social housing for rent. Due to this, it will be possible to verify if a project is compatible with the standards of living of inhabitants, and also if public funds are spent rationally. In the case of non-compliance with specific requirements, officials would have a tool in order not to grant funds for investments.
Educational Arguments: A possible way to educate the community (renters, buyers, and investors) is to objectively compare developments with each other so that the most interesting living environments can be highlighted. Objectively comparing housing environments is a difficult task that judges have to face when evaluating participation in a design competition for housing environments. This form of education reaches very large audiences, and such contests are often well publicized in the media and promoted by city administrators [31]. Highlighted investments create a level/standard, and therefore the worst investments may have a problem in finding inhabitants. Another educational value of a quality assessment system can be seen to be indicators that are appropriately identified. Education enables the promotion of good construction practices that will allow the negative impact of housing on the environment to be reduced by increasing the importance of the indicators of sustainable building development [32,33].
Environmental Arguments: Improving a city’s operational efficiency and livability also brings improvements in housing quality and urban system resilience [34,35]. Cities and housing spaces have microclimates of their own, which are reflected in higher temperatures. This is due to the release of anthropogenic heat, the excessive deposition of solar radiation, the lack of green spaces, limited air circulation, and a reduced ability to reflect infrared radiation. The phenomena give rise to urban heat islands, which are present in many cities around the world [36,37]. Overheating in cities has a serious impact on the energy consumption of buildings, peaks of electricity consumption, concentrations of air pollutants, and the level of mortality and morbidity of the human population [38]. Therefore, these factors significantly influence the assessment of the quality of the housing environment by residents. Urban and building typologies have serious implications for the urban climate, and generally determine the magnitude of urban overheating [39]. Overheating of the urban climate can be reduced through urban greenery and sufficient evaporation sources, etc. [40]. Contemporary cities represent a mosaic of different habitats. These habitats include urban green spaces, which take different forms: forests, parks, wastelands and ruderal sites, lawns, ornamental plantings, and meadows. Urban green infrastructure provides a range of different ecosystem services. The most commonly provided services are improvements in the local climate and air quality, as well as in the use of recreational and sport areas [41,42]. Nielsen [43] found that parks are important biodiversity hotspots in urban environments [44]. Community gardens and urban agriculture are important from a biodiversity perspective [45,46]. However, urban greenery can also be a source of biogenic pollutants such as pollen and volatile organic compounds that can reduce air quality [47]. The issue of vegetation as a source of allergenic pollen has been highlighted in a number of papers [48,49].

1.3. Evaluation of Living Environments

There are many reasons to evaluate the quality of residential architecture, and also reasons to improve knowledge in this field. At the same time, it is difficult to characterize all these reasons unequivocally. Research in this discipline is basic and fundamental, and the obtained results can affect a large part of society. Defining the factors (that influence the quality of housing environments) and their measurement methods is an important task in the process of improving people’s living conditions [50].
In order to achieve these objectives, it is helpful to use tools that measure the quality of HE. One of the main reasons for the measurement is the need to indicate that a quality factor has been included in the project, improving the quality of a housing development [51,52]. At the same time, it is noticeable that some of the quality factors correlate with each other, which poses a problem when describing them unambiguously, and also when giving them appropriate priority. Only when all elements influence a factor is it possible to achieve the best possible quality results [53]. For example, factors that improve conditions of the existing built environment can be measured by defining appropriate standards (factors), with respect to architectural, urban, natural, social, or educational aspects, as well as good engineering practices used in the construction of buildings [54,55] and designing a safe space [56,57].
The issue of the quality and measurability of housing environments has been tackled by various research groups, including psychologists, sociologists, geographers, ecologists, engineers, urban planners, and architects. As a result, this issue has been studied by various interdisciplinary groups, which analyzed its detailed aspects. In the analyzed papers, authors of research on the evaluation of housing environments often focus on one or a few areas without covering the whole issue. Moreover, it is difficult to find research papers that discuss systems for: evaluating housing environments, comparing them with each other, and drawing conclusions for further research. The identification of these quality factors in the housing environment can provide many possibilities of their use. Therefore, the authors want to show that the quality of housing environments consists of specific factors that can be distinguished and indicated by evaluation systems. In this paper, an analysis of evaluation systems is presented. These tools can easily measure some factors related to the quality of the housing environment. Moreover, the systems are described in a synthetic way and in three categories: general information about the system, how to use the system, and the criteria (defined by the system) that are subject to assessment.
Selected systems for the evaluation of housing environments will be presented. Based on the conclusions from the evaluation system analysis (according to the methodology, Figure 1), it will be possible to present the classification of quality factors whose application and implementation at a stage of housing environment design will facilitate to provide a quality place to live, complying with the needs of today’s inhabitants.

2. Materials and Methods

The main objective of this article is to analyze selected multi-criteria assessment systems that are applied in Europe in order to evaluate the quality of housing environments. These studies should be classified as fundamental in relation to the human-built environment. To achieve the research aim, the paper is divided into the stages described below, as shown in Figure 1.
Stage I: Literature analysis concerning multi-criteria systems for assessing buildings. Three main criteria were used to select the systems for the analysis: (i) a thematic scope—multi-criteria systems that can be applied to evaluate housing environments; (ii) a temporal scope—includes systems that were used from the year 2000 to 2022; and (iii) a territorial scope—systems applied in Europe in temperate climates. Based on the analysis of the nine systems shown in Table 1, it was possible to identify the scope of the selected systems for detailed analysis. The selection criteria are discussed in the key to Table 1.
Stage II: Detailed analysis of the research of five building evaluation systems, which were selected from the prepared database of systems. The examples presented in Table 1 were selected according to the following criteria: (i) the selection of varied evaluation systems that will allow a detailed analysis of material (spatial, architectural, and environmental) and non-material (social) factors to be presented; and (ii) the availability of research literature for verifying the system in terms of: (i) general information on how to use the system; (ii) assessment criteria; and (iii) application of the system in practice.
Stage III: As a result of five detailed analyses of selected multicriteria evaluation systems, by which the quality of residential environments can be assessed, a summary analysis of the evaluation factor will be presented.

3. Systems of Multicriteria Analysis

The presented paragraph about ways to evaluate housing environments provides evidence of how housing quality can be measured in practice. It proves that the increasing knowledge of subject allows delivery of high-quality living spaces that consider, e.g., sustainability, economic availability, and the needs of today’s society. Five systems are characterized, which represent a tool to objectively evaluate, compare, and improve the quality of housing projects in Europe.
The analyzed tools present a variety of evaluation methods and criteria, making it possible to obtain insightful and multifaceted partial conclusions. The diversity of criteria in the tools is caused, e.g., by aims and reasons for which a given system was created. Analyzing the assessment tools, by examining their advantages and disadvantages, and also by understanding the criteria that have a positive impact on designed housing environments, will allow a variety of quality factors to be identified. However, the structure of the evaluation systems is similar for all the reviewed examples. The inclusion of quality criteria at the design stage allows for a real improvement in the future quality of the lives of inhabitants. This is due to the fact that the quality criteria, and their importance, are based on specialized knowledge and are often the conclusion of work developed in an interdisciplinary group of experts. The criteria that are based on the current knowledge and research on residential architecture are often updated to include elements that are seen to be annoying for today’s city inhabitants, such as waste segregation, access to sustainable transportation, the impact of buildings on climate change, or environmental approaches to the construction of buildings.
For each of the five systems that are described, the same information about the methods of using the system will be presented, the criteria for evaluating the system, and the system’s applicability. The systems were selected based on the availability of research material, the variety of examples, and their potential for use in the design of housing environments. Quality factors were divided into the following categories: (i) architectural, (ii) spatial, (iii) ecological, and (iv) social, as shown in Figure 2.

3.1. Building for Life 12

Building for Life 12 (BfL 12) is a market-leading certification system in England, and is used for the planning of both new residential buildings and whole neighborhoods. The provisions of the document have been officially approved by the government. The document is intended to encourage local communities, authorities, and developers to engage in joint discussions. As a result, high-quality housing projects will be developed and will satisfy the expectations of all the parties involved in the construction process [58].
The BfL 12 project has lived to work on five editions, the first being in 2012, thanks to the Building for Life Partnership (made up of three organizations: Commission for Architecture and the Built Environment (CABE), Design for Homes, and Home Builders Federation. The current fifth edition is from 2016 and was written by David Birkbeck (founder of Design for Homes) and Stefan Kruczkowski (urban planner and expert at the Design Council). The system was created as a result of the need to systematize and improve the quality of new residential environments designed in England. The BfL 12 system is a kind of industry guide to designing good places to live, in which the authors formulate and present their key issues in the form of open questions, in turn making the document more accessible to the local community and all participants in the design process. People using BfL 12 do not have to pay user fees, and therefore the authors encourage people to use it free of charge and to use it to refer to local plan developments [58]. Unlike other certification systems used in the building industry, BfL 12 does not require a specially qualified professional to operate and coordinate the system. All that is required is meticulous familiarization with all twelve questions (main and supplementary).
One of the reasons for the success of BfL 12 is that it has been implemented within the national spatial policy and promoted by national agencies. This helps local authorities to create local policies related to the planning and design of high-quality residential environments. An example of the BfL 12 system being put into practice is the County Durham Spatial Policy Supplement document, which was implemented in the northeast of England in 2019. The County Durham Plan [59] aims to improve and promote design standards that directly affect the quality of the residential environment. The document explicitly dictates that designers incorporate aspects of BfL 12 into their projects. Additionally, the evaluation system also helps city officials determine the quality of the development in question. For this purpose, the document introduces “Internal Design Review” methods (Internal Design Review), which are presented in a dedicated form for each of the twelve main questions. The evaluation criteria, with their breakdown into factors, are shown in Table 2, and their analysis is shown in Figure 3.

3.2. Home Quality Mark

The Home Quality Mark (HQM) is an independent certification system for new housing in England, Scotland, and Wales, which was developed by the Building Research Establishment (BRE). BRE is also responsible for one of the most popular BREEM building rating schemes—used in more than 70 countries. The criteria developed for the HQM are based on the latest scientific research on issues such as energy efficiency, noise reduction, water management, and air quality. The system is one of the few to include issues such as climate change and carbon reduction. The HQM quality mark was designed to provide a reliable rating system for new housing developments. Developers can use the system to ensure that flats and buildings have been built at a high level of quality with respect to the environment. Every HQM-certified house fulfils higher standards than the minimum values specified, e.g., in the English building law. The system can also be used by potential buyers of apartments, as the certificate provides reliable facts, e.g., about the exploitation costs of a property and its technical condition [60].
There are many reasons for using the HQM system. By constructing a building with an impact on the quality of realization, which is included in the detailed guidelines, it is possible to improve the health and well-being of inhabitants. This is because good-quality houses require less renovation and repair, saving worries, time, and money. Another exemplary advantage of the system is the complex idea of not degrading the environment through the construction of the building. Buildings constructed according to this system are energy efficient and have a high energy performance. At the same time, the system has a tool to provide a positive net benefit from biodiversity or new plantings of trees and plants, compensating for losses caused by the construction of a new building [61]. These topics are formulated in 13 main qualitative categories [62]. The evaluation criteria, with their breakdown into factors, are shown in Table 3, and their analysis is shown in Figure 4.
The BRE Institute has certified a development of 100 Lancaster Grange homes in Bricket Wood, Hertfordshire (England), with the Home Quality Mark being used for the first time in 2018. By using the system, developer Crest Nicholson is giving homebuyers a guarantee that their new homes are designed and built to high standards. They have a low environmental impact, low running costs, and provide health benefits. The Lancaster Grange development includes communal green spaces, play areas, and cycle and footpaths, with its close location to Radlett town center allowing easy access to schools or workplaces.

3.3. Housing Quality Indicators

Housing Quality Indicators (HQI) is a tool for measuring and evaluating the quality of existing, retrofitted, or designed housing environments. The main objective for the authors from DEGW was the need to create a tool that would have a real impact on the market, and which would improve housing conditions in the U.K. [63,64].
The program was initiated by the Department of Environment, Transport, and the Regions and Housing Corporation, public agencies that have been responsible for funding affordable housing in the U.K. By implementing the HQI system, it was possible to evaluate the quality of housing in relation to the costs it had incurred, already at the design stage. A positive evaluation ensured that public funding achieved the best price-to-value ratio [65]. The assessment instrument was used to evaluate projects that received funding from the National Affordable Housing Program (NAHP) in the years 2008–2011 and from the Affordable Homes Program (AHP) in the years 2011–2015. The first version of the system was developed and published in February 1999 [66]. A major aspect of the HQI tool is its ability to assess a variety of residential projects—both public and private—according to established guidelines. The HQI tool consists of ten indicators, each with a series of questions to be answered. Through them, developers and architects can make well-informed design decisions that result in high-quality housing while respecting the economic balance of the investment [63].
In 1999, the project authors (DEGR specialists) conducted a series of pilot tests to verify the HQI system in practice. For this purpose, they carried out tests on a group of 31 housing developments in the U.K. The groups differed from each other in terms of scale, location, and the number of inhabitants, with the only common point being their contemporary time of construction. The qualified buildings were both new buildings and modernizations of, e.g., city-center townhouses, which were implemented in the last five years. The authors of the research invited various institutions that build social housing, and also developers representing the private sector. The developers were all asked to propose three investments of different scales and quality—one being better and one being slightly worse. This element was difficult for private investors to fulfill, as evidenced by the representation of the private sector of only 30% [67].
According to the pilot research, the HQI system has been shown to be successful as a tool for measuring the real quality of housing. However, the authors noted the need for further work on the system in order to increase its usefulness in the private sector. The measurements were carried out by both inhabitants and specialists, in turn confirming that the evaluation method is practical and can be used by all interested participants. In the research, the lowest score was obtained by a modernized tenement house in the city center, which was also the oldest building in the represented group. The best result—77%—was obtained by the youngest building, in which a prototype smart home system was introduced. The average final score among the respondents was 55%. This result was very interesting, as it indicated that the good points of the developments were their location and visual aesthetics, while the lowest-rated categories were building accessibility and sustainability [67,68]. The evaluation criteria, with their breakdown into factors, are shown in Table 4, and their analysis is shown in Figure 5.

3.4. Système D’évaluation De Logements (Sel)

Système D’évaluation de Logements (SEL) is one of the oldest tools for measuring and assessing the quality of housing environments. It was developed in 1975 in Switzerland, on the order of the federal government, to analyze the growing state-funded social housing [69,70].
The system has received several updates. The first edition, in 1975, contained 66 criteria for evaluating new developments under the federal housing finance program. Later updates were mainly aimed at adapting the system to today’s actualities and trying to make the tool as practical as possible. In 2000, the criteria were reviewed and reduced to 39 indicators [71]. The current version of the SEL system was published in September 2015 by the Federal Housing Office (Office ederal du logement). The number of criteria was reduced to 25 indicators, and grouped into three categories: living place; housing development; and dwellings. The tool was tested for its usefulness in responding to contemporary housing problems such as urban sprawl, energy overconsumption, or population growth in urban agglomerations. The system has also been updated with new criteria to improve the level of participation of future inhabitants and the local community in the design of the housing environment. The system gives more points for the design of land development that improves both the quality of life for inhabitants and the quality of the built environment, which have positive effects on the local community [71].
The SEL system was used to present a building evaluation and comparison in the series “Residential Buildings in Comparison” (Wohnbauten im Vergleich), by Paul Meyer-Meierling. The series, published between 1997 and 2004, consisted of more than 50 publications, with each edition dealing with a different theme, including timber housing [72] or low-energy housing [73]. The publication consisted of a detailed overview of housing developments and a presentation of key data and conclusions. The projects were documented in detail using photographs, plans, descriptions, and costs, and compared using the SEL system. The evaluation criteria, with their breakdown into factors, are shown in Table 5, and their analysis is shown in Figure 6.

3.5. NF Habitat—NF Habitat HQE

NF Habitat-NF Habitat HQE is an independent certification system for evaluating the quality of sustainable housing environments. The system was developed by the French association QUALITEL, which has been researching housing quality for over 46 years [70].
The beginnings of the association’s research date to 1974 when a method of measuring the quality of dwellings was created under the name Qualitel. The system was supposed to make an objective evaluation of individual apartments, thanks to which both investors and inhabitants would have complete information about the property. The quality certificate, which is issued by an objective association, was especially useful for people who decided to buy or sell a property. On its basis, it was possible to verify the rental or sale price. In its original version, the Qualitel system operated until 1988. The current version of the system was published in 2015 and is issued by CERQUAL Qualitel Certification, the certification unit of the QUALITEL Association. The unit is only involved in the certification of planned residential buildings. Developers can apply for the “NF Habitat” and its extension to the “NF Habitat HQE” certification, enriched with indicators for sustainable housing. The high level of certification and objectivity of the evaluation is confirmed by the cooperation with the French National Institute of Standardization (Association française de normalisation—AFNOR) [74]. The measurement indicators cover the entire life cycle of a building—through design, construction, use, renovation, and deconstruction. NF Habitat also offers indicators relating to the various contemporary housing challenges (including thermal comfort, acoustic comfort, safety, and ecology). According to the Qualitel association, NF Habitat certification is founded on four basic pillars: (1) quality of life; (2) respect for the environment; and (3) economic result [75]. The evaluation criteria, with their breakdown into factors, are shown in Table 6, and their analysis is shown in Figure 7.
The use of the certification system in France is significant, QUALITEL estimates that the association has issued more than 2.5 million certificates since its creation in 1974. The association responds to the expectations of the inhabitants, in a study carried out in 2015, up to 78% of French people who were surveyed would like to have a single national reference system for housing quality, which would allow and make easier their choice of place for living. Since then, the organization has been developing research towards the creation of a leading building certification system in France, and currently offers ten evaluation systems for multi-family housing, individual housing, or retrofitted residential buildings. In the year 2019 alone, 150,000 housing certificates were released [76].
The increased interest in the NF Habitat and NF Habitat HQE systems is evident in the number of issued certificates. It shows that in 2018, there was an increase of 21%, mainly to the expanded application in multifamily housing. This is due to the attention to the topic of improving the quality of housing and its environmental impact by city authorities. The QUALITEL association signs partnership agreements with cities in order to implement their certification system in newly designed residential buildings—both private and social ones. An example of this is the city of Metz in northeastern France, which on 24 January 2019 concluded an agreement committing to NF Habitat HQE certification for all new housing built in Zones D’aménagement Concerté (ZAC) [76].

4. Results

The systems that have been studied for analyzing and evaluating housing environments demonstrate real effectiveness in the designs (or modernizations) of housing projects in which they have been used. However, for the systems to achieve their purpose, it is crucial that the investor and designer work together to receive the best possible result in the evaluation system they have used. All the systems are different, with some focusing more on spatial factors and others expanding more on the architectural factors of the housing environment, as shown in Figure 8. This is due to the different goals that the authors wanted to achieve by introducing the new system. For example, the authors [58] of the BFL 12 system were looking to design user-friendly spaces, whereas the authors of the HQI system wanted to improve living conditions in social buildings.
The common point of the analyzed systems is the method of assessment by means of indicators, which contain specific guidelines, catalogues of “good practices” influencing the improvement of living conditions for the inhabitants. Due to this, it is possible to objectively evaluate the housing environment, and also use a comparative method to analyze different housing environments. This method is a very useful tool that allows both monitoring of its effectiveness and the analysis of results. By using appropriately defined indicators, the importance of factors that are currently problematic in housing environments can be highlighted. Measures to prevent the problem during the planning stage can also be included. The final assessment of the housing environment allows for a detailed analysis and comparison with the value applied by the system. Appropriately defined indicators could also play an educational and awareness-raising role for the public, e.g., to raise awareness of the importance of combating climate change. The use of a coherent and objective evaluation instrument would make it possible to compare housing buildings and, in the final analysis, to reward outstanding properties.
A common conclusion that can be made from research about the ways in which systems are used to evaluate the quality of residential environments is that the systems are most effective at the pre-design and design stages. This is due to the ability to apply quality factors in the early stages that later make up the final assessment. All the systems discussed provide a tool in discussions with the developer through which architects can implement good design solutions in housing developments.
Based on the analysis of the assessment systems, 13 main categories of quality factors are presented in Appendix A.

5. Discussion

The quality of housing environments consists of specific factors that can be identified and characterized. The analysis of the research problem and the identification of factors that improve the quality of the housing environment were the main and most difficult tasks of the conducted research. Characterization of these factors fulfils the identified research objectives of systematizing the state of knowledge affecting high-quality housing environments. The path to quality in residential architecture begins with working on a well-designed housing environment—a value that is difficult to evaluate [77,78,79]. The problem of presenting quality as an “added value” is common to all architectural projects. Owing to contemporary research, it can be stated that good design corresponds with long-term economic benefits [80]. This issue has been studied by a few researchers [81,82] dealing with quality in residential architecture, however, such work is relatively rare. The lack of extensive and systematic research in this specialization may be due to the belief that housing is one of the common investments of lesser importance for society. The analysis in the development of systems for measuring the quality of housing environments (result) has updated existing knowledge on the issue of housing quality.
The quality factors in the analysis (see Appendix A) define the elements which, if considered in the design of today’s housing environment, can allow one to realize a high-quality living space. The main categories have been grouped into quality types: spatial [83], architectural [68], environmental [84], and social [85]. With such a wide range of quality types, it is possible to satisfy the highest probability of future inhabitants’ needs. Moreover, quality factors can be divided into (i) material and (ii) non-material. Material factors can be measured in an objective way with the use of indicators. In the case of non-material factors, evaluation is subjective and depends on, e.g., the knowledge, experience, views, and preferences of the evaluator. The equal interaction of material and non-material factors can allow for an accurate assessment of the quality of the housing environment [86]. Therefore, the impossibility of objectively assessing non-material factors, which mainly affects the final assessment of the housing project, determines the difficulty of the assessment. A qualitative factor that cannot be translated into concrete values is, in the opinion of some stakeholders, an unreliable factor. This also coincides with the common opinion that good design is an “additional” value to investment. This opinion has been debunked by recent research, in which high-quality architecture brings a range of social, economic, and cultural benefits [87,88].
The analysis of systems for measuring the quality of housing environments shows that evaluation systems should strive for the synergy (interaction) of spatial, architectural, environmental, and social factors [89]. This is due to the fact that only by such a multisystem action is it possible to provide a completely high-quality living environment. Measuring only selected material factors, in the worst case, can result in the implementation of an investment, in which pressure related to costs and reduced construction time leads to a loss of functionality and an unattractive building [90]. It is therefore important that quality evaluation tools focus on a synergy of factors, without prioritizing the material factors over the non-material ones. Only with such an approach are we able to not lose the value of the project, which is something that should be emphasized by the evaluation system. An example of the complexity of using the measurement of some physical parameters of a building [91] is, e.g., the level of light intensity in a room. This can be measured using an illuminance meter, with a precise lux value being obtained. However, the inhabitant’s perception may be more perceptual or subjective, and may not confirm that the room has the right level of light.
The application of a building certification system at the design stage allows a high-quality building to be designed. The implementation of a building that meets the necessary functional, technical, and social quality standards is especially important for residential buildings. At the design stage, designers using the assessment system can make fundamental decisions that will be accepted by the investor in the development project. Implementing solutions such as sustainability at this stage allows them to be economically implemented, unlike in the case of retrofitting an existing building stock, where the work and financial effort is much higher and more difficult to implement. Therefore, the authors of all certification schemes explain that it is crucial to apply the systems’ solutions at the conceptual design stage.
In the search for elements that influence the quality of housing environments [92], researchers indicate that the most important evaluation indicators should be the needs of inhabitants and the measurement in the building after their occupation [93]. In housing, it is difficult—if not impossible—to know the opinions of future inhabitants. Apart from a few cases where designers have known the requirements of future occupants, some assessment systems also implement workshops with representatives of local organizations or the neighborhood community [94]. In this way, it is possible to get to know different perspectives and opinions on investments. Such pre-design workshops, carried out to understand the needs of all parties in the construction process, aim to identify common goals and priorities. This method is often decisive, since it is the user’s input that is innovative and contributes to the quality of the designed building. The lack of research in residential architecture, conducted after occupants have moved into the building, is limiting the designers’ knowledge of how to implement potential improvements to housing designs, as well as how to adapt these improvements to the needs of people in today’s time [95].
Improperly designed housing environments [96] impose increased (hidden) costs on municipalities, which ultimately cover these expenses through taxes. The main reason why hidden costs are not considered is that they are not incurred by decision makers, but instead by society as a general community [97]. An incorrect project location, a lack of infrastructure, and a lack of jobs are examples of the increased ”hidden” costs that will be imposed on future occupants, neighbors, and society. In economic science, this type of hidden cost is called a negative externality—it happens when someone, through their actions, does something that generates costs for others [88]. Examples of such negative external effects could be environmental pollution, noise, or overcrowding. Every new development involves certain costs which can certainly be counted as negative effects, e.g., consumption of natural resources, space, or green areas. However, the new development can generate compensation in terms of value and utility that will benefit the local community, as well as future inhabitants [98,99]. The issue of negative externalities is extremely important when trying to explain why the cost of a bad project is not always considered during the planning of a development. By transferring such costs to others, the initiators of these costs often insulate themselves from the negative consequences that are ultimately paid by the public.
Multi-criteria evaluation systems are becoming increasingly popular in developed countries, and are especially used in office [100], administration [101], and retail buildings [102], as well as in housing projects [19,53,75]. Clearly, this is a result of the implementation of sustainability policies in international corporations, and also the need to reduce expenditure. Rating systems such as BREEAM and LEED can reduce the environmental impact of a designed building by scoring quality measures [90], e.g., to reduce the use of fossil fuel resources, reducing carbon emissions and already visible climate change. Another argument to support green certification of buildings is the need to reduce expenditure in the energy sector [103]. The unstable situation on the energy market, rising energy prices, and difficulties in providing adequate amounts of fuel will mean that the solutions included in the certification systems will grow in popularity. An element that should also be pointed out in favor of using certification systems is the quality of a building’s construction, which reduces the costs of its maintenance and servicing [104,105].
Concluding the undertaken research and its results described in the Discussion Section 5, it can be stated the issue of the quality of living environments and multi-criteria assessment systems is a difficult subject to characterize. The characteristics presented (Appendix A) fill a gap in scientific publications on this research issue. The 13 universal categories of quality factors can be used more widely by city planners and authorities as the basis for updating urban policies. Suggestions for the use of the publication for future research work should refer to the identification of a hierarchy of quality factors for housing environments. The identification of this hierarchy appears to be an important and difficult task that is faced by all the authors of the building certification and the discussed assessment systems.

6. Conclusions

In the presented review publication concerning multicriteria analysis for the assessment of energy-efficient residential environments, five systems were discussed in detail: (1) Building For Life 12, (2) Home Quality Mark, (3) Housing Quality Indicators, (4) Système D’évaluation De Logements (Sel), and (5) NF Habitat-NF Habitat HQE. The research aimed to show how assessment systems can improve the energy efficiency of residential buildings. The analysis of the research problem and the identification of factors that influence the improvement of residential environments was the most important and most difficult task of the investigation. By characterizing the factors, the research objective was completed, and 13 main categories of quality factors were identified. The preparation of universal categories of quality factors will allow these aspects to be used in the implementation stage of housing environments. Considering these factors is an important element in the development of housing projects when taking into account the needs of residents, the environment, and the developer.
In the literature analysis, five contemporary assessment systems for housing environments were analyzed. The analysis of these assessment systems was related to the research thesis, as these tools easily identify selected qualitative factors of housing environments and allow for their evaluation. The results of the analysis of the systems showed that:
  • Factors can be identified.
  • An objective system can be prepared.
  • Such systems can be used in practice, e.g., in the design industry, real estate, and public administration.

Author Contributions

Conceptualization, Ł.M. and A.B.; methodology, Ł.M.; software, M.D.V.; validation, A.B., J.W. and M.D.V.; formal analysis, A.B.; investigation, E.K.; resources, J.W.; data curation, A.N.; writing—original draft preparation, Ł.M.; writing—review and editing, J.W., A.N. and E.K.; visualization, Ł.M.; supervision, E.K.; project administration, Ł.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Summary of systems for evaluating housing environments.
Table A1. Summary of systems for evaluating housing environments.
CategoryFactorRating System
12345
1. SpaceAccess for residents to services and facilities located close to the dwellingx x x
Clear separation of public and private space with access to the area for neighborhood contactsxxxx
2. Mobility and transportAccess to public transportxxxx
Access to sustainable mobility facilities such as city bikes, scooters, or a local car sharing system x
3. Economical availabilityFull information about housing costs, including, e.g., the maintenance and exploitation of the building x
4. Ecology and sustainabilityImproving the energy efficiency of the building x
Biodiversity x
Identification of environmental risks and opportunities x
Ecological changes and improvements x
5. WaterReduction of water use during construction of the building and during future use x x
Reduction in water consumption x
Ensuring good quality water x
Management of rainwater and land retention x x
6. Building materialsThe use of quality building materials x
7. Waste managementOn-site waste management x
Waste recycling (throughout the life cycle of the building) x
Designing appropriate outdoor spaces for waste storagex
8. Climate changeMinimizing greenhouse gas emissions x
9. SafetyDesigning safe housing environments, both the dwellings themselves and the developed area xx x
10. Comfort and functionality of the dwellingIndoor air quality x
Thermal comfort in the building x x
Acoustics x x
Natural lighting xx x
Smart building design x x
Ventilation x
Indoor pollutants x
Noise pollution xx
Living space per inhabitant x
Additional spaces/functions in the dwelling x
Appropriate living area, rooms, and additional space depending on the function x
Flexible living space design x
Kitchen and dining room x
Sanitary facilities xx
Storage space in the home and outside x
A well-designed space between the living area and the outdoor area x
11. Building and facilitiesOpen and accessible places x
Outdoor recreational space x
Shared spaces for inhabitants x
Integrating the building in the neighborhoodx
External storage space and facilitiesx x
External integration space x
Entrance area of buildings and housing units x
Community spaces x
Laundry and drying rooms x x
Extra rooms x
12. CommunityParticipation of future inhabitants or the local community in the design of buildings x
Guarantee for the proper use of the home, including: inspections, launching and testing of appliances, and installations x
Complete package of information about the property, which is necessary to make a decision before buying or renting x
13. Energy factorsAnalysis of the energy source and energy costs needed to construct the building and to exploit it x
Legend of evaluation systems: 1—Building For Life 12; 2—Home Quality Mark; 3—Housing Quality Indicators; 4—Système D’évaluation De Logements (Sel); and 5—NF Habitat–NF Habitat Hqe.

References

  1. European Commission. Indoor Air Pollution: New EU Research Reveals Higher Risks Than Previously Thought; European Commission: Brussels, Belgium, 2003. [Google Scholar]
  2. Klepeis, N.E.; Nelson, W.C.; Ott, W.R.; Robinson, J.P.; Tsang, A.M.; Switzer, P.; Behar, J.V.; Hern, S.C.; Engelmann, W.H. The National Human Activity Pattern Survey (NHAPS): A resource for assessing exposure to environmental pollutants. J. Expo. Sci. Environ. Epidemiol. 2001, 11, 231–252. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Salamon, M.; Muzioł-Węcławowicz, A. Mieszkalnictwo w Polsce. Analiza Wybranych Obszarów Polityki Mieszkaniowej; Habitat for Humanity Poland: Warsaw, Poland, 2015. [Google Scholar]
  4. Habitat. The Vancouver Declaration On Human Settlements; Habitat: Vancouver, BC, Canada, 1976. [Google Scholar]
  5. Klemeš, J.J.; Varbanov, P.S.; Ocłoń, P.; Chin, H.H. Towards Efficient and Clean Process Integration: Utilisation of Renewable Resources and Energy-Saving Technologies. Energies 2019, 12, 4092. [Google Scholar] [CrossRef] [Green Version]
  6. Huang, C.; Ma, J.; Song, K. Homeowners’ Willingness to Make Investment in Energy Efficiency Retrofit of Residential Buildings in China and Its Influencing Factors. Energies 2021, 14, 1260. [Google Scholar] [CrossRef]
  7. Rosak-Szyrocka, J.; Żywiołek, J. Qualitative Analysis of Household Energy Awareness in Poland. Energies 2022, 15, 2279. [Google Scholar] [CrossRef]
  8. Vilcekova, S.; Kridlova Burdova, E. Multi-criteria analysis of building assessment regarding energy performance using a life-cycle approach. Int. J. Energy Environ. Eng. 2014, 5, 83. [Google Scholar] [CrossRef] [Green Version]
  9. Moayedi, H.; Mosavi, A. Double-Target Based Neural Networks in Predicting Energy Consumption in Residential Buildings. Energies 2021, 14, 1331. [Google Scholar] [CrossRef]
  10. Gustavsson, L.; Piccardo, C. Cost Optimized Building Energy Retrofit Measures and Primary Energy Savings under Different Retrofitting Materials, Economic Scenarios, and Energy Supply. Energies 2022, 15, 1009. [Google Scholar] [CrossRef]
  11. Šujanová, P.; Rychtáriková, M.; Sotto Mayor, T.; Hyder, A. A Healthy, Energy-Efficient and Comfortable Indoor Environment, a Review. Energies 2019, 12, 1414. [Google Scholar] [CrossRef] [Green Version]
  12. Egiluz, Z.; Cuadrado, J.; Kortazar, A.; Marcos, I. Multi-Criteria Decision-Making Method for Sustainable Energy-Saving Retrofit Façade Solutions. Sustainability 2021, 13, 13168. [Google Scholar] [CrossRef]
  13. Bennadji, A.; Seddiki, M.; Alabid, J.; Laing, R.; Gray, D. Predicting Energy Savings of the UK Housing Stock under a Step-by-Step Energy Retrofit Scenario towards Net-Zero. Energies 2022, 15, 3082. [Google Scholar] [CrossRef]
  14. Calise, F.; Vicidomini, M.; Costa, M.; Wang, Q.; Østergaard, P.A.; Duić, N. Toward an Efficient and Sustainable Use of Energy in Industries and Cities. Energies 2019, 12, 3150. [Google Scholar] [CrossRef] [Green Version]
  15. Friedman, C.; Becker, N.; Erell, E. Retrofitting residential building envelopes for energy efficiency: Motivations of individual homeowners in Israel. J. Environ. Plan. Manag. 2018, 61, 1805–1827. [Google Scholar] [CrossRef]
  16. Klöckner, C.A.; Nayum, A. Specific Barriers and Drivers in Different Stages of Decision-Making about Energy Efficiency Upgrades in Private Homes. Front. Psychol. 2016, 7, 1362. [Google Scholar] [CrossRef] [Green Version]
  17. Wilson, C.; Pettifor, H.; Chryssochoidis, G. Quantitative modelling of why and how homeowners decide to renovate energy efficiently. Appl. Energy 2018, 212, 1333–1344. [Google Scholar] [CrossRef]
  18. Cortese, T.T.P.; de Almeida, J.F.S.; Batista, G.Q.; Storopoli, J.E.; Liu, A.; Yigitcanlar, T. Understanding Sustainable Energy in the Context of Smart Cities: A PRISMA Review. Energies 2022, 15, 2382. [Google Scholar] [CrossRef]
  19. D’Agostino, D.; Parker, D.; Melià, P. Environmental and economic implications of energy efficiency in new residential buildings: A multi-criteria selection approach. Energy Strategy Rev. 2019, 26, 100412. [Google Scholar] [CrossRef]
  20. Maleki, B.; Casanovas Rubio, M.d.M.; Hosseini, S.M.A.; de la Fuente Antequera, A. Multi-Criteria Decision Making in the Social Sustainability Assessment of High-Rise Residential Buildings. IOP Conf. Ser. Earth Environ. Sci. 2019, 290, 012054. [Google Scholar] [CrossRef]
  21. Garrett, H.; Mackay, M.; Nicol, S.; Piddington, J.; Roys, M. The Cost of Poor Housing in England; BRE: Watford, Herts, 2021. [Google Scholar]
  22. Nicol, S.; Roys, M.; Ormandy, D.; Ezratty, V. The Cost of Poor Housing in the European Union; BRE: Watford, North Dakota, 2016. [Google Scholar]
  23. Heywood, F. Understanding needs: A starting point for quality. Hous. Stud. 2004, 19, 709–726. [Google Scholar] [CrossRef]
  24. Watson, K.J.; Evans, J.; Karvonen, A.; Whitley, T. Re-conceiving building design quality: A review of building users in their social context. Indoor Built Environ. 2016, 25, 509–523. [Google Scholar] [CrossRef]
  25. Evans, G.W.; Wells, N.M.; Chan, H.-Y.E.; Saltzman, H. Housing quality and mental health. J. Consult. Clin. Psychol. 2000, 68, 526–530. [Google Scholar] [CrossRef]
  26. Madsen, B.; Ghekiere, L. The State of Housing in Europe 2021; European Commission: Brussels, Belgium, 2021. [Google Scholar]
  27. Statistics New Zealand. Measuring Housing Quality. In Potential Ways to Improve Data Collection on Housing Quality in New Zealand; 2015; Statistics New Zealand: Wellington, New Zealand. Available online: https://www.stats.govt.nz/methods/measuring-housing-quality-potential-ways-to-improve-data-collection-on-housing-quality-in-new-zealand (accessed on 1 January 2022).
  28. Clark, J.; Kearns, A. Housing Improvements, Perceived Housing Quality and Psychosocial Benefits From the Home. Hous. Stud. 2012, 27, 915–939. [Google Scholar] [CrossRef]
  29. Harrison, M. Defining housing quality and environment: Disability, standards and social factors. Hous. Stud. 2004, 19, 691–708. [Google Scholar] [CrossRef]
  30. Lounela, T. Model for the evaluation of the quality of housing management. Scand. Hous. Plan. Res. 1992, 9, 231–236. [Google Scholar] [CrossRef]
  31. Eilouti, B. Reinventing the wheel: A tool for design quality evaluation in architecture. Front. Archit. Res. 2020, 9, 148–168. [Google Scholar] [CrossRef]
  32. Karji, A.; Woldesenbet, A.; Khanzadi, M.; Tafazzoli, M. Assessment of Social Sustainability Indicators in Mass Housing Construction: A Case Study of Mehr Housing Project. Sustain. Cities Soc. 2019, 50, 101697. [Google Scholar] [CrossRef]
  33. Rindfuss, R.R.; Piotrowski, M.; Thongthai, V.; Prasartkul, P. Measuring Housing Quality in the Absence of a Monetized Real Estate Market. Popul. Stud. 2007, 61, 35–52. [Google Scholar] [CrossRef]
  34. Bać, A. Regeneration—Beyond sustainable architecture. In Theory of Habitat: The Contemporary Context; Bać, Z., Ed.; Publishing House of Wrocław University of Science and Technology: Wroclaw, Poland, 2019; pp. 107–114. [Google Scholar]
  35. Gu, C.; Guan, W.; Liu, H. Chinese urbanization 2050: SD modeling and process simulation. Sci. China Earth Sci. 2017, 60, 1067–1082. [Google Scholar] [CrossRef]
  36. Keat, W.J.; Kendon, E.J.; Bohnenstengel, S.I. Climate change over UK cities: The urban influence on extreme temperatures in the UK climate projections. Clim. Dyn. 2021, 57, 3583–3597. [Google Scholar] [CrossRef]
  37. Parker, J. The Leeds urban heat island and its implications for energy use and thermal comfort. Energy Build. 2021, 235, 110636. [Google Scholar] [CrossRef]
  38. Santamouris, M. Recent progress on urban overheating and heat island research. Integrated assessment of the energy, environmental, vulnerability and health impact. Synergies with the global climate change. Energy Build. 2020, 207, 109482. [Google Scholar] [CrossRef]
  39. Loeffler, R.; Österreicher, D.; Stoeglehner, G. The energy implications of urban morphology from an urban planning perspective—A case study for a new urban development area in the city of Vienna. Energy Build. 2021, 252, 111453. [Google Scholar] [CrossRef]
  40. Norton, B.A.; Coutts, A.M.; Livesley, S.J.; Harris, R.J.; Hunter, A.M.; Williams, N.S.G. Planning for cooler cities: A framework to prioritise green infrastructure to mitigate high temperatures in urban landscapes. Landsc. Urban Plan. 2015, 134, 127–138. [Google Scholar] [CrossRef]
  41. Giedych, R.; Maksymiuk, G. Specific Features of Parks and Their Impact on Regulation and Cultural Ecosystem Services Provision in Warsaw, Poland. Sustainability 2017, 9, 792. [Google Scholar] [CrossRef] [Green Version]
  42. Nowak, D.J.; Hirabayashi, S.; Doyle, M.; McGovern, M.; Pasher, J. Air pollution removal by urban forests in Canada and its effect on air quality and human health. Urban For. Urban Green. 2018, 29, 40–48. [Google Scholar] [CrossRef]
  43. Nielsen, A.B.; van den Bosch, M.; Maruthaveeran, S.; van den Bosch, C.K. Species richness in urban parks and its drivers: A review of empirical evidence. Urban Ecosyst. 2014, 17, 305–327. [Google Scholar] [CrossRef]
  44. Nowysz, A. Urban vertical farm—Introduction to the subject and discussion of selected examples. ACTA Sci. Pol. Archit. Bud. 2022, 20, 93–100. [Google Scholar] [CrossRef]
  45. Grochulska-Salak, M.; Nowysz, A.; Tofiluk, A. Sustainable Urban Agriculture as Functional Hybrid Unit—Issues of Urban Resilience. Buildings 2021, 11, 462. [Google Scholar] [CrossRef]
  46. Nowysz, A. Modernist Projects of Community-Based Urban Farms in Residential Areas—A Review of Agrarian Cooperatives in the Context of Contemporary Urban Development. Buildings 2021, 11, 369. [Google Scholar] [CrossRef]
  47. Salmond, J.A.; Williams, D.E.; Laing, G.; Kingham, S.; Dirks, K.; Longley, I.; Henshaw, G.S. The influence of vegetation on the horizontal and vertical distribution of pollutants in a street canyon. Sci. Total Environ. 2013, 443, 287–298. [Google Scholar] [CrossRef]
  48. Vaverková, M.D.; Adamcová, D.; Winkler, J.; Koda, E.; Červenková, J.; Podlasek, A. Influence of a Municipal Solid Waste Landfill on the Surrounding Environment: Landfill Vegetation as a Potential Risk of Allergenic Pollen. Int. J. Environ. Res. Public. Health 2019, 16, 5064. [Google Scholar] [CrossRef]
  49. Žiarovská, J.; Urbanová, L.; Fernández-Cusimamani, E.; Ražná, K.; Labajová, M. Variability in expression profiles of Betulaceae spring pollen allergens in Central Europe region. Biologia 2021, 76, 2349–2358. [Google Scholar] [CrossRef]
  50. Mazur, Ł. Quality of Contemporary Housing Environments on the Example of a Selected European Implementation from 2010–2020; Wrocław University of Science and Technology Faculty of Architecture: Wrocław, Poland, 2021. [Google Scholar]
  51. Kain, J.F.; Quigley, J.M. Measuring the Value of Housing Quality. J. Am. Stat. Assoc. 1970, 65, 532–548. [Google Scholar] [CrossRef]
  52. Solow, A.A. Measuring the Quality of Urban Housing Environment: A New Appraisal Technique. J. Land Public Util. Econ. 1946, 22, 282–293. [Google Scholar] [CrossRef]
  53. Mulliner, E.; Smallbone, K.; Maliene, V. An assessment of sustainable housing affordability using a multiple criteria decision making method. Omega 2013, 41, 270–279. [Google Scholar] [CrossRef] [Green Version]
  54. Godlewski, T.; Mazur, Ł.; Szlachetka, O.; Witowski, M.; Łukasik, S.; Koda, E. Design of Passive Building Foundations in the Polish Climatic Conditions. Energies 2021, 14, 7855. [Google Scholar] [CrossRef]
  55. Sivasuriyan, A.; Vijayan, D.S.; Górski, W.; Wodzyński, Ł.; Vaverková, M.D.; Koda, E. Practical Implementation of Structural Health Monitoring in Multi-Story Buildings. Buildings 2021, 11, 263. [Google Scholar] [CrossRef]
  56. Horne, R.; Willand, N.; Dorignon, L.; Middha, B. The lived experience of COVID-19: Housing and household resilience. AHURI Final Rep. 2020. [Google Scholar] [CrossRef]
  57. Winston, N. Multifamily housing and resident life satisfaction in Europe: An exploratory analysis. Hous. Stud. 2017, 32, 887–911. [Google Scholar] [CrossRef]
  58. Birkbeck, D.; Kruczkowski, S. Building for Life 12; Building for Life Partnership: Nottingham, UK, 2018; ISBN 978-0-9550885-9-9. [Google Scholar]
  59. County Durham Building for Life Supplementary Planning Document; County Durham Plan: Durham, UK, 2019.
  60. Home Quality Mark One. Technical Manual England, Scotland & Wales; BRE: London, UK, 2018. [Google Scholar]
  61. Winkler, J.; Jeznach, J.; Koda, E.; Sas, W.; Mazur, Ł.; Vaverková, M. Promoting Biodiversity: Vegetation in a Model Small Park Located in the Research and Educational Centre. J. Ecol. Eng. 2022, 23, 146–157. [Google Scholar] [CrossRef]
  62. Home Quality Mark One. A Brief Guide to the Home Quality Mark; BRE: London, UK, 2020. [Google Scholar]
  63. Harrison, A. Housing Quality Indicators: London, UK. 1999. Available online: https://www.housingauthority.gov.hk/eng/events/conf/conferen/pdf/eandrew.pdf (accessed on 1 January 2022).
  64. Whyte, J.; Gann, D. Design Quality Indicators: Work in progress. Build. Res. Inf. 2003, 31, 387–398. [Google Scholar] [CrossRef]
  65. Eryürük, Ş.; Kürüm Varolgüneş, F.; Varolgüneş, S. Assessment of stakeholder satisfaction as additive to improve building design quality: AHP-based approach. J. Hous. Built Environ. 2022, 37, 505–528. [Google Scholar] [CrossRef]
  66. Housing Quality Indicators. Housing Quality Indicators (HQI); The National Affordable Homes Agency: London, UK, 2008. [Google Scholar]
  67. Wheeler, P. Housing Quality Indicators in Practice, Designing Better Buildings Quality and Value in the Built Environment; Spon Press: London, UK, 2004. [Google Scholar]
  68. Eley, J. Design quality in buildings. Build. Res. Inf. 2004, 32, 255–260. [Google Scholar] [CrossRef]
  69. Aellen, K.; Keller, T.; Meyer, P.; Wiegand, J. Systeme D’evaluation de Iogements SEL; Office Fédéral du Logement: Berne, Switzerland, 1979. [Google Scholar]
  70. Le, L.H.; Ta, A.D.; Dang, H.Q. Building up a System of Indicators to Measure Social Housing Quality in Vietnam. Procedia Eng. 2016, 142, 116–123. [Google Scholar] [CrossRef]
  71. Office Fédéral du Logement. Concevoir, Évaluer et Comparer des Logements. Système D’évaluation de Logements SEL Edition 2000; Office Fédéral du Logement: Granges, Switzerland, 2000. [Google Scholar]
  72. Meyer-Meierling, P. Wohnbauten in Holz; Vdf Hochschulverlag AG: Zurych, Switzerland, 2004. [Google Scholar]
  73. Meyer-Meierling, P. Wohnbauten Mit Geringem Energiebedarf; Vdf Hochschulverlag AG: Zurych, Switzerland, 2002. [Google Scholar]
  74. Qualitel. NF Habitat & NF Habitat HQE, Certification Construction Logement; Qualitel: Paris, France, 2019. [Google Scholar]
  75. Natividade-Jesus, E.; Coutinho-Rodrigues, J.; Antunes, C.H. A multicriteria decision support system for housing evaluation. Decis. Support Syst. 2007, 43, 779–790. [Google Scholar] [CrossRef] [Green Version]
  76. Qualitel. Construction, Les Benefices d’un Logement Certifie NF Habitat; Qualitel: Paris, France, 2019. [Google Scholar]
  77. Bać, A. Zrównoważenie w Architekturze: Od Idei do Realizacji na tle Doświadczeń Kanadyjskich; Oficyna Wydawnicza Politechniki Wrocławskiej: Wrocław, Poland, 2016. [Google Scholar]
  78. Nelson, C. Managing Quality in Architecture; Routledge: London, UK, 2007; ISBN 978-1-136-38233-8. [Google Scholar]
  79. Saxon, R. Be Valuable. A Guide to Creating Value in the Built Environment; Constructing Excellence: London, UK, 2005; ISBN 1-905033-14-1. [Google Scholar]
  80. Callway, R.; Farrelly, L.; Samuel, F. The Value of Design and the Role of Architects; School of Architecture, University of Reading, Whiteknights: Reading, UK, 2019. [Google Scholar]
  81. Arku, G. The housing and economic development debate revisited: Economic significance of housing in developing countries. J. Hous. Built Environ. 2006, 21, 377–395. [Google Scholar] [CrossRef] [Green Version]
  82. Liabäck, M.; Femenías, P.; Skogsäter, N. Sustainability Indicators for Redevelopment: Assessing the Long-Term Effect of Different Strategies Used in Two Housing Areas. In Proceedings of the World Sustainable Building Congress 2014, Barcelona, Spain, 28–30 October 2014. [Google Scholar]
  83. Feneri, A.-M.; Vagiona, D.; Karanikolas, N. Multi-Criteria Decision Making to Measure Quality of Life: An Integrated Approach for Implementation in the Urban Area of Thessaloniki, Greece. Appl. Res. Qual. Life 2015, 10, 573–587. [Google Scholar] [CrossRef]
  84. Sedayu, A.; Setiono, A.R.; Subaqin, A.; Gautama, A.G. Improving the performance of construction project using green building principles. Asian J. Civ. Eng. 2020, 21, 1443–1452. [Google Scholar] [CrossRef]
  85. Franklin, B.J. Discourses of Design: Perspectives on the Meaning of Housing Quality and ?Good? Housing Design. Hous. Theory Soc. 2001, 18, 79–92. [Google Scholar] [CrossRef]
  86. Meng, G.; Hall, G.B. Assessing housing quality in metropolitan Lima, Peru. J. Hous. Built Environ. 2006, 21, 413–439. [Google Scholar] [CrossRef]
  87. Carmona, M. Place value: Place quality and its impact on health, social, economic and environmental outcomes. J. Urban Des. 2019, 24, 1–48. [Google Scholar] [CrossRef]
  88. Simmons, R. The cost of bad design. In The Cost of Bad Design; Commission for Architecture and the Built Environment: London, UK, 2006. [Google Scholar]
  89. Bać, A. Research into the Possibility of Achieving the NZEB Standard in Poland by 2021—Architect’s Perspective. In Sustainability in Energy and Buildings; Smart Innovation, Systems and Technologies; Littlewood, J., Howlett, R.J., Capozzoli, A., Jain, L.C., Eds.; Springer: Singapore, 2020; Volume 163, pp. 665–675. ISBN 978-981-329-867-5. [Google Scholar]
  90. Gann, D.; Salter, A.; Whyte, J. Design Quality Indicator as a tool for thinking. Build. Res. Inf. 2003, 31, 318–333. [Google Scholar] [CrossRef]
  91. Filali, R. Housing conditions in Tunisia: The quantity-quality mismatch. J. Hous. Built Environ. 2012, 27, 317–347. [Google Scholar] [CrossRef]
  92. Marans, R.W. Quality of urban life & environmental sustainability studies: Future linkage opportunities. Habitat Int. 2015, 45, 47–52. [Google Scholar] [CrossRef]
  93. Gür, M.; Murat, D.; Sezer, F.Ş. The effect of housing and neighborhood satisfaction on perception of happiness in Bursa, Turkey. J. Hous. Built Environ. 2020, 35, 679–697. [Google Scholar] [CrossRef]
  94. Durosaiye, I.O.; Hadjri, K.; Liyanage, C.L. A critique of post-occupancy evaluation in the UK. J. Hous. Built Environ. 2019, 34, 345–352. [Google Scholar] [CrossRef] [Green Version]
  95. Juan, Y.-K.; Hsing, N.-P.; Hsu, Y.-H. Applying the Kano two-dimensional model and quality function deployment to develop sustainable planning strategies for public housing in Taiwan. J. Hous. Built Environ. 2019, 34, 265–282. [Google Scholar] [CrossRef]
  96. Moghimi, V.; Jusan, M.B.M.; Izadpanahi, P.; Mahdinejad, J. Incorporating user values into housing design through indirect user participation using MEC-QFD model. J. Build. Eng. 2017, 9, 76–83. [Google Scholar] [CrossRef]
  97. Commission for Architecture & the Built Environment. The Value of Good Design. How Buildings and Spaces Create Economic and Social Value; CABE: London, UK, 2002. [Google Scholar]
  98. Trach, Y.; Melnychuk, V.; Melnychuk, G.; Mazur, Ł.; Podlasek, A.; Vaverková, M.; Koda, E. Using local mineral materials for the rehabilitation of the Ustya River—A case study. Desalination Water Treat. 2021, 232, 346–356. [Google Scholar] [CrossRef]
  99. Mazur, Ł. Selected natural factors affecting in housing architecture in today’s cities. Acta Sci. Pol. Arch. 2020, 19, 83–91. [Google Scholar] [CrossRef]
  100. Cheng, W.; Sodagar, B.; Sun, F. Comparative analysis of environmental performance of an office building using BREEAM and GBL. Int. J. Sustain. Dev. Plan. 2017, 12, 528–540. [Google Scholar] [CrossRef]
  101. Holmes, J.; Hudson, G. The application of BREEAM in corporate real estate: A case study in the design of a city centre office development. J. Corp. Real Estate 2003, 5, 66–77. [Google Scholar] [CrossRef]
  102. Ferreira, A.; Pinheiro, M.D.; de Brito, J.; Mateus, R. Retail Buildings’ Sustainability Assessment Tools: A Critical Analysis of Leed, Breeam and Dgnb. SSRN Electron. J. 2022. [Google Scholar] [CrossRef]
  103. Mahmoud, R.; Kamara, J.M.; Burford, N. Opportunities and Limitations of Building Energy Performance Simulation Tools in the Early Stages of Building Design in the UK. Sustainability 2020, 12, 9702. [Google Scholar] [CrossRef]
  104. Orihuela, P.; Pacheco, S.; Orihuela, J. Proposal of Performance Indicators for the Design of Housing Projects. Procedia Eng. 2017, 196, 498–505. [Google Scholar] [CrossRef]
  105. Rutkowska, G.; Chalecki, M.; Żółtowski, M. Fly Ash from Thermal Conversion of Sludge as a Cement Substitute in Concrete Manufacturing. Sustainability 2021, 13, 4182. [Google Scholar] [CrossRef]
Figure 1. Scheme of methodology.
Figure 1. Scheme of methodology.
Energies 15 07750 g001
Figure 2. Scheme of quality factors.
Figure 2. Scheme of quality factors.
Energies 15 07750 g002
Figure 3. (a) The % share of categories when evaluating quality. (b) System % share by type of factor: spatial (P), architectural (A), ecological (E), and social (S).
Figure 3. (a) The % share of categories when evaluating quality. (b) System % share by type of factor: spatial (P), architectural (A), ecological (E), and social (S).
Energies 15 07750 g003
Figure 4. (a) % share of categories when evaluating quality. (b) System % share by type of factor: spatial (P), architectural (A), ecological (E), and social (S).
Figure 4. (a) % share of categories when evaluating quality. (b) System % share by type of factor: spatial (P), architectural (A), ecological (E), and social (S).
Energies 15 07750 g004
Figure 5. (a) % share of categories when evaluating quality. (b) System % share by type of factor: spatial (P), architectural (A), ecological (E), and social (S).
Figure 5. (a) % share of categories when evaluating quality. (b) System % share by type of factor: spatial (P), architectural (A), ecological (E), and social (S).
Energies 15 07750 g005
Figure 6. (a) % share of categories when evaluating quality. (b) System % share by type of factor: spatial (P), architectural (A), ecological (E), and social (S).
Figure 6. (a) % share of categories when evaluating quality. (b) System % share by type of factor: spatial (P), architectural (A), ecological (E), and social (S).
Energies 15 07750 g006
Figure 7. (a) % share of categories when evaluating quality evaluation. (b) System % share by type of factor: spatial (P), architectural (A), ecological (E), and social (S).
Figure 7. (a) % share of categories when evaluating quality evaluation. (b) System % share by type of factor: spatial (P), architectural (A), ecological (E), and social (S).
Energies 15 07750 g007
Figure 8. % share of the factor.
Figure 8. % share of the factor.
Energies 15 07750 g008
Table 1. A summary of evaluation systems provided for the analysis, with a set of criteria for selecting examples for further analysis.
Table 1. A summary of evaluation systems provided for the analysis, with a set of criteria for selecting examples for further analysis.
No.Name of the System1.1.1.2.3.4.5.
1Building For Life 12yesyesyesyesP, Ayes
2Code for sustainable homesyesyesending in 2006yesA, Eno
3Design quality indicatoryesnoyesyesAno
4Home Quality MarkyesyesyesyesP, A, E, Syes
5Housing Quality IndicatorsyesyesyesyesP, A, E, Syes
6NF Habitat—NF Habitat HQEyesyesyesyesP, A, Syes
7Système D’évaluation De LogementsyesyesyesyesP, Ayes
8Woningwaarderingsstelselyesyes-yesA, Sno
9Zielony domyesyesnonoEno
Key: 1. Thematic scope—is it possible to evaluate the housing environment? 1.1. Is the main aim of the system to evaluate housing environments? 2. Temporal scope—was the system used between 2000 and 2020? 3. Territorial scope—has the system been applied in Europe? 4. Diversity of schemes—what is the leading objective of the analysis: spatial (P), architectural (A), ecological (E), and social (S) 5. Availability of literature in terms of: (i) general information on how to use the system; (ii) assessment criteria; and (iii) application of the system in practice.
Table 2. Quality evaluation criteria—system Building For Life 12.
Table 2. Quality evaluation criteria—system Building For Life 12.
No.CategoryFactorType of Factor: Spatial (P), Architectural (A), Ecological (E), Social (S)% Proportion of Final Score
1Integration into the neighborhoodConnectionsP8.33%
2Facilities and servicesP8.33%
3Public transportP8.33%
4Meeting local housing requirementsP8.33%
5Creating a placeCharacterA8.33%
6Working with the site and its contextA8.33%
7Creating well-defined streets and spacesP8.33%
8Easy to find your way aroundP8.33%
9Street and homeStreets for allP8.33%
10Car parkingP8.33%
11Public and private spaceP8.33%
12External storage and amenityA8.33%
Table 3. Quality evaluation criteria—Home Quality Mark system.
Table 3. Quality evaluation criteria—Home Quality Mark system.
No.CategoryFactorType of Factor: Spatial (P), Architectural (A), Ecological (E), Social (S)% Proportion of Final Score
1Transport and MovementPublic Transport AvailabilityP3.0%
2Sustainable TransportP3.4%
3Local AmenitiesP3.2%
4OutdoorsIdentifying Ecological Risks and OpportunitiesE1.4%
5Managing Impacts on EcologyE1.8%
6Ecological Change and EnhancementE2.4%
7Long Term Ecological Management and MaintenanceE1.6%
8Recreational SpaceP4.4%
9Safety and ResilienceFlood RiskP3.8%
10Managing Rainfall ImpactsP3.8%
11SecurityS1.8%
12ComfortIndoor PollutantsA2.4%
13DaylightA2.6%
14Noise SourcesA0.8%
15Sound InsulationA1.8%
16TemperatureA3.4%
17VentilationA2.6%
18EnergyEnergy and costA12.0%
19Decentralized EnergyE1.6%
20Impact on Local Air QualityE3.0%
21MaterialsResponsible SourcingA5.0%
22Environmental Impact of MaterialsE5.0%
23Life Cycle CostingE2.4%
24DurabilityA1.4%
25SpaceDrying SpaceA0.6%
26Access and SpaceA2.2%
27Recyclable WasteA2.0%
28WaterWater EfficiencyA3.4%
29Quality AssuranceProject PreparationA1.2%
30Commissioning and TestingA2.2%
31Inspections and CompletionA3.2%
32Construction ImpactsResponsible Construction PracticesA1.0%
33Construction Energy UseA1.0%
34Construction Water UseA1.0%
35Site Waste ManagementA3.0%
36Customer ExperienceAftercareS0.8%
37Home InformationS0.0%
38Smart HomesA1.6%
39Post Occupancy EvaluationS2.0%
Table 4. Quality evaluation criteria—Housing Quality Indicators system.
Table 4. Quality evaluation criteria—Housing Quality Indicators system.
No.CategoryFactorType of Factor: Spatial (P), Architectural (A), Ecological (E), Social (S)% Proportion of Final Score
1LocationAmenities—how close are they?P80%
2Liabilities—how close are they?P10%
3Noise sources—how close are they?P10%
4Visual ImpactVisual Impact—overall visual effect and relationship to local characterP33%
5Layout—relationship of buildings to each other, open areas and siteP33%
6Landscaping—excluding private open spaceP33%
7Open SpaceSite securityP20%
8Shared areas in flatsP10%
9Children’s playP20%
10Private and shared open spaceP16%
11Characteristics of garden/ private/ shared open spaceP9%
12Car parkingP25%
13Routes and MovementRoutes and movementP50%
14Access to the unitP50%
15Unit SizeUnit type by areaA75%
16Units by living spacesA25%
17Unit LayoutTotal number of units being assessed and scoredA50%
18Additional featuresA50%
19Unit Noise Control, Light Quality, ServicesNoise reduction characteristicsA27%
20Quality of light, aspects and prospectsA18%
21Standard of service provisionS24%
22Additional features–servicesA25%
23AdaptabilityA6%
24Accessibility within the UnitAccessibility within the unitA100%
25SustainabilityCode for sustainable homes 100%
26EcohomesE
27Rehabilitation
28System Building for LifeCharacterP25%
29Roads, parking, and pedestrianizationP25%
30Design and constructionA25%
31Environment and communityE25%
Table 5. Quality evaluation criteria—Système D’évaluation De Logements (SEL).
Table 5. Quality evaluation criteria—Système D’évaluation De Logements (SEL).
No.CategoryFactorType of Factor: Spatial (P), Architectural (A), Ecological (E), Social (S)% Proportion of Final Score
1Place of livingResidential offerS4%
2Supporting servicesS4%
3Mobility and transportP4%
4Spatial impactP4%
5Open spaceP4%
6ParticipationS4%
7Housing estateFree traffic zoneP4%
8Outdoor integration spaceP4%
9Individual transportP4%
10Entrance area of houses and flatsA4%
11Common roomA4%
12Community premisesA4%
13Laundries and drying roomsA4%
14Additional premisesA4%
15Housing unitReal living areaA4%
16Room size and additional spaceA4%
17Versatile arrangementA4%
18Flexible roomsA4%
19Kitchen and dining roomA4%
20Sanitary facilitiesA4%
21Storage spaceA4%
22Adaptability of private spaceA4%
23Private outdoor spacesA4%
24Space between the home and the outdoor areaA4%
25Private storage space outside the flatA4%
Table 6. Quality evaluation criteria—NF Habitat-NF Habitat HQE system.
Table 6. Quality evaluation criteria—NF Habitat-NF Habitat HQE system.
No.CategoryFactorType of Factor: Spatial (P), Architectural (A), Ecological (E), Social (S)% Proportion of Final Score
1Quality of lifeSafetyS4.5%
2Indoor air qualityA4.5%
3Water qualityA4.5%
4Impact of building on climate changeE4.5%
5Comfort of livingA4.5%
6Building thermal comfortA4.5%
7AcousticsA4.5%
8Natural lightingA4.5%
9Services and transportP4.5%
10Smart buildingA4.5%
11Respect for the environmentEnergy performanceE4.5%
12Reduction in water consumptionE4.5%
13Land development (site retention)E4.5%
14Building materialsE4.5%
15Waste (life cycle and construction waste)E4.5%
16Climate change (minimizing greenhouse gas emissions)E4.5%
17BiodiversityE4.5%
18Economic
result
Building renovation costsS4.5%
19Building exploitation costsS4.5%
20General costsS4.5%
21Deconstruction costsS4.5%
22Use of local resourcesE4.5%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Mazur, Ł.; Bać, A.; Vaverková, M.D.; Winkler, J.; Nowysz, A.; Koda, E. Evaluation of the Quality of the Housing Environment Using Multi-Criteria Analysis That Includes Energy Efficiency: A Review. Energies 2022, 15, 7750. https://doi.org/10.3390/en15207750

AMA Style

Mazur Ł, Bać A, Vaverková MD, Winkler J, Nowysz A, Koda E. Evaluation of the Quality of the Housing Environment Using Multi-Criteria Analysis That Includes Energy Efficiency: A Review. Energies. 2022; 15(20):7750. https://doi.org/10.3390/en15207750

Chicago/Turabian Style

Mazur, Łukasz, Anna Bać, Magdalena Daria Vaverková, Jan Winkler, Aleksandra Nowysz, and Eugeniusz Koda. 2022. "Evaluation of the Quality of the Housing Environment Using Multi-Criteria Analysis That Includes Energy Efficiency: A Review" Energies 15, no. 20: 7750. https://doi.org/10.3390/en15207750

APA Style

Mazur, Ł., Bać, A., Vaverková, M. D., Winkler, J., Nowysz, A., & Koda, E. (2022). Evaluation of the Quality of the Housing Environment Using Multi-Criteria Analysis That Includes Energy Efficiency: A Review. Energies, 15(20), 7750. https://doi.org/10.3390/en15207750

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop