Sustainability Indicators in Restaurants: The Development of a Checklist

Abstract

This study aimed to develop and carry out content validation, semantic evaluation, reproducibility, and internal consistency of a checklist designed to verify the sustainability indicators in foodservice. The preliminary version of the checklist was prepared based on the international standards ISO (International Organization for Standardization) 14000, ISO 14001, ISO 14004 and documents from the Sustainable Restaurant Association (SRA) Certification, Green Seal Certifications, and Green Restaurant Association (GRA) certification, in addition to the American Dietetic Association (ADA) position. Thirteen experts in the study topic performed the content validation and semantic evaluation of the checklist (a minimum of 80% agreement among experts and mean value ≥4 on a 5-point Likert scale were needed to keep the item in the instrument). After consensus was reached by the experts’ panel, two different researchers applied the checklist in 20 restaurants (at the same time, in the same place, without communication between them) for the analysis of reproducibility and internal consistency (Federal District, Brazil). The agreement among answers was verified by Cohen’s Kappa coefficient. The final version of the checklist consisted of 76 items, divided into three sections (1. water, energy, and gas supply; 2. menu and food waste; 3. waste reduction, construction materials, chemicals, employees, and social sustainability). The developed checklist was validated concerning the content, approved in the semantic evaluation, reproducible, and with good reliability (Intraclass Correlation Coefficient (ICC) > 0.9 and alpha > 0.672).

1. Introduction

The high demand for meals away from home and an increasing number of restaurants have expanded meal production. All steps involved in foodservice have a high financial and environmental cost that need to be rethought, especially concerning the environmental factor. This is due to a more substantial amount of discarded waste and the use of various natural resources [1,2,3,4]. Meal production is responsible for 80% of deforestation, 70% of the consumption of fresh water, and 30% of greenhouse gas emissions, being the most significant cause of the planet’s species biodiversity reduction [5]. Worldwide, the foodservice sector is considered the least sustainable among the economic sectors [6].

The Brazil is one of the top ten countries in food waste in the world. About 40 thousand tons of food goes to waste every day in Brazil, which is equivalent to 30% of everything that is produced [7]. Waste has enormous consequences for the environment, because with food waste, there is also water, land, energy, and transportation waste, among other services in the production of a meal [4]. Besides, the United Nations Organization [8] data state that the carbon footprint of food produced and not consumed in the world is estimated at 3.3 gigatons of carbon dioxide. This number puts food waste in third place among the largest CO₂ emitters in the world; therefore, reducing waste is a way to mitigate environmental impact. Foodservice companies must be committed not only to the quality of the meals and their profits but also to social responsibility and sustainability [9].

Given the world panorama and the potential shortage of natural resources, the procedures for the production of more sustainable meals have increased the attention and consciousness of the people involved in out-of-home meals. Severe environmental problems, such as global warming, waste, and pollution, have also increased people’s consciousness of the environment and of the need for actions based on sustainability [10].

Regarding the environmental domain of sustainability, the adoption of sustainable practices in foodservice favors their recognition through audits and certifications. In North America and Europe, there are companies such as the Green Restaurants Association (GRA) and the Green Seal that carry out restaurant certifications to stimulate ecological sustainable restaurants [11,12]. In Brazil, a study suggested the use of the international environmental quality system IS0 (International Organization for Standardization) 14000, which sets standards in the development of environmentally sustainable actions [13], and another research suggests the use of Ecoinefficiency evaluation [14]. Although the ISO establishes guidelines for obtaining a certificate, presenting evaluation items, it does not specify “how” these items should be evaluated in foodservice, as well as the cost for the certification, making their use complicated.

For international certifications such as the Sustainable Restaurant Association (SRA), GRA or Green Seal, the evaluation criteria and items are not specific to the Brazilian context and legislations. For example, some items question air pollution through the use of cigarettes in the sector, and this behavior is already prohibited in Brazil. Additionally, these certifications evaluate the use of fluorescent bulbs, but this habit is already prevalent in the country. When the items mention certifications adopted in other countries, like GreenPro for pest control or Bird Friendly for coffee, these items are too specific for other contexts. Besides, some items evaluate the issue of buying organic coffee or "exotic" fruits such as avocado or chocolate and cocoa, and Brazil is a big producer of these foods. Therefore, to our knowledge, there is no particular instrument to access the sustainability in Brazilian foodservice in all of their dimensions [15].

In this sense, the lack of a standard certificate, data collection instrument, laws or governmental policies for foodservice in Brazil makes sustainable restaurants scarce in the country, with little implementation of specific environmental actions. Sustainable restaurant initiatives could be an opportunity to create a competitive advantage, combining sustainability with profitability in the foodservice sector [16,17]. Additionally, sustainable restaurants could be a way to promote cities for tourism purposes.

The activities in foodservice use a large number of natural resources in meal production, impacting on global sustainability and individuals’ health [15]. Therefore the development of a specific instrument is essential for the use in the certification processes and the evaluation of restaurants on sustainability, helping them to implement agroecological strategies. Thus, the objective of our study was to develop and carry out content validation, semantic evaluation, reproducibility, and internal consistency of a checklist designed to verify the sustainability indicators in foodservice.

2. Materials and Methods

2.1. Checklist Development

The checklist was prepared through a literature review and researchers’ experience on the subject. In this sense, we used the International Organization for Standardization ISO 14000 that deals with the environmental quality system; ISO 14004, which guides the development, implementation, improvement, and maintenance of the Environmental Management System (EMS); and ISO 14001, which establishes guidelines for obtaining a quality certificate. The Brazilian Association of Technical Standards prepared all of these documents [18,19].

The Sustainable Restaurant Association (SRA) certifications, which characterize the sustainability policies adopted by foodservice, were also used, as well as the Green Seal Certifications (GSC). The GSC classify the foodservice (Bronze, Silver, or Gold), reconsidering them to change their category every three years until they reach the gold category [12]. Certification by the Green Restaurant Association (GRA) evaluates the restaurant, providing ways to implement environmentally sustainable activities [11].

We also used the American Dietetic Association (ADA) positions on practices for the Conservation of Natural Resources and support for Ecological Sustainability [20]. ADA’s positions aim to stimulate environmental practices to maintain natural resources, reduce the production of waste, and encourage ecological sustainability in food production. It is worth mentioning that all of these materials were extensively studied, and the items that were relevant to the Brazilian context were used for the first version of the checklist, as presented in the Supplementary file (Tables S3 and S4) and

Table 1. Checklist modifications in the content and semantics validation process by experts.

SUSTAINABILITY ASSESSMENT OF FOOD SERVICES
Phase 1
1. WATER SUPPLY	Acceptance/Rejection/Modifications
1.1 The company has goals for the use of water, as a limit of use over time (for example 10 liters of water per meal).	Changed the way it is written (it was not clear). Why 10 liters per meal.
1.2 The company has an inventory or an audit record from the last year to assess and inspect the water bills (consult).	Accepted
1.3 The company has reduced water consumption by at least 15% in the last six months, or 30% in the previous 12 months (see history of water bills).	Accepted
1.4 The company repairs all water leaks the moment they are noticed.	Accepted
1.5 The company checks that the taps are turned off when they are not in use and at the end of the service.	Accepted
1.6 Pressure from kitchen faucets; washbasins and bathrooms are regulated for less expense.	Accepted
1.7 The taps have automatic activation or have sensors for all hand and kitchen sinks (an exception is allowed for spray valve taps).	Accepted
1.8 Water reservoir properly capped and preserved (free from cracks, leaks, infiltrations, peeling, and other defects).	Accepted
1.9 The company does not use running water to melt ice in sinks or thaw food.	Accepted
1.10 The company removes visible food with utensils or paper before placing dishes in the dishwasher.	Accepted
1.11 Dishwashers are only operated when they are full.	Accepted
1.12 The dishwasher temperature is set to the lowest temperature allowed by health regulations and is consistent with the type of sanitizing system used.	This item was considered irrelevant and not very clear. It was removed.
1.13 The dishwasher is PROCEL or ENERGY STAR certified.	Changed the way it was written (it was not clear).
1.14 Dry and outdoor cleaning methods are used, followed by a wet mop, instead of spraying or hosing with water.	Changed the way it was written (it was not clear). The item had an approval score for relevance but not for 80% agreement.
1.15 Rainwater is collected on-site and used for permitted non-potable water needs.	Accepted
1.16 The facility’s water is recycled on-site and used for permitted non-potable water needs.	This item was considered irrelevant and not very clear. It was removed.
1.17 The company takes measures to reduce water use.	This item was considered irrelevant and not very clear. It was removed.
2. ENERGY	Acceptance/Rejection/Modifications
2.1 The company has a documented energy management plan with energy conservation objectives (an action plan to achieve the goals, documented monitoring of progress against the objectives and an operational plan to support the objectives—including the startup and shutdown schedule of the lights, equipment and other items that consume energy).	Changed the way it was written (it was not clear). Very extensive.
2.2 The company has an inventory or audit record from the last year to assess and inspect energy use and energy loss from equipment and lighting.	Accepted
2.3 The company has reduced energy expenditure by at least 15% in the last six months, or 30% in the previous 12 months (see history of energy expenditure).	Accepted
2.4 The company installed smart meters.	Changed the way it was written (it was not clear). The item had an approval score for relevance but not 80% agreement.
2.5 The company has a water heating system using solar energy.	Accepted
2.6 The company has control of the cold chamber thermostat.	This item was considered irrelevant and not very clear. It was removed.
2.7 The company has control of the thermostat on the counters.	The item had an approval score for relevance but not 80% agreement.
2.8 The company uses timed lighting in the production area.	Accepted
2.9 The company uses LED lighting.	Accepted
2.10 The company uses lighting with electric lamps.	This item was considered irrelevant and not very clear. It was removed.
2.11 The company uses air conditioning equipment in the production area.	Accepted
2.12 Refrigerators and freezer doors are kept closed.	The item had an approval score for relevance but not 80% agreement.
2.13 Refrigerators and freezer doors are kept at appropriate temperatures.	This item was considered irrelevant and not very clear. It was removed.
2.14 The refrigerator and freezer doors have audible alarms for open doors or automatic locks.	Accepted
2.15 There is a temperature monitoring system for refrigerators, cooling chambers, and freezers.	Accepted
2.16 The company performs and documents the maintenance recommended by the manufacturer for the devices to ensure that all equipment is working correctly and maintains energy efficiency levels.	Accepted
2.17 The company cleans the air cooler filters with mild detergents and changes the replaceable filters according to the manufacturer’s guidelines.	Changed the way it was written (it was not clear).
2.18 The company checks the HVAC (heating, ventilating and air conditioning) system every year for leaks from air coolers with a verification record.	Changed the way it was written (it was not clear). The item had an approval score for relevance but not 80% agreement.
2.19 The company makes adjustments to water heaters monthly according to the minimum or recommended feed temperature for dish machines (check the record).	This item was considered irrelevant and not very clear. It was removed.
2.20 The company has lighting controls, such as sensors and timers, in low-occupancy areas (for example, in the distribution area) so that lights are automatically turned off when daylight is sufficient or when spaces are not being occupied.	Accepted
2.21 The company uses some form of renewable energy in the production area.	Accepted
2.22 The company generates some of its energy through wind, solar, or biomass.	This item was considered irrelevant. It was removed.
2.23 The company achieves zero greenhouse gas emissions for direct use of commercial energy and fuel for vehicles, with proven partnerships.	Changed the way it was written (it was not clear). The item had an approval score for relevance but not 80% agreement.
2.24 The company has an active program to reduce carbon emissions through emission reductions (by at least 5% per year), without including carbon offsets.	Changed the way it was written (it was not clear).
2.25 The company takes measures to promote energy innovation, such as energy conservation.	This item was considered irrelevant. It was removed.
2.26 The company takes steps to promote energy innovation, such as renewable energy.	This item was considered irrelevant. It was removed.
2.27 The company takes measures to promote energy innovation, such as reducing the impact of greenhouse gases.	This item was considered irrelevant. It was removed.
3. GAS	Acceptance/Rejection/Modifications
3.1 The company has documented targets for reducing the use of liquefied petroleum gas.	Accepted
3.2 The company has documented targets for reducing the use of natural gas.	Accepted
3.3. The company uses biogas.	Accepted
4. SUSTAINABLE FOOD / MENU	Acceptance/Rejection/Modifications
4.1 The company’s menu is analyzed concerning the chemical composition of the preparations that compose it.	Changed the way it was written (it was not clear).
4.2 The company has technical preparation sheets.	Accepted
4.3 The staff use the preparation sheets to prepare the preparations.	Accepted
4.4 The company has a separate children’s menu or smaller portion options.	Accepted.
4.5 The company uses healthier cooking methods (for example, steam cooking, grilling).	This item was considered irrelevant. It was removed.
4.6 The company offers healthier options (with less sodium, less fried foods, or less sugar; for example, salad instead of chips).	Accepted
4.7 The company notifies customers of dishes that exceed 1/3 of the recommended daily intake for sodium / saturated fat / sugar or calories.	This item was considered irrelevant. It was removed.
4.8 The company offers a separate menu or substitutions to meet dietary restrictions, such as gluten-free substitutions, vegetarian cuisine, vegan menu, or religious restrictions.	Accepted
4.9 The company has documented commitments, with a defined term, to reduce the use of sugar, salt, or saturated fat on the menu.	Accepted
4.10 The staff has undergone some training on healthy eating and the health impact of what they are producing.	Accepted
4.11 The company has items on the menu that exceed 1/3 of the recommended daily intake for sodium, saturated fat, sugar or calories, for children.	This item was considered irrelevant. It was removed.
4.12 The company uses adequate criteria regarding nutritional aspects to substitute menu preparations in case of unforeseen situations.	This item was considered irrelevant. It was removed.
4.13 The company has a policy with the supplier or purchase specification in place that favors the acquisition of local products for foods such as dairy products, meat, fruits, and vegetables.	Accepted
4.14 The company is confident that the majority of employees (more than 50%) understand the policy for purchasing local products and would be able to explain it to a customer.	The item had an approval score for relevance but not 80% agreement.
4.15 This policy is publicly available (for example, on the spot or menu).	This item was considered irrelevant and not very clear. It was removed.
4.16 The company changes its menu to incorporate seasonal products.	Accepted
4.17 At least 50% of the fruits and vegetables that the company buys have an organic certificate.	Accepted
4.18 The vegetables and fruits are received at the unit all in natura.	Accepted
4.19 The company has already taken steps to change some of the menu items for more purchases of local products.	This item was considered irrelevant and not very clear. It was removed.
4.20 The company manages its own food garden/cultivation.	Accepted
4.21 The company has any direct partnerships on-site with a farm to increase the supply of products through the vegetable garden.	Changed the way it was written (it was not clear).
4.22 Animal-based food purchases have certificates that they are created without antibiotics.	Changed the way it was written (it was not clear). The item had an approval score for relevance but not 80% agreement.
4.23 The company has a written policy, with the supplier or procurement strategy in place that includes a commitment to specific animal welfare standards.	Changed the way it was written (it was not clear).
4.24 The company has documented, measurable, and time-bound commitments to reduce the amount of meat on the menu or is doing something innovative around reducing meat on its menu.	Changed the way it was written (it was not clear). The item had an approval score for relevance but not 80% agreement.
4.25 The company has a written policy of purchasing sustainable seafood.	Accepted
4.26 The company’s supplier uses farmed fish or has a sustainability certification (for example, organic).	Accepted
4.27 The company varies the fish on the menu to buy seasonally, locally available, or lesser-known fish.	This item was considered irrelevant. It was removed.
4.28 The company is doing something innovative to improve the quality of fish stocks, support fishers, or influence the supply of fish in its area or supply chain.	This item was considered irrelevant and not very clear. It was removed.
4.29 Does your company have any additional programs or plans to support local producers in your supply chain? (Consult)	Accepted
4.30 The company carries out a food innovation initiative in its company as the foods that are purchased for the menu are those that prove the least environmental impact.	This item was considered irrelevant and not very clear. It was removed.
4.31 The company uses ingredients or raw materials with transgenic ingredients in its composition in the production of meals.	Accepted
4.32 The company produces safe preparations that use vegetable peels and stalks as ingredients.	Accepted
5. FOOD WASTE	Acceptance/Rejection/Modifications
5.1 The company has a strategy for combating food waste documented in an operational environment.	Changed the way it was written (it was not clear).
5.2 The company assesses your food waste during the pre-preparation of the food.	Accepted
5.3 The company assesses its food waste during food preparation.	Items 5.2 and 5.3 can be transformed into one. Changed the writing.
5.4 The company assesses its food waste during food distribution.	The item had an approval score for relevance but not 80% agreement.
5.5 The company disposes of its food waste in the form of compost (only foods allowed for composting).	Changed the way it was written (it was not clear).
5.6 The company has options for composting sites (including farms).	This item was considered irrelevant. It was removed.
5.7 The company disposes of its food waste in the form of anaerobic digestion (only allowed foods).	This item was considered irrelevant It was removed.
5.8 The company discards its food waste in the form of maceration.	This item was considered irrelevant. It was removed.
5.9 The company trains its employees to avoid wasting food when receiving the ingredients.	Accepted
5.10 The company trains its employees to avoid food waste during the pre-preparation of food.	This item was considered irrelevant. It was removed.
5.11 The company trains its employees to avoid wasting food during preparation.	This item was considered irrelevant. It was removed.
5.12 The company carries out intelligent ordering systems, inventory monitoring, and inventory rotation to avoid food waste.	Accepted
5.13 The company donates to food banks or charities to avoid wasting food from products suitable for consumption.	Accepted
5.14 The company has targets for reducing food waste.	Accepted
5.15 The company recycles or reuses its coffee grounds.	The item had an approval score for relevance but not 80% agreement.
5.16 The company recycles cooking oil.	Changed the way it was written (it was not clear).
5.17 The company passes on the cooking oil used to recycling companies.	Accepted
5.18 The company calculated the financial savings made from its measures to reduce food waste.	Accepted
6. WASTE REDUCTION, COMPOUNDING, RECYCLING, DISPOSABLES	Acceptance/Rejection/Modifications
6.1 The company has an operational policy that contains a documented strategy on solid (non-food) waste.	Accepted
6.2 The company has physical facilities for the separation of recyclable materials, that is, selective collection.	Accepted
6.3 Employees correctly perform the separation of recyclable materials.	Accepted
6.4 The company provides training to its staff on how to manage or reduce waste from different flows.	This item was considered irrelevant. It was removed.
6.5 The company limits packaging and orders products in bulk to avoid waste.	Accepted
6.6 The company uses disposables.	Accepted
6.7 The company reduces the use of paper.	Accepted
6.8 The company returns packaging boxes for suppliers to reuse.	Accepted
6.9 The company returns glass bottles for suppliers to reuse.	Accepted
6.10 The company recycles plastic.	The item had an approval score for relevance but not 80% agreement.
6.11 The company recycles paper (cardboard).	This item was considered irrelevant. It was removed.
6.12 The company recycles metal.	This item was considered irrelevant. It was removed.
6.13 The company uses packaging (e.g., cups, cutlery, napkins, boxes) that is biodegradable, recyclable, or reusable.	Accepted
6.14 The company is encouraging its customers to reduce waste. (For example: maintaining glasses, reducing disposable packaging, or eliminating plastics).	Accepted
6.15 The company uses recycled paper for the office.	Accepted
6.16 The company uses FSC (Forest Stewardship Council) certified paper for the office.	This item was considered irrelevant. It was removed.
6.17 The company uses recycled paper for the menu.	This item was considered irrelevant. It was removed.
6.18 The company uses FSC certified paper for the menu.	This item was considered irrelevant. It was removed.
6.19 The company takes measures to promote waste innovation, such as reducing the use of discarded material.	This item was considered irrelevant. It was removed.
6.20 The company uses the standard configuration of printers and copying machines to copy and print on both sides of a paper.	The item had an approval score for relevance but not 80% agreement.
6.21 The company uses the standard configuration of printers and copying machines to copy and print on both sides of a paper.	This item was considered irrelevant. It was removed.
7. FURNITURE AND CONSTRUCTION MATERIALS	Acceptance/Rejection/Modifications
7.1 The company uses lamps, accessories, or furniture made from recovered or recycled materials or those provided with an environmental product declaration to improve the environmental impact.	The item had an approval score for relevance but not 80% agreement.
7.2 The paint used for architectural surfaces is environmentally sustainable.	Changed the way it was written (it was not clear). The item had an approval score for relevance but not 80% agreement.
7.3 The company’s furniture, such as tables, chairs, and rugs, is made of durable products that can be repaired.	The item had an approval score for relevance but not 80% agreement.
7.4 Tablecloths or uniforms are made from organic or environmentally sustainable products.	Accepted
7.5 The company uses rechargeable batteries for battery-powered devices, including flashlights, handheld vacuum cleaners, and other battery-powered equipment.	The item had an approval score for relevance but not 80% agreement.
7.6 The company’s prints are made with vegetable-based inks.	This item was considered irrelevant. It was removed.
7.7 Replaced or purchased printers, copiers, fax machines, and office scanners must be ENERGY STAR or PROCEL certified.	Accepted
8. CHEMICALS AND POLLUTION REDUCTION	Acceptance/Rejection/Modifications
8.1 The company uses environmentally friendly cleaning products.	Accepted
8.2 The company uses cleaning concentrates and dilution control systems to minimize the use of chemicals.	Accepted
8.3 The company uses durable cloths.	Changed the way it was written (it was not clear). The item had an approval score for relevance but not 80% agreement.
8.4 The company uses mops.	This item was considered irrelevant. It was removed.
8.5 The company uses environmentally sustainable hand cleaners in the client’s bathrooms.	Accepted
8.6 The company does not allow smokers in its physical space.	Accepted
9. EMPLOYEES	Acceptance/Rejection/Modifications
9.1 All of your employees have written contracts.	This item was considered irrelevant. It was removed.
9.2 The company has a clearly defined process for recognizing employee performance.	Changed the way it was written (it was not clear).
9.3 The team has already undergone environmental training (energy efficiency).	Accepted
9.4 The team has already undergone environmental training (water efficiency).	This item was considered irrelevant. It was removed.
9.5 The team has already undergone environmental training (fundamentals of sustainability).	Accepted
10. SOCIAL SUSTAINABILITY	Acceptance/Rejection/Modifications
10.1 The company has a strategy concerning charitable donations or support to its community.	Accepted
10.2 The manager donates surplus fresh food to Food Banks or Non-Governmental Organization.	This item was considered irrelevant. It was removed.
10.3 The company has taken any initiatives to work with any local schools/colleges or community groups to educate people about healthy eating.	Changed the way it was written (it was not clear).
10.4 The company supports local producers.	Accepted
10.5 Does the company have any sources of any products for its menu from a charitable foundation or a social enterprise that provides social impact? (For example, products created from leftover food, bread from a social enterprise bakery, etc.).	Changed the way it was written (it was not clear).
10.6 The company promotes charitable actions and/or works in the community for its customers.	This item was considered irrelevant. It was removed.
11. ENVIRONMENTAL CERTIFICATION	Acceptance/Rejection/Modifications
11.1 The company has the environmental certification.	Accepted
Phase 2
1. WATER SUPPLY	Acceptance/Rejection/Modifications
1.1 The company has goals for the rational use of water, such as the use limit per activity (for example: for each meal served, 10 liters of water are spent).	Accepted
1.13 The dishwasher is PROCEL or ENERGY STAR certified.	Accepted
1.14 When cleaning floors, the water flow is interrupted when it is not necessary to use it.	Accepted
2. ENERGY	Acceptance/Rejection/Modifications
2.1 The company has documentation for the assessment and/or inspection of energy use for energy conservation.	Accepted
2.4 The company has smart energy meters. Check the energy meter.	Accepted
2.7 The company has control of the thermostat on the counters.	Accepted
2.12 Refrigerators and freezer doors are kept closed.	Accepted
2.17 The company cleans the air cooler filters with suitable detergents or contracts a third-party company for this service and changes the replaceable filters according to the manufacturer’s guidelines.	Accepted
2.18 The company checks the HVAC (heating, ventilating and air conditioning) system every year for leaks from air coolers with a verification record.	Accepted
2.23 The company achieves zero greenhouse gas emissions with proven partnerships (e.g., commercial energy and vehicle fuel use).	Accepted
2.24 The company has a documented program to reduce carbon emissions (by at least 5% per year).	Accepted
4. SUSTAINABLE FOOD / MENU	Acceptance/Rejection/Modifications
4.1 The company’s menu is analyzed concerning the chemical composition of the preparations that compose it.	This item was considered irrelevant. It was removed.
4.14 The company is confident that the majority of employees (more than 50%) understand the policy for purchasing local products and would be able to explain it to a customer.	This item was considered irrelevant. It was removed.
4.21 The company manages its vegetable garden without using pesticides.	Accepted
4.22 Suppliers of products of animal origin have certificates that prove that animals are raised without the application of antibiotics.	Accepted
4.23 The company only buys products with an animal welfare certification seal.	Accepted
4.24 The company has reduced the amount of meat on the menu or is doing something innovative around reducing meat on its menu, for example: new recipes using less meat in the preparation.	This item was considered irrelevant and not very clear. It was removed.
5. FOOD WASTE	Acceptance/Rejection/Modifications
5.1 The company has an operational policy that contains a documented strategy on solid (non-food) waste management.	Accepted
5.3 The company assesses its food waste during food preparation.	Accepted
5.4 The company assesses its food waste during food distribution.	Accepted
5.5 The company discards food waste in the form of composting, anaerobic digestion, maceration, donates to feed pigs, or establishes partnerships with cooperatives that carry out these processes.	Accepted
5.15 The company recycles or reuses its coffee grounds.	Accepted
5.16 The company recycles cooking oil and/or transfers the cooking oil used to recycling companies.	Accepted
6. WASTE REDUCTION, COMPOUNDING, RECYCLING, DISPOSABLES	Acceptance/Rejection/Modifications
6.10 The company recycles plastic.	This item was considered irrelevant. It was removed.
6.20 The company uses the standard configuration of printers and copying machines to copy and print on both sides of a paper.	This item was considered irrelevant. It was removed.
7. FURNITURE AND CONSTRUCTION MATERIALS	Acceptance/Rejection/Modifications
7.1 The company uses lamps, accessories, or furniture made from recovered or recycled materials or those provided with an environmental product declaration to improve the environmental impact.	Accepted
7.2 The paints used for building are environmentally sustainable.	Accepted
7.3 The furniture (tables, chairs, and others) of the company is made of durable materials that can be repaired.	Accepted
7.5 The company uses rechargeable batteries for battery-powered devices and equipment, including flashlights, handheld vacuum cleaners, and others.	Accepted
8. CHEMICALS AND POLLUTION REDUCTION	Acceptance/Rejection/Modifications
8.3 The company uses disposable cloths to dry utensils, equipment, and surfaces that come into contact with food.	This item was considered irrelevant. It was removed.
9. EMPLOYEES	Acceptance/Rejection/Modifications
9.2 The company has employee performance evaluation criteria.	Accepted
10. SOCIAL SUSTAINABILITY	Acceptance/Rejection/Modifications
10.3 The company has initiatives to promote healthy eating education for the local community (schools, colleges, community groups).	Accepted
10.5 The company has a policy with the supplier or purchase specification in place that favors the acquisition of local products for foods such as dairy products, meat, fruits, and vegetables.	Accepted
Researchers evaluation and experts’ confirmation
1.2 The company has an inventory or an audit record from the last year to assess and inspect the water bills (consult).	Items 1.2 and 1.3 can be turned into one.
1.12 The dishwasher temperature is set to the lowest temperature allowed by health regulations and is consistent with the type of sanitizing system used.	Items 1.11 and 1.12 can be turned into one.
2.2 The company has an inventory or audit record from the last year to assess, inspect energy use, and energy loss from equipment and lighting (consult).	Items 2.2 and 2.3 can be turned into one.
2.5 The company has a water heating system using solar energy.	Items 2.5 and 2.21 can be turned into one.
2.6 The company has control of the cold chamber thermostat.	Items 2.6, 2.7, 2.13, and 2.15 can be turned into one.
2.7 The company has control of the thermostat on the counters.	Items 2.6, 2.7, 2.13, and 2.15 can be turned into one.
2.10 The company uses lighting with electric lamps.	Items 2.8 and 2.10 can be turned into one.
2.12 Refrigerators and freezer doors are kept closed.	Items 2.12 and 2.14 can be turned into one.
2.13 Refrigerators and freezer doors are kept at appropriate temperatures.	Items 2.6, 2.7, 2.13, and 2.15 can be turned into one.
2.15 There is a temperature monitoring system for refrigerators, cooling chambers, and freezers.	Items 2.6, 2.7, 2.13, and 2.15 can be turned into one.
4.1 The company’s menu is analyzed concerning the chemical composition of the preparations that compose it.	Item removed due to the complexity of the analysis.
4.11 The company has items on the menu that exceed 1/3 of the recommended daily intake for sodium, saturated fat, sugar or calories, for children.	Items 4.9 and 2.11 can be turned into one.
4.18 The vegetables and fruits are received at the unit all in natura.	Items 4.17 and 4.18 can be turned into one.
5.1 The company has a strategy for combating food waste documented in an operational environment.	Items 5.1 and 5.2 can be turned into one.
5.2 The company assesses your food waste during the pre-preparation of the food.	Items 5.1 and 5.2 can be turned into one.
5.11 The company trains its employees to avoid wasting food during preparation.	Items 5.9, 5.10, and 5.11 can be turned into one.
5.13 The company donates to food banks or charities to avoid wasting food from products suitable for consumption.	Items 5.13 and 10.1 can be turned into one.
6.3 Employees correctly perform the separation of recyclable materials.	Items 6.1 and 6.1 can be turned into one.
8.4 The company uses mops.	Items 1.14 and 8.4 can be turned into one.
9.1 All of your employees have written contracts.	Item removed because it is a law in the country.
10.3 The company has taken any initiatives to work with any local schools/colleges or community groups to educate people about healthy eating.	Items 10.1 and 10.3 can be turned into one.
11.1 The company has environmental certification.	Item was withdrawn because it is already a certificate.

.

2.2. Content Validation

Content validation is a method to assess the tool quality in evaluating what it intends to measure [21]. We used the Delphi method to perform content validation. It is a technique that seeks a group consensus, determined by experts, on a subject or topic through individual responses [22]. A total of 16 experts with Ph.D./master’s degrees and known experience in instruments’ management in food and/or sustainability services were invited to participate. Thirteen experts agreed to participate in this step and received by email the proceedings to the evaluation of the checklist items. Most of the experts were female (n = 12; 92%), and the mean age was 45.07 ± 11.46 years old. Seven had a Ph.D., three had a post-doc and three had a master’s degree, and all of them are researchers from Brazilian public or private Universities.

The Survey Monkey^® tool was used for content validation [23,24]. The questionnaire’s first page was used to guide the checklist evaluation criteria. The experts were guided to evaluate the items regarding the importance of sustainability in restaurants using a 5-point Likert scale from (1) “I totally disagree with the item” to (5) "I fully agree with the item" [23].

The Survey Monkey^® platform was also used for experts to provide feedback on the items and the results of the analysis. The content validation process was performed in two rounds. In the first round, experts received the completed version of the checklist elaborated by the researchers of the study. The experts in the second round reassessed the items that were not approved in the first round. After being informed of the opinions of the other experts, they were invited to reassess their previous responses, maintaining or changing their previous answers. This was performed until a consensus was reached among the experts. The thirteen experts agreed to evaluate the instrument in both rounds.

2.3. Semantic Evaluation

The checklist´s semantic evaluation was performed in the Survey Monkey^® at the same time as the steps described in Section 2.2. The experts were asked to evaluate each item concerning its clarity and considering their level of understanding of the subject. In this step, we also used the Likert scale from (0) “I did not understand anything” to (5) "I understood perfectly, and I had no doubts". Scores between 0 and 3 indicate a low level of understanding of the item, suggesting the need to reformulate the wording [25].

In cases of insufficient comprehension of the item or inappropriate language, experts were invited to suggest changes. These comments were used to create new versions of the items for further evaluation. Two rounds of semantic assessment were performed. Thirteen experts participated in this process. The researchers analyzed the questionnaire and merged the items that had similar wording or that could obtain the same result when evaluated, as suggested by the experts. Therefore, we sent the instrument’s final version to the experts for their final approval.

2.4. Reproducibility and Internal Consistency

After consensus by the experts’ panel, the reproducibility analysis (essential to determine the reliability of the instrument) [26,27] and the internal consistency (indicating if all parts of a tool evaluate the same features) [28,29] were performed.

The final version of the checklist was applied in 20 restaurants of the Federal District, Brazil, to verify the reproducibility and internal consistency of the instrument. Two different researchers applied the checklist to verify interobserver reproducibility, at the same time, in the same place, without communication between them. The instrument was filled out based on direct observation and questions asked to the dietitians and/or restaurant’s employees. It is worth mentioning that it was applied in different restaurant types (self-service, portioned service, cafeteria, à la carte), evaluating the checklist effectiveness and scope in different modalities. The restaurant’s owners were contacted to receive the invitation to participate in the research. The ones who agreed signed the agreement form.

The checklist reproducibility was tested item by item through the responses of the two independent evaluators, determining the reliability of the instrument by the answers. This phase served to verify possible difficulties with the checklist application. Additionally, we evaluated whether each item would measure actions in the way it was written.

The internal consistency of each item was also analyzed. For this step, the instrument was applied in 20 different restaurants in the Federal District, Brazil, at the same time as the reproducibility.

2.5. Statistical Analysis

Mean and standard deviation for quantitative variables (content validation and semantic evaluation) were used as descriptive statistics and as frequencies and percentages for categorical variables (reproducibility).

All responses were registered in Microsoft Software Excel 97–2003. With the answers of the 13 experts, we calculated the average score to assess the importance and clarity of the items. The rate of experts’ agreement for the items’ importance and clarity was assessed by the Kendall coefficient (W) of agreement (from 0 to 1). W values higher than 0.66 indicate a consensus among experts. Lower W values suggest disagreement among experts [21].

W values ≥0.8 were established for the approval of the item. Additionally, items should have an average of ≥4 for the importance and clarity assessment to be included in the instrument.

The items’ responses agreement was verified by absolute agreement and by Cohen’s kappa coefficient for the interobserver reproducibility test. Additionally, we verified reproducibility using the Intraclass Correlation Coefficient (ICC) (values ≥0.9 indicate good agreement). Regarding internal consistency, Cronbach’s alpha was used. Values from 0.7 ≤ α < 0.8 are acceptable, 0.8 ≤ α < 0.9 are good, and α ≥ 0.9 are excellent [29]. For all statistical analyses, we used the IBM SPSS version 22.0 software (SPSS Inc., Chicago, IL, USA).

3. Results

In this study, a checklist was developed and evaluated to provide a tool to support restaurants with the implementation of sustainability indicators. The final checklist was accurately reviewed, and all items were judged as essential and understandable by the experts (by Kendall’s coefficient ≥ 0.8).

Considering the suggestions made by the experts on content validation, and semantic evaluation, a checklist with 76 items was reached, which was subdivided into three sections (1. water, energy, and gas supply; 2. menu and food waste; 3. waste reduction, construction materials, chemicals, employees, and social sustainability). The first section is related to the practices that the company must adopt as a whole to reduce water, energy, and gas consumption. The second section consisted of items that directly assess food production and food waste. Finally, the third section of the instrument consisted of forms of waste and sustainability actions. Additionally, the organization of three sections with a closed number of items will facilitate the construction of a score and classification of foodservice as sustainable services or not.

In total, two evaluation steps were necessary until the agreement between experts for the content validation and two rounds for the semantic evaluation. Besides, assessment by researchers and endorsement by experts was carried out, to conclude all contributions and remove items with repeated content. Figure 1 presents the steps of the checklist validation process.

3.1. Content Validation and Semantic Evaluation: First Round

In the 1st round of content validation, 82 items were approved (57.34%) (W values ≥0.8), and the items had a score of ≥4 in the importance assessment. Thus, 20 items (12 for content validation; 8 for content validation and semantic evaluation) without approval were rewritten with the experts’ observations and sent for a second round (Table S1, supplementary file). For semantic evaluation, 104 items (72.72%) were considered comprehensible (score ≥4 on the Likert scale), thus being approved (Table S1, supplementary file).

Despite having been approved in the first round of content validation, items 1.1 and 1.13 on water supply, 2.1, 2.17, and 2.24 on energy information, 4.21 and 4.23 on sustainable food/menu, 5.1 and 5.5 on food waste, 9.2 on employees, and 10.3 and 10.5 on social sustainability were not considered sufficiently clear by experts in the semantic evaluation. Additionally, some experts proposed to remove some items and mention a poor comprehension of the item’s purpose in the checklist regarding sustainability practices in foodservice. Additionally, they judged some items as subjective and/or repetitive. Therefore, the researchers used the information to reformulate the items and resend them to a new assessment of their importance and semantic evaluation. A total of 33 modified items were submitted to the second assessment round (Table 1).

3.2. Content Validation and Semantic Evaluation: Second Round

In the second round, items 1.14, 2.4, 2.18, 2.23, 4.22, 4.24, 7.2, and 8.3 were submitted for content validation and semantic evaluation (Table 1 and Table S3). Items 2.7, 2.12, 4.1, 4.14, 5.3, 5.4, 5.15, 6.10, 6.20, 7.1, 7.3, and 7.5 were evaluated for content validation and items 1.1, 1.13, 2.1, 2.17, 2.24, 4.21, 4.23, 5.1, 5.5, 5.16, 9.2, 10.3, and 10.5 were evaluated for semantic evaluation (Table 1 and Table S3). After the experts’ evaluation, items 4.1, 4.14, 4.24, 6.10, 6.20, and 8.3 (Table 1 and Table S3) were removed from the checklist, because they were considered not relevant by the specialists (average score < 4). The other modified items were approved (judged as relevant and understandable) and maintained in the checklist.

Researchers analyzed the checklist set, merging the items that presented a similar purpose. In this sense, 22 items were merged with similar items: 1.2 and 1.12 for water supply, 2.2, 2.5, 2.6, 2.7, 2.10, 2.12, 2.13, and 2.15 for energy, 4.1, 4.11, and 4.18 on healthy food/menu, 5.1, 5.2, 5.11, and 5.13 on food waste, 6.3 on waste reduction, composting, recycling, and disposables, 8.4 on chemicals and pollution reduction, 9.1 on employees, 10.3 on social sustainability, and 11.1 on certification (Table 1,

Table 2. The final version of the checklist that evaluates sustainability in foodservice.

Checklist Mark the Answer to Each Question with X (Y = Yes / N = No / Na = Not Applicable)
SUSTAINABILITY ASSESSMENT OF FOODSERVICE
1. WATER, ENERGY, AND GAS SUPPLY	Y	N	Na*	Obs
1.1 The company has goals for the rational use of water, such as the use limit per activity (for example: for each meal served, 10 liters of water are spent).
1.2 The company has reduced water consumption by at least 15% in the last six months, or by 30% in the previous 12 months monitored by the record (see history of water bills).
1.3 The company performs preventive maintenance of the plumbing.
1.4 The company, in case of a water leak, performs immediate repair.
1.5 Employees verify that taps, when not in use and at the end of the service, are closed (note: confirm with the employee).
1.6 The pressure of kitchen faucets, washbasins, and bathrooms is regulated and limited to allow water savings.
1.7 Taps installed in hand or kitchen sinks have automatic activation.
1.8 The water reservoir is adequately kept covered and conserved, and is free from cracks, leaks, infiltrations, peeling, and other defects.
1.9 The company does not use running water to melt ice in sinks or thaw food.
1.10 Employees remove dirt without water from utensils before putting them in the washing machine.
1.11 Dishwashers are operated only at full loading capacity.
1.12 When cleaning floors, the water flow is interrupted when it is not necessary to use it.
1.13 Rainwater is collected and/or water from thermal counters that use water is recycled for use in activities where the use of drinking water is not required (e.g., flushing, washing outside areas).
1.14 The company has documentation for the assessment and/or inspection of energy use for energy conservation.
1.15 The company has reduced energy expenditure by at least 15% in the last six months, or 30% in the previous 12 months (see history of energy expenditure).
1.16 The company has smart energy meters. Check the energy meter.
1.17 The company does not use air coolers as it has natural ventilation to maintain thermal comfort.
1.18 The refrigerator and freezer doors have audible alarms for open doors or automatic locks.
1.19 The temperature of refrigerators, cooling chambers, and freezers are adequate and have a monitoring record.
1.20 The company performs and documents the maintenance recommended by the manufacturer for electronic devices to ensure that all equipment is functioning correctly and maintains energy efficiency levels.
1.21 The company cleans the air cooler filters with suitable detergents or contracts a third-party company for this service and changes the replaceable filters according to the manufacturer’s guidelines.
1.22 The company has lighting controls, such as sensors and timers, in low-occupancy areas (for example, in the distribution area) so that lights are automatically turned off when daylight is sufficient or when spaces are not being occupied.
1.23 The company uses some form of renewable energy (wind, solar, or photovoltaic) in the production area.
1.24 The company achieves zero greenhouse gas emissions with proven partnerships (e.g., commercial energy and vehicle fuel use).
1.25 The company has a documented program to reduce carbon emissions (by at least 5% per year).
1.26 The company has documented targets for reducing the use of liquefied petroleum gas.
1.27 The company has documented targets for reducing the use of natural gas.
1.28. The company uses biogas.
2. MENU AND FOOD WASTE	Y	N	Na*	Obs
2.1 The company owns and uses the technical preparation sheets to make the preparations.
2.2 The company has options for smaller portions separately or a children’s menu.
2.3 The company offers ≥50% of its proven healthiest (less salt, sugar and oil) dishes.
2.4 The company offers a separate menu or substitutions to meet diet restrictions, such as gluten-free preparations, vegetarian cuisine, vegan menu, or preparations to meet religious restrictions.
2.5 The company has documented commitments, with a defined term, to reduce the use of sugar, salt, or saturated fat on the menu.
2.6 The company includes seasonal products in its menu, changing it throughout the months of the year.
2.7 At least 50% of the fruits and vegetables that the company buys are certified organic.
2.8 The company manages its vegetable garden without using pesticides.
2.9 Suppliers of products of animal origin have certificates that prove that animals are raised without the application of antibiotics or organics.
2.10 The company only purchases products of animal origin that have an animal welfare certification seal.
2.11 The company has a policy of purchasing sustainable seafood.
2.12 The company’s supplier produces farmed fish and has a sustainability certification (for example, organic).
2.13 The company does not use ingredients or products with transgenic ingredients in its composition in the production of meals.
2.14 The company prioritizes the full use of food, producing safe preparations that use peels, stalks, and/or edible shavings of vegetables and fruits as ingredients.
2.15 The company assesses its food waste during food preparation.
2.16 The company assesses its food waste during food distribution.
2.17 The company discards food waste in the form of composting, anaerobic digestion, maceration, donates to feed pigs, or establishes partnerships with cooperatives that carry out these processes.
2.18 The company trains its employees to avoid food waste during all stages of meal production, from the receipt of food to distribution.
2.19 The company carries out smart ordering systems, inventory monitoring, inventory rotation and/or other inventory management strategies to avoid food waste.
2.20 The company has goals for reducing/controlling food waste.
2.21 The company recycles or reuses its coffee grounds.
2.22 The company recycles cooking oil and/or transfers the cooking oil used to recycling companies.
3. WASTE REDUCTION, CONSTRUCTION MATERIALS, CHEMICALS, EMPLOYEES, AND SOCIAL SUSTAINABILITY	Y	N	Na*	Obs
3.1 The company has an operational policy that contains a documented strategy on solid (non-food) waste management.
3.2 The company separates recyclable materials, that is, selective collection.
3.3 The company limits packaging and orders products in bulk to avoid waste generation.
3.4 The company does not use disposables and/or adopts strategies to minimize the use of these materials as much as possible, with documented goals.
3.5 The company adopts strategies to reduce the use of plastic in the distribution of meals.
3.6 The company returns packaging boxes for suppliers to reuse and/or provides suppliers with their returnable boxes for the delivery of goods.
3.7 The company returns glass bottles for suppliers to reuse and/or properly dispose of these materials for recycling.
3.8 The company adopts measures to encourage its customers to reduce waste (for example: maintaining glasses, reducing disposable packaging, and eliminating plastics or straws).
3.9 The company uses recycled paper or FSC certified office paper.
3.10 The company uses lamps, accessories, or furniture made from recovered or recycled materials or those provided with an environmental product declaration to improve the environmental impact.
3.11 The paints used for building are environmentally sustainable.
3.12 The furniture (tables, chairs, and others) of the company is made of durable materials that can be repaired.
3.13 The tablecloths (if any) and/or employees’ uniforms are made of organic or environmentally sustainable materials.
3.14 The company uses rechargeable batteries for battery-powered devices and equipment, including flashlights, handheld vacuum cleaners, and others.
3.15 Office equipment replaced or purchased is ENERGY STAR or PROCEL certified.
3.16 The company uses only ecological cleaning products.
3.17 The company uses cleaning concentrates and dilution control systems and/or employee training and monitoring for adequate dilution to minimize the use of chemicals.
3.18 The company exclusively uses environmentally sustainable hand cleaners in the bathrooms of customers and employees.
3.19 The team has already undergone environmental training (energy efficiency and water efficiency).
3.20 The team has already undergone environmental training (fundamentals of sustainability).
3.21 The staff has undergone some training on healthy eating and the health impact of what they are producing.
3.22 The company has a strategy regarding donations or support to its community.
3.23 The company donates to food banks or charities to avoid wasting food from products suitable for consumption.
3.24 The company has initiatives to promote healthy eating education for the local community (schools, colleges, community groups).
3.25 The company has a policy in place with the supplier or purchase specification that favors the acquisition of local products for foods such as dairy products, meat, fruits, and vegetables.
3.26 Does the company purchase one or more products from a charitable foundation or a social enterprise that provides social impact? (For example, a product made from leftover food, bread from a social enterprise bakery, etc.).

(*) Na = Not applicable; Obs. Observation.

and Table S3).

Additionally, researchers performed a new section organization, reducing the 11 sections (with a few numbers of items) to three sections (with a closer and higher number of items). Section 1 is composed of 28 items related to water, energy, and gas supply. Section 2 has 22 items on menu and food waste. Section 3 has 26 items on waste reduction, construction materials, chemicals, employees, and social sustainability. This checklist composition was sent to the experts (third round of evaluation), and all items and sections were approved, composing the final version of the checklist (Table 2).

Table 2 presents a checklist with the changes recommended by the experts for the best comprehension of the stages. All items had an answer type of "Yes / No / Not Applicable", except for the "Identification/information of the restaurant" section, composed by open questions characterizing the restaurant (name, number of meals, owner information).

3.3. Checklist Application in Restaurants—Reproducibility and Internal Consistency

Two different researchers applied the final version of the checklist in 20 restaurants (Federal District, Brazil) to verify interobserver reproducibility and internal consistency (Table S2, supplementary file). The average period of the application was two hours, with the necessary approach to the responsible nutritionist and some employees. The instrument is reproducible, all kappas were significant, the absolute concordances were greater than 90%, and all the Intraclass Correlation Coefficient (ICC) scores were >0.9 (

Table 3. Mean score (and standard deviation—SD) and Intraclass Correlation Coefficient (ICC).

Checklist Section	Evaluator 1 Mean (SD)	Evaluator 2 Mean (SD)	ICC	p
Section 1	40.92 (6.88)	41.61 (6.45)	0.938	0.000
Section 2	55.07 (9.10)	55.36 (9.51)	0.978	0.000
Section 3	35.64 (15.00)	36.15 (14.74)	0.996	0.000
Total checklist	43.90 (5.71)	44.42 (5.29)	0.963	0.000

).

The internal consistency of each item by section of the instrument was verified. The internal consistency analysis of the checklist considered the 76 items to build the final version of the checklist. All items of the instrument were approved for internal consistency (

Table 4. Internal consistency (Cronbach’s’ Alpha).

Checklist Section	Cronbach’s Alpha	p
Section 1	0.672	0.000
Section 2	0.788	0.000
Section 3	0.865	0.000
Total	0.907	0.000

), with alpha coefficient values greater than 0.672 (good internal consistency).

4. Discussion

The study is the first one to create a checklist to evaluate and develop standards for “green” or sustainable restaurants in Brazil. The results of other studies show that the indicators must assess three sustainable aspects—environmental, social, and economic [15]—which are considered the pillars of sustainability, covering 76 items that were selected and validated by the experts. In the systematic review conducted by Maynard et al. [15], the authors reinforced the importance of assessing the environmental, economic, and social aspects of foodservice to ensure that sustainability is verified in all its pillars. From the instruments used as the base for the Brazilian checklist, only the SRA and the Green Seal presented items from environmental, economic, and social aspects. However, they brought questions more related to legislations from the countries in which they were developed, and some items cannot be applied to Brazilian context.

For the development and validation of an instrument, it is essential to use strict methods [21,30]. In this sense, we used the Delphi technique, since it enables the achievement of a panel of experts performing content validation, facilitating consensus on the opinions of experts [23,31].

The Delphi technique guided the experts’ evaluations, allowing them to interact with the researcher by structured rounds [23,24,32]. The use of the Survey Monkey^@ platform allowed the experts to provide quick feedback, which ensures a more organized interaction between researchers and experts. Another crucial point in a checklist validation is the appropriate experts’ selection. It is essential to obtain reliable results based on their experience and knowledge and also the willingness to collaborate with the study. However, the literature does not present a consensus regarding the number of required experts for the validation process [22,26,33,34]. However, in Brazil, Pasquali [35] considers at least six experts as needed to obtain a consensus, allowing variations according to the characteristics of the tool. In our study, thirteen experts participated in the process of checklist validation, which is considered adequate for this purpose.

The checklist has strengths, as it was evaluated by a panel of experts in the area, which were free to comment on what they considered necessary to improve the instrument. Additionally, the semantic validation and evaluation process allowed guaranteeing that the items are clear and understandable [35]. Thus, the checklist was also applied by two evaluators who verified its reproducibility, and it was tested using the Intraclass Correlation Coefficient (ICC). We also analyzed the internal consistency using Cronbach’s alpha formula, indicating good internal consistency [36]. Therefore, it is a reliable and trustworthy instrument.

In the study by Molina et al. [37], the intraclass correlation coefficient of an instrument for measuring food frequency was used to assess reproducibility and validity. Their results showed that the questionnaire had moderate levels of reproducibility and validity and it can be used to evaluate food-frequency. The study by Costa et al. [38] used the same methodologies to validate a checklist for fish-bearing, and stated that the checklist is valid and reliable to assess their objective of the bearing, thus showing the importance of using reproducibility and internal consistency in the construction and validation of instruments like checklists.

Obtaining a validated checklist to identify the sustainability indicators applied in Brazilian foodservice is an urgent need. In Brazil, sustainability in foodservice is something new and is still little used in recent years [14,15,39]. In a systematic review by Maynard et al. [15], which assessed sustainability indicators in foodservice, only two studies were conducted in Brazil. One study evaluated activities that involved the environmental aspect [40], and the other one evaluated activities that involved the three aspects of sustainability (environmental, social, and economic) [41], reinforcing the scarcity of sustainability studies and activities in the country for the restaurant sector. The lack of rules or defined standards in the resolutions on sustainability is perhaps the most flawed point in our country, as well as studies on the development of instruments on sustainability indicators.

For Raab, Baloglu, and Chen [42], restaurants have the social responsibility to get involved in sustainable practices. Consumers are more worried about sustainability, and they want their restaurants to implement sustainable indicators to become “green”. Jacobs, Singhal, and Subramanian [43] discovered in their study that restaurant managers were hesitant to use sustainable practices due to the lack of evidence that these practices would be recognized and valued by their clients.

Sustainable development is an innovation in restaurants that can be useful to attract consumers to return, as well as attracting tourists and travel agencies’ attention when choosing a place to visit. With the growing environmental awareness, innovation in restaurant services must assume its role as an ecological agent [44]. Some studies already show that customers are willing to spend more money on meals with less environmental impact [45,46,47], and other studies already showed the importance of diners’ awareness about sustainability. This awareness starts with the reduction of food waste, since reducing waste is investing in sustainability [4,48]. Restaurants face difficulties in initiating friendly environmental practices because of the low awareness of practical methods for the sector and fear of higher costs [49]. A practical checklist can help establishments go over each item and start to change non-sustainable procedures.

Sustainable certifications are mostly done by private companies or associations, which ends up being a cost for restaurants to invest in these certifications or even in ISO. This scenario reinforces the importance of building and validating this checklist, which will be a free and easy tool for professionals involved in the production of meals. Additionally, the checklist must address the three pillars of sustainability (environmental, economic, and social). Sustainable practices need to cover the three points to be complete and to address the most significant number of activities that prioritize the best use of natural resources [15]. In this way, restaurants will be able to become aware of the need to implement safe agroecological practices and will act as future agents of environmental transformation.

In a Brazilian study by Martinelli and Cavalli (2019) [50], which surveyed the relationship between sustainability and healthy eating, the authors stated that sustainable diets are those that generate low environmental impact, contributing to the quality and food safety of individuals. They also reinforced that although many researchers focus only on the environmental aspect, sustainable diets must also involve social and economic aspects, since foods with less environmental impact may not be considered healthy or vice versa. It is worth mentioning that the menu and the sustainable menu are aspects evaluated in this checklist.

These data reinforce the importance of the constructed checklist (Table 2), since it includes the three sustainable dimensions in the form of items that contemplate various aspects for restaurants to be evaluated as agents that promote sustainable development. The instrument went through a rigorous validation process, including the experts’ evaluation, reproducibility, and internal consistency, demonstrating the concern to build a valid and comprehensive method that is used in this critical sector of the economy today. In the study of Wang et al. [6] that also built and validated an instrument for green restaurants, authors developed a checklist based on the need to create a standard for restaurants in Taiwan, and used the collaboration of government, industry, and academic experts. They concluded that the instrument had a significant contribution to establishing a management standard for green restaurants, which is not yet common in Taiwan.

Although there are other available instruments on sustainability, our study brings novelty because it includes the three pillars for evaluation (environment, economy, and social), and it is validated explicitly for foodservice in Brazil according to the country´s legislations. Besides, the use of the Delphi method allows a considerable volume of information, better reflection on the topic, and new suggested ideas by the experts in the field [22,23]. The checklist also becomes attractive due to the use of semantic evaluation, guarantying an adequate comprehension of the items, which is essential for the accurate assessment of sustainability indicators.

The checklist is practical, quick to apply, cheap, and easy to understand. It can be used by nutritionists, dietitians, managers, or owners of foodservice establishments, to classify whether the foodservice is sustainable or not, thus allowing the evaluated places to adapt to more sustainable practices. It can be applied in different foodservices, being an instrument that will be important in the Brazilian scenario, which has a growing sector related to the production of meals. Additionally, the study contributes to the formulation of an instrument capable of evaluating sustainability indicators. It can serve as a guide for the implementation of new sustainable practices in foodservices or even for a future classification of these places, also serving as a marketing strategy to consumers. In this way, restaurants will be able to become aware of the need to implement safe agroecological practices and will act as future agents of environmental transformation.

5. Conclusions

The checklist to verify sustainable indicators in foodservice was validated for content after careful analysis by experts. Items were considered essential and wide-ranging with a Kendall coefficient above 0.8. The instrument presents good internal consistency, and it is reproducible considering the proportion of agreement between professionals when applied in the same foodservice.

It is also important to highlight that the instrument is practical, quick to apply, not extensive, and encompasses the three pillars of sustainability (environmental, economic, and social). This instrument can help professionals working in foodservices to use and apply sustainability indicators, helping them to create strategies to change behaviors towards the environment.

Further studies are necessary to test the checklist in a more significant number of foodservice so as to evaluate the contribution of implementing and verifying sustainable indicators. Strategies in this area are essential to improve knowledge in this field and encourage changes for more sustainable restaurants.