Next Article in Journal
Enhancing Cultural Sustainability: Making Rescue Excavations Accessible through Educational Applications and Virtual Reality
Next Article in Special Issue
Elite Speech about Climate Change: Analysis of Sentiment from the United Nations Conference of Parties, 1995–2021
Previous Article in Journal
Bibliometric Analysis of Urban Coastal Development: Strategies for Climate-Resilient Timber Housing
Previous Article in Special Issue
Perceptions of Urban Community Resilience: Beyond Disaster Recovery in the Face of Climate Change
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Identifying Different Semantic Features of Public Engagement with Climate Change NGOs Using Semantic Network Analysis

1
The Media School, Indiana University, Bloomington, IN 47405, USA
2
Department of Information and Library Science, Luddy School of Informatics, Computing, and Engineering, Indiana University, Bloomington, IN 47405, USA
*
Author to whom correspondence should be addressed.
Sustainability 2024, 16(4), 1438; https://doi.org/10.3390/su16041438
Submission received: 26 December 2023 / Revised: 22 January 2024 / Accepted: 2 February 2024 / Published: 8 February 2024
(This article belongs to the Special Issue Transdisciplinary Perspectives on Environment and Communication)

Abstract

:
Social media platforms have revolutionized the engagement between climate non-governmental organizations (hereafter, NGOs) and their publics on climate issues. This research diverges from the traditional use of metrics like retweets and likes as simple indicators of identical success in ‘one-way’ climate communication. Instead, it underscores ‘two-way’ interactions and their connections that may vary by specific public engagement features, such as popularity, commitment, and virality. Using semantic network analysis, we analyzed tweets and replies between high-engagement NGOs and their publics, identifying communication patterns tied to particular types of public engagement. Additionally, we investigated shared meanings in these interactions with semantic similarity metrics and assessed sentiment alignment between NGOs and their publics as potential indicators of public engagement. Our findings suggest that climate NGOs should select resonating topics, ensuring their sentiments align with those of their publics. It’s also essential to tailor topics and focus points in climate communication strategies to reflect desired types of public engagement. This study offers insights into optimizing communication and engagement strategies for climate NGOs on social media.

1. Introduction

The landscape of information dissemination and accessibility has undergone a profound transformation with the advent of social media, exerting a significant influence on public discourse and engagement across socio-cultural, political, and policy domains [1,2]. Ranging from simple likes, shares, and brief comments easily accessible to a range of public audiences [3] to profound discussions taking place within topic-oriented communities on social media platforms [4,5,6], these cost-effective communication tools empower activists and ordinary individuals to readily participate in discussions concerning various issues, thereby amplifying their voices effectively. With this influence, social media serves as a conduit for both online and offline activism, mobilizing ‘non-expert publics’ (hereafter, ‘publics’) (In current research, the term ‘non-expert publics’ refers to non-expert individuals who recognize a problem or opportunity, and take action to address it (in this case, climate change), as well as those who have built or can build relationships with relevant organizations (in this case, organizations active on climate change) [7,8,9,10]) and advocating for climate policies [11,12,13,14].
Among the paramount concerns that have garnered substantial traction on social media is the predicament of climate change—an issue of utmost significance confronting our global landscape. According to the 2018 United Nations’ Intergovernmental Panel on Climate Change (IPCC) report, countries worldwide are not doing enough to limit CO2 emissions. The report highlights the urgent need to reduce global emissions by 45 percent by 2030 compared to 2010 levels [15]. Additionally, the IPCC, established in 1988, has consistently emphasized the severity of our current inaction and the future consequences of climate change [16,17]. In this context, social media serves as a means to express concerns about prominent climate change issues (e.g., extreme weather), share pertinent information, engage in discussions about climate science, and participate in climate politics [18].
Numerous non-governmental organizations (hereafter NGOs) are actively involved in advocating for climate change-related concerns, connecting global audiences and translating complex climate science for a range of public audiences [19]. Some climate change NGOs have been operating since the 1970s, with notable examples such as Greenpeace, which has been instrumental in influencing national and international discussions on environmental matters, including deforestation, since its establishment in 1971. For these NGOs, social media platforms have been valuable tools to address their diverse communication goals despite limited resources [20]. Specifically, social media has been identified as a crucial tool for climate-focused NGOs, enabling them to establish a direct information flow to a range of public audiences about climate issues, attract widespread media coverage, appeal to both internal and external audiences to take action on these issues, and establish direct communication channels with policymakers [19,21].
While the significance of social media for climate NGOs—key communicators on climate issues—has been acknowledged, we contend that there is a need for further exploration into the dynamics of engagement between these NGOs and their target audiences. While online platforms have been recognized as a means for deliberate scientific discourse with a range of public audiences [5], and dialogic two-way communication between NGOs and their audiences has been advocated for better engagement [22], existing research has primarily concentrated on the content and manner in which NGOs address climate change matters on social media, within one-way communication framework. This framework assumes that NGOs exert a unidirectional influence on publics, often relying on the metrics of public engagement on social media (e.g., number of likes) as the solo indicator of communicational success. In essence, there has been limited investigation into how various stakeholders, particularly publics, engage in discussions with climate NGOs, and consequently, there is a dearth of understanding regarding the organizations’ communication strategies and how these strategies relate to these interactions.
In light of the existing research gap, this study challenges conventional public engagement metrics on social media in two ways. First, it questions the notion that popularity, commitment, and virality, which are gauged through metrics such as likes, replies, and shares [23], should be considered indicators reflecting the identical success of communication strategies, as each type of public engagement may be linked to distinct aspects of interactions between the organization and its corresponding audiences [24]. Second, to gain a comprehensive understanding of ‘public engagement’, it advocates for an exploration not only of communications from the organization, but also of dialogues between the organizations and their publics, thus shedding light on the discourses facilitated by publics.
Therefore, guided by the two-way communication approach, our objective was to investigate the distinct characteristics of discussions related to climate change, with a particular focus on the themes and focal points in conversations initiated by both climate NGOs and publics across various types of public engagement on social media. Using semantic network analysis (SNA), we uncovered distinctive patterns and conversation themes between organizations and their audiences, which reflect the specific types of public engagement on social media platforms. Additionally, our study explored the extent to which these organizations and their specific target audiences maintain alignment in the subjects and central themes of their conversations across these different modes of engagement. This was accomplished through an analysis of the semantic similarity between the discourses of the organizations and their respective publics. We also examined the emotional alignments between organizations and their publics, as it could offer valuable insights into effective social media strategies. Through these explorations, this study enhances our understanding of the dynamics at play in the ‘two-way’ interactions between climate NGOs and their respective audiences and improves social media communication strategies tailored to the distinct engagement objectives of each organization.

2. Literature Review

2.1. Climate Change Communication on Social Media

Climate change has been a hot topic on social media, as media attention and civil society mobilization concerning the issue has been manifested in these channels [25]. This is especially true among younger generations, such as Gen Z, as they are actively being exposed to social media posts on climate actions and engaging with social media content on climate actions [13]. The prevalence of climate change discourse on social media has prompted researchers to investigate the themes and focuses of public discussions on this subject. Previous studies have explored the various topics and issues that publics addresses when discussing climate change on social media platforms [18,26]. These investigations have provided insights into the prevalent concerns, interests, and perspectives of social media users regarding climate change. By examining the themes and focuses of public discourse, we aimed to understand public engagement with climate change and the information that circulates through social media channels.

2.2. Engagement with Publics

Engaging publics with an issue through relevant organizations is considered crucial in the fields of science communication and public relations. In those fields of communications, such engagement motivates publics to build a favorable relationship with the organizations and actively seek out the necessary information, such as climate science, to make informed decisions [27,28,29]. From the perspective of science communication, it is a scientific responsibility [5]. More specifically, the concept of public engagement with science (PES) argues that interactive engagement among scientists, stakeholders, and publics, driven by meaningful dialogue regarding scientific issues, allows publics to play an active role in scientific decision-making and producing social impacts [30]. From the perspective of public relations, engagement with publics and stakeholders has been understood as “part of dialogue and through engagement, organizations and publics can make decisions that create social capital” [22] (p. 384), which was considered as an orientation to ethical communication [27].
In both communication fields, communication between experts, relevant organizations, and publics are essential for engagement. Consequently, social media has emerged as a pivotal tool, facilitating direct ‘two-way’ communication between scientists or pertinent organizations and an array of public audiences [27,31]. However, prior studies focusing on climate NGOs’ social media presence have predominantly emphasized a ‘one-way’ communication from these organizations. For instance, a study analyzed the framing of social media posts by 298 global climate NGOs, suggesting that these strategic messages could influence public perceptions and behaviors concerning climate change and engagement [19]. Similarly, another study spotlighted the ‘one-way’ communication strategies of environmental NGOs, investigating their campaigns that challenge the sustainability of corporate actions [32].
Studies concentrating on the communicative interactions between organizations and publics often hone in on publics’ social media engagement metrics, such as views, likes, and shares [23,24,27]. This scope, however, scarcely encapsulates the richness of dialogic interactions and the evolution of public discussions on climate change issues on social media (e.g., “What issues do publics want to discuss with climate organizations?”). Thus, the specific themes and focal points of communication between organizations and publics have not been extensively researched. Addressing this gap, Comfort and Hester posited that merely reaching a broad audience might not be an adequate measure of a climate NGO’s social media messaging success [33]. They proposed three alternative metrics, including topic and valence (i.e., whether publics aligns with and supports the topics NGOs champion). Building on Comfort and Hester’s insights, we venture beyond mere publics’ social media engagement metrics to explore the nature of conversations initiated by both climate NGOs and their audiences.

2.3. Why Climate NGOs?

NGOs have adeptly employed public relations strategies to communicate their agendas and issues effectively with publics [34,35]. In this digital age, social media stands as an indispensable platform for NGOs, not only to elevate public consciousness about their causes but also to engage meaningfully with stakeholders. Specifically for climate NGOs, these platforms bridge the gap between scientists and the wider public, demystifying scientific research into actionable steps and galvanizing both governmental and individual action [19].
Climate change, although globally pressing [36], represents a multifaceted challenge intricately intertwined with climate science, politics, and socio-cultural dynamics. Moreover, key stakeholders in climate change—from scientists and activists to everyday citizens—may possess varying levels of perceptions, knowledge, and action plans regarding the subject [37,38]. In this context, to harness the full potential of social media, climate NGOs need to craft strategies that both simplify scientific research and resonate with public concerns, tailored to their target audiences and the core missions of their organizations [34]. In essence, it is paramount for climate NGOs to identify mutual concerns with public audiences, align with their understandings of key topics, and strategically relate prominent issues to their established frames [19,33].
Effective communication with the broader public is paramount for climate NGOs, enabling the transformation of scientific knowledge into actionable public engagement. Eschewing the narrow scope of public engagement metrics as the sole evaluative tool, we aim to scrutinize how high-engagement, in terms of popularity, commitment, and virality, climate NGOs and their publics interact on social media platforms, identifying central themes, focuses, and the features of communication.
As part of our exploratory investigation, we also examined whether the “shared meaning” between the discourses of these two parties is associated with public engagement, as argued by Taylor and Kent [39]. To measure this shared meaning between climate NGOs and their publics, we utilized semantic similarity observed in their discourses (i.e., posts from the NGOs compared to corresponding replies), following the approach outlined by Cann et al [40]. They proposed that the alignment between organizational communication and target audiences’ communication, identified through semantic similarity, serves as an outcome of effective strategic communication.
Additionally, we investigated which climate NGOs achieved sentiment alignment between their organizational messages and the associated responses from their publics, using this as a potential indicator of public engagement on social media. In a previous study [41], researchers found that in the context of vaccination, information flow on social media was more frequently observed between individuals who shared the same sentiments, while the flow between individuals with differing sentiments were less frequent. Similarly, exploring sentiment [mis]alignment between the climate NGO and its public may provide valuable insights into how these groups incorporate shared or divergent issues and opinions in their communication and disseminate information, a crucial aspect of public engagement [42]. Consequently, this approach may serve as a potential metric for assessing shared interests and perspectives on contemporary climate issues.
The following research questions guide this study:
  • RQ1: How did publics engage with climate NGOs’ social media accounts, in terms of public engagement metrics (i.e., popularity, commitment, virality)?
  • RQ2: What are the relationships between (a) public engagement on social media and (b) the shared meaning between tweets from the climate NGOs and the corresponding public replies, as measured by semantic similarity (e.g., Euclidean Distance, Levenshtein Distance)?
  • RQ3: Which climate NGOs achieved sentiment alignment between their organizational posts and the corresponding replies they received?
As part of our exploratory investigation, we further analyzed three climate NGOs—(a) Greenpeace USA (hereafter GPU), (b) Climate Central, (c) Environmental Defense Fund (hereafter EDF)—that exhibited the highest public engagement scores, in terms of popularity, commitment, and virality, among our sampled 10 climate NGOs. These organizations also demonstrated alignment in sentiments with their respective publics. This analysis aimed to identify the particular characteristics of each type of public engagement with the following research question:
  • RQ4-1: What are the primary themes and focal points observed in the social media communication conducted by (a) GPU and (b) its corresponding publics, which reflect the characteristics of popularity?
  • RQ4-2: What are the primary themes and focal points observed in the social media communication conducted by (a) Climate Central and (b) its corresponding publics, which reflect the characteristics of commitment?
  • RQ4-3: What are the primary themes and focal points observed in the social media communication conducted by (a) EDF and (b) its corresponding publics, which reflect the characteristics of virality?

3. Materials and Methods

To measure public engagement with the climate NGOs on social media, we adopted and revised three public engagement measures with organizational social media accounts from Bonsón and Ratkai [43] and Haro-de-Rosario et al. [23] (i.e., citizen engagement): popularity (i.e., popularity of messages [from the climate NGOs] in public engagement); commitment (i.e., commitment of public in the communication with the climate NGOs); and virality (i.e., virality of messages among publics’ communication). More specifically, popularity measures the frequency of affective reactions from the public to social media messages, while commitment indicates a higher and more sustained level of engagement [44]. Virality represents the breadth of a message’s reach [44]. The three dimensions of public engagement have been operationalized as shown in Table 1.
This study aimed to explore the relationships between (a) public engagement and (b) shared meaning between social media communications of climate NGOs and their corresponding public. To operationalize shared meaning within this research’s context, we utilized semantic similarity metrics [40]. These metrics enable the identification of similarities between terms or texts that convey the same meaning, even if they do not exhibit lexical similarity [45]. More specifically, we used two semantic similarity metrics: (a) Euclidean distance and (b) Levenshtein distance. Euclidean distance is a measure calculating the straight-line distance between the corresponding coordinates of two points in a multidimensional space [46]. Within the context of assessing semantic similarity between two texts, it quantifies the distance between their vectorized representations in a multidimensional space, ranging from 0 to positive infinity [47]. Levenshtein distance is a measurement for quantifying the dissimilarity between two strings, which calculates the number of single-character edits (e.g., insertions, deletions, or substitutions) needed to transform one string into another [48]. A lower score for the two measurements indicates a higher level of similarity between the two examined documents, possibly suggesting the presence of shared meaning as the organization and its public have common or at least similar themes or focal points in their discourses.
This study investigates the sentiment alignment between a climate NGO’s tweets and the replies the organization received. To identify sentiment alignment, we conducted a correlation analysis between the trends of the organization’s weekly sentiment score and the ones of the corresponding replies that we computed.
To identify the prevailing themes and focal points of climate NGOs’ Twitter posts and following public discourses (represented in public audience replies to the climate NGOs), we used SNA. The method allowed us to identify key concepts—used by the NGOs and publics—and their interpretive contexts, by analyzing the significance of specific words based on their frequency and centrality measure values, as well as their co-occurrences and clustering patterns within the text [49,50]. In practice, previous studies have identified salient themes and frames within texts in various contexts, such as the ESG policies in sustainability reports of corporations, and publics’ discussions on childhood vaccination and COVID-19 vaccines [49,51,52].

3.1. Data Collection

We collected Twitter posts (i.e., tweets) posted by ten climate-change NGOs and corresponding public replies that were sent to those organizations from 1 July 2020 to 30 June 2021. Twitter was selected as the representative social media platform for this research because it is suitable for organizations including climate NGOs to share information publicly and engage with publics [53,54,55]. This time range was selected to encompass various factors such as seasonal climate change issues (e.g., extreme weather conditions, flooding), U.S. national political or policy-making issues (e.g., presidential election, Keystone XL pipelines), and global climate change concerns [56]. The acquisition of Twitter data (i.e., tweets and replies) was accomplished by employing the data collection service offered by exportcomments.com (1 September 2023) [57], which enabled us to extract relevant data including the textual content of tweets and replies, the date and time of posting, the number of likes received by the post, and the number of retweets generated by the post.
The organizations were selected from a list of top NGOs working to stop climate change [58] and then screened based on (a) relevance of their posts to climate change issues and (b) comparable volumes of posts from their Twitter accounts. The finalized list of climate NGOs in this research and brief information about the accounts are available in Table 2.

3.2. Analytic Approach

For RQ1, we calculated the three public engagement metrics for each organization following the formulas suggested by Haro-de-Rosario et al. [23].
For RQ2 and subsequent research questions that involve sentiment analysis and SNA, we performed pre-processing on the textual content of organizational tweets and replies that we collected. More specifically, we removed URLs, stopwords, and non-contextual elements, which included punctuation and special characters, except for the ‘@’ symbol used to indicate mentioned accounts. Additionally, we excluded Twitter function words such as ‘replying to’ to focus on the relevant content for our analysis. We then lemmatized and tokenized for each corpus (e.g., a group of tweets from an organization, a group of replies sent to an organization) using packages such as spaCy [59] and TextBlob [60] on Python.
For RQ2, we computed two semantic similarity metrics, namely Euclidean distance and Levenshtein distance, between each organization’s corpus and its corresponding reply corpus. We utilized Scikit-learn [61] and scipy.spatial [62] libraries to calculate the semantic similarities for each organization. To assess the relationships between three types of public engagement and the two types of semantic similarity, we performed a correlation analysis.
To conduct sentiment analysis for RQ3, we employed the Azure sentiment analysis model, developed through Microsoft Azure machine learning (version: 5.2.0), to calculate weekly average sentiment scores [63]. The sentiment analysis model provides a “sentiment label” (positive, negative, neutral) along with a confidence score for each post, ranging from 0 (lower confidence) to 1 (higher confidence). Using the model, we identified sentiment label for each preprocessed tweet/reply. To quantify sentiments and compare changes within the two groups (i.e., tweets from an organization vs. replies to the organization), we devised a “weighted sentiment score” by assigning numeric values to sentiment labels (positive = 1, negative = −1, neutral = 0) and multiplying these values by the corresponding confidence score. Higher scores close to 1 indicated more significantly positive posts, while scores close to −1 indicated more significantly negative posts. Weekly sentiment scores were determined by calculating the average sentiment scores of tweets and replies published during each week. Next, we conducted an analysis to explore the correlations between the weekly sentiment score trends of an organization’s posts and the corresponding replies. Our aim was to identify organizations that exhibited a significant and positive correlation, indicating their success in maintaining alignment with the sentiments expressed by the reply public.
To address RQ4, we employed SNA, which involves examining the structure of a semantic network constructed from a large volume of unstructured text datasets [64]. In this method, each word (e.g., ‘climate’, ‘change’) is treated as a node within a network, and the analysis focuses on the co-occurrences of these words [65]. These co-occurrences, such as the words ‘climate’ and ‘change’ appearing together in a single post, are counted as instances of co-occurrence. Representing the links between nodes, these co-occurrences are crucial for calculating closeness among words (i.e., nodes). SNA allows for a spatial representation of language structure, enabling the visual grasp of relationships between main concepts (e.g., ‘climate change’ in the current context) originating from specific terms and their connections to other concepts derived from different terms (e.g., ‘conservation’ or ‘wildfire’ in the current context) [65]. The visualization capability of SNA empowers researchers and professionals to uncover insights that might not be immediately apparent through traditional quantitative or qualitative analysis, thereby enhancing our understanding of complex and contextual information underlying the text.
Using the preprocessed text from the previous stage, which included tokenization, lemmatization, and the removal of stop words, we first extracted the most frequent words from the corpus and converted these into a list, annotating each with the frequency of its co-occurrence with other words (i.e., weight). For example, we created a link-list showing how often words like “change”, “crisis”, or “disaster” co-occurred with “climate” in the same post within the corpus of the NGO’s posts or replies to the NGO. Subsequently, employing NeTxt [66], we transformed the processed text and this annotated link-list into a network. In this network, the words serve as nodes, and their co-occurrences become the ties. As a result, we generated a semantic network for each corpus, resulting in six networks, each featuring the top 150 frequent words. For a more detailed step-by-step explanation, you may refer to Segev [66,67].
The generated semantic networks were then exported as weighted edge lists and converted to a format suitable for analysis in Gephi [68], using Python. Subsequently, we imported the data into Gephi to visualize and explore the networks further. Within Gephi, we conducted modularity analysis to identify distinct clusters or themes within each network and calculated various network statistical indicators, such as degree and eigenvector centrality, as outlined by Segev [66] and Luo et al. [69]. These measures helped us determine the importance and prominence of specific keywords within the networks.

4. Results

4.1. RQ1: Public Engagement Metrics

First, the results of our study provide insights into the public engagement on social media for each of the 10 climate NGOs included in our sample. In terms of follower count, Nature Conservancy leads the pack with an impressive 990,550 followers, followed by Skoll Foundation with 445,747 followers. However, GPU exhibits a high level of public response, generating the highest number of replies (5058). The organization also showcases the highest levels of popularity (GPU: 61.62), measured by the average number of likes per post. Notably, Climate Central and GPU stand out in terms of commitment, with commitment scores of 2.08 and 1.85, respectively. Finally, for virality, EDF achieves the highest average number of retweets (325.57), followed by Earth Justice (249.12). See Table 3 for overview.

4.2. RQ2: Public Engagement on Social Media and Shared Meaning

Second, to investigate the potential relationships between public engagement and the level of shared meaning between a climate NGO and its audiences, we conducted a study analyzing the correlations between public engagement metrics and semantic similarities. In order to assess the extent of shared meaning, we used two semantic similarities measures: Euclidean distance and Levenshtein distance. As shown in Table 4, only two pairs of measures displayed significant positive correlations. Specifically, the correlation between popularity and Levenshtein distance was (0.760 *), and the correlation between virality and Euclidean distance was (0.729 *). These findings suggest that higher levels of public engagement, as measured by popularity and virality, may be associated with a decrease in shared meaning between the climate NGO and its audiences.
Third, we conducted an analysis to examine the sentiment alignment between organizational posts and the corresponding replies they received. Based on the assertion that aligned sentiments on social media are indicative of shared interests or attention towards specific issues, as well as the strategic incorporation of publics’ agendas and concerns [42], our objective was to investigate the potential connections between sentiment alignment and public engagement driven by shared perspectives on these issues. Among the organizations included in the analysis, three organizations showed a significant positive correlations with weekly sentiment scores of their respective organizations’ posts and the corresponding replies: GPU (r = 0.322, p = 0.019), EDF (r = 0.320, p = 0.019), and Climate Central (r = 0.389, p = 0.004). Notably, these organizations also received top scores in terms of public engagement metrics as discussed above. These findings suggest that these organizations not only effectively maintained alignment with their audience in terms of sentiment but also achieved successful public engagement (see Table 5 for overview).

4.3. RQ4: Central Themes and Focuses

To address RQ4, we selected a total of three organizational accounts (GPU, Climate Central, and EDF) to explore the central themes and focuses of the discourses facilitated by these organizations and their publics with SNA. In addition to the commonly used public engagement measures (e.g., the number of retweets), which often fail to capture the emergence, convergence, or divergence of themes and focal points within discussions between organizations and their publics, this approach may offer a more insightful and holistic view of public engagement in this exploratory study. With the focus, we sampled three climate NGOs: high popularity: GPU; (b) high commitment: Climate Central; (c) high virality: EDF. Then, we identified and compared the key concepts (i.e., words), themes, and focal points between organizational tweets and the corresponding replies, based on (a) the centrality of words, (b) the associations between two words, and (c) the clusters of words within the network [70].

4.3.1. Greenpeace USA (GPU): High Popularity

The keywords with the highest degrees in GPU tweets are “nature” (degree = 1897), “new” (degree = 1202), and “climate” (degree = 995). In the replies, the top keywords include “climate” (degree = 658), “fossil” (degree = 585), and “fuel” (degree = 475) (Table 6).
Table 7 illustrates the weighted associations between words in GPU tweets and replies. Noteworthy associations in GPU’s tweets include “climate” and “change” (weight = 68), “nature” and “person” (weight = 56), and “nature” and “new” (weight = 52). In replies, significant associations include “climate” and “change” (weight = 113), “oil” and “gas” (weight = 56), and “public” and “health” (weight = 47).
The most prominent findings from the case of GPU were that GPU’s posts and its public’s replies had very specific and different key topics and frames in the discourses. For example, the tweets from GPU were commonly used to discuss a range of general and worldwide topics, including “nature”, “world”, and “planet” and broader climate change-related subjects such as “forest” and “water”. In contrast, the replies sent to GPU focused more on “fossil fuel” and “oil”, which is more tangible and associated with specific policies and expanded it as public health issue (e.g., Rank 29: “fossil” and “health” in Table 7). See Figure 1 for an overview.

4.3.2. Climate Central: Low Popularity, High Commitment, Low Virality

Climate Central was a unique case, in that its public engagement score was high on commitment, while low on popularity and virality. In tweets from Climate Central, the most frequently used keyword is “climate” (degree = 1112), followed by “temperature” (degree = 654) and “change” (degree = 646). Similarly, in replies sent to Climate Central, the most prominent keyword is “quote” (degree = 1192), followed by “climate” (degree = 1165) and “change” (degree = 719) (Table 8).
As shown in Table 9, the associations of words with the highest weights were “climate” and “change” (weight = 61) in tweets from Climate Central and “climate” and “change” (weight = 120) in replies. Other notable associations in tweets from Climate Central include “climate” and “temperature” (weight = 27), as well as “temperature” and “average” (weight = 27). In replies sent to Climate Central, the association between “climate” and “quote” has a weight of 64, and the association between “level” and “sea” has a weight of 39.
While both organizational posts and replies focused on the similar topics such as ocean-related issues (e.g., “sea level”) and global warming issues (e.g., “warming”), we identified that publics’ replies widely adopted “quote” to bring information from external sources. It implies that the organization and its public tended to focus on accumulating concrete scientific information in the organizational account, which might be less favored by the lay publics who are not ‘committed’ to the community of the organization. See Figure 2 for overview.

4.3.3. Environmental Defend Fund (EDF): High Virality

EDF was the organization that succeeded in making their posts be shared by their public (i.e., viral). In EDF tweets, the highest degree keywords were “climate” (degree = 4546), “rt” (degree = 2814), and “biden” (degree = 1723). The top keywords in replies include “environmental” (degree = 840), “health” (degree = 773), and “forest” (degree = 769) (Table 10).
Table 11 showcases the weighted associations between words in EDF tweets and replies that EDF received. Noteworthy associations in tweets include “climate” and “change” (weight = 277), “climate” and “rt” (weight = 168), and “climate” and “action” (weight = 154). In replies, significant associations include “climate” and “change” (weight = 83), “forest” and “burn” (weight = 44), and “environmental” and “health” (weight = 43).
We observed that the tweets from EDF and replies sent to EDF had different themes and frames than others. For example, while EDF associated the issues of climate changes with politics (e.g., “[T]rump administration”, “[P]resident [B]iden” in Table 11), its public focused more on public health issues (e.g., “environmental health”) and forest losses (e.g., “burn[ed] forest” in Table 11) associated with wildfire. Interestingly, EDF widely used “rt” (i.e., retweet) in their posts, possibly to motivate their public to retweet. The use of political frames and call for retweets may likely account for its high virality. See Figure 3 for overview.

5. Discussion

The aim of this exploratory study was to enhance our understanding of public engagement on social media, focusing on the features of two-way communications on social media. In addition to traditional public engagement metrics, we employed sentiment analysis and examined shared meaning with semantic similarity measures in our research. Furthermore, by utilizing SNA, we identified and compared key themes and focal points within climate NGOs’ tweets and the corresponding replies they received. Through our explorations, we discovered several noteworthy findings.
First, we observed that climate NGOs developed unique themes and focuses within their discourses. This highlights the distinct characteristic of science/organizational communication on social media, where organizations can participate in or establish topic-driven communities [34]. Social media allows individuals and organizations to engage in focused discussions on particular topics. To effectively connect with and mobilize like-minded individuals who share climate-related interests, climate NGOs may strategically monitor and select topics and issues to allocate their attention and communication efforts. Our study revealed that strategically selecting topics and discussion foci may encourage specific types of public engagement. For instance, Climate Central, by aligning its topics and foci with those of publics in terms of scientific information about climate change (with aligned sentiments with publics (Table 5)), it maintained shared interests with the committed publics and generated a high level of public commitment. In other words, both organization and the engaged publics aligned their perspectives and sentiments on the issues [71], incorporating their discussed issues (This alignment is facilitated potentially by both inviting certain groups of publics who share interests and knowledge about the issues that the specific NGO advocates for, and by mutually shifting their agendas and frames to reflect each other’s viewpoints). For example, when the organization focused on the ‘extreme temperature’ issue, the committed public shared their knowledge and opinions with the organization as below.
Climate Central: “RT @afreedma: This graph helps explain why heat extremes are becoming so much more common/severe in a warming world. [link redacted]”
A public: “On average, July in Raleigh-Durham is 4 degrees hotter now than it was in the 1970s. (See all locations here: [link redacted]) #ClimateMatters”
Understanding the themes and focuses that resonate with the public may enable climate NGOs to tailor their communication strategies and content effectively, thereby enhancing engagement and mobilization.
This finding highlights the significance of effectively managing organizational discourses while simultaneously monitoring public interests and concerns, considering the specific types of public engagement being targeted. Similar to the GPU in our sample, when attempting to engage a broader audience like publics, it would be advisable to concentrate on uncontested climate change topics such as nature, rather than delving into specific issues like “fossil fuel” that may have been raised by more active segments of publics (See Table 7).
Second, our findings highlight the importance of avoiding a one-size-fits-all strategy focusing solely on increasing public engagement scores, such as likes and retweets, in the research context. Instead, we recommend that climate NGOs tailor their communication strategies based on the specific types of public engagement they are targeting on social media [24]. We found that organizations that succeeded in generating specific types of public engagement on social media did not necessarily succeed in generating other types. For example, Climate Central achieved a high level of commitment but had low virality. This could be attributed to the nature of the topics chosen by Climate Central, which focused on climate sciences and meteorology: topics requiring a high level of science literacy from publics. If Climate Central aimed to engage more informed and active participants in the discourse, the low popularity and virality might be an insignificant concern. Conversely, organizations like GPU, which focused on climate topics generally applicable to the wider public, achieved high popularity but avoided highlighting national or regional political issues (e.g., U.S. presidential election). In contrast, EDF achieved high virality by actively mentioning political figures and associating climate change issues with the responsibility of the government (e.g., Biden action, Biden administration). Although EDF’s approach might have appealed more to the U.S. public than international audiences, it generated intense virality as engaged individuals shared EDF’s messages with like-minded individuals on social media. These examples suggest that organizations need to establish specific objectives regarding the types of public engagement on social media. Accordingly, they should allocate attention and interest to specific issues, as each objective necessitates different communication strategies.
Third, our analysis revealed significant and positive correlations between the weekly sentiment scores of the three organizations, namely GPU, Climate Central, and EDF, and the corresponding sentiment scores of the replies they received. Remarkably, the three organizations demonstrated commendable performance in at least one public engagement metric, such as popularity, commitment, and virality. While the correlations based on weekly sentiment scores may not provide a complete depiction of how organizations align with publics’ interests, they do highlight the importance of organizations focusing on current issues that evoke a range of sentiments [72]. By aligning their interests and attitudes with publics on these issues, climate NGOs may enhance public engagement by leveraging the incorporated attentions and shared sentiment surrounding these topics [42].
Furthermore, the study uncovered counter-intuitive findings. Specifically, the semantic similarity between organizational posts and public replies did not have a positive relationship with public engagement on social media. In other words, when organizations generated higher engagement from publics in terms of popularity, commitment, and virality, the use of similar themes and focuses was either insignificant or low. This might be due to the fact that organizations with more engagement are likely to have more diverse audiences, as their posts are shared not only with like-minded individuals but also individuals with different perspectives and opinions on climate issues. Investigating the network attributes of organizations’ social media communities could confirm these counter-intuitive findings in future studies.
There are several limitations and opportunities for further development in this study. First, to fully understand the implications of specific themes and focuses in generating public engagement, one must delve further into the influence of specific words and frames used in posts or posts within shorter time periods, such as a few days or weeks. Since Twitter imposes a 280-character limit, we had to explore the semantic features of all posts and replies within a one-year period, which may not fully capture the ‘real-time’ dynamics of dialogues between organizations and publics. Second, as a case study, we only investigated a few organizations with successful public engagement generation. To gain a more comprehensive understanding, it is important to explore whether our findings are generally applicable to a wider range of organizations and other contexts. Additionally, to comprehend the implications of specific types of public engagement on social media, it would be beneficial to investigate the network characteristics of an organization’s communities. For example, understanding how posts become viral can be better understood by examining how these posts are shared with individuals outside an organization’s immediate network. By conducting larger-scale investigations and employing additional analytic approaches, we can gain deeper insights into public engagement within this context.

6. Conclusions

In conclusion, our study sheds light on the themes, focuses, and sentiments identified in social media discourses of climate NGOs and their publics, within the framework of public engagement. Recognizing the imperative for climate NGOs to maximize the ‘two-way’ communication capabilities of social media to educate, persuade, captivate, and understand their target audiences concerning climate change issues, we delved into the interactive dynamics of these discourses. Based on our exploration, we advocate for communication strategies that are more oriented toward the public audience’s understanding of and interest in climate issues. This involves:
  • Assessing public perceptions and understanding of climate topics, as exemplified by the challenges faced by Climate Central in making scientific discourses appealing to lay public audiences.
  • Exploring the depth and variety of climate-related issues that captivate publics’ interest, demonstrated by the case of GPU, which focused on broader climate issues.
  • Understanding how different publics associate different issues with climate change, such as the disparate linking of climate change with political and wildfire issues in the communications of EDF and its public audiences.
When these tailored strategies align with each organization’s specific communication objectives and target audiences (e.g., individuals with interests and knowledge in climate science, in the case of Climate Central), they are likely to contribute to more desirable public engagement in climate change discourses. These shifts in strategies from ‘delivering effective messages to the public audiences in order to educate them’ (e.g., the IPCC report) to ‘understanding and representing the interests and issues of the public audiences’ also resonate the call for the shift in first-order thinking to second- and third-order thinking in science communication [73].
Specifically, with the ‘two-way’ approach indicative of second-order thinking, climate NGOs can not only build consensus on climate change issues but also directly address the uncertainties and concerns of publics [73]. This approach aligns with the principles of second-order thinking by prioritizing dialogue, engagement, and building trust through a transparent and accountable communication style.
Furthermore, by embracing the diverse perspectives and agendas of different public audiences, which is a hallmark of third-order thinking, these organizations can situate climate change within a wider cultural, societal, and political context of the publics as in the case of EDF. This approach goes beyond organization-led initiatives, recognizing the importance of heterogeneity and constructive disagreement as valuable societal resources to address climate change issues [73]. This multidimensional perspective will enhance reflexivity and critical analysis in climate communication, which is crucial for addressing ‘wicked problem’ [74] like climate change.
We also acknowledge the additional limitations of our study in terms of application, including the need to explore the influence of specific words and frames within shorter time periods, expand the scope of organizations and contexts studied, and investigate network characteristics for a more comprehensive understanding. Continued research in this area can contribute to a better understanding of public engagement and communication strategies of climate NGOs’ social media presence.
The current study used SNA, following previous studies [75,76], and recognized the limitations of methods like topic modeling in comparing multiple corpora and identifying nuanced themes within a topic [77]. Newly designed methods, such as contrastive topic modeling [77] and qualitative approaches (e.g., Haupt et al. [78]), which address these limitations, may be considered in our future studies.
We conducted sentiment analysis using the Microsoft Azure API (version: 5.2.0), which offers a parsimonious and accessible analytic approach for communication professionals to capture current public sentiments and potential sentiment gaps between the organization’s communication and publics’ responses. We propose that the practitioners may monitor what leads to specific sentiments among public audiences during specific periods, with a more careful review of the original posts and replies from these publics. However, to develop more sophisticated sentiment analysis, practitioners need to consider dictionary-based approaches or develop their own trained models for such analysis to reflect their organization’s specific context.

Author Contributions

Conceptualization, E.K. and N.H.; methodology, E.K. and N.H.; software, E.K.; validation, N.H.; formal analysis, E.K.; investigation, E.K.; data curation, N.H.; writing—original draft preparation, E.K.; writing—review and editing, E.K. and N.H.; visualization, E.K.; supervision, N.H.; project administration, E.K. and N.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was approved by the Institutional Review Board of Indiana University Bloomington (protocol code: 12984).

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy concerns associated with the Twitter dataset.

Acknowledgments

This project was carried out by members of the Mediated Public Engagement with Technology and Science (mPETS) research team, based at Indiana University Bloomington. The authors would like to express their gratitude to Patrick Sullivan for his invaluable editorial assistance. Additionally, the authors acknowledge the support provided by Indiana University (IU) Libraries for covering open access publication charges.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Hautea, S.; Parks, P.; Takahashi, B.; Zeng, J. Showing They Care (Or Don’t): Affective Publics and Ambivalent Climate Activism on TikTok. Soc. Media + Soc. 2021, 7, 205630512110123. [Google Scholar] [CrossRef]
  2. Yu, C.; Margolin, D.B.; Fownes, J.R.; Eiseman, D.L.; Chatrchyan, A.M.; Allred, S.B. Tweeting About Climate: Which Politicians Speak Up and What Do They Speak Up About? Soc. Media + Soc. 2021, 7, 205630512110338. [Google Scholar] [CrossRef]
  3. Eddington, S.M. The Communicative Constitution of Hate Organizations Online: A Semantic Network Analysis of “Make America Great Again”. Soc. Media + Soc. 2018, 4, 205630511879076. [Google Scholar] [CrossRef]
  4. Guo, J.; Chen, H.-T. How Does Political Engagement on Social Media Impact Psychological Well-Being? Examining the Mediating Role of Social Capital and Perceived Social Support. Comput. Hum. Behav. 2022, 133, 107248. [Google Scholar] [CrossRef]
  5. Hara, N.; Abbazio, J.; Perkins, K. An Emerging Form of Public Engagement with Science: Ask Me Anything (AMA) Sessions on Reddit r/Science. PLoS ONE 2019, 14, e0216789. [Google Scholar] [CrossRef]
  6. Wang, L.; Yang, A.; Thorson, K. Serial Participants of Social Media Climate Discussion as a Community of Practice: A Longitudinal Network Analysis. Inf. Commun. Soc. 2021, 24, 941–959. [Google Scholar] [CrossRef]
  7. Dewey, J. Logic-The Theory of Inquiry; Read Books Ltd.: Redditch, UK, 2018; ISBN 1-4474-9672-8. [Google Scholar]
  8. Muldoon, K. On the Role of the Non-Expert in a Crisis. Available online: https://scicomm.plos.org/2020/06/25/on-the-role-of-the-non-expert-in-a-crisis/ (accessed on 1 December 2023).
  9. Plowman, K.D.; Wakefield, R.I.; Winchel, B. Digital Publics: Tracking and Reaching Them. Public Relat. Rev. 2015, 41, 272–277. [Google Scholar] [CrossRef]
  10. Wynne, B. May the Sheep Safely Graze? A Reflexive View of the Expert-Lay Knowledge Divide. Risk Environ. Mod. Towards A New Ecol. 1996, 40, 44. [Google Scholar]
  11. Boulianne, S.; Lalancette, M.; Ilkiw, D. “School Strike 4 Climate”: Social Media and the International Youth Protest on Climate Change. Media Commun. 2020, 8, 208–218. [Google Scholar] [CrossRef]
  12. Knupfer, H.; Neureiter, A.; Matthes, J. From Social Media Diet to Public Riot? Engagement with “Greenfluencers” and Young Social Media Users’ Environmental Activism. Comput. Hum. Behav. 2023, 139, 107527. [Google Scholar] [CrossRef]
  13. Tyson, A.; Kennedy, B.; Funk, C.; Gen, Z. Millennials Stand Out for Climate Change Activism, Social Media Engagement with Issue; Pew Research Center: Washington, DC, USA, 2021. [Google Scholar]
  14. Yang, A.; Taylor, M. From Organizational-Centric Engagement to Network-Centric Engagement: The Role of Autonomous Public Communities in a Mediated Public Policy Advocacy Network. Soc. Media + Soc. 2021, 7, 205630512110382. [Google Scholar] [CrossRef]
  15. United Nations Climate Change. Climate Plans Remain Insufficient: More Ambitious Action Needed Now. Available online: https://unfccc.int/news/climate-plans-remain-insufficient-more-ambitious-action-needed-now (accessed on 1 December 2023).
  16. Harvey, F. Major Climate Changes Inevitable and Irreversible—IPCC’s Starkest Warning Yet. Available online: https://www.theguardian.com/science/2021/aug/09/humans-have-caused-unprecedented-and-irreversible-change-to-climate-scientists-warn (accessed on 1 December 2023).
  17. Intergovernmental Panel on Climate Change. AR6 Climate Change 2021: The Physical Science Basis; The Intergovernmental Panel on Climate Change: Cambridge, UK; New York, NY, USA, 2021. [Google Scholar]
  18. Pearce, W.; Niederer, S.; Özkula, S.M.; Sánchez Querubín, N. The Social Media Life of Climate Change: Platforms, Publics, and Future Imaginaries. Wiley Interdiscip. Rev. Clim. Chang. 2018, 10, e569. [Google Scholar] [CrossRef]
  19. Vu, H.T.; Blomberg, M.; Seo, H.; Liu, Y.; Shayesteh, F.; Do, H.V. Social Media and Environmental Activism: Framing Climate Change on Facebook by Global NGOs. Sci. Commun. 2020, 43, 107554702097164. [Google Scholar] [CrossRef]
  20. Vu, H.T.; Do, H.V.; Seo, H.; Liu, Y. Who Leads the Conversation on Climate Change?: A Study of a Global Network of NGOs on Twitter. Environ. Commun. 2019, 14, 450–464. [Google Scholar] [CrossRef]
  21. Nulman, E.; Özkula, S.M. Environmental Nongovernmental Organizations’ Digital Media Practices toward Environmental Sustainability and Implications for Informational Governance. Curr. Opin. Environ. Sustain. 2016, 18, 10–16. [Google Scholar] [CrossRef]
  22. Kent, M.L.; Taylor, M. Fostering Dialogic Engagement: Toward an Architecture of Social Media for Social Change. Soc. Media + Soc. 2021, 7, 205630512098446. [Google Scholar] [CrossRef]
  23. Haro-de-Rosario, A.; Sáez-Martín, A.; del Carmen Caba-Pérez, M. Using Social Media to Enhance Citizen Engagement with Local Government: Twitter or Facebook? New Media Soc. 2016, 20, 29–49. [Google Scholar] [CrossRef]
  24. Kim, C.; Yang, S.-U. Like, Comment, and Share on Facebook: How Each Behavior Differs from the Other. Public Relat. Rev. 2017, 43, 441–449. [Google Scholar] [CrossRef]
  25. Hopke, J.E.; Hestres, L.E. Visualizing the Paris Climate Talks on Twitter: Media and Climate Stakeholder Visual Social Media During COP21. Soc. Media + Soc. 2018, 4, 205630511878268. [Google Scholar] [CrossRef]
  26. Kovacheva, A.; Wiener, H.J.D.; Kareklas, I.; Muehling, D. Online Engagement with Memes and Comments about Climate Change. Sustainability 2022, 14, 8900. [Google Scholar] [CrossRef]
  27. Dhanesh, G.S. Putting Engagement in Its PRoper Place: State of the Field, Definition and Model of Engagement in Public Relations. Public Relat. Rev. 2017, 43, 925–933. [Google Scholar] [CrossRef]
  28. Lai, D.; Wang, D.; Calvano, J.; Raja, A.S.; He, S. Addressing Immediate Public Coronavirus (COVID-19) Concerns through Social Media: Utilizing Reddit’s AMA as a Framework for Public Engagement with Science. PLoS ONE 2020, 15, e0240326. [Google Scholar] [CrossRef]
  29. Namisango, F.; Kang, K. Organization-Public Relationships on Social Media: The Role of Relationship Strength, Cohesion and Symmetry. Comput. Hum. Behav. 2019, 101, 22–29. [Google Scholar] [CrossRef]
  30. Weingart, P.; Joubert, M.; Connoway, K. Public Engagement with Science—Origins, Motives and Impact in Academic Literature and Science Policy. PLoS ONE 2021, 16, e0254201. [Google Scholar] [CrossRef]
  31. Habibi, S.A.; Salim, L. Static vs. Dynamic Methods of Delivery for Science Communication: A Critical Analysis of User Engagement with Science on Social Media. PLoS ONE 2021, 16, e0248507. [Google Scholar] [CrossRef] [PubMed]
  32. Murphy-Gregory, H. Governance via Persuasion: Environmental NGOs and the Social Licence to Operate. Environ. Politics 2018, 27, 320–340. [Google Scholar] [CrossRef]
  33. Comfort, S.E.; Hester, J.B. Three Dimensions of Social Media Messaging Success by Environmental NGOs. Environ. Commun. 2019, 13, 281–286. [Google Scholar] [CrossRef]
  34. Li, Y.; Shin, J.; Sun, J.; Kim, H.M.; Qu, Y.; Yang, A. Organizational Sensemaking in Tough Times: The Ecology of NGOs’ COVID-19 Issue Discourse Communities on Social Media. Comput. Hum. Behav. 2021, 122, 106838. [Google Scholar] [CrossRef] [PubMed]
  35. Saffer, A.J.; Yang, A.; Morehouse, J.; Qu, Y. It Takes a Village: A Social Network Approach to NGOs’ International Public Engagement. Am. Behav. Sci. 2019, 63, 000276421983526. [Google Scholar] [CrossRef]
  36. Archer, D.; Rahmstorf, S. The Climate Crisis: An Introductory Guide to Climate Change; Cambridge University Press: Cambridge, UK, 2012; ISBN 978-0-521-40744-1. [Google Scholar]
  37. Marlon, J.; Neyens, L.; Jefferson, M.; Howe, P.; Mildenberger, M.; Leiserowitz, A. Yale Climate Opinion Maps 2019—Yale Program on Climate Change Communication. Available online: https://climatecommunication.yale.edu/visualizations-data/ycom-us/ (accessed on 23 December 2023).
  38. Asproudis, E.; Weyman-Jones, T. How the ENGOs Can Fight the Industrial/Business Lobby with Their Tools from Their Own Field? ENGOs Participation in Emissions Trading Market. Sustainability 2020, 12, 8553. [Google Scholar] [CrossRef]
  39. Taylor, M.; Kent, M.L. Dialogic Engagement: Clarifying Foundational Concepts. J. Public Relat. Res. 2014, 26, 384–398. [Google Scholar] [CrossRef]
  40. Cann, T.; Dennes, B.; Coan, T.; O’Neill, S.; Hywel, W. Using Semantic Similarity and Text Embedding to Measure the Social Media Echo of Strategic Communications. arXiv 2023. [Google Scholar] [CrossRef]
  41. Salathé, M.; Khandelwal, S. Assessing Vaccination Sentiments with Online Social Media: Implications for Infectious Disease Dynamics and Control. PLoS Comput. Biol. 2011, 7, e1002199. [Google Scholar] [CrossRef] [PubMed]
  42. Misiejuk, K.; Scianna, J.; Kaliisa, R.; Vachuska, K.; Shaffer, D.W. Incorporating Sentiment Analysis with Epistemic Network Analysis to Enhance Discourse Analysis of Twitter Data. In Communications in Computer and Information Science; Springer: Berlin/Heidelberg, Germany, 2021; pp. 375–389. [Google Scholar] [CrossRef]
  43. Bonsón, E.; Ratkai, M. A Set of Metrics to Assess Stakeholder Engagement and Social Legitimacy on a Corporate Facebook Page. Online Inf. Rev. 2013, 37, 787–803. [Google Scholar] [CrossRef]
  44. Liu, W.; Xu (Wayne), W.; Tsai (Jenny), J.-Y. Developing a Multi-Level Organization-Public Dialogic Communication Framework to Assess Social Media-Mediated Disaster Communication and Engagement Outcomes. Public Relat. Rev. 2020, 46, 101949. [Google Scholar] [CrossRef] [PubMed]
  45. Martinez-Gil, J. An Overview of Textual Semantic Similarity Measures Based on Web Intelligence. Artif. Intell. Rev. 2012, 42, 935–943. [Google Scholar] [CrossRef]
  46. San Segundo, E.; Tsanas, A.; Gómez-Vilda, P. Euclidean Distances as Measures of Speaker Similarity Including Identical Twin Pairs: A Forensic Investigation Using Source and Filter Voice Characteristics. Forensic Sci. Int. 2017, 270, 25–38. [Google Scholar] [CrossRef]
  47. Eminagaoglu, M. A New Similarity Measure for Vector Space Models in Text Classification and Information Retrieval. J. Inf. Sci. 2020, 48, 016555152096805. [Google Scholar] [CrossRef]
  48. Hao, J.; Shu, Z. Analyzing Process Data from Game/Scenario-Based Tasks: An Edit Distance Approach. J. Educ. Data Min. 2015, 7, 33–50. [Google Scholar] [CrossRef]
  49. Featherstone, J.D.; Ruiz, J.B.; Barnett, G.A.; Millam, B.J. Exploring Childhood Vaccination Themes and Public Opinions on Twitter: A Semantic Network Analysis. Telemat. Inform. 2020, 54, 101474. [Google Scholar] [CrossRef]
  50. Liu, W.; Lai, C.-H.; Xu (Wayne), W. Tweeting about Emergency: A Semantic Network Analysis of Government Organizations’ Social Media Messaging during Hurricane Harvey. Public Relat. Rev. 2018, 44, 807–819. [Google Scholar] [CrossRef]
  51. Xiong, Y.; Cho, M.; Boatwright, B. Hashtag Activism and Message Frames among Social Movement Organizations: Semantic Network Analysis and Thematic Analysis of Twitter during the #MeToo Movement. Public Relat. Rev. 2019, 45, 10–23. [Google Scholar] [CrossRef]
  52. Lee, J.; Lee, J.; Lee, C.; Kim, Y. Identifying ESG Trends of International Container Shipping Companies Using Semantic Network Analysis and Multiple Case Theory. Sustainability 2023, 15, 9441. [Google Scholar] [CrossRef]
  53. Himelboim, I.; Golan, G.J.; Moon, B.B.; Suto, R.J. A Social Networks Approach to Public Relations on Twitter: Social Mediators and Mediated Public Relations. J. Public Relat. Res. 2014, 26, 359–379. [Google Scholar] [CrossRef]
  54. Lee, N.M.; Abitbol, A.; VanDyke, M.S. Science Communication Meets Consumer Relations: An Analysis of Twitter Use by 23andMe. Sci. Commun. 2020, 42, 244–264. [Google Scholar] [CrossRef]
  55. Su, L.Y.-F.; Scheufele, D.A.; Bell, L.; Brossard, D.; Xenos, M.A. Information-Sharing and Community-Building: Exploring the Use of Twitter in Science Public Relations. Sci. Commun. 2017, 39, 569–597. [Google Scholar] [CrossRef]
  56. Newburger, E. Fires in the Arctic, Record Sea Levels: NOAA Report Details Effects of Climate Change in 2020. Available online: https://www.cnbc.com/2021/08/26/noaa-2020-climate-change-report-record-sea-levels-greenhouse-gases.html (accessed on 1 January 2021).
  57. ExportComments.com. Export Facebook, Instagram, Twitter, YouTube, TikTok, Vimeo Comments to CSV/Excel. Available online: https://exportcomments.com/ (accessed on 1 December 2023).
  58. Climate Store Non-Profit Organizations Working on Climate Change | ClimateStore. Available online: https://climatestore.com/take-action/get-involved/non-profit-organizations-working-on-climate-change (accessed on 1 November 2023).
  59. Honnibal, M.; Montani, I. spaCy 2: Natural language understanding with Bloom embeddings, convolutional neural networks and incremental parsing. Appear. 2017, 7, 411–420. [Google Scholar]
  60. Loria, S. textblob Documentation. Release 0.15 2018, 2, 269. [Google Scholar]
  61. Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V. Scikit-Learn: Machine Learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
  62. Virtanen, P.; Gommers, R.; Oliphant, T.E.; Haberland, M.; Reddy, T.; Cournapeau, D.; Burovski, E.; Peterson, P.; Weckesser, W.; Bright, J.; et al. SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python. Nat. Methods 2020, 17, 261–272. [Google Scholar] [CrossRef]
  63. What Is Sentiment Analysis and Opinion Mining in Azure Cognitive Service for Language?—Azure Cognitive Services. Available online: https://learn.microsoft.com/en-us/azure/cognitive-services/language-service/sentiment-opinion-mining/overview?tabs=version-3-1 (accessed on 1 January 2023).
  64. Kim, E.J.; Kim, J.Y. Exploring the Online News Trends of the Metaverse in South Korea: A Data-Mining-Driven Semantic Network Analysis. Sustainability 2023, 15, 16279. [Google Scholar] [CrossRef]
  65. Wang, B.; Park, S.D.; Lee, J.Y.; Campbell, J.W. Smart, Sustainable and Citizen Centered: A Network Analysis of Urban R&D Trends in Seoul, South Korea. Sustainability 2020, 12, 5933. [Google Scholar] [CrossRef]
  66. Segev, E. neTxt: Text and Network Analysis Tools. Available online: http://www.netxt.xyz (accessed on 1 January 2023).
  67. Segev, E. How to Conduct Semantic Network Analysis. In Semantic Network Analysis in Social Sciences; Routledge: London, UK, 2021; pp. 16–31. [Google Scholar]
  68. Bastian, M.; Heymann, S.; Jacomy, M. Gephi: An Open Source Software for Exploring and Manipulating Networks. In Proceedings of the International AAAI Conference on Web and Social Media, San Jose, CA, USA, 17–20 May 2009; Volume 3, pp. 361–362. [Google Scholar]
  69. Luo, C.; Chen, A.; Cui, B.; Liao, W. Exploring public perceptions of the COVID-19 vaccine online from a cultural perspective: Semantic network analysis of two social media platforms in the United States and China. Telemat. Informatics 2021, 65, 101712. [Google Scholar] [CrossRef]
  70. Calabrese, C.; Anderton, B.N.; Barnett, G.A. Online Representations of “Genome Editing” Uncover Opportunities for Encouraging Engagement: A Semantic Network Analysis. Sci. Commun. 2019, 41, 222–242. [Google Scholar] [CrossRef]
  71. Thomas, E.F.; McGarty, C.; Mavor, K.I. Aligning Identities, Emotions, and Beliefs to Create Commitment to Sustainable Social and Political Action. Personal. Soc. Psychol. Rev. 2009, 13, 194–218. [Google Scholar] [CrossRef] [PubMed]
  72. Jin, Y.; Liu, B.F.; Austin, L.L. Examining the Role of Social Media in Effective Crisis Management. Commun. Res. 2011, 41, 74–94. [Google Scholar] [CrossRef]
  73. Irwin, A. Risk, Science and Public Communication: Third-Order Thinking about Scientific Culture. In Routledge Handbook of Public Communication of Science and Technology; Routledge: London, UK, 2021; pp. 147–162. [Google Scholar]
  74. Rittel, H.W.; Webber, M.M. Dilemmas in a General Theory of Planning. Policy Sci. 1973, 4, 155–169. [Google Scholar] [CrossRef]
  75. Segev, E. Textual Network Analysis: Detecting Prevailing Themes and Biases in International News and Social Media. Sociol. Compass 2020, 14, e12779. [Google Scholar] [CrossRef]
  76. Yun, E.; Park, Y. Extraction of Scientific Semantic Networks from Science Textbooks and Comparison with Science Teachers’ Spoken Language by Text Network Analysis. Int. J. Sci. Educ. 2018, 40, 2118–2136. [Google Scholar] [CrossRef]
  77. Le, T.; Akoglu, L. ContraVis: Contrastive and Visual Topic Modeling for Comparing Document Collections. In Proceedings of the WWW ’19: The World Wide Web Conference, San Francisco, CA, USA, 13–17 May 2019; pp. 928–938. [Google Scholar]
  78. Haupt, M.R.; Chiu, M.; Chang, J.; Li, Z.; Cuomo, R.; Mackey, T.K. Detecting Nuance in Conspiracy Discourse: Advancing Methods in Infodemiology and Communication Science with Machine Learning and Qualitative Content Coding. PLoS ONE 2023, 18, e0295414. [Google Scholar] [CrossRef] [PubMed]
Figure 1. (a) Visualization of the Semantic Network Map of Top Words in ‘Tweets from GPU’; (b) Visualization of the Semantic Network Map of Top Words in ‘Replies Sent to GPU’. (The different colors correspond to the various modularity classes within the semantic network. The size of each term (i.e., node) indicates its comparative frequency within the corpus. The lines connecting the terms represent their co-occurrence (i.e., ties) in specific posts. The thickness (i.e., width) of each line denotes the tie strength (or weight), reflecting the frequency of co-occurrence between the connected terms. The concept of ‘closeness’ between two terms is reflected by their distance, suggesting that a shorter distance between terms indicates they are more frequently used together within the corpus and share similar themes, often belonging to the same cluster [67]. While ‘Tweets from GPU’ represent broad and general keywords such as ‘nature’, ‘world’, ‘planet’, and ‘conservation’, ‘Replies to GPU’ correspond to groups of cohesive keywords relevant to public health issues (e.g., ‘public’, ‘health’, ‘communities’, ‘help’) and fossil fuel issues (e.g., ‘fossil’, ‘oil’, ‘gas’, and ‘industry’).).
Figure 1. (a) Visualization of the Semantic Network Map of Top Words in ‘Tweets from GPU’; (b) Visualization of the Semantic Network Map of Top Words in ‘Replies Sent to GPU’. (The different colors correspond to the various modularity classes within the semantic network. The size of each term (i.e., node) indicates its comparative frequency within the corpus. The lines connecting the terms represent their co-occurrence (i.e., ties) in specific posts. The thickness (i.e., width) of each line denotes the tie strength (or weight), reflecting the frequency of co-occurrence between the connected terms. The concept of ‘closeness’ between two terms is reflected by their distance, suggesting that a shorter distance between terms indicates they are more frequently used together within the corpus and share similar themes, often belonging to the same cluster [67]. While ‘Tweets from GPU’ represent broad and general keywords such as ‘nature’, ‘world’, ‘planet’, and ‘conservation’, ‘Replies to GPU’ correspond to groups of cohesive keywords relevant to public health issues (e.g., ‘public’, ‘health’, ‘communities’, ‘help’) and fossil fuel issues (e.g., ‘fossil’, ‘oil’, ‘gas’, and ‘industry’).).
Sustainability 16 01438 g001
Figure 2. (a) Visualization of the Semantic Network Map of Top Words in ‘Tweets from Climate Central’; (b) Visualization of the Semantic Network Map of Top Words in ‘Replies Sent to Climate Central’. (The different colors correspond to the various modularity classes within the semantic network. The size of each term (i.e., node) indicates its comparative frequency within the corpus. The lines connecting the terms represent their co-occurrence (i.e., ties) in specific posts. The thickness (i.e., width) of each line denotes the tie strength (or weight), reflecting the frequency of co-occurrence between the connected terms. The concept of ‘closeness’ between two terms is reflected by their distance, suggesting that a shorter distance between terms indicates they are more frequently used together within the corpus and share similar themes, often belonging to the same cluster [67]. Both ‘Tweets from Climate Central’ and ‘Replies to Climate Central’ feature keywords relevant to global warming and ocean-related issues, with specific terms such as ‘sea’, ‘level’, and ‘rise’. In the case of ‘Replies to Climate Central’, the term ‘quote’ was frequently used, as indicated by its comparatively large size.).
Figure 2. (a) Visualization of the Semantic Network Map of Top Words in ‘Tweets from Climate Central’; (b) Visualization of the Semantic Network Map of Top Words in ‘Replies Sent to Climate Central’. (The different colors correspond to the various modularity classes within the semantic network. The size of each term (i.e., node) indicates its comparative frequency within the corpus. The lines connecting the terms represent their co-occurrence (i.e., ties) in specific posts. The thickness (i.e., width) of each line denotes the tie strength (or weight), reflecting the frequency of co-occurrence between the connected terms. The concept of ‘closeness’ between two terms is reflected by their distance, suggesting that a shorter distance between terms indicates they are more frequently used together within the corpus and share similar themes, often belonging to the same cluster [67]. Both ‘Tweets from Climate Central’ and ‘Replies to Climate Central’ feature keywords relevant to global warming and ocean-related issues, with specific terms such as ‘sea’, ‘level’, and ‘rise’. In the case of ‘Replies to Climate Central’, the term ‘quote’ was frequently used, as indicated by its comparatively large size.).
Sustainability 16 01438 g002
Figure 3. (a) Visualization of the Semantic Network Map of Top Words in ‘Tweets from EDF’; (b) Visualization of the Semantic Network Map of Top Words in ‘Replies Sent to EDF’. (The different colors correspond to the various modularity classes within the semantic network. The size of each term (i.e., node) indicates its comparative frequency within the corpus. The lines connecting the terms represent their co-occurrence (i.e., ties) in specific posts. The thickness (i.e., width) of each line denotes the tie strength (or weight), reflecting the frequency of co-occurrence between the connected terms. The concept of ‘closeness’ between two terms is reflected by their distance, suggesting that a shorter distance between terms indicates they are more frequently used together within the corpus and share similar themes, often belonging to the same cluster [67]. Key differences between the discourses of ‘Tweets from EDF’ and ‘Replies to EDF’ lie in distinct key topics. ‘Tweets from EDF’ address political issues, featuring terms like ‘trump’, ‘biden’, ‘administration’, and ‘president-elect.’ In contrast, ‘Replies to EDF’ focus on wildfire issues, with terms such as ‘forest’, ‘burn’, ‘area’, and ‘damage.’).
Figure 3. (a) Visualization of the Semantic Network Map of Top Words in ‘Tweets from EDF’; (b) Visualization of the Semantic Network Map of Top Words in ‘Replies Sent to EDF’. (The different colors correspond to the various modularity classes within the semantic network. The size of each term (i.e., node) indicates its comparative frequency within the corpus. The lines connecting the terms represent their co-occurrence (i.e., ties) in specific posts. The thickness (i.e., width) of each line denotes the tie strength (or weight), reflecting the frequency of co-occurrence between the connected terms. The concept of ‘closeness’ between two terms is reflected by their distance, suggesting that a shorter distance between terms indicates they are more frequently used together within the corpus and share similar themes, often belonging to the same cluster [67]. Key differences between the discourses of ‘Tweets from EDF’ and ‘Replies to EDF’ lie in distinct key topics. ‘Tweets from EDF’ address political issues, featuring terms like ‘trump’, ‘biden’, ‘administration’, and ‘president-elect.’ In contrast, ‘Replies to EDF’ focus on wildfire issues, with terms such as ‘forest’, ‘burn’, ‘area’, and ‘damage.’).
Sustainability 16 01438 g003
Table 1. Public Engagement Measures (Adopted from Bonsón and Ratkai [43]).
Table 1. Public Engagement Measures (Adopted from Bonsón and Ratkai [43]).
Name FormulaMeasures
PopularityNumber of posts with likes/
total posts
Percentage of the total posts that have been liked
CommitmentNumber of posts with comments/
total posts
Percentage of the total posts that have been commented on
ViralityNumber of posts with shares/
total posts
Percentage of the total posts that have been shared
Table 2. Brief Information about the 10 Climate Change NGO Twitter Accounts in this Research.
Table 2. Brief Information about the 10 Climate Change NGO Twitter Accounts in this Research.
Avg. # of
Likes (Favorates)
Avg. # of
RTs
# of
Followers *
# of Total Post **# of Total
Replies ***
1. CCL 30.3022.1841,08015071338
2. Earthjustice 60.54249.12196,98925563408
3. Greenpeace USA61.62188.23213,16527335058
4. EDF15.68325.57207,21027761757
5. Nature Conservancy58.6124.48990,55021633285
6. RAN10.8724.3894,7141816633
7. Wilderness24.08102.61102,3171973878
8. Saving Oceans15.2322.70108,613936250
9. Skoll Foundation5.7933.80445,7471802336
10. Climate Central10.0610.47132,4277291519
Total 2,532,81218,99118,462
1 = Citizens’ Climate Lobby (CCL) (@citizensclimate); 2 = @Earthjustice; 3 = @greenpeaceusa; 4 = Environmental Defense Fund (EDF) (@EnvDefenseFund); 5 = The Nature Conservancy (@nature_org); 6 = Rainforest Action Network (RAN) (@RAN); 7 = The Wilderness Society (@Wilderness); 8 = savingoceans (@savingoceans); 9 = @SkollFoundation; 10 = @ClimateCentral. * The number of followers as of 15 October 2021. ** The number of posts sampled in the research period. *** The number of replies to the organization in the research period.
Table 3. Public Engagement Scores for Each NGO’s Twitter Accounts and their Semantic Similarity Scores with Publics’ Replies.
Table 3. Public Engagement Scores for Each NGO’s Twitter Accounts and their Semantic Similarity Scores with Publics’ Replies.
Popularity CommitmentViralityEuclideanLevenshtein
1. CCL 30.30.8922.18983.11174,258
2. Earthjustice 60.541.33249.121583.78357,155
3. Greenpeace USA61.621.85188.231326.76252,773
4. EDF15.680.63325.571583.77256,464
5. Nature Conservancy58.611.5224.481436.28331,862
6. RAN10.870.3524.38957.85159,422
7. Wilderness24.080.45102.61959.66182,587
8. Saving Oceans15.230.2722.7554.3486,867
9. Skoll Foundation5.790.1933.81054.25188,157
10. Climate Central10.062.0810.47506.5975,228
1 = Citizens’ Climate Lobby (CCL) (@citizensclimate); 2 = @Earthjustice; 3 = @greenpeaceusa; 4 = Environmental Defense Fund (EDF) (@EnvDefenseFund); 5 = The Nature Conservancy (@nature_org); 6 = Rainforest Action Network (RAN) (@RAN); 7 = The Wilderness Society (@Wilderness); 8 = savingoceans (@savingoceans); 9 = @SkollFoundation; 10 = @ClimateCentral.
Table 4. Correlations between Engagement Measures and Semantic Similarity Measures.
Table 4. Correlations between Engagement Measures and Semantic Similarity Measures.
Popularity CommitmentViralityEuclidean DistanceLevenshtein Distance
PopularityPearson Correlation10.5800.3420.5830.760 *
Sig. (2-tailed) 0.0790.3330.0770.011
CommitmentPearson Correlation 10.1030.4620.530
Sig. (2-tailed) 0.7780.1790.115
ViralityPearson Correlation 10.729 *0.552
Sig. (2-tailed) 0.0170.098
Euclidean DistancePearson Correlation 10.931 **
Sig. (2-tailed) <0.001
Levenshtein DistancePearson Correlation 1
Sig. (2-tailed)
Note: * Correlation is significant at the 0.05 level (2-tailed). ** Correlation is significant at the 0.01 level (2-tailed).
Table 5. Pearson’s Correlations of Weekly Sentiment Scores between Posts from Organizations and Replies Sent to the Organizations.
Table 5. Pearson’s Correlations of Weekly Sentiment Scores between Posts from Organizations and Replies Sent to the Organizations.
Pearson Sig. (2-Tailed)
1: Citizens’ Climate Lobby −0.2120.132
2: Earthjustice −0.0290.836
3: GPU 0.3220.019
4: EDF 0.3200.019
5: The Nature Conservancy −0.1140.417
6: RAN0.0030.984
7: The Wilderness Society0.2430.080
8: Saving Oceans0.1370.342
9: Skoll Foundation−0.0350.808
10: Climate Central0.3890.004
Note: Pairwise dropped.
Table 6. Top Key Words by Degree of Tweets from GPU and Replies Sent to GPU.
Table 6. Top Key Words by Degree of Tweets from GPU and Replies Sent to GPU.
Tweets from GPU Replies Sent to GPU
Word Degree Eigenvector RankWordDegreeEigenvector
nature18970.3761climate6580.337
new12020.2482fossil5850.412
climate9950.2253fuel4750.378
world8400.1844people4530.191
food7810.1645oil4100.213
person7670.1786now3430.171
tnc6810.1447change3220.222
protect6690.1498need3220.146
change6560.1619new2890.171
planet6050.12610must2820.165
conservation6040.11911stop2670.151
future5980.13112health2480.153
global5810.12913action2400.149
way5620.12514public2350.145
land5570.12815take2260.135
one5500.11316no2200.109
year5430.13017gas2170.135
water5230.11718one2170.094
help5170.11619industry2100.171
time5020.10220biden2090.133
Note: Degree: The number of connections that a word (i.e., node) has to other words within the network. The degree of a word reflects the strength of its relationships with other words. Eigenvector (centrality): Eigenvector centrality indicates importance or centrality within a network reflecting both the number of connections a word (i.e., node) has and the importance of those connections.
Table 7. Top Associations of Word by Weight of Tweets from GPU and Replies Sent to GPU.
Table 7. Top Associations of Word by Weight of Tweets from GPU and Replies Sent to GPU.
Tweet from GPU Tweets Sent from GPU
Source Target WeightRankSourceTargetWeight
climatechange681fossilfuel154
natureperson562climatechange113
naturenew523oilgas56
natureclimate444publichealth47
natureyear415takeaction40
natureworld406fossilindustry36
foodsystem367fuelindustry35
newreport348tweet@firedrillfriday34
naturetnc329oilnew31
natureway3110climateaction30
natureprotect3111newgreen29
naturefuture3012oilbig24
newshow2813needget24
naturelearn2714helpplease24
naturehealth2715climatemust24
naturechange2716climatenew24
naturetake2617noone23
naturespeak2618neednow23
natureconservancy2519communitieshealth23
newclimate2520climatefossil23
natureneed2521oilindustry22
energyclean2522peoplepower21
natureglobal2323nowmust21
natureforest2324fossilstop20
climatewater2325fossilmust20
newworld2326climatepeople19
tncjoin2327planetearth19
natureknow2328@janefonda@firedrillfriday19
naturehelp2229fossilhealth19
nature@jenmorrisnature2230peopleact19
Note: Each ‘weight’ value represents the frequency of the word pairs presented in individual tweets.
Table 8. Top Key Words by Degree of Tweets from Climate Central and Replies Sent to Climate Central.
Table 8. Top Key Words by Degree of Tweets from Climate Central and Replies Sent to Climate Central.
Tweets from Climate Central Replies Sent to Climate Central
Node Degree Eigenvector RankNodeDegreeEigenvector
climate11120.3801quote11920.380
temperature6540.2342climate11650.434
change6460.2653change7190.340
year5460.1944temperature5360.177
warming5040.1775year4910.156
day4890.1776@climatecentral4450.153
new4040.1577warming4220.160
risk4030.1458level3770.129
sea3970.1489sea3470.126
today3940.15310day3430.108
average3880.14511average3390.116
level3860.14712coastal3190.106
weather3740.14313heat3140.104
season3630.13514rise3010.109
coastal3310.12115flooding2920.099
city3120.11916new2770.106
number3060.12017impact2760.120
heat3000.10418weather2750.118
flooding2800.10019#climatecentral2730.096
record2640.10020#climatematters2730.092
Table 9. Top Associations of Word by Weight of Tweets from Climate Central and Replies Sent to Climate Central.
Table 9. Top Associations of Word by Weight of Tweets from Climate Central and Replies Sent to Climate Central.
Tweets from Climate Central Replies Sent to Climate Central
Source Target Weight RankSourceTargetWeight
climatechange611climatechange120
climatetemperature272climatequote64
temperatureaverage273levelsea39
climatewarming244temperatureaverage35
sealevel245quotechange35
climatetoday226levelrise34
climatenew227searise34
climateyear218climatecentral32
climateweather219quotetemperature31
searise2110quoteyear29
climateday1911@climatecentralclimate28
levelrise1912@climatecentral#climatecentral28
climatecentral1813climateimpact26
climateseason1814quotewarming26
yearday1815climatewarming26
housingaffordable1816climateweather25
climateaverage1517coastalflooding24
temperaturechange1518quotesea21
climaterisk1519affordablehousing21
climateimpact1520quoteseason20
temperatureday1421quotelevel20
coastalflooding1422climatetoday20
warmingtrend1423quotecoastal20
climatenumber1424climatescience20
climatecity1325climatechanging19
climatechanging1326changeimpact19
climatelevel1327quoteweather19
temperatureyear1228@climatecentralchange19
daytoday1229quoterisk18
temperaturecity1230quoteaverage17
Table 10. Top Key Words by Degree of Tweets from EDF and Replies Sent to EDF.
Table 10. Top Key Words by Degree of Tweets from EDF and Replies Sent to EDF.
Tweets from EDF Replies Sent to EDF
Node DegreeEigenvectorRankNodeDegreeEigenvector
climate45460.4921environmental8400.243
rt28140.3192health7730.240
biden17230.2363forest7690.244
change16850.2774@envdefensefund7670.035
new15090.1935burn7230.241
action12250.1916public7180.238
administration11730.1607area7180.237
pollution10800.1358damage7160.237
@fredkrupp10090.1429force6990.235
need9520.12010hectare6980.241
make9190.12611leave6960.235
clean9160.10112deliberately6870.239
trump8860.11513dangerous6840.236
air7900.09414wreck6790.235
president7700.11615consequence6740.234
methane7410.08416armed6730.234
energy7310.08817stability6690.234
environmental7270.08818azerbaijani6550.229
year7230.09819climate5810.010
emission6670.08520@nrdc5610.193
Table 11. Top Associations of Word by Weight of Tweets from EDF and Replies Sent to EDF.
Table 11. Top Associations of Word by Weight of Tweets from EDF and Replies Sent to EDF.
Tweets from EDF Replies Sent to EDF
Source TargetWeightRankSourceTargetWeight
climatechange2771climatechange83
climatert1682forestburn44
climateaction1543environmentalhealth43
climatebiden1494foresthectare43
rt@fredkrupp1255healthpublic43
administrationtrump1116forestarea42
climatenew997foresthealth41
bidenpresident838forestdamage41
rtnew819environmentalforest41
climatepollution8110environmentaldamage41
pollutionair7911environmentalpublic41
climateneed7512forestdeliberately41
climateadministration7513environmentalburn41
climatebold7314damagehectare41
bidenjoe7115areahectare41
bidenadministration7116burnhectare41
climatefight7117burndeliberately41
climatemake6818hectaredeliberately41
cleanenergy6519forestpublic40
climatepresident6420healthburn40
rtchange6321healthconsequence40
climateyear6022healthdeliberately40
bidenpresident-elect5623damagearea40
climate@fredkrupp5424damageforce40
rtbiden5225environmentalleave40
climatecrisis5226areaburn40
climateemission5127forestforce40
bidenaction4728publicburn40
rtaction4629publichectare40
publichectare2930publicdeliberately40
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Kim, E.; Hara, N. Identifying Different Semantic Features of Public Engagement with Climate Change NGOs Using Semantic Network Analysis. Sustainability 2024, 16, 1438. https://doi.org/10.3390/su16041438

AMA Style

Kim E, Hara N. Identifying Different Semantic Features of Public Engagement with Climate Change NGOs Using Semantic Network Analysis. Sustainability. 2024; 16(4):1438. https://doi.org/10.3390/su16041438

Chicago/Turabian Style

Kim, Eugene, and Noriko Hara. 2024. "Identifying Different Semantic Features of Public Engagement with Climate Change NGOs Using Semantic Network Analysis" Sustainability 16, no. 4: 1438. https://doi.org/10.3390/su16041438

APA Style

Kim, E., & Hara, N. (2024). Identifying Different Semantic Features of Public Engagement with Climate Change NGOs Using Semantic Network Analysis. Sustainability, 16(4), 1438. https://doi.org/10.3390/su16041438

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop