3.1. A Quantitative and Uneven Boom of AI Coverage After ChatGPT
The largest numbers of news headlines related to AI appeared in the two national English-language dailies,
The Guardian and
The New York Times. The two Spanish newspapers came next, followed by the two German newspapers. The French appeared in the bottom half, as shown in
Table 3. The corpus indicated that the emergence of ChatGPT at the end of November 2022 dramatically increased the number of articles in the analyzed media by more than five times (5.16), from 273 in the six months prior to the appearance of the popular model to 1409 in the six months after.
However, there are important differences between the various news outlets. The moderate variation for Frankfurter Allgemeine Zeitung (2.33) and La Voz de Galicia (1.97) is remarkable, in both cases because their AI coverage was already high before the turning point in November 2022. The opposite was seen for the regional Münchner Merkur (37.6), Manchester Evening News (27), and San Francisco Chronicle (10.70), suggesting that they rode the wave of a popular issue that they had not been covering in depth before. The other national media maintained a rate close to the average, ranging from 4.93 (The Guardian) to 10.69 (The New York Times). The increase was also more stable and closer to the average when we grouped national (5.42) and regional (4.73) newspapers.
The monthly count also showed that the growth was continuous. From November onwards, each month exceeded the previous one in terms of the number of articles. The May figure (446) was ten times that for November (44), and a drastic increase occurred in all countries (
Figure 1).
The drastic increase in stories about AI after ChatGPT is not surprising. However, the fact that it occurred differently in the various newspapers studied seems to be relevant to this study. It is to be expected that the newspapers that suddenly increased their coverage on AI offered less balanced and nuanced stories than those that had been following the topic since before the launch of the popular chatbot, a hypothesis that is confirmed in the following sections.
3.2. Less Positive Coverage After ChatGPT
Before diving into the results of our AI anxiety index to answer our research question, it is worth following the strategy of previous studies and examining the evolution of sentiment towards AI in our corpus. Two major trends emerged. The first is a clear dominance of positive versus negative headlines, both before and after the launch of ChatGPT. This confirms the results of previous studies mentioned in the
Section 1.1. Second, the proportion of headlines with negative emotion increased after the launch of ChatGPT.
Figure 2 shows these trends according to the sentiment analysis conducted with the Hugging Face model.
These results were confirmed by a sentiment analysis of headlines with the Sentiment Analysis and Cognition Engine (SEANCE,
Crossley et al. 2017). This open-source tool for text processing uses predefined word vectors from several source databases (including EmoLex and VADER). The comparison between headlines before and after ChatGPT (
Table 4) showed that the hype unleashed by the chatbot not only made the media coverage less positive and more negative but also incremented feelings such as anger, anticipation, disgust, sadness, and surprise, while it reduced others such as joy and trust.
These results anticipate the major trends in our AI anxiety index presented in the next section. However, automated sentiment analysis presents limited reliability for this type of study, particularly when part of the emotion of each headline requires cultural context for its interpretation. Is the headline “Artificial intelligence to detect breast cancer in the poorest women” (El País, 2 October 2022) conveying a positive or negative emotion? What about “Generative A.I. Is Here. Who Should Control It?” (The New York Times, 21 October 2022)? The answer is ambiguous for a human, let alone a machine learning model. This is precisely the reason why it makes sense to measure “anxiety” instead of “sentiment”.
3.3. More “AI Anxiety” After ChatGPT, but Only in Regional News Outlets
Answering our RQ1, the index created for this study shows that the level of AI anxiety measured over one year increased by 10.59% after the launch of ChatGPT in the overall figure for all the newspapers studied (
Table 5).
Three English-speaking newspapers lead the classification with a higher level of AI anxiety over the analyzed period, Manchester Evening News, The Guardian, and The New York Times, suggesting more sensationalist and hyped coverage in these countries. News outlets from the other three countries occupy the last spots in the table: Frankfurter Allgemeine Zeitung, Le Monde, and La Voz de Galicia.
The most striking finding is the uneven distribution of the general trend. While in the five national newspapers as a whole, the anxiety index fell by −6.82%, in the regional ones, it shot up by 61.41%. This pattern applies to all media in each group, with a single exception: an increase for El País (12.94%).
Figure 3 shows this development month by month and grouped by type of outlet. The index remained quite stable for national outlets, with regular fluctuations that look like clickbait cycles of topics discovered, exploited, and soon forgotten. Regional media showed lower AI anxiety than national media with similar curves until the end of November, when ChatGPT was presented and this parallel development abruptly changed; while the index tended to stabilize in national outlets after this date, the regionals presented sharper and continuous growth until they surpassed national media in February. Overall, the trend in AI anxiety over the year moved slightly downwards in the group of five national outlets and upwards for the five regional outlets. Both started to decline in March.
Turning to the main factors behind these general trends (RQ2), a number of qualitative observations are worth highlighting. While all the AI anxiety variables increased in the regional media after the launch of ChatGPT, the opposite occurred among national media, where six out of nine fell and only three increased (
Table 6). The level of anxiety among regional outlets is mainly due to indicators of AI agency, anthropomorphism, and negative topics. A decrease in the number of concrete entities mentioned is also an important feature for regional media, as it reveals how often they connect AI stories to local reality and protagonists by including their names in headlines. On the other hand, among national outlets, the group of anxiety components that increased is primarily linked to clickbait features, such as greater use of pronouns, better readability scores (texts that are easier to understand), and the use of the future tense and uncertainty references.
More importantly, there is some correlation between a steeper increase in AI coverage after the launch of ChatGPT (
Table 3) and a larger increase in the anxiety index (
Table 5). The three newspapers that increased their production the most (
Münchner Merkur, Manchester Evening News, and
San Francisco Chronicle) also showed significant gains in the index (19.48%, 16.17%, and 49.53%, respectively). On the opposite side, smaller changes in the coverage of
Le Monde, The Guardian, and
Frankfurter Allgemeine Zeitung are associated with a decrease in the anxiety index (−9.10%, −6.23%, and −19.66%). An exception to this trend is
La Voz de Galicia, where an insignificant increase in AI coverage after ChatGPT contrasts with a surge of 59.41% in the anxiety index, probably because this newspaper started from the lowest pre-ChatGPT level and any change represents a higher percentage.
Finally, there is a certain consistency across the variables. The newspapers at the top of
Table 7 show a higher degree of anxiety (more orange) in most values, with only a few relevant exceptions. The most important is the NER value. We consider that fewer mentions of concrete persons, places, and organizations contribute to a higher level of anxiety (this is the reason why we inverted the number of entities extracted for each headline: more entities mean less anxiety). However, this variable correlates inversely with the rest, as already noted during the process of selecting which variables were to be included in this study.
The table also highlights other eloquent exceptions, such as the frequent use of AI as an agent, linked to anthropomorphizing verbs, in spots four and five of the table (Ouest France and Münchner Merkur), while this important feature seems to be low in the newspaper on top of the list (Manchester Evening News).
3.4. Two Opposite Cases
Having a standardized index allows comparisons to be made not only between different time series but also between different media outlets. As an example, we take two outlets with different characteristics at the extremes of the general classification of AI anxiety in
Table 5.
La Voz de Galicia, with 35.7M monthly visits to its website according to the platform SimilarWeb, is one of the main regional media outlets in Spain. From a central newsroom in the city of La Coruña, it covers the entire region of Galicia (Northwest) with several local editions. In our ranking, it stands out for having the lowest anxiety index among the ten newspapers analyzed. This can be linked to another fact: it is the one that increased its coverage the least after ChatGPT (excluding Ouest France, which is misleading due to its low number of articles). This suggests that it has been closely following AI-related issues even before the “hype” unleashed by OpenAI’s chatbot. Its approach also offers an interesting example of how to do so without having to convey an anxious tone: many of its articles on AI, before and after ChatGPT, focus on local issues linked to Galicia and La Coruña, which is reflected in the large number of entities detected. Additionally, it shows an interest in telling current and developing stories (less use of the future), with a more real approach (fewer interrogations) and focused more on human or governmental protagonists (less use of AI as an agent and fewer references to the danger of AI).
The Guardian, one of the most prestigious national newspapers in Europe, with 342M monthly visits to its website (ten times the figure of La Voz de Galicia), also provided intensive coverage on AI before ChatGPT, although with fewer previous articles than La Voz de Galicia (54 vs. 79) and more than twice the increase after the launch of the popular chatbot (4.93 vs. 1.97 times). As an international reference, the newspaper offers more ‘delocalized’ stories (more headlines without specific entities) and more critical opinion articles by well-known names (which encourages a more subjective tone, with more mentions of negative topics). Because of its global readership and large online reach, the headlines collected also play with a style that is more aware of the importance of SEO and the need for clickable focuses (more questions, many in the future tense; greater readability; and more signal words and allusions to the reader in the second person).
Table 8 sums up both newspapers’ performance across all variables.