1. Introduction
Access to quality health education for adolescents and young adults is highly variable across the world [
1]. Many individuals rely on social media to find health information, particularly for those with limited access to health resources [
2,
3,
4]. The growing popularity of TikTok opens new frontiers for medicine [
5]. It is becoming increasingly common to share personal experiences with diseases, treatment options, at-home remedies, and more, which can help foster a sense of community and educate the general user on various medical topics [
5]. While TikTok can be a unique, effective way to reach a large audience, it may also allow misinformation to be disseminated rapidly [
6]. With Tik Tok not being screened to the same degree as a peer-reviewed article, it is essential to better understand the content being disseminated [
7]. This could be vital to educating providers about the preconceived notions their patients may have when visiting their offices.
Social media users typically fall between the ages of 18–29 years, with 81% of people ages 30–49 using at least one platform [
8]. According to the Pew Research Center, women were more active than men on social media platforms and spent more time on short-form video content on social media [
9,
10]. Recently, TikTok has seen an increase in content related to women’s reproductive health, with one example being polycystic ovary syndrome (PCOS) [
11]. PCOS is a common endocrinopathy, affecting 4–8% of reproductive women [
12].
According to the American College of Obstetricians and Gynecologists (ACOG), PCOS is characterized by polycystic ovaries, hyperandrogenism, and ovulatory dysfunction [
13]. Common manifestations of the condition include menstrual disorders, infertility, hirsutism, and weight changes [
13]. PCOS increases the risk of type 2 diabetes and cardiovascular disease [
13].
PCOS often garners significant attention on social media, where it is frequently depicted through a lens of personal anecdotes and trending wellness advice [
11]. This heightened visibility can raise awareness and foster a sense of community but it can also perpetuate misconceptions. PCOS is influenced by various factors, including genetics and environmental conditions [
14]. The manifestations of the disease and the effectiveness of treatments can differ widely giving conflicting information to social media users [
14]. This can create frustration amongst users worried about misinformation as expressed through online platforms such as Reddit [
15]. While individual users have expressed concern, there is a lack of peer-reviewed research diving into PCOS content on social media. This social media investigation aims to provide a descriptive content analysis of the quality of PCOS information on TikTok. Symptoms and treatments discussed in videos will be compared to current ACOG guidelines on management of PCOS. Additionally, videos will be examined to determine differences between video quality and engagement based on demographics and healthcare affiliation. The study aims to serve as a resource for healthcare providers to educate themselves to provide more informed care to their patients.
2. Materials and Methods
2.1. Selection of Videos
This study was deemed exempt by the University of Nevada, Las Vegas Institutional Review Board (UNLV-2022-169). A new TikTok account was created to collect videos for our study. A search was conducted on TikTok (
https://www.tiktok.com) in April 2024 for the search term “PCOS”. The search results were organized according to the TikTok algorithm. The first 325 uniform resource locators (URLs) were collected and recorded on a Microsoft Excel spreadsheet.
The inclusion criteria were videos uploaded to TikTok from a public account that were relevant to the condition in question. The exclusion criteria were videos not in English and videos unrelated to PCOS. Two authors independently verified the video selection, and a third author resolved any disagreements.
2.2. Data Collection
Engagement metrics such as views, likes, comments, saves, shares, and followers were recorded for each video. The number of views per day (views divided by days since the video was posted), views per like (number of views divided by the number of likes), and likes per day (number of likes divided by days since the video was posted) were calculated. It was also recorded whether videos were sponsored by a product or company and whether TikTok verified the user’s account. Videos were then categorized by themes, including “Education/Informational”, “Humor/Entertainment”, “Testimonial/Seeking Advice”, or “Advertisement”. Sources (including physicians, non-physician healthcare providers, students, talk shows, for-profit companies, patients, and other individual users) were recorded for each video based on self-reported data from users. These categories were further stratified according to physicians, non-physician healthcare professionals, and non-healthcare professionals. Non-physician healthcare professionals included pharmacists, physician assistants, nurse practitioners, nurses, students studying healthcare, and dieticians. Non-healthcare professionals were defined as all other user qualifications or users who did not state their qualifications. The sex, race, and age of the person posting the video were perceived by the researchers analyzing these videos.
The characteristics discussed in the videos, including whether the user mentioned having PCOS, the stigma of PCOS, and/or an interaction with a provider, were recorded. All videos were viewed and assessed independently by two authors. Any disagreements were resolved through discussion between the two authors.
2.3. Content Analysis
Videos were analyzed for symptoms and interventions mentioned that related to PCOS. Possible symptoms included “weight gain”, “acne”, “hirsutism”, “infertility”, “cysts”, and “mental health”. Interventions included “diet”, “exercise”, “OCPs”, “non-OCP medications”, and “supplements”. A single post often referenced multiple topics. The symptoms and interventions were recorded if they were discussed within the video but excluded if they were only referenced in the caption. The symptoms and interventions were recorded and compared to the American College of Obstetricians and Gynecologists (ACOG) practice bulletin, which details common symptoms and well-researched interventions [
13].
2.4. Video Reliability
Video reliability was assessed using a modified version of the DISCERN criteria consisting of 5 questions [
16]. The DISCERN instrument was developed to judge the quality of consumer health information. The tool is utilized to determine whether a video is of high or low quality. Questions included: “Are the aims clear and achieved?” “Are reliable sources of information used?” “Is the information presented balanced and unbiased?” “Are additional sources of information listed for patient reference?” and “Are areas of uncertainty mentioned?” Each video was scored from 0 to 5 using the sum of the questions, with 0 indicating ‘low quality’ and 5 indicating ‘high quality’. All videos were analyzed independently by two authors.
2.5. Statistical Analysis
The unit of analysis was the TikTok video. First, a univariate analysis was conducted to describe the data in terms of the measures of central tendencies (e.g., mean, median), measures of dispersion (standard deviation), and range for the numeric variables. The categorical variables were presented as counts and proportions. The normal approximation to the binomial distribution method was used to calculate 95% confidence intervals of proportions in the univariate analyses. An independent-samples t-test (a type of bivariate test) was performed to determine if there were any statistically significant differences in the metrics of social media engagement (i.e., likes, views, and comments) and in the data validation scores (Modified DISCERN) among different groups of users, video types, and video sources. A logistic regression was also utilized to model the probability of healthcare professionals creating educational videos. Estimates for the parameters were obtained through the maximum likelihood estimation method with 95% Wald’s confidence limits for the logistic model. All analyses were conducted using SPSS version 27 and SAS 9.4.
4. Discussion
Our analysis found that while TikTok videos discussing PCOS received substantial engagement, the overall quality of the information is low, particularly when produced by non-healthcare professionals.
One key finding was that over 65% of videos related to PCOS were created by individuals without healthcare qualifications, including patients, educational platforms, for-profit companies, and other individuals without listed qualifications. The high engagement of these videos, as shown by the millions of views and thousands of likes and comments, demonstrates the broad audiences reached by these creators. Videos created by non-healthcare professionals received more likes on average than those created by physicians and non-physician healthcare professionals.
In categorizing videos based on educational value, videos that were found to be “non-educational” had significantly more likes and views than those that were “educational”. Interestingly, a 2022 study published in Proceedings of the National Academy of Sciences of the United States of America, which looked at the influences surrounding content posted on social media, found that video interaction, such as likes and comments, leads to habit formation among users [
17]. They found that once the habit of increased engagement of their videos is formed, users continue their behaviors without considering the outcomes of their actions, such as spreading misinformation. Their hypothesis that false news is part of learned behavior could explain our finding that the less educational videos had the highest engagement. Additionally, it has been hypothesized that content spreading misinformation or evoking strong emotions such as anger or opposition receives more attention and is more likely to go viral [
18,
19]. Additionally, short-form videos, typically lasting from a few seconds to a few minutes, have seen a surge in popularity due to their concise format and lower production costs, which contribute to increased engagement and more positive viewer responses [
20,
21,
22]. Furthermore, image-based posts, compared to text-only content, have also been shown to generate more engagement [
23]. In our study, the average video length was under one minute, which may account for the high levels of likes, comments, saves, and views. While our study did not specifically compare engagement between “educational” and “non-educational” videos or examine the influence of text versus video presenters, these are important areas for future research to better inform healthcare professionals seeking to leverage social media for patient education.
These “non-educational” videos received significantly lower modified DISCERN scores (p < 0.001), indicating that the information they provide is often unreliable. This finding suggests that TikTok users are likely exposed to a vast amount of misinformation, which could influence their understanding of PCOS and available therapies.
Conversely, videos produced by physicians and other healthcare professionals, though fewer in quantity overall, were associated with significantly higher DISCERN scores and had a significantly higher likelihood of being “educational”, reflecting higher quality information. These videos garnered less engagement than those made by non-healthcare professionals. This may reflect the broader trend of social media favoring engaging and easily digestible content over scientific and evidence-based information [
24]. These trends highlight a critical challenge: while healthcare professionals are more likely to create reliable content, their influence may be limited by what is popularized by audiences on social media platforms.
Our findings regarding the poor quality of information on social media align closely with those reported in the current literature. The concept of “fake news” gained prominence around 2016, particularly during the U.S. presidential election [
25]. Since then, the spread of false information has become an increasing concern. Research indicates that fake news is particularly harmful because it is designed to mimic key features of credible news—such as accuracy, verifiability, conciseness, balance, and truthfulness—to deceive the public [
26,
27]. Recent studies have highlighted the dangers of misinformation not only in the political realm but across multiple sectors, including business, consumer reviews, climate change discussions, popular culture, and healthcare [
25,
28,
29,
30]. Our findings further underscore the growing societal impact of misinformation on social media, contributing to issues such as public mistrust and psychological distress [
31].
Our findings also highlight the concerning nature of interactions with healthcare providers discussed in the videos. A notable proportion of users who mentioned an interaction with a physician described it as negative, which may contribute to the dissatisfaction many women report with their PCOS diagnosis and treatment options. This dissatisfaction with providers, noted in other studies, may also drive patients to seek information from less reliable sources on TikTok, perpetuating the cycle of misinformation [
32,
33]. The prevalence of negative interactions with healthcare providers signals the need for improved communication and support within clinical settings to address the concerns of patients with PCOS.
In terms of content, symptoms and interventions discussed were compared with those discussed in the practice bulletin on polycystic ovary syndrome produced by the ACOG [
13]. This piece of literature, created by the governing body of obstetrics and gynecology, is considered the standard of care by most practitioners in the field. The most frequently discussed symptoms in the videos were weight gain and hirsutism, which are common symptoms of PCOS discussed in the practice bulletin. However, the ACOG does not formally endorse several other symptoms discussed, such as food cravings and moon facies. Moreover, the practice bulletin states that “there is no ideal dietary modification for women with PCOS beyond caloric restriction”, yet the TikToks analyzed were filled with specific food recommendations and restrictive diets [
13]. Additionally, supplements are never discussed within the ACOG bulletin, yet an astounding 20.6% of videos recommended a supplement, and 9.2% recommended a tea or other herb. While some of the interventions mentioned are commonly recommended for managing PCOS symptoms, how they are presented in the videos, with limited or no reference to the scientific literature, raises concerns about the potential for misinformation [
34,
35]. Videos created by healthcare professionals were more likely to provide accurate information and acknowledge areas of uncertainty, which is essential for helping patients understand the complexity of PCOS and the need for individualized treatment [
36].
This study brings to light broader implications for healthcare providers. As patients increasingly turn to social media for health information, providers must be made aware of the content their patients are consuming and the potential misconceptions they may have. A 2021 study underscored the “3 Rs of Social Media”, including reviewing, recognizing, and responding to public health content shared on social media. It was emphasized that the target population should be reviewed, their needs recognized, and their responses should be tailored to disseminate healthcare education to the target audience [
37]. Thus, healthcare professionals should consider leveraging social media platforms to provide accurate and evidence-based information in a format that reaches broad audiences to increase access to reliable health education.
Strengths and Limitations
The strengths of this study include its size and systematic search method. It provides a combination of content analysis and assessment of video quality. This allows providers to understand the possible misinformation circulating on TikTok and provides solutions for providers.
The limitations of this study include the following. First, the inability to ascertain specific characteristics of videos, including the country of origin. Additionally, sampling bias as the content of videos may not be posted by the broader population of individuals with PCOS. Next, the algorithm influence might have influenced which videos are seen and how frequently. In other words, videos that align with the platform’s algorithmic preferences might be over-represented. Additionally, TikTok’s ‘search’ function may not represent what individual users see on their For You page. As TikTok content is constantly changing, the search may yield different videos depending on the timeframe during which they are viewed, which is certainly a temporal limitation. Next, video length, format, and quality varied, making comparisons challenging. Lastly, this study might not account for user interactions outside the video content itself, such as discussions in comments or additional user-generated content that could provide a complete picture of PCOS-related discourse.