Next Article in Journal
Perceptions about the Federally Mandated Smoke-Free Housing Policy among Residents Living in Public Housing in New York City
Previous Article in Journal
Quantitative Assessment of Relationship between Population Exposure to PM2.5 and Socio-Economic Factors at Multiple Spatial Scales over Mainland China
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 15
Issue 9
10.3390/ijerph15092059
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Personal Involvement Moderates Message Framing Effects on Food Safety Education among Medical University Students in Chongqing, China

by
Li Bai
1,†,
Zhengjie Cai
2,†,
Yalan Lv
1,
Tingting Wu
2,
Manoj Sharma
3,
Zumin Shi
4,
Xiaorong Hou
1,* and
Yong Zhao
2,*
1
School of Medical and Information, Chongqing Medical University, Chongqing 400016, China
2
School of Public Health and Management, Chongqing Medical University, Chongqing 400016, China
3
Behavioral & Environmental Health, School of Public Health, Jackson State University, Jackson, MS 39213, USA
4
Human Nutrition department, Qatar University, Doha 999043, Qatar
*
Authors to whom correspondence should be addressed.
†
These authors contributed equally to this work.
Int. J. Environ. Res. Public Health 2018, 15(9), 2059; https://doi.org/10.3390/ijerph15092059
Submission received: 21 August 2018 / Revised: 10 September 2018 / Accepted: 18 September 2018 / Published: 19 September 2018
Versions Notes

Abstract

:
Objective: This study explored whether the efficacy of food safety education interventions can be increased by message framing among medical university students, and demonstrated the role of personal involvement within the message recipient in moderating framed effects. Methods: A cross-sectional study of food safety message framing was conducted among medical university students (randomly selected 1353 participants). An online self-administered questionnaire was used to collect information. Wilcoxon rank-sum test and Ordered multivariate logistic regression were utilised in the data analyses. Results: The present study showed significant differences in acceptance between the gain- and loss-framed groups (p < 0.001). Participants with higher personal involvement had higher acceptance than those with low personal involvement in gain- and loss-framed message models (p < 0.001). The acceptance of participants who were concerned about their health condition was higher than those who were neutral regarding their health condition (p < 0.001) and participants who suffered a food safety incident had higher acceptance than those who did not (p < 0.05). Conclusions: This study portrayed the selection preference of message framing on food safety education among medical university students in southwest China. Participants exposed to loss-framed messages had higher message acceptance than those exposed to gain-framed messages. Personal involvement may affect the food safety message framing. Public health advocates and professionals can use framed messages as a strategy to enhance intervention efficacy in the process of food safety education.

1. Introduction

Food safety is a global health goal, and foodborne diseases represent a growing public health problem in developed and developing countries [1], especially those with large populations, such as China [2]. During the period of 2003 to 2008 in China, a total of 2795 foodborne disease outbreaks occurred, which resulted in 62,559 cases, 31,261 hospital admissions, and 330 deaths in 12 provinces of China according to the China National Foodborne Diseases Surveillance Network [3]. Owing to the fact that cases of foodborne diseases were often under-reported, especially in developing countries [4,5], it has been estimated that approximately 200 million cases of foodborne diseases occur in China annually [6]. Furthermore, food safety incidents, such as “milk contaminated with melamine”, “pork products contaminated with clenbuterol”, and “swill-cooked dirty oil” have been frequently reported in recent years [7].
Health education plays a vital role in maintaining and promoting people’s health in China. The State Council of China issued the “Outline of the Plan for Health China 2030” in 2016, which proposed the necessity to establish a sound system of health promotion and education, aiming to improve the capabilities of health education services and popularising scientific knowledge of health [8]. Food safety education is one of the crucial parts of health education, which is of considerable importance to enhance food safety awareness and reduce the risk of foodborne diseases.
However, there are certain limitations in food safety interventions education among university students [9]. Although previous studies demonstrated that conducting food safety education is an important measure to improve the food safety knowledge of university students [10,11], many studies found that university students have inadequate knowledge and inappropriate behaviours regarding food safety, thus placing their health at risk from foodborne diseases [7,12,13,14,15]. Motivating students to receive food safety knowledge and develop favourable awareness and behaviour changes are necessary.
The recent report “Healthy People 2020” published by the US Office of the Surgeon General, detailed the importance of research and evaluation as an aid in the development of these health communication programmes [16]. In accordance with these objectives, researchers have sought to take advantage of the important interplay between theory and practice in designing effective health communication strategies. One consideration for the communication of health information is the framing of the behaviour recommendations and health outcomes in a message [17].
Message framing is theoretically grounded in prospect theory [18], which suggests that people respond differently to information highlighting gains versus losses. If the choices emphasise potential losses, the individual may be generally more willing to choose a risky option to prevent those losses. However, if the choices emphasise potential gains, the individual may be generally less willing to choose options involving risks to secure gains. Drawing on prospect theory, Rothman and Salovey [19] proposed that health messages can be framed in terms of either the benefits of engaging in the recommended behaviour (gain-framed messages) or the costs of not engaging in the behaviour (loss-framed messages). Although conveying essentially identical information, one form of message framing may be more effective at promoting health behaviour change than the other. Many studies also confirmed that framed messages can alter the persuasive impact of a message and profoundly affect choices and behaviours of people [19,20,21]. Specifically, loss-framed messages might be persuasive for illness detection behaviours, such as mammography [22] or skin cancer detection [23], while the gain-framed messages should be more persuasive for illness prevention behaviours, such as physical activity promotion [24]. Differences in persuasiveness exist between gain- and loss-framed messages in some specific behavioural domains. However, earlier meta-analysis found that no statistically significant difference existed in the persuasiveness of gain- and loss-framed appeals for certain domains [25,26], which demonstrated the importance of exploring the role of potential moderators of framing effects.
Investigating the role of potential moderators of framing effects is important to enhance our knowledge of the message framing, which can influence perceptions, attitudes, and behaviours of individuals. Personal involvement has played an important role in the process of responding to health-promoting information [27,28,29]. Previous studies have proposed that framed effects might be used when people are concerned or highly educated regarding a health issue [19,30,31]; these factors may contribute to the systematic processing of information. A limited number of studies explored whether personal involvement moderated message framing effects on food safety, one study indicated that a media food safety story which intended to elicit respondent involvement and a combination of the loss-framed message, was more impactful on the consumer response and willingness to pay for beef products [32]. Furthermore, a previous study has found that concerning food safety issues, thinking about food safety, and having experienced food poisoning were related to food safety behaviours [33]; consumers’ perceived risks of online shopping or dining out would also directly influence the consumption intentions of users [34,35]. Hence, the “To what degree are you concerned about your health condition”, “Food safety incidents experience”, “Dining-out experience”, and “Online food shopping experience” severed as personal involvement in this study.
Medical students’ food safety knowledge, attitudes, and practice are not only important to their health, but are expected to play an important role in health education and promotion after their graduation, which may influence a broader population [36]. The current study was the first that focused on message framing effects on food safety education of medical university students and served personal involvement as potential moderators of food safety message framing. Therefore, this research explored whether the efficacy of food safety education interventions can be increased by message framing among medical university students and demonstrated the role of individual involvement within the message acceptance of moderating framing effects.

2. Methods

2.1. Study Design and Participants

A cross-sectional study on the acceptance of different modes of food safety message framing was conducted among students in a medical university in Chongqing municipality. The study applied a stratified cluster random sampling method to select the participants. The study randomly sampled four classes out of 38 classes in each grade level, from grade one to three, using a random number table. All the students in the 12 sampled classes were surveyed.
The information was collected through an online survey whilst students were sitting in a computer laboratory at school. During the survey, the researchers were present and answered questions raised by the students. A total of 1353 students participated in the current study. According to the results of the preliminary experiments, the invalid questionnaires, which were defined as a responding time of less than 200 s, were excluded. A total of 1264 students were included in the analysis, and the valid participation rate was 93.4%.

2.2. Questionnaire

The questionnaire was self-administered and customised for the target population based on two pilot studies. The first pilot study tested the extent of the message framework description and was completed after several discussions by a panel of experts. Then, the second pilot study investigated 36 students who participated in the pretest to test the reliability of the questionnaire. The Cronbach’s alpha of the questionnaire (demographic characteristics, personal involvement, and framed message materials) was found to be 0.903. The Cronbach’s alpha was found to be 0.861 and 0.903 for the gain-framed and loss-framed message materials, respectively.
The questionnaire had three sections, namely, demographic characteristics, personal involvement variables, and food safety message framing materials. The demographic characteristics included gender, grade, current residence, ethnicity, lack of siblings, and monthly living expenses. The personal involvement variables included four questions: (1) “To what degree are you concerned about your health condition?”; (2) “Did you encounter food safety incidents?”; (3) “How often did you eat out?”; and (4) “How often did you shop for food online?”.
The message framing materials were grouped into three sections based on the food safety knowledge-attitude-practice (KAP) model. Food safety knowledge included three items: (1) “knowledge of storing methods on cooked and raw foods”: gain-framed: “If you know that processing and storing of raw foods and cooked foods should be separated, the risk of cross-contamination, food poisoning, or food-borne illnesses may be reduced”; loss-framed: “If you do not know that processing and storing of raw foods and cooked foods should be separated, the risk of cross-contamination, food poisoning, or foodborne illnesses may be increased”; (2) “knowledge of heating methods on leftovers”; gain-framed: “If you know that cooked food or leftovers should be heated thoroughly, the risk of pathogenic microorganisms or food-borne diseases may be reduced.”; loss-framed: “If you do not know that cooked food or leftovers should be heated thoroughly, the risk of pathogenic microorganisms or food-borne diseases may be increased”; (3) “knowledge of cleaning methods on pesticide residues in fruits and vegetables”; gain-framed: “If you know that fresh vegetable and fruit are treated with water and salt before eating, the risk of pesticide residues may be reduced”; loss-framed: “If you do not know that fresh vegetables and fruit are treated with water and salt before eating, the risk of pesticide residues may be increased”.
Food safety attitude included two items: (1) “attention to food safety events”; gain-framed: “If you have strong intention to pay attention to food safety events in recent years in China, food safety awareness may be improved and the risk of food poisoning or foodborne illness may be reduced”; loss-framed: “If you do not pay attention to food safety events in recent years in China, the risk of food poisoning or foodborne illness may be increased owing to poor food safety awareness”; (2) “intention to change bad eating habits”; gain-framed: “If you develop healthy eating habits (balanced diet; limit salt, cooking oil, added sugar, alcohol, etc.), the risk of related diseases and health problems (overweight, obesity, or other related chronic diseases) may be reduced”; loss-framed: “If you form bad eating habits (unbalanced dietary; excessive salt, cooking oil, added sugar, alcohol, etc.), the risk of related diseases and health problems (overweight, obesity, or other related chronic diseases) may be increased”.
Food safety practice involved seven items: (1) “frying eggs”; gain-framed: “If you fry eggs until the egg-white and egg-yolk are solid, the risk of salmonella infection may be reduced”; loss-framed: “When frying eggs, if you do not wait until egg-white and egg-yolk form a solid, the risk of salmonella infection may be increased”; (2) “dining out”: gain-framed: “If you reduce the frequency of eating out, the risk of overweight and obese may be reduced”; loss-framed: “If you often eat out, the risk of overweight and obese may be increased”; (3) “checking sensory traits”; gain-framed: “When purchasing food, if you pay attention to checking sensory traits of the food (color, smell, aroma, and shape), you may buy fresh and safe food”; loss-framed: “When purchasing food, if you pay no attention to checking sensory traits of the food (color, smell, aroma, and shape), you may buy stale and unsafe food”; (4) “checking food nutrition labels”; gain-framed: “When purchasing foods, if you check nutrition labels (mainly including the nutritional composition table, nutrition claims, and nutritional function claims), dietary balance may be promoted”; loss-framed: “When purchasing food, if you do not check nutrition labels (mainly including nutritional composition table, nutrition claim, and nutritional function claim), the risk of unbalanced diet may be increased”; (5) “checking food labels”; gain-framed: “When purchasing food, if you check the food label (food name, ingredient list, production date, shelf-life, storage conditions, allergenic substances, etc.), high-quality food information may be obtained and the risk of food purchase may be reduced”; loss-framed: “When purchasing food, if you do not check the food label (food name, ingredient list, production date, shelf-life, storage conditions, allergenic substances, etc.), the risk of food purchase may be increased”; (6) “checking online food safety information”; gain-framed: “When shopping for food online, if you check the food safety information, (health permission license, manufacturer, shelf-life, etc.), you may buy safe and high-quality food.”; loss-framed: “When shopping food online, if you do not check the food safety information (health permission license, manufacturer, shelf-life, etc.), you may buy inferior quality food”; (7) “washing hands before handling food”; gain-framed: “If you wash your hands before getting food, the incidence of food contamination or foodborne illnesses may be reduced”; loss-framed: “If you do not wash your hands before getting food, the risk of food contamination or foodborne illness may be increased”. A corresponding photograph was attached to each message to enhance the persuasive effect of messages.
Personal involvement was assessed by four questions: “To what degree are you concerned about your health condition? (1 = not concerned, 2 = neutral, and 3 = concerned)”; “Did you encounter food safety incidents? (1 = yes and 2 = no)”; “How often did you eat out? (1 = never, 2 = occasionally, and 3 = often)”; and “How often did you shop for food online? (1 = never, 2 = occasionally, and 3 = often)”. The scores of personal involvement among participants ranged from 4 to 11, and the number of participants who a score between 4 and 8 was 660 (52.2%). The cut-off was used in order to have a similar proportion in each category; hence, the study defined participants whose scores were below 9 as the low personal involvement group, and scores above 9 as the high personal involvement group.
Food safety message framing materials contained twenty-four questions, each question consisted of five levels with a score ranging from 1 to 5, which implied “totally disagree”, “disagree”, “neutral”, “agree”, and “totally agree”, respectively. The study summarized the scores of the all the items. In the gain-framed model of this study, the score of participants ranged from 32 to 60, and the number of participants who scored below 49, between 49 and 55, and above 55 were 517 (40.9%), 432 (34.2%), and 315 (24.9%), respectively. In the loss-framed model of this study, the score of participants ranged from 33 to 60, and the number of participants who got a score below 49, between 49 and 55, and above 55 were 432 (33.5%), 402 (31.8%), and 439 (34.7%), respectively. Considering the frequency distribution of the score in the gain- and loss-framed models, we defined the below 49 score as the low-score group, a score between 49 and 55 denoted the median-score group and a score above 55 was the high-score group.

2.3. Quality Control

The questionnaire was adapted from previous literature [37,38,39,40]. The questionnaire was repeatedly revised through expert interviews and two pilot surveys. The research team members, including teachers and students (postgraduates and undergraduates), all underwent standardised investigation training. Investigators were required to thoroughly understand the approach and methodology of this research, as well as being full of experience in handling potentially sensitive issues. Participants filled out the questionnaires online in the laboratory.

2.4. Ethical Approval

All participants provided their informed consent for inclusion before participating in this study. The study protocol was approved by the Ethics Committee of Chongqing Medical University. The record number is 2018011.

2.5. Statistical Analysis

The data were carefully processed by Excel software prior to entry into the database. Data analyses were performed using SPSS 20.0 software (IBM Corporation, Armonk, NY, US). The demographic characteristics of participants were expressed as frequencies and percentages. The framework message materials were tested with normality test and homogeneity of variance assumptions. A Wilcoxon signed rank-sum test was performed to assess whether a significant difference existed between gain- and loss-framed messages. The message framing acceptance was expressed as average rank. The factors associated with the framing effects were analysed by Wilcoxon rank-sum test, Wilcoxon signed rank-sum test, and Kruskal–Wallis test. Ordered multivariate logistic regression analysis was implemented to analyse the factors associated with framing effects of food safety. The moderating effects of personal involvement factors were expressed as average rank and high average rank represented by the high acceptance of food safety message framing. All statistics were analysed using a two-sided test. A p-value of no more than 0.05 was considered statistically significant.

3. Results

3.1. Demographic Characteristics of Participants

Demographic characteristics of the participants have been provided in Table 1. The participants comprised of 499 males and 765 females. There were 224 (17.7%) freshman students, 753 (59.65%) sophomore students, and 287 (22.7%) junior students. The Han nationality constituted 89.5% of the sample. There were 634 (50.2%) students from urban areas and 630 (49.8%) from rural areas. The participants with monthly living expenses between 1000 CNY–1499 CNY were 698 (55.2%). Approximately 43.4% of the participants had no siblings.

3.2. Analyses of Personal Involvement Variables

As shown in Table 2, more than half (55.8%) of the participants were concerned regarding their health condition and 2.1% were not concerned regarding their health condition among all participants; 4.2% of male and 0.8% of female participants were not concerned regarding their health condition, respectively. In total, 37.2% of all participants encountered food safety incidents. Only 0.6% of all students did not have a dining-out experience. Approximately 9.8% of all participants never shopped for food online, and 15.6% of male and 6% of female participants never shopped for food online.

3.3. Analyses of Framed Messages

3.3.1. Test Framing Effects

As shown in Table 3, many food safety messages that used gain-framed and loss-framed descriptions had significant differences (p < 0.05) among all participants and female students: (1) Knowledge of heating methods on leftovers; (2) Knowledge of cleaning methods on pesticide residues in fruits; (3) Intention of bad eating habits changes; (4) Frying eggs; (5) Dining out; (6) Checking food sensory traits; (7) Checking food nutrition labels; and (8) Checking food labels. However, several items demonstrated inconsistencies. The messages, which included (1) Knowledge of storing methods on cooked food and raw food; (2) Attention to food safety events; (3) checking food safety information (shelf-life, manufacturer, etc.) during online shopping; and (4) Washing hands before handling food, which showed no significant differences (p > 0.05). Regarding male participants, significant differences were observed in the following food safety messages (p < 0.05). (1) Knowledge of storing methods on cooked food and raw food; (2) Knowledge of heating methods on leftovers; (3) Intention of bad eating habits changes; (4) Frying eggs; (5) Dining out; (6) Checking food sensory traits; and (7) Checking food labels. Of the food safety messages, which included (1) Knowledge of cleaning methods on pesticide residues in fruits and vegetables; (2) Attention to food safety events; (3) Checking food nutrition labels; (4) Checking food safety information; and (5) Washing hands before handling food, there were no significant differences (p > 0.05).
As shown in Table 4, a significant difference was observed between gain- and loss-framed messages (p < 0.001). Regarding the gain-framed and loss-framed message model, a significant difference was observed between high personal involvement and low personal involvement (p < 0.001). Therefore, those results that demonstrated higher acceptance on the loss-framed than gain-framed food safety messages among participants and among those participants with high personal involvement, had higher acceptance than those who with low personal involvement.

3.3.2. Analyses of Demographic Characteristics and Personal Involvement

Separate moderation analyses were performed to investigate whether the effects of framing on acceptance were moderated by demographic characteristics and personal involvement. Several factors, which included “Gender”, “Grade”, “Residence”, “Ethnicity”, “Lack of sibling”, “Monthly living expenses”, “The degree of concern about health condition”, “Food safety incidents experience”, “Dining-out experience”, and “Online food shopping experience”, were considered.
As shown in Table 5, the results of these analyses indicated that “Gender” (p = 0.004 vs. p = 0.021), grade (p = 0.046 vs. p = 0.013), “The degree of concern about your health condition” (p = 0.000 vs. p = 0.000), and “food safety incidents experience” (p = 0.005 vs. p = 0.005) exhibited significant differences in gain- and loss-framed messages. The other variables had no significant difference. Compared with males, females had higher rates regarding acceptance of messages (p < 0.05). Sophomore had the highest acceptance of messages among all grades (p < 0.05). Those participants who were concerned regarding their health condition had the highest rates regarding acceptance of messages than those who felt neutral or provided no attention to their health condition (p < 0.05). The participants who suffered a food safety incident had higher acceptance of messages than those who did not suffer any food safety incident (p < 0.05).

3.3.3. Ordered Multivariate Logistic Regression Analyses for the Factors Influencing the Message Acceptance

To further investigate the factors that affect the acceptance of food safety messages, the study performed ordered multivariate logistic regression analysis. According to previous studies, “The degree of concern about health condition”, “Food safety incidents experience”, “Gender”, and “Grade” were associated with food safety, which were significant different on the Wilcoxon rank sum test/Kruskal–Wallis test. We chose these four parameters as independent variables.
As shown in Table 6, in the gain-framed message model, compared with participants who were concerned about their health condition, participants who were neutral about their health condition were less likely to exhibit a high acceptance of the message (95% CI (−0.619, −0.193), p < 0.001). Participants who did not have food safety incident experience were less likely to gain a high acceptance of message than those who had encountered food safety incidents experience (95% CI (0.034, −0.477), p < 0.05).
In the loss-framed message model, compared with participants who were concerned about their health condition, participants who were neutral about their health condition were less likely to gain a high acceptance of message (95% CI (−0.600, −0.179), p < 0.001). The participants who did not have food safety incident experience were less likely to have a high acceptance of the message than those who had encountered food safety incidents experience (95% CI (−0.497, −0.07), p < 0.05).

4. Discussion

This cross-sectional study found a significant difference between gain- and loss-framed food safety messages. Therefore, message framing was effective in the food safety messages of this study. Participants exposed to loss-framed messages showed higher acceptance than those exposed to gain-framed messages. Moreover, the study showed that personal involvement may influence framed messages, and concluded that participants with a higher level of personal involvement produced higher acceptance than those with a lower level of personal involvement.
Empirical studies have demonstrated that gain-framed messages should be more persuasive for health prevention behaviour, and loss-framed messages should be more persuasive for health detection behaviour [22,23,24]. However, this study showed inconsistent results, loss-framed messages were more persuasive than gain-framed messages on the food safety education of medical university students, which is part of the realm of health prevention behaviour. Regarding the gain-framed and loss-framed message model, participants with high personal involvement had higher acceptance than those who with low personal involvement. Several empirical studies were consistent with this study. Riet [41] conducted a test which used anti-smoking framed messages targeted at current smokers. The results found that a loss-framed communication was more persuasive for participants with high self-efficacy to quit smoking than gain-framed communication or no communication. Similarly, Gerend [42] examined the relative effectiveness of gain- versus loss-framed messages in promoting acceptance of a vaccine against human papilloma virus (HPV), and found that a loss-framed message led to considerable HPV vaccination intentions than a gain-framed message only among participants who had multiple sexual partners and those who infrequently used condoms.
Furthermore, this study showed that the participants who were concerned regarding their health condition had the highest acceptance. In addition, participants who suffered food safety incidents had higher acceptance than those who did not. The finding was consistent with previous studies, which proposed that behavioural responses to framed information should be a function of the framed message and pre-existing perceptions of the health issue [43,44]. Particularly, with a health issue experience should influence one's receptivity to information about gain or loss and whether a behaviour is perceived as risky or uncertain to adopt [18,45,46].
Rothman and Salovey [18] proposed that matching the framed message to the type of health behaviour being promoted can increase the persuasiveness of the message. The success of a framed message, which relied on the extent of the perceived risks of the recommended behaviour. Given that people are relatively open to taking risks when faced with potential losses, loss-framed messages should be more effective than gain-framed messages in promoting health detection behaviours. The present study found that food safety acceptance was high when participants were exposed to loss-framed messages (at least among certain individuals). One possible explanation for this finding is that food safety is generally perceived to be a relatively risky behaviour as opposed to a safe one. Similarly, Gallagher [41] found that a loss-framed message may be more effective in people who were perceived with high degree of risk associated with performing health behaviours.
Nevertheless, a few messages, including (1) Knowledge of storing methods on cooked food and raw food; (2) Attention to food safety events; (3) Checking food safety information; and (4) Washing hands before handling food elicited high acceptance using a gain-framed description. The cause of these phenomena may be that such behaviours are often overlooked or considered low perceived risk [47,48,49]. This idea was similar to a recent study [50], which found that gain-framed messages were more effective than loss-framed messages when people perceived low risk. In addition, a previous study [18] proposed that women who were concerned regarding the risk of finding a lump while conducting mammography should be particularly sensitive to a loss-framed appeal. However, when women considered mammography as a health-affirming behaviour, a gain-framed message might more persuasive. Rothman [21] proposed that loss-framed messages were persuasive when people considered a behaviour that they perceived to involve some risks of an unpleasant outcome; by contrast, gain-framed messages were persuasive when people considered a behaviour that they perceived to involve a relatively low risk of an unpleasant outcome.
The present study may confirm that personal involvement plays a crucial role in the food safety message framing effects. “To what degree are you concerned about your health condition” and “food safety incidents experience” might moderate the effects of gain- and loss-framed messages. The degree of personal involvement would influence one’s message processing either in a detailed and integrative manner or in a superficial manner. People who are not considerably involved in or not concerned regarding a certain behaviour are predicted to heuristically process the message [51]. However, high issue involvement led to systematic processing of the message, which favoured loss-framed message [52].
The study was the first to focus on the application of food safety education on message framing, which can broaden the research field of message framework and innovate the education method of food safety. Moreover, to enhance the recognition of message framing among the participants, the current study provided corresponding pictures for each framed message, which supplemented the limitation of previous literature in describing the framed message by plain text.
This study also had certain limitations. Firstly, the use of cross-sectional survey data reduced the researchers’ ability to make direct causal inferences. Secondly, the participants who were investigated only included the medical university students. Hence, the results may not be representative of all university students in China. Further national representative studies are warranted. Thirdly, this study only included personal involvement as a moderator. Future research could consider self-efficacy [20] or emotional state of the message recipient [40] as moderator, which may influence the framed messages. Fourth, we mainly considered the effect of grade on acceptance of the food safety message, but ignored the age of students. Further studies will complete the analysis of demographic characteristics of participants. Finally, the study relied on self-report, which can introduce bias due to dishonesty, over-reporting, under-reporting, and measurement flaws. Limitations of this study would provide interesting avenues for further research.

5. Conclusions

This study found that the loss-framed messages received higher acceptance than gain-framed messages on food safety among medical university students. The study also provided support for the contention that personal involvement may influence message framing, which concluded that participants with a high level of personal involvement exhibited higher acceptance of food safety messages. Meanwhile, this study portrayed the selection preference of message framing regarding food safety education among medical university students in southwest China and provided useful information for public health advocates or professionals in the domain of food safety to conduct effective education. Finally, given the enormous growth in the number of food safety incidents over recent years, understanding the promotion of food safety with different framed messages constitutes an important area of food safety education.

Author Contributions

X.H., Y.Z., L.B., and Z.C. designed and performed the experiments. M.Z. helped perform the experiments. L.B. and Z.C. wrote the paper. L.B. analyzed the data. M.Z. and Y.L. helped analyze the data. T.W., Z.S., and M.S. helped draft the manuscript. All authors read and approved the final manuscript.

Funding

This research was funded by the School of Medical and Information, Chongqing Medical University, China, student research and innovation experiment project (Grant No.2017C018), and Chongqing Medical University, China, the special research project of philosophy and social science (Grant No.201712).

Acknowledgments

We would like to thank all teachers who helped us coordinate the survey as well as all the students who participated in it. We would also like to acknowledge the support provided by Miping Zhu during the field investigation.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Velusamy, V.; Arshak, K.; Korostynska, O.; Oliwa, K.; Adleyl, C. An overview of foodborne pathogen detection: In the perspective of biosensors. Biotechnol. Adv. 2010, 28, 232–254. [Google Scholar] [CrossRef] [PubMed]
  2. Lam, H.M.; Remais, J.; Fung, M.C.; Xu, L.; Sun, S.S. Food supply and food safety issues in China. Lancet 2013, 381, 2044–2053. [Google Scholar] [CrossRef] [Green Version]
  3. Wu, Y.; Wen, J.; Ma, Y.; Ma, X.; Chen, Y. Epidemiology of foodborne disease outbreaks caused by Vibrio parahaemolyticus, China, 2003–2008. Food Control 2014, 46, 197–202. [Google Scholar] [CrossRef]
  4. Odeyemi, O.A. Public health implications of microbial food safety and foodborne diseases in developing countries. Food Nutr. Res. 2016, 60. [Google Scholar] [CrossRef] [PubMed]
  5. Zanin, L.M.; da Cunha, D.T.; de Rosso, V.V.; Stedefeldt, E. Knowledge, attitudes and practices of food handlers in food safety: An integrative review. Food Res. Int. 2017, 100, 53–62. [Google Scholar] [CrossRef] [PubMed]
  6. Yan, C.; Yan, W.X.; Zhou, Y.J.; Zhang, R.H.; Chen, J.; Liu, Z.H. Burden of self-reported acute gastrointestinal illness in China: A population-based survey. BMC Public Health 2013, 13, 456. [Google Scholar] [CrossRef]
  7. Li, S.G. Analysis of food safety events reported by media from 2004 to 2012 in China. J. Chin. Inst. Food Sci. Technol. 2014, 14, 1–8. [Google Scholar]
  8. The State Council of China. Outline of the Plan for Health China 2030. Available online: http://www.nhfpc.gov.cn/guihuaxxs/s3586s/201610/21d120c917284007ad9c7aa8e9634bb4.shtml (accessed on 25 October 2016).
  9. Young, I.; Waddell, L.; Harding, S.; Greig, J.; Mascarenhas, M.; Sivaramalingam, B.; Mai, T.; Papadopoulos, A. A systematic review and meta-analysis of the effectiveness of food safety education interventions for consumers in developed countries. BMC Public Health 2015, 15, 822. [Google Scholar] [CrossRef] [PubMed]
  10. Yarrow, L. Food Safety Attitudes, Beliefs, Knowledge and Self-Reported Practices of College Students before and after Educational Intervention. Ph.D. Thesis, Kansas State University, Manhattan, KS, USA, 2006. [Google Scholar]
  11. Yarrow, L.; Remig, V.; Higgins, M.M. Food safety educational intervention positively influences college students’ food safety attitudes, beliefs, knowledge, and self-reported practices. J. Environ. Health 2009, 71, 30–35. [Google Scholar] [PubMed]
  12. Ferk, C.C.; Calder, B.L.; Camire, M.E. Assessing the food safety knowledge of University of Maine students. J. Food Sci. Educ. 2016, 15, 14–22. [Google Scholar] [CrossRef]
  13. Hassan, H.F.; Dimassi, H. Food safety and handling knowledge and practices of Lebanese University students. Food Control 2014, 40, 127–133. [Google Scholar] [CrossRef]
  14. Lazou, T.; Georgiadis, M.; Pentieva, K.; Mckevitt, A.; Iossifidou, E. Food safety knowledge and food-handling practices of Greek University students: A questionnaire-based survey. Food Control 2012, 28, 400–411. [Google Scholar] [CrossRef]
  15. Stratev, D.; Odeyemi, O.A.; Pavlov, A.; Kyuchukova, R.; Fatehi, F. Food safety knowledge and hygiene practices among veterinary medicine students at Trakia University, Bulgaria. J. Infect. Public Health 2017, 10, 778. [Google Scholar] [CrossRef] [PubMed]
  16. Gallagher, K.M.; Updegraff, J.A. Health message framing effects on attitudes, intentions, and behavior: A meta-analytic review. Ann. Behav. Med. 2012, 43, 101–116. [Google Scholar] [CrossRef] [PubMed]
  17. Tversky, A.; Kahneman, D. The framing of decisions and the psychology of choice. Science 1981, 211, 453–458. [Google Scholar] [CrossRef] [PubMed]
  18. Rothman, A.J.; Salovey, p. Shaping perceptions to motivate healthy behavior: The role of message framing. Psychol. Bull. 1997, 121, 3–19. [Google Scholar] [CrossRef] [PubMed]
  19. Rothman, A.J.; Kelly, K.M.; Hertel, A.; Salovey, P. Message frames and illness representations: Implications for interventions to promote and sustain healthy behavior. In The Self-Regulation of Health and Illness Behavior; Cameron, L.D., Leventhal, H., Eds.; Routledge: London, UK, 2003; pp. 278–296. [Google Scholar]
  20. Rothman, A.J.; Stark, E.; Salovey, P. Using message framing to promote healthy behavior: A guide to best practices. In Best Practices in the Behavioral Management of Chronic Diseases; Institute for Brain Potential: Los Banos, CA, USA, 2006; Volume 3, pp. 31–48. [Google Scholar]
  21. Rothman, A.J.; Bartels, R.D.; Wlaschin, J.; Salovey, P. The strategic use of gain- and loss-framed messages to promote healthy behavior: How theory can inform practice. J. Commun. 2006, 56, S202–S220. [Google Scholar] [CrossRef]
  22. Abood, D.A.; Coster, D.C.; Mullis, A.K.; Black, D.R. Evaluation of a “loss-framed” minimal intervention to increase mammography utilization among medically un- and under-insured women. Cancer Detect. Prev. 2002, 26, 394–400. [Google Scholar] [CrossRef]
  23. Van't Riet, J.; Ruiter, R.A.; Werrij, M.Q.; De Vries, H. Self-efficacy moderates message-framing effects: The case of skin-cancer detection. Psychol. Health 2010, 25, 339–349. [Google Scholar] [CrossRef] [PubMed]
  24. Riet, J.V.T.; Ruiter, R.A.C.; Werrij, M.K.; Vries, H.D. Investigating message-framing effects in the context of a tailored intervention promoting physical activity. Health Edu. Res. 2010, 25, 343. [Google Scholar] [CrossRef] [PubMed]
  25. O’Keefe, D.J.; Jensen, J.D. The relative persuasiveness of gain-framed and loss-framed messages for encouraging disease prevention behaviors: A meta-analytic review. J. Commun. 2009, 59, 296–316. [Google Scholar] [CrossRef]
  26. O’Keefe, D.J.; Nan, X. The relative persuasiveness of gain- and loss-framed messages for promoting vaccination: Ameta-analytic review. Health Commun. 2012, 27, 776. [Google Scholar] [CrossRef] [PubMed]
  27. Block, L.G.; Williams, P. Undoing the effects of seizing and freezing: Decreasing defensive processing of personally relevant messages. J. Appl. Soc. Psychol. 2002, 32, 803–830. [Google Scholar] [CrossRef]
  28. Abraham, C. Measuring defensive responses to threatening messages: A meta-analysis of measures. Health Psychol. Rev. 2007, 1, 208–229. [Google Scholar]
  29. Kessels, L.T.; Ruiter, R.A.; Jansma, B.M. Increased attention but more efficient disengagement: neuroscientific evidence for defensive processing of threatening health information. Health Psychol. 2010, 29, 346–354. [Google Scholar] [CrossRef] [PubMed]
  30. Millar, M.G.; Millar, K.U. Promoting safe driving behaviors: The influence of message framing and issue involvement. J. Appl. Soc. Psychol. 2010, 30, 853–866. [Google Scholar] [CrossRef]
  31. Rothman, A.J.; Martino, S.C.; Bedell, B.T.; Detweiler, J.B.; Salovey, P. The systematic influence of gain-and loss-framed messages on interest in and use of different types of health behavior. Pers. Soc. Psychol. Bull. 1999, 25, 1355–1369. [Google Scholar] [CrossRef]
  32. Britwum, K.; Yiannaka, E. Consumer willingness to pay for food safety interventions: The role of message framing and involvement. Agric. Appl. Econ. Assoc. 2016, 61, 487–490. [Google Scholar]
  33. Knight, A.J.; Worosz, M.R.; Todd, E.C.D. Dining for safety: Consumer perceptions of food safety and eating out. J. Hosp. Tour. Res. 2009, 33, 471–486. [Google Scholar] [CrossRef]
  34. Nina, M.; Louisem, H. The role of health consciousness, food safety concern and ethical identity on attitudes and intentions towards organic food. Int. J. Consum. Stud. 2008, 32, 163–170. [Google Scholar] [Green Version]
  35. Ariff, M.S.M.; Sylvester, M.; Zakuan, N.; Ismail, K.; Ali, K.M. Consumer perceived risk, attitude and online shopping behavior; empirical evidence from Malaysia. Mater. Sci. Eng. 2014, 58, 012007. [Google Scholar] [CrossRef]
  36. Sun, J.; Bo, Y.; Shi, J.; Liu, C.; Shi, J.; Wang, P. Evaluation of a food safety education on knowledge, attitude and practice among 1300 college students of Henan province, China. J. Food Nutr. Res. 2016, 2, 136–140. [Google Scholar] [CrossRef]
  37. Haidar, A.; Carey, F.R.; Ranjit, N.; Archer, N.; Hoelscher, D. Self-reported use of nutrition labels to make food choices is associated with healthier dietary behaviours in adolescents. Public Health Nutr. 2017, 20, 2329–2339. [Google Scholar] [CrossRef] [PubMed]
  38. Affenito, S.G.; Franko, D.; Striegel-Moore, R.H.; Douglas, T. Behavioral determinants of obesity: research findings and policy implications. J. Obes. 2012, 2012, 150732. [Google Scholar] [CrossRef] [PubMed]
  39. Word Health Organization (WHO). Five Keys to Safer Food Manual. Available online: http://apps.who.int/iris/handle/10665/43546?locale-attribute=zh& (accessed on 11 December 2016).
  40. Nesbitt, A.; Thomas, M.K.; Marshall, B.; Snedeker, K.; Meleta, K.; Watson, B.; Bienefeld, M. Baseline for consumer food safety knowledge and behaviour in Canada. Food Control 2014, 38, 157–173. [Google Scholar] [CrossRef] [Green Version]
  41. Riet, J.V.T.; Ruiter, R.A.C.; Werrij, M.Q.; Vries, H.D. The influence of self-efficacy on the effects of framed health messages. Eur. J. Soc. Psychol. 2008, 38, 800–809. [Google Scholar] [CrossRef]
  42. Gerend, M.A.; Shepherd, J.E. Using message framing to promote acceptance of the human papillomavirus vaccine. Health Psychol. Off. J. Divis. Health Psychol. Am. Psychol. Assoc. 2007, 26, 745–752. [Google Scholar] [CrossRef] [PubMed]
  43. Gerend, M.A.; Cullen, M. Effects of message framing and temporal context on college student drinking behavior. J. Exp. Soc. Psychol. 2008, 44, 1167–1173. [Google Scholar] [CrossRef]
  44. Gerend, M.A.; Maner, J.K. Fear, anger, fruits, and veggies: Interactive effects of emotion and message framing on health behavior. Health Psychol. 2011, 30, 420–423. [Google Scholar] [CrossRef] [PubMed]
  45. Tracy, W.; Valerie, C. Effects of message framing on breast-cancer-related beliefs and behaviors: The role of mediating factors. J. Appl. Soc. Psychol. 2001, 31, 925–950. [Google Scholar]
  46. Maheswaran, D.; Meyers-Levy, J. The influence of message framing and issue involvement. J. Mark. Res. 1990, 27, 361–367. [Google Scholar] [CrossRef]
  47. Ni, C.M.; Eyles, H.; Jiang, Y.; Blakely, T. Do nutrition labels influence healthier food choices? Analysis of label viewing behaviour and subsequent food purchases in a labelling intervention trial. Appetite 2018, 121, 360–365. [Google Scholar]
  48. Christoph, M.J.; An, R. Effect of nutrition labels on dietary quality among college students: A systematic review and meta-analysis. Nutr. Rev. 2018, 76, 187–203. [Google Scholar] [CrossRef] [PubMed]
  49. Dong, Z. How to persuade adolescents to use nutrition labels: Effects of health consciousness, argument quality, and source credibility. Asian J. Commun. 2015, 25, 84–101. [Google Scholar] [CrossRef]
  50. Lee, A.Y.; Aaker, J.L. Bringing the frame into focus: The influence of regulatory fit on processing fluency and persuasion. J. Pers. Soc. Psychol. 2004, 86, 205–218. [Google Scholar] [CrossRef] [PubMed]
  51. Chaiken, S. Heuristic and systematic information processing and the use of source versus message cues in persuasion. J. Pers. Soc. Psychol. 1980, 39, 752–756. [Google Scholar] [CrossRef]
  52. Rothman, A.J.; Salovey, P.; Antone, C.; Keough, K.; Martin, C.D. The influence of message framing on intentions to perform health behaviors. J. Exp. Soc. Psychol. 1993, 29, 408–433. [Google Scholar] [CrossRef]
Table
Table 1. Demographic characteristics of the study population by gender (n = 1264).
Table 1. Demographic characteristics of the study population by gender (n = 1264).
VariablesTotal (n = 1264)Male ( n= 499)Female (n = 765)
n (%)n (%)n (%)
Grade
 Freshman224 (17.7%)99 (19.8%)125 (16.3%)
 Sophomore753 (59.6%)288 (57.7%)465 (60.8%)
 Junior287 (22.7%)112 (22.4%)175 (22.9%)
Residence
 Urban634 (50.2%)263 (52.7%)371 (48.5%)
 Rural630 (49.8%)236 (47.3%)394 (51.5%)
Ethnicity
 Han nationality1131 (89.5%)443 (88.8%)688 (89.9%)
 Minority133 (10.5%)56 (11.2%)77 (10.1%)
Lack of siblings
 Yes549 (43.4%)240 (48.1%)309 (40.4%)
 No715 (56.6%)259 (51.9%)456 (59.6%)
Monthly living expenses
 <¥1000269 (21.3%)98 (19.6%)171 (22.4%)
 ¥1000–¥1499698 (55.2%)280 (56.1%)418 (54.6%)
 ¥1500–¥1999222 (17.6%)93 (18.6%)129 (16.9%)
 ¥2000–¥249956 (4.4%)19 (3.8%)37 (4.8%)
 >¥250019 (1.5%)9 (1.8%)10 (1.3%)
Table
Table 2. Personal involvement of the study population by gender (n = 1264).
Table 2. Personal involvement of the study population by gender (n = 1264).
VariablesTotal (n = 1264)Male (n = 499)Female (n = 765)
n (%)n (%)n (%)
To what degree are you concerned about your health condition
 Not concerned27 (2.1%)21 (4.2%)6 (0.8%)
 Neutral532 (42.1%)216 (43.3%)316 (41.3%)
 Concerned705 (55.8%)262 (52.5%)443 (57.9%)
Did you encounter food safety incident
 No794 (62.8%)320 (64.1%)474 (62%)
 Yes470 (37.2%)179 (35.9%)291 (38%)
How often did you eat out
 Never8 (0.6%)7 (1.4%)1 (0.1%)
 Occasionally728 (57.6%)275 (55.1%)453 (49.2%)
 Often528 (41.8%)217 (43.5%)311 (41.7%)
How often did you shop food online
 Never124 (9.8%)78 (15.6%)46 (6%)
 Occasionally859 (68%)338 (67.3%)523 (68.4%)
 Often281 (22.2%)85 (17.0%)196 (25.6%)
Table
Table 3. Analyses of the gain- and loss-framed of food safety messages.
Table 3. Analyses of the gain- and loss-framed of food safety messages.
VariablesTotal (n = 1264)Male (n = 499)Female (n = 765)
GainLosspGainLosspGainLossp
Average RankAverage RankAverage Rank
Knowledge
 Knowledge of storing methods on cooked food and raw food190.8197.00.05280.2380.690.047 *117.26110.350.40
 Knowledge of heating methods on leftovers162.9200.10.000 **66.0685.090.000 **98.69115.880.000 **
 Knowledge of cleaning methods on pesticide residues in fruits and vegetables134.8145.20.014 *57.7165.080.62377.8079.680.003 *
Attitude
 Attention to food safety events204.5211.60.84891.1387.500.051115.75124.500.11
 Intention of bad eating habits changes185.0179.30.000 **75.3970.640.006 *110.50108.860.000 **
Practice
 Frying eggs219.6218.80.000 **81.2084.380.000 **138.43135.440.000 **
 Dining out313.4377.80.000 **133.55163.750.000 **179.45214.680.000 **
 Checking food sensory traits288.9343.10.000 **115.82135.990.000 **172.75207.730.000 **
 Checking food nutrition labels229.6234.00.02 *88.1489.890.93142.12144.300.003 *
 Checking food labels232.1229.10.000 **104.88104.320.000 **127.84125.320.000 **
 Checking food safety information204.3201.70.98686.7884.160.631118.06117.940.671
 Washing hands before handling food159.2163.70.62567.8063.340.97191.97101.030.534
Note: Wilcoxon signed rank sum test was used. * p < 0.05 and ** p < 0.001 (statistically significant).
Table
Table 4. Wilcoxon signed rank sum test for testing framed effects.
Table 4. Wilcoxon signed rank sum test for testing framed effects.
VariablesAverage RankZp
Gain-framed431.7−17.7480.000 **
Loss-framed559.3
Gain-framed—low personal involvement592.316.8470.000 **
Gain-framed—high personal involvement678.8
Loss-framed—low personal involvement591.9
Loss-framed—high personal involvement676.817.1790.000 **
Note: Wilcoxon signed rank sum test was used, ** p < 0.001(statistically significant).
Table
Table 5. Wilcoxon rank sum test/Kruskal–Wallis test for demographic characteristics and personal involvement.
Table 5. Wilcoxon rank sum test/Kruskal–Wallis test for demographic characteristics and personal involvement.
VariablesGain-FramedLoss-Framed
nAverage RankZ/HpnAverage RankZ/Hp
Gender−2.8760.004 *−2.3080.021 *
 Male499596499603.26
 Female765656.31765651.57
Grade6.1710.046 *8.7310.013 *
 Freshman224578.27224567.69
 Sophomore753646.81753648.32
 Junior287637.28287641.57
Residence−1.560.119−1.7480.08
 Urban634616.56634614.67
 Rural630648.54630650.45
Ethnicity−0.3850.7−0.4660.641
 Han nationality1131633.851131634.13
 Minority133620.99133618.61
Lack of sibling−1.0980.272−1.0130.311
 Yes549645.34549644.33
 No715622.64715623.42
Monthly living expense0.4100.9822.0550.726
 <¥1000269630.05269623.50
 ¥1000–¥1499698631.05698630.83
 ¥1500–¥1999222633.30222635.63
 ¥2000–¥249956622.2756695.71
 >¥250019623.2119598.32
To what degree are you concerned about your health condition25.3180.000 **22.5310.000 **
 Not concerned27550.2027557.06
 Neutral532575.97532579.14
 Concerned705678.31705675.65
Did you encounter food safety incident−8.1520.004 *8.0100.005 *
 No794609.98794610.22
 Yes470670.54470670.14
How often did you eat out0.0650.9680.0290.986
 Never8559.818615.50
 Occasionally728632.51728631.69
 Often528632.99528633.88
How often did you shop food online3.5870.1665.7020.058
 Never124621.80124619.45
 Occasionally859622.71859619.44
 Often281668.81124678.19
Note: Nonparametric test was used. * p < 0.05 and ** p < 0.001(statistically significant).
Table
Table 6. Ordered Multivariate Logistic Regression for demographic characteristics and personal involvement.
Table 6. Ordered Multivariate Logistic Regression for demographic characteristics and personal involvement.
Gain-Framed Message
ParameterEstimateSE95%CIp
Intercept 1−0.8120.144−1.0950.5290.000
Intercept 20.6880.1440.4060.9700.000
GenderMale−0.2070.108−0.4190.0050.056
Female (ref.)
GradeFreshman−0.2660.167−0.5940.0610.111
Sophomore0.0240.129−0.2300.2770.854
Junior (ref.)
To what degree are you concerned about your health conditionNot concerned−0.3420.372−1.0710.3880.359
Neutral−0.4060.108−0.6190.1930.000 **
Concerned (ref.)
Did you encounter food safety incidentsNo−0.2320.109−0.447−0.0180.034 *
Yes (ref.)
Loss-Framed Message
Intercept 1−1.1850.146−1.471−0.8990.000 **
Intercept 20.1600.142−0.1180.4390.259
GenderMale−0.1510.107−0.3610.0590.159
Female (ref.)
GradeFreshman−0.3110.165−0.6340.0130.060
Sophomore−0.0320.129−0.2840.2200.803
Junior (ref.)
To what degree are you concerned about your health conditionNot concerned−0.3590.366−1.0760.3580.326
Neutral−0.3890.107−0.600−0.1790.000 **
Concerned (ref.)
Did you encounter food safety incidentsNo−0.2830.109−0.497−0.0700.009 *
Yes (ref.)
Note: Ordered multivariate logistic regression analysis. * p < 0.05 and ** p < 0.001 (statistically significant).

Share and Cite

MDPI and ACS Style

Bai, L.; Cai, Z.; Lv, Y.; Wu, T.; Sharma, M.; Shi, Z.; Hou, X.; Zhao, Y. Personal Involvement Moderates Message Framing Effects on Food Safety Education among Medical University Students in Chongqing, China. Int. J. Environ. Res. Public Health 2018, 15, 2059. https://doi.org/10.3390/ijerph15092059

AMA Style

Bai L, Cai Z, Lv Y, Wu T, Sharma M, Shi Z, Hou X, Zhao Y. Personal Involvement Moderates Message Framing Effects on Food Safety Education among Medical University Students in Chongqing, China. International Journal of Environmental Research and Public Health. 2018; 15(9):2059. https://doi.org/10.3390/ijerph15092059

Chicago/Turabian Style

Bai, Li, Zhengjie Cai, Yalan Lv, Tingting Wu, Manoj Sharma, Zumin Shi, Xiaorong Hou, and Yong Zhao. 2018. "Personal Involvement Moderates Message Framing Effects on Food Safety Education among Medical University Students in Chongqing, China" International Journal of Environmental Research and Public Health 15, no. 9: 2059. https://doi.org/10.3390/ijerph15092059

APA Style

Bai, L., Cai, Z., Lv, Y., Wu, T., Sharma, M., Shi, Z., Hou, X., & Zhao, Y. (2018). Personal Involvement Moderates Message Framing Effects on Food Safety Education among Medical University Students in Chongqing, China. International Journal of Environmental Research and Public Health, 15(9), 2059. https://doi.org/10.3390/ijerph15092059

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop