Next Article in Journal
Factors Predicting Treatment of World Trade Center-Related Lung Injury: A Longitudinal Cohort Study
Next Article in Special Issue
Being a Gambler during the COVID-19 Pandemic: A Study with Italian Patients and the Effects of Reduced Exposition
Previous Article in Journal
COVID-19 in Switzerland and Liechtenstein: A Cross-Sectional Survey among Dentists’ Awareness, Protective Measures and Economic Effects
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Perspective of Internet Poker Players on Harm-Reduction Strategies: A Cross-Sectional Study

1
Faculty of Psychology, Kazimierz Wielki University, 85-867 Bydgoszcz, Poland
2
Department of Psychiatry, Geneva University Hospital, 1205 Geneva, Switzerland
3
Institute of Global Health, Geneva University, 1211 Geneva, Switzerland
4
Addiction Medicine, Department of Psychiatry, Lausanne University Hospital, 1011 Lausanne, Switzerland
5
Faculty of Biology and Medicine, Lausanne University, 1005 Lausanne, Switzerland
6
Department of Psychology, Université du Québec à Montréal, Montreal, CP 8888, Canada
7
Institute for Social Management, Social Policy and Prevention, Lucerne University of Applied Sciences and Arts, 6002 Lucerne, Switzerland
8
Research Center, Montreal University Institute of Mental Health, Montreal, QC H3C 3P8, Canada
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(23), 9054; https://doi.org/10.3390/ijerph17239054
Submission received: 27 August 2020 / Revised: 23 November 2020 / Accepted: 27 November 2020 / Published: 4 December 2020

Abstract

:
Background: Internet gambling may increase rates of gambling harm. This current study aimed to assess Internet poker players’ views on various harm-reduction (HR) strategies. It also examined differences in these views according to the games played (poker only vs. poker plus other gambling activities), indebtedness, and problem gambling severity. Methods: Internet poker players (n = 311; 94.2% Male) recruited online between 2012 and 2014 were included in the analyses and completed a survey on indebtedness, problem gambling severity index, and ten statements regarding HR features. Results: Among the whole sample, the most frequently endorsed HR strategy was setting money limits, specialized online help, and peer support forums. People who play poker only (70%) are less prone to endorse the utility of information on excessive gambling and specialized healthcare centers. No differences were found between those people with debt versus those without regarding HR assessment. Participants with severe problem gambling were more skeptical about HR strategies based on information on specialized healthcare centers. Conclusion: Setting money limits, online help, and peer support forums are the most commonly endorsed strategies. Future research is needed to evaluate the effectiveness of online harm reduction strategies.

1. Introduction

1.1. Poker Characteristics

Poker is a competitive social gambling card game of skill and luck. The game includes a wide range of challenging strategic and interpersonal choices in a context of risk and uncertainty [1]. In the last few years, poker has turned into a multi-million-dollar industry [2].
Due to its unique game characteristics and the players‘ psychological and behavioral specificity, poker can be considered different from other gambling games [3]. Research with land-based gamblers has found that poker players and casino gamblers differ on measures of novelty seeking and gambling problems which were found to be higher and more frequent in the former than in the latter [4]. Furthermore, in a game of skill such as poker, players may overestimate their capacity to win (perceived skills) while relating their loss to bad luck [5]. Therefore, poker activity challenges existing theoretical concepts about problem gambling behaviors [3].
High rates of problem gambling and indebtedness were repeatedly reported among on-line gamblers [6]. However, using a simple dichotomy of online versus offline gamblers to examine the impact of Internet gambling seems inadequate according to some authors [7]. One may speculate that a broader taxonomy of online poker gamblers may exist ranging from those who play poker only to those who play poker and other games. With regard to problematic gambling, previous studies of poker players have identified the number of gambling activities as contributing to gambling problems [8,9].

1.2. Harm Reduction Strategies

Even if the group of online poker players is not homogeneous, it is crucial to develop customized harm reduction (HR) features that target this specific group of gamblers. HR-initiatives and programs are designed to reduce the magnitude of gambling-related harm by assisting gamblers with various strategies including helping gamblers to maintain their gambling expenditure within affordable limits [10]. There is currently a large variation in the type and extent of responsible gambling and HR features for Internet gambling [11,12]. Effective interventions are crucial to assist gamblers at various levels of risk. They can allow them to acquire and apply the requisite skills and knowledge in order to maintain their gambling within affordable limits [13].
Since the main goal of a HR program is to prevent gambling-related harms, programs should inter alia provide information that consumers could use to make decisions [14]. Thus, gamblers should receive: (a) information about the dangers of excessive gambling and how to avoid them; (b) resources for help-seeking; (c) information about how games really work, and; (d) education regarding common misconceptions that encourage false beliefs about the probabilities of winning [15]. Nevertheless, some mixed results showed that information [16] and awareness campaigns hardly modify irrational beliefs or gambling behavior.
One of the most widely used public health strategies for reducing harm from gambling is prevention messages. Messaging seeks to elicit direct changes in behaviors/beliefs and may inform the public of associated risks or programs. With recent technological changes in gambling products, it is hypothesized that customized messages may be more effective than a one-size-fits-all messaging program. Tailoring the messages to specific player groups could increase their acceptability (i.e., skilled-game gamblers prefer more direct communication) [13]. Internet gambling allows delivering in-game tailored warning signs for prolonged play or high expenditure, including possible player behavioral tracking and personalized feedback as well as alerts (warning messages) during the game sessions [17,18]. In spite of possible negative perception by some gamblers (disruption of game enjoyment) [17], such messages are expected to be potentially helpful.
One of the more widespread types of social responsibility tools concerns limits setting [19]. The goal of this tool is to enable gamblers to pre-set monetary and time limits in a non-emotional state to assist them in spending only as much as they can afford to lose. Depending on the gaming venue or website, spending limits can include deposit, play, loss, win and bet limits. Time limits can be provided for a game session within daily, weekly, and monthly time frames [20]. However, there is mixed evidence on the impact of deposit limits for online gambling; some studies indicate reduced spending as a result, others show small or no effects [21]. Moreover, not all providers offer this option [1]. Overall, a distinction has to be made between voluntary and mandatory game limits. Voluntary limit setting tools allow players to pre-set the amount of time and/or money they wish to spend on gambling in a specified time period (typically per day and/or per calendar month) [22]. On the other hand, mandatory (i.e., operator-imposed) limits can include time and/or money spending thresholds (gambling opportunities are automatically blocked upon the reach of such thresholds) [23]. However, according to one study, operator-imposed limits are not always appropriate for at least some of the players [24].

1.3. Gamblers’ Attitudes towards Harm Reduction Strategies

Several studies have examined players’ attitudes towards limit-setting tools [13,22,25]. An evaluation of 50 online gambling sites revealed that monetary limit-setting tools are generally positively viewed because they encourage gamblers to reflect on the amount of time they spend gambling [26]. A recent study stressed that players were generally aware of the consumer protection tool and had accessed activity statements; even though few had used deposit limits or time-outs, the use of these restrictive tools was higher among those at-risk of gambling problems [21].
It seems that gamblers generally support the availability of HR tools, particularly those that assist customers to play within their means, including player feedback and regular financial statements. Customer engagement with HR tools, however, appears to be relatively low [13].
The Internet is not only changing gambling, but it also provides new opportunities for more interactive and in-game HR tools. It is therefore of particular interest to understand how Internet gamblers, and more specifically the emerging subgroup of Internet poker gamblers, consider the potential efficacy of such tools.

1.4. Aims

This research aims thus to preliminarily explore online poker gamblers’ attitudes concerning HR measures. Besides, the study focuses on the question of whether gamblers’ attitudes differ across groups with respect to the gamblers’ type of game (poker only versus poker plus other gambling activities), indebtedness, and the severity of problem gambling, with the hypothesis that such characteristics influence poker gamblers’ views on HR tools.

2. Materials and Methods

2.1. Participants and Procedure

The current study was a secondary analysis of a previously published study which aimed to identify latent groups of online gamblers from a number of social-related variables [27]. Adult Internet gamblers were recruited through advertisements posted in specialized poker dedicated forums and websites between January 2012 and March 2014. The questionnaires were completed anonymously online after obtaining informed consent online, without any compensation. The study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the Ethical Committee of the Geneva University Hospitals.
Of the 584 participants who took part in the survey, 311 online poker gamblers were retrieved for the purposes of this study and analyzed. The others were excluded because either they were off-line gamblers or not poker gamblers.

2.2. Measures

Participants were asked to give information on their demographics (age, gender) and gambling behaviors including the game type which allowed a comparison between pure poker players and mixed gamblers. It was, for instance, reported that gamblers who play skills and luck games had higher gambling severity scores and higher coping motivation for gambling than skill gamblers [28]. They also completed assessments of possible gambling-related debts in the past 12 months (adapted from the South Oaks Gambling Screen [29]) as well as the following measures:

2.2.1. The Problem Gambling Severity Index

Problem Gambling Severity Index (PGSI) was a nine-item measure of the severity of gambling problems. The scoring allowed a classification of individuals according to gambling risk: (0) no risk; (1–2) low risk; (3–7) moderate risk; and (8 through higher) problem gamblers [30].

2.2.2. Harm Reduction Items

The participants were asked about their attitude towards various HR measures. They were specifically asked about their perception of whether the measures could be helpful in reducing gambling-related harm. For this purpose, a set of various preventive measures offered by providers were put together. The participants responded to ten statements regarding gambling prevention strategies on a 5-points Likert scale: (1) this would not help at all, (2) this would be slightly helpful, (3) this would be moderately helpful, (4) this would be very helpful, (5) this would extremely helpful.

3. Data Analysis

In this study, we used an SPSS 25.0 (IBM, Chicago, IL, USA) software program. Descriptive statistics such as mean (SD), median (min, max), or percentages were reported for demographics and gambling characteristics in Table 1. We analyzed harm reduction strategies according to game type (Table 2), indebtedness (Table 3), and the problem gambling severity index (Table 4). Due to the small sample size, the five original categories of the HR items were reduced to three (items 2 and 3 respectively, 4 and 5 were collapsed) in order to increase statistical power and further validate statistical inferences. T-tests (or the median test when required) and Chi-square tests of homogeneity were performed to test for group differences. Significance was set at p = 0.05.
Because multiple statistical tests were performed within the same analysis, we adjusted the raw p-value by the number of tests to be conducted in order to maintain the overall Type I error rate. This was done using the Bonferroni correction method where the rejection criterion value of 0.05 was divided by the respective number of tests performed in each table. The new critical p-values were, therefore, rounded to the nearest two significant digits, 0.0038, 0.0045, and 0.0050 in Table 2, Table 3 and Table 4 respectively. The p-value in bold indicates that the null hypothesis had been rejected after the multiple-test correction was made.
Finally, when the omnibus Chi-square test was significant, we used adjusted standardized residuals, following a Bonferroni adjustment, and the ones exceeding 1.96 in absolute value helped identify those specific cells making the greatest contribution to the omnibus Chi-square result. If the criteria of +/− 1.96 were met, this would indicate that there were more/fewer participants in a condition than would be expected by chance [31,32].

Handling of Missing Data

As PGSI scores were missing in almost 18% of the cases, participants with missing observations on this variable were compared with those with complete data against selected gambling characteristics such as the time since gambling began, the number of hours spent gambling, indebtedness due to gambling, and source of income to make sure that no systematic differences existed between the two groups.
These missing observations explained why the totals did not match in the different tables.

4. Results

The sample included mostly men (94.2%) and the average age was 30.6 years (SD = 8.1). About 70% of the participants exclusively played poker online whereas the others were also involved in different kinds (one or more) of Internet gambling activities (e.g., 26.6% in sports betting, 6.2% in slot machines, 5.1% in lottery games, 9.7% in casino games, 7% other games) besides poker (data not shown). Other demographics and gambling characteristics of the sample are reported in Table 1.
When considering the whole sample in Table 2, only two HR measures were endorsed (the last category “would be very or extremely helpful” is considered as an endorsement) by at least 50% of the study participants: setting money limits (53.4%) and specialized online help (50.0%). Another kind of online help, peer support forums with other gamblers, was endorsed by 44% of the sample. Two of the items were endorsed by less than 30% of the participants: information on excessive gambling and its consequences (25.2%) and warnings based on playing time (28.3%).
Finally, the analyses of participants with missing data on the PGSI compared with those with complete observations showed no systematic difference between the two groups (output not shown).

4.1. Harm Reduction Items by Game Type

Table 2 shows the distribution of the gambling severity score, indebtedness status, and participants’ attitudes towards prevention measures by game type. The median test showed no statistically significant between-group difference regarding their gambling severity (Med = 2 and p = 0.5). However, a statistical between-group difference was observed for indebtedness: those playing online poker plus other games compared to online poker only were significantly more indebted (15.7% vs. 5.0%, χ2 (1) = 9.8 and p = 0.002). As far as the HR measures were concerned, there were significant statistical differences between online poker only and online poker plus other games in their answers to the first two preventive measures (χ2 (2) = 14, p = 0.001 and χ2 (2) = 10.4, p= 0.006 respectively). Adjusted standardized residuals showed that responses 1 and 2 were the ones that significantly contributed to the omnibus Chi-square result. Indeed, there were more participants in the poker only condition which rated that HR1 “information on excessive gambling and its consequences” would be moderately or slightly helpful compared to the other conditions (68.4% vs. 43.3%), whereas people playing online poker plus other games were more likely than the other group to endorse this proposition (40.3% vs. 19.3). The same distribution was observed regarding the HR2 measure on specialized healthcare centers: 60.0% vs. 37.3% were skeptical about this proposal while 50.7% vs. 34.1% endorsed it. Group membership did not differentiate the other prevention items.

4.2. Harm Reduction Items by Indebtedness Status

In Table 3, women represented less than 8% of indebted players. Regarding the PGSI score, the median test was statistically significant between the indebted and the non-indebted players (p < 0.001). It showed a wider range in the indebted group compared to the non-indebted one [(0–27) vs. (0–15)]. Group membership differentiated none of the preventive measures.

4.3. Harm Reduction Items by Problem Gambling Severity Index (PGSI)

Table 4 shows how HR measures were distributed according to the participants’ PGSI severity index. There was a significant between-group difference regarding indebtedness (χ2 (2) = 73.4, p < 0.001). Adjusted standardized residuals showed that people with moderate problem gambling were more likely to be indebted than those with low or without problem gambling (8.8% vs. 0.7%). Similarly, people with severe problem gambling tended to be overrepresented in the indebted group when compared to those with moderate or no problem gambling (60% vs. 8.8% respectively 60% vs. 0.7%). As far as the HR measures were concerned, there was a significant group difference (χ2 (4) = 9.8, p = 0.04) for the second one only (information on specialized healthcare centers). Adjusted standardized residuals showed that people with severe problem gambling compared to those without or low levels of problem gambling (26.7% vs. 5.3) were more skeptical (would not help at all) about this proposal. There were no other significant differences.

5. Discussion

The aim of this study was to examine online poker gamblers’ attitudes concerning HR measures. Besides, the study examined whether gamblers’ attitudes differ across groups related to the type of game (poker only versus poker plus other gambling activities), and to what extent the attitude is influenced by the degree of indebtedness and gambling-related problems.
First, when considering all participants, the proposed strategies were endorsed to some extent varying from 25% to 53% of the participants. None of the HR measures were completely rejected by the participants. Three of them received around 50% endorsement rates, namely, setting money limits, automatic block after losing or wagering a certain amount of money (mandatory limit), and specialized online help.
Given that playing poker is a more time-consuming game than almost all other forms of gambling, it could be argued that voluntary limit setting impacting on the duration of play would be a desirable outcome of limit-setting for this particular type of player [33]. Nonetheless, setting time limits, as shown in other studies [34], was less endorsed than monetary limits [34]. An automatic block when mandatory money limits were wagered and/or lost was considered a helpful strategy by almost 50% of the sample. Messages and warnings related to money limits were also endorsed by about 45% of the sample indicating that Internet poker gamblers consider such interactive in-game tracking and interventions [35] as possibly helpful. Endorsement of online help has to be considered with specific attention as it requires the development of Internet interventions dedicated to gambling problems [36,37,38,39,40]. Internet-delivered treatments for gambling problems could be particularly helpful to fill the treatment gap faced by people with gambling disorders [41]. Internet-based interventions could have very different forms such as web format [38,42], smartphone apps [40,43], or specialized email or video call support. Future studies may further assess different kinds of assistance, their acceptability, usability, and effectiveness. The results at hand, however, at least argue for the indication of some online HR support on the Internet by gamblingoperators. Finally, in consideration of the important comorbidity between gambling disorders and other psychiatric disorders [44,45], possible transdiagnostic interventions (i.e., focusing on emotion regulation) [46] might also be helpful.
A substantial proportion (50%) of the participants also endorsed online peer support as a helpful tool. Online gambling communities are widely used by gamblers and specifically by people with pathological gambling disorders [47]. However, the gambling communities seem rather orientated towards sharing gambling tips than on HR or recovery. Therefore, it was supposed to increase the risk of gambling problems [47] by maintaining gambling fallacy rather than increasing control over gambling [48]. Nevertheless, it seems, according to the present results, that peer support is also viewed by poker players as a helpful strategy as reported for other addictive disorders [37].
Second, people who play poker plus other games, in comparison to those playing poker only, more frequently endorse items related to psychoeducation (information on gambling-related risks and on specialized healthcare centers). They are also more frequently indebted and have a higher score on the PGSI. It seems that those participants are at higher risk for such problems and value more such kind of help. One may hypothesize that information on specialized healthcare centers would include not only local addresses but possibly also information on how such centers could help reduce stigma and shame associated with gambling treatment venues. In addition, indebted participants more frequently endorsed items related to specialized help (clinical centers and online help). Similarly, the group with the greatest problem gambling level endorsed more frequently than the other poker players the item related to information on specialized healthcare. It seems that gamblers facing problems consider the need for specialized interventions. However, looking at the whole sample, a large part of the participants were skeptical regarding the efficacy of the proposed interventions. Similar findings were reported in another study showing that less than half of the sample considered that monetary-loss limits could be helpful [22]. The finding is possibly influenced by public stigma related to gambling disorders [49], lack of knowledge about possible HR strategies, lack of metacognitive capacity to question possible biases or irrational beliefs or previous unsuccessful experiences. Acceptability and effectiveness, as well as the availability of the different tools, should be assessed and repetitively improved taking into account users’ views and needs.
In spite of concerns related to the specific needs of female gamblers [50,51], it is difficult to draw any conclusion on gender-specific needs from the data at hand due to the small number of women involved in the study. In comparison to men, women are possibly more prone to consider online gambling as safer, less intimidating, anonymous, and more acceptable than places like a physical casino, bar, or race track [52]. Previously, problem gambling in women was associated with a feeling of loneliness [27]. In consideration of such findings, specific views on the needs of female Internet gamblers should be further assessed.

6. Limits of the Study

The results of the study should be read with several limitations in mind, particularly its cross-sectional design. Participants were recruited from the Internet and may gamble on poker from different websites and different countries with various policies and harm reduction tools. This study did not include all possible strategies. For instance, in consideration of the high number of available websites for gambling, a self-exclusion strategy was not included [53]. Furthermore, the proposed strategies are mostly related to what players can do themselves to prevent gambling-related risks. Such HR strategies are in coherence with the so-called “responsible gambling perspective” [54,55]. This perspective is, however, criticized because it focuses on the gambler’s responsibility only, without taking into account structural aspects of the games as well as gambling products and commercial practices [56,57].
In addition, when comparing the participants according to the three characteristics (poker only versus poker plus other games, indebtedness, gambling severity), only a few significant differences emerged across the groups, which might be due to the small sample size in some groups and the related lack of power. The study is based on self-assessment methods and lacks details about gambling frequency, however, weekly hours spent on Internet gambling as well as PGSI are assessed. Furthermore, due to the online recruitment method, the study was subjected to self-selection biases [58]. Finally, further studies may assess Internet gamblers’ use of the different harm-reduction strategies in real-time using methods like behavioral tracking data analyses.

7. Conclusions

Information-related strategies were rarely endorsed by poker gamblers in comparison to more structural ones. The possible efficacy of some of the tools could be also influenced by other factors such as impulsivity [59]. Future research is needed to evaluate the effectiveness of HR strategies, including limit-settings, with the aim of increasing the effectiveness and acceptability of such interventions in representative samples of gamblers [20,60]. HR strategies may also benefit from perspectives acknowledging the socio-cultural influences on Internet-gambling related harm [61]. Involving users in the development and assessment of the results highlights the importance of involving users in the assessment of HR strategies. This finding is in accordance with calls and studies in the psychiatric and addictive disorders fields [62,63] showing the importance of user-involvement approaches. Involving Internet gamblers in HR conception and assessment could be by itself a dynamic and continuous structural HR strategy.
Most of the HR strategies reported in the present study were endorsed by the participants across different levels of gambling severity suggesting possible usefulness also among the lower risk group of gamblers. The effectiveness of such interventions is however limited by the extent to which gamblers are prone to use the systems when they need it.
HR strategies could be further improved by better awareness of emotional reactivity during game sessions and their possible impact on players’ loss of control [64]. In addition to effective HR tools, other preventative population approaches, such as supply reduction or less addictive gambling design, are needed to reduce the global burden of problem Internet gambling [12].

Author Contributions

Conceptualization, Y.K.; Funding acquisition: Y.K.; Writing Original draft, P.M., P.I., A.C., M.D., L.R., S.L., Y.K.; Formal analysis: A.C.; Writing, reviewing and editing: All authors. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by a grant from a Swiss Inter-Cantonal program aiming to prevent gambling addiction (PILDJ).

Conflicts of Interest

The authors declare that they have no conflict of interest.

References

  1. Khazaal, Y.; Chatton, A.; Bouvard, A.; Khiari, H.; Achab, S.; Zullino, D. Internet poker websites and pathological gambling prevention policy. J. Gambl. Stud. 2013, 29, 51–59. [Google Scholar] [CrossRef] [PubMed]
  2. Fiedler, I.; Wilcke, A.C. The market for online poker. UNLV Gaming Res. Rev. J. 2011, 16, 7–20. [Google Scholar] [CrossRef]
  3. Moreau, A.; Chabrol, H.; Chauchard, E. Psychopathology of online poker players: Review of literature. J. Behav. Addict. 2016, 5, 155–168. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Welte, J.W.; Barnes, G.M.; Tidwell, M.C.; Hoffman, J.H. The association of form of gambling with problem gambling among American youth. Psychol. Addict. Behav. 2009, 23, 105–112. [Google Scholar] [CrossRef] [Green Version]
  5. Barrault, S.; Varescon, I. Cognitive distortions, anxiety, and depression among regular and pathological gambling online poker players. Cyberpsychol. Behav. Soc. Netw. 2013, 16, 183–188. [Google Scholar] [CrossRef]
  6. Hakansson, A.; Widinghoff, C. Over-indebtedness and problem gambling in a general population sample of online gamblers. Front. Psychiatry 2020, 11, 7. [Google Scholar] [CrossRef] [Green Version]
  7. Wardle, H.; Moody, A.; Griffiths, M.; Orford, J.; Volberg, R. Defining the online gambler and patterns of behaviour integration: Evidence from the British Gambling Prevalence Survey 2010. Int. Gambl. Stud. 2011, 11, 339–356. [Google Scholar] [CrossRef]
  8. Dufour, M.; Morvannou, A.; Brunelle, N.; Kairouz, S.; Laverdière, É.; Nadeau, L.; Berbiche, D.; Roy, É. Gambling problem trajectories and associated individuals risk factors: A three-year follow-up study among poker players. J. Gambl. Stud. 2020, 36, 355–371. [Google Scholar] [CrossRef]
  9. Morvannou, A.; Dufour, M.; Brunelle, N.; Berbiche, D.; Roy, E. One-year prospective study on passion and gambling problems in poker players. J. Gambl. Stud. 2018, 34, 379–391. [Google Scholar] [CrossRef]
  10. Simon, O.; Savary, J.F.; Guarrasi, G.; Dickson, C. Defining harm reduction as part of a public health approach towards gambling. In Harm Reduction for Gambling: A Public Health Approach; Bowden-Jones, H., Dickson, C., Dunand, C., Simon, O., Eds.; Routledge: London, UK, 2019; pp. 71–77. [Google Scholar]
  11. Haefeli, J.; Lischer, S.; Schwarz, J. Early detection items and responsible gambling features for online gambling. Int. Gambl. Stud. 2011, 11, 273–288. [Google Scholar] [CrossRef] [Green Version]
  12. McMahon, N.; Thomson, K.; Kaner, E.; Bambra, C. Effects of prevention and harm reduction interventions on gambling behaviours and gambling related harm: An umbrella review. Addict. Behav. 2019, 90, 380–388. [Google Scholar] [CrossRef] [PubMed]
  13. Gainsbury, S.M.; Abarbanel, B.L.L.; Philander, K.S.; Butler, J.V. Strategies to customize responsible gambling messages: A review and focus group study. BMC Public Health 2018, 18, 1381. [Google Scholar] [CrossRef] [PubMed]
  14. Blaszczynski, A.; Ladouceur, R.; Shaffer, H.J. A science-based framework for responsible gambling: The Reno model. J. Gambl. Stud. 2004, 20, 301–317. [Google Scholar] [CrossRef] [PubMed]
  15. Blaszczynski, A.; Collins, P.; Fong, D.; Ladouceur, R.; Nower, L.; Shaffer, H.J.; Tavares, H.; Vénisse, J.-L.; Blaszczynski, A. Responsible gambling: General principles and minimal requirements. J. Gambl. Stud. 2011, 27, 565–573. [Google Scholar] [CrossRef] [PubMed]
  16. Williams, R.J.; Connolly, D. Does learning about the mathematics of gambling change gambling behavior? Psychol. Addict. Behav. 2006, 20, 62–68. [Google Scholar] [CrossRef] [Green Version]
  17. Blaszczynski, A.; Gainsbury, S.; Karlov, L. Blue gum gaming machine: An evaluation of responsible gambling features. J. Gambl. Stud. 2014, 30, 697–712. [Google Scholar] [CrossRef]
  18. Edgerton, J.D.; Keough, M.T.; Roberts, L.W. Co-development of problem gambling and depression symptoms in emerging adults: A parallel-process latent class growth model. J. Gambl. Stud. 2018, 34, 949–968. [Google Scholar] [CrossRef]
  19. Wood, R.T.A.; Griffiths, M.D. Social responsibility in online gambling: Voluntary limit setting. World Online Gambl. Law Rep. 2010, 9, 10–11. [Google Scholar]
  20. Ladouceur, R.; Shaffer, P.; Blaszczynski, A.; Shaffer, H.J. Responsible gambling: A synthesis of the empirical evidence. Addict. Res. Theory 2017, 25, 225–235. [Google Scholar] [CrossRef]
  21. Gainsbury, S.M.; Angus, D.J.; Procter, L.; Blaszczynski, A. Use of consumer protection tools on internet gambling sites: Customer perceptions, motivators, and barriers to use. J. Gambl. Stud. 2020, 36, 259–276. [Google Scholar] [CrossRef]
  22. Auer, M.; Reiestad, S.H.; Griffiths, M.D. Global limit setting as a responsible gambling tool: What do players think? Int. J. Ment. Health Addict. 2018, 1–13. [Google Scholar] [CrossRef] [Green Version]
  23. Auer, M.; Littler, A.; Griffiths, M.D. Legal aspects of responsible gaming pre-commitment and personal feedback initiatives. Gaming Law Rev. Econ. 2015, 19, 444–456. [Google Scholar] [CrossRef] [Green Version]
  24. Broda, A.; Laplante, D.A.; Nelson, S.E.; Labrie, R.A.; Bosworth, L.B.; Shaffer, H.J. Virtual harm reduction efforts for Internet gambling: Effects of deposit limits on actual Internet sports gambling behavior. Harm Reduct. J. 2008, 5, 27. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Griffiths, M.D.; Wood, R.T.; Parke, J. Social responsibility tools in online gambling: A survey of attitudes and behavior among Internet gamblers. Cyberpsychol. Behav. 2009, 12, 413–421. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Lucar, C.; Wiebe, J.; Philander, K. Monetary Limits Tools for Internet Gamblers: A Review of Their Availability, Implementation and Effectiveness Online; Ontario Problem Gambling Research Centre: Guelph, ON, Canada, 2012. [Google Scholar]
  27. Khazaal, Y.; Chatton, A.; Achab, S.; Monney, G.; Thorens, G.; Dufour, M.; Zullino, D.; Rothen, S. Internet Gamblers Differ on Social Variables: A Latent Class Analysis. J. Gambl. Stud. 2017, 33, 881–897. [Google Scholar] [CrossRef] [PubMed]
  28. Mathieu, S.; Barrault, S.; Brunault, P.; Varescon, I. The role of gambling type on gambling motives, cognitive distortions, and gambling severity in gamblers recruited online. PLoS ONE 2020, 15, e0238978. [Google Scholar] [CrossRef]
  29. Lesieur, H.R.; Blume, S.B. The South Oaks Gambling Screen (SOGS): A new instrument for the identification of pathological gamblers. Am. J. Psychiatry 1987, 144, 1184–1188. [Google Scholar]
  30. Ferris, J.; Wynne, H. The Canadian Problem Gambling Index: Final Report; Canadian Centre on Substance Abuse: Ottawa, ON, Canada, 2001. [Google Scholar]
  31. Sharpe, D. Your Chi-square test is statistically significant: Now what? Pract. Assess. Res. Eval. 2015, 20, 2–10. [Google Scholar]
  32. Kline, R.B. Beyond Significance Testing: Statistics Reform in the Behavioral Sciences, 2nd ed.; American Psychological Association: Washington, DC, USA, 2013. [Google Scholar]
  33. Auer, M.; Griffiths, M.D. Voluntary limit setting and player choice in most intense online gamblers: An empirical study of gambling behaviour. J. Gambl. Stud. 2013, 29, 647–660. [Google Scholar] [CrossRef] [Green Version]
  34. Kim, H.S.; Wohl, M.J.; Stewart, M.J.; Sztainert, T.; Gainsbury, S.M. Limit your time, gamble responsibly: Setting a time limit (via pop-up message) on an electronic gaming machine reduces time on device. Int. Gambl. Stud. 2014, 14, 266–278. [Google Scholar] [CrossRef] [Green Version]
  35. Auer, M.; Malischnig, D.; Griffiths, M. Is “pop-up” messaging in online slot machine gambling effective as a responsible gambling strategy? J. Gambl. Issues 2014, 1–10. [Google Scholar] [CrossRef] [Green Version]
  36. Fleming, T.; Bavin, L.; Stasiak, K.; Hermansson-Webb, E.; Merry, S.N.; Cheek, C.; Lucassen, M.; Lau, H.M.; Pollmuller, B.; Hetrick, S. Serious games and gamification for mental health: Current status and promising directions. Front. Psychiatry 2016, 7, 215. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Monney, G.; Penzenstadler, L.; Dupraz, O.; Etter, J.F.; Khazaal, Y. mHealth app for cannabis users: Satisfaction and perceived usefulness. Front. Psychiatry 2015, 6, 120. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Casey, L.M.; Oei, T.P.S.; Namrata, R.; Horrigan, K.; Day, J.J.; Ireland, M.; Clough, B.A. Internet-based delivery of cognitive behaviour therapy compared to monitoring, feedback and support for problem gambling: A randomised controlled trial. J. Gambl. Stud. 2017, 33, 993–1010. [Google Scholar] [CrossRef]
  39. Baumgartner, C.; Bilevicius, E.; Khazaal, Y.; Achab, S.; Schaaf, S.; Wenger, A.; Haug, S.; Keough, M.; Hodgins, D.; Schaub, M.P. Efficacy of a web-based self-help tool to reduce problem gambling in Switzerland: Study protocol of a two-armed randomised controlled trial. BMJ Open 2019, 9, e032110. [Google Scholar] [CrossRef] [Green Version]
  40. Khazaal, Y.; Monney, G.; Richter, F.S.A. «Jeu-contrôle», rationnel d’une application de soutien aux limites de jeux. J. Thérapie Comport. Cogn. 2017, 27, 129–137. [Google Scholar] [CrossRef]
  41. Queri, S.; Erbas, B.; Soyka, M. Treatment prevalence in pathological gambling. Fortschr. Neurol. Psychiatr. 2007, 75, 458–462. [Google Scholar] [CrossRef]
  42. Luquiens, A.; Tanguy, M.L.; Lagadec, M.; Benyamina, A.; Aubin, H.J.; Reynaud, M. The efficacy of three modalities of internet-based psychotherapy for non-treatment-seeking online problem gamblers: A randomized controlled trial. J. Med. Internet Res. 2016, 18, e36. [Google Scholar] [CrossRef]
  43. LeComte, T.; Potvin, S.; Corbière, M.; Guay, S.; Samson, C.; Cloutier, B.; Francoeur, A.; Pennou, A.; Khazaal, Y. Mobile apps for mental health issues: Meta-review of meta-analyses. JMIR mHealth uHealth 2020, 8, e17458. [Google Scholar] [CrossRef]
  44. Hakansson, A.; Karlsson, A.; Widinghoff, C. Primary and secondary diagnoses of gambling disorder and psychiatric comorbidity in the Swedish health care system—A nationwide register study. Front. Psychiatry 2018, 9, 426. [Google Scholar] [CrossRef] [Green Version]
  45. Lorains, F.K.; Cowlishaw, S.; Thomas, S.A. Prevalence of comorbid disorders in problem and pathological gambling: Systematic review and meta-analysis of population surveys. Addiction 2011, 106, 490–498. [Google Scholar] [CrossRef] [PubMed]
  46. Pennou, A.; Lecomte, T.; Potvin, S.; Khazaal, Y. Mobile intervention for individuals with psychosis, dual disorders, and their common comorbidities: A literature review. Front. Psychiatry 2019, 10, 302. [Google Scholar] [CrossRef] [PubMed]
  47. Sirola, A.; Kaakinen, M.; Oksanen, A. Excessive gambling and online gambling communities. J. Gambl. Stud. 2018, 34, 1313–1325. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  48. Khazaal, Y.; Chatton, A.; Billieux, J.; Bizzini, L.; Monney, G.; Frésard, E.; Thorens, G.; Bondolfi, G.; El-Guebaly, N.; Zullino, D.F.; et al. Effects of expertise on football betting. Subst. Abuse Treat. Prev. Policy 2012, 7, 18. [Google Scholar] [CrossRef] [Green Version]
  49. Hing, N.; Russell, A.M.; Gainsbury, S.M.; Nuske, E. The public stigma of problem gambling: Its nature and relative intensity compared to other health conditions. J. Gambl. Stud. 2016, 32, 847–864. [Google Scholar] [CrossRef] [Green Version]
  50. Corney, R.; Davis, J. The attractions and risks of Internet gambling for women: A qualitative study. J. Gambl. Issues 2010, 24, 121–139. [Google Scholar] [CrossRef] [Green Version]
  51. Husky, M.M.; Michel, G.; Richard, J.B.; Guignard, R.; Beck, F. Gender differences in the associations of gambling activities and suicidal behaviors with problem gambling in a nationally representative French sample. Addict. Behav. 2015, 45, 45–50. [Google Scholar] [CrossRef]
  52. McCormack, A.; Shorter, G.W.; Griffiths, M.D. An empirical study of gender differences in online gambling. J. Gambl. Stud. 2014, 30, 71–88. [Google Scholar] [CrossRef] [Green Version]
  53. Gainsbury, S.M. Review of self-exclusion from gambling venues as an intervention for problem gambling. J. Gambl. Stud. 2014, 30, 229–251. [Google Scholar] [CrossRef] [Green Version]
  54. Ladouceur, R.; Blaszczynski, A.; Shaffer, H.J.; Fong, D. Extending the Reno model: Responsible gambling evaluation guidelines for gambling operators, public policymakers, and regulators. Gaming Law Rev. Econ. 2016, 20, 580–586. [Google Scholar] [CrossRef]
  55. Ladouceur, R.; Shaffer, P.; Blaszczynski, A.; Shaffer, H.J. Responsible gambling research and industry funding biases. J. Gambl. Stud. 2019, 35, 725–730. [Google Scholar] [CrossRef] [PubMed]
  56. Van Schalkwyk, M.C.I.; Cassidy, R.; McKee, M.; Petticrew, M. Gambling control: In support of a public health response to gambling. Lancet 2019, 393, 1680–1681. [Google Scholar] [CrossRef]
  57. Wardle, H.; Reith, G.; Langham, E.; Rogers, R.D. Gambling and public health: We need policy action to prevent harm. BMJ 2019, 365, l1807. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  58. Khazaal, Y.; Van Singer, M.; Chatton, A.; Achab, S.; Zullino, D.F.; Rothen, S.; Khan, R.A.; Billieux, J.; Thorens, G. Does self-selection affect samples’ representativeness in online surveys? An investigation in online video game research. J. Med. Internet Res. 2014, 16, e164. [Google Scholar] [CrossRef] [PubMed]
  59. Freinhofer, D.; Schwartenbeck, P.; Thon, N.; Eigenberger, T.; Aichhorn, W.; Lenger, M.; Wurst, F.M.; Kronbichler, M. Deficient decision making in pathological gamblers correlates with gray matter volume in medial orbitofrontal cortex. Front. Psychiatry 2020, 11, 109. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  60. Harris, A.; Griffiths, M.D. A critical review of the harm-minimisation tools available for electronic gambling. J. Gambl. Stud. 2017, 33, 187–221. [Google Scholar] [CrossRef] [Green Version]
  61. Gordon, R.; Reith, G. Gambling as social practice: A complementary approach for reducing harm? Harm Reduct. J. 2019, 16, 64. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  62. Rummery, K. Healthy partnerships, healthy citizens? An international review of partnerships in health and social care and patient/user outcomes. Soc. Sci. Med. 2009, 69, 1797–1804. [Google Scholar] [CrossRef]
  63. Penzenstadler, L.; Soares, C.; Machado, A.; Rothen, S.; Picchi, A.; Ferrari, P.; Zullino, D.; Khazaal, Y. Advance statements to prevent treatment disengagement in substance use disorders. Can. J. Addict. 2019, 10, 10–18. [Google Scholar] [CrossRef]
  64. Moreau, A.; Sevigny, S.; Giroux, I.; Chauchard, E. Ability to discriminate online poker tilt episodes: A new way to prevent excessive gambling? J. Gambl. Stud. 2020, 36, 699–711. [Google Scholar] [CrossRef]
Table 1. Socio-demographics and gambling characteristics of the participants. Data are expressed as mean (±SD), median (range), or percentage.
Table 1. Socio-demographics and gambling characteristics of the participants. Data are expressed as mean (±SD), median (range), or percentage.
Sample main characteristics cccn = 311
Age30.6 (8.1)
Sex
- male94.2
Living status: I live
- alone27.1
- in a relationship31.3
- with my family32.3
- with friends2.9
- with roommates6.5
Annual income (in euros)
- less than 30,000 53.4
- between 30,000 and 50,00022.0
- more than 50,00024.6
I have been gambling on the Internet since:
- less than 2 years16.1
- between 2 and 5 years47.6
- more than 5 years36.3
Number of hours gambling in a week on the Internet15.0 (1–50)
Game types *
- poker99.7
- sports betting19.0
- casino7.1
- lottery3.9
- slot machines3.5
- scratching games3.2
- other1.9
Number of gaming sites visited in the last 3 months
- only one42.2
- more than one 57.8
In the last 12 months gambling has been:
- my main source of income14.5
- an ancillary source of income30.2
- not a significant source of income55.3
* Total exceeds 100% due to multiple responses.
Table 2. Harm reduction items by game type. Data are expressed as mean (±SD) or percentage.
Table 2. Harm reduction items by game type. Data are expressed as mean (±SD) or percentage.
All (n = 311)Online Poker Only (n = 222)Online Poker Plus Other Games (n = 89)p-Value a
Age30.6 (8.1)30.0 (7.8)32.2 (8.7)0.3
Sex
-male
94.294.593.20.6
Did you borrow money in the past twelve months to gamble or to pay for gambling debts? 0.002
- yes8.05.015.0
1. Information on excessive gambling and its consequences: 0.001
- this would not help at all13.412.316.4
- this would be slightly or moderately helpful61.368.443.3
- this would be very or extremely helpful25.219.340.3
2. Information on specialized healthcare centers: 0.006
- this would not help at all7.65.911.9
- this would be slightly or moderately helpful53.660.037.3
- this would be very or extremely helpful38.834.150.7
3.Setting individual time limits on Internet gambling sites: 0.3
- this would not help at all14.716.410.4
- this would be slightly or moderately helpful45.446.243.3
- this would be very or extremely helpful39.937.446.3
4. Messages and warnings based on playing time limits: 1.0
- this would not help at all 15.615.216.7
- this would be slightly or moderately helpful56.156.156.1
- this would be very or extremely helpful28.328.727.3
5. Gambling opportunities are automatically blocked after a set time (mandatory limit): 0.7
- this would not help at all19.721.116.4
- this would be slightly or moderately helpful39.139.238.8
- this would be very or extremely helpful41.239.844.8
6. Setting individual money limits, for instance, players can set their own money limit to gamble and to lose on their profile: 0.4
- this would not help at all5.54.77.6
- this would be slightly or moderately helpful41.143.527.1
- this would be very or extremely helpful53.451.857.6
7.Messages and warnings concerning the total amount wagered and lost: 0.5
- this would not help at all9.78.213.4
- this would be slightly or moderately helpful45.445.644.8
- this would be very or extremely helpful45.046.241.8
8.Gambling options are automatically blocked after a certain amount wagered and lost (mandatory limit): 0.6
- this would not help at all11.111.210.6
- this would be slightly or moderately helpful39.641.134.8
- this would be very or extremely helpful49.447.354.5
9.Offering online forums for discussion with other gamblers: 0.07
- this would not help at all 8.05.813.4
- this would be slightly or moderately helpful47.951.538.8
- this would be very or extremely helpful44.142.747.8
10.Online support with a specialist on a website dedicated to gambling problems 0.3
- this would not help at all7.15.810.4
- this would be slightly or moderately helpful42.945.635.8
- this would be very or extremely helpful50.048.553.7
ap-values result from Chi-square tests of homogeneity for categorical variables and T-tests for continuous variables respectively.
Table 3. Harm reduction items by indebtedness status. Data are expressed as a percentage.
Table 3. Harm reduction items by indebtedness status. Data are expressed as a percentage.
Indebted Players (n = 25)Non Indebted Players (n = 284)p-Value a
1.Information on excessive gambling and its consequences: 0.8
- this would not help at all11.113.8
- this would be slightly or moderately helpful55.661.5
- this would be very or extremely helpful33.324.8
2. Information on specialized healthcare centres: 0.1
- this would not help at all16.76.9
-this would be slightly or moderately helpful33.354.8
- this would be very or extremely helpful50.038.2
3. Setting individual time limits on Internet gambling sites: 1.0
- this would not help at all16.714.7
- this would be slightly or moderately helpful44.445.4
- this would be very or extremely helpful38.939.9
4. Messages and warnings based on playing time limits: 0.7
- this would not help at all22.215.2
- this would be slightly or moderately helpful50.056.2
- this would be very or extremely helpful27.828.6
5. Gambling opportunities are automatically blocked after a set time: 0.9
- this would not help at all22.219.7
- this would be slightly or moderately helpful33.339.4
- this would be very or extremely helpful44.440.8
6. Setting individual money limits, for instance, players can set their own money limit to gamble and to lose on their profile: 0.7
- this would not help at all5.65.6
- this would be slightly or moderately helpful50.040.3
- this would be very or extremely helpful44.454.2
7. Messages and warnings concerning the total amount wagered and lost: 1.0
- this would not help at all11.19.6
- this would be slightly or moderately helpful44.445.0
- this would be very or extremely helpful44.445.4
8. Gambling options are automatically blocked after a certain amount wagered and lost: 0.3
- this would not help at all012.1
- this would be slightly or moderately helpful50.038.6
- this would be very or extremely helpful50.049.3
9. Offering online forums for discussion with other distressed gamblers: 0.9
- this would not help at all5.68.3
- this would be slightly or moderately helpful44.447.7
- this would be very or extremely helpful50.044.0
10.Online support, with a specialist on a website dedicated to gambling problems 0.4
- this would not help at all5.67.3
- this would be slightly or moderately helpful27.843.6
- this would be very or extremely helpful66.749.1
ap-values result from Chi-square tests of homogeneity for categorical variables.
Table 4. Harm reduction items according to the Problem Gambling Severity Index (PGSI). Data are expressed as a percentage.
Table 4. Harm reduction items according to the Problem Gambling Severity Index (PGSI). Data are expressed as a percentage.
Non-Problem to Low Level of Problem Gambling (n = 148)Moderate Level of Problem Gambling (n = 93)High Level of Problem Gambling (n = 15)p-Value a
1. Information on excessive gambling and its consequences: 0.2
- this would not help at all12.812.226.7
- this would be slightly or moderately helpful57.168.953.3
- this would be very or extremely helpful30.118.920.0
2.Information on specialized healthcare centers: 0.04
- this would not help at all5.37.826.7
- this would be slightly or moderately helpful53.856.733.3
- this would be very or extremely helpful40.935.640.0
3. Setting individual time limits on Internet gambling sites: 0.6
- this would not help at all17.312.26.7
- this would be slightly or moderately helpful46.543.346.7
- this would be very or extremely helpful36.144.446.7
4. Messages and warnings based on playing time limits: 0.9
- this would not help at all15.914.420.0
- this would be slightly or moderately helpful57.654.453.3
- this would be very or extremely helpful26.531.126.7
5. Gambling opportunities are automatically blocked after a time set: 0.5
- this would not help at all21.816.720.0
- this be slightly or moderately helpful41.437.826.7
- this would be very or extremely helpful36.845.653.3
6. Setting individual money limits, for instance, players can set their own money limit to gamble and to lose on their profile: 0.5
- this would not help at all6.13.313.3
- this would be slightly or moderately helpful40.542.240.0
- this would be very or extremely helpful53.454.446.7
7. Messages and warnings concerning the total amount wagered and lost: 0.8
- this would not help at all9.010.013.3
- this would be slightly or moderately helpful48.941.140.0
- this would be very or extremely helpful42.148.946.7
8. Gambling options are automatically blocked after a certain amount wagered and lost: 0.9
- this would not help at all11.411.27.1
- this would be slightly or moderately helpful41.737.135.7
- this would be very or extremely helpful47.051.757.1
9. Offering online forums for discussion with other gamblers: 0.9
- this would not help at all
- this would be slightly or moderately helpful8.345.96.751.113.346.7
- this would be very or extremely helpful45.942.240.0
10.Online support, with a specialist on a website dedicated to gambling problems 0.6
- this would not help at all9.04.46.7
- this would be slightly or moderately helpful44.442.233.3
- this would be very or extremely helpful46.653.360.0
ap-values result from Chi-square tests of homogeneity for categorical variables.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Michalska, P.; Chatton, A.; Penzenstadler, L.; Izdebski, P.; Jeannot, E.; Simon, O.; Dufour, M.; Rochat, L.; Lischer, S.; Khazaal, Y. Perspective of Internet Poker Players on Harm-Reduction Strategies: A Cross-Sectional Study. Int. J. Environ. Res. Public Health 2020, 17, 9054. https://doi.org/10.3390/ijerph17239054

AMA Style

Michalska P, Chatton A, Penzenstadler L, Izdebski P, Jeannot E, Simon O, Dufour M, Rochat L, Lischer S, Khazaal Y. Perspective of Internet Poker Players on Harm-Reduction Strategies: A Cross-Sectional Study. International Journal of Environmental Research and Public Health. 2020; 17(23):9054. https://doi.org/10.3390/ijerph17239054

Chicago/Turabian Style

Michalska, Patrycja, Anne Chatton, Louise Penzenstadler, Paweł Izdebski, Emilien Jeannot, Olivier Simon, Magali Dufour, Lucien Rochat, Suzanne Lischer, and Yasser Khazaal. 2020. "Perspective of Internet Poker Players on Harm-Reduction Strategies: A Cross-Sectional Study" International Journal of Environmental Research and Public Health 17, no. 23: 9054. https://doi.org/10.3390/ijerph17239054

APA Style

Michalska, P., Chatton, A., Penzenstadler, L., Izdebski, P., Jeannot, E., Simon, O., Dufour, M., Rochat, L., Lischer, S., & Khazaal, Y. (2020). Perspective of Internet Poker Players on Harm-Reduction Strategies: A Cross-Sectional Study. International Journal of Environmental Research and Public Health, 17(23), 9054. https://doi.org/10.3390/ijerph17239054

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop