1. Introduction
Since acquired immunodeficiency syndrome (AIDS) was first reported in 1981, it quickly became a global epidemic. The current epidemiological characteristics of the AIDS epidemic have also changed. Populations at high risk for acquiring human immunodeficiency virus (HIV) infection have shifted to sexually active groups, including people with sexually transmitted infection (STI) [
1,
2]. While universal antiretroviral therapy for people living with HIV is recommended and does reduce mortality, it is a treatment and not a cure [
3]. Fortunately, the antiretroviral drug oral emtricitabine/tenofovir has been introduced as pre-exposure prophylaxis (PrEP), which helps reduce HIV transmission.
Before the advent of PrEP, public health measures to prevent HIV infection, such as condom use, antiretroviral therapy, male circumcision, and regular HIV testing of high-risk populations, achieved great success in preventing HIV transmission [
1]. However, the development of PrEP has brought AIDS prevention to another level, and its efficiency and safety has been proven in many clinical trials [
4,
5,
6,
7]. The initial clinical trials of PrEP have yielded different estimations of efficacy, which may be explained by varying population adherence. Two studies failed to demonstrate efficacy of PrEP, the Vaginal and Oral Interventions to Control the Epidemic (VOICE) trial with 29% population adherence, and the Preexposure Prophylaxis Trial for HIV Prevention among African Women (FEM-PrEP) trial with 37% population adherence [
8,
9]. Compared with other clinical trials, such as the Preexposure Prophylaxis Initiative (iPrEx) trial and the Partners Preexposure Prophylaxis (Partner PrEP) Study, where population adherence was above 50%, a low level of adherence may explain the findings in the VOICE and FEM-PrEP trials [
4,
10]. Nevertheless, medication adherence has an important role in the effectiveness of PrEP among people at high risk for HIV infection [
11,
12]. Various measures have been introduced in recent clinical studies to improve adherence, such as usage of short message service, medication level testing and electronic medicine containers with automated monitoring that remind patients to take their medication [
13]. Nevertheless, unlike clinical trials in which medication adherence can be monitored and a more supportive environment can be provided by researchers, medication adherence is difficult to assess previously in the real world.
There were many studies of self-reported medication adherence, and two main approaches of adherence measurements were used at present. One approach was measurement of medication-taking behavior, which was an objective but expensive and inconvenient measure for adherence to some extent [
14,
15]; the other approach was identifying patient’s non-adherence, a kind of subjective measurement including barriers or beliefs related to adherence [
16], such as the well-validated medication adherence scale, the Adherence Starts with Knowledge (ASK-20) scale and its brief version ASK-12, barrier items related to patient-report medication adherence and related behavior were identified [
17,
18]. In a previous study among transgender women sex workers, Wang explored the risk factors related to the daily use of free oral PrEP which was based on the theory of planned behavior (TPB) [
19], behavior intention towards PrEP was evaluated from three aspects, including attitude (positive attitude that benefits the PrEP adherence and negative attitude), subjective norm and perceived behavioral control. Behavior intention can be directly linked to actual behavior in the framework of TPB [
20]. Thus, we incorporated the TPB into the subjective adherence measurement as well as some developed adherence measurements in barriers and behaviors, in order to develop an easier, user-friendly and theoretical based tool for identifying PrEP adherence.
While many studies have assessed PrEP uptake and adherence as well as the sustainability of providing PrEP services for men who have sex with men or transgender women, patients with STI also require equivalent attention [
10,
19,
21,
22,
23,
24,
25,
26,
27,
28]. In a national review of the HIV infection epidemic trend in China, although the incidence of HIV infection was low among patients with STI, more HIV infections have been caused by heterosexual contact [
2]. Moreover, a recent STI infection has been reported to be a risk factor for poor PrEP adherence compared with gay-identified participants [
29]. Great benefits can be derived from promoting the use of PrEP where identifying medication adherence is inevitable.
Surprisingly, even though there was plenty of the literature concerning PrEP adherence, how to identify adherence in scale from reminders is less studied. In addition, considering the cost of PrEP was expensive and was known by people in the form of oral pill, we excluded the effect of PrEP cost which impeded the use of PrEP significantly, and assumed that PrEP was available for free in an oral way. Hence, what the free oral PrEP adherence questionnaire measured in our research was whether people would insist on PrEP prevention when oral PrEP is provided for free. Therefore, we chose STI patients as our targeted population, and aimed to validate a self-administrated free oral PrEP adherence questionnaire as well as to explore the predictive accuracy of the questionnaire, which would contribute to identifying patients’ adherence to PrEP in advance in a sexually transmitted infection setting. Thus, we could pay more attention to those with poorer adherence tendency and help them develop better PrEP adherence behaviors.
2. Methods
2.1. Participants
We recruited outpatients and inpatients who visited STI clinics on Wednesdays and Saturdays at two branch institutes of Shanghai Dermatology Hospital in the Jingan district (located on Qiujiang Road and Baode Road, respectively) from November 2017 to May 2018.
The inclusion criteria were met by patients aged over 18 years old with syphilis, gonorrhea, condyloma acuminatum, and genital herpes according to the latest revised STI prevention and management measures in China. All diagnoses (including clinical and laboratory diagnoses) were conducted by doctors in the hospital.
The exclusion criteria were as follows: (1) infected with HIV (2) serious psychological or cognitive diseases; (3) unconscious status; (4) unwilling to cooperate with researchers; (5) vision or hearing loss or poor reading ability, leading to little understanding of the purpose and content of this research.
2.2. Data Collection
Our research team recruited all physicians working at STI clinics in two cooperative Shanghai Dermatology Hospitals. All doctors were trained on how to select patients who met the inclusion and exclusion criteria of this study. After training, doctors were responsible for informing eligible patients about the purpose and content of this research and determining their willingness to participate. The interviewer team comprised senior undergraduate or graduate students recruited from Shanghai Jiao Tong University School of Medicine, who had experience with administering questionnaire surveys. The interviewer team was responsible for conducting face-to-face interviews with patients. All interviews were conducted twice a week over nearly 7 months.
In each interview, the interviewer team invited patients one by one to a quiet room, to keep patients focused on completing the questionnaire. The interview was comprised of three phases; during the first phase, patients were provided with an informed consent form to sign. Interviewers answered all patients’ concerns in principle. During the second phase, patients were required to complete the questionnaire on their own; no private information was collected during this process. In the third phase, interviewers verified the completed questionnaire to ensure no items were missed or ignored. At the end of the interview, patients receive a cash stipend (80 RMB, nearly 12 USD) in consideration of their cooperation in this study.
2.3. Measurement
The questionnaire included self-reported demographic characteristics, PrEP adherence questionnaire, and PrEP uptake behavior items, to evaluate patients’ adherence to PrEP [
19]. PrEP adherence questionnaire used in this research was original and self-administered, and eight items were included, based on factors found to be associated with free oral PrEP behavior in previous team work [
19]. Those eight items were used to measure participants’ attitudes, subjective norms, and perceived behavioral control based on the theory of planned behavior. Behavioral intention was measured using an additional question separated from the questionnaire, to predict the actual performance of individuals. Considering the conciseness and clarity of the questionnaire items, four subscales were established: benefits, barriers, peer support, and self-efficacy. Eight items were included, with two items for each subscale. Each item on the questionnaire was scored using a three-point scale: 0 points for “disagree”, 1 point for “unclear”, and 2 points for “agree”; the total score on the questionnaire was 16 points. Higher scores indicated higher adherence to PrEP. Both positive and negative questions were included, to reduce participants’ response bias to a certain extent. (Full questionnaire was shown in
Supplementary File S1).
Participants were asked the following question apart from the adherence questionnaire: Would you be willing to take PrEP on a daily basis during the following 6 months? There were five responses, corresponding to different degrees of PrEP behavioral intention (answers: 1 = definitely not, 2 = unlikely, 3 = neutral, 4 = likely, 5 = definitely will). Given that not all behavioral intentions translate into action [
30], we selected “definitely will” as the standard predicting positive behavior, in a conservative manner.
2.4. Statistical Analysis
For item analysis, we checked the normality via Shapiro–Wilk method, and all items did not pass the Shapiro–Wilk test. Thus, we used the critical ratio and Spearman correlation coefficient to test and evaluate the relevance and reliability of all items. In the calculation of critical ratio, participants were divided into two groups based on their total adherence scores: a high-adherence group (participants ranked among the 27% with the highest scores) and a low-adherence group (participants ranked among the 27% with the lowest scores). We conducted a t-test for scores of each item in the high- and low-adherence groups. A Spearman correlation test was conducted between each item score and the total score.
For reliability analysis, McDonald’s ω coefficient and the item reliability, if item dropped, were used to evaluate the internal consistency of the questionnaire.
A panel of eight experts specializing in population health and health behavior was invited to conduct the content validity analysis, scoring the relevance of each item to the corresponding content concept, the simplicity and clarity of each item, and the ambiguity of each item. In addition, the experts gave their opinions, based on a four-point scale, in evaluating the questionnaire using the content validity index (CVI), including the item-level CVI (I-CVI) and scale-level CVI (S-CVI).
For construct validity, factor analysis was performed. Samples were randomly divided into two groups. Group 1 (406 patients) was used for exploratory factor analysis (EFA) and Group 2 (410 patients) for confirmatory factor analysis (CFA). In the EFA, Bartlett’s test of sphericity and the Kaiser–Meyer–Olkin (KMO) value were applied for eligibility; principal component analysis was adopted to extract common factors. In the CFA, the maximum likelihood method was used to verify the fitness of the initial model. Goodness-of-fit indices such as χ2, degrees of freedom (df), p-value, root mean square error of approximation (RMSEA), goodness-of-fit index (GFI), adjusted goodness-of-fit index (AGFI), and comparative fit index (CFI) were adopted.
The value of average variance extracted (AVE) and construct reliability (CR) were used to evaluate convergent validity. We used the square root value of AVE and related analysis results to evaluate discriminant validity.
For predictive value and score translation, univariate logistic regression, hierarchical logistic regression, and receiver operating characteristic curve (ROC) analyses were carried out to assess the predictive value of adherence questionnaire scores in discriminating patients with positive behaviors (high-adherence group) and negative behaviors (low-adherence group), and to determine the cutoff score.
The data were analyzed using SPSS 25.0, AMOS 22.0, R 3.6.3, and MedCalc 19.0.
4. Discussion
Since the introduction of PrEP as primary prevention for HIV transmission, its efficacy is evident in rigorous clinical trials [
4,
10]. Nevertheless, it is important to maximize the use of PrEP to best prevent HIV transmission. Adherence is one factor that has an impact on PrEP efficacy [
1]. The aim of this research was to assess the reliability and validity of the free oral PrEP adherence questionnaire among patients with STI who did not have but were at high risk of HIV infection. Our results demonstrated that the PrEP adherence questionnaire had acceptable reliability and validity and could serve as a useful measurement to evaluate differences in PrEP adherence among patients with STI.
We conducted item analysis and evaluated reliability and validity in this study. In item analysis, items 3 and 4 showed disqualifying results, and should be eliminated according to the results of item analysis. However, the subscales of items 3 and 4 describe the factors that hinder adherence to PrEP, including drug side-effects and HIV stigma. The influence of these two factors on PrEP has been shown in previous studies [
24,
31,
32], which were also wide-used items that represented barriers on adherence in some developed medication adherence scale [
17,
18]. In Golub’s research, PrEP stigma was found to be highly associated with HIV stigma as PrEP is designed to prevent HIV infection [
32]. People tend to relate HIV stigma to concerns about being seen taking medicine by family or friends, and such concerns substantially impact adherence [
25,
33]. In our design of item 4, we mainly considered concerns from sexual partners, which could represent PrEP stigma to some extent. Meanwhile, we have analyzed the reasons for this situation. More specificity and clarity may be needed in the expressions of the questionnaire. Another issue that may account for this situation was that medication side-effects and HIV stigma were not the main barriers to PrEP among patients with STI. In general, considering the critical ratio value and correlation coefficient of items 3 and 4 were still statistically significant and previous research findings, we decided to reserve the room for future discussion about whether item 3 and item 4 should be eliminated. However, further investigation into barriers among the population with STI is required.
In reliability analysis, results for internal consistency and external reliability showed that the questionnaire has acceptable reliability. In validity analysis, we first carried out EFA. According to the questionnaire design, four common factors had to be extracted during this process. Through principal component analysis, four common factors with an aggregate variance contribution rate up to 79.838% were obtained, indicating that the variance caused by the four common factors can well explain variation in the variables measured in the questionnaire. In addition, the load of each item on the subscale to which it belongs was above 0.7, demonstrating that the classification of each item to its corresponding subscale was consistent with our design purpose. Furthermore, CFA indicated that the theoretical model, divided according to the designed four subscales, could explain the actual data but more fitness was still needed to improve the value of RMSEA in order to form a better validated questionnaire structure; the above results with acceptable convergent and discriminant validity indicated that the questionnaire has good structural validity to some extent. Furthermore, the results of logistic regression and ROC curve analysis demonstrated that the predictive value of the questionnaire has enough accuracy in practice. When the adherence score obtained by patients with STI reaches 9, we believe that the patient would perform well with good adherence. The same methods for evaluating the predictive value of indicators have been used previously [
34,
35,
36,
37].
To our knowledge, no scale for PrEP adherence for STI patients was validated before. We developed the validated free oral PrEP adherence questionnaire in order to evaluate patients’ adherence in advance, so that a patient with low adherence can be detected before starting PrEP prevention, and health workers could pay more attention to helping them, and thus could yield greater benefits by improving the efficiency of PrEP application.