Verification of the Effectiveness of a Communication Application in Improving Social Connectedness and Physical Health among Unacquainted Older Men: A Mixed-Methods Pilot Study
Abstract
:1. Introduction
2. Materials and Methods
2.1. Design
2.2. Definition of Terms
2.3. Research Participants
2.4. Intervention
2.5. Data Collection Method
2.5.1. Self-Administered Questionnaire Survey
2.5.2. Semi-Structured Interview
2.5.3. Logs from the Server
2.6. Data Analysis
2.6.1. Self-Administered Questionnaire Survey
2.6.2. Semi-Structured Interview
2.6.3. Logs from the Server
2.6.4. Combined Results from Quantitative and Qualitative Methods
2.7. Ethical Approval and Consent to Participate
3. Results
3.1. Characteristics of Research Participants
3.2. Usage of the Application
3.3. Social Connectedness Established through the Use of the App
3.3.1. Category 1: Sharing Posts Deepens Understanding and Impressions
“Participant I often participates in various events and posts… It seems that he has a sore throat, but he often takes various pictures and posts them, so I understand the pictures easily, even without his voice. It is easy to understand what he is doing.”—Participant A
3.3.2. Category 2: Familiarity Advances the Relationship
“I want to cherish the long-awaited encounter because we met and worked together by some kind of fate.”—ParticipantF
3.3.3. Category 3: Being Interested in the Unfiltered Lives of the Members
“The number of steps participant H takes daily is amazing. How does do it?”—Participant B
3.3.4. Category 4: Wanting Other Members to Gain Interest
“When members provide a topic such as a flower series or a cooking series, I want to get on it, but I have not done any cooking to take a photo... I know that daily meals are fine, but there is just something about posting them that makes me feel self-conscious.”—Participant B
“I go to play table tennis as soon as the gymnasium opens at 8:30 am. I wish I could take a picture that would make everyone thinks “How can an older person like them (participant H) do this?””—Participant H
3.3.5. Category 5: Feeling Motivated to Stay Active
“They are doing what I aim for. If I think they’re doing great at something, I want to make an effort to get as close as possible to it.”—Participant H
“By looking at the app, I can see that Participant H is walking more. I also want to increase the number of steps I take, so I take more walks than in the past. When visiting an acquaintance, I often walk instead of driving.”—Participant I
3.3.6. Category 6: Wanting More Than the Level of Interaction through the App Alone
“For now (because I cannot meet the members owing to COVID-19), I can only get in touch with them through this app, so I am still a little dissatisfied.”—Participant C
3.4. Loneliness
3.5. Impact of ICT Use on Health
3.5.1. Step Count
3.5.2. Subjective Health
3.5.3. Combined Results from Quantitative and Qualitative Methods
4. Discussion
4.1. New Social Connectedness Established through the App
4.2. Impact of ICT Use on the Health of Older Men
4.3. Limitations
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Toepoel, V. Ageing, leisure, and social connectedness: How could leisure help reduce social isolation of older people? Soc. Indic. Res. 2013, 113, 355–372. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Mullen, R.A.; Tong, S.; Sabo, R.T.; Liaw, W.R.; Marshall, J.; Nease, D.E., Jr.; Krist, A.H.; Frey, J.J. Loneliness in primary care patients: A prevalence study. Ann. Fam. Med. 2019, 17, 108–115. [Google Scholar] [CrossRef] [PubMed]
- World Health Organization. Advocacy Brief: Social Isolation and Loneliness among Older People. 2021; p. 2. Available online: https://www.who.int/publications/i/item/9789240030749 (accessed on 12 January 2023).
- O’Rourke, H.M.; Sidani, S. Definition, determinants, and outcomes of social connectedness for older adults: A scoping review. J. Gerontol. Nurs. 2017, 43, 43–52. [Google Scholar] [CrossRef] [PubMed]
- O’Rourke, H.M.; Collins, L.; Sidani, S. Interventions to address social connectedness and loneliness for older adults: A scoping review. BMC Geriatr. 2018, 18, 214. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Gyasi, R.M.; Phillips, D.R.; Asante, F.; Boateng, S. Physical activity and predictors of loneliness in community-dwelling older adults: The role of social connectedness. Geriatr. Nurs. 2021, 42, 592–598. [Google Scholar] [CrossRef]
- Itzick, M.; Kagan, M.; Zychlinski, E. The big five personality traits as predictors of loneliness among older men in Israel. J. Psychol. 2020, 154, 60–74. [Google Scholar] [CrossRef]
- Tsai, T.H.; Chang, H.T.; Chen, Y.J.; Chang, Y.S. Determinants of user acceptance of a specific social platform for older adults: An empirical examination of user interface characteristics and behavioral intention. PLoS ONE 2017, 12, e0180102. [Google Scholar] [CrossRef] [Green Version]
- Forsman, A.K.; Nordmyr, J. Psychosocial links between Internet use and mental health in later life: A systematic review of quantitative and qualitative evidence. J. Appl. Gerontol. 2017, 36, 1471–1518. [Google Scholar] [CrossRef]
- Hofer, M.; Hargittai, E. Online Social engagement, depression, and anxiety among older adults. New Media Soc. 2021. online first. [Google Scholar] [CrossRef]
- Cotten, S.R.; Anderson, W.A.; McCullough, B.M. Impact of internet use on loneliness and contact with others among older adults: Cross-sectional analysis. J. Med. Internet Res. 2013, 15, e39. [Google Scholar] [CrossRef]
- Johansson-Pajala, R.M.; Gusdal, A.; Eklund, C.; Florin, U.; Wagert, P.V. A codesigned web platform for reducing social isolation and loneliness in older people: A feasibility study. Inform. Health Soc. Care. 2022. online first. [Google Scholar] [CrossRef] [PubMed]
- Czaja, S.J.; Boot, W.R.; Charness, N.; Rogers, W.A.; Sharit, J. Improving social support for older adults through technology: Findings from the PRISM randomized controlled trial. Gerontologist. 2018, 58, 467–477. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Jerrome, D.; Wenger, G.C. Stability and change in late-life friendships. Ageing Soc. 1999, 19, 661–676. [Google Scholar] [CrossRef] [Green Version]
- Sims, T.; Reed, A.E.; Carr, D.C. Information and communication technology use is related to higher well-being among the oldest-old. J. Gerontol. B Psychol. Sci. Soc. Sci. 2017, 72, 761–770. [Google Scholar] [CrossRef] [Green Version]
- Far, I.K.; Ferron, M.; Ibarra, F.; Baez, M.; Tranquillini, S.; Casati, F.; Doppio, N. The interplay of physical and social wellbeing in older adults: Investigating the relationship between physical training and social interactions with virtual social environments. PeerJ Comput. Sci. 2015, 1, e30. [Google Scholar] [CrossRef] [Green Version]
- Baez, M.; Far, I.K.; Ibarra, F.; Ferron, M.; Didino, D.; Casati, F. Effects of online group exercises for older adults on physical, psychological and social wellbeing: A randomized pilot trial. PeerJ Comput. Sci. 2017, 5, e3150. [Google Scholar] [CrossRef] [Green Version]
- Cai, X.; Qiu, S.H.; Luo, D.; Li, R.X.; Liu, C.Y.; Lu, Y.H.; Xu, C.R.; Li, M.Z. Effects of peer support and mobile application-based walking programme on physical activity and physical function in rural older adults: A cluster randomized controlled trial. Eur. Geriatr. MedE. 2022, 13, 1187–1195. [Google Scholar] [CrossRef]
- Geraedts, H.A.E.; Zijlstra, W.; Zhang, W.; Bulstra, S.; Stevens, M. Adherence to and effectiveness of an individually tailored home-based exercise program for frail older adults, driven by mobility monitoring: Design of a prospective cohort study. BMC Public Health. 2014, 14, 570. [Google Scholar] [CrossRef] [Green Version]
- Schuster, A.M.; Cotton, S.R. Differences between employed and retired older adults in information and communication technology use and attitudes. Work Aging Retire. 2022, waac025, online first. [Google Scholar] [CrossRef]
- Seifert, A.; Charness, N. Digital transformation of everyday lives of older Swiss adults: Use of and attitudes toward current and future digital services. Eur. J. Ageing 2022, 19, 729–739. [Google Scholar] [CrossRef]
- Li, Y.Y.; Godai, K.; Kido, M.; Komori, S.; Shima, R.; Kamide, K.; Kabayama, M. Cognitive decline and poor social relationship in older adults during COVID-19 pandemic: Can information and communications technology (ICT) use helps? BMC Geriatr. 2022, 22, 375. [Google Scholar] [CrossRef] [PubMed]
- Williamson, E.J.; Walker, A.J.; Bhaskaran, K.; Bacon, S.; Bates, C.; Morton, C.E.; Curtis, H.J.; Mehrkar, A.; Evans, D.; Inglesby, P.; et al. Factors associated with COVID-19-related death using OpenSAFELY. Nature 2020, 584, 430–436. [Google Scholar] [CrossRef] [PubMed]
- Lebrasseur, A.; Fortin-Bédard, N.; Lettre, J.; Raymond, E.; Bussières, E.; Lapierre, N.; Faieta, J.; Vincent, C.; Duchesne, L.; Ouellet, M.; et al. Impact of the COVID-19 pandemic on older adults: Rapid review. JMIR Aging 2021, 4, e26474. [Google Scholar] [CrossRef] [PubMed]
- Wallinheimo, A.-S.; Evans, S.L. Patterns of Internet use, and associations with loneliness, amongst middle-aged and older adults during the COVID-19 pandemic. Healthcare 2022, 10, 1179. [Google Scholar] [CrossRef] [PubMed]
- Sandelowski, M. Whatever happened to qualitative description? Res. Nurs. Health 2000, 23, 334–340. [Google Scholar] [CrossRef]
- Abe, H.; Kamishima, T.; Ojima, R.; Onishi, R.; Hirano, M. Social and physical effects of a pedometer and communication application among older men: A mixed-methods, pre/post pilot study. Inf. Commun. Soc. 2021, 1–20, online first. [Google Scholar] [CrossRef]
- Morris, J.N.; Hardman, A.E. Walking to health. Sport. Med. 1997, 23, 306–332. [Google Scholar] [CrossRef]
- Ando, T.; Nagata, H.; Kodama, Y. Construction of a new loneliness scale and correlates of loneliness among middle aged and aged. Yokohama Kokuritu Daigaku Kyouiku Ningen Kagakubu Kiyou 2000, 3, 19–27, (In Japanese with English abstract). [Google Scholar]
- Ando, T.; Koike, T.; Takahashi, T. Correlates of loneliness among the elderly living alone in an urban area. Yokohama Kokuritu Daigaku Kyouiku Ningen Kagakubu Kiyou 2016, 18, 1–9, (In Japanese with English abstract). [Google Scholar]
- Creswell, J.W.; Clark, V.L.P. Designing and Conducting Mixed Methods Research, 3rd ed.; SAGE Publications, Inc: Thousand Oaks, CA, USA, 2017; p. 4. [Google Scholar]
- Vošner, H.B.; Bobek, S.; Kokol, P.; Krečič, M.J. Attitudes of active older internet users towards online social networking. Comput. Hum. Behav. 2016, 55, 230–241. [Google Scholar] [CrossRef]
- Lüders, M.; Brandtzæg, P.B. ‘My children tell me it’s so simple’: A mixed-methods approach to understand older non-users’ perceptions of social networking sites. New Media Soc. 2017, 19, 181–198. [Google Scholar] [CrossRef]
- Nimrod, G. Seniors’ online communities: A quantitative content analysis. Gerontologist 2010, 50, 382–392. [Google Scholar] [CrossRef] [PubMed]
- Groarke, J.M.; Berry, E.; Graham-Wisener, L.; McKenna-Plumley, P.E.; MuGlinchey, E.; Armour, C. Loneliness in the UK during the COVID-19 pandemic: Cross-sectional results from the COVID-19 Psychological Wellbeing Study. PLoS ONE 2020, 15, e0239698. [Google Scholar] [CrossRef]
- Cohen-Mansfield, J.; Hazan, H.; Lerman, Y.; Shalom, V. Correlates and predictors of loneliness in older-adults: A review of quantitative results informed by qualitative insights. Int. Psychogeriatr. 2016, 28, 557–576. [Google Scholar] [CrossRef] [PubMed]
- Koopman-Boyden, P.G.; Reid, S.L. Internet/E-mail usage and well-being among 65–84 year olds in New Zealand: Policy imply cations. Educ. Gerontol. 2009, 35, 990–1007. [Google Scholar] [CrossRef]
- McKenzie, S.K.; Collings, S.; Jenkin, G.; River, J. Masculinity, social connectedness, and mental health: Men’s diverse patterns of practice. Am. J. Men. Health 2018, 12, 1247–1261. [Google Scholar] [CrossRef]
- Bryant-Bedell, K.; Waite, R. Understanding major depressive disorder among middle-aged African American men. J. Adv. Nurs. 2010, 66, 2050–2060. [Google Scholar] [CrossRef] [Green Version]
- Okayama, Y.; Kimura, M.; Satoh, I.; Okuno, T.; Itoi, A.; Komatsu, M.; Kojima, K.; Morimoto, T. Seasonal differences in physical activity and eating behavior in the elderly in Tohoku district: A survey of participants in a health-promotion program for the elderly. Jpn. J. Biometeorol. 2004, 41, 77–85. (In Japanese) [Google Scholar] [CrossRef]
- Besser, L.M.; Dannenberg, A.L. Walking to public transit: Steps to help meet physical activity recommendations. Am. J. Prev. Med. 2005, 29, 273–280. [Google Scholar] [CrossRef] [Green Version]
- Harries, T.; Eslambolchilar, P.; Stride, C.; Rettie, R.; Walton, S. Walking in the wild: Using an always-on smartphone application to increase physical activity. In Proceedings of the IFIP Conference on Human-Computer Interaction, Cape Town, South Africa, 2–6 September 2013. [Google Scholar] [CrossRef] [Green Version]
- Zhou, J. Improving older people’s life satisfaction via social networking site use: Evidence from China. Australas. J. Ageing 2018, 37, E23–E28. [Google Scholar] [CrossRef]
- Leary, M.R.; Hoyle, R.H. (Eds.) Handbook of Individual Differences in Social Behavior; The Guilford Press: New York, NY, USA, 2009. [Google Scholar]
- Reifegerste, D.; Rossmann, C. Promoting physical activity with group pictures. Affiliation-based visual communication for high-risk populations. Health Commun. 2017, 32, 161–168. [Google Scholar] [CrossRef] [PubMed]
ID | Age | Living Arrangements | Duration of Residence (Years) | Care Need Levels | Final Education | Economic Situation | Previous Smartphone Experience |
---|---|---|---|---|---|---|---|
A | 70s | with spouse, child, and other family members | over 10 less than 20 | not applicable | junior college or university | slightly worried | Yes |
B | 70s | with spouse, child, and other family members | over 20 less than 30 | not applicable | university | slightly worried | Yes |
C | 70s | with spouse | over 20 less than 30 | not applicable | high school | not too worried | Yes |
D | 70s | with spouse | over 20 less than 30 | not applicable | junior college or university | not too worried | No |
E | 70s | with spouse | over 30 less than 40 | support level 2 | junior high school | not too worried | Yes |
F | 80s | with spouse, child, and other family members | over 10 less than 20 | not applicable | junior high school | slightly worried | No |
G | 80s | with spouse | over 30 less than 40 | not applicable | junior college or university | not too worried | No |
H | 80s | with spouse | less than 10 | not applicable | high school | not too worried | No |
I | 80s | with spouse | over 30 less than 40 | support level 1 | junior high school | not too worried | No |
1st Month | 2nd Month | 3rd Month | 4th Month | 5th Month | 6th Month | |
---|---|---|---|---|---|---|
ID | (Number of Days: 31) | (Number of Days: 30) | (Number of Days: 31) | (Number of Days: 31) | (Number of Days: 29) | (Number of Days: 31) |
A | 31 | 30 | 31 | 31 | 29 | 31 |
B | 31 | 30 | 31 | 31 | 29 | 31 |
C | 30 | 29 | 29 | 28 | 23 | 28 |
D | 27 | 5 | 11 | 15 | 11 | 15 |
E | 24 | 30 | 28 | 25 | 28 | 30 |
F | 30 | 25 | 29 | 28 | 27 | 26 |
G | 19 | 28 | 29 | 31 | 29 | 31 |
H | 25 | 30 | 30 | 31 | 29 | 31 |
I | 2 | 21 | 21 | 31 | 29 | 31 |
Category | Subcategory | Representative Quote |
---|---|---|
Sharing Posts Deepens Understanding and Impressions | Development of greater respect for others | Participant I frequently attends various events and posts about them… It seems that he has a sore throat, but he often takes various pictures and posts them, so I understand the pictures easily, even without his voice. It is easy to understand what he is doing. (Participant A) |
Listening to each other’s posts deepened their understanding of the members | I am inspired by other people’s posts. Even if it is the same scenery or photo, I feel that there are different ways of feeling and seeing. (Participant F) | |
Self-projecting onto other members’ posts and finding them relatable | I think a post like that (where we can hear their wife’s voice in the background) is fine. I think it’s great that it conveys a sense of life. (Participant C) | |
Familiarity Advances the Relationship | Familiarity with the members, by way of knowing what they are doing, later led to deeper face-to-face conversations | I can see that other people are absent on Saturdays and Sundays, and on the contrary, there are people who are active on Saturdays and Sundays. I wonder what kind of person he is. It may be easier to meet and talk because I understand that. (Participant I) |
Interaction through the app laid the foundation for face-to-face conversation | The other day, I happened to sit next to one of the members at a community gathering New Year’s party. It was then that he realized for the first time that she belonged to the same group. (Participant G) | |
The desire to become acquainted with each other grew during interactions through the app | I want to cherish the long-awaited meeting because we met and worked together by chance. (Participant F) | |
Sharing posts led to the desire to keep the group active | After listening to the post, I thought that I would like to cooperate with everyone who has the same idea to liven up the meeting. (Participant G) | |
Feeling a sense of familiarity through online interaction, even without meeting | Even if I cannot meet or go out because of the new coronavirus infection, it is fun to connect with the members by using the communication app. (Participant E) | |
Being Interested in the Unfiltered Lives of the Members | Wanting to know the voice of the members, not just see posts that look good | I think we can share our feelings. (I think it’s better to post what I think, even if I stumble or use short sentence.) (Participant C) |
Thinking about the members after seeing the posts and number of steps | The number of steps participant H takes every day is amazing. How does he do it? (Participant B) | |
Wanting Other Members to Gain Interest | Wanting to share things that look good, not just daily life activities | I can take unusual pictures if I go to a strange place. Because I cannot go out owing to COVID-19, I do not have any pictures to post. (Participant C) |
Feeling pressured to make a proper post | When members provide a topic, such as a flower series or a cooking series, I want to get on it, but I have not done any cooking to take a photo... I know that daily meals are fine, but there is just something about posting them that makes me feel self-conscious. (Participant B) | |
Wanting to positively impact other members through the app | I go to play table tennis as soon as the gymnasium opens at 8:30 am. I wish I could take a picture that would make everyone thinks “How can an older person like them (participant H) do this?” (Participant H) | |
Feeling glad about other members commenting on the posts | I’m glad that everyone praised my step count. (Participant H) I feel lonely when I don’t get a reaction to my post. (Participant A) | |
Feeling Motivated to Stay Active | Wanting to challenge each other with the number of steps walked and other posts, and make changes in their own life | They are doing what I aim for. If I think they’re doing great at something, I want to make an effort to get as close as possible to it. (Participant H) |
Wanting to get a reaction to their own daily activities and being able to sympathize with members | I want to publicize what I have done so far, such as what kind of conversation is necessary when interacting with people, how I have maintained my health, etc. (Participant G) | |
Wanting More Than the Level of Interaction Through the App Alone | The relationship cannot be developed by online interaction alone | For now, because I cannot meet the members owing to COVID-19, I can only get in touch with them through this app, so I am still a little dissatisfied. (Participant C) |
Loneliness | Subjective Health Status | |||
---|---|---|---|---|
ID | Before Intervention | After Intervention | Before Intervention | After Intervention |
A | 0 | 2 | 3 | 6 |
B | 0 | 0 | 8 | 7 |
C | 1 | 2 | 9 | 9 |
D | 1 | 1 | 8 | 8 |
E | 4 | 0 | 5 | 4 |
F | 2 | 1 | 7 | 7 |
G | 1 | 1 | 9 | 7 |
H | 0 | 0 | 10 | 7 |
I | 0 | 0 | 5 | 8 |
ID | 1st Month | 2nd Month | 3rd Month | 4th Month | |
---|---|---|---|---|---|
A | 3412.45 | 4185.23 | 3888.81 | 4460.45 | |
B | 9809.76 | 10432.9 | 11180.61 | 12021.52 | |
C | 3005.77 | 2102.43 | 1651.16 | 1742.74 | |
D | 5235.32 | 4432.44 | 5112.52 | 5940.26 | |
E | 3474.96 | 6071.9 | 5098.81 | 5289.11 | |
F | 3417.48 | 3215.7 | 3760.29 | 2873.72 | |
G | 580.87 | 2354.63 | 2548.87 | 1775.45 | |
H | 9812.9 | 14323.5 | 14641.23 | 17579.84 | |
I | 0.18 | 545.57 | 275.35 | 538.26 | |
1st and 2nd month | 3rd and 4th month | p value | |||
(Mean ± SD) | (Mean ± SD) | ||||
Number of steps | 4780.78 ± 3797.66 | 5840.22 ± 4840.54 | 0.038 a |
Goal | Quantitative Results | Qualitative Results | Interpretation |
---|---|---|---|
Establishing social connectedness | The average loneliness scores before and after the intervention were 1.00 ± 1.25 points and 0.77 ± 0.79 points, respectively. | Category 1: Sharing Posts Deepens Understanding and Impressions Category 2: Familiarity Advances the Relationship Category 3: Being Interested in the Unfiltered Lives of the Members Category 4: Wanting Other Members to Gain Interest Category 6: Wanting More Than the Level of Interaction Through the App Alone | At the time of the baseline assessment, participants had a low level of loneliness. As all the participants lived with their families, it is probable that a low level of loneliness was maintained. However, during the intervention period, the COVID-19 infection spread, which included the period of quarantine. Therefore, the feeling of loneliness was likely to increase during the period of high COVID-19 infections. However, it is presumed that participants were able to maintain a low level of loneliness even during the COVID-19 pandemic by building social connectedness with the members. Unlike social isolation, loneliness is a subjective index; therefore, interacting with members through the app could enable them to feel a connection with people. As shown in Category 6, it can be difficult to maintain favorable connections among participants with long-term ICT-only interactions. |
Improving their physical health | The average number of steps in the third and fourth months was significantly higher than that of the first two months (5840.22 ± 4840.54 versus 4780.78 ± 3977.66, respectively; p = 0.038). The average subjective health rating before the intervention was 7.1 ± 2.18 points and that after the intervention was 7.0 ± 1.33 points. | Category 4: Wanting Other Members to Gain Interest Category 5: Feeling Motivated to Stay Active | Participants wanted to post and have a positive health impact on other participants who viewed it. Participants who saw the posts of others found an opportunity to improve their physical activities. Furthermore, it is possible that the influence of the affiliation motivation to approach the state and maintain the relationship by being aware of others who have a higher step count contributed to their own increases. |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Shinokawa, S.; Abe, H.; Takashima, R.; Onishi, R.; Hirano, M. Verification of the Effectiveness of a Communication Application in Improving Social Connectedness and Physical Health among Unacquainted Older Men: A Mixed-Methods Pilot Study. Int. J. Environ. Res. Public Health 2023, 20, 1884. https://doi.org/10.3390/ijerph20031884
Shinokawa S, Abe H, Takashima R, Onishi R, Hirano M. Verification of the Effectiveness of a Communication Application in Improving Social Connectedness and Physical Health among Unacquainted Older Men: A Mixed-Methods Pilot Study. International Journal of Environmental Research and Public Health. 2023; 20(3):1884. https://doi.org/10.3390/ijerph20031884
Chicago/Turabian StyleShinokawa, Sakino, Hiroki Abe, Risa Takashima, Ryuta Onishi, and Michiyo Hirano. 2023. "Verification of the Effectiveness of a Communication Application in Improving Social Connectedness and Physical Health among Unacquainted Older Men: A Mixed-Methods Pilot Study" International Journal of Environmental Research and Public Health 20, no. 3: 1884. https://doi.org/10.3390/ijerph20031884
APA StyleShinokawa, S., Abe, H., Takashima, R., Onishi, R., & Hirano, M. (2023). Verification of the Effectiveness of a Communication Application in Improving Social Connectedness and Physical Health among Unacquainted Older Men: A Mixed-Methods Pilot Study. International Journal of Environmental Research and Public Health, 20(3), 1884. https://doi.org/10.3390/ijerph20031884