Self-Reflection and Peer-Assessments Effect on Pharmacy Students’ Performance at Simulated Counselling Sessions
Abstract
:1. Introduction
2. Materials and Methods
2.1. Study Setting
2.2. Data Collection
2.3. Data Analysis
3. Results
3.1. Learning Style
3.1.1. Gradual Introduction to Assessment
That was nice how kind of gradually ramped up like it started off as it wasn’t assessed and then the next [one] we did, just the labels and then you did the labels and the counselling and then you do counselling for all of them.Student 5, focus group 6.
3.1.2. Learning through Self-Reflection Videos
I find the video, like the one video is actually quite helpful because you can go back and look at your expressions and your body language and that sounds.Student 3, focus group 7.
That thing where you see someone else or you’re like Oh but why’d they do this. But then when you see a video of yourself you like right there and that’s where you like you know you do make mistakes.Student 3, focus group 9.
In saying that, the video was good because during the video you would stuff up, you redo it, redo it chance to practice other than the actual scenarios themselves whichever so this is a good way to practice it without having the pressure of the marks there but then having to get the grading criteria that’s a bit tedious.Student 5, focus group 8.
3.1.3. Learning through Authentic Assessment
Not having every resource there it’s just more of what you find in class and what you remember and forcing yourself to do that. Is going to help you in a practical sense where you don’t always have your AMH on you when you’re talking to a patient. And so this is a very realistic exposure to that sort of situation and did help from the first week.Student 3, focus group 7.
If our week-to-week scenario was more like an OSCE question where we would be given the scenario, we are able to browse through our resources and find the answer instead of just having to memories all the ancillary labels.Student 5, focus group 8.
3.1.4. Individual Learning Compared to Group Learning
I feel like a lot more people were responsible in doing the prework and coming prepared, I found a lot more people were prepared then if it was group-based learning where it would be easier to rely on another person.Student 1, focus group 1.
I liked that it actually helps you, like it forces you to practice…which is really beneficial for a lot of people.Student 2, focus group 6.
3.1.5. Learning through Observation of Best Practice
I like to listen to someone do it first and I like to be like Oh I like that and then I’ll take it. But I don’t know, I feel like maybe a suggestion like I know we don’t have that much time during labs but maybe if two demos just demonstrate what is a good counselling session because I’ve never really heard what’s good like what is good.Student 6, focus group 6.
3.2. Feedback
3.2.1. Inconsistent Feedback
Some tutors prompt you and some don’t and then that determines whether you pass or fail.Student 5, focus group 4.
So, it’s a bit of discrepancy between what assessors are looking for as well which I found a bit frustrating to kind of deal with as well.Student 2, focus group 6.
3.2.2. Summative Feedback
I thought that was also really beneficial in comparison with the other ones, actually having marked, being marked on umm on our performance was also very useful that meant we took it more seriously, we took more time to prepare for the, for the medications like, for the scenarios before we came in.Student 1, focus group 1.
I love it, it’s actually really fun like one of my fun unit out of all the units that we have been doing, because you kind of interact, like you get to do something rather than sitting down and writing with pens and what not but it’s kind of stressful at the same time because you are under time pressure.Student 3, focus group 4.
3.2.3. Perception of Self and Relationship with Peers Informing Assessment
Watching my video I do immediately see and see gaps in knowledge or like if I’m comparing if I’m watching it while looking at the rubric I can see things that I don’t.Student 2, focus group 9.
But I mean the self-assessment also is like really subjective like I am such a pessimist and I’m really hard on myself. Whereas if I watch, say Sally and I did the exact same thing then I would probably give, I would give her a higher mark than what I would give myself even if we said the exact same thing.Student 4, focus group 6.
So if I had a friend, I found that it would be very casual, their feedback wouldn’t be umm as honest or comprehensive in comparison when it was with a random person who took the scenario more seriously and who wanted to give feedback.Student 1, focus group 1.
I’d prefer the video. The video alone that would be fantastic but the peer marking me that’s just we are all mates here, we would give each other 100%. I would give anyone 100%, I wouldn’t take that seriously though.Student 5, focus group 8.
3.2.4. Benefits in Real Life Practice
I think it’s more effective, because it’s putting us in what is similar to reality situations and it kinda puts us in the spotlight, we kinda have to do, we do have to think on our feet, it is a trait we do need to learn for the future.Student 3, focus group 3.
Even at like work I remember all the counselling points from what I learnt here, and I can say to people in real life. And it really helps them too, like I like how you guys like teach us like the main points of it is like I think it really helps.Student 5, focus group 7.
For consultations I actually found it more rewarding for me because I feel like I can actually apply what I’ve learned from lectures like therapeutic knowledge to practice and it really like helped me consolidate similarities and differences between different meds. So it was very helpful.Student 2, focus group 7.
I have used those questions going into a counselling session with a patient to try and get them to open up about what they already know. Which I have found useful.Student 6, focus group 6.
I’ve been working in community pharmacy for a few years, but I was never comfortable in counselling drugs... until I took this unit of study.Student 1, focus group 1.
4. Discussion
Limitations
5. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- World Health Organization (WHO). The Role of the Pharmacist in the Health Care System: Preparing the Future Pharmacist: Curricular Development: Report of a Third WHO Consultative Group on the Role of the Pharmacist, Vancouver, Canada, 27–29 August 1997; WHO: Geneva, Switzerland, 1997. [Google Scholar]
- International Pharmaceutical Federation. FIP Global Competency Framework. Available online: https://www.fip.org/file/5127 (accessed on 17 August 2022).
- Australian Pharmacy Council. Accreditation Standards for Pharmacy Programs in Australia and New Zealand. Available online: https://apcwebsite.blob.core.windows.net/webfiles/16ee2b4a2eb0ea11a812000d3a6aa9f7/ACCREDITATION%20STANDARDS%20FOR%20PHARMACY%20PROGRAMS-2020-web-071119.pdf?sv=2015-07-08&sr=b&sig=AcWRKB4yVln0jK4DwtnC2EtEBZlg%2BJ%2FhSHd%2Bw%2FizkuI%3D&se=2022-08-17T07%3A55%3A10Z&sp=r (accessed on 17 August 2022).
- The Pharmaceutical society of Australia. PSA Code of Ethics. Available online: https://www.psa.org.au/wp-content/uploads/2018/07/PSA-Code-of-Ethics-2017.pdf (accessed on 17 August 2022).
- The Pharmacy Board of Australia. Code of Conduct. Available online: https://www.pharmacyboard.gov.au/codes-guidelines.aspx (accessed on 17 August 2022).
- The Pharmaceutical Society of Australia. National Competency Standards Framework for Pharmacists in Australia. Available online: https://www.psa.org.au/practice-support-industry/national-competency-standards/ (accessed on 10 December 2020).
- Barker, M.C.; Mak, A.S. From Classroom to Boardroom and Ward: Developing Generic Intercultural Skills in Diverse Disciplines. J. Stud. Int. Educ. 2013, 17, 573–589. [Google Scholar] [CrossRef]
- Berger, K.; Eickhoff, C.; Schulz, M. Counselling quality in community pharmacies: Implementation of the pseudo customer methodology in Germany. J. Clin. Pharm. Ther. 2005, 30, 45–57. [Google Scholar] [CrossRef] [PubMed]
- Boesen, K.P.; Herrier, R.N.; Apgar, D.A.; Jackowski, R.M. Improvisational exercises to improve pharmacy students’ professional communication skills. Am. J. Pharm. Educ. 2009, 73, 35. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Chen, Y.C.; Kiersma, M.E.; Abdelmageed, A. Evaluation of student perceptions of standardized patient simulation on patient counseling confidence during introductory pharmacy practice experiences. Curr. Pharm. Teach. Learn. 2015, 7, 811–818. [Google Scholar] [CrossRef]
- Cobb, B.T.; Bowen, J.F.; Pontiggia, L.; Koffer, K.F.; Scholtz, J.M. Evaluation of an individualized vs non-specific standardized patient activity in improving communication skills amongst pharmacy students. Curr. Pharm. Teach. Learn. 2019, 11, 603–608. [Google Scholar] [CrossRef]
- Adrian, J.A.L.; Zeszotarski, P.; Ma, C. Developing Pharmacy Student Communication Skills through Role-Playing and Active Learning. Am. J. Pharm. Educ. 2015, 79, 44. [Google Scholar] [CrossRef] [Green Version]
- Goggin, K.; Hawes, S.M.; Duval, E.R.; Spresser, C.D.; Martinez, D.A.; Lynam, I.; Barnes, A.; Hinton-Dampf, A.M.; Murphy, M.E.; Marken, P.A.; et al. A motivational interviewing course for pharmacy students. Am. J. Pharm. Educ. 2010, 74, 70. [Google Scholar] [CrossRef] [Green Version]
- Horton, N.; Payne, K.D.; Jernigan, M.; Frost, J.; Wise, S.; Klein, M.; Epps, J.; Anderson, H.G. A standardized patient counseling rubric for a pharmaceutical care and communications course. Am. J. Pharm. Educ. 2013, 77, 152. [Google Scholar] [CrossRef] [Green Version]
- Hussainy, S.Y.; Styles, K.; Duncan, G. A virtual practice environment to develop communication skills in pharmacy students. Am. J. Pharm. Educ. 2012, 76, 202. [Google Scholar] [CrossRef] [Green Version]
- Jin, H.K.; Park, S.H.; Kang, J.E.; Choi, K.S.; Kim, H.A.; Jeon, M.S.; Rhie, S.J. The influence of a patient counseling training session on pharmacy students’ self-perceived communication skills, confidence levels, and attitudes about communication skills training. BMC Med. Educ. 2019, 19, 172. [Google Scholar] [CrossRef]
- Lundquist, L.M.; Shogbon, A.O.; Momary, K.M.; Rogers, H.K. A Comparison of Students’ Self-Assessments with Faculty Evaluations of Their Communication Skills. Am. J. Pharm. Educ. 2013, 77, 72. [Google Scholar] [CrossRef] [Green Version]
- Parkhurst, C. A communication course for a linguistically diverse student population. Am. J. Pharm. Educ. 2007, 71, 36. [Google Scholar] [CrossRef] [Green Version]
- Planas, L.G.; Er, N.L. A systems approach to scaffold communication skills development. Am. J. Pharm. Educ. 2008, 72, 35. [Google Scholar] [CrossRef] [Green Version]
- Volino, L.R.; Das, R.P. Video Review in Self-Assessment of Pharmacy Students’ Communication Skills. J. Educ. Learn. 2014, 3, 26–36. [Google Scholar] [CrossRef]
- Lust, E.; Moore, F.C. Emotional intelligence instruction in a pharmacy communications course. Am. J. Pharm. Educ. 2006, 70, 6. [Google Scholar] [CrossRef] [Green Version]
- Mort, J.R.; Hansen, D.J. First-year pharmacy students’ self-assessment of communication skills and the impact of video review. Am. J. Pharm. Educ. 2010, 74, 578. [Google Scholar] [CrossRef] [Green Version]
- Branch, C.; Gill, T.; Apampa, B. Can you learn from a dummy? Pharmacy students’ views and perceptions of SimMan, a human patient simulator. Pharm. Educ. 2011, 11, 78. [Google Scholar]
- Gums, T.H.; Kleppinger, E.L.; Urick, B.Y. Outcomes of Individualized Formative Assessments in a Pharmacy Skills Laboratory. Am. J. Pharm. Educ. 2014, 78, 166. [Google Scholar] [CrossRef] [Green Version]
- Liekens, S.; Vandael, E.; Roter, D.; Larson, S.; Smits, T.; Laekeman, G.; Foulon, V. Impact of training on pharmacists’ counseling of patients starting antidepressant therapy. Patient Educ. Couns. 2014, 94, 110–115. [Google Scholar] [CrossRef]
- Kerr, A.; Kelleher, C.; Pawlikowska, T.; Strawbridge, J. How can pharmacists develop patient-pharmacist communication skills? A realist synthesis. Patient Educ. Couns. 2021, 104, 2467–2479. [Google Scholar] [CrossRef]
- Yusuff, K.B. Does self-reflection and peer-assessment improve Saudi pharmacy students’ academic performance and metacognitive skills? Saudi Pharm. J. 2015, 23, 266–275. [Google Scholar] [CrossRef] [PubMed]
- Oderda, G.M.; Zavod, R.M.; Carter, J.T.; Early, J.L.; Joyner, P.U.; Kirschenbaum, H.; Mack, E.J.; Traynor, A.P.; Plaza, C.M. An environmental scan on the status of critical thinking and problem solving skills in colleges/schools of pharmacy: Report of the 2009–2010 Academic Affairs Standing Committee. Am. J. Pharm. Educ. 2010, 74, S6. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Abeyaratne, C.; Nhu, T.; Malone, D. Self-Assessment of Therapeutic Decision-Making Skills in Pharmacy Students. Am. J. Pharm. Educ. 2022, 86, 8696. [Google Scholar] [CrossRef] [PubMed]
- Tsingos, C.; Bosnic-Anticevich, S.; Lonie, J.M.; Smith, L. A Model for Assessing Reflective Practices in Pharmacy Education. Am. J. Pharm. Educ. 2015, 79, 124. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Tsingos-Lucas, C.; Bosnic-Anticevich, S.; Smith, L. A Retrospective Study on Students’ and Teachers’ Perceptions of the Reflective Ability Clinical Assessment. Am. J. Pharm. Educ. 2016, 80, 101. [Google Scholar] [CrossRef] [PubMed]
- Theising, K.; Wu, K.; Sheehan, A.H. Impact of peer assessment on student pharmacists’ behaviors and self-confidence. Curr. Pharm. Teach. Learn. 2014, 6, 10–14. [Google Scholar] [CrossRef]
- Han, Z.; Chan, A. Pharmacy students’ perceptions toward peer assessment and its use in teaching patient presentation skills. Curr. Pharm. Teach. Learn. 2020, 12, 228–236. [Google Scholar] [CrossRef]
- Mumba, F.; Chabalengula, V.M.; Bassoppo-Moyo, T. Ethical and educational justification for computer-based instructions: A case of simulations in science teaching. Int. J. Instr. Media 2006, 33, 405–415. [Google Scholar]
- Australian Government. PBS Expenditure and Prescription Report 1 July 2020 to 30 June 2021. Available online: https://www.pbs.gov.au/info/statistics/expenditure-prescriptions/pbs-expenditure-and-prescriptions (accessed on 27 August 2022).
- Lam, N.; Muravez, S.N.; Boyce, R.W. A comparison of the Indian Health Service counseling technique with traditional, lecture-style counseling. J. Am. Pharm. Assoc. 2015, 55, 503–510. [Google Scholar] [CrossRef] [Green Version]
- Kouladjian, L.; Gnjidic, D.; Reeve, E.; Chen, T.F.; Hilmer, S.N. Health Care Practitioners’ Perspectives on Deprescribing Anticholinergic and Sedative Medications in Older Adults. Ann. Pharmacother. 2016, 50, 625–636. [Google Scholar] [CrossRef]
- Neubauer, B.E.; Witkop, C.T.; Varpio, L. How phenomenology can help us learn from the experiences of others. Perspect. Med. Educ. 2019, 8, 90–97. [Google Scholar] [CrossRef] [Green Version]
- Braun, V.; Clarke, V. Using thematic analysis in psychology. Qual. Res. Psychol. 2006, 3, 77–101. [Google Scholar] [CrossRef]
- Saldaña, J. The Coding Manual for Qualitative Researchers; SAGE Publications: Thousand Oaks, CA, USA, 2021; pp. 1–440. [Google Scholar]
- Bowen, G.A. Naturalistic inquiry and the saturation concept: A research note. Qual. Res. 2008, 8, 137–152. [Google Scholar] [CrossRef] [Green Version]
- Ryan, R.M.; Deci, E.L. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am. Psychol. 2000, 55, 68–78. [Google Scholar] [CrossRef]
- Booth, A.; Hannes, K.; Harden, A.; Noyes, J.; Harris, J. COREQ (Consolidated Criteria for Reporting Qualitative Studies); John Wiley & Sons: New York, NY, USA, 2014. [Google Scholar] [CrossRef]
- Hyvärinen, M.-L.; Tanskanen, P.; Katajavuori, N.; Isotalus, P. A method for teaching communication in pharmacy in authentic work situations. Commun. Educ. 2010, 59, 124–145. [Google Scholar] [CrossRef]
- Drew, S. Perceptions of what helps learn and develop in education. Teach. High. Educ. 2001, 6, 309–331. [Google Scholar] [CrossRef]
- Higgins, R.; Hartley, P.; Skelton, A. The conscientious consumer: Reconsidering the role of assessment feedback in student learning. Stud. High. Educ. 2002, 27, 53–64. [Google Scholar] [CrossRef]
- Katajavuori, N.; Lindblom-Ylanne, S.; Hirvonen, J. The significance of practical training in linking theoretical studies with practice. High. Educ. 2006, 51, 439–464. [Google Scholar] [CrossRef]
- Segrin, C.; Givertz, M. Methods of social skills training and development. In Handbook of Communication and Social Interaction Skills; Greene, J.O., Burleson, B.R., Eds.; Lawrence Erlbaum Associates Publishers: Mahwah, NJ, USA, 2003. [Google Scholar]
- Sonthisombat, P. Pharmacy student and preceptor perceptions of preceptor teaching behaviors. Am. J. Pharm. Educ. 2008, 72, 110. [Google Scholar] [CrossRef] [Green Version]
- Schneider, C.; Moles, R. Walking in Consumers’ Shoes: Reshaping the Pharmacy Student Placement Curriculum via Mystery Shopping with Feedback; Department of Education and Training: Canberra, Australia, 2016. [Google Scholar]
- Cheng, W.N.; Warren, M. Having second thoughts: Student perceptions before and after a peer assessment exercise. Stud. High. Educ. 1997, 22, 233–239. [Google Scholar] [CrossRef] [Green Version]
- Sluijsmans, D.M.A.; Brand-Gruwel, S.; van Merrienboer, J.J.G.; Martens, R.L. Training teachers in peer-assessment skills: Effects on performance and perceptions. Innov. Educ. Teach. Int. 2004, 41, 59–78. [Google Scholar] [CrossRef]
- Smith, H.; Cooper, A.; Lancaster, L. Improving the quality of undergraduate peer assessment: A case for student and staff development. Innov. Educ. Teach. Int. 2002, 39, 71–81. [Google Scholar] [CrossRef]
- Topping, K. Peer Assessment. Theory Pract. 2009, 48, 20–27. [Google Scholar] [CrossRef]
- Sung, Y.T.; Lin, C.S.; Lee, C.L.; Chang, K.E. Evaluating proposals for experiments: An application of Web-based self-assessment and peer-assessment. Teach. Psychol. 2003, 30, 331–334. [Google Scholar] [CrossRef]
- Van den Berg, I.; Admiraal, W.; Pilot, A. Design principles and outcomes of peer assessment in higher education. Stud. High. Educ. 2006, 31, 341–356. [Google Scholar] [CrossRef]
- Brakel, V.L. The revising processes of sixth-grade writers with and without peer feedback. J. Educ. Res. 1990, 84, 22–29. [Google Scholar] [CrossRef]
- Yu, F.Y.; Liu, Y.H.; Chan, T.W. A web-based learning system for question-posing and peer assessment. Innov. Educ. Teach. Int. 2005, 42, 337–348. [Google Scholar] [CrossRef]
- Lin, S.S.J.; Liu, E.Z.F.; Yuan, S.M. Web-based peer assessment: Feedback for students with various thinking-styles. J. Comput. Assist. Learn. 2001, 17, 420–432. [Google Scholar] [CrossRef]
- Magin, D. Reciprocity as a source of bias in multiple peer assessment of group work. Stud. High. Educ. 2001, 26, 53–63. [Google Scholar] [CrossRef]
- Kanthan, R.; Senger, J.L.B. An appraisal of students’ awareness of “self-reflection” in a first-year pathology course of undergraduate medical/dental education. BMC Med. Educ. 2011, 11, 67. [Google Scholar] [CrossRef] [Green Version]
- Austin, Z.; Gregory, P.A.M.; Chiu, S. Use of reflection-in-action and self-assessment to promote critical thinking among pharmacy students. Am. J. Pharm. Educ. 2008, 72, 48. [Google Scholar] [CrossRef]
- Gün, B. Quality self-reflection through reflection training. ELT J. 2011, 65, 126–135. [Google Scholar] [CrossRef]
- Motycka, C.A.; Rose, R.L.; Ried, L.D.; Brazeau, G. Self-assessment in pharmacy and health science education and professional practice. Am. J. Pharm. Educ. 2010, 74, 85. [Google Scholar] [CrossRef] [Green Version]
- Bergen, N.; Labonté, R. “Everything is perfect, and we have no problems”: Detecting and limiting social desirability bias in qualitative research. Qual. Health Res. 2020, 30, 783–792. [Google Scholar] [CrossRef]
- Brookfield, S.D. Becoming a Critically Reflective Teacher; John Wiley & Sons: New York, NY, USA, 2017. [Google Scholar]
Self-Determination Theory | ||||
---|---|---|---|---|
Autonomy | Competence | Relatedness | ||
Themes | Learning Style | Gradual introduction to assessmentLearning through self-reflection videos | Learning through authentic assessmentIndividual learning compared to group learning | Learning through observation of best practice |
Feedback | Inconsistent feedback | Summative feedback | Perception of selfRelationship with peers informing peer assessment | |
Benefits in real life practice | Benefits in real life practice |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Bartlett, A.; Pace, J.; Arora, A.; Penm, J. Self-Reflection and Peer-Assessments Effect on Pharmacy Students’ Performance at Simulated Counselling Sessions. Pharmacy 2023, 11, 5. https://doi.org/10.3390/pharmacy11010005
Bartlett A, Pace J, Arora A, Penm J. Self-Reflection and Peer-Assessments Effect on Pharmacy Students’ Performance at Simulated Counselling Sessions. Pharmacy. 2023; 11(1):5. https://doi.org/10.3390/pharmacy11010005
Chicago/Turabian StyleBartlett, Andrew, Jessica Pace, Angela Arora, and Jonathan Penm. 2023. "Self-Reflection and Peer-Assessments Effect on Pharmacy Students’ Performance at Simulated Counselling Sessions" Pharmacy 11, no. 1: 5. https://doi.org/10.3390/pharmacy11010005
APA StyleBartlett, A., Pace, J., Arora, A., & Penm, J. (2023). Self-Reflection and Peer-Assessments Effect on Pharmacy Students’ Performance at Simulated Counselling Sessions. Pharmacy, 11(1), 5. https://doi.org/10.3390/pharmacy11010005