Prerpints.org logo
Preprint
Article

This version is not peer-reviewed.

Needs-Assessment for an Artificial Intelligence-based Chatbot for Pharmacists in HIV Care: Results from a Knowledge-Attitudes-Practices Survey

A peer-reviewed version of this preprint was published in:
Healthcare 2024, 12(16), 1661. https://doi.org/10.3390/healthcare12161661

Submitted:

14 August 2024

Posted:

16 August 2024

You are already at the latest version

Abstract
Background: Pharmacists need up-to-date knowledge and decision-making support in HIV care. We aim to develop MARVIN-Pharma, an adapted artificial intelligence-based chatbot initially for people with HIV, to assist pharmacists, considering evidence-based needs. Methods: From Dec 2022 to Dec 2023, an online needs-assessment survey evaluated Québec pharmacists' knowledge, attitudes, involvement, and barriers relative to HIV care, alongside perceptions relevant to the usability of MARVIN-Pharma. Recruitment involved convenience and snowball sampling, targeting National HIV and Hepatitis Mentoring Program affiliates. Results: Forty-one pharmacists (28 community, 13 hospital-based) across 15 Québec municipalities participated. Participants perceived their HIV knowledge as moderate (M=3.74/6). They held largely favorable attitudes towards providing HIV care (M=4.02/6). They reported a “little” involvement in the delivery of HIV care services (M=2.08/5), most often ART adherence counseling, refilling, and monitoring. The most common barriers reported to HIV care delivery were a lack of time, staff resources, clinical tools, and HIV information/training, with pharmacists at least somewhat agreeing that they experienced each (M≥4.00/6). On average, MARVIN-Pharma's acceptability and compatibility were in the ‘undecided’ range (M=4.34, M=4.13/7, respectively), while pharmacists agreed to their self-efficacy to use online health services (M=5.6/7). Conclusion: MARVIN-Pharma might help address pharmacists' knowledge gaps and barriers to HIV treatment and care, but pharmacist engagement in the chatbot’s development seems vital for its future uptake and usability.
Keywords: 
pharmacists
;  
HIV
;  
chatbot
;  
artificial intelligence
;  
needs assessment
;  
surveys and questionnaires
;  
health information technology
;  
healthcare provider
;  
health knowledge-attitudes-practices
;  
patient care
Subject: 
Public Health and Healthcare  -   Public Health and Health Services

1. Introduction

In Canada, the HIV epidemic is on the rise, with a 24.9% increase in reported cases across the country in 2022, amounting to 1,833 new diagnoses [1]. The national rate of new HIV diagnoses was 4.7 per 100,000 people, with Québec slightly exceeding this average at 4.9 per 100,000 [2]. Montréal saw a particularly alarming spike, with a 120% increase in HIV diagnoses between 2021 and 2022, resulting in approximately 310 new cases [3]. This surge is attributed in part to the resumption of HIV testing post-pandemic and the arrival of immigrants from regions where HIV is more prevalent [4].
Managing HIV requires interprofessional efforts and pharmacists play a significant role in the care of people with HIV (PWH) [5,6,7]. They often serve as first, regular, and trusted points of contact for people seeking medical treatment and advice [8,9,10,11,12], especially in community pharmacies [13]. They support PWH, notably, by providing crucial assistance in the regular refill and management of their antiretroviral therapy (ART).
Generalist pharmacists in Canada can struggle to stay current with HIV treatments and make informed decisions [14]. They can face challenges related to rapidly evolving drug landscapes, constrained time resources, and expanded care roles [15]. These difficulties can be compounded by infrequent interactions with PWH and significantly impair their ability to acquire specialized knowledge and expertise in HIV care, which can, in turn, impact the quality of care they provide.
A range of digital tools are available to support pharmacists in medication management, patient education, and professional communication, including mobile health applications and online clinical references [16,17,18]. These resources provide access to drug information, clinical guidelines, and patient care tips [16,17,18]. Nevertheless, the abundance of online health information complicates the retrieval of specific, reliable data [19], which can make it difficult for pharmacists to provide informed care and navigate treatment options effectively.
Chatbots that leverage artificial intelligence (AI) offer a promising solution to these challenges by facilitating the retrieval of medical information [20,21,22,23]. Chatbots, also known as “conversational agents,” are computer programs designed to mimic human conversation through various platforms, including websites, texting apps, and computer software [22,23,24,25,26,27,28,29,30,31,32,33]. As such, they could provide pharmacists with instant and streamlined access to the most current, validated information on HIV treatments, potentially outperforming web- or app-based tools in these functions. Chatbots could generate personalized advice, aligning with demands from healthcare providers for comprehensive information resources on medication, including, for example, drug-drug interactions and dietary supplements [34,35].
Given pharmacists’ challenges in HIV care delivery, our overarching goal is to adapt an existing AI-based chatbot and connect it with a constantly updated and verified source of information to help pharmacists serve PWH. Since 2020, a team of experts, including physicians, pharmacists, PWH, researchers, and engineers at the McGill University Health Centre (MUHC), developed an innovative AI chatbot called MARVIN for Minimal AntiretRoViral Interference [36]. Running on Facebook Messenger, MARVIN was created as a retrieval-based independent component analysis (ICA) trained to chat with PWH on various aspects of self-management of HIV in both English and French [36]. To configure MARVIN for pharmacists (MARVIN-Pharma), a formal assessment of local pharmacists’ needs is required. With this needs-assessment, our objectives are to describe the pharmacists’ knowledge, attitudes, involvement, and barriers in HIV care as well as their perceptions of MARVIN-Pharma’s usability. Ultimately, this needs assessment aims to inform the adaptation of MARVIN-Pharma to ensure it effectively addresses the identified gaps and challenges in HIV care, enhancing pharmacists’ ability to deliver high-quality care and improving the overall usability and acceptance of the chatbot in clinical practice.

2. Methods

2.1. Study Design

For this study, we utilized a cross-sectional needs-assessment survey.
Conceptual Underpinnings
The Knowledge-Attitudes-Practices (KAP) model underscores the importance of considering the knowledge, attitudes, and practices of a given population, notably, to identify problems, design targeted interventions, and evaluate their effectiveness [37]. Knowledge refers to a person’s understanding of a given topic [38], or their capacity to receive, retain, and utilize information, and may require education [39]. Attitudes reflect a person’s feelings towards a specific topic, and they encompass how individuals react to a given situation [40]. Practice refers to how individuals demonstrate their knowledge and attitudes [38], namely, how they act on these [40]. Based on cognitive, affective, and behavioral theories, the model hypothesizes that relationships exist between these concepts [41]. Specifically, it suggests that knowledge influences attitudes, which in turn influence practices. Further supporting its relevance to our study, the KAP model is commonly used in health research to gather data from patients and practitioners with structured questions in cross-sectional surveys [37,42]. In this study, we assessed all three concepts of this model.
Usability concerns a technology’s ability to be used with effectiveness, efficiency, and satisfaction [43]. The related concepts we measured were perceived acceptability, compatibility, and self-efficacy. Acceptability concerns the degree to which a technology meets its users’ needs, preferences, and expectations; compatibility refers to the extent to which it is consistent with their habits, workflows, and digital environments; and self-efficacy relates to its users’ confidence in their ability to effectively use it.
A composite framework of the KAP and usability-related concepts guiding this study is shown in Figure 1.

2.2. Selection and Enrollment of Participants

2.2.1. Sample Size

Participant recruitment and data collection took place between December 2023 and December 2023. During this time, there were 9,385 licensed practicing pharmacists in Québec [44]. Given our desired margin of error (15%), confidence level (95%), and assumed response distribution (50%), we determined our minimum required sample size to be 43 participants. This calculation, performed using an online sample size calculator [45], ensures that our study achieves a minimum precision level of 15 percentage points or less for the half-width of a 95% confidence interval, adequately representing estimated proportions within our population.

2.2.2. Eligibility Criteria

We recruited licensed practising pharmacists working part- or full-time in the Canadian province of Québec, regardless of their specialized field. We adopted an inclusive approach that acknowledges that all pharmacists may encounter PWH in their practice.

2.2.3. Recruitment Strategy

We employed a two-fold recruitment approach utilizing convenience [46,47,48] and snowball sampling [48], starting with affiliates of the National HIV and Hepatitis Mentoring Program (Programme National de Mentorat sur le VIH et les Hépatites or PNMVH). The PNMVH sent out invitations to their mailing list of affiliated pharmacists in Québec that described the study and provided a QR code to the survey as well as the email address of a research team member. The PNMVH also advertised the survey through multiple platforms (PNMVH newsletters, mailing lists, and postings on PNMVH social media accounts).
Snowball sampling proceeded as follows. Pharmacists who completed the survey were sent an email inviting them to forward the survey link to other pharmacists. The survey also included a prompt for participants to provide the email addresses of other potential respondents [49]. Referred pharmacists were emailed information about the study, including the email address of a study team member.

2.3. Data Collection and Analysis

2.3.1. The Survey

2.3.1.1. Sociodemographic and Professional Characteristics

The survey contained items on practice location (city), age, ethnic background, sexual orientation, and gender, as well as years of experience as pharmacist, type of pharmacy practice setting, and served populations. Additionally, information was collected on Facebook Messenger use and the frequency of health/work application usage on mobile devices.

2.3.1.2. KAP Model Measures

To measure knowledge, we used a set of questions assessing perceived (subjective) knowledge related to HIV and its pharmaceutical treatment. Perceived knowledge was measured with 5 items on pharmacists’ perceived “preparedness” to advise patients extracted and adapted from a survey that underwent face validity testing with four Arizona pharmacists [50]. Items were answered on a 6-point Likert scale from “Strongly unprepared” to “Strongly prepared.” Cronback alpha for the 5 items was reported as 0.84.
Attitudes towards PWH and HIV care were measured with 13 attitudinal items also from the previous study’s survey [50]. Respondents recorded their answers on a 6-point Likert scale from “Strongly disagree” to “Strongly agree”.
Practice was assessed with three sets of items. First, 9 questions that measured involvement in HIV care were adapted from a questionnaire that was evaluated for face and content validity, tested for reliability in ten community pharmacies, and used among community pharmacists in Nigeria [51]. These questions were answered with a 5-point Likert scale from “Not involved” to “Very much involved”. Barriers to providing HIV care were measured with 8 items from the same questionnaire. However, we replaced the original multiple-choice response options with a 6-point Likert scale from “Strongly Disagree” to “Strongly Agree”. Competence was evaluated with 4 items from a questionnaire used among Australian pharmacists on dispensing ART [52]. Participants responded with a 6-point Likert scale from “Strongly disagree” to “Strongly agree”.

2.3.1.3. Usability-Related Measures

To limit respondent burden, all three usability-related measures were answered on a 7-point scale of agreement from “Strongly disagree” to “Strongly agree”, which differed from the agreement scales of two of the original measures. Acceptability was assessed using the 4- item Acceptability of Intervention Measure (AIM) which has undergone elaborate psychometric testing (Cronbach alpha: 0.85) [53]. Note that the original response scale has 5 points. Compatibility was evaluated with a 4-item subscale of an “Instrument to Measure the Perceptions of Adopting an Information Technology Innovation” which has demonstrated reliability and evidence of content and construct validity (Cronback alpha: 0.81-0.88) [54]. We slightly modified the original 7-point scale’s labels. To measure self-efficacy to use Internet health services, we used the 4-item Healthcare Technology Self-Efficacy -Web subscale [55] with the original response options. It was created with adapted items from existing instruments and submitted to reliability and validity testing (global scale Cronbach alpha: 0.89) [55].

2.4. Technical Procedures and Survey Administration

We developed the survey in English, which was then translated into French using the forward-backward translation method. A pharmacy student in the research team, who is a native French speaker, performed the initial translation [56]. Subsequently, we retranslated the survey back into English to check for any discrepancies. To ensure linguistic and cultural appropriateness, the translation underwent rigorous pretesting. Two members of the research team, specifically a physician and a pharmacy student, carefully reviewed the French survey for clarity, comprehensibility, and coherence. The pretesting phase aimed to enhance the quality, interpretation, and suitability of the survey.
Between December 2022 and December 2023, pharmacists completed the survey online, through a secure online platform, REDCap© [57], which ensured ease of administration and data storage. Participants were offered compensation of 50 CAD to complete the survey.

2.5. Statistical Analysis

We calculated descriptive statistics and reported them in tables. We provide the means and ± standard deviations (SD) of continuous variables. We summarize categorical variables with frequencies and percentages. Statistical analyses were performed with R statistical software [58].

2.6. Research Ethics Board (REB)

REB review exemption was obtained from the MUHC REB on September 8, 2022. The project does not qualify as “research” based on the definition outlined in Article 2.1 of the Tri-Council Policy Statement (TCPS2, 2018).

3. Results

We recruited 41 pharmacists and all participants provided complete data.

3.1. Sociodemographic and Professional Characteristics

Table 1 presents descriptive sociodemographic information on respondents. Over two-thirds (68%) worked in the Montreal area. The average age of respondents was 36. In terms of ethnic backgrounds, approximately one half (49%) identified as French Canadian while the other half (51%) identified as East Asian, South Asian, Arab, or North African. The gender distribution showed that slightly more women than men were recruited. As to sexual orientation, most (85%) identified as heterosexual.
Professionally, respondents had an average of 10 years of experience. Over two-thirds (68%) worked in community pharmacies, with the remainder working in hospital settings. As to their patient groups, approximately half served women (54%) and LGBTQ+ community members (46%). Over a third provided care to people who use injection drugs (39%) and migrants from HIV endemic countries (37%). Fewer attended to such groups as the elderly (12%), Indigenous people (12%), and sex workers (10%). Respondents’ patients were approximately 8% PWH, with an additional 12% deemed at high risk of acquiring HIV.
Considering technology usage, on average, respondents used Facebook Messenger regularly for over 10 years, indicating familiarity with the MARVIN chatbot’s current communication platform. Moreover, pharmacists reported, on average, “sometimes” using health or work-related applications on their mobile devices.

3.2. Knowledge

Perceived Knowledge
Our results indicate a moderate level of perceived knowledge on HIV and its treatment among respondents (Table 2). The average score across the items was 3.74 on 6, almost equivalent to being “somewhat prepared” to advise PWH in the areas evaluated. The highest average item scores (over 4.0) were for preparedness to counsel PWH on HIV transmission and HIV prevention. Meanwhile, the lowest individual item scores (with means between 3.5 and 3.6) concerned adverse drug effects and interactions; HIV treatments; and HIV symptoms and disease progression. These values corresponded to being “somewhat unprepared” to “somewhat prepared” to address these topics.

3.3. Attitudes

For the most part, pharmacists indicated positive attitudes towards PWH and HIV care in the context of their professional work, with a global mean of 4.02 on 6, where a higher mean indicates more favorable attitudes (Table 3). They strongly disagreed with stigmatizing statements (e.g., PWH deserve to have HIV or HIV treatments are not worthwhile) and agreed or strongly agreed with inclusive statements (e.g., I am willing to work with an HIV-positive colleague or providing information about HIV is a professional responsibility). However, pharmacists’ mean attitude toward mandatory continuing education on HIV/AIDS was tepid (M = 3.66; between “somewhat disagree” and “somewhat agree”).

3.4. Practice

3.4.1. Involvement

On average, respondents indicated being “little” involved in HIV care, across the services considered (M = 2.08) (Table 4), and were most involved in ART adherence counseling; refilling ART; treatment and monitoring of ART and referring patients for postexposure prophylaxis (PEP); with mean involvement ratings ranging from 2.3 to 2.8 on 5 (which refer to being “little” to “moderately” involved in these areas).

3.4.2. Competence

Pharmacists’ global mean score on items related to their perceived competence in HIV care delivery was 3.78/6 (Table 5). On average, they agreed they were sometimes hesitant to dispense ART to PWH and somewhat agreed they were unable to spend enough time counseling PWH. They also somewhat disagreed they were able to confidently manage the complexities faced by PWH and that they were satisfied with the amount of care they provided them.

3.4.3. Barriers

Table 6 shows perceived barriers to providing HIV care. Most mentioned barriers were lack of time, of staff resources, of clinical tools, and of information or training on HIV/AIDS services. On average, they at least “somewhat” agreed that they experienced these barriers.

3.5. Usability

Table 7 presents results on acceptability, compatibility and self-efficacy. On average, pharmacists were “undecided” about the acceptability of the proposed MARVIN-pharma chatbot (M = 4.34/7) as well as about its compatibility with their work (M = 4.13). In addition, pharmacists showed tempered agreement with their self-efficacy to use Internet health services (M = 5.65).

4. Discussion

Drawing on a conceptual framework and existing instruments, this study aimed to better understand the needs of pharmacists in HIV care and their perceptions of the MARVIN-Pharma chatbot (in development), as a tool to reduce their challenges in HIV care. Specifically, it sought to characterize their knowledge, attitudes and practices tied to HIV care as well as the chatbot’s usability, in terms of its acceptability, its compatibility, and pharmacist self-efficacy.
Our findings indicate that pharmacists perceive their HIV knowledge as moderate and face significant barriers, such as lack of time and resources, which hinder their involvement in HIV care. Despite these challenges, there is a generally favorable attitude towards providing HIV care, suggesting a readiness to engage more deeply, if provided with the right support tools. However, pharmacists were generally undecided about the acceptability and compatibility of MARVIN-Pharma. Nevertheless, this study highlights the potential of the chatbot to address the identified gaps and barriers, but also the importance of involving pharmacists in its development to ensure its future uptake and usability.

4.1. Knowledge

Our results showed that pharmacists perceived their knowledge to be moderate across the various aspects of HIV care evaluated. As found in past research [50,52], pharmacists felt most prepared to advise patients about HIV transmission and prevention. However, they did not feel fully prepared to advise on HIV treatments [50,52,59]; symptoms and progression of HIV; and adverse drug effects and interactions with ART. Pharmacists’ moderate HIV knowledge, as observed in our study, given their generally limited specialization in this area, reflects the broader trend towards increased HIV knowledge among healthcare professionals in general [50,52,59,60,61,62,63,64,65].
Efficiently bridging pharmacists’ knowledge gaps is essential, as their guidance may significantly enhance PWH’s understanding of their treatment [66], potentially boosting ART adherence and lowering HIV transmission rates [67]. MARVIN-Pharma could therefore prioritize content that helps pharmacists provide informed HIV care such as on HIV treatment guidelines and ART regimens, drug interactions, management of medication side effects, and considerations during pregnancy. The chatbot’s connection to a regularly updated ART regimen database like the Canadian HIV/AIDS Pharmacists Network (CHAP) or the Canadian AIDS Treatment Information Exchange (CATIE) seems essential to address the challenge of keeping pace with current information and to streamline access to it. Indeed, Ada Health, Buoy Health, Woebot, and Your.MD are real-world examples of chatbots linked to constantly updated medical databases which demonstrate the feasibility and benefits of such an approach in healthcare [68].
Additionally, MARVIN-Pharma’s eventual ability to deliver just-in-time training and educational content could further enhance pharmacists’ confidence and competence, addressing knowledge gaps as they arise during patient interactions. This practical application ensures the chatbot not only fills existing knowledge gaps but also supports continuous learning, directly linking back to the study’s objective of improving pharmacists’ knowledge in HIV care.

4.2. Attitudes

Pharmacists’ attitudes towards PWH and aspects of HIV care were favorable and non-stigmatizing, consistent with previous studies among pharmacists [50,51,62,64]. On average, the participants had been pharmacists for 10 years, which may partially explain these results. Healthcare personnel with greater work experience, especially related to PWH care, are found to have less stigmatizing attitudes towards PWH [69].
Our results show that some pharmacists were reluctant towards mandatory continuing education on HIV. This finding increases the relevance of a tool like MARVIN-Pharma for practice [70]. Indeed, AI-driven educational tools have been shown to improve healthcare outcomes by keeping practitioners updated with the latest guidelines and best practices in a user-friendly manner [71,72]. The chatbot, however, is not intended to teach pharmacists the latest guidelines directly. Rather, it will be designed to answer specific questions and provide responses based on these guidelines. Thus, pharmacists will be able to easily retrieve up-to-date information and apply it to real-life situations, enhancing their ability to make informed decisions quickly and effectively during patient care.
This focus on integrating the chatbot seamlessly into pharmacists’ workflows, rather than adding additional educational burdens, directly supports the objective of understanding and addressing pharmacists’ attitudes towards HIV care and ensuring that MARVIN-Pharma aligns with their professional practices.

4.3. Involvement

Our findings indicate that pharmacists, overall, were only a “little” involved in HIV care. Their most common activities concerned ART counselling, monitoring and refilling as well as PEP referrals. Notwithstanding, pharmacists’ delivery of HIV care remains crucial for extending services beyond specialized settings; it is both feasible and well-received, and can help reach underserved populations [73], to enhance antiretroviral adherence, viral suppression, and retention in care [74]. MARVIN-Pharma could assist pharmacists in their important HIV care roles and help compensate for any limited involvement in this area. For example, an adherence counseling module could enable them to perform detailed, interactive assessments of patient adherence, providing personalized advice and interventions based on patients’ responses. Studies have shown that pharmacist-led adherence interventions significantly improve medication adherence and clinical outcomes in HIV patients [75,76,77,78,79]. Additionally, a PEP referral feature could streamline and simplify the referral process, complete with checklists and easily submittable forms to health services. This approach is supported by research indicating that pharmacist-initiated post-exposure prophylaxis (PEP) services increase timely access to PEP and improve adherence to PEP regimens [80,81,82].
These practical features demonstrate how MARVIN-Pharma could directly enhance pharmacists’ involvement in HIV care, fulfilling the study’s objective of assessing and improving their engagement in this area.

4.4. Competence

Our results indicate that pharmacists experience limited competence in HIV care delivery, when managing complex issues faced by patients living with HIV, dispensing ART, and trying to provide sufficient care, underscoring the need for enhanced support and training.
The competence challenges identified align with those highlighted by past research [52]. Given their findings, some investigators [83] have emphasized the importance of continuous professional development to address knowledge gaps and improve clinical confidence among pharmacists as well as the need for comprehensive training programs [84] to enhance their ability to manage complex patient needs and improve overall care delivery.
In addition to real-time support for pharmacists’ questions, MARVIN-Pharma could significantly enhance pharmacists’ competence in HIV care by offering tailored interactive learning modules, such as on ART management, drug interactions, and counseling techniques. Connected to a database like CHAP or CATIE, it could incorporate real-time updates on treatment guidelines and emerging data, thus reducing hesitation when dispensing ART. Additionally, it could facilitate just-in-time training, offering educational content and clinical support as pharmacists encounter specific challenges, thereby building confidence and improving the overall quality of HIV care [70].
By addressing these competence challenges through tailored features, MARVIN-Pharma aligns with the study’s ultimate objective of informing the development of tools to enhance pharmacists’ ability to deliver high-quality HIV care, ensuring the practical application of the findings.

4.5. Barriers

Mitigating barriers to integrating HIV services into pharmacy practice is crucial for enhancing care. Our study suggests that the pharmacists’ most prominent challenges were limited time, clinical tools, and staff resources which are known to impact the provision of comprehensive HIV care [51,73,85,86,87]. Importantly, pharmacists also somewhat agreed that they lacked information or training on HIV/AIDS services, which can hinder effective patient counseling and care [14,88,89]. Lesser barriers, including a lack of collaboration with other healthcare professionals, inadequate pharmacy design, patient disinterest in preventive services, and the absence of financial incentives for HIV service provision, have also been reported in prior literature [74,85,90,91].
MARVIN-Pharma could be designed to help address the key barriers identified. By incorporating such features as educational modules [92,93,94,95,96,97], time-management tools [94,96,98,99,100,101], resource access [94,96,100,101,102], collaboration facilitation [99,102,103,104], patient engagement strategies [95,97,100,105], and incentive guidance [95,96,100,101], MARVIN-Pharma could significantly enhance HIV care delivery in pharmacy practice. The literature supports the potential of chatbots to incorporate these features effectively, demonstrating their capacity to overcome various barriers in healthcare.
Addressing these barriers directly relates to the objective of identifying challenges in HIV care and informing the design of MARVIN-Pharma to overcome them, ensuring the chatbot is practically useful in real-world settings.

4.6. Usability

Concerning the acceptability and compatibility of MARVIN-Pharma, pharmacists demonstrated a relatively neutral stance. This may be attributed, in part, to the hypothetical nature of the chatbot at this stage. Yet, these findings emphasize that, to foster adoption, pharmacists must be engaged in the chatbot’s design to ensure it meets their specific needs and resonates with their professional responsibilities and workflow requirements. Stakeholder involvement and co-design are crucial for the success of mHealth tools. Studies have shown that involving end-users in the design process leads to higher acceptance and more effective implementation [106,107]. By collaborating with pharmacists during the development of MARVIN-Pharma, the tool can be tailored to their circumstances, enhancing its usability and integration into daily practice.
Encouragingly, our study also points to a level of comfort with digital technologies among Quebec pharmacists, aligned with broader research showing openness to digital tools among pharmacists [16,17,18,108,109,110,111,112,113,114]. The sample’s self-efficacy with using Internet health services, their average 10 years of using Facebook Messenger, and their occasional use of health or work-related applications on their mobile devices indicate a potential facility to take up a tool like MARVIN-Pharma.
Emphasizing the importance of user involvement and the need for further development based on pharmacists’ feedback highlights how the findings align with the objective of assessing MARVIN-Pharma’s usability to ensure its successful implementation in practice.

5. Limitations of the Study

This study has several limitations. Despite employing multiple recruitment strategies, its sample size was small (n = 41 pharmacists). We were thus unable to examine the effects of potential confounders (e.g., age, gender, professional experience level). While snowball sampling may have helped reach a broader range of participants, self-selection and sampling bias may still affect the generalizability of the obtained results. For instance, the predominance of pharmacists from Montreal may not accurately represent the broader population of pharmacists in the province and the sample’s average of 10 years of pharmacy experience and slight overrepresentation of females, suggests a relatively experienced and gender-skewed group. We did, however, largely attain our sample size target to help ensure adequate statistical precision.
While the study relied on participant self-report, potentially introducing risks of response, recall, social desirability, and confirmation bias, the consistency of results obtained with respect to previous literature is encouraging in this regard.
The study’s quantitative design and limited scope mean the nuances and depth of pharmacists’ experiences and needs were not explored. A more comprehensive perspective will be achieved with the analysis of qualitative interview data collected as part of the larger mixed methods research project in which this study is embedded.

6. Conclusions

Our needs-assessment survey of Québec pharmacists indicates that while they have moderate HIV-related knowledge and positive attitudes towards providing HIV services in pharmacy practice, their involvement in HIV care remains limited. Despite pharmacists’ apparent capacity to adopt digital tools like MARVIN-Pharma, knowledge gaps and barriers in HIV treatment and management were identified. Although MARVIN-Pharma has the potential to address these challenges, its success will likely depend, in part, on achieving adequate perceived acceptability and compatibility with pharmacists’ work, on which they were undecided in this study. The findings suggest that buy-in for MARVIN-Pharma is not assured and that it must be developed with continuous pharmacist feedback and responsiveness to their specific needs.

Author Contributions

ML designed the study with the MARVIN team led by YM, supervised by BL, and in collaboration with RT and SA. ML developed the survey and its framework through discussions with KE and YM, under BL’s supervision. MN translated the survey. MN, RT, B. Lemire, AK, and DL assisted with recruitment. ML analyzed and interpreted the results. ML wrote the manuscript with KE. TS, KE, and BL reviewed the first draft. TS and SV provided statistical advice throughout the study. KE conducted five cycles of manuscript and data presentation reviews. All authors reviewed and edited the manuscript and approved the final version.

Funding

This study is part of a wider project aiming to inform the adaptation of the MARVIN chatbot for pharmacists, led by Rachel Therrien (pharmacist) and Dr. Lebouché and funded by the Canadian Institutes of Health Research Strategy for Patient-Oriented Research Québec Support Unit-Methodological Developments (grant M006, PI: BLeb), the Partnerships to Improve HIV Outcomes and Treatments (PIHVOT) program from ViiV Healthcare (grant 2020-1976-PIHVOT, PI: BLeb).

Institutional Review Board Statement

REB review exemption was obtained from the MUHC REB on September 8, 2022. The project does not qualify as “research” based on the definition outlined in Article 2.1 of the Tri-Council Policy Statement (TCPS2, 2018).

Data Availability Statement

The data sets generated and analyzed for this study are available from the corresponding author (B.L.) on reasonable request.

Acknowledgments

We extend our gratitude to the National HIV and Hepatitis Mentoring Program (PNMVH) for their support in recruitment and promotion of the survey through their mailing list, newsletters, member emails, and social media. BL is supported by 2 career awards: a Senior Salary Award from Fonds de recherche du Québec–Santé (FRQS) (#311200) and the LE 250, from Quebec’s Ministry of Health for researchers in Family Medicine and holds a Canadian Institutes for Health Research Strategy for Patient-Oriented Research (SPOR) Mentorship Chair in Innovative Clinical Trials. ML is supported by a Graduate Excellence Fellowship (GEF) Award from the Department of Family Medicine at McGill University and McGill Centre for Viral Diseases (MCVD) studentship. YM is supported by the Postgraduate Scholarship – Doctoral program (PGS D) and the OPSIDIAN program from the Natural Sciences and Engineering Research Council (NSERC), and a doctoral research award from the Fonds de recherche Nature et Technologies (FRQNT) in partnership with the Unité de soutien au système de santé apprenant (SSA) Québec.

Conflicts of Interest

B.L. has received research support and consulting fees and speaker fees from ViiV Healthcare, Merck, and Gilead, all outside of the submitted work.

Abbreviations

AI: Artificial Intelligence
ART: AntiRetroviral Therapy
ICA: Independent Component Analysis
KAP: Knowledge-Attitudes-Practices
MARVIN: Minimal AntiretRoViral Interference
MARVIN-Pharma: Minimal AntiretRoViral Interference for Pharmacists
MUHC: McGill University Health Centre
N: Number
PNMVH: Programme National de Mentorat sur le VIH et les Hépatites (National HIV and Hepatitis Mentoring Program)
PWH: People With HIV
REB: Research Ethics Board
SD: Standard Deviation
TCPS: Tri-Council Policy Statement

References

  1. Public Health Agency of Canada. HIV in Canada: 2022 surveillance highlights. Government of Canada. Published December 1, 2023. Available online: https://www.canada.ca/en/public-health/services/publications/diseases-conditions/hiv-2022-surveillance-highlights.html (accessed on 14 August 2024).
  2. The Canadian Press. HIV epidemic on the rise again, with more cases in Quebec than national average. CTV News. Published February 12, 2024. Available online: https://www.ctvnews.ca (accessed on 14 August 2024).
  3. Morris, E. Montreal saw a 120% increase in HIV diagnoses last year. CBC News. Published December 7, 2023. Available online: https://www.cbc.ca/news/montreal (accessed on 14 August 2024).
  4. McGill University. Expert: HIV epidemic on the rise, with more cases in Quebec than national average. McGill University Newsroom. Published March 20, 2024. Available online: https://www.mcgill.ca/newsroom (accessed on 14 August 2024).
  5. Smith M, Bates DW, Bodenheimer TS. Pharmacists belong in accountable care organizations and integrated care teams. Health Affairs. 2013 Nov 1;32(11):1963-70.
  6. Smith M, Bates DW, Bodenheimer T, Cleary PD. Why pharmacists belong in the medical home. Health affairs. 2010 May 1;29(5):906-13.
  7. Schafer JJ, Gill TK, Sherman EM, McNicholl IR, Hawkins B. ASHP guidelines on pharmacist involvement in HIV care. American Journal of Health-System Pharmacy. 2016 Apr 1;73(7):468-94.
  8. World Health Organization. The role of the pharmacist in the health care system: preparing the future pharmacist: curricular development: report of a third WHO Consultative Group on the Role of the Pharmacist, Vancouver, Canada, 27-29 August 1997. World Health Organization; 1997.
  9. Vorobjov S, Uusküla A, Abel-Ollo K, Talu A, Jarlais DD. Should pharmacists have a role in harm reduction services for IDUs? A qualitative study in Tallinn, Estonia. Journal of Urban Health. 2009 Nov;86:918-28.
  10. Bluml, B.M. Definition of medication therapy management: development of professionwide consensus. Journal of the American Pharmacists Association. 2005 Sep 1;45(5):566-72.
  11. Park-Wyllie LY, Kam D, Bayoumi AM. The Adherence Support Gap: The ‘Ideal’Versus ‘Reality’of Antiretroviral Adherence Support Provided by HIV Health Providers in Clinical Practice. Annals of Pharmacotherapy. 2009 Jun;43(6):1036-44.
  12. Darin KM, Klepser ME, Klepser DE, Klepser SA, Reeves A, Young M, Scarsi KK. Pharmacist-provided rapid HIV testing in two community pharmacies. Journal of the American Pharmacists Association. 2015 Jan 1;55(1):81-8.
  13. Smith, Y.B. Community Pharmacy. News-Medical.Net. 2019 Feb 27. Available online: https://www.news-medical.net/health/Community-Pharmacy.aspx.
  14. Kibicho J, Pinkerton SD, Owczarzak J. Community-based pharmacists’ needs for HIV-related training and experience. Journal of pharmacy practice. 2014 Aug;27(4):369-78.
  15. Iwanowicz SL, Marciniak MW, Zeolla MM. Obtaining and providing health information in the community pharmacy setting. American Journal of Pharmaceutical Education. 2006 Jun 6;70(3).
  16. Crilly P, Kayyali R. A systematic review of randomized controlled trials of telehealth and digital technology use by community pharmacists to improve public health. Pharmacy. 2020 Aug 4;8(3):137.
  17. Crilly P, Hassanali W, Khanna G, Matharu K, Patel D, Patel D, Rahman F, Kayyali R. Community pharmacist perceptions of their role and the use of social media and mobile health applications as tools in public health. Research in social and administrative pharmacy. 2019 Jan 1;15(1):23-30.
  18. mHealth: Use of Mobile Health Tools in Pharmacy Practice. 2019. Available online: https://www.fip.org/files/content/publications/2019/mHealth-Use-of-mobile-health-tools-in-pharmacy-practice.pdf (accessed on 8 February 2024).
  19. Curley SP, Connelly DP, Rich EC. Physicians’ use of medical knowledge resources: preliminary theoretical framework and findings. Medical Decision Making. 1990 Dec;10(4):231-41.
  20. Brixey J, Hoegen R, Lan W, Rusow J, Singla K, Yin X, Artstein R, Leuski A. Shihbot: A facebook chatbot for sexual health information on hiv/aids. InProceedings of the 18th annual SIGdial meeting on discourse and dialogue 2017 Aug (pp. 370-373).
  21. Garett R, Young SD. Potential application of conversational agents in HIV testing uptake among high-risk populations. Journal of Public Health. 2023 Mar;45(1):189-92.
  22. Kocaballi AB, Berkovsky S, Quiroz JC, Laranjo L, Tong HL, Rezazadegan D, Briatore A, Coiera E. The personalization of conversational agents in health care: systematic review. Journal of medical Internet research. 2019 Nov 7;21(11):e15360.
  23. Luo TC, Aguilera A, Lyles CR, Figueroa CA. Promoting physical activity through conversational agents: mixed methods systematic review. Journal of Medical Internet Research. 2021 Sep 14;23(9):e25486.
  24. Laranjo L, Dunn AG, Tong HL, Kocaballi AB, Chen J, Bashir R, Surian D, Gallego B, Magrabi F, Lau AY, Coiera E. Conversational agents in healthcare: a systematic review. Journal of the American Medical Informatics Association. 2018 Sep;25(9):1248-58.
  25. Vaidyam AN, Wisniewski H, Halamka JD, Kashavan MS, Torous JB. Chatbots and conversational agents in mental health: a review of the psychiatric landscape. The Canadian Journal of Psychiatry. 2019 Jul;64(7):456-64.
  26. Milne-Ives M, de Cock C, Lim E, Shehadeh MH, de Pennington N, Mole G, Normando E, Meinert E. The effectiveness of artificial intelligence conversational agents in health care: systematic review. Journal of medical Internet research. 2020 Oct 22;22(10):e20346.
  27. Griffin AC, Xing Z, Khairat S, Wang Y, Bailey S, Arguello J, Chung AE. Conversational agents for chronic disease self-management: a systematic review. InAMIA Annual Symposium Proceedings 2020 (Vol. 2020, p. 504). American Medical Informatics Association.
  28. Tudor Car L, Dhinagaran DA, Kyaw BM, Kowatsch T, Joty S, Theng YL, Atun R. Conversational agents in health care: scoping review and conceptual analysis. Journal of medical Internet research. 2020 Aug 7;22(8):e17158.
  29. Vaidyam AN, Linggonegoro D, Torous J. Changes to the Psychiatric Chatbot Landscape: A Systematic Review of Conversational Agents in Serious Mental Illness. The Canadian Journal of Psychiatry. 2021 Apr;66(4):339-48.
  30. Geoghegan L, Scarborough A, Wormald JC, Harrison CJ, Collins D, Gardiner M, Bruce J, Rodrigues JN. Automated conversational agents for post-intervention follow-up: a systematic review. BJS open. 2021 Jul 1;5(4):zrab070.
  31. Allouch M, Azaria A, Azoulay R. Conversational agents: Goals, technologies, vision and challenges. Sensors. 2021 Dec 17;21(24):8448.
  32. Bibault JE, Chaix B, Nectoux P, Pienkowski A, Guillemasé A, Brouard B. Healthcare ex Machina: Are conversational agents ready for prime time in oncology?. Clinical and translational radiation oncology. 2019 May 1;16:55-9.
  33. Abd-Alrazaq AA, Alajlani M, Alalwan AA, Bewick BM, Gardner P, Househ M. An overview of the features of chatbots in mental health: A scoping review. International journal of medical informatics. 2019 Dec 1;132:103978.
  34. Daniel T, de Chevigny A, Champrigaud A, Valette J, Sitbon M, Jardin M, Chevalier D, Renet S. Answering Hospital Caregivers’ Questions at Any Time: Proof-of-Concept Study of an Artificial Intelligence–Based Chatbot in a French Hospital. JMIR Human Factors. 2022 Oct 11;9(4):e39102.
  35. Koman J, Fauvelle K, Schuck S, Texier N, Mebarki A. Physicians’ perceptions of the use of a chatbot for information seeking: Qualitative study. Journal of medical Internet research. 2020 Nov 10;22(11):e15185.
  36. Ma Y, Tu G, Lessard D, Vicente S, Engler K, Achiche S, Laymouna M, de Pokomandy A, Lebouché B. An artificial intelligence-based chatbot to promote HIV primary care self-management: a mixed method usability study.
  37. Vandamme, E. Concepts and challenges in the use of knowledge-attitude-practice surveys: Literature review. Department of Animal Health. Institute of Tropical Medicine. 2009;1:1-7.
  38. Kaliyaperumal, K.I. Guideline for conducting a knowledge, attitude and practice (KAP) study. AECS illumination. 2004;4(1):7.
  39. Rwanamiza, E. Knowledge, education, learning and teaching: Meanings and relationships. Journal of the American Association for the Advancement of Curriculum Studies (JAAACS). 2009;5(2).
  40. Badran, I.G. Knowledge, attitude and practice the three pillars of excellence and wisdom: a place in the medical profession. EMHJ-Eastern Mediterranean Health Journal, 1 (1), 8-16, 1995. 1995.
  41. Bano R, AlShammari E, Fatima SB, Al-Shammari NA. A comparative study of knowledge, attitude, practice of nutrition and non-nutrition student towards a balanced diet in Hail University. Journal of Nursing and Health Science. 2013;2(3):29-36.
  42. Launiala, A. How much can a KAP survey tell us about people’s knowledge, attitudes and practices? Some observations from medical anthropology research on malaria in pregnancy in Malawi. Anthropology Matters. 2009;11(1).
  43. International Organization for Standardization (ISO). ISO 9241-11:2018 Ergonomics of human-system interaction — Part 11: Usability: Definitions and concepts. Geneva: ISO; 2018.
  44. National Association of Pharmacy Regulatory Authorities (NAPRA). National Statistics. 2023. Available online: https://www.napra.ca/resources/national-statistics/ (accessed on 14 August 2023).
  45. Sample Size Calculator by Raosoft, Inc. 2022. Available online: http://www.raosoft.com/samplesize.html.
  46. Etikan I, Musa SA, Alkassim RS. Comparison of convenience sampling and purposive sampling. American journal of theoretical and applied statistics. 2016 Jan 5;5(1):1-4.
  47. Stratton, S.J. Population research: convenience sampling strategies. Prehospital and disaster Medicine. 2021 Aug;36(4):373-4.
  48. Emerson, R.W. Convenience sampling, random sampling, and snowball sampling: How does sampling affect the validity of research?. Journal of visual impairment & blindness. 2015 Mar;109(2):164-8.
  49. Goodman, L.A. Snowball sampling. The annals of mathematical statistics. 1961 Mar 1:148-70.
  50. Katz MD, Draugalis JR, Lai RP. HIV infection and AIDS: attitudes and knowledge of Arizona pharmacists. Annals of Pharmacotherapy. 1995 Dec;29(12):1218-23.
  51. Oseni YO, Erhun WO. Assessing community pharmacists’ involvement and clients’ opinion on HIV/AIDS services in community pharmacies in Nigeria: a cross-sectional survey. International journal of STD & AIDS. 2021 May;32(6):538-50.
  52. Singleton JA, Lau ET, Nissen LM. Exploring Australian pharmacists’ perceptions and attitudes towards dispensing HIV medicines in the community setting. Journal of Pharmacy Practice and Research. 2021 Jun;51(3):238-46.
  53. Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, Boynton MH, Halko H. Psychometric assessment of three newly developed implementation outcome measures. Implementation science. 2017 Dec;12:1-2.
  54. Moore GC, Benbasat I. Development of an instrument to measure the perceptions of adopting an information technology innovation. Information systems research. 1991 Sep;2(3):192-222.
  55. Rahman MS, Ko M, Warren J, Carpenter D. Healthcare Technology Self-Efficacy (HTSE) and its influence on individual attitude: An empirical study. Computers in Human Behavior. 2016 May 1;58:12-24.
  56. Yu DS, Lee DT, Woo J. Issues and challenges of instrument translation. Western journal of nursing research. 2004 Apr;26(3):307-20.
  57. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. Journal of biomedical informatics. 2009 Apr 1;42(2):377-81.
  58. R Core Team. R: A language and environment for statistical computing. URL. R Foundation for Statistical Computing: Vienna, Austria. 2021.
  59. Dapar ML, Joseph BN, Damun PA, Okunlola CR, Alphonsus PN, Aya BM. Assessment of knowledge and competencies of community pharmacists for differentiated HIV care and services in Jos, Nigeria.
  60. Passannante MR, Louria DB, French J. How much do health care providers know about AIDS?. American Journal of Preventive Medicine. 1993 Jan 1;9(1):6-14.
  61. Knowledge and Training Needs of Health Professionals Working with People with HIV: With Consideration for Mixed Urban/Rural Care Settings Question. 2010. Available online: https://www.ohtn.on.ca/Pages/Knowledge-Exchange/Rapid-Responses/Documents/RR16-2010-HC-Professionals-Training-Needs.pdf (accessed on 7 April 2023).
  62. Ma’aji HU, Ilyas OS. Assessment of knowledge, attitude and practice of community pharmacists towards pharmaceutical care in Kaduna State, Nigeria. Int J Pharm Teach Pract. 2014;5(2):972-6.
  63. Sianturi EI, Latifah E, Pane M, Perwitasari DA, Satibi, Kristina SA, Hastuti EB, Pavlovich J, Taxis K. Knowledge, empathy, and willingness to counsel patients with HIV among Indonesian pharmacists: a national survey of stigma. AIDS care. 2022 Jan 2;34(1):21-8.
  64. Balfour L, Corace K, Tasca GA, Best-Plummer W, MacPherson PA, Cameron DW. High HIV knowledge relates to low stigma in pharmacists and university health science students in Guyana, South America. International Journal of Infectious Diseases. 2010 Oct 1;14(10):e881-7.
  65. Letshwenyo-Maruatona SB, Madisa M, Boitshwarelo T, George-Kefilwe B, Kingori C, Ice G, Bianco JA, Marape M, Haile ZT. Association between HIV/AIDS knowledge and stigma towards people living with HIV/AIDS in Botswana. African Journal of AIDS Research. 2019 Jan 2;18(1):58-64.
  66. Kim GS, Choi JP, Yi JM, Shim MS. Development of a question prompt list for patients living with HIV and assessment of their information needs. Journal of the Association of Nurses in AIDS Care. 2019 Sep 1;30(5):575-83.
  67. Govender S, Naidoo P, Esterhuizen T. Impact of pharmacists’ intervention on the knowledge of HIV infected patients in a public sector hospital of KwaZulu-Natal. African Journal of Primary Health Care and Family Medicine. 2011 Jan 1;3(1):1-8.
  68. Gilbert S, Fenech M, Idris A, Türk E. Periodic Manual Algorithm Updates and Generalizability: A Developer’s Response. Comment on “Evaluation of Four Artificial Intelligence–Assisted Self-Diagnosis Apps on Three Diagnoses: Two-Year Follow-Up Study”. J Med Internet Res. 2021 Jun 16;23(6):e26514.
  69. Srithanaviboonchai K, Khemngern P, Chuayen J, Siraprapasiri T. Increased Work Experience Associated with Less Stigmatizing Attitudes towards People Living with HIV among Thai Healthcare Personnel. International Journal of Environmental Research and Public Health. 2021 Sep 18;18(18):9830.
  70. Royal College of Physicians and Surgeons of Canada. AI in medicine: Supporting learning and practice. 2023. Available online: https://www.royalcollege.ca/en/newsroom/posts/ai-in-medicine--supporting-learning-and-practice-.html.
  71. Moorhead SA, Hazlett DE, Harrison L, Carroll JK, Irwin A, Hoving C. A new dimension of health care: systematic review of the uses, benefits, and limitations of social media for health communication. Journal of medical Internet research. 2013 Apr 23;15(4):e1933.
  72. Topol, E.J. High-performance medicine: the convergence of human and artificial intelligence. Nature medicine. 2019 Jan;25(1):44-56.
  73. Kuo AP, Roche SD, Mugambi ML, Pintye J, Baeten JM, Bukusi E, Ngure K, Stergachis A, Ortblad KF. The effectiveness, feasibility and acceptability of HIV service delivery at private pharmacies in sub-Saharan Africa: a scoping review. Journal of the International AIDS Society. 2022 Oct;25(10):e26027.
  74. Schommer JC, Garza OW, Taitel MS, Akinbosoye OE, Suzuki S, Clay PG. Work system and process designs for community pharmacy-medical clinic partnerships to improve retention in care, antiretroviral adherence, and viral suppression in persons with HIV. Pharmacy. 2020 Jul 22;8(3):125.
  75. Ma A, Chen DM, Chau FM, Saberi P. Improving adherence and clinical outcomes through an HIV pharmacist’s interventions. AIDS care. 2010 Oct 1;22(10):1189-94.
  76. Foisy MM, Akai PS. Pharmaceutical care for HIV patients on directly observed therapy. Annals of Pharmacotherapy. 2004 Apr;38(4):550-6.
  77. Tseng A, Foisy M, Hughes CA, Kelly D, Chan S, Dayneka N, Giguère P, Higgins N, Hills-Nieminen C, Kapler J, La Porte CJ. Role of the pharmacist in caring for patients with HIV/AIDS: clinical practice guidelines. The Canadian journal of hospital pharmacy. 2012 Mar;65(2):125.
  78. Tailor SA, Foisy MM, Tseng A, Beardsall A, Ostrop N, Khaliq Y, Shevchuk Y, Chin T, Gin A, Dayneka N, Slayter K. The role of the pharmacist caring for people living with HIV/AIDS: a Canadian position paper. Canadian Journal of Hospital Pharmacy. 2000;53(2).
  79. McCree DH, Byrd KK, Johnston M, Gaines M, Weidle PJ. Roles for pharmacists in the “Ending the HIV Epidemic: A Plan for America” initiative. Public Health Reports. 2020 Sep;135(5):547-54.
  80. Khosropour CM, Backus KV, Means AR, Beauchamps L, Johnson K, Golden MR, Mena L. A pharmacist-led, same-day, HIV pre-exposure prophylaxis initiation program to increase PrEP uptake and decrease time to PrEP initiation. AIDS patient care and STDs. 2020 Jan 1;34(1):1-6.
  81. Southern State Directors Work Group. National Alliance of State and Territorial AIDS Directors. Southern States Manifesto: HIV/AIDS and STD’s in the South. 2003.
  82. Scarnati K, Esser K, Sahloff EG, Duggan J. The role of community pharmacies in providing access to HIV post-exposure prophylaxis (PEP). Journal of Community Health. 2024 Apr;49(2):222-8.
  83. Blenkinsopp A, Bond C, Raynor DK. Medication reviews. British journal of clinical pharmacology. 2012 Oct;74(4):573-80.
  84. Cohen MS, Chen YQ, McCauley M, Gamble T, Hosseinipour MC, Kumarasamy N, Hakim JG, Kumwenda J, Grinsztejn B, Pilotto JH, Godbole SV. Antiretroviral therapy for the prevention of HIV-1 transmission. New England Journal of Medicine. 2016 Sep 1;375(9):830-9.
  85. Laliberté MC, Perreault S, Damestoy N, Lalonde L. Ideal and actual involvement of community pharmacists in health promotion and prevention: a cross-sectional study in Quebec, Canada. BMC public health. 2012 Dec;12:1-1.
  86. Ajagu N, Anetoh MU, Nduka SO. Expanding HIV/AIDS care service sites: a cross sectional survey of community pharmacists’ views in South-East, Nigeria. Journal of Pharmaceutical Policy and Practice. 2017 Dec;10:1-2.
  87. Maja L, Polile R, Khoarai N, Ramathebane M. Pharmacists’ perspective on hiv testing services in community pharmacies in maseru, lesotho. International Journal of Current Research in Life Sciences. 2018;7(04):1594-8.
  88. Adeola, O.A. The opinions of pharmacists in Ondo state, Nigeria, towards the inclusion of HIV services into community pharmacies. S Am J Public Health. 2014;2(3):476-88.
  89. Henderson KC, Hindman J, Johnson SC, Valuck RJ, Kiser JJ. Assessing the effectiveness of pharmacy-based adherence interventions on antiretroviral adherence in persons with HIV. AIDS patient care and STDs. 2011 Apr 1;25(4):221-8.
  90. Kielly J, Kelly DV, Hughes C, Day K, Hancock S, Asghari S, Gahagan J, Marra C, Nguyen H. Adaptation of POCT for pharmacies to reduce risk and optimize access to care in HIV, the APPROACH study protocol: examining acceptability and feasibility. Pilot and feasibility studies. 2018 Dec;4:1-0.
  91. Babigumira JB, Castelnuovo B, Stergachis A, Kiragga A, Shaefer P, Lamorde M, Kambugu A, Muwanga A, Garrison LP. Cost effectiveness of a pharmacy-only refill program in a large urban HIV/AIDS clinic in Uganda. Plos one. 2011 Mar 28;6(3):e18193.
  92. Clark M, Bailey S. Chatbots in Health Care: Connecting Patients to Information. Canadian Journal of Health Technologies. 2024 Jan 22;4(1).
  93. Prochaska JJ, Vogel EA, Chieng A, Kendra M, Baiocchi M, Pajarito S, Robinson A. A therapeutic relational agent for reducing problematic substance use (Woebot): development and usability study. Journal of medical Internet research. 2021 Mar 23;23(3):e24850.
  94. Radziwill NM, Benton MC. Evaluating quality of chatbots and intelligent conversational agents. 2017 Apr 15. arXiv:1704.04579.
  95. Inkster B, Sarda S, Subramanian V. An empathy-driven, conversational artificial intelligence agent (Wysa) for digital mental well-being: real-world data evaluation mixed-methods study. JMIR mHealth and uHealth. 2018 Nov 23;6(11):e12106.
  96. Chow JC, Wong V, Li K. Generative Pre-Trained Transformer-Empowered Healthcare Conversations: Current Trends, Challenges, and Future Directions in Large Language Model-Enabled Medical Chatbots. BioMedInformatics. 2024 Mar 14;4(1):837-52.
  97. Ni L, Lu C, Liu N, Liu J. Mandy: Towards a smart primary care chatbot application. InInternational symposium on knowledge and systems sciences 2017 Oct 17 (pp. 38-52). Singapore: Springer Singapore.
  98. O’Leary K, Tanghe D, Pratt W, Ralston J. Collaborative health reminders and notifications: Insights from prototypes. InAMIA Annual Symposium Proceedings 2018 (Vol. 2018, p. 837). American Medical Informatics Association.
  99. Calvaresi D, Eggenschwiler S, Mualla Y, Schumacher M, Calbimonte JP. Exploring agent-based chatbots: a systematic literature review. Journal of Ambient Intelligence and Humanized Computing. 2023 Aug;14(8):11207-26.
  100. Fadhil A, Villafiorita A. An adaptive learning with gamification & conversational UIs: The rise of CiboPoliBot. InAdjunct publication of the 25th conference on user modeling, adaptation and personalization 2017 Jul 9 (pp. 408-412).
  101. Singh J, Sillerud B, Singh A. Artificial intelligence, chatbots and ChatGPT in healthcare—narrative review of historical evolution, current application, and change management approach to increase adoption. Journal of Medical Artificial Intelligence. 2023 Dec 30;6.
  102. Office of the National Coordinator for Health Information Technology. Patient engagement playbook. HealthIT.gov. 2023. Available online: https://www.healthit.gov/playbook/patient-engagement/ (accessed on 23 June 2024).
  103. Suppadungsuk S, Thongprayoon C, Miao J, Krisanapan P, Qureshi F, Kashani K, Cheungpasitporn W. Exploring the Potential of Chatbots in Critical Care Nephrology. Medicines. 2023 Oct 20;10(10):58.
  104. Yang HS, Wang F, Greenblatt MB, Huang SX, Zhang Y. AI Chatbots in Clinical Laboratory Medicine: Foundations and Trends. Clinical Chemistry. 2023 Nov;69(11):1238-46.
  105. Kadariya D, Venkataramanan R, Yip HY, Kalra M, Thirunarayanan K, Sheth A. KBot: Knowledge-enabled personalized chatbot for asthma self-management. In2019 IEEE International Conference on Smart Computing (SMARTCOMP) 2019 Jun 12 (pp. 138-143). IEEE.
  106. Van Velsen L, Wentzel J, Van Gemert-Pijnen JE. Designing eHealth that matters via a multidisciplinary requirements development approach. JMIR research protocols. 2013 Jun 24;2(1):e2547.
  107. O’connor S, Hanlon P, O’donnell CA, Garcia S, Glanville J, Mair FS. Understanding factors affecting patient and public engagement and recruitment to digital health interventions: a systematic review of qualitative studies. BMC medical informatics and decision making. 2016 Dec;16:1-5.
  108. What Is Digital Health? Food and Drug Administration. 2020 Sep 22. Available online: https://www.fda.gov/medical-devices/digital-health-center-excellence/what-digital-health.
  109. Crilly P, Jair S, Mahmood Z, Moin Khan A, Munir A, Osei-Bediako I, Samir M, Kayyali R. Public views of different sources of health advice: pharmacists, social media and mobile health applications. International Journal of Pharmacy Practice. 2019 Feb;27(1):88-95.
  110. Benetoli A, Chen TF, Aslani P. The use of social media in pharmacy practice and education. Research in social and administrative pharmacy. 2015 Jan 1;11(1):1-46.
  111. Cain J, Romanelli F, Fox B. Pharmacy, social media, and health: Opportunity for impact. Journal of the American pharmacists Association. 2010 Nov 1;50(6):745-51.
  112. Kayyali R, Crilly P. Digital media in pharmacy public health. Pharmacy & Pharmacology International Journal. 2016;4(2):00069.
  113. Shcherbakova N, Shepherd M. Community pharmacists, Internet and social media: an empirical investigation. Research in Social and Administrative Pharmacy. 2014 Nov 1;10(6):e75-85.
  114. Lam, A. Practice innovations: delivering medication therapy management services via videoconference interviews. The Consultant Pharmacist®. 2011 Oct 1;26(10):764-74.
Preprints 115277 g001
Figure 1. Guiding composite conceptual framework.
Figure 1. Guiding composite conceptual framework.
Preprints 115277 g001
Table 1. Participating pharmacists’ sociodemographic and professional characteristics (n = 41).
Table 1. Participating pharmacists’ sociodemographic and professional characteristics (n = 41).
Characteristic n (%) Mean ± SD (range)
City of work
 Montreal 28 (68%)
 Other cities 13 (32%)
Age - 36 yrs. ± 8 (23 –52)
Ethnicity
 French Canadian 20 (49%)
 Other 21 (51%)
Sexual orientation
 Heterosexual 35 (85%)
 Homosexual 3 (7%)
 Bisexual 3 (7%)
Gender
 Female 25 (61%)
 Male 16 (39%)
Years of pharmacy experience - 10 yrs. ± 8 (1 – 30)
Main setting of pharmacy practice
 Community 28 (68%)
 Hospital 13 (32%)
Patient groups seen by pharmacists
 Women 22 (54%)
 People from LGBTQ+ community 19 (46%)
 People who use injection drugs 16 (39%)
 People from countries where HIV is endemic 15 (37%)
 HIV-negative partners of PWH 8 (20%)
 Indigenous people 5 (12%)
 Elderly 5 (12%)
 Sex workers 4 (10%)
 Incarcerated people 1 (2%)
 Dialysis patients with frequent transfusions 1 (2%)
Percentage of patients with HIV - 8 ± 15 % (0 – 75%)
Percentage of patients at high risk of HIV - 12 ± 15% (0 – 66%)
Years of using Facebook Messenger regularly - 11 yrs. ± 3 (1 – 20)
Frequency of using applications related to health/work on pharmacists’ mobile devices - 2 ± 1 (0 – 4)*
* Frequency of use was rated on a 5-point scale from 0 = “Never” to 4 = “Very frequently.”.
Table 2. Pharmacists’ perceived knowledge to counsel people with HIV in various areas of HIV care.
Table 2. Pharmacists’ perceived knowledge to counsel people with HIV in various areas of HIV care.
Area Response* n Mean ± SD
1 2 3 4 5 6
HIV prevention 1 3 10 11 12 4 4.02 ± 1.20
HIV transmission 1 3 8 14 11 4 4.05 ± 1.17
HIV/AIDS symptoms & disease progression 1 6 16 12 1 5 3.51 ± 1.21
HIV treatments 1 4 20 10 1 5 3.51 ± 1.17
Adverse effects and drug-drug interactions with HIV treatments 1 4 19 8 4 5 3.61 ± 1.23
Global average 3.74 ± 1.20
*1=very unprepared; 2=unprepared; 3=somewhat unprepared; 4=somewhat prepared; 5=prepared; 6=very prepared.
Table 3. Pharmacists’ attitudes to people with HIV and their related care.
Table 3. Pharmacists’ attitudes to people with HIV and their related care.
Statement Response* n Mean ± SD
1 2 3 4 5 6
Providing information about HIV/AIDS is part of a pharmacist’s professional responsibility 0 0 2 7 14 18 5.17 ± 0.88
I have time while at work to answer questions about HIV/AIDS 2 8 8 9 7 7 3.78 ± 1.49
People who are educated about how HIV is transmitted sexually will change their risky behavior 1 1 6 19 11 3 4.15 ± 1.00
People who are educated about how HIV is transmitted by contaminated needles will change their risky behavior 2 2 9 19 5 4 3.85 ± 1.16
Some people who have HIV/AIDS deserve to have the disease** 34 5 2 0 0 0 5.78 ± 0.52
Drugs to treat HIV/AIDS are too expensive for the pharmacy to keep in stock 1 6 16 8 6 4 3.59 ± 1.25
Approved treatments for HIV/AIDS simply delay the inevitable and may not be worthwhile** 29 9 2 1 0 0 5.61 ± 0.69
I would provide information about a patient’s HIV status to healthcare providers other than the prescribing physician 22 5 7 5 1 1 2.05 ± 1.34
I might become infected with HIV from contact with an HIV/AIDS patient when I am working** 17 10 8 2 3 1 2.90 ± 1.14
Many of my patients are at high risk for HIV/AIDS 14 16 5 3 3 0 2.15 ± 1.18
I might be sued if I unknowingly advise an HIV/AIDS patient with incomplete medication information 1 7 8 6 12 7 4.02 ± 1.44
I am willing to work with a coworker who has HIV/AIDS 0 0 0 4 9 28 5.59 ± 0.66
Continuing education on HIV/AIDS should be mandatory 3 4 11 11 10 2 3.66 ± 1.28
Global mean 4.02 ± 1.64
*1=Strongly Disagree; 2=Disagree; 3=Somewhat Disagree; 4=Somewhat Agree; 5=Agree; 6=Strongly Agree. **The reversal process for this item converts the original score x to the reversed score 7−x, to calculate the global mean.
Table 4. Pharmacists’ involvement in HIV care services.
Table 4. Pharmacists’ involvement in HIV care services.
HIV care service Response* n Mean ± SD
1 2 3 4 5
Pharmaceutical care to HIV patients 9 23 4 1 4 2.22 ± 1.12
Adherence counseling for HIV/AIDS patients 9 15 9 3 5 2.51 ± 1.25
Referral of patients for postexposure prophylaxis (PEP) 10 15 12 3 1 2.27 ± 0.99
Refill of ART 15 9 7 8 2 2.34 ± 1.28
Stocking of ART 19 7 10 4 1 2.05 ± 1.15
Social responsibility to HIV patients 18 12 6 3 2 2.00 ± 1.15
Treatment and monitoring of ART 13 12 10 2 4 2.32 ± 1.24
Provision of a PEP test for a patient 31 8 1 0 1 1.34 ± 0.75
Home delivery of ART 24 10 3 3 1 1.71 ± 1.04
Global mean 2.08 ± 1.12
*1=Not Involved; 2=Little Involvement; 3=Moderately Involved; 4=Very Involved; 5=Very Much Involved. PEP = post-exposure prophylaxis; ART = antiretroviral therapy.
Table 5. Pharmacists’ perceived competence in the delivery of HIV care.
Table 5. Pharmacists’ perceived competence in the delivery of HIV care.
Statement Response* n Mean ± SD
1 2 3 4 5 6
I believe I am able to confidently manage the complex issues & experiences faced by patients living with HIV 10 10 11 4 2 4 2.76 ± 1.53
I feel I am unable to spend sufficient time counseling patients living with HIV** 5 7 11 14 1 3 3.81 ± 1.31
I am satisfied with the amount of care I provide to patients living with HIV 4 12 11 8 2 4 3.10 ± 1.39
I sometimes feel hesitant to dispense HIV medicines to patients living with HIV** 27 8 3 3 0 0 5.44 ± 0.91
Global mean 3.78 ± 1.31
*1=Strongly Disagree; 2=Disagree; 3=Somewhat Disagree; 4=Somewhat Agree; 5=Agree; 6=Strongly Agree. **The reversal process for this item converts the original score x to the reversed score 7−x, to calculate the global mean.
Table 6. Pharmacists’ perceived barriers to providing HIV care.
Table 6. Pharmacists’ perceived barriers to providing HIV care.
Barrier Response* n Mean ± SD
1 2 3 4 5 6
Lack of clinical tools (i.e., HIV test kits) 0 3 6 16 11 5 4.22 ± 1.07
Lack of collaboration with other healthcare professionals 3 7 9 14 5 3 3.49 ± 1.31
Lack of information or training on HIV/AIDS services 0 6 5 19 5 6 4.00 ± 1.19
Lack of staff resources 1 4 1 14 16 5 4.34 ± 1.18
Absence of financial compensation 2 9 8 8 8 6 3.71 ± 1.49
Lack of space/inadequate physical design of the pharmacy 5 6 6 9 10 5 3.68 ± 1.57
Lack of time 3 1 1 9 14 13 4.68 ± 1.39
Patients are not interested in preventive services 3 9 12 13 3 1 3.17 ± 1.15
*1=Strongly Disagree; 2=Disagree; 3=Somewhat Disagree; 4=Somewhat Agree; 5=Agree; 6=Strongly Agree.
Table 7. Pharmacists’ perceived acceptability and compatibility the chatbot and self-efficacy to use Internet health services.
Table 7. Pharmacists’ perceived acceptability and compatibility the chatbot and self-efficacy to use Internet health services.
Response* n Mean ± SD
1 2 3 4 5 6 7
Acceptability
MARVIN Pharma Chatbot meets my approval 1 1 1 31 3 3 1 4.15 ± 0.95
MARVIN Pharma Chatbot is appealing to me 1 0 1 26 8 4 1 4.37 ± 0.92
I like MARVIN Pharma Chatbot 1 0 1 30 7 1 1 4.20 ± 0.80
I welcome MARVIN Pharma Chatbot 1 0 0 23 7 8 2 4.63 ± 1.10
Global mean 4.34 ± 0.95
Compatibility
Using MARVIN Pharma Chatbot is compatible with all aspects of my work 1 0 2 27 7 3 1 4.27 ± 0.94
Using MARVIN Pharma Chatbot is completely compatible with my current situation 1 0 5 28 3 4 0 4.07 ± 0.90
I think that using MARVIN Pharma Chatbot fits well with the way I like to work 1 0 7 26 3 3 1 4.07 ± 0.90
Using MARVIN Pharma Chatbot fits into my work style 1 1 3 27 6 2 1 4.12 ± 0.97
Global mean 4.13 ± 0.95
Self-efficacy
It is easy for me to use internet health services 0 1 0 0 15 16 9 5.76 ± 0.96
I feel uncomfortable to use internet health services** 11 16 4 0 4 5 1 5.27 ± 1.81
I am very confident in my abilities to use internet health services 0 1 0 0 15 14 11 5.81 ± 0.99
I would be able to use internet health services without much effort 0 0 1 2 14 13 11 5.76 ± 0.98
Global mean 5.65 ± 1.24
*1=Strongly Disagree; 2=Disagree; 3=Somewhat Disagree; 4=Undecided; 5=Somewhat Agree; 6=Agree; 7=Strongly Agree. ** The reversal process for this item converts the original score x to the reversed score 8−x, to calculate the global mean.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

facebook logotwitter logolinkedin logo
bsky
MDPI Initiatives
Important Links
Subscribe

Disclaimer

Terms of Use

Privacy Policy

Privacy Settings

© 2026 MDPI (Basel, Switzerland) unless otherwise stated