1. Introduction
Vaccine coverage is declining in the United States and globally [1]. COVID vaccine uptake became highly controversial in the US during the COVID pandemic, and uptake of routine vaccines was also impacted. Following the pandemic, vaccine confidence has been at an all-time low [2,3]. In parallel, the incidence of vaccine-preventable diseases, such as Mumps, Measles, Hepatitis A, and Whooping Cough (Pertussis) are on the rise. Limited access to clinical care for some vulnerable populations, such as immigrants, uninsured, underinsured, and low-income, has further reduced the uptake of childhood vaccines [4].
Clínica Esperanza/Hope Clinic (CEHC) is a free clinic located on the west side of Providence, Rhode Island that has extensive experience working with low-income, predominantly Spanish-speaking immigrants who live in Rhode Island. CEHC provides free access to vaccines and clinical care at two locations in the Valley neighborhood of Providence. At the main clinic, patients are seen by providers in-person or via telemedicine. Vaccine clinics are held at the Neighborhood Health Station (NHS), a multipurpose building where educational programs and health screening events are held. CEHC provides several educational and peer-support programs designed for the Spanish-speaking clinic population, including Vida Sana [5,6,7] and Vida Pura, for patients who have substance use disorders. The NHS also supports Health Fairs where basic point-of-care testing, including blood glucose, A1C, blood pressure, and more, is available to all. Both the main clinic and the NHS provided vaccine education and administration to patients
1.
The Oportuna Vacuna (OV) pilot intervention was designed to assess barriers to vaccination and to improve vaccine uptake over a 24-month period. The intervention involved targeted education for healthcare providers as well as patients, and workflow improvements. We hypothesized that vaccine knowledge and confidence would be low among patients and staff and that targeted education efforts would increase vaccine knowledge, confidence, and uptake among both groups. Workflow improvements included focused chart review for each scheduled clinic visit (including new patient visits), informing patients about vaccines that would be given at their visit, and establishment of protocols enabling Navegantes, bilingual community health workers cross trained as medical interpreters and medical assistants, to administer vaccines. Chart reviews before and after the intervention period were used to evaluate the impact of the intervention on vaccine uptake for previously registered patients over the 24-month period. Vaccine uptake was measured for the overall patient panel by comparing vaccinations given prior to the intervention and after the intervention. Surveys were performed before and after educational sessions for HCP and patients to evaluate changes to knowledge, attitudes, and vaccine acceptance.
This brief intervention had a strong impact on vaccine uptake, which could be attributed to educational sessions and workflow improvements. The primary impact appeared to be on vaccine uptake by new and returning patients, patients who returned after being out of state or out of the country for longer than a year, rather than improved vaccination rates for individual patients. This difference may be attributed to low overall annual follow-up rates for individual patients at CEHC, where the average visit frequency is 1.5 visits per year. Thus, many patients did not return for a second visit during the evaluation period and did not receive updated vaccines.
This program demonstrated that integrating vaccine assessments and administering vaccines as needed at each individual patient visit regardless of the reason for the visit, appears to be a successful strategy for transient populations such as the one accessing healthcare at a typical free clinic. Ambulatory clinic workflow interventions that prioritize vaccination, in conjunction with HCP and patient education, may be useful and easily implemented approaches for improving vaccine uptake in vulnerable populations.
2. Materials and Methods
This was a quality improvement study utilizing a pre- and post-intervention design. Data were collected from patient chart reviews and surveys administered to both staff and patients before and after the intervention. CEHC serves a largely uninsured, low-income immigrant population. Participants in this intervention included healthcare providers (HCPs): physicians, nurses, community health workers (CHWs), and administrative staff. Patient participants included individuals engaged in routine clinic visits, Health Fair attendees, or participants in the clinic’s lifestyle education programs, Vida Sana, and Vida Pura. No artificial intelligence, generative or otherwise, was used in the creation, implementation, or analysis of this project.
2.1. Informed Consent for Participation
Two types of participant consent were used for this intervention. For patient chart reviews, charts were selected randomly for patients who had visited during specified time periods. Charts were reviewed by clinic personnel using a vaccine uptake tracking form. Charts were only reviewed if a signed CEHC Partnership form was included in the patient documents in the chart (Appendix A). The CEHC Partnership form permits CEHC personnel to track and report patient health outcomes in deidentified individual and aggregated data sets, for the duration of the individual’s participation in clinical care at CEHC.
In addition, a standardized informed consent process was followed for individual patients and HCP who participated in OV educational sessions as follows: participants were informed about the OV objectives and asked whether they would be interested in filling out a pre- and post- intervention survey. Those individuals who responded positively to fill out surveys were then provided with information about the study and asked to complete an informed consent form.
All of the study information and all materials were provided to participants in Spanish and English, depending on the participant’s preference. For individuals who could not read, the consent form and survey were read orally to the participant in their preferred language by a trained CHW. For participants who could not write, oral consent was given, and a fingerprint was used in lieu of a written signature. Trained CHWs assisted individuals with completing the consent process and survey. Pre- and post-intervention surveys were completed anonymously, and no identifiable information was recorded on the survey forms. The study protocol and surveys were reviewed prior to the initiation of the project and approved by Salus IRB (formerly Ethical and Independent Review Services).
2.2. Chart Review
Pre- and post-intervention chart reviews (n=816 and n=709, respectively) were conducted to assess vaccine uptake for individual patients over a one-year period. The initial 816 charts were pulled from patient visits between October 1, 2022 – February 28, 2023. The same charts were reviewed in at the conclusion of the intervention and vaccine status was updated accordingly. Data collected from the charts on vaccines was stored in an encrypted Excel spreadsheet; a coding system was used to avoid disclosure of individual patient information. The results of the chart review were analyzed by clinic personnel. Charts were removed from the post intervention chart review if the patient fit one or more of the following criteria: transferred care to another health center, moved out of Rhode Island, were deceased, or if the clinic was unable to contact the patient after three phone call attempts and if no response was received to outreach letters sent to their last known address during the intervention period.
2.3. Patient Vaccine Education Programs
The vaccine education sessions were provided to all patients who were participating in health education classes at CEHC. For participants who were willing to participate in a pre- and post-education session survey, consent forms were provided, and consent was obtained prior to the education session (See informed consent section). Patient education sessions were led by multilingual CHWs (Navegantes), who provided culturally sensitive education on vaccines in Spanish. Topics covered in these sessions included vaccine basics, why vaccines are an important health intervention, and detailed information about the vaccines offered at CEHC. Special sessions were devoted to COVID-19 and HPV, as both vaccines have a greater impact on health outcomes in populations that have constraints on access to specialized care. Material included in the presentation was sourced from the World Health Organization (WHO) [8], National Cancer Institute [9], and Rhode Island Department of Health (RIDOH) [10]. Participants in these sessions viewed a presentation about the aforementioned topics with an open question-and-answer and discussion session with the Navegante instructors following the conclusion of the presentation. The topics in the presentation and discussion session aligned with the topics covered in the pre- and post-intervention surveys. All class attendees received the presentation and participated in the discussion, only those who wished to participate in the study were consented following the consent process outlined in the “Informed Consent for Participation” section prior to completing the pre-survey.
2.4. Healthcare Provider Educational Programs
Medical providers, including volunteer medical doctors, physician assistants, nurse practitioners, and registered nurses (MDs, PAs, NPs, and RNs), also participated in vaccine education programs; however, these were individual efforts, using “continuing education” materials available online. For example, individual providers completed the CDC’s “You Call the Shots” online modules during the intervention period. These “You Call the Shots” modules addressed vaccine recommendations including for the HPV, flu, Hepatitis B, Diphtheria, Tetanus, and Pertussis (TDAP), pneumococcal pneumonia vaccines. Other topics covered by the CDC online modules included vaccine handling, storage, best practices and immunization schedules. Additionally, providers were asked to complete the International Pediatric Association’s (IPA) Vaccine Trust Project modules online. Topics covered in the IPA modules include "infodemiology [11],” interpersonal communication, techniques related to talking about vaccines with vaccine deniers, and how to be a vaccine advocate. Other CME courses include “UpToDate” courses and CDC webinars on vaccines.
HCPs also participated in monthly "Lunch-and-Learn" sessions, which were held from March 2023 to December 2023, covering education materials related to vaccination guidelines and best practices. Clinical staff, including CHWs, nurses, administrative staff, and providers participated in the Lunch-and-Learn sessions. Topics covered included motivational interviewing and the AIMS method for achieving higher vaccine uptake, HPV and HPV vaccinations, vaccination best practices and current CDC guidelines, and more. Training materials were sourced from the CDC’s “You Call the Shots” online training module series, the WHO, the IPA’s Vaccine Trust Project online modules, and RIDOH. The sessions were presented to staff through PowerPoint presentations in English with real-time Spanish translation, as many of the CHWs at CEHC speak Spanish as their first language. Paper-based knowledge attitudes and practices surveys were administered to both staff and patients, pre- and post-intervention, to evaluate their knowledge and attitudes towards vaccines (Appendix B).
The AIMS approach [12] was implemented during OV and explained to HCPs during Lunch and Learn sessions and provided to volunteers in an online module. AIMS is an acronym for “Announce, Inquire, Mirror, Secure”. Vaccine providers are asked to Announce the plan to vaccinate during a patient’s clinic visit, in a professional manner. If the vaccine recipient hesitates, the vaccine provider then Inquires about the hesitation, asking open-ended questions and seeking to understand the patient’s hesitancy or concerns. Instead of responding directly to patient’s concerns, the AIMS method recommends that the provider Mirror their response, demonstrating active listening. The Inquire-Mirror steps continue until the provider and patient establish that the HCP understands the patient’s vaccine-related concerns. Once that agreement is reached, the provider moves to Secure trust, by responding to the patient’s concerns with information that fits the patient’s needs. If the patient is still hesitant or refuses, then the provider can explain that while they disagree with the patient, they share a concern for the patient’s health. The focus is on securing trust and mutual respect which then enables the HCP to provide all, or some of the vaccines that are recommended to the patient. The vaccination then proceeds or the plan to vaccinate will be modified to fit the agreement between the patient and the HCP.
2.5. Clinic Workflow Changes
Clinical interventions were primarily focused on workflow improvements. For example, pre-visit chart reviews identified vaccines due for each patient, and Navegantes informed patients of their vaccination needs during check-in for their appointment using the AIMS approach described above. Vaccines were administered by Navegantes and nursing staff using a pre-approved protocol, reducing the need for individual review and approval by supervisory HCP. Additionally, Navegantes added the appropriate vaccine consent forms and required VIS documents to the patient’s folder prior to the visit. Doing so ensured that all Navegantes and HCPs that worked with that patient were aware of the vaccines the patient was going to be receiving during the visit. A vaccination z-code was automatically added to every office visit type in the electronic medical record system (EMR) which is an added reminder for Navegantes and HCPs to discuss vaccination with every patient at every visit, as warranted.
Primary outcomes related to clinic workflow changes included vaccination records (number of vaccines distributed at the clinic, based on nursing documentation), and by retrospective chart review, prior to the interventions listed above and during the post-intervention period.
3. Results
3.1. Clinic Population
CEHC primarily serves Spanish-speaking immigrants that work in low-income employment, are uninsured, have multiple chronic health problems, and who have low health literacy. Most of the HCP staff members are also immigrants or second-generation Americans. CEHC patients have limited access to healthcare as are not eligible for subsidized or public medical insurance due to their recent immigration status - public support such as Medicaid is not available until the individual has been a legal resident for more than five years - and their employment income is usually insufficient to pay for employer-based or private health insurance.
3.2. Chart Review Population
816 charts were randomly selected for the initial chart review (CR1); 709 of these individuals were still active patients at CEHC at the time of the post-intervention chart review (CR2). 48% of the patients included in the chart review identified as female and 52% identified as male with 0.1% identifying as transgender; these proportions did not change between CR1 and CR2. The ages of patients ranged from 18 to 87 years old, and the average and median age of both CR populations was 47 years old. Approximately 93% of patients included in the chart review identified as Hispanic or Latino, 5% identified as Black/African American, and 14% identified as White.
3.3. Survey Participants
Of the 36 individuals who completed surveys pre-and post-educational sessions, 69% were female, 25% were male, and 0.5% chose not to disclose their gender. Ages ranged from 23 to 62 years old. Survey respondents were also asked about their education history: 19% reported that they had only completed primary school, 42% reported completing high school, and 25% had completed college. Staff surveys (10 total) were also performed.
Figure 1.
Heat Map View of CEHC Patient Demographics in Initial Chart Review Cohort.
Figure 1.
Heat Map View of CEHC Patient Demographics in Initial Chart Review Cohort.
The heat map is overlaid on a frequency table showing the cohort participants’ age range and ethnicity/race. The increased intensity of the blue color indicates increased frequency among demographic categories. The increased intensity of the green color indicates increased frequency and relative frequency in the totals. M indicates male gender. F indicates female gender. Tr indicates that a survey participant marked a gender other than male or female.
3.4. Chart Review
Vaccine uptake and completion status for the individual patients evaluated during Chart Review I (CR1) and Chart Review II (CR2) improved, but not at the same pace as the overall vaccination rate at CEHC. The patient population at CEHC is highly transient, and patients often move unexpectedly, transfer care to other health centers when they become insured, or change jobs, or are otherwise lost to follow up. 107 (13%) of the charts were removed from the second chart review (CR2), and for those reasons, a total of 709 charts reviewed in CR2.
Chart review focused on the following vaccines and used the CDC recommendations for vaccination for the age and health status of the individual: flu, Tdap, Pneumococcal Pneumonia, Hepatitis B, Measles, Mumps, Rubella (MMR), Varicella, HPV, and COVID-19. For the purpose of this study, “up to date” for COVID-19 vaccines was defined as having received a full series of Johnson & Johnson (1-dose series), Pfizer or Moderna (2-dose series) and a booster (monovalent or bivalent) at the time of chart review.
3.4.1. Chart Review 1 Findings
Charts were randomly selected for CR1 based on the following criteria: the patient had an office visit before the intervention period (between October 1, 2022, and February 28, 2023), was 18 years or older, and had a signed partnership form in their patient file. Charts that did not fit those criteria were removed and not included in the study. After chart identification and data collection, charts were de-identified for the purpose of data analysis and reporting.
Chart reviews performed for CR1 determined that 37.5% of individuals were not up to date with any vaccines they were eligible for and were recommended by the CDC. Only 2 individual patients were completely up to date with all vaccines they were eligible for and that were recommended by the CDC. Only 43 patients received 50% or more of the vaccines recommended to them.
3.4.2. Chart Review 2 Findings
The same charts from CR1 were reviewed in CR2. Between CR1 and CR2, charts were removed following the protocol described above. As with CR1, after data collection, these charts were de-identified for the purpose of analysis and reporting. At the time of the second chart review (CR2), fewer (25% percent) of individuals were found to be not up to date with their vaccines and only one more individual (for a total of 3) was entirely up to date on all vaccines. However, the proportion of individuals who had received 50% or more of the vaccines recommended to them increased from 43 to 106 at the time CR2 was performed. The chart review also revealed an 88% increase in individuals who had received a bivalent COVID-19 booster and a decrease in COVID-19 unvaccinated patients. Other than for COVID vaccines, there was only a slight increase in specific vaccine uptake between CR1 and CR2. (Table 1).
While the absolute number of vaccinations increased by four-fold during the intervention, the number of individuals who were up to date with their recommended vaccinations, based on the Chart Reviews, only increased by 28% on average during the intervention (
Table 2). The definition of “up to date” also changed during the period of the intervention, as a new COVID vaccine booster was introduced. As a result, the number of patients who were up to date with their COVID-19 vaccination decreased. (
Table 3A and
Table 3B).
Table 2.
– Chart Review: Up to Date by Vaccine.
Table 2.
– Chart Review: Up to Date by Vaccine.
| Vaccine |
CR1 |
CR2 |
| Flu (2022-2023 batch) |
309 |
315 |
| Tdap |
243 |
308 |
| Pneumococcal |
132 |
158 |
| Hep B |
56 |
119 |
| MMR |
46 |
71 |
| Varicella |
30 |
56 |
| HPV |
30 |
38 |
The table compares the first and second chart reviews to see how many patients were “Up to Date,” meaning that they had received all the vaccines that the CDC recommended in 2022-2023.
Table 3.
A – Chart Review: COVID-19 Vaccine Uptake.
Table 3.
A – Chart Review: COVID-19 Vaccine Uptake.
| |
CR1 (n=816) |
CR2 (n=709) |
|
| COVID-19 Status |
# of Pts |
% of Total Pts |
# of Pts |
% of Total Pts |
Difference in Percentage Points |
| Primary Series is still in progress* |
18 |
2.21% |
9 |
1.27% |
-0.94% |
| Completed Primary Series |
664 |
81.37% |
607 |
85.61% |
4.24% |
| Received monovalent booster |
311 |
38.11% |
297 |
41.89% |
3.78% |
| Received bivalent booster(s) |
100 |
12.25% |
188 |
26.52% |
14.26% |
| "Up to Date" on series/booster as defined by CDC* |
105 |
12.87% |
181 |
25.53% |
12.66% |
| Unvaccinated (0 doses) |
33 |
4.04% |
12 |
1.69% |
-2.35% |
| Missing documentation/unconfirmed vaccination status |
96 |
11.76% |
67 |
9.45% |
-2.31% |
The table compares the first and second chart reviews to see the COVID-19 vaccination status of patients, including primary series vaccination and monovalent booster vaccination, after the introduction of the new bivalent booster. Here the symbol * indicates that monovalent COVID-19 vaccines lost FDA approval for use in April 2023, meaning that the vaccine cadence was updated by health authorities. Some categories in the table overlap, such as how those who receive a monovalent booster could have also completed a primary series.
Table 3.
B – Chart Review: COVID-19 Vaccine Uptake.
Table 3.
B – Chart Review: COVID-19 Vaccine Uptake.
| COVID-19 Status |
CR1 |
CR2 |
| Completed Primary Series |
664 |
607 |
| Received monovalent booster(s) |
311 |
297 |
| Received bivalent booster(s) |
100 |
188 |
The table compares the first and second chart reviews to see COVID-19 vaccination status with the introduction of the new bivalent booster.
3.5. Vaccine Administration to CEHC Patients
Separately from the chart review, the clinic was able to track the total number of vaccines ordered and administered during 2022 and 2023 for this study. Individuals who were not included in the chart review (and thus were likely to be receiving vaccines for the first time at CEHC) were asked about vaccination status and vaccinated per clinic protocol as described above in “clinic workflow changes”. Vaccine administration increased significantly during the intervention period (2023), compared to the previous year (
Figure 2). The most significant changes were noted in the following areas: TDAP vaccines (529% increase; 66 doses in 2022 vs. 349 doses in 2023), Hepatitis B (897% increase; 36 doses in 2022 vs. 323 doses in 2023), and the overall vaccines administered across patients visiting the clinic (414% increase; 356 doses in 2022 vs. 1,473 doses in 2023).
During the period from April to August 2023 (when HCP educational sessions were taking place), an average of 133 vaccines were administered each month, compared to an average of 24 during the same period in 2022. CEHC was provided with access to the varicella vaccine by the RI Department of Health in 2023, and over 100 doses were administered during the April to August intervention period. Other routine immunizations that increased during the intervention included Hepatitis B, HPV, MMR, Tdap, and pneumococcal pneumonia vaccines.
These improvements were likely attributable to the workflow modifications, which allowed for the timely identification and administration of vaccines during patient visits. However, it is also possible that reinforcement of vaccine knowledge through the “Lunch and Learn” education sessions gave HCPs more confidence to discuss vaccination schedules during patient visits and to reinforce the importance of being up to date with vaccines.
This figure compares the number of CDC-recommended vaccines administered between 2022 and 2023. There is a marked upwards trend across all vaccines listed except for Hepatitis A.
Figure 3.
– Vaccine Administration by Month (2022 vs. 2023).
Figure 3.
– Vaccine Administration by Month (2022 vs. 2023).
This figure compares the monthly number of CDC-recommended vaccines administered in two adjacent years, 2022 and 2023. Only the months of April to August were included because that is the period when HCP educational sessions took place in August 2023. There is a marked upwards trend across all included months.
3.6. Survey Results
36 participants completed pre- and post-educational session surveys yielding a total of 72 completed surveys. Several measures of vaccination knowledge improved. For example, the proportion of patients correctly identifying the recommended age group for HPV vaccination increased significantly (76% and 33% increases in choosing the correct age groups “boys and girls ages 9-26,” and “adults ages 27-45,” respectively). Additionally, the number of participants who correctly identified a link between cervical cancer prevention and the HPV vaccine increased (17 in the pre-survey, 28 in the post-survey), and more individuals reported that they were willing to vaccinate their children against HPV (18 in the pre-survey, 28 in the post-survey).
The proportion of participants that correctly identified groups at a higher risk of severe COVID-19 infections also increased after the educational intervention. Additionally, survey respondents expressed an increase in willingness to receive the COVID-19 vaccine (80% increase between pre- and post-survey) and recommend it to others in post-survey responses: 7% increase for “to the elderly,” 21% increase in “to my family,” 41% increase in “to children,” and 17% increase in “to my friends/colleagues/neighbors”. There was a 100% decrease in respondents saying they do not recommend it between the pre- and post-survey.
The figure compares responses before and after the educational session for 36 participants when asked the question: indicate how often you follow the recommendations of the people/entities below regarding vaccination. The red and blue lines are included for ease of comparison between the pre-session survey and the post-session survey.
Both pre- and post-surveys showed that patients trust the Navegantes and HCPs at CEHC at a higher rate than other health authorities and trustworthy individuals in patients’ lives such as parents, siblings, close friends, and neighbors (see
Figure 4). Patients showed they had less trust in celebrities, athletes, and religious leaders compared to the healthcare team at CEHC. Additionally, survey respondents indicated that discussions with CEHC’s Navegantes, HCPs, or discussions in a healthy lifestyle education class increased their trust in vaccines. While the sample size of the survey is small, this finding reinforces the hypothesis that CEHC is a highly trusted community organization and source of health information.
3.7. Staff Education and Feedback
The “Lunch-and-Learn” sessions were well-received, with an average attendance of 7 staff members per session. Staff feedback highlighted improved confidence in discussing vaccines with patients. Staff survey results demonstrated an increase in knowledge of vaccine guidelines and confidence in administering vaccines. The sample size for staff surveys was small (n=5 for pre-survey, n=4 for post-survey), but findings from these surveys indicated an increase in fact-based knowledge around vaccines including correctly identifying what vaccines help prevent which infectious disease (see supplemental Table 4), the link between HPV infection and cervical cancer, and which higher risk patient populations should receive specific vaccines.
Moreover, the practice and implementation of the AIMS method for discussing vaccines with patients helped to reinforce the workflow modifications and learnings from the Lunch-and-Learn sessions. Staff reported higher levels of confidence and comfort when discussing the importance of vaccination with vaccine hesitant patients in the months following the trainings.
4. Discussion
Understanding whether access to vaccines or vaccine confidence, or both, are impacting vaccination rates, is critical to improving vaccine uptake interventions in the United States, especially among vulnerable populations such as the undocumented, uninsured, and immigrant populations living in urban and rural areas. Vaccine-preventable outbreaks, including measles outbreaks and COVID-19 transmission at the community level, disproportionately affect immigrants who are under-vaccinated [14]. Outbreaks of vaccine-preventable diseases can be severe, affecting thousands of families, as has been observed with measles in New York City [15]. Undocumented, immigrant and uninsured populations in the United States have been especially hard-hit by outbreaks of infectious diseases such as Hepatitis B, Measles, Mumps, and Meningitis. Rates of routinely recommended vaccinations among uninsured adults are significantly lower compared to those who are insured, and are as low as 16.6% for Hepatitis A, 14.4% for Influenza, and 20.9% for HPV, which causes cervical cancer. Vaccination rates have been further suppressed by limited access to care during the COVID pandemic fears of “becoming a public charge” by utilizing government-funded health promotion programs during previous administrations [16,17,18].
CEHC has previously published studies evaluating vaccination and Knowledge, Attitudes and Practices (KAP) including willing to participate in vaccination, specifically related to HPV vaccination, in 2013 [19]. 100 clinic patients were recruited for this study during routine clinic visits. When compared to the non-Hispanic study participants in the intervention, Hispanic study participants also had more limited knowledge of HPV and cervical cancer than non-Hispanics, as has previously been reported. Hispanic survey participants were also less likely to know where to get tested for cervical cancer and STIs, and less knowledgeable methods for protection against STIs and HPV vaccines. These findings were consistent with published studies and reflected a need for increased education of the patient population, especially since Latina women are at increased risk for cervical cancer [20,21]. Following this KAP intervention, CEHC conducted an HPV vaccination campaign, “Entre Mujeres” which was extremely successful, causing a 60-fold increase in the number of women receiving HPV vaccinations at CEHC [22].
While this study did not demonstrate a direct link between the AIMS approach and the education sessions with patient vaccine uptake, the HCP surveys indicated that HCP had increased confidence and knowledge about vaccines. When CEHC combined HCP training on the AIMS method with improved vaccine workflows, more individual patients were vaccinated. Implementation of these methods may improve overall vaccination rates in ambulatory care settings. It is certainly possible that HCPs were more confident when discussing vaccinations with patients at various stages of their visits at the clinic, which improved their ability to complete the vaccination plans that were established by improved workflows for each patient. AIMS training, vaccine education sessions, and workflow modifications are all interventions that can be implemented in other clinics serving vulnerable, under-vaccinated populations.
In conclusion, providing educational sessions on vaccines to HCP and patients, while streamlining vaccination procedures in an ambulatory setting, may successfully improve vaccine knowledge, confidence, and vaccine uptake. Increasing patient acceptance and HCP confidence in vaccines may have similar effects on vaccine uptake in other clinics serving low-income, Spanish-speaking immigrant patients. These efforts may also serve to reinforce vaccinations of children by immigrant families that can least afford the healthcare costs associated with illness from vaccine-preventable infectious diseases.
Supplementary Materials
The following supporting information can be downloaded at the website of this paper posted on Preprints.org. Supplementary materials can be viewed at [placeholder for MDPI link]. Supplement A: Clinica Esperanza Partnership Form, Supplement B: Oportuna Vacuna Patient Consent Form (English), Supplement C: Supplementary Figures and Tables
Author Contributions
Conceptualization, A.D.G., M.L., J.M., J.T.; Methodology, A.DG., M.L., J.M., J.T.; Validation, M.L., J.T., C.W.; Formal Analysis, J.T., C.W.; Investigation, A.DG., S.F., M.L., J.M., J.T.; Resources, M.L., S.F.; Data Curation, J.T.; Writing – Original Draft Preparation, A.DG., M.L., J.T., C.W.; Writing – Review & Editing, A.DG., M.L., J.M., J.T., C.W.; Visualization, J.T., C.W.; Supervision, A.DG., M.L., Project Administration, M.L., J.M., J.T.; Funding Acquisition, A.DG., M.L.
Funding
Oportuna Vacuna was funded by a research grant from the Investigator-Initiated Studies Program of Merck Sharp & Dohme LLC (MISP #100868). The opinions expressed in this paper are those of the authors and do not necessarily represent those of Merck Sharp & Dohme LLC.
Institutional Review Board Statement
The study was conducted in accordance with the Declaration of Helsinki and approved by Salus Institutional Review Board (formerly Ethical and Independent Review Services). Protocol number: IRB#22257. Informed Consent Statement: Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
The data presented in this study are available upon request from the corresponding authors in compliance with HIPAA and all applicable privacy laws.
Acknowledgments
We are grateful to the individuals who generously agreed to participate in this study and the staff and volunteers of Clínica Esperanza/Hope Clinic for their work on this study. Their support played a pivotal role in the implementation and success of this program, enabling us to make a meaningful impact on the health and well-being of our patients. We would also like to thank the Rhode Island Department of Health for their support in providing us with vaccines to administer to patients and study participants. Generative AI was not used in this study.
Conflicts of Interest
The authors declare no conflicts of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.
Abbreviations
The following abbreviations are used in this manuscript:
| AIMS |
AIMS Approach; Announce, Inquire, Mirror, Secure |
| CDC |
Centers for Disease Control |
| OV |
Oportuna Vacuna |
| CHW(s) |
Community Health Worker(s) |
| CEHC |
Clinica Esperanza/Hope Clinic |
| RIDOH |
Rhode Island Department of Health |
| HCP |
Healthcare Provider |
| WHO |
World Health Organization |
References
- Cunniff L, Alyanak E, Fix A, Novak M, Peterson M, Mevis K, Eiden AL, Bhatti A. The impact of the COVID-19 pandemic on vaccination uptake in the United States and strategies to recover and improve vaccination rates: A review. Hum Vaccin Immunother 2023, 19, 2246502. [CrossRef] [PubMed] [PubMed Central]
- Lu PJ, Hung MC, Srivastav A, Grohskopf LA, Kobayashi M, Harris AM, Dooling KL, Markowitz LE, Rodriguez-Lainz A, Williams WW. Surveillance of Vaccination Coverage Among Adult Populations -United States, 2018. MMWR Surveill Summ 2021,70, 1-26. [CrossRef] [PubMed] [PubMed Central]
- Oliver K, Raut A, Pierre S, Silvera L, Boulos A, Gale A, Baum A, Chory A, Davis NJ, D'Souza D, Freeman A, Goytia C, Hamilton A, Horowitz C, Islam N, Jeavons J, Knudsen J, Li S, Lupi J, Martin R, Maru S, Nabeel I, Pimenova D, Romanoff A, Rusanov S, Schwalbe NR, Vangeepuram N, Vreeman R, Masci J, Maru D. Factors associated with COVID-19 vaccine receipt at two integrated healthcare systems in New York City: a cross-sectional study of healthcare workers. BMJ Open 2022,12, e053641. [CrossRef] [PubMed] [PubMed Central]
- Santoli JM, Lindley MC, DeSilva MB, et al. Effects of the COVID-19 Pandemic on Routine Pediatric Vaccine Ordering and Administration — United States, 2020. MMWR Morb Mortal Wkly Rep 2020,69 ,591–593. [CrossRef]
- Risica PM, McCarthy ML, Barry KL, Oliverio SP, Gans KM, De Groot AS. Clinical outcomes of a community clinic-based lifestyle change program for prevention and management of metabolic syndrome: Results of the 'Vida Sana/Healthy Life' program. PLoS One 2021, 16, e0248473. [CrossRef] [PubMed] [PubMed Central]
- Risica PM, McCarthy M, Barry K, Oliverio SP, De Groot AS. Community clinic-based lifestyle change for prevention of metabolic syndrome: Rationale, design and methods of the 'Vida Sana/healthy life' program. Contemp Clin Trials Commun 2018, 12, 123-128. [CrossRef] [PubMed] [PubMed Central]
- Buckley J, Yekta S, Joseph V, Johnson H, Oliverio S, De Groot AS. Vida Sana: a lifestyle intervention for uninsured, predominantly Spanish-speaking immigrants improves metabolic syndrome indicators. J Community Health 2015, 40,116-23. [CrossRef] [PubMed]
- Vacunas E Inmunización: ¿Qué Es La Vacunación? Available online: https://www.who.int/es/news-room/questions-and-answers/item/vaccines-and-immunization-what-is-vaccination (accessed on 30 August 2021).
- El Virus Del Papiloma Humano (VPH) Y El Cáncer - Instituto Nacional Del Cáncer. Available online: https://www.cancer.gov/espanol/cancer/causas-prevencion/riesgo/germenes-infecciosos/vph-y-cancer (accessed on 3 January 2019.
- COVID-19 (Coronavirus) | Department of Health. Available online: https://health.ri.gov/covid-19-coronavirus (accessed on 10 March 2025).
- Eysenbach, Gunther. Infodemiology and Infoveillance. Am J Prev Med 2019, 40, S154–58. [CrossRef]
- Parrish-Sprowl J, Thomson A, Johnson RD, Parrish-Sprowl S. The AIMS approach: regulating receptivity in patient-provider vaccine conversations. Front Public Health 2023, 11, 1120326. [CrossRef] [PubMed] [PubMed Central]
- Wang C, Yang J, Testa J, Gill M, Leonard M, De Groot AS. Continuity of Care and Lifestyle Intervention Programs for Spanish-Speaking Immigrants Without Health Insurance at a Free Clinic in Rhode Island. Prev Chronic Dis 2024, 21, E92. [CrossRef] [PubMed] [PubMed Central]
- Zucker, J. R., Rosen, J. B., Iwamoto, M., Arciuolo, R. J., Langdon-Embry, M., Vora, N. M., Rakeman, J. L., Isaac, B. M., Jean, A., Asfaw, M., Hawkins, S. C., Merrill, T. G., Kennelly, M. O., Maldin Morgenthau, B., Daskalakis, D. C., & Barbot, O. (2020). Consequences of undervaccination — measles outbreak, New York City, 2018–2019. N Engl J Med 2020, 382, 1009–1017. [CrossRef]
- Patel M, Lee AD, Clemmons NS, Redd SB, Poser S, Blog D, Zucker JR, Leung J, Link-Gelles R, Pham H, Arciuolo RJ, Rausch-Phung E, Bankamp B, Rota PA, Weinbaum CM, Gastañaduy PA. National Update on Measles Cases and Outbreaks - United States, January 1-October 1, 2019. MMWR Morb Mortal Wkly Rep. 2019 ,68, 893-896. [CrossRef] [PubMed] [PubMed Central]
- Alwan RM, Kaki DA, Hsia RY. Barriers and Facilitators to Accessing Health Services for People Without Documentation Status in an Anti-Immigrant Era: A Socioecological Model. Health Equity. 2021, 5, 448-456. [CrossRef] [PubMed] [PubMed Central]
- Philbin, M. M., Flake, M., Hatzenbuehler, M. L., & Hirsch, J. S. . State-level immigration and immigrant-focused policies as drivers of Latino Health Disparities in the United States. Soc Sci Med, 2018, 199, 29–38. [CrossRef]
- Martinez, O., Wu, E., Sandfort, T., Dodge, B., Carballo-Dieguez, A., Pinto, R., Rhodes, S. D., Moya, E., & Chavez-Baray, S. . Erratum to: Evaluating the impact of immigration policies on health status among undocumented immigrants: A systematic review. J Immigr Minor Health, 2014, 18, 288–288. [CrossRef]
- Chau J, Kibria F, Landi M, Reilly M, Medeiros T, Johnson H, Yekta S, De Groot AS. HPV knowledge and vaccine acceptance in an uninsured Hispanic population in Providence, RI. R I Med J (2013) 2014, 97, 35-9. [PubMed]
- Reiter PL, Pennell ML, Martinez GA, Perkins RB, Katz ML. HPV vaccine coverage across Hispanic/Latinx subgroups in the United States. Cancer Causes Control 2020, 31, 905-914. Epub 2020 Aug 4. [CrossRef] [PubMed] [PubMed Central]
- Khodadadi AB, Redden DT, Scarinci IC. HPV Vaccination Hesitancy Among Latina Immigrant Mothers Despite Physician Recommendation. Ethn Dis 2020, 30, 661-670. [CrossRef] [PubMed] [PubMed Central]
- Kumar NR, DuVernois G, Almeida-Monroe V, Siegert N, De Groot AS. Evaluating the Impact of a Student-Run Women's Clinic on Access to Gynecologic Care for Uninsured Women in Rhode Island. R I Med J (2013) 2019, 102, 52-56. [PubMed]
|
Effective February 2023, the NHS location was relocated to the Main Clinic and continues to provide a space for these activities. |
|
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).