4. The Proposed Approach in Healthcare Service Quality Evaluation
In the near future, a medical institution hopes to self-assess the quality of its healthcare services through a systematic, organized, and logical scientific method, so as to achieve the following objectives, and enhance its overall competitive advantage.
- ➤
Provide better patient care: medical institutions are committed to providing the best patient care, improving the quality of medical services can ensure that patients receive appropriate attention, care and treatment during treatment, and improve patient satisfaction and curative effect.
- ➤
Ensuring safety and quality: Improving the quality of medical services helps ensure that medical facilities operate in accordance with safety standards and best practices. By establishing standard operating procedures and implementing monitoring and evaluation, medical institutions can improve the accuracy and efficiency of medical operations and reduce errors and complications.
- ➤
Enhancing the image of medical professionals: providing high-quality medical services helps to establish a good image of medical professionals. This is critical to the reputation and brand image of a medical institution, attracting more patients and medical professionals, and gaining the trust and support of the community and partners.
- ➤
Meet regulations and regulatory requirements: Medical institutions need to comply with various regulations and regulatory requirements to ensure that the medical services provided meet the corresponding standards and requirements. Improving the quality of medical services can help meet these requirements and reduce possible legal risks and penalties.
- ➤
Improve comprehensive medical experience: Improving the quality of medical services can improve the comprehensive medical experience of patients and their families. This includes providing a more convenient appointment system, shortening waiting time, improving communication and information sharing, and providing humanized environment and facilities, so that patients can feel more comfortable and caring during the medical treatment process.
Generally speaking, it is to be able to improve the quality of its healthcare services, have definite goals and directions, and ultimately ensure that the public receives the best healthcare. According to the concepts of fuzzy linguistic computing method, this study proposes a 2-tuple-based evaluation approach to measure the healthcare service quality level of an actual hospital in Taiwan. Suppose there are n criteria Ci(i = 1, 2, …, n) and each criterion contains several sub-criteria in the healthcare service quality performance evaluation framework. The proposed method can help the medical institution to effectively improve the quality of healthcare service related problems, and proficiently apply the limited medical resources. All in all, the following questions can be responded:
How to establish the facet factors and evaluation items of healthcare service quality evaluation?
Determination of the weights of the hospital service quality evaluation facet factors and service quality evaluation items.
Introduce the fuzzy multi-criteria evaluation method to obtain the performance of hospital service quality.
Explore the impact of the hospital’s inclusion of medical quality indicators on its operating efficiency.
Explore the impact of hospitals’ inclusion of medical quality indicators on medical investment resources.
What aspects should be included in the establishment of healthcare service quality indicators in the past? How to create meaningful and effective indicators? There is no consistent consensus. In order to construct a healthcare service quality measurement index with a high degree of theoretical basis, high applicability and verifiability, the research method and structure data source designed in this study firstly compiles the aspects and indicators that may be considered in the measurement of healthcare service quality based on relevant literature, and the preliminary healthcare service quality indicators are established. In order to take into account the professionalism and representativeness of the indicators, five senior executives of the designated healthcare institute in this paper formed a self-evaluation committee and interviewed each other to integrate their views and opinions. And carry out various indicator corrections to establish dimensions and indicators suitable for evaluating the quality of healthcare services. Through fieldwork and in-depth discussions with the general public, experts, operators, and front-line medical staff, it can be concluded that the main concerns of measuring the quality and performance of healthcare services are as follows (as shown in
Figure 5.):
The core viewpoints of each criterion and sub-criteria are briefly described below, and their hierarchical structure is shown in
Figure 6.
Overall Healthcare Environment: It refers to various factors and elements inside and outside the medical institution, including the physical environment, personnel composition, management system, facilities and equipment, and service quality, which have an impact on the medical experience and results of patients and medical staff. The sub-criteria are as follows:
Environmental cleanliness
Complete medical service facilities
Department location/indication clarity
Ease of access to medical information
The environment for family members to accompany the sick
Catering environment and cleanliness
Traffic and parking convenience
Medical service attitude: It refers to the attitude and behavior of medical personnel when treating patients and providing medical services. It is an important part of the quality of medical services and has a significant impact on patient satisfaction, treatment outcomes and medical experience. The sub-criteria are as follows:
Concern for patients during the outpatient clinic
Punctuality of consultation
The friendliness of medical staff
Clarity of medical treatment instructions
Willingness to communicate with patients
Medical security: It refers to ensuring that patients are not subject to unnecessary harm caused by medical activities or possible medical errors and accidents during the medical process. It is an important aspect of the quality of medical care, aimed at minimizing medical risks and providing a safe medical environment. The sub-criteria are as follows:
Confidentiality of the diagnosis and treatment process
Patient safety during diagnosis and treatment
Medical quality effect
Waiting room environment
Confidentiality of patient information
Comprehensiveness of sample submission
Administrative service measures of institutions: It refers to various measures and methods adopted by institutions to provide efficient and high-quality administrative services. It involves all aspects of the internal administration of the organization, aimed at improving administrative efficiency and meeting the needs and requirements of the organization and beyond. The sub-criteria are as follows:
Clarity of administrative service measures
Subject selection diversity
Completeness of registration and waiting list
Comprehensiveness in paying fees and receiving medicines
Completeness of medical follow-up consultation
After preliminary and careful screening of relevant materials and the above-mentioned healthcare service quality evaluation literature, a commissioning evaluation committee is composed of 5 senior medical service quality practitioners to conduct self-evaluation for the healthcare service quality currently provided by the designated medical institution. First, all evaluators were asked to judge the overall performance of the designated medical institution’s healthcare service quality according to five levels (imperfect, unsatisfactory, passable, hopefully better, and perfect). That is, each evaluator expresses his personal opinion based on his own knowledge, expertise and experience, and infers the overall performance level of medical service quality for the case hospital. By using linguistic variables, the inferences are “hopefully better”, “Perfect”, “passable”, “hopefully better”, “passable”, respectively, namely (
S3, 0), (
S4, 0), (
S2, 0), (
S3, 0) and (
S2, 0). In addition, four related evaluation criteria and their corresponding sub-criteria lead to further assessments, as shown in
Figure 5. According to the algorithm of the proposed approach as shown in
Figure 4, the health care service quality level evaluation procedure is summarized as follows.
| Step 1. |
Form a healthcare multi-expert evaluation committee, set up relevant healthcare quality evaluation frameworks and criteria, and transform them into their corresponding positive and negative criteria. Five senior employees or supervisors (or more) from different sectors or departments can be appropriately selected to form the service quality review committee. They professionally and objectively evaluate the performance of each criterion and sub-criteria and their corresponding weights. According to Table 1, except for the first and fifth evaluators who use a three-term linguistic variable, the rest of the evaluators use a five-term linguistic variable. |
| Step 2. |
The experts determine the required linguistic term set, individual weight, and performance ratings for each criterion (or subcriteria). Every decision-maker chooses one kind of linguistic variables from the selective categories (Table 1), say, a five-term linguistic variable, to determine the importance of each criterion and the performance of each sub-criterion with respect to each criterion. Afterward the rating outcome is shown in Table 2 and Table 3. |
| Step 3. |
For each criterion, aggregate the fuzzy linguistic assessments of the N experts, and calculate their fuzzy aggregated ratings, respectively.The 2-tuple fuzzy linguistic aggregation method is employed to compute fuzzy evaluation and weighting value of each sub-criterion. For example, fuzzy rating and weighting value of sub-criteria “Traffic and parking convenience” with respect to criterion “Overall Health care Environment” are computed as
five evaluators, the average evaluation value was calculated as
five evaluators, the average evaluation value was calculated as
And then the computational results are shown in Table 4. |
| Step 4. |
Summarize and calculate the overall performance level of healthcare service quality. The aggregated weighting value of each criterion can be calculated as follows; for example, the calculation of the weight of “Medical Service Attitude (MSA)” is as follows.
For example, the weighted rating of “Medical Security” can be calculated as
The right-hand side of Table 4 displays the foregoing outcomes. |
Table 2.
Linguistic assessments of each evaluator for each sub-criteria.
Table 2.
Linguistic assessments of each evaluator for each sub-criteria.
| Criteria |
Members of Evaluation Committee |
| E1
|
E2
|
E3
|
E4
|
E5
|
|
| C1: Overall Healthcare Environment (OHE) |
|
|
|
|
|
|
| C11: Environmental cleanliness |
NG |
VG |
A |
VG |
A |
|
| C12: Complete medical service facilities |
G |
G |
G |
G |
NG |
|
| C13:Department location/indication clarity |
G |
G |
A |
G |
G |
|
| C14:Ease of access to medical information |
NG |
A |
VG |
A |
NG |
|
| C15:Environment for family members to accompany the sick |
G |
VG |
G |
VG |
G |
|
| C16:Catering environment and cleanliness |
G |
G |
A |
G |
A |
|
| C17:Traffic and parking convenience |
A |
A |
G |
A |
G |
|
| C2: Medical Service Attitude (MSA) |
|
|
|
|
|
|
| C21: Concern for patients during the outpatient clinic |
NG |
A |
VG |
VG |
A |
|
| C22: Punctuality of consultation |
A |
A |
A |
B |
NG |
|
| C23: The friendliness of medical staff |
G |
VG |
A |
G |
A |
|
| C24: Clarity of medical treatment instructions |
NB |
A |
A |
A |
A |
|
| C25: Ability to fill emergency orders |
A |
G |
VG |
VG |
G |
|
| C26: Willingness to communicate with patients |
G |
VG |
VG |
G |
A |
|
| C3: Medical Security (MS) |
|
|
|
|
|
|
| C31: Confidentiality of diagnosis and treatment process |
G |
A |
A |
VG |
A |
|
| C32: Patient safety during diagnosis and treatment |
NG |
VG |
A |
VG |
G |
|
| C33: Medical quality effect |
A |
A |
VG |
VG |
A |
|
| C34: Waiting room environment |
A |
G |
G |
VG |
NG |
|
| C35: Confidentiality of patient information |
NG |
G |
VG |
A |
G |
|
| C36: Comprehensiveness of sample submission |
G |
A |
VG |
G |
A |
|
| C4: Institutional Service Measures (ISM) |
|
|
|
|
|
|
| C41: Clarity of administrative service measures |
G |
A |
A |
VG |
A |
|
| C42: Subject selection diversity |
G |
VG |
VG |
VG |
NG |
|
| C43: Completeness of registration and waiting list |
A |
A |
G |
VG |
A |
|
| C44: Comprehensiveness in paying fees and receiving medicines |
A |
A |
A |
G |
A |
|
| C45: Completeness of medical follow-up consultation |
NG |
G |
VG |
A |
G |
|
| Step 5. |
Summarize the current improvement focus of healthcare quality from the results, as well as the strategic goals for future development and management. On the basis of weighted rating values and the aggregated weighting of each criterion, the “comprehensive performance level” (CPL) for the case hospital can be computed as:
|
In contrast with the linguistic term set S, the obtained comprehensive performance level (CPL) of the medical service quality of the designated medical institution, the converted value (S3, -0.011), indicates that it is not as good as “hopefully better”. Such a result is intuitively reasonable. In other words, the final evaluation results of the proposed method are consistent with the initial judgments made by the five evaluators on the overall performance assessment. Furthermore, based on the preliminary inferences made by the five evaluators, the average evaluation value was calculated as
Table 3.
Linguistic assessments of each criterion and corresponding sub-criteria.
Table 3.
Linguistic assessments of each criterion and corresponding sub-criteria.
| Criteria |
Members of Evaluation Committee |
| E1
|
E2
|
E3
|
E4
|
E5
|
|
| C1: Overall Healthcare Environment (OHE) |
VI |
VI |
VI |
I |
I |
|
| C11: Environmental cleanliness |
A |
VI |
A |
A |
A |
|
| C12: Complete medical service facilities |
I |
A |
I |
I |
I |
|
| C13:Department location/indication clarity |
NI |
I |
VI |
VI |
NI |
|
| C14:Ease of access to medical information |
I |
I |
A |
I |
A |
|
| C15:Environment for family members to accompany the sick |
I |
I |
VI |
I |
I |
|
| C16:Catering environment and cleanliness |
NI |
VI |
VI |
VI |
NI |
|
| C17:Traffic and parking convenience |
I |
VI |
I |
VI |
I |
|
| C2: Medical Service Attitude (MSA) |
I |
I |
VI |
I |
VI |
|
| C21: Concern for patients during the outpatient clinic |
I |
A |
VI |
A |
NI |
|
| C22: Punctuality of consultation |
I |
I |
VI |
I |
NI |
|
| C23: The friendliness of medical staff |
NI |
I |
A |
VI |
A |
|
| C24: Clarity of medical treatment instructions |
A |
I |
A |
A |
I |
|
| C25: Ability to fill emergency orders |
NI |
VI |
VI |
VI |
I |
|
| C26: Willingness to communicate with patients |
I |
VI |
I |
VI |
A |
|
| C3: Medical Security (MS) |
VI |
VI |
I |
VI |
VI |
|
| C31: Confidentiality of diagnosis and treatment process |
NI |
I |
A |
VI |
I |
|
| C32: Patient safety during diagnosis and treatment |
NI |
I |
I |
VI |
I |
|
| C33: Medical quality effect |
A |
VI |
VI |
A |
NI |
|
| C34: Waiting room environment |
I |
VI |
I |
A |
A |
|
| C35: Confidentiality of patient information |
I |
A |
VI |
VI |
NI |
|
| C36: Comprehensiveness of sample submission |
A |
I |
I |
I |
I |
|
| C4: Institutional Service Measures (ISM) |
I |
I |
VI |
I |
I |
|
| C41: Clarity of administrative service measures |
NI |
VI |
A |
I |
NI |
|
| C42: Subject selection diversity |
I |
A |
I |
VI |
I |
|
| C43: Completeness of registration and waiting list |
I |
I |
I |
I |
I |
|
| C44: Comprehensiveness in paying fees and receiving medicines |
A |
VI |
A |
VI |
I |
|
| C45: Completeness of medical follow-up consultation |
I |
A |
VI |
I |
A |
|
From the overall results in
Table 4, the current service level of specific medical institutions is the best in both C
15(Environment for family members to accompany the sick) and C
42(Subject selection diversity), with a high score of 0.95. In other words, the evaluated medical institution is superior in both C
15 and C
42 criteria. Administrators can therefore make good use of these two advantages to create and improve the quality of medical services. In addition, C
25(Ability to fill emergency orders), C
26 (Willingness to communicate with patients) and C
32(Patient safety during diagnosis and treatment) also have an outstanding performance of 0.85 points. On the other hand, it has unsatisfactory evaluations in C
22(Punctuality of consultation) and C
24(Clarity of medical treatment instructions), and even C
24 only has a score of 0.45, which is a part that needs to be strengthened urgently. That is, the main disadvantages of the designated medical institution are C
22 and C
24. Therefore, the management must seek to improve these criteria of performance practices. Observing the four evaluation criteria, C
1(Overall Healthcare Environment, OHE) currently has the best overall performance, followed by C
3 (Medical Security, MS), C
4 (Institutional Service Measures, ISM) and C
2 (Medical Service Attitude, MSA). Therefore, according to the current overall health care service quality of the designated hospital, it is urgent to improve C
2.
Table 4.
Aggregation results.
Table 4.
Aggregation results.
| Criteria |
Mean rating |
Mean weighting |
Weighted rating |
Aggregated weighting |
| C1: Overall Healthcare Environment (OHE) |
| C11: Environmental cleanliness |
(S3, 0) |
(S2, 0.1) |
(S3, 0.0143) |
(S3, 0.01535) |
| C12: Complete medical service facilities |
(S3, 0.05) |
(S3, 0.05) |
| C13:Department location/indication clarity |
(S3, 0.05) |
(S3, 0.1) |
| C14:Ease of access to medical information |
(S3, -0.05) |
(S3, -0.05) |
| C15:Environment for family members to accompany the sick |
(S4, -0.05) |
(S4, -0.1) |
| C16:Catering environment & cleanliness |
(S3, -0.05) |
(S4, -0.1) |
| C17:Traffic and parking convenience |
(S2, 0.15) |
(S4, -0.05) |
| C2: Medical Service Attitude (MSA) |
| C21: Concern for patients during the outpatient clinic |
(S3, 0) |
(S3, 0) |
(S3, -0.0583) |
(S3, -0.0479) |
| C22: Punctuality of consultation |
(S2, 0) |
(S3, 0.1) |
| C23: The friendliness of medical staff |
(S3, 0) |
(S3, -0.05) |
| C24: Clarity of medical treatment instructions |
(S2, -0.05) |
(S2, 0.15) |
| C25: Ability to fill emergency orders |
(S3, 0.1) |
(S4, -0.05) |
| C26: Willingness to communicate with patients |
(S3, 0.1) |
(S3, 0.1) |
| C3: Medical Security (MS) |
| C31: Confidentiality of diagnosis &treatment process |
(S3, -0.05) |
(S3, 0.05) |
(S3, 0.0833) |
(S3, 0.01053) |
| C32: Patient safety during diagnosis & treatment |
(S3, 0.1) |
(S3, 0.1) |
| C33: Medical quality effect |
(S3, -0.05) |
(S3, 0) |
| C34: Waiting room environment |
(S3, 0) |
(S3, 0) |
| C35: Confidentiality of patient information |
(S3, 0.05) |
(S3, 0.1) |
| C36: Comprehensiveness of sample submission |
(S3, 0) |
(S3, 0) |
| C4: Institutional Service Measures (ISM) |
| C41: Clarity of administrative service measures |
(S3, -0.05) |
(S3, 0) |
(S4, -0.0281) |
(S3, -0.03) |
| C42: Subject selection diversity |
(S4, -0.05) |
(S3, 0.1) |
| C43: Completeness of registration &waiting list |
(S2, 0.15) |
(S3, 0.1) |
| C44: Comprehensiveness in paying fees & receiving medicines |
(S2, 0.05) |
(S3, 0.05) |
| C45: Completeness of medical follow-up consultation |
(S3, 0) |
(S3, 0) |
| Comprehensive performance level (CPL) |
(S3, -0.011) |
In addition, from the perspective of the four evaluation criteria, the members of the evaluation committee tend to pay more attention to the quality of health care services from the perspective of C1(Overall Healthcare Environment, OHE, (S3, 0.01535), quite important). Although C2(Medical Service Attitude, MSA, (S3, -0.0479), not so important) is the major of most judges, they don’t pay much attention to it. In terms of the reason, they are confident in their profession, but as for the professional peripheral supporting services, it is not the quality of health care service that they care about. For example, C22, (S3, -0.0479), Punctuality of consultation, is limited by surgery or other administrative affairs, delays in meetings, and …, making it impossible to conduct outpatient consultations on time, which is not what outpatient physicians would like to see.
Because the case hospital is close to the seaside, the wind is usually strong, not to mention the northeast monsoon has a great impact; so it is different from the traditional space design arrangement, and the main administrative services such as registration, price approval, drug collection, inspection, and most outpatient services are combined. The locations are all arranged on the first floor of the basement. This is a relatively unique design method, and it is also affirmed by the public. This can be seen from the high evaluation of the hospital in item C4 (Institutional Service Measures, ISM, (S4, -0.0281)).
It is worth mentioning that the medical institution of the case is located in a rural area, but its performance in C17 ((S2, 0.15) means unsatisfactory performance) is mediocre, reflecting that although the location is not ideal, if the traffic flow, tour pick-up, parking arrangements and surrounding services can be done well support and preparation can still prevent patients or family members from having to take this unfavorable factor into consideration. From another point of view, in terms of criteria C17 and C25 that most evaluators consider very important (considers their average weight to be very high, say (S4, -0.05)), the performance of the case hospital is not satisfactory. That is, none stand out. That is to say, on these key factors that everyone thinks are very important, some more breakthrough methods must be made in order to demonstrate a more ideal quality of health care services and win the trust of the public.