Feasibility and Reliability of the OA-QI v3 for Assessing Osteoarthritis Care in Bilingual General Practices in South Tyrol/Alto Adige, Italy

1. Introduction

Osteoarthritis (OA) of the hip and knee is one of the most prevalent chronic musculoskeletal disorders, affecting over 500 million individuals globally. Its prevalence is increasing in Europe and worldwide, primarily due to aging populations, obesity, and joint injuries [1,2,3]. Knee OA is the most common site and a leading contributor to years lived with disability, while hip OA also imposes a significant burden, with notable sex differences in prevalence across both conditions [4]. Collectively, hip and knee OA are major contributors to reduced physical function, impaired quality of life, and rising healthcare costs, posing a central challenge to health systems [5,6]. Given the demographic shift towards aging societies and the projected substantial increase in osteoarthritis prevalence over the coming decades [7,8,9], effectively addressing OA through prevention, early diagnosis, and evidence-based management strategies has become a pressing priority for clinical practice and public health.

Exercise and physical activity are fundamental evidence-based interventions for hip and knee OA, as substantiated by systematic reviews, meta-analyses, and international guidelines, which consistently demonstrate benefits in pain relief, functional improvement, and prognosis [10,11,12,13,14]. Interventions ranging from aerobic and strength-training programs to mind-body approaches and aquatic exercise yield effects comparable to pharmacological therapies, while also enhancing quality of life and aiding in the management of comorbidities such as cardiovascular disease and diabetes [12,13,15]. No single exercise modality has been proven superior, as all forms of regular activity appear to be beneficial, with moderate-intensity exercise performed 2-3 times weekly emerging as a pragmatic recommendation [14,16]. Exercise is generally safe for most patients with OA, with a minimal risk of serious adverse events [11,17]. Guidelines consistently advocate exercise, weight management, and self-management as first-line strategies [7,10]. However, despite this evidence and the central role of physical activity in OA management, implementation remains suboptimal. Contributing factors include patient barriers (such as pain, kinesiophobia, and low motivation), clinician factors (including outdated beliefs and limited confidence in prescribing exercise), and systemic issues (such as lack of access to programs and insufficient adherence support) [18,19,20].

Standardized measurement tools are essential for assessing and improving the quality of OA care. The Osteoarthritis Quality Indicator (OA-QI) questionnaire provides structured, measurable items that translate guideline recommendations into auditable domains, such as assessment, education, exercise counseling, weight management, pharmacological management, and follow-up [21,22]. Developed through systematic reviews and expert consensus, often including patient involvement, OA-QI sets have demonstrated their validity and feasibility for use in both clinical audits and patient-reported surveys [23,24]. International adaptation across various countries consistently revealed the underuse of non-pharmacological strategies, particularly exercise and lifestyle counseling, highlighting their role in benchmarking and guiding quality improvement initiatives [25].

Despite significant international advancements in the development of OA quality indicators, there is a deficiency in validated, regionally adapted instruments for South Tyrol and Italy. The bilingual (i.e. German and Italian) healthcare context of the region has constrained the capacity of general practice networks to systematically measure quality and to benchmark outcomes. The current initiative addresses this issue by translating the OA-QI questionnaire into German and Italian for application within South Tyrol's healthcare setting, thereby facilitating standardized patient-reported assessments of OA care [26]. This adaptation ensures cultural relevance and enables cross-border comparisons with future data from Austria and other German speaking countries. Up until now, the broader Italian primary care landscape lacked such standardized tools, and reviews have indicated deficiencies in OA management practices [27,28]. On this line, the South Tyrol project will establish a foundation for quality monitoring while also supporting international benchmarking and testing the feasibility of integrating the South Tyrolean system. Feasibility testing is a critical methodological step when introducing standardized instruments into new cultural and health system contexts, as it ensures that questionnaires are both linguistically adapted and practically applicable before broader validation [29,30,31]. Without this process, even well-validated instruments may fail to accurately capture the intended constructs, leading to invalid results [32,33]. Therefore, the present study evaluated the feasibility, acceptability, and test–retest reliability of the German and Italian versions of the OA-QI v3 questionnaire in general practice, while also providing an initial description of care gaps, particularly in patient education, exercise, and lifestyle counseling.

2. Methods

2.1. Study Design and Setting

This study was designed as a cross-sectional, practice-based survey within the South Tyrolean General Practice Research Network (SAMNET), a regional collaboration of general practitioners (GPs) engaged in health services research [34].

The bilingual context of South Tyrol provided the opportunity to test both language versions while considering the cultural and organizational features of primary care in Italy. The a priori targeted sample size was 280 patients, based on 40 GPs each enrolling seven consecutive eligible patients during routine consultation. This approach mirrored international OA-QI validation studies conducted in Norway [23] and the Netherlands [35], but was adapted to the South Tyrolean setting.

Sample size considerations were pragmatic and reflected the recruitment capacity of the network. For questionnaire validation, subject-to-item ratios of approximately 1:5 to 1:30 are considered sufficient [36]. With 17 OA-QI items, the targeted sample size corresponded to a ratio of approximately 1:16. For test–retest reliability, a minimum of 50 participants is recommended [37].

2.2. Participants

2.2.1. General Practitioners

Forty GPs affiliated with the SAMNET were invited to participate. Each physician was asked to recruit seven consecutive patients with hip or knee OA during routine consultations. To ensure methodological completeness, each practice contributed to the main survey and specific subgroups: one patient per practice was assigned to the comprehensibility assessment, and two patients were assigned to the test–retest reliability assessment. The GPs were responsible for informing the patients, obtaining written consent, and assigning anonymized study codes. The completed questionnaires were sealed by the patients in envelopes and returned in bulk to the study center.

2.2.2. Patients

Patients were eligible if they (i) had a known diagnosis of hip or knee OA or presented with knee or hip pain and fulfilled NICE-based clinical criteria (age ≥45 years, activity-related joint pain, and no or <30 minutes of morning stiffness) [38], and (ii) were able to complete the questionnaire in German or Italian language. The exclusion criteria were as follows: malignant disease, rheumatoid or other inflammatory arthritis, Kellgren–Lawrence grade IV joint degeneration, other inflammatory rheumatic conditions, psychiatric or cognitive disorders preventing participation, and concurrent involvement in other clinical studies.

2.2.3. Recruitment Flow

Of the 40 invited GPs, 38 actively participated (95.0%). Together, they recruited 266 patients, corresponding to 95.0% of the planned sample size of 280. All patients completed the main OA QI questionnaire. In addition, 89 patients completed the retest questionnaire approximately 14 days later, and 40 patients completed the comprehensibility module.

2.3. Study Registration

This feasibility and reliability study was conducted within the framework of a project previously described in a published study protocol [26]. This protocol outlines the stepwise translation, cultural adaptation, and validation of the OA-QI questionnaire [23] for use in Germany and Italy. Although the feasibility phase reported here was not separately registered, it represents the first step of a larger program of research that is registered in the ISRCTN registry (ISRCTN93874734) and includes a planned combined South Tyrol–Salzburg cohort.

2.4. Instruments

2.4.1. Osteoarthritis Quality Indicator Questionnaire (OA-QI v3)

The OA-QI questionnaire was originally developed and validated in Norway [23] and has since been applied internationally to evaluate the implementation of guideline-recommended care for hip and knee OA [35,39]. The most recent version, OA-QI v3, was developed under the leadership of Nina Østerås, together with an international working group, including two of the authors of the current study (A. Z.-N. and C. J. W.). The English OA-QI v3 builds on OA-QI v2 [23] by broadening the context of information sources, refining the wording of several questions (notably weight advice, work, non-steroidal anti-inflammatory drugs (NSAIDs), and side effect-related questions), and restructuring the numbering of items. OA-QI v3 specified the question regarding medication uptake by asking if NSAIDs were the first medication recommended and listing examples, while the side effects question is reframed in terms of actual use. Version 3 also clarifies the scope of work (paid or unpaid) and introduces slight wording changes for improved clarity. Overall, OA-QI v3 maintained the same 17 core indicators but with more precise wording and reorganized numbering. The OA-QI v3 has not yet been formally published.

The questionnaire covered the following domains of OA management:

• Information and counseling: provision of information about OA and treatment options; advice and instruction on exercise; counseling on coping and daily management; and advice and support for weight reduction (if overweight).
• Assessment: evaluation of pain, activity limitations, and need for walking aids; discussion of occupational aspects.
• Follow-up and pharmacological treatment: control visits; prescription of NSAIDs and information on side effects; and corticosteroid injections and information on side effects.
• Surgical treatment: Information about and/or referral for joint replacement surgery.

Each item has three response options: (i) Yes (the indicator was achieved). (ii) No (the indicator was not achieved). (iii) Not relevant/do not remember (the indicator was not applicable).

Following established scoring procedures, items marked “not relevant/do not remember” were treated as “not eligible” and excluded from the denominator of the percentage calculation. For each participant, an individual OA-QI achievement score was calculated (Equation 1).

$$OA-QI score (\%)={\displaystyle \frac{Number of “Yes” responses}{Number of eligible items (Yes+No)}} x 100$$

(1)

Patients with fewer than four eligible items were excluded from the analysis to avoid unstable estimates. At the item level, achievement rates were expressed as the percentage of eligible patients responding “Yes.” At the patient level, achievement was summarized using the mean, standard deviation, median, and interquartile range. Distributions were checked for floor and ceiling effects, defined as >15% of patients scoring 0% or 100%. For comparability, the analytic procedures followed those reported in the validation study from Norway [23] and the application in the Netherlands [35].

OA-QI v3 Translation and Adaptation

The German (OA-QI v2-D) and Italian (OA-QI v2-I) versions of the OA-QI were initially produced by a professional translation agency (Wilkens Translation Agency, Leiden, Netherlands) specializing in medical translations and certified according to ISO 9001, ISO 17100, and ISO 13485. For the present study, these versions were adapted to the updated OA-QI v3, and translated from English into German and Italian by native-speaking translators. No back-translation was performed because the main work was performed by a certified medical translation provider. Subsequently, both language versions (OA-QI v3-D and OA-QI v3-I) were reviewed by two rheumatologists who were native speakers of German (C.D.) and Italian (M.L.). This step ensured cultural appropriateness and patient comprehensibility, with terms adapted for clarity, such as rendering “NSAIDs” as “schmerzstillende Entzündungshemmer” in German and “farmaci antidolorifici e antiinfiammatori” in Italian (Table S1).

2.4.2. Additional Variables

In addition to the 17 OA-QI items, the primary questionnaire gathered data on the clinical characteristics of OA and the sociodemographic factors of the participants.

Among the clinical variables, patients reported whether they had ever received a formal diagnosis of OA and indicated the frequency of joint pain (daily, weekly, rarely, or never). They were asked to specify the joints most affected (left or right hip, left or right knee, or other joints) and whether their pain impaired daily activities, with response options ranging from “no” to “constantly.” Further items assessed the use of physiotherapy or exercise therapy (yes/no) and whether the patients had undertaken lifestyle changes due to OA (no, more physical activity, dietary changes, or both). The questionnaire also inquired about the presence of comorbidities (no/yes, with specification) and the duration of symptoms, with response categories ranging from less than 1 year to > 20 years. A detailed history of joint replacement surgery was collected, including recommendations or operations performed on the hip or knee, with the year of surgery, if applicable. Finally, patients were asked about their sources of information on OA and its treatment, with options including GPs, orthopedic surgeons, rheumatologists, physiotherapists, nurses, pharmacists, other patients, family or friends, and the Internet or social media.

Sociodemographic information included year of birth, sex (male, female, diverse, or prefer not to answer), native language (German, Italian, Ladin, or other), educational attainment (compulsory school, vocational training, high school, or university degree), and employment status (full-time, part-time, retired, unemployed, or other). Additionally, patients were asked to rate their subjective economic situation on a five-point scale ranging from “very good” to “very difficult.”

2.5. Comprehensibility and Acceptability Questionnaire

To evaluate comprehensibility and acceptability, a stand-alone questionnaire was administered to a predefined subsample of patients, with one participant per practice site. This instrument included items assessing the overall clarity of the OA-QI questions, ranging from "very well understandable" to "not understandable," the presence of questions perceived as difficult, and the identification of unclear terms. Additional items addressed the ease of completing the questionnaire, from "very easy" to "very difficult," the perceived time burden, and the comprehensibility of the response options. Furthermore, patients were invited to provide open-ended feedback on the wording and potential improvements.

Patients were selected according to the study protocol, with one patient per participating practice invited to complete a comprehensibility module. German- and Italian-speaking patients were included to ensure the representation of the bilingual study setting. Analyses were conducted overall and stratified by language subgroups. Responses to the four-point and dichotomous scales were summarized descriptively, and open-text feedback was reviewed qualitatively to identify recurring issues and suggestions for improvement.

2.6. Retest for Reliability

Test–retest reliability was assessed in a predefined subsample of patients, with two participants per practice invited to complete the OA-QI questionnaire again after approximately 14 days. The retest questionnaire repeated the 17 OA-QI items and included four additional questions on consultations with healthcare professionals, interim changes in osteoarthritis symptoms, new or modified medication, and other treatments initiated since the first administration. Participant responses were excluded from the test-retest analyses if they had visited a general practitioner, medical specialist, or physiotherapist during the interim period. Patients were identified by a combined practice and patient ID, allowing linkage between baseline and retest responses.

2.7. Statistical Analyses

All analyses were performed using IBM SPSS Statistics (version 27.0; IBM Corp., Armonk, NY, USA). Data were screened for completeness and plausibility; patients with missing responses on all OA-QI items or fewer than four eligible items were excluded from the study. Descriptive statistics (frequencies, percentages, means with standard deviations (SD), medians with interquartile ranges (IQR) were used to summarize the sample characteristics, OA-QI item responses, and overall achievement scores. Floor and ceiling effects were defined as >15% of patients scoring 0% or 100% on the patient-reported outcome measure, respectively. Bivariate associations between OA-QI achievement scores and patient characteristics were examined using correlation analyses (Spearman’s rank correlation coefficient for ordinal and categorical variables, and Pearson’s correlation coefficient for continuous age). Effect sizes were interpreted according to Cohen’s thresholds.

The test–retest reliability of OA-QI v3 was assessed in a predefined stable subsample. Item-level agreement was quantified using percent agreement and Cohen’s kappa (κ) with 95% confidence intervals, as interpreted by Landis and Koch [40]. For the overall achievement score, intraclass correlation coefficients (ICC; two-way mixed effects, absolute agreement) were calculated. Measurement error was further characterized using the standard error of measurement (SEM) and the smallest detectable change (SDC) at the individual and group levels, derived from ICC and the pooled SD.

Multivariable mixed-effects linear regression models were fitted with the OA-QI achievement score (%) as the dependent variable to assess independent associations with sociodemographic, clinical, and contextual characteristics. Predictors included age (continuous), sex (female vs. male), education (ordinal, per higher category), economic status (ordinal, higher values indicating worse status), comorbidity (≥1 chronic disease vs. none), prior joint surgery (yes/no), number of affected joints (0–4), pain frequency, activity limitation, duration of symptoms, language group (Italian, Ladin, or other vs. German as the reference), and number of information sources. A random intercept for general practitioners accounted for clustering within practices. Since each patient contributed only one observation, no random effect for patient ID was necessary. Models were estimated using restricted maximum likelihood (REML) with robust standard errors. The intraclass correlation coefficient (ICC) was calculated to quantify the proportion of variance in OA-QI scores attributable to practice-level clustering. Multicollinearity was assessed using variance inflation factors (VIF), and model fit was evaluated using –2 log likelihood (–2LL), Akaike’s Information Criterion (AIC), and Bayesian Information Criterion (BIC).

All statistical tests were two-sided, and p-values < 0.05 were considered statistically significant.

3. Results

3.1. Study Population

A total of 40 GPs from the SAMNET were invited to participate in the study. Of these, 38 practices actively recruited patients, while 2 did not contribute, resulting in an overall GP participation rate of 95.0%. A total of 266 patients with hip or knee osteoarthritis were enrolled, corresponding to 95.0% of the planned sample size of 280 participants. All included patients completed the OA-QI questionnaire, with subsamples further completing the comprehensibility module (n = 38) and test–retest reliability assessment (n = 73). Among the 73 participants’ retest responses at a two-week interval, 37 (48%) were excluded from the test-retest analyses because they had visited a general practitioner, medical specialist, or physiotherapist in the interim period. The test–retest subsample (n = 36) appeared broadly representative of the larger study cohort with respect to age, sex, language, employment, comorbidity, and most clinical variables. It contained proportionally more patients with prior joint replacement and somewhat higher educational attainment (Table 1).

The sociodemographic and clinical characteristics of the study population are shown in Table 1. The mean age was 71.9 years (SD 10.3), and 58.6% of the participants were female. Most patients reported German as their mother tongue (61.3%), followed by Italian (32.3%), Ladin (2.3%), and other languages (4.1%). Educational attainment varied, with 16.5% having completed only compulsory schooling, 22.9% vocational training, 37.6% secondary school, and 23.0% higher education or university. Most patients were retired (69.9%), with smaller proportions employed full-time (14.7%) or part-time (9.4%) jobs. Among patients with valid responses (n = 266), 35.3% rated their financial situation as very good or good, 52.6% as moderate, and 12.0% as poor or very poor. Clinically, 47.9% of the patients reported right knee involvement and 34.3% reported left knee involvement, 26.7% had previously undergone joint replacement surgery, and 61.5% reported at least one chronic comorbidity.

Patients most frequently reported their general practitioner (65.4%) and orthopedic surgeon (50.4%) as sources of information on OA, followed by physiotherapists (16.5%). Only a minority mentioned other sources, including rheumatologists (7.5%), the internet or media (5.3%), family or friends (4.9%), pharmacists (1.5%), nurses (0.8%), or other patients (0.8%). While 55.3% of patients reported using a single source of information, 27.4% used two sources, 10.9% used three sources, and only small proportions reported four (3.8%) or five (0.8%) different sources. Regarding the absence of information, 7.9% explicitly indicated that they had not received information from any source, yet only 1.9% had no source recorded at all, suggesting that some participants marked both “no source” and at least one source, resulting in inconsistent responses.

3.2. OA-QI Achievement Scores

At the item level, the proportion of patients who reported receiving recommended care varied widely across the 17 OA-QI indicators (Table 2). The highest achievement rates were observed for advice on physical activity (81.6%), NSAID prescription (80.3%), and assessment of joint pain (77.2%). In contrast, the lowest rates were recorded for discussions on occupational aspects (18.2%), support for weight reduction (33.5%), and assessment of the need for walking aids (31.0%).

At the patient level, the mean OA-QI achievement score was 58.7% (SD 28.5), with a median score of 60.8% (IQR 35.3–84.9). This distribution indicates that, on average, patients reported receiving slightly more than half of the recommended quality indicators, with marked variability across individuals.

Floor and ceiling analyses showed that only 1.5% of patients scored 0% and 8.3% achieved the maximum score of 100%. As both values were below the predefined 15% threshold, no floor or ceiling effects were observed.

3.3. Comprehensibility and Acceptability

Among the 38 patients who completed the comprehensibility and acceptability module, 94.7% rated all questions as “very understandable” or “rather understandable,” while 5.3% considered at least some items to be difficult. A total of 10.5% of the participants reported that individual questions were difficult to understand, and 18.4% noted unclear terms. Regarding ease of completion, 94.7% described the questionnaire as “very easy” or “rather easy,” whereas 5.3% found it difficult, and 10.5% felt that completing the questionnaire took too long. Finally, 86.8% of the participants considered the response categories to be clear and appropriate, whereas 13.2% indicated difficulties with them.

There were only three comments in the open-text fields. Two respondents mentioned that they found the German and Italian terms for "osteoarthritis" challenging to comprehend, while one patient pointed out that some questions seemed redundant. These remarks did not concern the OA-QI items but additional sociodemographic and clinical variables that had been included in the questionnaire.

3.4. Test–Retest Reliability

The test–retest reliability was evaluated among 36 participants who remained stable and did not consult a healthcare professional during the interim period. For the overall OA-QI achievement score, the intraclass correlation coefficient (ICC, two-way mixed effects, absolute agreement, single measures) was 0.55 (95% CI 0.28–0.74; p < 0.001), indicating moderate reliability. The corresponding Cronbach’s alpha for the two measurement occasions was 0.71. The standard error of measurement (SEM) was 20.7, resulting in the smallest detectable change (SDC) of 57.3 points at the individual level and 9.6 points at the group level (n = 36).

At the item level, κ values ranged from 0.33 to 0.69, with percent agreement between 61.1% and 86.1% (Table 3), indicating acceptable reliability. Most items demonstrated moderate reliability, with several reaching substantial reliability. Information items showed κ = 0.51 for information about osteoarthritis and κ = 0.53 for information about treatment options. Self-management advice also yielded substantial reliability (κ = 0.64). The item on receiving help for weight loss, which previously showed poor agreement, now had fair reliability (κ = 0.38). Items regarding pharmacological treatment and side effects demonstrated only fair to moderate agreement, with κ values of approximately 0.40–0.46. The newly added version 3 item on surgical referral achieved moderate reliability (κ = 0.55).

3.5. Associations with Additional Variables

At the bivariate level, OA-QI achievement scores were largely unrelated to age, sex, pain frequency, activity limitation, symptom duration, number of joints affected, or prior surgery. In contrast, several sociodemographic and contextual factors showed small but significant associations. Italian-speaking patients reported higher OA-QI scores than German speakers (ρ ≈ 0.13, p = 0.03), while vocational and university education were associated with lower scores than mid-level education (ρ = –0.17 to –0.24, p ≤ 0.02). Patients in full-time employment and those who rated their financial situation as poor also reported lower OA-QI scores (ρ ≈ –0.12 to –0.18, p ≤ 0.05). The presence of at least one chronic comorbidity was correlated with reduced OA-QI scores (ρ = –0.13, p = 0.045).

The strongest positive associations were observed for information behavior: both the number of information sources used (ρ = 0.34, p < 0.001) and categorized information use (none, one, ≥2 sources; ρ = 0.32, p < 0.001) correlated with higher OA-QI scores. Overall, these findings suggest that patient education, language, socioeconomic context, and access to information play a more important role in reported care quality than clinical severity. An overview of the correlation results is presented in Table 4.

Multivariable Mixed-Effects Linear Regression

Regression analyses were conducted to examine independent associations between patient characteristics and OA-QI achievement scores, while accounting for clustering at the practice level.

Results are shown in Table 5. Female patients had significantly lower OA-QI scores than male patients (β = –6.18, 95% CI –11.62 to –0.74; p = 0.026). Each higher level of education was associated with an average 2.65-point higher OA-QI score (95% CI 0.81–4.49; p = 0.005). Greater activity limitation was independently associated with lower OA-QI scores (β = –3.71, 95% CI –6.19 to –1.23; p = 0.004). No significant associations were observed between age, economic status, comorbidity, prior surgery, number of affected joints, pain frequency, symptom duration, or language group.

The intraclass correlation coefficient (ICC) indicated that approximately 6% of the variance in OA-QI scores was attributable to differences between GP practices. Collinearity diagnostics indicated no evidence of problematic multicollinearity, with all VIF values < 1.5 and tolerance values > 0.7. The model fit statistics indicated an adequate fit (–2LL = 2276.9, AIC = 2280.9, BIC = 2287.9).

4. Discussion

This feasibility study introduced the OA-QI questionnaire version 3 in German and Italian to South Tyrol general practice and confirmed its applicability and reliability in the healthcare context. The achievement of quality indicators varied, with high rates for physical activity advice, NSAID prescription, and joint pain assessment, but low attainment for weight reduction support, occupational aspects discussion, and walking aid needs assessment. The mean achievement score was 58.7%, indicating that slightly more than half of the recommended indicators were met. Test–retest analyses showed fair to substantial reliability at the item level (κ range 0.33–0.69, agreement 61–86%), with the new surgical referral item showing moderate stability. At the total-score level, reliability was moderate (ICC = 0.55, 95% CI 0.28–0.74), with a standard error of measurement of 20.7 and smallest detectable change of 57.3 points at the individual level (9.6 at the group level). These results indicate that while OA-QI v3 can detect small changes in group-level achievement scores (≈10 percentage points), changes in individual patients must exceed 57 percentage points to be distinguished from the measurement error.

The main objective was to determine whether OA-QI v3 could be implemented in routine general practice, whether it was acceptable to patients, and whether it demonstrated reliability in this cultural and organizational setting in South Tyrol. Recruitment of targeted general practitioners and patients demonstrated the practicality of integrating the instrument into daily workflows. Patient feedback confirmed high comprehensibility and ease of completion in German and Italian, indicating their suitability for bilingual regions. The patterns of missingness were low, although items such as occupational aspects and weight management were less frequently applicable, reflecting domain relevance in the local context. The test–retest findings at the item and total score levels support the instrument's stability and reliability. These feasibility outcomes demonstrate that OA-QI v3 is practicable in South Tyrol and generates consistent results that can serve as a basis for broader applications and international benchmarking of OA care.

4.1. Feasibility, Reliability, and Comparison with Other OA-QI Versions

The findings of this study confirm that OA-QI v3 is feasible and reliable in South Tyrol, with high patient acceptability using German or Italian translations. These results extend the evidence base of the OA-QI, which has undergone a staged process of development, revision, and cross-cultural adaptation since its inception. The original Norwegian OA-QI demonstrated content validity and fair-to-substantial reliability (κ = 0.20–0.80, agreement = 62–90%) [41]. A revised version (OA-QI v2) further improved the measurement properties, showing excellent reliability at the total score level (ICC = 0.89), acceptable construct validity, and responsiveness suitable for evaluative purposes [23]. The present findings of moderate total score reliability and item-level stability are consistent with the literature, confirming their applicability in a new bilingual setting.

Several language versions have been developed internationally. The Dutch translation followed forward–backward procedures and pre-testing with patient representatives, resulting in an 18-item version with acceptable internal consistency (α = 0.79) and achievement patterns similar to those observed in other countries [35]. The OA-QI has also been applied in Portuguese and English in cross-country comparisons with consistent psychometric performance [42]. In the United Kingdom, a patient-reported OA-QI (UK) was developed with the strong involvement of a Research User Group as part of the MOSAICS study, harmonizing several items with the Norwegian version and aligning the instrument with the NICE quality standards [24]. These parallel developments highlight the adaptability of OA-QI instruments to local contexts while retaining their core international comparability.

The German and Italian versions were prepared through professional translation, followed by adaptation by native-speaking rheumatologists in accordance with the recommended cross-cultural adaptation procedures [35,42,43]. Acceptability and reliability were confirmed using patient feedback and retesting at the pooled level. Given the small number of Italian-speaking participants (<10), subgroup analyses of acceptability and reliability would have been statistically underpowered. Future studies with larger Italian-speaking samples are needed to confirm the measurement equivalence across languages.

4.2. Interpretation and Comparison with Previous Literature

Across international primary care systems, the results of this survey replicate a well-described pattern in OA quality indicator achievement: relatively high delivery of lifestyle/exercise advice and routine pharmacotherapy, contrasted with persistent shortfalls in weight management support, occupational guidance, and assessment for assistive devices. Concordant findings have been reported in multi-country surveys and systematic reviews from the United Kingdom, Netherlands, Canada, Australia, Denmark, Norway, Portugal, and Singapore, suggesting system-wide rather than region-specific implementation gaps [21,22,42,44,45,46,47,48]. Patient-reported assessments echo these discrepancies, with many individuals indicating insufficient information and support for non-pharmacological care [24,42,44,45].

While average achievement is suboptimal across settings, specific profiles vary, likely reflecting differences in local priorities, access to multidisciplinary services and system design [42,44,46]. The recurrent under-delivery of weight-loss support and functional/assistive assessments aligns with evidence that indicators fitting established workflows (exercise advice, NSAID prescribing) are easier to operationalize, whereas indicators requiring coordinated behavior change or multidisciplinary input (weight management, occupational advice, walking-aid assessment) face greater barriers [49,50,51,52,53,54,55].

Taken together, the international literature positions our results within a consistent cross-system profile of strengths in lifestyle and basic pharmacologic management and persistent gaps in weight, work/role, and assistive device domains. These gaps are plausibly driven by structural constraints (time, referral pathways, reimbursement, limited integration of physiotherapy/occupational therapy), as well as clinician and patient beliefs that dampen the uptake of recommended non-pharmacologic care [51,52,53,54]. This comparison underscores the need for targeted implementation strategies in South Tyrol, embedding multidisciplinary pathways, practical weight-management support, and consistent assessment of functional aids so that guideline priorities translate into routine primary care.

4.3. Implications for Clinical Practice and Quality Monitoring

The study demonstrates that the bilingual OA-QI is suitable for use in South Tyrolean general practice, offering a reliable and patient-friendly way to assess care quality and highlight differences across the domains of OA management. In daily practice, the instrument can help general practitioners systematically identify gaps and address them more effectively, such as in weight management, occupational aspects, and assistive device provision.

The OA-QI is particularly valuable for quality monitoring at the group level. While individual-level reliability is limited, requiring very large changes in scores to exceed measurement error, group-level reliability is strong and allows for the meaningful detection of smaller changes in average scores. This mirrors the findings from the revised Norwegian OA-QI v2, where group-level reliability was excellent, but the measurement error at the individual level was high [23]. Similar patterns have been reported for other patient-reported instruments, including the EuroQol 5-Dimension 5-Level questionnaire (EQ-5D-5L), Knee Injury and Osteoarthritis Outcome Score (KOOS), Hip Disability and Osteoarthritis Outcome Score (HOOS), Osteoarthritis Knee and Hip Quality of Life questionnaire (OAKHQOL), and Osteoarthritis Quality of Life scale (OAQoL). These measures consistently show high reliability and validity for group comparisons but limited responsiveness for tracking individual patients [56,57,58,59,60,61,62,63].

Aggregated OA-QI results can thus form a basis for practice-level quality work, regional training initiatives, and benchmarking across practices and internationally [23,24,35]. In this way, the instrument contributes to both transparency and quality-oriented improvement efforts.

4.4. Strengths and Limitations

This study is the first to apply the OA-QI v3 in a bilingual healthcare setting, demonstrating its feasibility in South Tyrolean general practice. The recruitment rates were high, missing data were low, and patient feedback confirmed good comprehensibility. Feasibility studies typically do not require formal power calculations; however, guidance emphasizes stable estimates for recruitment, acceptability, and missingness [30,37]. Reliability was assessed using multiple metrics, and the findings replicated international patterns of OA care quality, with strengths in lifestyle advice and pharmacotherapy but gaps in weight management and functional support.

However, several limitations temper these strengths. The study was conducted in a motivated GP network (SAMNET), which may limit its generalizability. As this study was conceived as a feasibility pilot rather than a full validation, certain elements of the published protocol [26] could not be implemented, such as the language-specific reliability testing. Nevertheless, this process provided important lessons, including the risk of dropout in retest groups due to clinical instability. The retest subgroup differed from the full cohort (e.g., more post-surgery patients and educational differences), and because approximately half had contact with a healthcare professional during the interval, indicating potential changes in their clinical status, the effective sample for reliability analyses was small. This underscores the need to account for patient stability when planning retest studies. Finally, reliance on retrospective self-reports carries the risk of recall bias.

The planned cross-national study in South Tyrol and Austria should follow the original protocol [26], ensure larger and clinically stable subgroups for test–retest analyses, and include cognitive debriefing in the study design. Broader psychometric testing, including responsiveness and construct validity, is needed to establish the OA-QI as a robust tool for quality monitoring and international benchmarking.

5. Conclusions

This feasibility pilot demonstrated that the German and Italian OA-QI v3 can be integrated into South Tyrolean general practice, with high patient acceptability and adequate reliability for group-level monitoring. Achievement rates revealed strengths in lifestyle advice, pharmacological management, and pain assessment but persistent shortfalls in weight reduction support, occupational aspects, and assistive device provision, mirroring international patterns. The study showed that the OA-QI is most reliable for evaluating care quality at the group level, whereas measurement error limits its use for monitoring individual patients. Lessons learned from the retest phase, particularly the influence of subgroup composition and clinical instability on reliability estimates, are directly relevant for future validation studies. Overall, the findings support the OA-QI as a practical and informative tool for identifying care gaps, guiding quality improvement, and enabling international benchmarking. Cross-national validation in Italy and Austria will be necessary to establish full psychometric evidence for the German and Italian versions.