The Rasch model is one of the most prominent item response models. In this article, different item parameter estimation methods for the Rasch model are compared through a simulation study. The type of ability distribution, the number of items, and sample sizes were varied. It is shown that variants of joint maximum likelihood estimation and conditional likelihood estimation are competitive to marginal maximum likelihood estimation. However, efficiency losses of limited-information estimation methods are only modest. It can be concluded that in empirical studies using the Rasch model, the impact of the choice of an estimation method with respect to item parameters is almost negligible for most estimation methods. Interestingly, this sheds a somewhat more positive light on old-fashioned joint maximum likelihood and limited information estimation methods.

Missing item responses are prevalent in educational large-scale assessment studies like the programme for international student assessment (PISA). The current operational practice scores missing item responses as wrong, but several psychometricians advocated a model-based treatment based on latent ignorability assumption. In this approach, item responses and response indicators are jointly modeled conditional on a latent ability and a latent response propensity variable. Alternatively, imputation-based approaches can be used. The latent ignorability assumption is weakened in the Mislevy-Wu model that characterizes a nonignorable missingness mechanism and allows the missingness of an item to depend on the item itself. The scoring of missing item responses as wrong and the latent ignorable model are submodels of the Mislevy-Wu model. This article uses the PISA 2018 mathematics dataset to investigate the consequences of different missing data treatments on country means. Obtained country means can substantially differ for the different scaling models. In contrast to previous statements in the literature, the scoring of missing item responses as incorrect provided a better model fit than a latent ignorable model for most countries. Furthermore, the dependence of the missingness of an item from the item itself after conditioning on the latent response propensity was much more pronounced for constructed-response items than for multiple-choice items. As a consequence, scaling models that presuppose latent ignorability should be refused from two perspectives. First, the Mislevy-Wu model is preferred over the latent ignorable model for reasons of model fit. Second, we argue that model fit should only play a minor role in choosing psychometric models in large-scale assessment studies because validity aspects are most relevant. Missing data treatments that countries can simply manipulate (and, hence, their students) result in unfair country comparisons.

This article shows that the recently proposed latent D-scoring model of Dimitrov is statistically equivalent to the two-parameter logistic item response model. An analytical derivation and a numerical illustration are employed for demonstrating this finding. Hence, estimation techniques for the two-parameter logistic model can be used for estimating the latent D-scoring model. In an empirical example using PISA data, differences of country ranks are investigated when using different metrics for the latent trait. In the example, the choice of the latent trait metric matters for the ranking of countries. Finally, it is argued that an item response model with bounded latent trait values like the latent D-scoring model might have advantages for reporting results in terms of interpretation.

The comparison of group means in item response models constitutes an important issue in empirical research. The present article discusses an extension of Haebara linking by proposing a flexible class of robust linking functions for comparisons of many groups. These robust linking functions are particularly suited to item response data that are generated under partial invariance. In a simulation study, it is shown that the newly proposed robust Haebara linking approach outperforms existing approaches of Haebara linking. In an empirical application using PISA data, it is illustrated that country means can be sensitive to the choice of linking functions.

The comparison of group means in latent variable models plays a vital role in empirical research in the social sciences. The present article discusses extensions of invariance alignment and Haberman linking concerning the choice of linking functions for comparisons of many groups. Robust linking functions are proposed for invariance alignment and robust Haberman linking that are particularly suited to item response data under partial invariance. In a simulation study, it is shown that both linking approaches have comparable performance, and in some conditions, the newly proposed robust Haberman linking outperforms invariance alignment.

Discrete distribution estimation is a fundamental statistical tool, which is widely used to perform data analysis tasks in various applications involving sensitive personal information. Due to privacy concerns, individuals may not always provide their raw information, which leads to unpredictable biases in the final results of estimated distribution. Local Differential Privacy (LDP) is an advanced technique for privacy protection of discrete distribution estimation. Currently, typical LDP mechanisms provide same protection for all items in the domain, which imposes unnecessary perturbation on less sensitive items and thus degrades the utility of final results. Although, several recent works try to alleviate this problem, the utility can be further improved. In this paper, we propose a novel notion called Item-Oriented Personalized LDP (IPLDP), which independently perturbs different items with different privacy budgets to achieve personalized privacy protection. Furthermore, to satisfy IPLDP, we propose the Item-Oriented Personalized Randomized Response (IPRR) based on the observation that the sensitivity of data shows an inverse relationship with the population size of respective individuals. Theoretical analysis and experimental results demonstrate that our method can provide fine-grained privacy protection and improve data utility simultaneously.

Guessing effects frequently occur in testing data in educational or psychological applications. Different item response models have been proposed to handle guessing effects in dichotomous test items. However, it has been pointed out in the literature that the oftenemployed three-parameter logistic model poses implausible assumptions regarding the guessing process. The four-parameter guessing model has been proposed as an alternative to circumvent these conceptual issues. In this article, the four-parameter guessing model is compared with alternative item response models for handling guessing effects through a simulation study and an empirical example. It turned out that model selection for item response models should be rather based on the AIC than the BIC. However, the RMSD item fit statistic used with typical cutoff values was found to be ineffective in detecting misspecified item response models. Furthermore, sufficiently large sample sizes are required for sufficiently precise item parameter estimation. Moreover, it is argued that the criterion of statistical model fit should not be the sole criterion of model choice. The item response model used in operational practice should be valid with respect to the meaning of the ability variable and the underlying model assumptions. In this sense, the four-parameter guessing model could be the model of choice in educational large-scale assessment studies.

This study addresses the latent construct of attitudes towards environmental conservation based on study participant’s responses. We measured and evaluated the latent scale based on an 18-item scale instrument, over four experimental strata (N=945) in the US Virgin Islands and the Caribbean. We estimated the latent scale reliability and validity. We further fitted multiple alternative two-parameter logistic (2PL) and graded response models (GRM) from Item-Response Theory. We finally constructed and fitted equivalent structural and generalized structural equation models (SEM/GSEM) for the attitudinal latent scale. All scale measures (composite, alpha-based, IRT-based and SEM-based) were consistently and reliably valid measures of the study participants’ latent attitudes toward conservation. We found statistically significant differences among participant’s attributes relating to socio-demographic, physical and core environmental characteristics of participants. We assert that the nature of relationship between cognitive attitudes and individual as well as social behavior related to environmental conservation.

Despite extensive investigations of the Depression Anxiety Stress Scales-21 (DASS-21) since its development in 1995, its factor structure and other psychometric properties still need to be firmly established, with several calls for revising its item structure. Employing confirmatory factor analysis (CFA), this study examined the factor structure of the DASS-21 and five shortened versions of the DASS-21 among psychiatric patients (N = 168) and the general public (N = 992) during the COVID-19 confinement period in Saudi Arabia. Multigroup CFA, Mann Whitney W test, Spearman’s correlation, and coefficient alpha were used to examine the shortened versions of the DASS-21 (DASS-13, DASS-12, DASS-9 (two versions), and DASS-8) for invariance across age and gender groups, discriminant validity, predictive validity, item coverage, and internal consistency, respectively. Compared with the DASS-21, all three-factor structures of the shortened versions expressed good fit, with the DASS-8 demonstrating the best fit and highest item loadings on the corresponding factors in both samples (χ2(16, 15) = 16.5, 67.0; p = 0.420, 0.000; CFI= 1.000, 0.998; TLI = 0.999, 0.997; RMSEA = 0.013, 0.059, SRMR = 0.0186, 0.0203). It expressed configural, metric, and scalar invariance across age and gender groups. Its internal consistency was comparable to other versions (α = 0.94). Strong positive correlations of the DASS-8 and its subscales with the DASS-21 and its subscales (r = 0.97 to 0.81) suggest adequate item coverage and good predictive validity of this version. The DASS-8 and its subscales distinguished the clinical sample from the general public at the same level of significance expressed by the DASS-21 and other shortened versions, supporting its discriminant validity. Neither the DASS-21 nor the shortened versions distinguished patients diagnosed with depression and anxiety from other conditions. The DASS-8 represents a valid short version of the DASS-21, which may be useful in research and clinical practice for quick identification of individuals with potential psychopathologies. Diagnosing depression/anxiety disorders may be further confirmed in a next step by clinician-facilitated examinations. Brevity of the DASS-21 would save time and effort used for filling the questionnaire and support comprehensive assessments by allowing the inclusion of more measures on test batteries.