Submitted:
30 June 2026
Posted:
02 July 2026
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Materials and Methods
2.1. Design and Participants
2.2. Instruments
2.3. Data Analysis
- Incremental fit indices: The Comparative Fit Index (CFI) and the Tucker-Lewis Index (TLI). Values > 0.95 were considered indicative of excellent fit.
- Absolute fit indices: The Root Mean Square Error of Approximation (RMSEA) and the Standardized Root Mean Square Residual (SRMR). Values < 0.06 for RMSEA indicate excellent fit, and values < 0.08 for SRMR indicate good fit [43]. These criteria were applied flexibly, considering the ordinal nature of the data, the WLSMV estimation method, and empirical evidence showing that RMSEA tends to penalize correctly specified models in this context [44]. Notably, SRMR is recognized for its robustness to the choice of estimation method (WLSMV vs. ML) at the population level, making it a reliable indicator of model misfit regardless of the challenges posed by data ordinality [44,45].
2.4. Ethical Considerations
3. Results
3.1. Comparison of Factorial Models
3.2. Convergent Validity of the Adjusted Model
3.3. Discriminant Validity of the Adjusted Model
3.4. Factorial Invariance by Sex
4. Discussion
5. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| AVE | Average Variance Extracted |
| CFA | Confirmatory Factor Analysis |
| CFI | Comparative Fit Index |
| ECIPQ | European Cyberbullying Intervention Project Questionnaire |
| HTMT | Heterotrait – Monotrait |
| M | Mean |
| MI | Modification Indices |
| QR | Quick Response |
| RMSEA | Root Mean Square Error of Approximation |
| SD | Standard Deviation |
| SEM | Structural Equation Modeling |
| SRMR | Standardized Root Mean Square Residual |
| TLI | Tucker–Lewis Index |
| WLSMV | Weighted Least Squares Mean and Variance |
Appendix A
| Title 1 | English items | Spanish items |
| Vic_01 | Someone said nasty things to me or called me names using texts or online messages. | Alguien me ha dicho palabras inapropiadas o me ha insultado usando internet. |
| Vic_02 | Someone said nasty things about me to others either online or through text messages. | Alguien ha dicho a otros, palabras inapropiadas sobre mí usando internet. |
| Vic_03 | Someone threatened me through texts or online messages. | Alguien me ha amenazado a través de mensajes en internet. |
| Vic_04 | Someone hacked into my account and stole personal information. | Alguien ha pirateado mi cuenta de correo y ha sacado mi información personal. |
| Vic_05 | Someone hacked into my account and pretended to be me. | Alguien ha pirateado mi cuenta y se ha hecho pasar por mí. |
| Vic_06 | Someone created a fake account, pretending to be me. | Alguien ha creado una cuenta falsa para hacerse pasar por mí. |
| Vic_07 | Someone posted personal information about me online. | Alguien ha publicado información personal sobre mí en internet. |
| Vic_08 | Someone posted embarrassing videos or pictures of me online. | Alguien ha publicado videos o fotos comprometedoras mías en internet. |
| Vic_09 | Someone altered pictures or videos of me that I had posted online. | Alguien ha retocado fotos mías que yo había publicado en internet. |
| Vic_10 | I was excluded or ignored by others in a social networking site or internet chat room. | He sido excluido o ignorado de una red social o de chat. |
| Vic_11 | Someone spread rumors about me on the internet. | Alguien ha difundido rumores sobre mí en internet. |
| Agr_01 | I said nasty things to someone or called them names using texts or online messages. | He dicho palabras inapropiadas a alguien o le he insultado usando internet. |
| Agr_02 | I said nasty things about someone to other people either online or through text messages. | He dicho palabras inapropiadas sobre alguien a otras personas en mensajes por internet. |
| Agr_03 | I threatened someone through texts or online messages. | He amenazado a alguien a través de mensajes en internet. |
| Agr_04 | I hacked into someone’s account and stole personal information. | He pirateado la cuenta de correo de alguien y he robado su información personal. |
| Agr_05 | I hacked into someone’s account and pretended to be them. | He pirateado la cuenta de alguien y me he hecho pasar por él/ella. |
| Agr_06 | I created a fake account, pretending to be someone else. | He creado una cuenta falsa para hacerme pasar por otra persona. |
| Agr_07 | I posted personal information about someone online. | He publicado información personal de alguien en internet. |
| Agr_08 | I posted embarrassing videos or pictures of someone online. | He publicado videos o fotos comprometidas de alguien en internet. |
| Agr_09 | I altered pictures or videos of another person that had been posted online. | He retocado fotos o videos de alguien que estaban publicados en internet. |
| Agr_10 | I excluded or ignored someone in a social networking site or internet chat room. | He excluido o ignorado a alguien en una red social o chat. |
| Agr_11 | I spread rumors about someone on the internet. | He difundido rumores sobre alguien en internet. |
References
- Olweus, D. Cyberbullying: An overrated phenomenon? Eur. J. Dev. Psychol. 2012, 9, 520-538. [CrossRef]
- Smith, P.K., Mahdavi, J., Carvalho, M., Fisher, S., Russell, S., Tippett, N. Cyberbullying: Its nature and impact in secondary school pupils. J. Child Psychol. Psychiatry 2008, 49, 376-385. [CrossRef]
- Ortega-Ruiz, R., Del Rey, R., Casas, J.A. Evaluar el bullying y el ciberbullying: Validación española del EBIP-Q y del ECIP-Q. Psicología Educativa 2016, 22, 71-79. [CrossRef]
- Tokunaga, R.S. Following you home from school: A critical review and synthesis of research on cyberbullying victimization. Comput. Hum. Behav. 2010, 26, 277-287. [CrossRef]
- Sticca, F., Perren, S. Is cyberbullying worse than traditional bullying? Examining the differential roles of medium, publicity, and anonymity for the perceived severity of bullying. J. Youth Adolescence 2013, 42, 739-750. [CrossRef]
- Francisco, S.M., Veiga Simão, A.M.V., Costa, P., das Dore, M.J. Cyberbullying: The hidden side of college students. Comput. Hum. Behav. 2015, 43, 167-182. [CrossRef]
- Watts, L.K., Wagner, J., Velasquez, B., Behrens, P.I. Cyberbullying in higher education: A literature review. Comput. Hum. Behav. 2017, 69, 268-274. [CrossRef]
- Heiman, T., Olenik-Shemesh, D. Cyber-victimization experience among higher education students: Effects of social support, loneliness, and self-efficacy. Int. J. Environ. Res. Public Health 2022, 19, 7395. [CrossRef]
- Estévez, E., Cañas, E., Estévez, J.F., Povedano, A. Continuity and overlap of roles in victims and aggressors of bullying and cyberbullying in adolescence: A systematic review. Int. J. Environ. Res. Public Health 2020, 17, 7452. [CrossRef]
- Méndez, I., Ruiz Esteban, C., Martínez, J.P., Cerezo, F. Ciberacoso según características sociodemográficas y académicas en estudiantes universitarios. Revista Española de Pedagogía 2019, 77, 261–276. [CrossRef]
- Souza, S.B., Veiga Simão, A.M., Ferreira, A.I., Costa Ferreira, P. University students’ perceptions of campus climate, cyberbullying and cultural issues: Implications for theory and practice. Stud. High. Educ. 2017, 44, 169–181. [CrossRef]
- Ragusa, A.; Núñez-Rodríguez, S.; Vaz, P.; Silva, J.; Caliciotti, V.; González-Bernal, J.J.; López-Rivero, A.J.; Petrillo, E.; Gatto, M.; Obregón-Cuesta, A.; González-Santos, J. Impact of Cyberbullying on Academic Performance and Psychosocial Well-Being of Italian Students. Children-Basel 2024, 11, 943. [CrossRef]
- Chamizo-Nieto, M.T.; Rey, L. Cybervictimisation and depressive symptoms among adolescents: A moderated mediation model. Curr. Psychol. 2023, 42, 11475-11485. [CrossRef]
- Chamizo-Nieto, M.T.; Rey, L. Gratitude as a Protective Factor for Cybervictimisation and Anxiety Symptomatology: A Prospective Study. Appl. Res. Qual. Life 2023, 18, 1057-1071. [CrossRef]
- Chamizo-Nieto, M.T.; Rey, L.; Pellitteri, J. Gratitude and Emotional Intelligence as Protective Factors against Cyber-Aggression: Analysis of a Mediation Model. Int. J. Environ. Res. Public Health 2020, 17, 4475. [CrossRef]
- Rojo-Ramos, J.; Gomez-Paniagua, S.; Castillo-Paredes, A.; Galán-Arroyo, C. Inclusion and adolescence: Attitudes towards students with disabilities and cyberbullying behavior in physical education. Espiral 2024, 17, 62-75. [CrossRef]
- Feijóo, S., Foody, M., O'Higgins Norman, J., Pichel, R., Rial, A. Ciberacosados, ciberacosadores y uso problemático de Internet: algunos parecidos razonables. Psicothema 2021, 33, 198-205. [CrossRef]
- López-Pradas, I.C.; Romera, E.M.; Casas, J.A.; Ortega-Ruiz, R. Cybergossip and cyberbullying during primary school years. Psicol. Educ. 2017, 23, 73-80. [CrossRef]
- Castano-Pulgarin, S.A.; Tang, J.F.C.; Tilano-Vega, L.M.; Herrera-López, M. Design and Validation of a Cyberhate Scale (ECO) in Colombian University Students. Electron. J. Res. Educ. Psychol. 2022, 21, 397-420.
- Díaz-Moreno, A.; Bonilla, I.; Chamarro, A. Gaming Toxicity Scale (GTOX): an assessment tool of toxic behaviours within online video games. Behav. Inf. Technol. 2026, 45, 1136-1152. [CrossRef]
- Del Rey, R., Casas, J.A., Ortega-Ruiz, R., Schultze-Krumbholz, A., Scheithauer, H., Smith, P., ... Plichta, P. Structural validation and cross-cultural robustness of the European Cyberbullying Intervention Project Questionnaire. Comput. Hum. Behav. 2015, 50, 141-147. [CrossRef]
- Elipe, P., Ortega-Ruiz, R., Del Rey, R. Validation of the Cybervictimization Emotional Impact Scale (CVEIS). Int. J. Environ. Res. Public Health 2017, 14, 1546. [CrossRef]
- Brighi, A., Ortega, R., Pyzalski, J., Scheithauer, H., Smith, P. K., Tsormpatzoudis, H., Tsorbatzoudis, H. European Cyberbullying Intervention Project Questionnaire (ECIPQ) [Database record]. APA PsycTests 2012. [CrossRef]
- Álvarez-Marín, I., Pérez-Albéniz, A., Lucas-Molina, B., Martínez-Valderrey, V., Fonseca-Pedrero, E. Assessing cyberbullying in adolescence: New evidence for the Spanish version of the European Cyberbullying Intervention Project Questionnaire (ECIP-Q). Int. J. Environ. Res. Public Health 2022, 19, 14196. [CrossRef]
- Monteiro, A.P., Fonseca, D., Correia, E. Adaptação e validação da escala European Cyberbullying Intervention Project Questionnaire numa amostra de adolescentes portugueses. Rev. Electron. Educ. 2025, 29, 1-19. [CrossRef]
- Zych, I., Ortega-Ruiz, R., Marín-López, I. Cyberbullying: A systematic review of research, its prevalence and assessment issues in Spanish studies. Psicología Educativa 2016, 22, 5-18. [CrossRef]
- Cuesta-Andaluz, E., Moreta-Herrera, R., Lascano-Arias, G., Pino-Falconí, M., Moreno-Montero, E. Propiedades psicométricas del European Bullying Intervention Project Questionnaire (EBIPQ) y el European Cyberbullying Intervention Project Questionnaire (ECIPQ) en una muestra de adolescentes del Ecuador. Suma Psicológica 2025, 32, 54-64. [CrossRef]
- Gözütok, A.S.; Akçil, S.; Ulus, I.C. (2024). Turkish Adaptation of the European Cyberbullying Intervention Project Questionnaire (ECIPQ). J. Learn. Teach. Digit. Age 2024, 9, 80-87. [CrossRef]
- Zhu, Y.H.; Wu, S.Y.; Marsiglia, F.F.; Wu, Q.; Chen, Q.Q. Adaptation and validation of the European cyberbullying intervention project questionnaire with and for Chinese adolescents. Health Soc. Care Community 2022, 30, 1363-1372. [CrossRef]
- Herrera-López, M.; Casas, J.A.; Romera, E.M.; Ortega-Ruiz, R.; Del Rey, R. Validation of the European Cyberbullying Intervention Project Questionnaire for Colombian Adolescents. Cyberpsychology Behav. Soc. Netw. 2017, 20, 117-125. [CrossRef]
- Rial, A., Gómez, P., Isorna, M., Araujo, M., Varela, J. PIUS-a: Problematic Internet Use Scale in adolescents. Development and psychometric validation. Adicciones 2015, 27, 47-63. [CrossRef]
- Souza, S.B., Pardo-Gonzalez, E., Paulino, P., Francisco, S.M., Fredes-Montero, J., Herrera, H.A. Measuring and characterizing cyberbullying among Chilean university students. Current Psychol. 2024, 43, 17416-17431. [CrossRef]
- Sidera, F; Serrat, E; Rostan, C. Effects of Cybervictimization on the Mental Health of Primary School Students. Front. Public Health 2021, 9, 588209. [CrossRef]
- Brown, T.A. Confirmatory factor analysis for applied research, 2nd ed.; Guilford Press: New York, NY, USA, 2015.
- Kline, R.B. Principles and practice of structural equation modeling, 4th ed.; The Guilford Press: New York, NY, USA, 2016.
- Muthén, B.O., Kaplan, D. A comparison of some methodologies for the factor analysis of non-normal Likert variables: A note on the size of the model. Br. J. Math. Stat. Psychol. 1992, 45, 19-30. [CrossRef]
- Curran, P.J., West, S.G., Finch, J. F. The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychol. Methods 1996, 1, 16-29. [CrossRef]
- Savalei, V., Rhemtulla, M. The performance of robust test statistics with categorical data. Br. J. Math. Stat. Psychol. 2013, 66, 201-223. [CrossRef]
- Muthén, B.O., Kaplan, D. A comparison of some methodologies for the factor analysis of non-normal Likert variables. Br. J. Math. Stat. Psychol. 1985, 38, 171-189. [CrossRef]
- Flora, D.B., Curran, P.J. An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychol. Methods 2004, 9, 466-491. [CrossRef]
- Jöreskog, K.G. (2005). Structural equation modeling with ordinal variables using LISREL; Scientific Software International: Chicago, IL, USA, 2005.
- MacCallum, R.C., Browne, M.W., Sugawara, H.M. Power analysis and determination of sample size for covariance structure modeling. Psychol. Methods 1996, 1, 130-149. [CrossRef]
- Hu, L., Bentler, P. M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary J. 1999, 6, 1-55. [CrossRef]
- Xia, Y., Yang, Y. RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behav. Res. Methods 2019, 51, 409-428. [CrossRef]
- Shi, D., Maydeu-Olivares, A. The effect of estimation methods on SEM fit indices. Educ. Psychol. Measurement 2020, 80, 421-445. [CrossRef]
- McDonald, R. P. Test theory: A unified treatment; Lawrence Erlbaum: Mahwah, NJ / London, USA / UK, 1999.
- Zumbo, B., Gadermann, A., Zeisser, C. Ordinal versions of coefficients alpha and theta for Likert rating scales. J. Modern Applied Stat. Methods 2007, 6, 21-29. [CrossRef]
- Fornell, C., Larcker, D.F. Evaluating structural equation models with unobservable variables and measurement error. J. Mark. Res. 1981, 18, 39-50. [CrossRef]
- MacCallum, R.C., Roznowski, M., Necowitz, L.B. Model modifications in covariance structure analysis: The problem of capitalization on chance. Psychol. Bulletin 1992, 111, 490-504. [CrossRef]
- Satorra, A., Bentler, P.M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In Latent variable analysis: Applications to developmental research; von Eye, A., Clogg, C.C., Eds.; Sage: New York, NY, USA, 1994; pp. 399-419.
- Henseler, J., Ringle, C.M., Sarstedt, M. A new criterion for assessing discriminant validity in variance-based structural equation modeling. J. Acad. Mark. Sci. 2015, 43, 115-135. [CrossRef]
- Del Rey, R.; Elipe, P.; Ortega-Ruiz, R. Bullying and cyberbullying: Overlapping and predictive value of the co-occurrence. Psicothema 2012, 24, 608-613.
- Ojeda, M.; Del Rey, R.; Hunter, SC. Longitudinal relationships between sexting and involvement in both bullying and cyberbullying. J. Adolesc. 2019, 77, 81-89. [CrossRef]
- Arnett, J.J. Emerging adulthood: A theory of development from the late teens through the twenties. Am. Psychol. 2000, 55, 469–480. [CrossRef]
- Vejmelka, L.; Matkovic, R.; Rajter, M. Cyberbullying in COVID-19 Pandemic Decreases? Research of Internet Habits of Croatian Adolescents. Information 2022, 13, 586. [CrossRef]
- Benítez-Sillero, J.D; Corredor-Corredor, D; Córdoba-Alcaide, F; Calmaestra, J. Intervention programme to prevent bullying in adolescents in physical education classes (PREBULLPE): a quasi-experimental study. Phys. Educ. Sport Pedag. 2021, 26, 36-50. [CrossRef]
- Benítez-Sillero, J.D; Crespo, J.M.A; Córdoba, ER; Raya-Gonzalez, J. Relationship between Amount, Type, Enjoyment of Physical Activity and Physical Education Performance with Cyberbullying in Adolescents. Int. J. Environ. Res. Public Health 2021, 18, 2038. [CrossRef]

| Model 1 | χ² | df | CFI | TLI | RMSEA | 90% CI | SRMR |
| Unidimensional (1F) | 2994.695 | 209 | 0.984 | 0.982 | 0.133 | [0.129, 0.137] | 0.141 |
| Two-factor base (2F) | 2386.832 | 208 | 0.987 | 0.986 | 0.118 | [0.114, 0.122] | 0.127 |
| Bifactor | 1274.194 | 187 | 0.994 | 0.992 | 0.088 | [0.083, 0.092] | 0.099 |
| Two-factor adjusted (2F + residual covariances) |
1105.518 | 202 | 0.995 | 0.994 | 0.077 | [0.073, 0.081] | 0.084 |
| Factor |
Number of Items |
McDonald's Omega (ω) |
Ordinal Alpha (αord) |
Average Variance Extracted (AVE) |
Item |
Standardized Factor Loading (λ) |
| Cybervictimization | 11 | 0.836 | 0.943 | 0.603 | Vic_01 | 0.542 |
| Vic_02 | 0.630 | |||||
| Vic_03 | 0.677 | |||||
| Vic_04 | 0.764 | |||||
| Vic_05 | 0.797 | |||||
| Vic_06 | 0.829 | |||||
| Vic_07 | 0.887 | |||||
| Vic_08 | 0.935 | |||||
| Vic_09 | 0.946 | |||||
| Vic_10 | 0.679 | |||||
| Vic_11 | 0.748 | |||||
| Cyberaggression | 11 | 0.908 | 0.969 | 0.770 | Agr_01 | 0.688 |
| Agr_02 | 0.711 | |||||
| Agr_03 | 0.834 | |||||
| Agr_04 | 0.961 | |||||
| Agr_05 | 0.987 | |||||
| Agr_06 | 0.821 | |||||
| Agr_07 | 0.967 | |||||
| Agr_08 | 0.985 | |||||
| Agr_09 | 0.938 | |||||
| Agr_10 | 0.744 | |||||
| Agr_11 | 0.941 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).