Category: Health Sciences and Medicine
ORIGINAL
Towards a Culturally Adapted JVQ: Rasch Model Validation among Adolescents in India
Hacia un JVQ culturalmente adaptado: validación del modelo Rasch entre adolescentes de la India
Syed Faraz Ali1 *, Aqeel Khan1 *, Adibah Binti Abdul Latif1 *, Abdul Wahab Pathath2 *, Shabnam3 *, Sriyanto4 *, Arieff Salleh Rosman5 *
1Faculty of Social Sciences & Humanities, Universiti Teknologi Malaysia (UTM), Johor, Malaysia.
2Faculty, Department of Clinical Neurosciences, College of Medicine, King Faisal University, Al Ahsa – Saudi Arabia.
3Faculty, Department of Humanities and Social Sciences, National Institute of Technology (NIT) Kurukshetra, 136119, Haryana, India.
4Faculty, Social Studies Department, Universitas Muhammadiyah Purwokerto, Jawa Tengah, 53182, Indonesia.
5Arieff Salleh Rosman (Center of Research for Fiqh Science & Technology (CFiRST), Universiti Teknologi Malaysia (UTM), Johor –Malaysia.
Cite as: Faraz Ali S, Khan A, Abdul Latif AB, Wahab Pathath A, Shabnam, Sriyanto, Rosman AS. Towards a Culturally Adapted JVQ: Rasch Model Validation among Adolescents in India. Salud, Ciencia y Tecnología - Serie de Conferencias. 2024; 3:675. https://doi.org/10.56294/sctconf2024675
Submitted: 30-11-2023 Revised: 17-03-2024 Accepted: 05-05-2024 Published: 06-05-2024
Editor: Dr. William Castillo-González
ABSTRACT
Purpose: this study evaluates the psychometric properties of Juvenile Victimization Questionnaire (JVQ) based on the lifetime victimization and traumatic experiences reported by Indian adolescents.
Method: a cohort of 350 adolescents, aged 12 to 18 years, from various schools in Aligarh District of India participated in this study.
Result: the JVQ’s content validity using Fleiss Kappa analysis, Unidimensionality, and item and person reliability were assessed through rasch measurement model. Moreover, the analysis yielded promising result for the JVQ, indicating high reliability, the Fleiss Kappa score of 0,92 suggest an almost perfect agreement, while the person and item reliability scores were recorded at 0,70 and 0,90, respectively.
Conclusion: this initial study supports the JVQ’s potential reliability and validity, suggesting it could be foundational tool for broader research across multiple locations.
Keywords: Victimization; Traumatic Experiences; Adolescent; Juvenile Victimization Questionnaire; Validity; Reliability.
RESUMEN
Propósito: este estudio evalúa las propiedades psicométricas del Cuestionario de Victimización Juvenil (JVQ) basado en la victimización a lo largo de la vida y las experiencias traumáticas reportadas por adolescentes indios.
Método: una cohorte de 350 adolescentes, de 12 a 18 años de edad, de varias escuelas en el distrito de Aligarh de la India participaron en este estudio.
Resultados: se evaluó la validez de contenido del JVQ mediante el análisis Kappa de Fleiss, la unidimensionalidad y la fiabilidad de los ítems y las personas mediante el modelo de medición de Rasch. Además, el análisis arrojó resultados prometedores para el JVQ, indicando una alta fiabilidad, la puntuación Fleiss Kappa de 0,92 sugiere un acuerdo casi perfecto, mientras que las puntuaciones de fiabilidad de la persona y del ítem se registraron en 0,70 y 0,90, respectivamente.
Conclusiones: este estudio inicial apoya la fiabilidad y validez potenciales del JVQ, sugiriendo que podría ser una herramienta fundacional para una investigación más amplia en múltiples lugares.
Palabras clave: Victimización; Experiencias Traumáticas; Adolescente; Cuestionario de Victimización Juvenil; Validez; Fiabilidad.
INTRODUCTION
Victimization has evolved its root mechanism all over the world, which involves the association between offender and victim in any crime causation. Generally, a victim may be a person, an organization, the ethical order, or the legal system when scarce, misuse, or ruined by a certain unlawful or illegal act.(1,2,3,4,5) It is an experience of being harmed either directly or indirectly or in-need of safeguard from harm by the measures of others.(6,7,8,9) Beyond the instantaneous outcomes, like physical harm or may be material loss, the victimization experiences at personal level may have the negative outcomes or emotions, for example, anger, depressive symptoms, anxiety, risk about affecting social cognitions, and also further future risks.(10,11)
Research in psychology and criminology has identified numerous forms of victimization, ranging from various abuses (physical, sexual, emotional) and neglect (physical, emotional), to more specific crimes like domestic violence, stalking, and human trafficking, among others.(7,12,13,14) To encompass these varied experiences under one umbrella, the concept of ‘Polyvictimization’ was developed. This term is used to describe experiences multiple types, of form, of victimization, highlighting the breadth of an individual’s victimization experiences beyond repeated instances of a single type.(15)
Based on the recent evidences, it has become evident that the impact of various forms of victimization on mental well-being is apparent. It has been acknowledged that victimization constitutes a significant stressor and plays a crucial role in the development of numerous psychiatric disorders.(12) A sub-group of polyvictims has been recognized constantly in researches conducted with community, school, psychiatry, child welfare, and juvenile justice samples of children and adolescents in several countries globally.(7) However, polyvictimization may have a harsh and unfortunately lifelong biopsychosocial impact through significant developmental periods.(3)
Hence, the current study aimed to examine to assess the reliability and validity of the Juvenile Victimization Questionnaire (JVQ) when applied to Indian adolescents; to estimate the occurrence rates of different forms of victimization among adolescents aged 12 to 18 years in Aligarh District, India, through the JVQ; to validate the use of the JVQ as a foundational tool for broader research across multiple locations by establishing its potential reliability and validity within the context of Indian adolescents; and use the validated instrument to facilitate the development of appropriate interventions and policies that are tailored to support victimized youth more effectively, thereby benefiting this vulnerable demographic.
METHODOLOGY
Sampling
For this study, a Two-Stage Cluster Sampling Method utilizing “Disproportional Random Sampling” was employed in Aligarh district, India. The district was segmented into four zones: North, South, East, and West, referred to as ‘Clusters’, to facilitate data collection. Subsequently, respondents were selected from each zone using the Disproportional sampling method, considering factors such as availability and study requirements. Additionally, respondents were randomly chosen from various schools and local communities.
Participants
The target population for this study was 348 adolescents aged 12-18 years who live in Aligarh District, India. Only the data of only those respondents have be analyzed who have addressed at-least 2 or more types of victimization in their life-time based on the cut-score evaluation. For this study, the participants sample size was determined through G-power tool, administered as non-probabilistic sampling. Furthermore, the researcher focused on schools, coaching centers and local communities in order to collect data from Aligarh district. In order to do so, the research visited local schools from each zone based on the availability of number of schools and collect data of respondents. Then from coaching centers, researcher focused on each zone based on the availability of number and collect the data. And at-last data more respondents was collected from local communities of each zone.
Juvenile Victimization Questionnaire
The Juvenile Victimization Questionnaire (JVQ) was developed intended to focus on a broader range of information about multiple forms of victimization. It is a comprehensive questionnaire developed by David Finkelhor, Sherry Hamby, Turner & Ormrod (2005). The questionnaire was designed to be administered to children and teenagers from aged 8-17 years. Moreover, the adopted questionnaire consists of 34 items divided into five major domains, which are: Conventional Crime (item 1-8), Child Maltreatment (item 9-12), Peer & Sibling Victimization (item 13-18), Sexual Victimization (item 19-25), and Witnessing & Indirect Victimization (item 29-34).(4) The questionnaire has a pattern such that respondents will be asked to respond on a scale of the dichotomous item, that is, “yes” or “no”.
RESULTS
Statistical Analysis
The demographic profiles of the respondents and the occurrence rates extracted from JVQ were synthesized. To gauge the questionnaire’s content validity, we conducted Fleiss Kappa Analysis, followed by Unidimensionality analysis employing the Rasch Measurement Model. The Winsteps software tool was utilized to assess both person and item reliability. Additionally, statistical analysis was conducted using SPSS 23.
Content Validity
The instrument was reviewed by four experts, who were the professionals and specialists in the field of counseling and psychology from India. Below table 2 indicates the Peer & Sibling Victimization subconstructs secure the highest kappa value (K=1,00) which is almost perfect agreement. It shows that almost every subconstructs has almost perfect agreement except child maltreatment, which is, substantial agreement (K=0,75). The overall kappa value for Juvenile Victimization Questionnaire (JVQ) is (K=0,92) and all the subconstructs values individually are greater than the considerable promise value (K≥0,40) among all the experts.(5)
Table 1 shows Fleiss Kappa for Juvenile Victimization Questionnaire (JVQ)
Table 1. Fleiss Kappa for Juvenile Victimization Questionnaire (JVQ) |
|||
Sr. No |
Sub-Construct |
Kappa Value |
Interpretation |
1. |
Conventional Crime |
0,89 |
Almost Perfect Agreement |
2. |
Child Maltreatment |
0,75 |
Substantial Agreement |
3. |
Peer & Sibling Victimization |
1,00 |
Almost Perfect Agreement |
4. |
Sexual Victimization |
0,92 |
Almost Perfect Agreement |
5. |
Witnessing & Indirect Victimization |
0,97 |
Almost Perfect Agreement |
|
Overall Fleiss Kappa |
0,92 |
Almost Perfect Agreement |
Construct Validity
Using the Rasch measurement model, Unidimensionality analysis was performed to evaluate the construct validity. In order to assess the construct validity, the model concentrates on analyzing a single attribute or dimension at a time.(2) Unidimensionality is established based on 20 % difference criteria, where at least 20 % of raw performance differences defined by measure are required. Additionally, the first construct’s difference shouldn’t be more than 15 %.(2) Reckase (1979) likewise implies that the instrument can tolerate a braw variance explained by measures more than 20 %.(9) Furthermore, based on the raw variance explained by measurements, Sumintono & Widhiarse (2015) testified that the interpretation values for unidimensionality were as follows: accepted if equal to or above 20 %; good if equal to or above 40 %; and excellent if equal to or above 60 %.(14) Additionally, the initial constrast’s Eigen Value shouldn’t be greater than 5.(6) The table 2 below displays the findings of the Unidimensionality analysis for the JVQ in this investigation.
Table 2. Unidimensionality of Juvenile Victimization Questionnaire |
||||
|
|
Empirical |
|
Modeled |
Total raw variance in observation |
42,8 |
100,0 % |
|
100,0 % |
Raw variance explained by measures |
12,8 |
29,9 % |
|
30,2 % |
Raw variance explained by persons |
3,1 |
7,3 % |
|
7,4 % |
Raw variance explained by items |
9,7 |
22,6 % |
|
22,8 % |
Raw unexplained variance (total) |
30,0 |
70,1 % |
100,0 % |
69,8 % |
Unexplained variance in 1st contrast |
2,6 |
6,2 % |
8,8 % |
|
Unexplained variance in 2nd contrast |
2,5 |
5,9 % |
8,4 % |
|
Unexplained variance in 3rd contrast |
2,4 |
5,6 % |
8,0 % |
|
Unexplained variance in 4th contrast |
2,2 |
5,1 % |
7,3 % |
|
Unexplained variance in 5th contrast |
1,9 |
4,5 % |
6,4 % |
|
Figure 1 indicates the unidimensionality of Juvenile Victimization Questionnaire (JVQ). The value of unidimensionality is 29,9 % which is higher than 20 %; which indicates that the value is accepted. And the Eigen value of first contrast, i.e. error is 2,6, which is less than 5, so it is accepted. Hence the instrument subconstruct is valid.(6,9)
Item Statistics: Misfit Order
Moreover, there were some negative polarities in items from the misfit order in item statistics. However, after removing the negative polarities, that is, item 10,5,15,11. The value of item and person reliability become much more balanced. Therefore, the current questionnaire will be consisting of 30 items instead of 34 items. The following table no.4 shows the item statistics of the questionnaire JVQ.
Figure 1. Item statistics
Reliability
Using the item reliability and person reliability and separation using the Rasch Measurement Model analysis, the reliability of the instrument was determined. It has been suggested that the required value of reliability acceptance in the Rasch Model is 0,6.(2)
Table 4. Person Reliability of Juvenile Victimization Questionnaire |
||||||||
PERSON |
350 INPUT |
329 MEASURED |
INFIT |
OUTFIT |
||||
|
TOTAL |
COUNT |
MEASURE |
REALSE |
IMNSQ |
ZSTD |
OMNSQ |
ZSTD |
MEAN |
40,4 |
30,0 |
-,81 |
,48 |
1,00 |
,0 |
,98 |
,0 |
S.D. |
4,3 |
,0 |
,89 |
,06 |
,20 |
,9 |
,33 |
,8 |
REAL RMSE |
,49 |
TRU SD |
,74 |
SEPARATION |
1,53 |
PERSON RELIABILITY ,70 |
||
JVQ (Juvenile Victimization Questionnaire), REALSE (Real Standard Error), IMNSQ (Mean Square Infit Statistic), ZSTD (Infit Mean Square Fit Statistic), OMNSQ (Mean Square Outfit Statistic), REAL RMSE (Real Root Mean Square Error), S.D (Standard Deviation), INFIT (Information Weighted Fit Statistic), OUTFIT (Outlier Sensitive Fit Statistic) |
Table 5. Item Reliability of Juvenile Victimization Questionnaire |
|||||||||
ITEM |
34 INPUT |
30 MEASURED |
INFIT |
OUTFIT |
|||||
|
TOTAL |
COUNT |
MEASURE |
REALSE |
IMNSQ |
ZSTD |
OMNSQ |
ZSTD |
|
MEAN |
71,3 |
53,0 |
,00 |
,37 |
1,00 |
,1 |
,98 |
,0 |
|
S.D. |
11,4 |
,0 |
1,21 |
,08 |
,10 |
,5 |
,16 |
,5 |
|
REAL RMSE |
,38 |
TRU SD |
1,15 |
SEPARATION |
3,03 |
ITEM RELIABILITY ,90 |
|||
JVQ (Juvenile Victimization Questionnaire), REALSE (Real Standard Error), IMNSQ (Mean Square Infit Statistic), ZSTD (Infit Mean Square Fit Statistic), OMNSQ (Mean Square Outfit Statistic), REAL RMSE (Real Root Mean Square Error), S.D (Standard Deviation), INFIT (Information Weighted Fit Statistic), OUTFIT (Outlier Sensitive Fit Statistic) |
|||||||||
Tables 4 and 5 illustrates Juvenile Victimization Questionnaire (JVQ) yielded person reliability and item reliability values of 0,70 and 0,90, correspondingly. These values surpass the threshold of 0,6, as recommended by Bond and Fox (2007), thus indicating acceptable person reliability and item reliability. Furthermore, the person ad item separation values for questionnaire were determined to be 1,53 and 3,03, respectively. These figures meet the satisfactory criteria, given that the minimum acceptable values for person separation are 1,5 (Souza et al., 2017) and for item separation are 2 (Linacre, 2007). Consequently, the JVQ screener sum version demonstrates acceptable person and item reliability and separation. It is important to note that four items were excluded from JVQ in order to achieve such satisfactory values of reliability. Therefore, the final version of the JVQ questionnaire comprises 30 items, enabling the exploration of various forms of victimization among adolescents in the Aligarh district, India.
DISCUSSION
This research aimed to adapt and validate the Juvenile Victimization Questionnaire (JVQ) within the Indian adolescent context, reflecting a significant step towards understanding and measuring victimization cross-culturally. The validation process yielded a Fleiss Kappa score of 0,92, indicating almost perfect agreement among experts, and reliability scores for items and persons at 0,90 and 0,70, respectively. These results are pivotal, underscoring the JVQ's robustness and applicability for Indian adolescents. The successful adaptation of the JVQ in this study resonates with the instrument's original design and validation work by Finkelhor et al. (2005), which emphasized its reliability and validity across diverse victimization domains. The high reliability and validity scores reported herein are not only indicative of the JVQ's comprehensive nature but also its adaptability across cultural boundaries, reinforcing the instrument's foundational utility for global research endeavors.
Moreover, this study's methodological approach, particularly the use of the Rasch model for validating the JVQ, aligns with the guidelines proposed by Bond and Fox (2007). Their work on applying the Rasch model in the human sciences underscores the importance of rigorous measurement and validation techniques in ensuring the reliability of psychometric tools across different populations and cultural settings. The cultural adaptation and validation of the JVQ also contribute to the broader discourse on polyvictimization and its impacts, as explored in studies such as those by Soler et al. (2013) and Charak et al. (2016). These studies highlight the complex interrelations between multiple victimization experiences and psychological outcomes, underscoring the necessity of nuanced, culturally sensitive tools like the JVQ for capturing the breadth of victimization experiences among adolescents. Furthermore, the study's adaptation process, which involved the removal of certain items to enhance the tool's cultural relevance and reliability, mirrors the adaptive measures recommended by Reckase (1979) in ensuring the unidimensionality and validity of psychometric instruments. This adjustment underscores the critical need for cultural sensitivity in the measurement of complex constructs like victimization.
However, the study's scope, focused on a specific region within India, presents limitations regarding the JVQ's applicability across the diverse Indian cultural landscape. Future research should aim to validate the JVQ across various Indian states and socio-cultural contexts, enhancing the tool's utility for national-level victimization assessment and intervention planning. Hence, this study affirms the JVQ's potential as a reliable and valid instrument for assessing adolescent victimization in India, advocating for its broader application across different cultural contexts. It emphasizes the ongoing need for culturally adapted psychometric tools, crucial for the global endeavor to understand and mitigate victimization among vulnerable populations.
CONCLUSION
In conclusion, the investigation was grounded in the necessity to understand the reliability and validity of the JVQ in capturing a wide array of victimization experiences among Indian adolescents, thereby offering a foundational tool for broader research applicability across diverse geographical and cultural landscapes. The research achieved significant milestones by demonstrating that the JVQ holds high reliability and validity within the Indian context, as indicated by the almost perfect Fleiss Kappa score of 0,92 and the substantial reliability scores for both items and persons. This achievement not only underscores the JVQ's effectiveness in assessing victimization among Indian adolescents but also its potential as a critical instrument for identifying and understanding the prevalence and nature of adolescent victimization across India. Furthermore, the study adeptly addressed the need for culturally sensitive research tools. Through the adaptation process—where certain items were refined to better suit the cultural context—this research illuminated the path for future endeavors in cross-cultural studies. The methodological rigor applied, particularly the use of the Rasch measurement model, exemplifies the study's commitment to maintaining scientific precision while navigating the complexities of cultural adaptation.
In essence, this study not only validates the JVQ's applicability among Indian adolescents but also contributes significantly to the ongoing discourse on victimization research. It paves the way for future investigations to further explore the nuances of victimization in varied cultural settings, enabling the development of targeted interventions and policies to support victimized youth. This research serves as a beacon for subsequent studies, advocating for the importance of cultural sensitivity in the psychometric evaluation of tools designed to measure complex social phenomena such as victimization.
REFERENCES
1. Bhattacharyya, A., Lev-Wiesel, R., & Banerjee, M. (2021). Roles of emotional reactions and potency in coping with abusive experiences of Indian adolescent. Journal of Child & Adolescent Trauma, 14(1), 61-72.
2. Bond, T., Yan, Z., & Heene, M. (2020). Applying the Rasch model: Fundamental measurement in the human sciences. Routledge.
3. Charak, R., Byllesby, B. M., Roley, M. E., Claycomb, M. A., Durham, T. A., Ross, J., ... & Elhai, J. D. (2016). Latent classes of childhood poly-victimization and associations with suicidal behavior among adult trauma victims: Moderating role of anger. Child Abuse & Neglect, 62, 19-28.
4. Finkelhor, D., Hamby, S. L., Ormrod, R., & Turner, H. (2005). The Juvenile Victimization Questionnaire: reliability, validity, and national norms. Child abuse & neglect, 29(4), 383-412.
5. Latif, A. A. (2013). Pembangunan Instrumen Penilaian Akhlak Pelajar di institusi pengajian tinggi awam (Doctoral dissertation, Universiti Teknologi Malaysia).
6. Linacre, J. M. (2005). Standard errors: means, measures, origins and anchor values. Rasch Measurement Transactions, 19(3), 1030.
7. Oxford Bibliography (2017). Polyvictimization Introduction.
8. Pandey, R., Gupta, S., Upadhyay, A., Gupta, R. P., Shukla, M., Mishra, R. C., ... & Kumari, V. (2020). Childhood maltreatment and its mental health consequences among Indian adolescents with a history of child work. Australian & New Zealand Journal of Psychiatry, 54(5), 496-508.
9. Reckase, M. D. (1979). Unifactor latent trait models applied to multifactor tests: Results and implications. Journal of educational statistics, 4(3), 207-230.
10. Rühs, F., Greve, W., & Kappes, C. (2017). Coping with criminal victimization and fear of crime: The protective role of accommodative self‐regulation. Legal and Criminological Psychology, 22(2), 359-377.
11. Schneider, H. J. (1982). The present situation of victimology in the world. The victim in international perspective, 11-46.
12. Soler, L., Kirchner, T., Paretilla, C., & Forns, M. (2013). Impact of poly-victimization on mental health: The mediator and/or moderator role of self-esteem. Journal of interpersonal violence, 28(13), 2695-2712.
13. Souza, M. A. P., Coster, W. J., Mancini, M. C., Dutra, F. C. M. S., Kramer, J., & Sampaio, R. F. (2017). Rasch analysis of the participation scale (P-scale): usefulness of the P-scale to a rehabilitation services network. BMC public health, 17, 1-9.
14. Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan rasch pada assessment pendidikan. Trim komunikata.
15. Turner, H. A., Shattuck, A., Finkelhor, D., & Hamby, S. (2017). Effects of poly-victimization on adolescent social support, self-concept, and psychological distress. Journal of interpersonal violence, 32(5), 755-780.
ACKNOWLEDGEMENT
Researchers would like to thank to RMC, UTM number: Q.J130000.3053.04M76 for supporting in conducting research.
CONFLICT OF INTEREST
The authors declare that there is no conflict of interest.
AUTHORSHIP CONTRIBUTION
Conceptualization: Aqeel Khan, Abdul Wahab Pathath & Sriyanto.
Data curation: Syed Faraz Ali, Shabnam.
Formal analysis: Adibah Binti Abdul Latif.
Methodology: Syed Faraz Ali, Adibah Binti Abdul Latif.
Project management: Aqeel Khan.
Writing: Aqeel Khan, Arieff Salleh Rosman.