Assessment of the Validity and Reliability of Mental Health Instruments of High School Student in Indonesia
This study aims to develop a standard instrument for measuring mental health among urban adolescents in Indonesia. The objective is to produce valid a.
- Pub. date: April 15, 2021
- Pages: 729-742
- 636 Downloads
- 1643 Views
- 2 Citations
This study aims to develop a standard instrument for measuring mental health among urban adolescents in Indonesia. The objective is to produce valid and reliable school adolescent mental health instruments to be used by agencies or schools to identify students' mental health. The survey was conducted in Jakarta and South Tangerang with a total of 1007 respondents divided into two experiments where the first trial was conducted on 597 students and the second trial was conducted on 410 students. Measurements were made using a Likert scale questionnaire. Instrument testing begins with a theoretical validity test by 4 experts and 20 panelists who test the instrument material in terms of construction, content and language. Experts analyze and correct the instrument qualitatively. The instrument was then reviewed and analyzed quantitatively by panelists using the Aiken index. At this stage, 44 items, 9 indicators and 3 variable dimensions were obtained. The next test is done by testing the validity empirically, by analyzing the measurement model using Confirmatory Factor Analysis (CFA) with the LISREL 8.80 Full Version program. By using the criteria for the SLF value ≥0.30 and t-value ≥1.96, and calculating the reliability with the construct reliability (CR) at the level> 0.70, the results of the second trial showed that 35 items were valid. The observations of the model fitness through Goodness-of-Fit test showed that there is a fitness between the theoretical model and the empirical model for the mental health instruments in this study.
Keywords: Validity, reliability, mental health, item measurement, adolescence, Indonesia.
References
Abubakar, A., Van de Vijver, F. J., Suryani, A. O., Handayani, P., & Pandia, W. S. (2015). Perceptions of parenting styles and their associations with mental health and life satisfaction among urban Indonesian adolescents. Journal of Child and Family Studies, 24(9), 2680-2692.
Arici-Ozcan, N., Cekici, F., & Arslan, R. (2019). The relationship between resilience and distress tolerance in college students: The mediator role of cognitive flexibility and difficulties in emotion regulation. International Journal of Educational Methodology, 5(4), 525-533. htpps://doi.org/ 10.12973/ijem.5.4.525
Behere, P. B., Das, A., Yadav, R., & Behere, A. P. (2013). Religion and mental health. Indian journal of psychiatry, 55(Suppl 2), S187–S194.
Bohnenkamp, J. H., Stephan, S. H., & Bobo, N. (2015). Supporting student mental health: The role of the school nurse in coordinated school mental health care. Psychology in the Schools, 52(7), 714-727.
Cecil, R., Ronald, B. R., & Victor, W. (2009). Measurement and Assessment in Education. Pearson Education.
Chidarikire, S. (2012). Spirituality: The neglected dimension of holistic mental health care. Advances in Mental Health, 10(3), 298-302.
Clauss-Ehlers, C. S., Serpell, Z. N., & Weist, M. D. (2013). Introduction: Making the case for culturally responsive school mental health. In Handbook of Culturally Responsive School Mental Health (pp. 3-15). Springer.
Cohen, R. J., & Swerdlik, M. E. (2010). Psychological Testing and Assessment. Tata McGraw Hill Education.
Cohen, R. J., Swerdlik, M. E., & Phillips, S. M. (1996). Psychological testing and assessment: An introduction to tests and measurement. Mayfield Publishing Co.
de Almeida Vieira, A. P. T., & Fernandes, A. B. (2016). Cultural competence in mental health nursing: validity and internal consistency of the Portuguese version of the multicultural mental health awareness scale—MMHAS. BMC psychiatry, 16(1), 1-8.
Eryılmaz, A., & Sapsağlam, Ö. (2018). Development of subjective well-being increasing strategies scale for children (1-5 ages) their mothers use. Journal of Education and Training Studies, 6(6), 77-83.
Flannelly, K. J., & Galek, K. (2010). Religion, evolution, and mental health: Attachment theory and ETAS theory. Journal of Religion and Health, 49(3), 337-350.
Gable, R. K., & Wolf, M. B. (2012). Instrument development in the affective domain: Measuring attitudes and values in corporate and school settings (Vol. 36). Springer Science & Business Media.
Garey, E., Siregar, J. R., Hood Jr, R. W., Agustiani, H., & Setiono, K. (2016). Development and validation of Religious Attribution Scale: In association with religiosity and meaning in life among economically disadvantaged adolescents in Indonesia. Mental Health, Religion & Culture, 19(8), 818-832.
Gillam, T. (2018). Creativity, Wellbeing and Mental Health Practice. Palgrave Pivot.
Gonçalves, J. P., Lucchetti, G., Menezes, P. R., & Vallada, H. (2015). Religious and spiritual interventions in mental health care: a systematic review and meta-analysis of randomized controlled clinical trials. Psychological Medicine, 45(14), 2937-2949.
Gonçalves, T. E. D., Zimmermann, G. S., Figueiredo, L. C., Souza, M. D. C., da Cruz, D. F., Bastos, M. F., da Silva, H. D. P., & Duarte, P. M. (2015). Local and serum levels of adipokines in patients with obesity after periodontal therapy: one‐year follow‐up. Journal of Clinical Periodontology, 42(5), 431-439.
Gould, N. (2016). Mental health social work in context. Routledge.
Hair Jr. J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate data analysis. Pearson Education.
Hammarström, A., Westerlund, H., Kirves, K., Nygren, K., Virtanen, P., & Hägglöf, B. (2016). Addressing challenges of validity and internal consistency of mental health indices in a 27-year longitudinal cohort study–the Northern Swedish Cohort study. BMC Medical Research Methodology, 16(1), 1-9.
Hardy, S. A., Francis, S. W., Zamboanga, B. L., Kim, S. Y., Anderson, S. G., & Forthun, L. F. (2013). The roles of identity formation and moral identity in college student mental health, health‐risk behaviors, and psychological well‐being. Journal of Clinical Psychology, 69(4), 364-382.
Hefti, R. (2011). Integrating religion and spirituality into mental health care, psychiatry and psychotherapy. Religions, 2(4), 611-627.
Hudson, P. J., Lai, B., & Short, M. B. (2020). Cumulative risk of psychological distress in college students effected by Hurricane Harvey. European Journal of Psychology and Educational Research, 3(2), 101-109.
Igbaria, M., & Baroudi, J. J. (1993). A short-form measure of career orientations: A psychometric evaluation. Journal of Management Information Systems, 10(2), 131-154.
Kline, R. B. (2015). Principles and practice of structural equation modeling. Guilford publications.
Kring, A. M., & Caponigro, J. M. (2010). Emotion in schizophrenia: where feeling meets thinking. Current Directions in Psychological Science, 19(4), 255-259.
Kubiszyn, T., & Borich, G. (1987). Educational testing and measurement. Scott, Foresman.
Lamborn, P., Cramer, K. M., & Riberdy, A. (2018). The structural validity and measurement invariance of the mental health continuum–short form (MHC-SF) in a large Canadian sample. Journal of Well-Being Assessment, 2(1), 1-19.
Linn, R. L. (2008). Measurement and assessment in teaching. Pearson Education India.
Liu, C., Yanling, L., Guo, C., & Lan, H. (2013). Preliminary exploration of the mental health education competency survey of primary and middle school head teachers. Journal of Education and Training Studies, 2(1), 73-80.
Mace, C. (2007). Mindfulness and mental health: Therapy, theory and science. Routledge.
Martin, D. K. (2012). Measuring the impact of a residential learning community on the mental health and well-being of art students in higher education [Unpublished doctoral dissertation]. Loyola University Chicago.
Maslow, A. H. (1981). Motivation and personality. Harper & Row.
McMillan, J. H. (2015). Fundamentals of educational research. Pearson.
Miller, M. D., Linn, R. L., & Gronlund, N. E. (2009). Measurement and Assessment in Teaching. Pearson Education.
Nagase, M. (2012). Does a Multi-Dimensional Concept of Health Include Spirituality? Analysis of Japan Health Science Council’s Discussionson WHO’s ‘Definition of Health’ (1998). International Journal of Applied Sociology, 2(6), 71-77.
Omoniyi, M. B. I. (2016). Unemployment and underemployment as indices of Nigerian youths' mental health and the place of agricultural revolution as a Panacea: Implications for counselling. Journal of Education and Practice, 7(10), 80-88.
Petrillo, G., Capone, V., Caso, D., & Keyes, C. L. (2015). The Mental Health Continuum–Short Form (MHC–SF) as a measure of well-being in the Italian context. Social Indicators Research, 121(1), 291-312.
Reynolds, C. R., Livingston, R. B., & Willson, V. (2009). Measurement and assessment in education. Merrill.
Reynolds, C. R., Livingston, R. B., & Willson, V.L. (2006). Measurement and Assessment in Education. Pearson Education.
Szaflarski, M., Kudel, I., Cotton, S., Leonard, A. C., Tsevat, J., & Ritchey, P. N. (2012). Multidimensional assessment of spirituality/religion in patients with HIV: conceptual framework and empirical refinement. Journal of Religion and Health, 51(4), 1239-1260.
Tengland, P. A. (2012). Health and morality: two conceptually distinct categories? Health Care Analysis, 20(1), 66-83.
Topkaya, N., Sahin, E., & Meydan, B. (2017). The development, validity, and reliability of the Barriers to Seeking Psychological Help Scale for college students. International Journal of Higher Education, 6(1), 48-62.
Townsend, M. C., & Morgan, K. I. (2017). Psychiatric mental health nursing: Concepts of care in evidence-based practice. FA Davis.
Tran, T. D., Kaligis, F., Wiguna, T., Willenberg, L., Nguyen, H. T. M., Luchters, S., Azzopardi, P., & Fisher, J. (2019). Screening for depressive and anxiety disorders among adolescents in Indonesia: Formal validation of the centre for epidemiologic studies depression scale–revised and the Kessler psychological distress scale. Journal of Affective Disorders, 246, 189-194. https://doi.org/10.1016/j.jad.2018.12.042
Wijayanto, S. H. (2008). Structure equation modelling, konsep and tutorial dengan LISREL 8.80 [Structural equation modeling, concepts and tutorials with LISREL 8.80]. Graha Ilmu.
World Health Organization. (2013). World Health Organization mental health action plan 2013–2020. https://www.who.int/publications/i/item/9789241506021.
Yoon, E., Chang, C. C. T., Clawson, A., Knoll, M., Aydin, F., Barsigian, L., & Hughes, K. (2015). Religiousness, spirituality, and eudaimonic and hedonic well-being. Counselling Psychology Quarterly, 28(2), 132-149. https://doi.org/10.1080/09515070.2014.968528