Brief report

Scientific output on validation and adaptation of depression screening instruments in peruvian population

Julio Cjuno ^1,2, Master of Science in Clinical Research
Andrea Moya ², Psychology student
Eliana Calderón-Pérez ², bachelor's degree in Psychology
Cintia Quispe-Ilizarbe ², Psychology student
Luis Mayon ², Psychology student
José Livia ³, Doctor in Psychology

¹ Universidad Peruana Unión, Escuela de Posgrado, Lima, Peru.
² Universidad Peruana Unión, Escuela de Psicología, Lima, Perú.
³ Universidad Nacional Federico Villarreal, Facultad de Psicología, Lima, Perú.

ABSTRACT

The aim of the research was to describe the scientific output of psychometric studies on screening instruments for depression in the Peruvian population. We carried out a descriptive study of the scientific literature in Scopus, Web of Science, PubMed and SciELO, with descriptors for depression, psychometric properties, and Peru. After the review process, we included 22 studies. We found validations of screening instruments for older adults, adults, adults with depression, adult women, pregnant women, health professionals, university students, high school students and children. The Patient Health Questionnaire (PHQ-9) was the most widely used instrument. Psychometric studies cover most populations; however, native people and clinical populations remain to be studied. The PHQ-9, due to its characteristics, could be implemented in mental health policies in Peru.

Keywords: Depression; Depressive Disorder; Validation; Psychometrics; Peru (Source: MeSH NLM).

INTRODUCTION

The World Health Organization ⁽¹⁾ states that by 2030 depression will be the leading cause of morbidity worldwide. The proportion of the world population with this mental health problem is estimated at 4.4%, and is more common in women than in men ⁽²⁾. In Peru, it has been reported that 15.6% of people treated in hospitals have some level of depression ⁽³⁾. It is recognized as a public health problem ⁽⁴⁾ and has a significant impact on people’s quality of life ⁽⁸⁾. For this reason, health systems should implement or strengthen their professional services to offer psychological treatment and adapted screening instruments.

Screening and prevention tools are useful to accurately identify patients with depressive disorders and initiate treatment ⁽⁵⁾. There are several screening tools for depression ⁽⁶⁾, but they should be selected based on methodological aspects in terms of validity and reliability, considering the advances in measurement theory and its theoretical foundations ⁽⁷⁾. In this context, knowing the aspects of the scientific production of psychometric studies, regarding depression screening instruments in the Peruvian context, is important because it shows the process of calibration of the instruments in different age groups, geographical regions, and cultural contexts; especially in a country with a wide cultural diversity, languages, and native languages such as Peru ⁽⁸⁾. Therefore, this study aimed at describing the scientific output of psychometric studies on depression instruments adapted or validated in the Peruvian context.

THE STUDY

This is a descriptive study. We searched for literature published in in PubMed, Web Of Science, Scopus and SciELO between 1993 and August 2022, either in Spanish or English. The search strategy included terms and descriptors for depression ⁽⁹⁾, psychometric properties and Peruvian population; the system was validated by an expert in bibliometrics for better search precision (Supplementary Material).

The search was conducted by four independent reviewers, the results were organized in Microsoft Excel 2016. We found 200 results in Scopus, 158 in Web Of Science, 132 in PubMed and 47 in SciELO. The titles and abstracts were reviewed, seeking to include studies that aimed to validate or adapt depression assessment instruments in Peruvian populations, either as a primary or secondary objective. Original articles, brief reports, short communications, and letters to the editor were selected. Fifteen studies were eligible from Scopus, 10 from Web Of Science, 8 from SciELO (core collection) and 3 from PubMed. After eliminating duplicate items, 22 studies were selected. Works considered as gray literature (undergraduate and graduate theses and studies published in journals with indexing different from the databases mentioned) were not included (Supplementary material).

Once the list of selected articles was obtained, we carried out the analysis of the complete document and compiled the data. The variables considered were: year of publication, type of article, language, quartile of the journal according to Scimago Journal & Country Rank at the date of data collection, country of the corresponding author, affiliation of the corresponding author, city of the Peruvian corresponding author, profession of the Peruvian corresponding author at the time of data collection according to the registry of degrees and titles of the National Superintendence of University Higher Education (SUNEDU), funding of the study, scientific output for ten-year periods, population in which the instrument was evaluated, language of origin and target language in the translations of the instruments and psychometric properties evaluated.

The statistical analysis was descriptive; frequencies and percentages were estimated because the variables were categorical. We used the SPSS version 26 statistical program. 

Regarding ethical aspects, the principle of scientific integrity was respected, since the study analyzed scientific articles published in peer-reviewed journals.

FINDINGS

When assessing the scientific output on validation or adaptation of instruments that assess depression in the Peruvian population, we found that 12 articles (54.6%) were published in Spanish; 20 (91.0%) were original articles; 9 (40.9%) were published in Q1 journals and 10 (45.0%) in English-speaking journals. Likewise, 15 (68.2%) studies were led by Peruvian researchers, of which 5 (22.8%) were affiliated with the Universidad Peruana Cayetano Heredia; 13 (59.1%) Peruvian correspondent researchers reside in Lima, in which physicians specializing in psychiatry (5) and psychologists ⁽⁵⁾ took the lead, each accounting for 22.7%. In addition, 15 (68.2%) studies came from research projects funded by the researchers; 16 (72.7%) were published between 2013 and 2022, and 17 (77.2%) studies were published in international journals (Table 1).

Table 1. Characteristics of psychometric scientific production on depression in Peru (n=22).

 ^a According to the Scimago Journal & Country Rank 2022

Validations or adaptations were carried out on adults (4 of 22); adults with depression (3 of 22); adult women (4 of 22); pregnant women (4 of 22); health professionals (1 of 22); college students (2 of 22); high school students (1 of 22); and children (1 of 22). In addition, 17 (72.2%) of the validations or adaptations were conducted on nonclinical samples, and most instruments (13 of 22) were translated from English to Spanish (Table 2).

Table 2. Population where the adaptation was carried out and source and target language of translation.

The psychometric studies analyzed reliability (20 of 22); construct validity (20 of 22); sensitivity and specificity (15 of 22) (Table 3). On the other hand, most studies (9 out of 22) adapted the Patient Health Questionnaire (PHQ-9) in university students, health personnel, pregnant women, adults, and older adults (Table 4).

Table 3. Psychometric properties evaluated in the instruments that measure depression in Peru. 

Table 4. Instruments adapted to assess depression in Peru. 

^a There are 23 screening instruments in the Peruvian context because some studies validated two instruments and compared them.

DISCUSSION

In the last ten years (2013 - 2022), most studies adapting or validating screening instruments for depression were found in English-language, quartile 1 journals. The preference for international, English-language, quartile 1 journals may be due to researchers seeking the highest visibility and impact of their work in the scientific community ⁽¹⁰⁾.

International scientific journals may be preferred by researchers because Peruvian scientific journals have not yet reached the first or second quartile ⁽¹¹⁾. However, there has been an increased interest in the adaptation and validation of depression screening tests, possibly driven by the quality policies of Peruvian universities that started hiring researchers as part of the teaching staff ⁽¹²⁾ and licensing process.

Instruments have been validated in populations of older adults, adults, adults with depression, adult women, pregnant women, health professionals, university students, high school students and children, reflecting the diversity of the age groups. A pending task is to adapt or construct instruments in native languages, because our country, due to its cultural and linguistic richness, has more than 50 native languages ⁽¹³⁾, a cultural and linguistic difference that starts from the same theoretical construction of how this population perceives depression; therefore, instruments adapted to this context are needed ⁽⁷⁾. Another reason to encourage the adaptation of instruments to native people is the prevalence of depression in Quechua people, which reaches 38.9% ⁽⁹⁾, and is seven times higher than the worldwide prevalence in adults ⁽¹⁾.

Most studies showed reliability, construct validity, sensitivity/specificity, and content validity analyses. The validity and reliability of the studies show that the appropriate statistical and psychometric processes are being followed for the adaptation and construction of instruments ⁽⁷⁾, since content validity makes it possible to adapt or correct the wording to the cultural-linguistic context and evaluates the relevance of the content related to the theoretical construct ⁽¹⁴⁾. Construct validity analyzes the factors that explain the construct from its internal structure, reliability determines how accurate the scores of the instrument are under certain conditions, while specificity and sensitivity determine the diagnostic capacity with which an instrument will efficiently score among participants who have or do not have the problem being assessed ⁽¹⁴⁾.

Instruments that do not imply biases are necessary due to bio-sociodemographic diversity of the Peruvian population; therefore, the analysis of invariance is important, even if only a few instruments have this characteristic. This procedure verifies whether the instrument could be transversal to the characteristics of the population under study, such as age groups, sex, place of residence, clinical/non-clinical populations, and other similar ones ⁽⁷⁾. Therefore, not all instruments would be suitable for use in different populations or groups.

Most adaptation or validation studies analyzed the PHQ-9, which can be used in university students, health personnel, adults of both sexes, pregnant women in primary health care, and older adults. This preference may be due to its adequate psychometric properties and adaptations to more than 20 languages, being the most widely used screening instrument worldwide and chosen in an international consensus among 15 instruments evaluated for depression screening ⁽¹⁵⁾. In Peru, the PHQ-9 has been culturally adapted by experts, and its validity, reliability and invariance have been analyzed ⁽¹⁶⁾, which determines its eligibility over other instruments.

In this context, Peruvian agencies responsible for mental health care could implement the PHQ-9 in their depression care guidelines in populations where it already has solid psychometric evidence. Especially, because some official documents such as the technical guideline for mental health care of health personnel in the context of COVID-19 of the Ministry of Health, recommends the Self-Reporting Questionnaire (SRQ) ⁽¹⁷⁾ which, to date, has been validated only in women, while the Hamilton Depression Rating Scale (HDRS) ⁽¹⁸⁾ is recommended for screening in primary health care, with no evidence of validation in Peru, and the Abbreviated Yesavage Scale ⁽¹⁹⁾ is implemented in the Technical Health Standard for the Comprehensive Health Care of the Elderly ⁽¹⁹⁾. The latter is not recommended for use because even though it has initial validity of its internal structure, it lacks reliability ⁽²⁰⁾. This is of concern, since the selection of screening instruments should be made considering the best evidence of their psychometric properties.

A limitation of this study is that we did not include publications from journals indexed in other regional databases or from the gray literature. However, by searching Scopus, Web of Science, PubMed and SciELO, we included the largest refereed literature on the validity or construction of tests assessing depression in the Peruvian population.

In conclusion, we found 22 studies including adaptations and validations of instruments that assess depression in the Peruvian population. They have been adapted for university students, health personnel, patients with depression, pregnant women, adults of both sexes, older adults, and children. Instrumental studies in native languages and in clinical populations are still needed. Due to its characteristics, the PHQ-9 could be implemented in policies of care, evaluation, and follow-up of depression in populations where psychometric studies have been carried out.

Author contributions: JC, JL and AM conceptualized the study and designed the methodology LM, ECP, CQI, LM and AM carried out the data collection, analyzed the data, JC, AM, ECP, LM, CQL and JL wrote the initial draft and revised the final version. JC, AM, ECP, LM, CQL, and JL assume responsibility for publication of the article.

Conflicts of interest: the authors declare that they have no conflicts of interest.

Funding: self-funded by the investigators.

Supplementary files: supplementary material.

REFERENCES

1. World Health Organization. Depression. WHO. 2021 [cited 2022, Jul 5]. Available from: https://www.who.int/health-topics/depression.

2. Sandmire D, Gorham S, Rankin N, Grimm D. The Influence of Art Making on Anxiety: A Pilot Study. J Am Art Ther Assoc. 2012;29(2):68–73. doi: 10.1080/07421656.2012.683748.

3. Instituto Nacional de Salud Mental. Estudio Epidemiológico de Salud Mental en Hospitales Regionales – 2015. An Salud Ment. 2018;XXXV(1):100–50. Available from: https://www.insm.gob.pe/investigacion/estudios.html.

4. Navarro-Loli JS, Moscoso M, Calderón-De la Cruz G. La investigación de la depresión en adolescentes en el Perú: una revisión sistemática. Liberabit. 2017;23(1):57–74. doi: 10.24265/liberabit.2017.v23n1.04.

5. MacMillan HL, Patterson CJS, Wathen CN. Screening for depression in primary care: recommendation statement from the Canadian Task Force on Preventive Health Care. CMAJ. 2005;172(1):33–5. doi: 10.1503/cmaj.1030823.

6. Lloyd-Williams M, Shiels C, Dowrick C, Kissane D. Socio-Economic Deprivation and Symptom Burden in UK Hospice Patients with Advanced Cancer—Findings from a Longitudinal Study. Cancers. enero de 2021;13(11):2537. doi: 10.3390/cancers13112537.

7. Muñiz J. La medición de lo psicológico. Psicothema. 1998;10(1):1–21. Available from: https://reunido.uniovi.es/index.php/PST/article/view/7442.

8. Ministerio de Educación. En el Perú hay 47 lenguas originarias que son habladas por cuatro millones de personas. 2017 [cited on 2022 Mar 28]. Available from: http://www.minedu.gob.pe/n/noticia.php?id=42914.

9. Cjuno J, Figueroa-Quiñones J, Marca-Dueñas GG, Esteban RFC. Producción científica sobre depresión en poblaciones quechua hablantes: una revisión narrativa. Ter Psicológica. 2021;163–74. doi: 10.4067/s0718-48082021000200163.

10. Cjuno J, Taype-Rondan A. Latin American psychology journals in Scopus. Medwave. 2016;16(09). doi: 10.5867/medwave.2016.09.6579.

11. Scimago Journal & Country Rank. Journal Rankings. 2022 [cited on 2022 Sep 24]. Available from: https://www.scimagojr.com/journalrank.php.

12. Mamani O, Verastegui-Diaz A, Mejía C, Caycho-Rodríguez T. Scientific publication of psychology thesis advisors from 30 Peruvian universities. Rev Interam Psicol J Psychol. 2020;54(1):e1124. doi: 10.30849/ripijp.v54i1.1124.

13. Ministerio de Cultura del Perú. Lista de pueblos indígenas u originarios. 2021 [cited on 2021 Oct 8]. Available from: https://bdpi.cultura.gob.pe/pueblos-indigenas.

14. Hambleton R, Merenda M, Spielberger C. Adapting Educational and Psychological Tests for Cross-Cultural Assessment [Internet]. Vol. 1. Psychology Press; 2005 [cited on 2021 May 21]. Available from: https://www.routledge.com/Adapting-Educational-and-Psychological-Tests-for-Cross-Cultural-Assessment/Hambleton-Merenda-Spielberger/p/book/9780805861761.

15. El-Den S, Chen TF, Gan YL, Wong E, O’Reilly CL. The psychometric properties of depression screening tools in primary healthcare settings: A systematic review. J Affect Disord. 2018;225(1):503–22. doi: 10.1016/j.jad.2017.08.060.

16. Villarreal-Zegarra D, Copez-Lonzoy A, Bernabé-Ortiz A, Melendez-Torres GJ, Bazo-Alvarez JC. Valid group comparisons can be made with the Patient Health Questionnaire (PHQ-9): A measurement invariance study across groups by demographic characteristics. PLOS ONE. el 9 de septiembre de 2019;14(9):e0221717. doi: 10.1371/journal.pone.0221717.

17. Ministerio de Salud del Perú. Guía técnica para el cuidado de la salud mental del personal de la salud en el contexto del COVID-19. MINSA. 180, R.M. 180-2020-MINSA abr 6, 2020 p. 44. Available from: http://bvs.minsa.gob.pe/local/MINSA/5000.pdf.

18. Ministerio de Salud del Perú. Guía de práctica Clínica en depresión. 2008. Available from: http://bvs.minsa.gob.pe/local/MINSA/1084_DGSP261.pdf.

19. Ministerio de Salud. Norma Técnica de Salud para la atención Integral de Salud de las personas adultas mayores. MINSA; 2010. Available from: http://bvs.minsa.gob.pe/local/MINSA/3132.pdf.

20. Arias W, Muños Del Carpio A, Rivera R. Análisis psicométrico de la Escala de Depresión Geriátrica de Yesavage en adultos mayores de la Macroregión Sur del Perú. Rev Enfermeria Hered. 2019;12(2):11–9. doi: 10.20453/renh.v12i0.3960.

Correspondence: Julio Cjuno, jcjunosuni@gmail.com

Cite as:Cjuno J, Moya A, Calderón-Pérez E, Quispe-Ilizarbe C, Mayon L, Livia J. Scientific output on validation and adaptation of depression screening instruments in peruvian population. Rev Peru Med Exp Salud Publica. 2022;39(3):357-61. doi: https://doi.org/10.17843/rpmesp.2022.393.11197.

Received: 17/04/2022
Approved: 02/09/2022
Online: 30/09/2022