Diseño y validación del Test Situacional Desarrollo de Competencias Socioemocionales de Jóvenes (DCSE-J)

  1. Rodríguez-Pérez, Sara 1
  2. Sala-Roca, Josefina 2
  3. Doval, Eduardo 2
  4. Urrea-Monclús, Aida 3
  1. 1 Universidad de Oviedo
    info

    Universidad de Oviedo

    Oviedo, España

    ROR https://ror.org/006gksa02

  2. 2 Universitat Autònoma de Barcelona
    info

    Universitat Autònoma de Barcelona

    Barcelona, España

    ROR https://ror.org/052g8jq94

  3. 3 Universitat de Lleida
    info

    Universitat de Lleida

    Lleida, España

    ROR https://ror.org/050c3cw24

Show affiliations +
Journal:
Relieve: Revista ELectrónica de Investigación y EValuación Educativa

ISSN: 1134-4032

Year of publication: 2021

Volume: 27

Issue: 2

Type: Article

DOI: 10.30827/RELIEVE.V27I2.22431 DIALNET GOOGLE SCHOLAR lock_openOpen access editor

More publications in: Relieve: Revista ELectrónica de Investigación y EValuación Educativa

Sustainable development goals

Abstract

This article presents the design and validation of the situational judgment test of socioemotional competence development in young people (SCD-Y), a copyleft psychoeducational instrument for use with young people aged 12 to 18 years. The test presents five scenarios from everyday life which represent different problematic situations. Interviews were held with 117 young people in order to elaborate the different response options. Seven experts assigned response options to dimensions which had been initially proposed at an earlier stage. In addition, 11 experts assigned discrete scores to each response option. Exploratory factor analysis was carried out on data from 1,227 students attending 12 schools. Test-retest reliability was examined using data from 123 students. Convergent validity was tested using a sample of 215 students who also completed the TMMS-24 and STEM_Y tests. The SCD-Y is a promising psychoeducational evaluation instrument. Notably, it was generally accepted and positive evaluated by teachers, with validity and reliability outcomes also being acceptable up to the present date.

€ View funding

Funding information

The present study was supported by a grant from the Ministry of Economy and Competitiveness (Spain) and co-funded by FEDER funds (EDU2016-77284-R). We would like to thanks the secondary schools and students for their participation in the study.

Funders

Bibliographic References

  • Allen, V., Rahman, N., Weissman, A., MacCann, C., Lewis, C. y Roberts, R. D. (2015). The Situational Test of Emotional Management – Brief (STEM-B): Development and validation using item responsive theory and latent class analysis. Personality and Individual Differences, 81, 195–200. https://doi.org/10.1016/j.paid.2015.01.053
  • Allen, V. D., Weissman, A., Hellwig, S., MacCann, C. y Roberts, R. D. (2014). Development of the situational test of emotional understanding – Brief (STEU-B) using item response theory. Personality and Individual Differences, 65, 3–7. https://doi.org/10.1016/j.paid.2014.01.051
  • Bar-On, R. y Parker, J. (2000). EQ-I: YV. Bar-On Emotional Quotient inventory: Youth version. Technical manual. Multi Health Systems, Inc. https://doi.org/10.1037/t14077-000
  • Bisquerra, R. y Pérez-Escoda, N. (2015). ¿Pueden las escalas Likert aumentar en sensibilidad? REIRE, Revista d’Innovació i Recerca en Educació, 8(2), 129-147. https://doi.org/10.1344/reire2015.8.2.82
  • Blakemore, S. J., & Mills, K. L. (2014). Is adolescence a sensitive period for sociocultural processing? Annual review of psychology, 65, 187-207. https://doi.org/10.1146/annurev-psych-010213-115202
  • Boyatzis, R. E., Gaskin, J., & Wei, H. (2015). Emotional and social intelligence and behavior. In Handbook of intelligence (pp. 243-262). Springer. https://doi.org/10.1007/978-1-4939-1562-0_17
  • Cohen J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20, 37-46. https://doi.org/10.1177/001316446002000104
  • Ciarrochi, J., Forgas, J.P. & Mayer, J.D. (2006). Emotional Intelligence in everyday life. Psychology Press/Taylor and Francis.
  • Darwin, Ch. (1872). The Expression of Emotion in Man and Animals. Appleton Century Crofts. https://doi.org/10.1037/10001-000
  • Extremera, N. (2003). El modelo de inteligencia emocional de Mayer y Salovey y su validez predictiva en muestras españolas. Málaga. https://doi.org/10.21840/siic/159626
  • Everwijn, S. E. M., Bomers, G. B. J., & Knubben, J. A. (1993). Ability-or competence-based education: bridging the gap between knowledge acquisition and ability to apply. Higher education, 25(4), 425-438. https://doi.org/10.1007/bf01383845
  • Fariselli, L., Ghini, M., & Freedman, J. (2008). Age and emotional intelligence. Six Seconds: The Emotional Intelligence Network, 1-10.
  • Rui-Berrocal, P., Cabello, R., Castillo, R., & Extremera, N. (2012). Gender differences in emotional intelligence: The mediating effect of age. Behavioral Psychology, 20(1), 77-89.
  • Fernández-Berrocal, P., & Extremera, N. (2006). Emotional intelligence: A theoretical and empirical review of its first 15 years of history. Psicothema, 18, 7-12.
  • Fernández-Berrocal, P., Extremera, N. Y Ramos, N. (2004). Validity and reliability of the Spanish modified version of the Trait Meta-Mood Scale. Psychological Reports, 94, 751-755. https://doi.org/10.2466/pr0.94.3.751-755
  • Ferrando, P. J., & Anguiano-Carrasco, C. (2010). El análisis factorial como técnica de investigación en psicología [Factor analysis as a technique in psychological research]. Papeles del Psicólogo, 31(1), 18–33.
  • Ferrando, P. J., & Lorenzo-Seva, U. (2000). Unrestricted versus restricted factor analysis of multidimensional test items: Some aspects of the problem and some suggestions. Psicológica, 21(3), 301–323.
  • Frías-Navarro, D., & Pascual Soler, M. (2012). Exploratory factor Analysis (EFA) in consumer behavior and marketing research. Suma Psicológica, 19(1), 47-58.
  • Grusec, J. E. (2011). Socialization processes in the family: Social and emotional development. Annual review of psychology, 62, 243-269. https://doi.org/10.1146/annurev.psych.121208.131650
  • Hernández, M. M., Eisenberg, N., Valiente, C., VanSchyndel, S. K., Spinrad, T. L., Silva, K. M., ... & Southworth, J. (2016). Emotional expression in school context, social relationships, and academic adjustment in kindergarten. Emotion, 16(4), 553. https://doi.org/.1037/emo0000147
  • Kar, N., & Kar, B. (2017). Social cognition and individual effectiveness in interpersonal scenarios: A conceptual review. Journal of Mental Health and Human Behavior, 22, 27-34. https://doi.org/10.4103/0971-8990.210705
  • Kvavilashvili, L. & Ellis, J. (2004). Ecological validity and the real-life/laboratory controversy in memory research: A critical and historical review. History & Philosophy of Psychology, 6, 59–80.
  • Laghi, F., Lonigro, A., Pallini, S., & Baiocco, R. (2018). Emotion regulation and empathy: Which relation with social conduct? The Journal of genetic psychology, 179(2), 62-70. https://doi.org/10.1080/00221325.2018.1424705
  • Lewis, M.; Sullivan, M.W.; Stanger, C. & Weiss, M. (1989): Self-development and self-conscious emotions. Child Development, 60, 146-156. https://doi.org/10.2307/1131080
  • Lievens, F. R. O., & Chan, D. (2017). Practical Intelligence, Emotional Intelligence, and Social Intelligence. In Handbook of Employee Selection (pp. 342-364). New York: Routledge. https://doi.org/10.4324/9781315690193-15
  • Lievens, F., Peeters, H., & Schollaert, E. (2008). Situational judgment tests: A review of recent research. Personnel Review, 37(4), 426-441. https://doi.org/10.1108/00483480810877598
  • Lorenzo-Seva, U. y Ferrando, P. (2007). FACTOR: A computer program to fit the exploratory factor analysis model. University Rovira y Virgili. https://doi.org/10.3758/BF03192753
  • Lorenzo-Seva, U. y Ferrando, P. (2011). Manual of the program FACTOR v. 8.02. https://psico.fcep.urv.cat/utilitats/factor/documentation/Manual_de_Factor_Esp.pdf
  • MacCann, C. y Roberts, R. D. (2008). New paradigms for assesing emotional intelligence: theory and data. Emotion, 8(4), 540–551. https://doi.org/10.1037/a0012746
  • MacCann, C., Wang, L., Matthews, G. y Roberts, R. (2010). Emotional intelligence and the eye of the beholeder: comparing self- and parent-rated situational judgments in adolescents. Journal of Research in Personality, 44, 673–676. https://doi.org/10.1016/j.jrp.2010.08.009
  • Matthews, G., Zeidner, M., & Roberts, R. D. (2017). Emotional intelligence, health, and stress. The handbook of stress and health: A guide to research and practice, 312. https://doi.org/10.1002/9781118993811.ch18
  • Mayer, J. D., Salovey, P. y Caruso, D. R. (2002a). Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT): item booklet. Multi-Health Systems. https://doi.org/10.1037/t05047-000
  • Mayer, J. D., Salovey, P. y Caruso, D. R. (2002b). The Mayer-Salovey-Caruso Emotion lntelligence Test SCE T User’s manual. Multi-Health Systems.
  • Monnier, M. (2015). Difficulties in defining social-emotional intelligence, competences and skills-a theoretical analysis and structural suggestion. International journal for research in vocational education and training, 2(1), 59-84. https://doi.org/10.13152/IJRVET.2.1.4
  • O'Connor, P. J., Hill, A., Kaya, M., & Martin, B. (2019). The Measurement of Emotional Intelligence: A Critical Review of the Literature and Recommendations for Researchers and Practitioners. Frontiers in Psychology, 10, 1116. https://doi.org/10.3389/fpsyg.2019.01116
  • Rodrigo, D. (2017). Evaluación de la inteligencia emocional capacidad en adolescentes españoles: adaptación y validación del Situational Test of Emotion Management (STEM). (Tesis doctoral) Universidad Nacional de Educación a Distancia (UNED), España. https://doi.org/10.21134/rpcna.2018.05.2.6
  • Rodríguez-Ruiz, D. (2017). Evaluación de la inteligencia emocional capacidad en adolescentes españoles: adaptación y validación del Situational Test of Emotion Management (STEM) [Tesis de doctorado, Universidad Nacional de Educación a Distancia (España)] http://e-spacio.uned.es/fez/view/tesisuned:Educacion-Drodrigo
  • Rothbart, M. K., Ahadi, S. A., & Evans, D. E. (2000). Temperament and personality: origins and outcomes. Journal of personality and social psychology, 78(1), 122. https://doi.org/10.1037/0022-3514.78.1.122
  • Saarni, C. (1997): Emotional Competence and Self-Regulation in Childhood, 35-64. In Salovey, P. & Sluyter, D. (eds.). Emotional Development and Emotional Inteligance. Educational Implication. BasicBooks.
  • Saarni, C. (2000). Emotional competence: A developmental perspective. In R. Bar-On & J. D. A. Parker (Eds.), The handbook of emotional intelligence: Theory, development, assessment, and application at home, school, and in the workplace (pp. 68-91). Jossey-Bass.
  • Saarni, C. (2008). The interface of emotional development with social context. In M. Lewis, J. Haviland-Jones, & L. Feldman Barrett (Eds.), The handbook of emotions (3rd ed., pp. 332–347). Guilford Press.
  • Sala-Roca, J., Filella, G., Oriol, X., Ros, A., Secanilla, E., Rodríguez, M., Soldevila, A. (2016). Test Situacional de Desarrollo de Competencias Socioemocionales (DCSE-J). Versión revisada por Josefina Sala, Anna Soldevila, Sara Rodríguez Pérez, Aida Urrea-Monclús y Nair Zárate en 2020. Universitat Autònoma de Barcelona. https://ddd.uab.cat/record/212951
  • Salovey, P., Mayer, J.D., Goldman, S.L., Turvey, C. y Palfai, T.P. (1995). Emotional attention, clarity and repair: exploring emotional intelligence using the trait meta-mood scale. En J. Pennebaker (ed.): Emotion, disclousure and health. Washington, D.C.: American Psychological Association. https://doi.org/10.1037/10182-006
  • Sánchez-Nunez, M., Fernández-Berrocal, P., Montañés, J., & Latorre, J. M. (2008). Does emotional intelligence depend on gender? The socialization of emotional competencies in men and women and its implications.
  • Sánchez-Teruel, D. y Robles-Bello, M.A. (2018). Instrumentos de evaluación en inteligencia emocional: una revisión sistemática cuantitativa. Perspectiva educacional. Formación de profesores, 57(2), 27-50. https://doi.org/10.4151/07189729-Vol.57-Iss.2-Art.712
  • Sharma, S.; Gangopadhyay, M.; Austin, E. y Manas, K.M. (2013). Development and Validation of a Situational Judgment Test of Emotional Intelligence. International Journal of Selection and Assessment, 21(1), 57-73. https://doi.org/10.1111/ijsa.12017
  • Sheppes, G., Suri, G., & Gross, J. J. (2015). Emotion regulation and psychopathology. Annual review of clinical psychology, 11, 379-405. https://doi.org/10.1146/annurev-clinpsy-032814-112739
  • Sorrel, M. A., Olea, J., Abad, F. J., de la Torre, J., Aguado, D., & Lievens, F. (2016). Validity and Reliability of Situational Judgement Test Scores A New Approach Based on Cognitive Diagnosis Models. Organizational Research Methods, 19(3), 506-532. https://doi.org/10.1177/1094428116630065
  • Steinberg, L. (2005). Cognitive and affective development in adolescence. Trends in cognitive sciences, 9(2), 69-74. https://doi.org/10.1016/j.tics.2004.12.005
Data source: Dialnet