EVIDÊNCIAS DE VALIDADE E PRECISÃO DO TESTE FLUÊNCIA DA BATERIA TSP
Keywords:
Psychometrics; Psychological test; Intelligence; Verbal Fluency; Vocabulary.Abstract
The TSP Battery is an instrument used to assess people in the organizational and work context, consisting of nine objective tests to assess different cognitive skills. Among them, the Fluency test seeks to assess the candidate's simple vocabulary capacity, representing an important aspect of verbal aptitude for different job functions. The objective of this study was to verify the psychometric properties of the Fluency test, for this, 1352 people participated, between 15 and 76 years old, 65,6% female. Accuracy results were satisfactory for Cronbach's alpha (α = 0,79), McDonald's omega (ω = 0,81) and the test and retest with strong Pearson correlation (r = 0.77; p < 0,001). For validity studies, confirmatory factor analysis (CFA) was carried out, which indicated adequate fit indices to the tested unidimensional model (χ2= 2,97; df = 2; p < 0,227; TLI = 0,998; CFI = 0,999; RMSEA = 0,02; SRMR = 0,006). A convergent validity study was carried out using the BPR-5 Verbal Reasoning (RV) test. The correlation result for the 83 subjects submitted to the Fluency test and the RV test was moderate and statistically significant (r = 0,46; p < 0,001). Finally, studies of evidence of criterion validity with sociodemographic variables found results consistent with the literature, that is, there was no important difference in performance depending on gender; there was a significant difference between the extreme age groups, there was a significant difference depending on education, in which the lowest average performances were observed for participants with a lower level of education. The Fluency test indicated adequate evidence of validity and precision and can be used to assess vocabulary fluency in samples similar to that of the present study.
Downloads
References
AMERICAN EDUCATIONAL RESEARCH ASSOCIATION [AERA]; AMERICAN PSYCHOLOGICAL ASSOCIATION [APA]; NATIONAL COUNCIL ON MEASUREMENT IN EDUCATION [NCME]. Standards for educational and psychological testing. Wa-shington, DC: American Educational Research Association, 2014.
ANDRÉS-PUEYO, Antônio. Modelos psicométricos da inteligência. In: Flores-Mendoza, Carmen et al. (Orgs.). Introdução à psicologia das diferenças individuais. Porto Alegre: Artmed, 2006. p. 73-100.
BISHARA, Anthony J.; LI, Jiexiang; CONLEY, Christian. Informal versus formal judgment of statistical models: The case of normality assumptions. Psychonomic Bulletin & Revi-ew, v. 28, p. 1164-1182, 2021. Disponível em: https://doi.org/10.3758/s13423-021-01879-z. Acesso em: 01 jan. 2024.
BROWN, Timothy A. Confirmatory factor analysis for applied research. New York: The Guilford Press, 2006.
CAMPOS, Carolina Rosa; ZAIA, Priscila; PRIMI, Ricardo. Avaliação psicológica da inteli-gência. In: BAPTISTA, Makilim Nunes et al. (Orgs.). Compêndio de Avaliação Psicológi-ca. Petrópolis: Vozes, 2019. p. 349-363.
CHIODI, Marcelo Gulini. Estudo de adaptação e validação da bateria de habilidades cognitivas Woodcock-Johnson-III versão ampliada. Tese (Doutorado em Psicologia) - Pontifícia Universidade Católica de Campinas, Campinas, 2012.
CONSELHO FEDERAL DE PSICOLOGIA. Resolução CFP nº 31/2022. Estabelece diretriz-es para a realização de Avaliação Psicológica no exercício profissional da psicóloga e do psicólogo, regulamenta o Sistema de Avaliação de Testes Psicológicos – SATEPSI e revoga a Resolução CFP nº 09/2018. Brasília, 2022. Disponível em: https://atosoficiais.com.br/cfp/resolucao-do-exercicio-profissional-n-31-2022-estabelece-diretrizes-para-a-realizacao-de-avaliacao-psicologica-no-exercicio-profissional-da-psicologa-e-do-psicologo-regulamenta-o-sistema-de-avaliacao-de-testes-psicologicos-satepsi-e-revoga-a-resolucao-cfp-no-09-2018?origin=instituicao. Acesso em: 01 dez. 2023.
DANCEY, Christine P.; REIDY, John. Estatística sem matemática para psicologia. Tradu-ação de Lori Viali. 7. ed. Porto Alegre: Penso, 2019.
GADERMANN, Anne M.; GUHN, Martin; ZUMBO, Bruno D. Estimating ordinal reliability for Likert-type and ordinal item response data: A conceptual, empirical, and practical guide. Practical Assessment, Research & Evaluation, v. 17, n. 3, p.1-13, 2012. Disponível em: https://openpublishing.library.umass.edu/pare/article/id/1351/. Acesso em: 01 dez. 2023.
HAIR, Joseph F. et al. Análise multivariada de dados. Tradução de Adonai Schlup Sant’Anna. 6. ed. Porto Alegre: Bookman, 2009.
HAUCK-FILHO, Nelson; VALENTINI, Felipe. Coeficientes de fidedignidade e violações dos pressupostos essencialmente tau-equivalentes. Avaliação psicológica, Campinas, v. 19, n. 3, p. a-b, set. 2020. Disponível em: http://dx.doi.org/10.15689/ap.2020.1903.ed. Aces-so em: 14 dez. 2023.
HAYES, Andrew F.; COUTTS, Jacob J. Use Omega Rather than Cronbach's Alpha for Esti-mating Reliability. But. Communication Methods and Measures, v. 14, n.1, p. 1-24, 2020. Disponível em: https://doi.org/10.1080/19312458.2020.1718629. Acesso em: 14 dez. 2023.
HENDERSON, Ralph A. Testing experimental data for univariate normality. Clinica Chim-ica Acta, v. 366, n. 1-2, p. 112-129, abr. 2006. Disponível em: https://www.sciencedirect.com/science/article/abs/pii/S0009898105006790?via%3Dihub. Acesso em: 12 jan. 2024.
HU, Li-tze; BENTLER, Peter M. Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, v. 3, n. 4, p. 424-453, 1998. Disponível em: https://sci-hub.se/10.1037/1082-989X.3.4.424. Acesso em: 8 fev. 2024.
HUNTER, John E.; SCHMIDT, Frank L. Intelligence and job performance: Economic and social implications. Psychology, Public Policy, and Law, v. 2, n. 3-4, p. 447-472, 1996. Disponível em: https://doi.org/10.1037/1076-8971.2.3-4.447. Acesso em: 8 fev. 2024.
HUNTER, John E.; SCHMIDT, Frank L.; JUDIESCH, Michael K. Individual differences in output variability as a function of job complexity. Journal of Applied Psychology, v. 75, n. 1, p. 28-42, 1990. Disponível em: gwern.net/doc/iq/ses/1990-hunter.pdf. Acesso em: 8 fev. 2024.
JÚNIOR, Renê Marcelino da Silva; NASCIMENTO, Alexsandro Medeiros; ROAZZI, Anto-nio. Bateria de Provas de Raciocínio (BPR-5): Avaliação das qualidades psicométricas em adolescentes do Nordeste. Amazônica - Revista de Psicopedagogia, Psicologia Escolar e Educação, v. 23, n.1, p. 264-288, jan-jun. 2019. Disponível em: https://periodicos.ufam.edu.br/index.php/amazonica/article/view/5174. Acesso em: 8 dez. 2023.
KALKBRENNER, Michael T. A Practical Guide to Instrument Development and Score Va-lidation in the Social Sciences: The MEASURE Approach. Practical Assessment, Rese-arch, and Evaluation, v. 26, n. 1, p. 1-18, 2021. Disponível em: https://doi.org/10.7275/svg4-e671. Acesso em: 20 dez. 2023.
KELL, Harrison J.; LANG, Jonas W. B. Specific Abilities in the Workplace: More Important Than g? Journal of Intelligence, v. 5, n. 2, p.13, 2017. Disponível em: https://www.mdpi.com/2079-3200/5/2/13. Acesso em: 20 fev. 2024.
LAROS, Jacob Arie; JESUS, Girlene Ribeiro de; KARINO, Camila Akemi. Validação brasi-leira do teste não-verbal de inteligência SON-R 2½-7[a]. Avaliação psicológica, Itatiba, v. 12, n. 2, p. 233-242, ago. 2013. Disponível em: http://pepsic.bvsalud.org/scielo.php?script=sci_arttext&pid=S1677-04712013000200014. Acesso em: 10 fev. 2024.
LARSON, Elliott. C. A Meta-Analysis of Information Processing Measures of Intelligence, Performance, and Group Score Differences. CUNY Academic Works, 2019. Disponível em: https://academicworks.cuny.edu/gc_etds/3040/. Acesso em: 10 fev. 2024.
MARSH, Herbert W.; HAU, Kit-Tai; WEN, Zhonglin. In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in over-generalizing Hu and Bentler’s (1999) findings. Structural Equation Modeling: A Multidis-ciplinary Journal, v. 11, n. 3, p. 320-341, 2004. Disponível em: https://doi.org/10.1207/s15328007sem1103_2. Acesso em: 02 jan. 2024.
McGREW, Kevin S. The Cattell-Horn-Carroll theory of cognitive abilities: past, presente, and future. In: FLANAGAN, Dawn P.; HARRISON, Patti L. (Orgs.), Contemporary intel-lectual assessment: Theories, tests and issues. 2. ed. New York: Guilford Press, 2005. p. 136-181.
McNEISH, Daniel. Thanks coefficient alpha, we’ll take it from here. Psychological Me-thods, v. 23, n. 3, p. 412–433, 2018. Disponível em: https://doi.org/10.1037/met0000144. Acesso em: 12 dez. 2023.
MIOT, Hélio Amante. Avaliação da normalidade dos dados em estudos clínicos e experi-mentais. Jornal Vascular Brasileiro, v. 16, n.2, p. 88-91, abr-jun. 2017. Disponível em: https://www.scielo.br/j/jvb/a/FPW5hwZ6DTH4gvj5mJYpt6B/. Acesso em: 10 jan. 2024.
MORIN, Alexandre J. S.; ARENS, A. Katrin; MARSH, Herbert W. A Bifactor Exploratory Structural Equation Modeling Framework for the Identification of Distinct Sources of Con-struct-Relevant Psychometric Multidimensionality. Structural Equation Modeling: A Multidisciplinary, v. 23, n. 1, p. 116-139, 2016. Disponível em: https://doi.org/10.1080/10705511.2014.961800. Acesso em: 20 dez. 2023.
MUÑIZ, José; FONSECA-PEDRERO, Edudardo. Diez pasos para la construcción de un test. Psicothema, v. 31, n. 1, p. 7-16, 2019. Disponível em: doi: 10.7334/psicothema2018.291. Acesso em: 20 dez. 2023.
MUTHÉN, Linda K.; MUTHÉN, Bengt O. Mplus user’s guide. 7. ed. Los Angeles: Muthén & Muthén, 2012. Disponível em: https://www.statmodel.com/download/usersguide/Mplus%20user%20guide%20Ver_7_r3_web.pdf. Acesso em: 20 dez. 2023.
NASCIMENTO, Elizabeth do; FLORES-MENDOZA, Carmen E. Manual da Bateria TSP (revisão e reavaliação). São Paulo: Edites, 2006.
PILATI, Rornaldo; LAROS, Jacob Arie. Modelos de Equações Estruturais em Psicologia: conceitos e aplicações. Psicologia: Teoria e Pesquisa, v. 23, n.2, p. 205-216, jun. 2007. Dis-ponível em: https://www.scielo.br/j/ptp/a/7dtRLCKQVY5fhtpCFBYPXHB/. Acesso em: 15 jan. 2024.
PRIMI, Ricardo; ALMEIDA, Leandro S. Estudo de validação da bateria de provas de racio-cínio (BPR-5). Psicologia: Teoria e Pesquisa, v. 16, n. 2, p. 165-173, ago. 2000. Disponível em: https://www.scielo.br/j/ptp/a/6rvvQsNBT9ZmgqQz7SyJ5TL/?lang=pt. Acesso em: 10 dez. 2023.
PRIMI, Ricardo; ALMEIDA, Leandro S. BPR-5 – Bateria de Provas de Raciocínio: Estu-dos de Revisão das Normas. Pearson Clinical Brasil, 2018.
PRIMI, Ricardo; CORREIA, Tatiane Alves; ALMEIDA, Leandro S. Bateria de Provas de Raciocínio (BPR-5). In: HUTZ, Claudio Simon; BANDEIRA, Denise Ruschel; TRENTINI, Clarissa Marceli (Orgs.). Avaliação psicológica da inteligência e da personalidade. Porto Alegre: Artmed, 2018. p. 109-122.
PRIMI, Ricardo; NAKANO, Tatiana de Cássia; WECHSLER, Solange Muglia. Cross-battery factor analysis of the Battery of Reasoning Abilities (BPR-5) and Woodcock-Johnson Tests of Cognitive Ability (WJ-III): Bateria de Habilidades de Raciocínio (BPR-5) e Bateria de Habilidades Cognitivas Woodcock-Johnson III. Temas em Psicologia, Ribeirão Preto, v. 20, n.1, p. 121-132, jun. 2012. Disponível em: http://pepsic.bvsalud.org/scielo.php?script=sci_arttext&pid=S1413-389X2012000100010&lng=pt&nrm=iso. Acesso em: 10 dez. 2023.
ROBBINS, P. Stephen; JUDGE, Timothy A.; SOBRAL, Filipe. Comportamento Organiza-cional: teoria e prática no contexto brasileiro. Tradução Rita de Cássia Gomes. 14. ed. São Paulo: Pearson Prentice Hall, 2010.
SASS, Daniel. A.; SCHMITT, Thomas A. A Comparative Investigation of Rotation Criteria Within Exploratory Factor Analysis. Multivariate Behavioral Research, v. 45, n. 1, p. 73-103, feb. 2010. Disponível em: https://doi.org/10.1080/00273170903504810. Acesso em: 20 dez. 2023.
SCHNEIDER, W. Joel; McGREW, Kevin S. The Cattell-Horn-Carroll model of intelligence. In: FLANAGAN, Dawn P.; HARRISON, Patti L. Contemporary intellectual assessment: Theories, tests, and issues. 3. ed. New York: The Guilford Press, 2012. p. 99–144.
SCHNEIDER, W. Joel; McGREW, Kevin S. The Cattell-Horn-Carroll Theory of Cognitive Abilities. In: FLANAGAN, Dawn P.; McDONOUGH, Erin M. Contemporary intellectual assessment: Theories, tests, and issues. 4. ed. New York: The Guilford Press, 2018. p. 73-163.
TABACHNICK, Barbara G.; FIDELL, Linda S. Using multivaria te statistics. 7. ed. Boston: Pearson, 2019. Disponível em: https://www.pearsonhighered.com/assets/preface/0/1/3/4/0134790545.pdf. Acessom em: 20 jan. 2024.
TABER, Keith S. The use of Cronbach’s alpha when developing and reporting research ins-truments in science education. Research in Science Education, v. 48, n. 6, p. 1273-1296, 2018. Disponível em: https://doi.org/10.1007/s11165-016-9602-2. Acesso em: 20 dez. 2023.
THE JAMOVI PROJECT (2022). Jamovi. (Version 2.3) [Computer Software]. Disponível em: https://www.jamovi.org. Acesso em: 20 dez. 2023
VETTER, Thomas R. Fundamentals of Research Data and Variables: The Devil Is in the De-tails. Anesthesia & analgesia, v. 125, n. 4, p. 1375-1380, oct. 2017. Disponível em: https://journals.lww.com/anesthesia-analge-sia/Fulltext/2017/10000/Fundamentals_of_Research_Data_and_Variables__The.45.aspx. Acesso em: 20 jan. 2024.
Downloads
Published
How to Cite
Issue
Section
License
The authors retain the copyright and grant the journal the right to initial publication, with the work simultaneously licensed under the Creative Commons License CC BY 4.0, and for publication rights. Authors can publish their work online in institutional / disciplinary repositories or on their own websites.