Game-based Assessment: The Development of Logical Reasoning Test
(1) PT. Global Talentlytica Indonesia
(2) PT. Global Talentlytica Indonesia
(3) PT. Global Talentlytica Indonesia
(*) Corresponding Author
Abstract
This study aims to test the validity of a game-based logical reasoning test tool called the Library Game. This tool consists of eight stimuli, each representing interrelated scenarios that follow a specific pattern to address problems. Data analysis results show that the eight stimuli in the Library Game are unidimensionally valid in measuring logical reasoning constructs (n=284, chi-square=30.742, df=21, p-value=0.078, RMSEA=0.040, CFI=0.996, TLI=0.995). Furthermore, the researchers calibrated the items using Item Response Theory (IRT) 1 PL (parameter logistic). The results show that all items fit the established model. The level of item difficulty ranges from easy to moderate (-0.962 to 0.122). Therefore, this test can provide optimal information when administered to a population with an average level of logical reasoning. In conclusion, instead of conventional methods (question-answer format), valid assessment tools can be developed through innovative games.
Keywords
Full Text:
PDFReferences
Green, A. L., Hill, A. Y., Friday, E., & Friday, S. S. (2005). The use of multiple intelligences to enhance team productivity. Management Decision, 43(3), 349–359. doi:10.1108/00251740510589742
Klauer, K., & Phye, G. (2008). Inductive reasoning: a training approach. Review of Educational Research, 78(1), 85–123.
Landers, R., Armstrong, M., Collmus, A., Mujcic, S., & Blaik, J. (2021). Theory-driven Game-based Assessment of General Cognitive Ability: Design Theory, Measurement, Prediction of Performance, and Test Fairness. Journal of Applied Psychology, 107. doi:10.1037/apl0000954
Molnar, A., & Estrada, J. G. (2018). A Comparative Study of In-Game and Out-Game Assessment for Storyline-Based Games. 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT), (pp. 138-142).
Niebaum, J. C., & Bunge, S. A. (2014). Your Brain is Like a Muscle: Use it and Make it Strong. Frontiers for Young Minds, 1-6. doi:10.3389/frym.2014.00005
Nunes, T. (2012). Logical Reasoning and Learning. Encyclopedia of the Sciences of Learning, 2066–2069. doi:10.1007/978-1-4419-1428-6_790
Nye, C. D., Ma, J., & Wee, S. (2022). Cognitive Ability and Job Performance: Meta-analytic Evidence for the Validity of Narrow Cognitive Abilities. Journal of Business and Psychology, 37, 1119-1139. doi:10.1007/s10869-022-09796-1
OECD. (2014). PISA 2012 Results: Creative Problem Solving: Students’ Skills in Tackling Real-Life Problems. PISA, OECD Publishing. doi:10.1787/9789264208070-en
Salgado, J., & Anderson, N. (2002). Cognitive and GMA Testing in the European Community: Issues and Evidence. Human Performance, 15(1-2), 75-96. doi:10.1080/08959285.2002.9668084
Schmidt, F. L., & Hunter, J. (2004). General Mental Ability in the World of Work: Occupational Attainment and Job Performance. Journal of Personality and Social Psychology, 86(1), 162-173. doi:10.1037/0022-3514.86.1.162
Schmitt, N. (2014). Personality and Cognitive Ability as Predictors of Effective Performance at Work. The Annual Review of Organizational Psychology and Organizational Behavior, 1, 45-65. doi:10.1146/annurev-orgpsych-031413-091255
Schneider, W. J., & McGrew, K. S. (2018). The Cattell–Horn–Carroll theory of cognitive abilities. In D. P. Flanagan, & E. M. McDonough, Contemporary intellectual assessment: Theories, tests, and issues (pp. 73-163). The Guilford Press.
Tobin, K. G., & Capie, W. (1981). The Development and Validation of a Group Test of Logical Thinking. Educational and Psychological Measurement, 41(2), 413-423. doi:10.1177/001316448104100220
DOI: https://doi.org/10.24071/suksma.v5i1.7650
Refbacks
- There are currently no refbacks.