Email this article 
THE IMPACT OF COMPUTERIZED EXAM FEATURES, EFFECTIVE EXAM IMPLEMENTATION, TOWARD STUDENT SATISFACTION
(1) STMIK Swadharma, Indonesia
(2) STMIK Swadharma, Indonesia
(3) STMIK Swadharma, Indonesia
(*) Corresponding Author
Abstract
This paper intends to examine in detail the relationship between computerized exam features and effective exam implementation toward student satisfaction. The main goal is to examine the synergistic relationships which impacting student satisfaction after they using a computerized standardization exam in the college setting. Design/methodology/approach –an initial exploratory analysis was conducted methodically to confirm the proposed model through a structural equation modeling approach. The computerized exam features (especially, clear wording instruction and exam rulebook) had high effects on student satisfaction. Secondly, Effective Exam implementation (especially, efficient effort, time and cost) also impacted student satisfaction. Thirdly, the statistical testing result confirmed a joint impact of computerized exam features and effective exam implementation toward student satisfaction. The conceptual model has been validated to understand the role of both variables toward student satisfaction. However, there is lack of empirical validation and generalization of the model into wider scope due to limited time of research and a small number of the participant which suggest future research.
Keywords
Full Text:
PDFReferences
AlAzawei, A., Parslow, P., & Lundqvist, K. (2016). Barriers and opportunities of elearning implementation in Iraq: A case of public universities. The International Review of Research in Open and Distributed Learning, 17(5).
Annamdevula, S., & Bellamkonda, R. S. (2016). Effect of student perceived service quality on student satisfaction, loyalty, and motivation in Indian universities: Development of HiEduQual. Journal of Modelling in Management, 11(2), 488517.
Apugliese, A., & Lewis, S. E. (2017). Impact of instructional decisions on the effectiveness of cooperative learning in chemistry through metaanalysis. Chemistry Education Research and Practice, 18(1), 271278.
Balta, N., PereraRodríguez, V. H., & HervásGómez, C. (2018). Using socrative as an online homework platform to increase students' exam scores. Education and Information Technologies, 23(2), 837850.
Bano, M., & Zowghi, D. (2015). A systematic review of the relationship between user involvement and system success. Information and Software Technology, 58, 148169.
Bjorklund, D. F., & Causey, K. B. (2017). Children's thinking: Cognitive development and individual differences. Thousand Oaks: Sage Publications.
Bol, L., Campbell, K. D., Perez, T., & Yen, C. J. (2016). The effects of selfregulated learning training on community college students' metacognition and achievement in developmental math courses. Community College Journal of Research and Practice, 40(6), 480495.
Bottiani, J. H., Bradshaw, C. P., & Mendelson, T. (2017). A multilevel examination of racial disparities in high school discipline: Black and white adolescents' perceived equity, school belonging, and adjustment problems. Journal of Educational Psychology, 109(4), 532.
Brock, A., & Hundley, H. (2016). The growth mindset coach: A teacher's month by month handbook for empowering students to achieve. Berkeley, CA: Ulysses Press.
Calderón, A., Meroño, L., & MacPhail, A. (2019). A student centered digital technology approach: The relationship between intrinsic motivation, learning climate, and academic achievement of physical education preservice teachers. European Physical Education Review, 1356336X19850852.
Cameron, K. (2015). Organizational effectiveness. Wiley Encyclopedia of Management, 14.
Card, S. K. (2018). The psychology of human computer interaction. Boca Raton: CRC Press.
Connolly, G. J. (2017). Applying social cognitive theory in coaching athletes: The power of positive role models. Strategies, 30(3), 2329.
Czerkawski, B. C., & Lyman, E. W. (2016). An instructional design framework for fostering student engagement in online learning environments. TechTrends, 60(6), 532539.
Darling Hammond, L. (2015). The flat world and education: How America's commitment to equity will determine our future. New York: Teachers College Press.
De Boer, H., Jongbloed, B., Benneworth, P., Cremonini, L., Kolster, R., Kottmann, A., ... & Vossensteyn, H. (2015). Performance-based funding and performance agreements in fourteen higher education systems. Enschede: Center for Higher Education Policy Studies.
De Marco, A. P., & Broshek, D. K. (2016). Computerized cognitive testing in the management of youth sportsrelated concussion. Journal of child neurology, 31(1), 6875.
Debuse, J. C., & Lawley, M. (2016). Benefits and drawbacks of computer‐based assessment and feedback systems: Student and educator perspectives. British Journal of Educational Technology, 47(2), 294301.
Dennis, A., Wixom, B. H., & Roth, R. M. (2018). Systems analysis and design. Hoboken: John Wiley & sons.
Devi, B., Khandelwal, B., & Das, M. (2017). Application of Bandura's social cognitive theory in the technology enhanced, blended learning environment. International Journal of Applied Research, 3(1), 721724.
Flynn, A. B., & Featherstone, R. B. (2017). Language of mechanisms: Exam analysis reveals students' strengths, strategies, and errors when using the electronpushing formalism (curved arrows) in new reactions. Chemistry Education Research and Practice, 18(1), 6477.
Grange, T. D. A. G., de Jorge, B., Franci, D., Santos, T. M., Setubal, M. S. V., Schweller, M., & de CarvalhoFilho, M. A. (2016). Cognitive load and self-determination theories applied to e learning: Impact on students' participation and academic performance. Plus One, 11(3), e0152462.
Halpern, M., Zhu, Y., & Reddi, V. J. (2016, March). Mobile CPU'S rise to power: Quantifying the impact of generational mobile CPU design trends on performance, energy, and user satisfaction. In 2016 IEEE International Symposium on High Performance Computer Architecture (HPCA) (pp. 6476). IEEE.
Hanus, M. D., & Fox, J. (2015). Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance. Computers & Education, 80, 152161.
Harasim, L. (2017). Learning theory and online technologies. New York: Routledge.
Harrati, N., Bouchrika, I., Tari, A., & Ladjailia, A. (2016). Exploring user satisfaction for elearning systems via usage-based metrics and system usability scale analysis. Computers in Human Behavior, 61, 463471.
Holinka, C. (2015). Stress, emotional intelligence, and life satisfaction in college students. College Student Journal, 49(2), 300311.
Horvat, A., Dobrota, M., Krsmanovic, M., & Cudanov, M. (2015). Student perception of the Moodle learning management system: A satisfaction and significance analysis. Interactive Learning Environments, 23(4), 515527.
Hwang, G. H., Chen, B., & Huang, C. W. (2016). Development and effectiveness analysis of a personalized ubiquitous multi device certification tutoring system based on bloom's taxonomy of educational objectives. Journal of Educational Technology & Society, 19(1), 223236.
James, L. T., & Casidy, R. (2018). Authentic assessment in business education: Its effects on student satisfaction and promoting behavior. Studies in higher education, 43(3), 401415.
Johansen, J. D., Aalto‐Korte, K., Agner, T., Andersen, K. E., Bircher, A., Bruze, M., ... & John, S. M. (2015). European society of contact dermatitis guideline for diagnostic patch testing–recommendations on best practice. Contact dermatitis, 73(4), 195221.
Johnson, L., Becker, S. A., Cummins, M., Estrada, V., Freeman, A., & Hall, C. (2016). NMC horizon report: 2016 higher education edition (pp. 150). Austin, Texas: The New Media Consortium.
Jones, G., & Alba, A. D. (2019). Reviewing the effectiveness and learning outcomes of a 3D virtual museum: A pilot study. In Virtual Reality in Education: Breakthroughs in Research and Practice (pp. 5275). Hershey, Pennsylvania: IGI Global.
Kintu, M. J., Zhu, C., & Kagambe, E. (2017). Blended learning effectiveness: The relationship between student characteristics, design features, and outcomes. International Journal of Educational Technology in Higher Education, 14(1), 7.
Ladhari, R., Souiden, N., & Dufour, B. (2017). The role of emotions in utilitarian service settings: The effects of emotional satisfaction on product perception and behavioral intentions. Journal of Retailing and Consumer Services, 34, 1018.
Lee, J., Lim, C., & Kim, H. (2017). Development of an instructional design model for flipped learning in higher education. Educational Technology Research and Development, 65(2), 427453.
Littlejohn, A., Hood, N., Milligan, C., & Mustain, P. (2016). Learning in MOOCs: Motivations and self-regulated learning in MOOCs. The Internet and Higher Education, 29, 4048.
Malik, M. F., & Khan, M. N. A. (2016). An analysis of performance testing in distributed software applications. International Journal of Modern Education and Computer Science, 8(7), 53.
McDougall, W. (2015). An introduction to social psychology. Kitchener, Ontario: Psychology Press.
McKnight, K., O'Malley, K., Ruzic, R., Horsley, M. K., Franey, J. J., & Bassett, K. (2016). Teaching in a digital age: How educators use technology to improve student learning. Journal of research on technology in education, 48(3), 194211.
Meier, D., & Knoester, M. (2017). Beyond testing: Seven assessments of students and schools more effective than standardized tests. New York City: Teachers College Press.
Moridis, C. N., Terzis, V., Economides, A. A., Karlovasitou, A., & Karabatakis, V. E. (2018). Using EEG frontal asymmetry to predict IT user's perceptions regarding the usefulness, ease of use, and playfulness. Applied psychophysiology and biofeedback, 43(1), 111.
Moser, R. S., Schatz, P., & Lichtenstein, J. D. (2015). The importance of proper administration and interpretation of neuropsychological baseline and post-concussion computerized testing. Applied Neuropsychology: Child, 4(1), 4148.
Myers, R. H., Montgomery, D. C., & AndersonCook, C. M. (2016). Response surface methodology: Process and product optimization using designed experiments. Hoboken, NJ: John Wiley & Sons.
Napitupulu, D., Rahim, R., Abdullah, D., Setiawan, M. I., Abdillah, L. A., Ahmar, A. S., ... & Pranolo, A. (2018, January). Analysis of student satisfaction toward the quality of the service facility. Journal of Physics: Conference Series, 954(1), 012019. IOP Publishing.
Nardi, P. M. (2018). Doing survey research: A guide to quantitative methods. New York: Routledge.
Navimipour, N. J., & Zareie, B. (2015). A model for assessing the impact of elearning systems on employees' satisfaction. Computers in Human Behavior, 53, 475485.
Nilson, L. B. (2016). Teaching at its best: A research based resource for college instructors. Hoboken: John Wiley & Sons.
Oliver, G. P. (2017). Taking it to heart: A case study of supporting English language learners through culturally responsive teaching, collaboration, and ESOL focused leadership. The State University of New York at Albany.
Permzadian, V., & Credé, M. (2016). Do first year seminars improve college grades and retention? A quantitative review of their overall effectiveness and an examination of moderators of effectiveness. Review of Educational Research, 86(1), 277316.
Rahimi, E., van den Berg, J., & Veen, W. (2015). Facilitating student driven constructing of learning environments using Web 2.0 personal learning environments. Computers & Education, 81, 235246.
Rangel, V. S., & Coulson, H. L. (2017). Educational resilience: How students navigate the challenges of attending an early college high school. Annual meeting of the University Council for Educational Administration November.
Rashid, T., & Asghar, H. M. (2016). Technology use, self -directed learning, student engagement, and academic performance: Examining the interrelations. Computers in Human Behavior, 63, 604612.
Rohatgi, A., Scherer, R., & Hatlevik, O. E. (2016). The role of ICT self efficacy for students' ICT use and their achievement in a computer and information literacy test. Computers & Education, 102, 103116.
Romiszowski, A. J. (2016). Designing instructional systems: Decision making in course planning and curriculum design. London: Routledge.
Rowntree, D. (2015). Assessing students: How shall we know them?. London: Routledge.
Shoemaker, J. R., Chavez, R. A., Keane, P., Butz, S., & Yowler, S. K. (2017). Effective utilization of computerized curricular assistive tools in improving NCLEXRN pass rates for a baccalaureate nursing program. CIN: Computers, Informatics, Nursing, 35(4), 194200.
Simonetti, V., Comparcini, D., Flacco, M. E., Di Giovanni, P., & Cicolini, G. (2015). Nursing students' knowledge and attitude on pressure ulcer prevention evidence based guidelines: A multicenter crosssectional study. Nurse education today, 35(4), 573579.
Skinner, B. F. (2016). The technology of teaching. BF Skinner Foundation.
Smith, G. G., Besalti, M., Nation, M., Feldman, A., & Laux, K. (2019). Teaching climate change science to high school students using computer games in an intermedia narrative. Eurasia Journal of Mathematics, Science and Technology Education, 15(6).
Strayhorn, T. L. (2018). College students' sense of belonging: A key to educational success for all students. New York: Routledge.
Sung, Y. T., Chang, K. E., & Liu, T. C. (2016). The effects of integrating mobile devices with teaching and learning on students' learning performance: A meta-analysis and research synthesis. Computers & Education, 94, 252275.
Tarhini, A., Hone, K., Liu, X., & Tarhini, T. (2017). Examining the moderating effect of individual level cultural values on users' acceptance of E-learning in developing countries: a structural equation modeling of an extended technology acceptance model. Interactive Learning Environments, 25(3), 306328.
Tidd, J., & Bessant, J. R. (2018). Managing innovation: Integrating technological, market, and organizational change. Hoboken, NJ: John Wiley & Sons.
Trelease, R. B. (2016). From chalkboard, slides, and paper to e‐learning: How computing technologies have transformed anatomical sciences education. Anatomical sciences education, 9(6), 583602.
Turner, J., & Briggs, G. (2017). Using third party audiovisual materials in module production: learning design, cost effectiveness, and student satisfaction on DD210 and DE200.
Wampoid, B. E. (2015). The intensive examination of social interaction. In Single Case Research Design and Analysis (Psychology Revivals) (pp. 105144). Routledge.
Wang, M., Cheng, B., Chen, J., Mercer, N., & Kirschner, P. A. (2017). The use of web based collaborative concept mapping to support group learning and interaction in an online environment. The Internet and Higher Education, 34, 2840.
Whiteside, A. L. (2015). Introducing the social presence model to explore online and blended learning experiences. Online Learning, 19(2), n2.
Wlodkowski, R. J., & Ginsberg, M. B. (2017). Enhancing adult motivation to learn: A comprehensive guide for teaching all adults. Hoboken, NJ: John Wiley & Sons.
Yang, H., Yu, J., Zo, H., & Choi, M. (2016). User acceptance of wearable devices: An extended perspective of perceived value. Telematics and Informatics, 33(2), 256269.
Yilmaz, R. (2017). Exploring the role of e-learning readiness on student satisfaction and motivation in flipped classrooms. Computers in Human Behavior, 70, 251260.
Yu, G. O. (2016). Intellectual and personality factors in the achievement of high exam effectiveness in first year Russian university students. Psychology in Russia: State of the art, 9(3).
DOI: https://doi.org/10.24071/ijiet.v6i2.2440
Refbacks
- There are currently no refbacks.
Copyright (c) 2022 Indra Hendro, Victor Wiley, Thomas Lucas
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Indexed and abstracted in:
IJIET Sinta 2 Certificate (S2 = Level 2)
We would like to inform you that IJIET (International Journal of Indonesian Education and Teaching):has been nationally accredited Sinta 2 by the Ministry of Education, Culture, Research and Technology of the Republic of Indonesia based on the decree No. Surat Keputusan 158/E/KPT/2021. Validity for 5 years: Vol 5 No 2, 2021 until Vol 10 No 1, 2026.
This work is licensed under CC BY-SA.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
IJIET DOI: https://doi.org/10.24071/ijiet
p-ISSN: 2548-8422 (since 5 January 2017); e-ISSN: 2548-8430 (since 5 January 2017)
IJIET (International Journal of Indonesian Education and Teaching) is published twice a year, namely in January and July, by the Institute for Research and Community Services of Sanata Dharma University, Yogyakarta, Indonesia.