Gamification of Assessment Test through Multiple Question Paths to Facilitate Participants’ Autonomy and Competence

Pratama Wirya Atmaja, Eka Prakarsa Mandyartha

Abstract


Gamifying activities to make them more game-like is one of the hottest trends in various fields, including education. Among the factors influencing the success of gamification for education are the participants’ sense of autonomy and competence, which can be facilitated with the incorporation of multiple learning paths. However, the use of multiple question paths in gamified assessment tests is still under-studied. This mixed-method study was aimed at exploring the matter through a paper-based and gamified assessment test in higher education. A controlled experiment was conducted in a calculus course in an informatics department. The experimental group (n equal 38) undertook a gamified written test, and the control group (n equal 37) undertook a regular one. The gamified test consisted of several Hard and Medium Questions, and each participant would choose a question path containing some of the questions. Nine question paths were available with varying ratios between Hard and Medium Questions, and the participants were allowed to ask for two hints on the Hard ones. A questionnaire, based on the EGameFlow model, was used to assess the gamified test. The results show that the gamified test was able to facilitate the participants’ sense of autonomy but not their sense of competence, which was due to flaws of the test. Two additional positive effects of the test on the participants’ knowledge improvement and Flow experience are identified. The path selection pattern among the participants and the flaws of the gamified test are also discussed.

Full Text:

PDF

References


K. Huotari and J. Hamari, “A definition for gamification: anchoring gamification in the service marketing literature,” Electronic Markets, vol. 27, no. 1, pp. 21–31, 2017.

F. Garcia-Sanjuan, S. Jurdi, J. Jaen, and V. Nacher, “Evaluating a tactile and a tangible multi-tablet gamified quiz system for collaborative learning in primary education,” Computers and Education, vol. 123, pp. 65–84, 2018.

S. Subhash and E. A. Cudney, “Gamified learning in higher education: A systematic review of the literature,” Computers in Human Behavior, vol. 87, pp. 192–206, 2018.

F. Xu, F. Tian, D. Buhalis, J. Weber, and H. Zhang, “Tourists as Mobile Gamers: Gamification for Tourism Marketing,” Journal of Travel and Tourism Marketing, vol. 33, no. 8, pp. 1124–1142, 2016.

C. F. Hofacker, K. de Ruyter, N. H. Lurie, P. Manchanda, and J. Donaldson, “Gamification and Mobile Marketing Effectiveness,” Journal of Interactive Marketing, vol. 34, pp. 25–36, 2016.

C. K. Lo and K. F. Hew, “A comparison of flipped learning with gamification, traditional learning, and online independent study: the effects on students’ mathematics achievement and cognitive engagement,” Interactive Learning Environments, 2018.

M. B. Armstrong, R. N. Landers, and A. B. Collmus, “Gamifying recruitment, selection, training, and performance management: Game-thinking in human resource management,” in Emerging Research and Trends in Gamification, 2015, pp. 140–165.

J. Barwick, D. Watkins, E. Kirk, and E. Law, “Adventures with Lex: The gamification of research?,” Convergence, vol. 24, no. 3, pp. 229–250, 2018.

T. Dal Sasso, A. Mocci, M. Lanza, and E. Mastrodicasa, “How to gamify software engineering,” in SANER 2017 - 24th IEEE International Conference on Software Analysis, Evolution, and Reengineering, 2017.

T. Halloluwa, D. Vyas, H. Usoof, and K. P. Hewagamage, “Gamification for development: a case of collaborative learning in Sri Lankan primary schools,” Personal and Ubiquitous Computing, vol. 22, no. 2, pp. 391–407, 2018.

O. Ezezika, J. Oh, N. Edeagu, and W. Boyo, “Gamification of nutrition: A preliminary study on the impact of gamification on nutrition knowledge, attitude, and behaviour of adolescents in Nigeria,” Nutrition and Health, vol. 24, no. 3, pp. 137–144, 2018.

Y. Udjaja, V. S. Guizot, and N. Chandra, “Gamification for Elementary Mathematics Learning in Indonesia,” International Journal of Electrical and Computer Engineering (IJECE), vol. 8, no. 5, pp. 3860–3865, Oct. 2018.

A. Y. Utomo and H. B. Santoso, “Development of gamification-enriched pedagogical agent for e-learning system based on community of inquiry,” in ACM International Conference Proceeding Series, 2015, pp. 1–9.

S. Deterding, D. Dixon, R. Khaled, and L. Nacke, “From game design elements to gamefulness: Defining ‘gamification,’” in Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments, MindTrek 2011, 2011, pp. 9–15.

B. Taspinar, W. Schmidt, and H. Schuhbauer, “Gamification in education: A board game approach to knowledge acquisition,” in Procedia Computer Science, 2016, vol. 99, pp. 101–116.

B. E. Wiggins, “An overview and study on the use of games, simulations, and gamification in higher education,” International Journal of Game-Based Learning, vol. 6, no. 1, pp. 18–29, 2016.

S. A. Kocadere and Ş. Çağlar, “The design and implementation of a gamified assessment,” Journal of E-Learning and Knowledge Society, vol. 11, no. 3, pp. 85–99, 2015.

L. Moccozet, C. Tardy, W. Opprecht, and M. Leonard, “Gamification-based assessment of group work,” in 2013 International Conference on Interactive Collaborative Learning, ICL 2013, 2013, pp. 171–179.

Z. Zainuddin, M. Shujahat, H. Haruna, and S. K. W. Chu, “The role of gamified e-quizzes on student learning and engagement: An interactive gamification solution for a formative assessment system,” Computers and Education, vol. 145, 2020.

Y. Attali and M. Arieli-Attali, “Gamification in assessment: Do points affect test performance?,” Computers and Education, vol. 83, pp. 57–63, 2015.

M. Guerreiro and C. Nordengren, “‘No Fun Games’: Engagement Effects of Two Gameful Assessment Prototypes,” Journal of Research on Technology in Education, vol. 50, no. 2, pp. 134–148, 2018.

K. Berkling and C. Thomas, “Gamification of a software engineering course and a detailed analysis of the factors that lead to it’s failure,” in 2013 International Conference on Interactive Collaborative Learning, ICL 2013, 2013, pp. 525–530.

D. Rojas, B. Kapralos, and A. Dubrowski, “The missing piece in the gamification puzzle,” in ACM International Conference Proceeding Series, 2013, pp. 135–138.

R. N. Landers, “Gamification Misunderstood: How Badly Executed and Rhetorical Gamification Obscures Its Transformative Potential,” Journal of Management Inquiry, vol. 28, no. 2, pp. 137–140, 2019.

M. Sailer, J. U. Hense, S. K. Mayr, and H. Mandl, “How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction,” Computers in Human Behavior, vol. 69, pp. 371–380, 2017.

R. van Roy and B. Zaman, “Why gamification fails in education and how to make it successful: Introducing nine gamification heuristics based on self-determination theory,” in Serious Games and Edutainment Applications: Volume II, 2017, pp. 485–509.

L. Shi and A. I. Cristea, “Motivational gamification strategies rooted in self-determination theory for social adaptive e-learning,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2016, vol. 9684, pp. 294–300.

S. Nicholson, “A recipe for meaningful gamification,” in Gamification in Education and Business, Springer, Cham, 2015, pp. 1–20.

A. F. Aparicio, F. L. G. Vela, J. L. G. Sánchez, and J. L. I. Montes, “Analysis and application of gamification,” in INTERACCION ’12: Proceedings of the 13th International Conference on Interacción Persona-Ordenador, 2012, pp. 1–2.

D. H. Rose, A. Meyer, N. Strangman, and G. Rappolt, Teaching every student in the digital age: universal design for learning. Alexandria, VA: Association for Supervision & Curriculum Development (ASCD), 2002.

M. Böckle, I. Micheel, M. Bick, and J. Novak, “A Design Framework for Adaptive Gamification Applications,” in Proceedings of the 51st Hawaii International Conference on System Sciences, 2018.

N. Gordon, M. Brayshaw, and S. Grey, “Maximising gain for minimal pain: Utilising natural game mechanics,” ITALICS Innovations in Teaching and Learning in Information and Computer Sciences, vol. 12, no. 1, pp. 27–38, 2013.

T. Jagušt, I. Botički, and H. J. So, “Examining competitive, collaborative and adaptive gamification in young learners’ math learning,” Computers and Education, vol. 125, pp. 444–457, 2018.

A. Iosup and D. Epema, “An experience report on using gamification in technical higher education,” in SIGCSE 2014 - Proceedings of the 45th ACM Technical Symposium on Computer Science Education, 2014, pp. 27–32.

S. J. Aguilar, C. Holman, and B. J. Fishman, “Game-Inspired Design: Empirical Evidence in Support of Gameful Learning Environments,” Games and Culture, vol. 13, no. 1, pp. 44–70, 2018.

P. Sweetser and P. Wyeth, “GameFlow: a model for evaluating player enjoyment in games,” Computers in Entertainment, vol. 3, no. 3, 2005.

A. S. Miller, J. A. Cafazzo, and E. Seto, “A game plan: Gamification design principles in mHealth applications for chronic disease management,” Health Informatics Journal, vol. 22, no. 2, pp. 184–193, 2014.

F. L. Fu, R. C. Su, and S. C. Yu, “EGameFlow: A scale to measure learners’ enjoyment of e-learning games,” Computers and Education, vol. 52, no. 1, pp. 101–112, 2009.

H. Akoglu, “User’s guide to correlation coefficients,” Turkish Journal of Emergency Medicine, vol. 18, no. 3. pp. 91–93, 2018.

J. Hamari and J. Koivisto, “Measuring flow in gamification: Dispositional Flow Scale-2,” Computers in Human Behavior, vol. 40, pp. 133–143, 2014.




DOI: http://dx.doi.org/10.17977/um010v3i12020p009

Refbacks

  • There are currently no refbacks.


 

 Letters in Information Technology Education (LITE)
 2654-5667
 Contact
 Published by Electrical Engineering, Universitas Negeri   Malang, Indonesia
 Jl. Semarang No. 5 Malang, East Java, Indonesia
 Homepage:  http://journal2.um.ac.id/index.php/lite/index
 E-mail: lite.teum@gmail.com

View My Stats