Submitted:
17 January 2023
Posted:
19 January 2023
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Materials and Methods
2.1. Advantages and Disadvantages of GBL
2.2. Alternatives to GBL
2.3. Principles, Characteristics and Mechanisms of GBL
2.4. Successful Strategies in GBL
3. Results
Creating a Digital Game-Based Learning Game focused on Arithmetic Training
3. Research
4. Conclusions
Appendix A
- Playtest Script
- Background
- “You are stranded in a space base, and the only way to get home is to successfully repair the robots in the base so they can help you repair your spaceship and you can get home. In the first level, broken robots will spawn and attack if you get too close! To repair them, you will have to lock on to a robot, answer the question on their screen and pick the correct answer! This will disable the robot. Try to disable as many robots before the time runs out.”
- Instructions
- The first screen describes how to play. Press F1 to disable or enable the help screen. Try to disable as many robots before the time runs out and don’t let the enemies take all your health away. You have 4 levels to play where you must disable all the robots to continue. Between levels you will be teleported into the base where you can buy power-ups for the next level.
- Do not let the enemies touch you or surround you, if they do, they will harm you and if you lose all your health you will be disabled.
- Levels are roughly 2 minutes long so the entire experience should take less than 10 minutes to play. Each level will have different types of arithmetic problems.
- Questionnaire
- Questionnaire (User Experience)
- (Answer 1-5 depending on how strongly you agree with the sentiment: 1, I strongly disagree, 3, neither agree nor disagree, 5 strongly agree)
- How well do you understand the controls?
- Can you lock onto an enemy and solve the equation?
- Can you disable all the robots before the time runs out?
- Are you dying to the robots?
- Did you have a problem with the control scheme?
- Did you encounter any bugs or problems?
- Questionnaire (Learning Motivation)
- (Answer 1-5 depending on how strongly you agree with the sentiment: 1, I strongly disagree, 3, neither agree nor disagree, 5 strongly agree)
- Do you agree math games are a good way to learn math?
- Did you have fun while playing the game?
- Would you play again to improve your score?
- Were the math puzzles you solved too hard?
- Was the number of enemies appropriate?
- Questionnaire (Design Specific)
- Does navigating the world support the implementation of game feel?
- Is the difficulty level appropriate?
- Are the powerups enhancing the game experience?
- Is the goal of the game clear?
- Playtest Results
- Introduction
- This document consolidates the results of our play test as well as the justification of those questions and the analysis of the results. The author playtested with 10 different individuals going over 15 different questions, spanning areas like design, user experience and user motivation.
- Justifying Playtesting Questions:
- Design Questions:
- Does navigating the world support the implementation of game feel?
- A lot of the design choices made were around the implementation of the “Game Feel” requirement so I was sensitive to feedback in this area. This question required explaining to the player what constitutes game feel.
- Is the difficulty level appropriate?
- There was some tuning of the difficulty prior to playtesting, and the overall time per level was increased and the number of enemies was drastically reduced as a result.
- Are the powerups enhancing the game experience?
- I spent a lot of time working on “interesting choices'' by allowing the player to collect and buy power-ups throughout the game. Once the player has the power-ups, do they understand how to switch between them and use them? The purpose of this question is to see if they understand everything around power-ups.
- Is the goal of the game clear?
- I worked on the game for a few months now and clearly understand the objectives and goal of the game. This question was to help us see if the game is actually clear to the player, in the sense that it’s easy to understand that you have to disable all the robots in order to move on to the next level.
- User Experience:
- How well do you understand the controls?
- For the alpha version of the game, I added an overlay to the game world that shows the controls the player uses to play the game. This question was to see how well those explanations worked to teach the player how the game works.
- Can you lock onto an enemy and solve the equation?
- The main interaction with the robots to play the game is through locking onto enemies to disable them. This question is trying to check that this main mechanic is clear and works well for the player.
- Can you disable all the robots before the time runs out?
- In order to pass off the current level and move on in the game, the player must disable the robots in the given time. Since this is a main way the player progresses in the game, I needed this question to make sure they understood this mechanic and that they were able to accomplish this on each level.
- Are you dying to the robots?
- One of the ways you fail to complete the current level is by having the robots hit you or answering the questions incorrectly, both reduce your HP causing the player to die and restart the level. Is this happening a lot? Is it too easy and never happens?
- Did you have a problem with the control scheme?
- I already made sure they understood the control scheme in an earlier question, but this question targets and issues with the control scheme. Is it hard to use? Are there too many controls that make the game artificially more difficult?
- Did you encounter any bugs or problems?
- For the final game I wanted to improve on the above questions and fix any bugs the play testers found during their time playing.
- Approach to testing design questions and Playtest Methods
- I ran the game for 10 minutes with each player and asked them to complete the survey in the end. They answered all the questions with a 5 point scale. After they answered, I asked clarifying questions to get additional insight. Through these clarifying questions, I discovered that once the controls were understood the difficulty was appropriate and even tended to be a bit easy. In particular, the early levels need to be adjusted to increase the difficulty from the second level on and playtest that in the future.
- I asked the users about the power ups and discovered that the over-abundance made them unremarkable. It was also clear from the play test that they needed more of a tutorial with the power-ups to understand how to use them to evade enemies (with the raised platform power-up) or kill enemies easier (with the slow time power-up). The game was moving too quickly for the play testers to learn how to use the power-ups during the game. This will be an area of focus for future work.
- The answers to the questions and additional feedback received leads us to believe that the goal of the game is well understood by the players. It helps that the objective of the game is very straightforward and there is no unnecessary complexity.
Appendix B

- found that the play-testers rarely died from the robots and it was easy to disable them all before the time ran out.
| Question | Player | Player | Player | Player | Player | Player | Player | Player | Player | Player | Player | Player | Player |
| How well do you understand the controls? | 3 | 4 | 3 | 3 | 3 | 4 | 2 | 3 | 2 | 4 | 5 | 5 | 3 |
| Can you lock onto an enemy and solve the equation? | 4 | 5 | 3 | 2 | 3 | 3 | 3 | 3 | 1 | 2 | 4 | 3 | 3 |
| Can you disable all the robots before the time runs out? | 5 | 5 | 2 | 1 | 4 | 3 | 4 | 3 | 1 | 1 | 1 | 1 | 1 |
| Are you dying to the robots? | 1 | 1 | 1 | 1 | 2 | 2 | 1 | 2 | 5 | 4 | 1 | 3 | 3 |
| Did you have a problem with the control scheme? | 2 | 1 | 4 | 5 | 3 | 2 | 4 | 2 | 4 | 4 | 4 | 2 | 4 |
| Did you encounter any bugs or problems? | 4 | 2 | 5 | 4 | 5 | 5 | 4 | 3 | 1 | 4 | 4 | 4 | 5 |
| Question | Player | Player | Player | Player | Player | Player | Player | Player | Player | Player | Player | Player | Player |
| Are math games a good way to learn math? | 4 | 5 | 5 | 3 | 4 | 5 | 5 | 4 | 5 | 5 | 5 | 2 | 4 |
| Did you have fun while playing the game? | 4 | 5 | 3 | 2 | 3 | 4 | 3 | 3 | 4 | 3 | 5 | 3 | 4 |
| Would you play again to improve your score? | 4 | 5 | 4 | 2 | 4 | 4 | 4 | 4 | 5 | 2 | 5 | 2 | 3 |
| Were the math puzzles you solved too hard? | 2 | 1 | 3 | 1 | 4 | 2 | 1 | 4 | 1 | 2 | 1 | 1 | 2 |
| Was the number of enemies appropriate? | 3 | 1 | 2 | 2 | 4 | 4 | 2 | 3 | 1 | 1 | 2 | 1 | 3 |
| Does navigation support the implementation of game feel? | 3 | 4 | 4 | 4 | 3 | 4 | 4 | 4 | 5 | 5 | 5 | 3 | 2 |
| Is the difficulty level appropriate? | 3 | 4 | 4 | 2 | 4 | 3 | 3 | 3 | 4 | 2 | 1 | 3 | 3 |
| Are the powerups enhancing the game experience? | 2 | 4 | 2 | 2 | 2 | 3 | 5 | 3 | 5 | 3 | 2 | 2 | 2 |
| Is the goal of the game clear? | 3 | 4 | 5 | 4 | 3 | 4 | 4 | 4 | 3 | 5 | 2 | 2 | 4 |
| General Results: (1-Totally Disagree,5- Strongly Agree) | ||
| Question | Average | Standard Deviation |
| How well do you understand the controls? | 3.384615385 | 0.9607689228 |
| Can you lock onto an enemy and solve the equation? | 3 | 1 |
| Can you disable all the robots before the time runs out? | 2.461538462 | 1.613246448 |
| Are you dying to the robots? | 2.076923077 | 1.320450584 |
| Did you have a problem with the control scheme? | 3.153846154 | 1.214231845 |
| Did you encounter any bugs or problems? | 3.846153846 | 1.214231845 |
| Do you agree math games are a good way to learn math? | 4.307692308 | 0.9473309334 |
| Did you have fun while playing the game? | 3.538461538 | 0.8770580193 |
| Would you play again to improve your score? | 3.692307692 | 1.109400392 |
| Were the math puzzles you solved too hard? | 1.923076923 | 1.11516355 |
| Was the number of enemies appropriate? | 2.230769231 | 1.091928428 |
| Does navigating the world support the implementation of game feel? | 3.846153846 | 0.8987170343 |
| Is the difficulty level appropriate? | 3 | 0.9128709292 |
| Are the powerups enhancing the game experience? | 2.846153846 | 1.14354375 |
| Is the goal of the game clear? | 3.615384615 | 0.9607689228 |
References
- Perrotta, C., Featherstone, G., Aston, H., & Houghton, E. (2013). The NFER Research Programme Game-based learning: latest evidence and future directions. https://www.nfer.ac.uk/nfer/publications/GAME01/GAME01.pdf.
- Vilches, J. (2011, June 9). ESA: Facts and figures about the gaming industry in 2010. TechSpot; TechSpot. https://www.techspot.com/news/44167-esa-facts-and-figures-about-the-gaming-industry-in-2010.html.
- Kebritchi, M., Hirumi, A., & Bai, H. (2010). The effects of modern mathematics computer games on mathematics achievement and class motivation. Computers & education, 55(2), 427-443. [CrossRef]
- Annetta, L. A., Minogue, J., Holmes, S. Y., & Cheng, M. T. (2009). Investigating the impact of video games on high school students’ engagement and learning about genetics. Computers & Education, 53(1), 74–85. [CrossRef]
- Hays, R. T. (2005). The effectiveness of instructional games: A literature review and discussion. Orlando, FL: Naval Air Warfare Center Training Systems Division.
- Lee, K. M., & Peng, W. (2006). What do we know about social and psychological effects of computer games. In P. Vorderer, & J. Bryant (Eds.), Playing video games: Motives, responses, and consequences (pp. 327–345). Mahwah, NJ: Erlbaum.
- Lieberman, D. A. (2006). What can we learn from playing interactive games? In P. Vorderer, & J. Bryant (Eds.), Playing video games: Motives, responses, and consequences) Mahwah, NJ: Erlbaum.
- Moreno, R., & Mayer, R. E. (2007). Interactive multimodal learning environments. Educational Psychology Review, 19, 309–326. [CrossRef]
- Rieber, L. P. (2005). Multimedia learning in games, simulations, and microworlds. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 549–568). New York: Cambridge University Press.
- Tobias, S., & Fletcher, J. D. (2007). What research has to say about designing computer games for learning. Educational Technology, 47(5), 20–29.
- Gee, J. P. (2007). Good video games+ good learning: Collected essays on video games, learning, and literacy. Peter Lang.
- Mayer, R. E. (2014). Computer games for learning: An evidence-based approach. MIT press.
- Omrod, J. E. (2014). How motivation affects learning and behavior. Retrieved from https://www.slideshare.net/marimontenegro9/how-motivation-affects-learning-and-behavior-38154037.
- Kim, B., Park, H., & Baek, Y. (2009). Not just fun, but serious strategies: Using meta-cognitive strategies in game-based learning. Computers & Education, 52(4), 800–810. [CrossRef]
- Çankaya, S., & Karamete, A. (2009). The effects of educational computer games on students’ attitudes towards mathematics course and educational computer games. Procedia - Social and Behavioral Sciences, 1(1), 145–149. [CrossRef]
- Sedighian, K., & Sedighian, A. S. (1996). Can educational computer games help educators learn about the psychology of learning mathematics in children. In 18th Annual Meeting of the International Group for the Psychology of Mathematics Education (pp. 573-578).
- Mansureh Kebritchi, Atsusi Hirumi, & Bai, H. (2010, September). The effects of modern mathematics computer games on mathematics achievement and class motivation. ResearchGate; Elsevier. https://www.researchgate.net/publication/223595686_The_effects_of_modern_mathematics_computer_games_on_mathematics_achievement_and_class_motivation#:~:text=Students%20who%20played%20the%20games,motivation%20of%20the%20experimental%20group.
- Tüzün, H., Yılmaz-Soylu, M., Karakuş, T., İnal, Y., & Kızılkaya, G. (2009). The effects of computer games on primary school students’ achievement and motivation in geography learning. Computers & Education, 52(1), 68–77. [CrossRef]
- Tsai, M.-J., Huang, L.-J., Hou, H.-T., Hsu, C.-Y., & Chiou, G.-L. (2016). Visual behavior, flow and achievement in game-based learning. Computers & Education, 98, 115–129. [CrossRef]
- Alaswad, Z. (2015). Designing for Game-Based Learning: The Effective Integration of Technology to Support Learning - Zina Alaswad, Larysa Nadolny, 2015. Journal of Educational Technology Systems. https://journals.sagepub.com/doi/full/10.1177/0047239515588164?casa_token=Uu5S52zoR7sAAAAA%3AzhrYZGX-7j7AzzmMs4Dsbl9T6ppD-aVTIvxa5Fgtn3KXZOQoIAlKQia_dr1gJjmdlWe588EpayNB.
- Hwang, G.-J., Chiu, L.-Y., & Chen, C.-H. (2015). A contextual game-based learning approach to improving students’ inquiry-based learning performance in social studies courses. Computers & Education, 81, 13–25. [CrossRef]
- Byun, J., & Joung, E. (2018). Digital game-based learning for K-12 mathematics education: A meta-analysis. School Science and Mathematics, 118(3-4), 113–126. [CrossRef]
- Hussein, M. H., Ow, S. H., Elaish, M. M., & Jensen, E. O. (2021). Digital game-based learning in K-12 mathematics education: a systematic literature review. Education and Information Technologies, 27(2), 2859–2891. [CrossRef]
- Pan, Y., Ke, F., & Xu, X. (2022). A systematic review of the role of learning games in fostering mathematics education in K-12 settings. Educational Research Review, 36, 100448. [CrossRef]
- Vogel, J. J., Vogel, D. S., Cannon-Bowers, J., Bowers, C. A., Muse, K., & Wright, M. (2006). Computer gaming and interactive simulations for learning: A meta-analysis. Journal of Educational Computing Research, 34(3), 229–243. [CrossRef]
- Rupp, A.A., Gushta, M., Mislevy, R.J., & Shafer, D.W. (2010). Evidence-centered Design of Epistemic Games: Measurement Principles for Complex Learning Environments. Journal of Technology, Learning.
- Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153–189. [CrossRef]
- Gee, J. P. (2003). What video games have to teach us about learning and literacy. Palgrave Macmillan.
- Hamari, J. (2007). Gamification. The Blackwell Encyclopedia of Sociology, 1-3.
- Ahmed, A., & Sutton, M. J. (2017). Gamification, serious games, simulations, and immersive learning environments in knowledge management initiatives. World Journal of Science, Technology and Sustainable Development. [CrossRef]
- Cai, Y., Goei, S. L., & Trooster, W. (Eds.). (2016). Simulation and serious games for education. Springer. [CrossRef]
- Csikszentmihalyi, M., 1990. Flow: The Psychology of Optimal Experience, Harper & Row.
- Bateman, C. and Boon R., 2005. 21st Century game design. Rockland, MA: Charles River Media.
- Perrotta, C., Featherstone, G., Aston, H., & Houghton, E. (2013). The NFER Research Programme Game-based learning: latest evidence and future directions. https://www.nfer.ac.uk/nfer/publications/GAME01/GAME01.pdf.
- Bartle, R.A., 2004. Designing Virtual Worlds, New Riders.
- McDaniel, R., Lindgren, R., & Friskics, J. (2012, October). Using badges for shaping interactions in online learning environments. In 2012 IEEE international professional communication conference (pp. 1-4). IEEE. [CrossRef]
- Janaki Mythily Kumar, Herger, M., & Rikke Friis Dam. (2020, June 5). Bartle’s Player Types for Gamification. The Interaction Design Foundation; UX courses. https://www.interaction-design.org/literature/article/bartle-s-player-types-for-gamification.
- R. Bartle, "Hearts, clubs, diamonds, spades: players who suit MUDs," August 2008, http://www.mud.co.uk/richard/hcds.htm.
- Yang, K.-H., & Lu, B.-C. (2021). Towards the successful game-based learning: Detection and feedback to misconceptions is the key. Computers & Education, 160, 104033. [CrossRef]
- Montola, M., Nummenmaa, T, Lucero, A., Boberg, M., Korhonen, H.: Applying game achievement systems to enhance user experience in a photo sharing service. In: Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era, New York (2009).
- Björk, S., Holopainen, J.: Patterns in Game Design. Charles River Media, Hingham (2005).
- Galli, L., & Fraternali, P. (2014). Achievement systems explained. In Trends and applications of serious gaming and social media (pp. 25-50). Springer, Singapore. [CrossRef]
- R. Bartle, "Hearts, clubs, diamonds, spades: players who suit MUDs," August 2008, http://www.mud.co.uk/richard/hcds.htm.
- Bird, J., & Edwards, S. (2014). Children learning to use technologies through play: A Digital Play Framework. British Journal of Educational Technology, 46(6), 1149–1160. [CrossRef]
- Hays, R. T. (2005). The effectiveness of instructional games: A literature review and discussion. Orlando, FL: Naval Air Warfare Center Training Systems Division.
- Lee, K. M., & Peng, W. (2006). What do we know about social and psychological effects of computer games. In P. Vorderer, & J. Bryant (Eds.), Playing video games: Motives, responses, and consequences (pp. 327–345). Mahwah, NJ: Erlbaum.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).