Have a personal or library account? Click to login
A Meta-Analysis on Mobile-Assisted Language Learning Applications: Benefits and Risks Cover

A Meta-Analysis on Mobile-Assisted Language Learning Applications: Benefits and Risks

Psychologica Belgica
Volume 62 (2022): Issue 1
By: Mariela Mihaylova,  Simon Gorin,  Thomas P. Reber and  Nicolas Rothen  
Open Access
|Sep 2022

References

  1. 1Agarwal, P. K., Nunes, L. D., & Blunt, J. R. (2021). Retrieval Practice Consistently Benefits Student Learning: a Systematic Review of Applied Research in Schools and Classrooms. Educational Psychology Review, 33, 1409–1453. DOI: 10.1007/s10648-021-09595-9
    Back to article
  2. 2Azabdaftari, B., & Mozaheb, M. (2012). Comparing vocabulary learning of EFL learners by using two different strategies: Mobile learning vs. Flashcards. The EUROCALL Review, 20(2), 13. DOI: 10.4995/eurocall.2012.11377
    Back to article
  3. 3Balduzzi, S., Rucker, G., & Schwarzer, G. (2019). How to perform a meta-analysis with R: a practical tutorial. DOI: 10.1136/ebmental-2019-300117
    Back to article
  4. 4Bano, M., Zowghi, D., Kearney, M., Schuck, S., & Aubusson, P. (2018). Mobile learning for science and mathematics school education: A systematic review of empirical evidence. Computers & Education, 121, 30–58. DOI: 10.1016/j.compedu.2018.02.006
    Back to article
  5. 5Başoğlu, E., & Akdemir, Ö. (2010). A Comparison of Undergraduate Students’ English Vocabulary Learning: Using Mobile Phones and Flash Cards. The Turkish Online Journal of Educational Technology, 9(3).
    Back to article
  6. 6Belardi, A., Pedrett, S., Rothen, N., & Reber, T. P. (2021). Spacing, Feedback, and Testing Boost Vocabulary Learning in a Web Application. Frontiers in Psychology, 12, 5072. DOI: 10.3389/fpsyg.2021.757262
    Back to article
  7. 7Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. (2009). Introduction to Meta-Analysis. John Wiley & Sons. DOI: 10.1002/9780470743386
    Back to article
  8. 8Bozdoğan, D. (2015). MALL Revisited: Current Trends and Pedagogical Implications. Procedia – Social and Behavioral Sciences, 195, 932–939. DOI: 10.1016/j.sbspro.2015.06.373
    Back to article
  9. 9Burston, J. (2015). Twenty years of MALL project implementation: A meta-analysis of learning outcomes. ReCALL, 27(1), 4–20. DOI: 10.1017/S0958344014000159
    Back to article
  10. 10Cavus, N., & Ibrahim, D. (2017). Learning English using children’s stories in mobile devices: Children’s stories in mobile devices. British Journal of Educational Technology, 48(2), 625–641. DOI: 10.1111/bjet.12427
    Back to article
  11. 11Chen, C., & Chung, C. (2008). Personalized mobile English vocabulary learning system based on item response theory and learning memory cycle. Computers & Education, 51(2), 624–645. DOI: 10.1016/j.compedu.2007.06.011
    Back to article
  12. 12Chen, C., & Hsu, S. (2008). Personalized Intelligent Mobile Learning System for Supporting Effective English Learning. Educational Technology & Society, 11(3), 153–180. DOI: http://www.jstor.org/stable/jeductechsoci.11.3.153
    Back to article
  13. 13Chen, C., & Li, Y. (2010). Personalised context-aware ubiquitous learning system for supporting effective English vocabulary learning. Interactive Learning Environments, 18(4), 341–364. DOI: 10.1080/10494820802602329
    Back to article
  14. 14Chen, Z., Chen, W., Jia, J., & An, H. (2020). The effects of using mobile devices on language learning: a meta-analysis. Education Technology, Research and Development, 68, 1769–1789. DOI: 10.1007/s11423-020-09801-5
    Back to article
  15. 15Cho, K., Lee, S., Joo, M., & Becker, B. (2018). The Effects of Using Mobile Devices on Student Achievement in Language Learning: A Meta-Analysis. Education Sciences, 8(3), 105. DOI: 10.3390/educsci8030105
    Back to article
  16. 16Darmi, R., & Albion, P. (2014). A Review of Integrating Mobile Phones for Language Learning. International Association for Development of the Information Society.
    Back to article
  17. 17Dempster, F. N. (1987). Effects of variable encoding and spaced presentations on vocabulary learning. Journal of Educational Psychology, 79(2), 162–170. DOI: 10.1037/0022-0663.79.2.162
    Back to article
  18. 18Duval, S., & Tweedie, R. (2000). Trim and Fill: A Simple Funnel-Plot–Based Method of Testing and Adjusting for Publication Bias in Meta-Analysis. Biometrics, 56(2), 455–463. DOI: 10.1111/j.0006-341X.2000.00455.x
    Back to article
  19. 19Egger, M., Smith, G., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ, 315(7109), 629–634. DOI: 10.1136/bmj.315.7109.629
    Back to article
  20. 20Fageeh, A. (2013). Effects of MALL Applications on Vocabulary Acquisition and Motivation. Arab World English Journal, 4(4), 420–447.
    Back to article
  21. 21Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008). GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. Bmj, 336(7650), 924–926. DOI: 10.1136/bmj.39489.470347.AD
    Back to article
  22. 22Harrer, M., Cuijpers, P., Furukawa, T., & Ebert, D. (2019). dmetar: Companion R Package For The Guide ‘Doing Meta-Analysis in R’. http://dmetar.protectlab.org
    Back to article
  23. 23Harrer, M., Cuijpers, P., Furukawa, T. A., & Ebert, D. D. (2021). Doing Meta-Analysis with R: A Hands-On Guide. Boca Raton, FL and London: Chapman & Hall/CRC Press. ISBN 978-0-367-61007-4. DOI: 10.1201/9781003107347
    Back to article
  24. 24Hedges, L. V. (1981). Distribution Theory for Glass’s Estimator of Effect size and Related Estimators. Journal of Educational Statistics, 6(2), 107–128. DOI: 10.2307/1164588
    Back to article
  25. 25Higgins, J., Thomas, J., Chandler, J., Cumpston, M., Li, T., Page, M., & Welch, V. (eds.) (2019). Cochrane Handbook for Systematic Reviews of Interventions version 6.0 (updated July 2019). Cochrane, 2019. Available from www.training.cochrane.org/handbook. DOI: 10.1002/9781119536604
    Back to article
  26. 26Higgins, J., Savović, J., Page, M. J., Elbers, R. G., & Sterne, J. A. C. (2020). Chapter 8: Assessing risk of bias in a randomized trial. In: J. P. T. Higgins, J. Thomas, J. Chandler, M. Cumpston, T. Li, M. J. Page & V. A. Welch (eds.), Cochrane Handbook for Systematic Reviews of Interventions version 6.1 (updated September 2020). Cochrane, 2020. Available from www.training.cochrane.org/handbook
    Back to article
  27. 27Hsieh, T., Wang, T., Su, C., & Lee, M. (2012). A fuzzy logic-based personalized learning system for supporting adaptive English learning. Journal of Educational Technology & Society, 15(1), 273–288.
    Back to article
  28. 28Hsu, C., Hwang, G., & Chang, C. (2013). A personalized recommendation-based mobile learning approach to improving the reading performance of EFL students. Computers & Education, 63, 327–336. DOI: 10.1016/j.compedu.2012.12.004
    Back to article
  29. 29Hwang, W., Chen, H., Shadiev, R., Huang, Y., & Chen, C. (2014). Improving English as a foreign language writing in elementary schools using mobile devices in familiar situational contexts. Computer Assisted Language Learning, 27(5), 359–378. DOI: 10.1080/09588221.2012.733711
    Back to article
  30. 30Ibrahim, N., Chee, K., & Yahaya, N. (2017). Effectiveness of mobile learning application in improving reading skills in Chinese language and towards post-attitudes. International Journal of Mobile Learning and Organisation, 11(3), 210. DOI: 10.1504/IJMLO.2017.10005992
    Back to article
  31. 31Kapler, I. V., Weston, T., & Wiseheart, M. (2015). Spacing in a simulated undergraduate classroom: Long-term benefits for factual and higher-level learning. Learning and Instruction, 36, 38–45. DOI: 10.1016/j.learninstruc.2014.11.001
    Back to article
  32. 32Kast, M., Baschera, G. M., Gross, M., Jäncke, L., & Meyer, M. (2011). Computer-based learning of spelling skills in children with and without dyslexia. Annals of dyslexia, 61(2), 177–200. DOI: 10.1007/s11881-011-0052-2
    Back to article
  33. 33Khodabandeh, F., & Soleimani, H. (2017). The Effect of MALL-Based Tasks on EFL Learners’ Grammar Learning. Teaching English with Technology, 17(2), 29–41.
    Back to article
  34. 34Kiliçkaya, F., & Krajka, J. (2010). Comparative Usefulness of Online and Traditional Vocabulary Learning. The Turkish Online Journal of Educational Technology, 9(2).
    Back to article
  35. 35Kim, H., & Kwon, Y. (2012). Exploring Smartphone Applications for Effective Mobile-Assisted Language Learning. Multimedia-Assisted Language Learning, 15(1), 31–57. DOI: 10.15702/mall.2012.15.1.31
    Back to article
  36. 36Knapp, G., & Hartung, J. (2003). Improved tests for a random effects meta-regression with a single covariate. Statistics in medicine, 22(17), 2693–2710. DOI: 10.1002/sim.1482
    Back to article
  37. 37Kondo, M., Ishikawa, Y., Smith, C., Sakamoto, K., Shimomura, H., & Wada, N. (2012). Mobile Assisted Language Learning in university EFL courses in Japan: Developing attitudes and skills for self-regulated learning. ReCALL, 24(2), 169–187. DOI: 10.1017/S0958344012000055
    Back to article
  38. 38Kukulska-Hulme, A. (2012). Mobile-Assisted language learning. The encyclopedia of applied linguistics (pp. 1–9). DOI: 10.1002/9781405198431.wbeal0768.pub2
    Back to article
  39. 39Lan, Y., & Lin, Y. (2016). Mobile Seamless Technology Enhanced CSL Oral Communication. Journal of Educational Technology & Society, 19(3), 335–350. DOI: https://www.jstor.org/stable/10.2307/jeductechsoci.19.3.335
    Back to article
  40. 40Lee, P. (2014, September). Are mobile devices more useful than conventional means as tools for learning vocabulary? Paper presented at 2014 IEEE 8th International Symposium on Embedded Multicore/Manycore SoCs, Aizu-Wakamatsu, Japan. DOI: 10.1109/MCSoC.2014.24
    Back to article
  41. 41Li, J.-T., & Tong, F. (2019). “Multimedia-assisted self-learning materials: the benefits of E-flashcards for vocabulary learning in Chinese as a foreign language.” Reading and Writing, 32(5), 1175–1195. DOI: 10.1007/s11145-018-9906-x
    Back to article
  42. 42Li, Z., & Hegelheimer, V. (2013). Mobile-Assisted Grammar Exercises: Effects on Self-Editing in L2 Writing. Language Learning & Technology, 17(3), 135–156. DOI: 10.125/44343
    Back to article
  43. 43Lin, M., Chen, H., & Liu, K. (2017). A Study of the Effects of Digital Learning on Learning Motivation and Learning Outcome. EURASIA Journal of Mathematics, Science and Technology Education, 13(7). DOI: 10.12973/eurasia.2017.00744a
    Back to article
  44. 44Lüdecke, D. (2019). _esc: Effect Size Computation for Meta Analysis (Version 0.5.1). DOI: 10.5281/zenodo.1249218
    Back to article
  45. 45Maassen, E., van Assen, M., Nuijten, M., Olsson-Collentine, A., & Wicherts, J. (2020). Reproducibility of individual effect sizes in meta-analyses in psychology. PLOS ONE, 15(5), e0233107. DOI: 10.1371/journal.pone.0233107
    Back to article
  46. 46Mahdi, H. S. (2018). Effectiveness of Mobile Devices on Vocabulary Learning: A Meta-Analysis. Journal of Educational Computing Research, 56(1), 134–154. DOI: 10.1177/0735633117698826
    Back to article
  47. 47McDaniel, M., Fadler, C., & Pashler, H. (2013). Effects of spaced versus massed training in function learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 39(5), 1417–1432. DOI: 10.1037/a0032184
    Back to article
  48. 48McShane, B. B., Böckenholt, U., & Hansen, K. T. (2016). Adjusting for publication bias in meta-analysis: An evaluation of selection methods and some cautionary notes. Perspectives on Psychological Science, 11, 730–749. DOI: 10.1177/1745691616662243
    Back to article
  49. 49Metcalfe, J. (2017). Learning from Errors. Annual Review of Psychology, 68(1), 465–489. DOI: 10.1146/annurev-psych-010416-044022
    Back to article
  50. 50Oz, H. (2013). Prospective English teachers’ ownership and usage of mobile device as m-learning tools. Procedia-Social and Behavioral Sciences, 141, 1031–1041. DOI: 10.1016/j.sbspro.2014.05.173
    Back to article
  51. 51Ozer, O., & Kılıç, F. (2018). The Effect of Mobile-Assisted Language Learning Environment on EFL Students’ Academic Achievement, Cognitive Load and Acceptance of Mobile Learning Tools. EURASIA Journal of Mathematics, Science and Technology Education, 14(7). DOI: 10.29333/ejmste/90992
    Back to article
  52. 52Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., … Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. International Journal of Surgery, 88, 105906.
    Back to article
  53. 53Parsons, D., & Ryu, H. (2006). A Framework for Assessing the Quality of Mobile Learning. In Proceedings of the 11th International Conference for Process Improvement, Research and Education.
    Back to article
  54. 54Pustejovsky, J. E., & Melissa, A. R. (2019). “Testing for Funnel Plot Asymmetry of Standardized Mean Differences.” Research Synthesis Methods, 10(1), 57–71. DOI: 10.1002/jrsm.1332
    Back to article
  55. 55R Core Team. (2020). R: A language and environment for statistical computing. Vienna, Austria: R Foundation of Statistical Computing. https://www.R-project.org/
    Back to article
  56. 56Rachels, J. R., & Rockinson-Szapkiw, A. J. (2017). The effects of a mobile gamification app on elementary students’ Spanish achievement and self-efficacy. Computer Assisted Language Learning, 31(1–2), 72–89. DOI: 10.1080/09588221.2017.1382536
    Back to article
  57. 57Rahimi, M., & Miri, S. S. (2014). The Impact of Mobile Dictionary Use on Language Learning. Paper presented at International Conference on Current Trends in ELT. DOI: 10.1016/j.sbspro.2014.03.567
    Back to article
  58. 58Reber, T. P., & Rothen, N. (2018). Educational App-Development needs to be informed by the Cognitive Neurosciences of Learning & Memory. Npj Science of Learning, 3(1), 22. DOI: 10.1038/s41539-018-0039-4
    Back to article
  59. 59Roediger, H. L., & Butler, A. C. (2011). The critical role of retrieval practice in long-term retention. Trends in Cognitive Sciences, 15(1), 20–27. DOI: 10.1016/j.tics.2010.09.003
    Back to article
  60. 60Sandberg, J., Maris, M., & de Geus, K. (2011). Mobile English learning: An evidence-based study with fifth graders. Computers & Education, 57(1), 1334–1347. DOI: 10.1016/j.compedu.2011.01.015
    Back to article
  61. 61Schwarzer, G., James, R. C., & Rücker, G. (2015). Meta-Analysis with R. Use R! Cham: Springer International Publishing. DOI: 10.1007/978-3-319-21416-0
    Back to article
  62. 62Shadiev, R., Hwang, W., & Liu, T. (2018). Investigating the effectiveness of a learning activity supported by a mobile multimedia learning system to enhance autonomous EFL learning in authentic contexts. Educational Technology Research and Development, 66(4), 893–912. DOI: 10.1007/s11423-018-9590-1
    Back to article
  63. 63Shams, L., & Seitz, A. R. (2008). Benefits of multisensory learning. Trends in Cognitive Sciences, 12(11), 411–417. DOI: 10.1016/j.tics.2008.07.006
    Back to article
  64. 64Sobel, H. S., Cepeda, N. J., & Kapler, I. V. (2011). Spacing effects in real-world classroom vocabulary learning. Applied Cognitive Psychology, 25(5), 763–767. DOI: 10.1002/acp.1747
    Back to article
  65. 65Stanley, T. D., & Doucouliagos, H. (2014). Meta-regression approximations to reduce publication selection bias. Research Synthesis Methods, 5(1), 60–78. DOI: 10.1002/jrsm.1095
    Back to article
  66. 66Sterne, J., Savović, J., Page, M., Elbers, R., Blencowe, N., Boutron, I., Cates, C., Cheng, H., Corbett, M., Eldridge, S., Hernán, M., Hopewell, S., Hróbjartsson, A., Junqueira, D. R., Jüni, P., Kirkham, J. J., Lasserson, T., Li, T., McAleenan, A., Reeves, B. C., Shepperd, S., Shrier, I., Stewart, L. A., Tilling, K., White, I. R., Whiting, P. F., & Higgins, J. P. T. (2019). RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ, 366, l4898. DOI: 10.1136/bmj.l4898
    Back to article
  67. 67Sung, Y., Chang, K., & Liu, T. (2016). The effects of integrating mobile devices with teaching and learning on students’ learning performance: A meta-analysis and research synthesis. Computers & Education, 94, 252–275. DOI: 10.1016/j.compedu.2015.11.008
    Back to article
  68. 68Sung, Y., Chang, K., & Yang, J. (2015). How effective are mobile devices for language learning? A meta-analysis. Educational Research Review, 16, 68–84. DOI: 10.1016/j.edurev.2015.09.001
    Back to article
  69. 69Taj, I., Sulan, N., Sipra, M., & Ahmad, W. (2016). Impact of Mobile Assisted Language Learning (MALL) on EFL: A Meta-Analysis. Advances in Language and Literary Studies, 7(2). DOI: 10.7575/aiac.alls.v.7n.2p.76
    Back to article
  70. 70Thornton, P., & Houser, C. (2005). Using mobile phones in English education in Japan: Using mobile phones in English education in Japan. Journal of Computer Assisted Learning, 21(3), 217–228. DOI: 10.1111/j.1365-2729.2005.00129.x
    Back to article
  71. 71Viberg, O., & Grönlund, Å. (2012). Mobile assisted language learning: A literature review. In 11th World Conference on Mobile and Contextual Learning.
    Back to article
  72. 72Viechtbauer, W. (2005). Bias and efficiency of meta-analytic variance estimators in the random-effects model. Journal of Educational and Behavioral Statistics, 30(3), 261–293. DOI: 10.3102/10769986030003261
    Back to article
  73. 73Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48. DOI: 10.18637/jss.v036.i03
    Back to article
  74. 74Wang, Y. (2016). Integrating self-paced mobile learning into language instruction: Impact on reading comprehension and learner satisfaction. Interactive Learning Environments, 25(3), 397–411. DOI: 10.1080/10494820.2015.1131170
    Back to article
  75. 75Wang, Y., & Shih, S. (2015). Mobile-assisted language learning: Effects on EFL vocabulary learning. International Journal of Mobile Communications, 13(4), 358. DOI: 10.1504/IJMC.2015.070060
    Back to article
  76. 76Weinstein, Y., Madan, C., & Sumeracki, M. (2018). Teaching the science of learning. Cognitive Research: Principles and Implications, 3(1), 2. DOI: 10.1186/s41235-017-0087-y
    Back to article
  77. 77Wu, Q. (2014). Learning ESL Vocabulary with Smartphones. Procedia – Social and Behavioral Sciences, 143, 302–307. DOI: 10.1016/j.sbspro.2014.07.409
    Back to article
  78. 78Wu, Q. (2015a). Pulling Mobile Assisted Language Learning (MALL) into the Mainstream: MALL in Broad Practice. PLoS ONE, 10(5), e0128762. DOI: 10.1371/journal.pone.0128762
    Back to article
  79. 79Wu, Q. (2015b). Designing a smartphone app to teach English (L2) vocabulary. Computers & Education, 85, 170–179. DOI: 10.1016/j.compedu.2015.02.013
    Back to article
  80. 80Wu, Q., Wu, Y., Chen, C., Kao, H., Lin, C., & Huang, S. (2012). Review of trends from mobile learning studies: A meta-analysis. Computers & Education, 59(2), 817–827. DOI: 10.1016/j.compedu.2012.03.016
    Back to article
  81. 81Wu, T., Sung, T., Huang, Y., & Yang, C. (2011). Ubiquitous English Learning System with Dynamic Personalized Guidance of Learning Portfolio. Journal of Educational Technology & Society, 14(4), 164–180. DOI: https://www.jstor.org/stable/10.2307/jeductechsoci.14.4.164
    Back to article
  82. 82Yaman, I., Senel, M., & Yesilel, D. B. A. (2015). Exploring the extent to which ELT students utilize smartphones for language learning purposes. South African Journal of Education, 35(4), 9. DOI: 10.15700/saje.v35n4a1198
    Back to article
  83. 83Yang, C., Luo, L., Vadillo, M. A., Yu, R., & Shanks, D. R. (2021). Testing (quizzing) boosts classroom learning: A systematic and meta-analytic review. Psychological Bulletin, 147(4), 399–435. DOI: 10.1037/bul0000309
    Back to article
  84. 84Zhang, Y. (2016, August). The impact of mobile learning on ESL listening comprehension. Paper Presented at 3rd International Conference on Advanced Education and Management (ICAEM 2016), Hangzhou, Zheijiang, China. DOI: 10.12783/dtssehs/icaem2016/4290
    Back to article
  85. 85Zou, D., & Xie, H. (2018). Personalized Word-Learning based on Technique Feature Analysis and Learning Analytics. Journal of Educational Technology & Society, 21(2), 233–244. DOI: https://www.jstor.org/stable/10.2307/26388402
    Back to article
  86. 86Zydney, J. M., & Warner, Z. (2016). Mobile apps for science learning: Review of research. Computers & Education, 94, 1–17. DOI: 10.1016/j.compedu.2015.11.001
    Back to article
DOI: https://doi.org/10.5334/pb.1146 | Journal eISSN: 0033-2879
Journal RSS Feed
Language: English
Submitted on: Nov 30, 2021
Accepted on: Aug 12, 2022
Published on: Sep 16, 2022
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year
Keywords:
memory,
language acquisition,
mobile-assisted language learning,
language learning,
meta-analysis,
learning principles

© 2022 Mariela Mihaylova, Simon Gorin, Thomas P. Reber, Nicolas Rothen, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.

Previous articleVolume 62 (2022): Issue 1Next article