Κριτήρια Ποιότητας Βίντεο για τα Μαζικά Ανοικτά Διαδικτυακά Μαθήματα (MOOCs)


Published: Jun 27, 2023
Keywords:
MOOCs ΜΑΔΜ εκπαιδευτικά βίντεο κριτήρια ποιότητας διαδικτυακά μαθήματα
Στέφανος Γιασιράνης
Αλιβίζος (Λοΐζος) Σοφός
Απόστολος Κώστας
Abstract

Massive Open Online Courses (MOOCs) emerged in 2008 to democratize higher education by offering free access to learning to everyone. The main learning material in MOOCs are short videos, which contribute to their successful completion, as one of the main problems of MOOCs is the very high non-completion rates. A prerequisite for this is that the videos are of high quality, as a quality video contributes to the achievement of learning objectives and is positively judged by the learners. This paper presents the results of a literature review conducted to collect and group together those criteria that characterize a video as qualitative. Fifty quality indicators were identified, which were grouped into 3 axes and 5 categories.  These indicators can be used both when designing a MOOC course and for evaluating the videos included in such a program.

Article Details
  • Section
  • Articles
Downloads
Download data is not yet available.
References
Albelbisi, N. A. (2020). Development and validation of the MOOC success scale (MOOC-SS). Education and Information Technologies, 25, 4535-4555.
Aldowah, H., Al-Samarraie, H., Alzahrani, A. I., & Alalwan, N. (2020). Factors affecting student dropout in MOOCs: a cause and effect decision‐making model. Journal of Computing in Higher Education, 32, 429-454.
Amantha Kumar, J., & Al-Samarraie, H. (2019). An investigation of novice pre-university students’ views towards MOOCs: the case of Malaysia. The Reference Librarian, 60(2), 134-147.
Beheshti, M., Taspolat, A., Kaya, O. S., & Sapanca, H. F. (2018). Characteristics of Instructional Videos. World Journal on Educational Technology: Current Issues, 10(1), 61-69. https://doi.org/10.18844/wjet.v10i2.3418.
Blokzijl, W., & Naeff, R. (2004). The instructor as stagehand: Dutch student responses to PowerPoint. Business communication quarterly, 67(1), 70-77.
Bonafini, F., Chae, C., Park, E., & Jablokow, K. (2017). How much does student engagement with videos and forums in a MOOC affect their achievement?. Online Learning Journal, 21(4).
Brame, C.J. (2015). Effective educational videos. http://cft.vanderbilt.edu/guides-sub-pages/effective-educational-videos/
Brame, C.J. (2016). Effective educational videos: Principles and guidelines for maximizing student learning from video content. CBE Life Sciences Education, 15(4), es6.
Buchner, J. (2018). How to create Educational Videos: From watching passively to learning actively. R&E-SOURCE.
Carliner, S. (2000). Physical, cognitive, and affective: A three-part framework for information design. Technical Communication, 47(4), 561–576.
Castro-Alonso, J. C., De Koning, B. B., Fiorella, L., & Paas, F. (2021). Five Strategies for Optimizing Instructional Materials: Instructor-and Learner-Managed Cognitive Load. Educational Psychology Review, 1-29. https://doi.org/10.1007/s10648-021-09606-9.
Cattaneo, A., Evi-Colombo, A., Ruberto, M., & Stanley, J. (2019). Video pedagogy for vocational education. An overview of video-based teaching and learning. https://www.etf.europa.eu/sites/default/files/2019-08/video_pedagogy_for_vocational_education.pdf.
Chauhan, J., & Goel, A. (2016, August). An analysis of quiz in MOOC. In 2016 Ninth International Conference on Contemporary Computing (IC3) (pp. 1-6). IEEE.
Chen, B., Fan, Y., Zhang, G., & Wang, Q. (2017). Examining motivations and self-regulated learning strategies of returning MOOCs learners. In Proceedings of the Seventh International Learning Analytics & Knowledge Conference (pp. 542-543). ACM. https://doi.org/10.1145/3027385.3029448.
Chen, C. J., Wong, V. S., Teh, C. S., & Chuah, K. M. (2017). MOOC videos-derived emotions. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 9(2-9), 137-140.
Chorianopoulos, K. (2018). A Taxonomy of Asynchronous Instructional Video Styles. International Review of Research in Open and Distributed Learning, 19(1). https://doi.org/10.19173/irrodl.v19i1.2920.
Clark, R. C., & Mayer, R. E. (2008). e-Learning and the science of instruction. Pfeiffer.
Clark, R. C., & Mayer, R. E. (2011). E-learning and The Science of Instruction: Proven Guidelines For Consumers and Designer of Multimedia Learning. Pfeiffer.
Clark, R. C., & Mayer, R. E. (2016). E-learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning. Hoboken, NJ: Wiley.
Cooney, S. M., Brady, N., & Ryan, K. (2017). Spatial orienting of attention to social cues is modulated by cue type and gender of viewer. Experimental Brain Research, 235(5), 1–10.
Corrin, L., de Barba, P. G., & Bakharia, A. (2017). Using learning analytics to explore help-seeking learner profiles in MOOCs. In Proceedings of the Seventh International Learning Analytics & Knowledge Conference (pp. 424-428). ACM. DOI: http://dx.doi.org/10.1145/3027385.3027448.
Cross, A., Bayyapunedi, M., Ravindran, D., Cutrell, E., & Thies, W. (2014, February). VidWiki: Enabling the crowd to improve the legibility of online educational videos. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing (pp. 1167-1175).
Darling-Hammond, L., Orcutt, S., Strobel, K., Kirsch, E., Lit, I., & Martin, D. (2003). Feelings count: Emotions and learning. The learning classroom: Theory into practice, 89-104.
Depover, C., Karsenti, T. & Komis, V. (2018). Μαζικά Ανοικτά Διαδικτυακά Μαθήματα, φύση, προκλήσεις και προοπτικές. Αθήνα: Κλειδάριθμος.
Di Paolo, T., Wakefield, J. S., Mills, L. A., & Baker, L. (2017). Lights, camera, action: Facilitating the design and production of effective instructional videos. TechTrends, 61(5), 452-460. https://doi.org/10.1007/s11528-017-0206-.
Ding, Y. (2020). What constitutes an effective instructional video? Perspectives from Chinese EFL learners. In B. Zou & M. Thomas (Eds.), Recent developments in technology-enhanced and computer-assisted language learning (pp. 236–256). IGI.
Doolittle, P. E., Bryant, L. H. & Chittum, J. R. (2014). Effects of degree of segmentation and learner disposition on multimedia learning. British Journal of Educational Technology, 46(6), 1333–1343. https://doi.org/10.1111/bjet.12203.
Ebben, M. & Murphy, J.S. (2014). Unpacking MOOC scholarly discourse: a review of nascent MOOC scholarship. Learning Media and Technology, 39(3), 328-345.
EdTech. (2022). LMS Data – Spring 2022 Updates. Retrieved from https://edutechnica.com/.
Fiorella, L., & Mayer, R. E. (2016). Effects of observing the instructor draw diagrams on learning from multimedia messages. Journal of Educational Psychology, 108(4), 528.
Fiorella, L., & Mayer, R. E. (2018). What works and doesn't work with instructional video. Computers in Human Behavior, 89, 465-470. https://doi.org/10.1016/j.chb.2018.07.015.
Fiorella, L., & Mayer, R. E. (2018). What works and doesn't work with instructional video. https://doi.org/10.1016/j.chb.2018.07.015.
Geri, N., Winer, A., & Zaks, B. (2017). Challenging the six-minute myth of online video lectures: Can interactivity expand the attention span of learners?. Online Journal of Applied Knowledge Management, 5(1), 101-111. https://doi.org/10.36965/OJAKM.2017.5(1)101-111.
Guo, P. J., Kim, J., & Rubin, R. (2014). How video production affects student engagement: An empirical study of MOOC videos. In Proceedings of the First ACM Conference on Learning at Scale Conference (pp. 41–50). https://doi.org/10.1145/2556325.2566239.
Hansch, A., Hillers, L., McConachie, K., Newman, C., Schildhauer, T., & Schmidt, P. (2015). Video and online learning: Critical reflections and findings from the field. SSRN Electronic Journal.doi:10.2139/ssrn.2577882
Harrison, D. (2015). Assessing Experiences with Online Educational Videos: Converting Multiple Constructed Responses to Quantifiable Data International. Review of Research in Open and Distributed Learning, 16(1), 168-192.
Hew, K. F. (2016). Promoting engagement in online courses: What strategies can we learn from three highly rated MOOCS. British Journal of Educational Technology, 47(2), 320-341. https://doi.org/10.1111/bjet.12235.
Hibbert, M.C. (2014). What makes an online instructional video compelling?Online Educause Review. Retrieved from https://er.educause.edu/articles/2014/4/what-makes-an-online-instructional-video-compelling
Hollands, F. M., & Tirthali, D. (2014). MOOCs: Expectations and reality. Full report. NY: Center for Benefit Cost Studies of Education, Teachers College, Columbia University.
Hone, K. S., & El Said, G. R. (2016). Exploring the factors affecting MOOC retention: A survey study. Computers & Education, 98, 157-168. https://doi.org/10.1016/j.compedu.2016.03.016.
Hung, I-C., Kinshuk, & Chen, N.-S. (2018). Embodied interactive video lectures for improving learning comprehension and retention. Computers & Education, 117, 116–131. https://doi.org/10.1016/j.compedu.2017.10.005.
Ibrahim, M., Antonenko, P. D., Greenwood, C. M., & Wheeler, D. (2012). Effects of segmenting, signaling, and weeding on learning from educational video. Learning, media and technology, 37(3), 220-235. https://doi.org/10.1080/17439884.2011.585993.
Ibrahim, M., Callaway, R., & Bell, D. (2014). Optimizing instructional video for preservice teachers in an online technology integration course. American Journal of Distance Education, 28(3), 160-169.
Iorio-Morin, C., Brisebois, S., Becotte, A., & Mior, F. (2017). Improving the pedagogical effectiveness of medical videos. Journal of visual communication in medicine, 40(3), 96-100. https://doi.org/10.1080/17453054.2017.1366826.
Kalyuga, S., & Sweller, J. (2014). The Redundancy Principle in Multimedia Learning. In R. E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (Second Edition, pp. 247–262). Cambridge, UK: Cambridge University Press.
Karnouskos, S., & Holmlund, M. (2014). Impact of Massive Open Online Courses (MOOCs) on Employee Competencies and Innovation. Blekinge Institute of Technology.
Kay, R. H. (2014). Developing a Framework for Creating Effective Instructional Video Podcasts. International Journal of Emerging Technologies in Learning, 9(1). http://dx.doi.org/10.3991/ijet.v9i1.3335.
Kay, R., & Ruttenberg-Rozen, R. (2020). Exploring the Creation of Instructional Videos to Improve the Quality of Mathematical Explanations for Pre-Service Teachers. International Journal of E-Learning & Distance Education/Revue internationale du e-learning et la formation à distance, 35(1).
Kester, L., Lehnen, C., Van Gerven, P. W., & Kirschner, P. A. (2006). Just-in-time, schematic supportive information presentation during cognitive skill acquisition. Computers in Human Behavior, 22(1), 93–112. https://doi.org/10.1016/j.chb.2005.01.008.
Köster, J. (2018). Video in the age of digital learning. Springer International Publishing. https://doi.org/10.1007/978-3-319-93937-7.
Koumi, J. (2006). Designing video and multimedia for open and flexible learning. London, New York: Routledge.
Koumi, J. (2015). Learning outcomes afforded by self-assessed, segmented video–print combinations. Cogent Education, 2(1). https://doi.org/10.1080/2331186X.2015.1045218.
Koumi, J. (2019). Guidelines for pedagogic video design and production. http://jackkoumi.co.uk/gfp-video-production.pdf
Kravvaris, D., & Kermanidis, K. L. (2014). Speakers’ language characteristics analysis of online educational videos. In IFIP International Conference on Artificial Intelligence Applications and Innovations (pp. 60-69). Springer, Berlin,
Laaser, W., & Toloza, E. A. (2017). The changing role of the educational video in higher distance education. The International Review of Research in Open and Distributed Learning, 18(2).
Lei, C. U., Yau, C. W., Lui, K. S., Tam, V., Yuen, A. H., & Lam, E. Y. (2019). Designing instructional videos and classwork activities: teaching internet of things via flipped classroom. International Journal of Mobile Learning and Organisation, 13(4), 392-411.
Levy, Y., & Ellis, T. J. (2006). A systems approach to conduct an effective literature review in support of information systems research. Informing Science, 9.
Li, Q., & Baker, R. (2018). The different relationships between engagement and outcomes across participant subgroups in Massive Open Online Courses. Computers & Education, 127, 41–65. doi:10.1016/j.compedu.2018.08.005
Littenberg-Tobias, J., & Reich, J. (2020). Evaluating access, quality, and equity in online learning: A case study of a MOOC-based blended professional degree program. The Internet and Higher Education, 47, 100759.
Luke, K. (2020). Create Effective Instructional Videos. How To. Medical Education. Cardiff. Retrieved from https://orca.cardiff.ac.uk/id/eprint/137062/1/How-to-Create-Effective-Instructional-Videos.pdf
Mayer, R. E. (2005). Cognitive theory of multimedia learning. The Cambridge handbook of multimedia learning, 41, 31-48.
Mayer, R. E. (2008). Applying the science of learning: Evidence-based principles for the design of multimedia instruction. American psychologist, 63(8), 760.
Mayer, R. E. (2009). Multimedia learning (2nd ed.). New York: Cambridge University Press.
Mayer, R. E. (2014). Principles based on social cues in multimedia learning: Personalization, voice, image, and embodiment principles. In R. E. Mayer (Ed.), Cambridge handbook of multimedia learning (2nd ed., pp. 345–368). New York, NY: Cambridge University Press. https://doi.org/10.1017/cbo9781139547369.017.
Mayer, R. E. (2017). Using multimedia for e‐learning. Journal of Computer Assisted Learning, 33(5), 403-423.
Mayer, R. E. (2020). Multimedia learning, (3rd ed.). New York: Cambridge University Press.
Mayer, R. E. (2021). Evidence-based principles for how to design effective instructional videos. Journal of Applied Research in Memory and Cognition, 10(2), 229-240.
Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational psychologist, 38(1), 43-52.
Mayer, R. E., Fiorella, L., & Stull, A. (2020). Five ways to increase the effectiveness of instructional video. Educational Technology Research and Development, 68(3), 837-852.
Mayer, R. E., Heiser, J., & Lonn, S. (2001). Cognitive constraints on multimedia learning: When presenting more material results in less understanding. Journal of educational psychology, 93(1), 187. https://doi.org/10.1037/0022-0663.93.1.187.
Mayer, R.E., Fennell, S., Farmer, L., & Campbell, J. (2004). A personalization effect in multimedia learning: Students learn better when words are in conversational style rather than formal style. Journal of Educational Psychology, 96, 389–395. https://doi.org/10.1037/0022-0663.96.2.389.
Mercedes, A. R., Sergio, M., Jose, A. M., Belen, M., Miguel, R., Manuel, C., & Dario, A. (2016, April). Computer science MOOCs: A methodology for the recording of videos. In 2016 IEEE Global Engineering Education Conference (EDUCON) (pp. 1115-1121). IEEE.
Merrill, M. D. (2002). First principles of instruction. Educational Technology Research and Development, 50(3), 43–59. https://doi.org/10.1007/bf02505024.
Merrill, M. D. (2007). First principles of instruction: A synthesis. In R. A. Reiser & J. V. Dempsey (Eds.), Trends and issues in instructional design and technology (2nd ed., pp. 62–71). Upper Saddle River, NJ: Merrill/Prentice-Hall.
Miller, G. A. (1956). The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychological Review, 63 (2) 81-97.
Monge, R. (2007, November). Designing YouTube instructional videos to enhance information literacy. In Brick and Click Libraries: An Academic Library Symposium, Northwest Missouri State University(November 2, 2007).
Morales C. A. F., Chicaiza V. E. R. & Guerrero, J. S. (2017, April). BLMOOCs, a proposal for the design of Language MOOCs in a Blended context. In 2017 Fourth International Conference on eDemocracy & eGovernment (ICEDEG) (pp. 265-268). IEEE. https://doi.org/10.1109/icedeg.2017.7962547.
Morris, N.P., & Lambe, J. (2014). Studying a MOOC: a guide. Palgrave MacMillan. Retrieved from https://www.macmillanihe.com/resources/Product-Page-Downloads/M/Morris-Studying-a-MOOC/Studying-a-MOOC-Neil-Morris-James-Lambe.pdf.
Moussiades, L., Kazanidis, I., & Iliopoulou, A. (2016). Developing effective educational s for blended learning. In Proceedings of the 1st International association for blended learning conference (IABL2016), Kavala, Greece.
Ou, C., Joyner, D.A., & Goel, A.K. (2019). Designing and developing video lessons for online learning: A seven-principle model. Online Learning, 23(2), 82-104. https://doi.org/10.24059/olj.v23i2.1449.
Öztürk, Y. E., & Gürler, İ. (2020). Evaluation of Moodle, Canvas, Blackboard, and Open EdX. In ICT-based assessment, methods, and programs in tertiary education (pp. 363-382). IGI Global.
Patru, M., & Balaji, V. (2016). Making sense of MOOCs: A guide for policy-makers in developing countries: UNESCO and Commonwealth of Learning. Canada. ISBN: 9789231001574. Retrieved from http://oasis.col.org/bitstream/handle/11599/2356/2016_Guide-on-MOOCs-for-Policy-Makers-in-Developing-Countries.pdf
Paulus, M., Murillo, E., & Sodian, B. (2016). When the body reveals the mind: Children’s use of others’ body orientation to understand their focus of attention. Journal of Experimental Child Psychology, 148, 101–118.
Perifanou, M. (2016). Designing strategies for an efficient language MOOC. In S. Papadima-Sophocleous, L. Bradley, & S. Thouësny (Eds.), CALL communities and culture – short papers from EUROCALL 2016 (pp. 380-385). Research-publishing.net. https://doi.org/10.14705/rpnet.2016.eurocall2016.592.
Phan, T., McNeil, S. G., & Robin, B. R. (2016). Students’ patterns of engagement and course performance in a Massive Open Online Course. Computers & Education, 95, 36-44. https://doi.org/10.1016/j.compedu.2015.11.015.
Pi, Z., Xu, K., Liu, C., & Yang, J. (2020). Instructor presence in video lectures: Eye gaze matters, but not body orientation. Computers & Education, 144, 103713. https://doi.org/10.1016/j.compedu.2019.103713.
Rajadell, M., & Garriga-Garzón, F. (2017). Educational videos: After the why, the how. Intangible Capital, 13(5), 902-922. https://doi.org/10.3926/ic.1042.
Reparaz, C., Aznárez-Sanado, M., & Mendoza, G. (2020). Self-regulation of learning and MOOC retention. Computers in Human Behavior, 111, 106423.
Salimpoor, V.N., Benevoy, M., Larcher, K., Dagher, A., & Zatorre, R. (2011). Anatomically distinct dopamine release during abticipationj and experience of peak emotion to music. Nature Neuroscience, 14, 257-262. https://doi.org/10.1038/nn.2726.
Santos-Espino, J. M., Afonso-Suárez, M. D., & Guerra-Artal, C. (2016). Speakers and boards: A survey of instructional video styles in MOOCs. Technical Communication, 63(2), 101-115.
Schwartz, D. L., & Hartman, K. (2007). It is not television anymore: Designing digital video for learning and assessment. Video research in the learning sciences, 335-348.
Sokolik, M. (2014). What constitutes an effective language MOOC? In E. Martin-Monje, & E. Bárcena (Eds.), Language MOOCs: Providing learning, transcending boundaries (pp. 16–32). Berlin, Germany: Walter de Gruyter.
Stracke, C. M., & Trisolini, G. (2021). A systematic literature review on the quality of MOOCs. Sustainability, 13(11), 5817.
Swarts, J. (2012). New modes of help: Best practices for instructional video. Technical Communication (Washington), 59(3), 195–206.
Swarts, J. (2012). New modes of help: Best practices for instructional video. Technical Communication, 59(3), 195–206.
Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learning and instruction, 4(4), 295-312.
Sweller, J. (2011). Cognitive load theory. In Psychology of learning and motivation (Vol. 55, pp. 37-76). Academic Press.
Sweller, J., van Merriënboer, J. J., & Paas, F. (2019). Cognitive architecture and instructional design: 20 years later. Educational Psychology Review, 31(2), 261-292.
Sweller, J., van Merriënboer, J. J., & Paas, F. G. (1998). Cognitive architecture and instructional design. Educational psychology review, 10(3), 251-296.
Thomson, A., Bridgstock, R., & Willems, C. (2014). Teachers flipping out'beyond the online lecture: Maximising the educational potential of video. Journal of Learning Design, 7(3), 67-78.
Watson, W. R., Kim, W., & Watson, S. L. (2016). Learning outcomes of a MOOC designed for attitudinal change: A case study of an Animal Behavior and Welfare MOOC. Computers & Education, 96, 83-93. doi:10.1016/j.compedu.2016.01.013
Wijnker, W., Bakker, A., Van Gog, T., & Drijvers, P. (2019). Educational videos from a film theory perspective: Relating teacher aims to video characteristics. British Journal of Educational Technology, 50(6), 3175-3197.
Yepes-Baldó, M., Romeo, M., Martín, C., García, M. Á., Monzó, G., & Besolí, A. (2016). Quality indicators: Developing “MOOCs” in the european higher education area. Educational Media International, 53(3), 184-197.
Younger, W. R. (n.d.). What are the key techniques required to create instructional videos? Version 2. Retrieved from https://www.chiark.greenend.org.uk/~ryounger/assets/Key_techniques_for_instructional_videos.pdf
Zhang, D., Zhou, L., Briggs, R. O., & Nunamaker Jr, J. F. (2006). Instructional video in e-learning: Assessing the impact of interactive video on learning effectiveness. Information & management, 43(1), 15-27.
Zhu, Y., Pei, L., & Shang, J. (2017). Improving video engagement by gamification: A proposed design of MOOC videos. In Proceedings of the International Conference on Blended Learning (pp. 433-444). New York, NY: Springer. https://doi.org/10.1007/978-3-319-59360-9_38.
Βεργίδης, Δ., Λιοναράκης, Α., Λυκουργιώτης, Α., Μακράκης, Β., και Ματραλής, Χ. (2019). Ανοικτή και εξ αποστάσεως εκπαίδευση. Θεσμοί και Λειτουργίες (Τόμος Α). Πάτρα: ΕΑΠ.
Σοφός, Α. Λ. (2021). Επισκοπική μελέτη κριτηρίων αξιολόγησης εκπαιδευτικών βίντεο. Open Journal of Animation, Film and Interactive Media in Education and Culture [AFIMinEC], 2(1). https://doi.org/10.12681/afiinmec.27153
Σοφός, Α., & Γιασιράνης, Σ. (2022). Η ταινία και το βίντεο στην εκπαίδευση [Μεταπτυχιακό εγχειρίδιο]. Κάλλιπος, Ανοικτές Ακαδημαϊκές Εκδόσεις. http://dx.doi.org/10.57713/kallipos-58
Most read articles by the same author(s)