THE INFLUENCE OF EMOTION WITH DIFFERENT LEVELS OF REALISMS OF ANIMATED TALKING-HEADS ON STUDENT PRONUNCIATION LEARNING IN COMMUNITY COLLAGES
Keywords:
animation, emotion, courseware, talking head, realism levelsAbstract
This study aims to evaluate the influence of emotion with different levels of realism of
animated talking-heads on student pronunciation learning. Emotional evaluation was made after
students completed their learning based on courseware provided to them. Four animated
talking-head courseware with various levels of realism were developed and tested. These
models composed of unrealistic 3D (3D-NR) , realistic 3D (3D-R), 2D animated (2d) and real
human (HUMAN) talking-head. A total of 150 students in a Semester 1 course for a Certificate
in Creative Multimedia Animation at four Community Colleges were sampled for the study.
overall, test scores of descriptive, linear regression and multiple linear regression analysis was
used to answer the research questions. The results have shown that emotion is significant as a
partial mediator in influencing student pronunciation learning based on realism levels of
animated talking head.
References
Ahmad Zamzuri, M. A., & Kogilathah, S. (2013). 3D Talking-head mobile app: A conceptual framework for english pronunciation learning among non-native speakers. English Language Teaching, 6(8), 66-76.
Ahmad Zamzuri M.A., Laili Farhana M.I., & Syamsulaini S. (2012). Model reka bentuk instruksi DIDEA. In
Ahmad Zamzuri et al. (Eds). Pembelajaran Berasaskan Web: Isu dan Trend (pp. 13-25). Tanjong Malim, Malaysia: Penerbit UPSI.
Alessi S. M., & Trollip, S.R. (2001). Multimedia for learning: Methods and development (3rd ed.). Boston: Allyn & Bacon.
Bartneck, C., Kanda, T., Ishiguro, H., & Hagita, N. (2007). Is the uncanny valley an uncanny cliff? Proceedings of the 16th IEEE, RO-MAN 2007, 368-373. doi:10.1109/ROMAN.2007.4415111.
Brutcher, N.C. (2013). Avoiding the uncanny valley effect in education films for children. Proceedings of the INTED2013, 978-984 March, Valencia EJ ISSN 2340-1079 (2012).
Butler, M., & Joschko, L. (2009). Final fantacy or the incredibles, animation studies. Journal for Animation History and Theory, 8(1), 15-24.
Burleigh, T. J., Schoenherr, J. R., & Lacroix, G. L. (2013). Does the uncanny valley exist? An empirical test of the relationship between eeriness and the human likeness of digitally created faces, Computers in Human Behavior, 29(3), 759-771, doi: 10.1016/j.chb.2012.11.021.
Cosker, D., Paddock,S., Marshall, D., Rosin, P.L., & Rushton, S. (2005).Towards perceptually realistic talking heads: Models, methods and mcgurk. Journal of CM Transactions on Applied Perception, 2(3), 270-285.
Cook, V. (1996). Second language learning and language teaching. London: Arnold.
Creswell, J. W. (2012). Educational research: Planning, conducting and evaluating quantitaive and qualitative research (4 th ed.) Boston: Pearson.
Dey, P., Maddock, S. & Nicolson, R. (2010). Evaluation of a viseme-driven talking head. Proceedings of the EG UK Theory and Practice of Computer Graphics, 118-116.
Feldman, B. L., & Russell, J. A. (1998). Independence and bipolarity in the structure of current affect. Journal of Personality and Social Psychology, 74(2), 967–984. doi: 10.1037/0022-3514.74.4.967.
Farag, M., & Shemy, N. (2011). Course delivery through the web: Effects of linear/nonlinear navigation and individual differences in online learning. International Journal on E-Learning, 10(3), 243-271.
Geller, T. (2008). Overcoming the uncanny valley. IEEE Computer Graphics and Applications, 28(4), 11-17.
Gilakjani, A.P. (2012). The significance of pronunciation so difficult? Canadian Center of Science Education, 4(3), 74-83.
Goleman, D. (1995). Emotional Intelligence: Why It Can Matter More Than IQ. New York: Bantam Books.
Hariati, A., & Mun, L. (2011). Minding our languange. The Star Oline. Retrieved form http://thestar.com.my/news/story.asp?file=/2011/4/10/nation/8357917&sec=nation.
Hyde, J., Kiesler, S., Hodgins, J.K., & Carter, E.J. (2014). Conversing with children: Cartoon and video people elicit similar conversational behaviors. Proceedings of the 32nd annual ACM conference on Human factors in computing systems, 1787-1796.
Jones, R. H. (2002). Beyond listen and repeat: Pronunciation teaching materials and theories of second language acquisition. In Richards, J. C. & Renandya, W. A. (Eds.). Methodology in language teaching: An anthology of current practice (pp. 12-16). Cambridge University Press, Cambridge.
Institut Penyelidikan Pendidikan Tinggi Negara (2003). Kajian masalah pengangguran di kalangan siswazah. Pulau Pinang: USM.
Kaba, F. (2013). Hyper realistic characters and the existence of the uncanny valley in animation films. International Review of Social Sciences and Humanities, 4(3), 188-195.
Kensinger , E. A., & Corkin, S. (2003). Effect of negative emotional content on working memory and long-term memory. American Psychological Association, 3(4), 378-393. doi: 10.1037/1528-3542.3.4.378Levis, J. M. (2005). Changing contexts and shifting paradigms in pronunciation teaching. TESOL Quarterly, 39(3), 369-377.
Levesque, R. (2006). Spss programming and data management, A guide for spss users. Chicago: SPSS Ins.
Liu, K., & Ostermann, J. (2011). Evaluation of an image-based talking head with realistic facial expression and head motion. Journal on Multimodal User Interfaces, Special issue: Emotion-based Interaction, 5(2),37-44.
Liu, Y., Massaro, D.W., Chen, T.H., Chan, D., & Perfetti, C. (2007) Using visual speech for training chinese pronunciation: an in-vivo experiment. Proceedings of the SLaTE Workshop on Speech and Language Technology in Education, 233-241. October, Farmingon EJ ISSN 1324-9339 (2007).
Massaro, D.W., Bigler, S., Chen, T., Perlman, M., & Ouni, S. (2008). Pronunciation training: The role of eye and ear. Proceedings of Interspeech 2008, 2623-2626 March, September EJ ISSN 1990-9772 (2008).
Mayer, R. E., & Moreno, R. (2002). Aids to computer-based multimedia learning. Learning and Instruction, 12 (1), 107–119.
Mohd. Najib, A. G. (2003). Reka bentuk tinjauan soal selidik pendidikan. Skudai: Penerbit Universiti Teknologi Malaysia.
Mohd Najib, H., & Ahmad Zamzuri, M. A. (2014). Kesan tahap realistik karakter animasi talking-head ke atas emosi dan prestasi pelajar: Satu kajian awal. Asia-Pasific Journal of Information Technology and Multimedia, 3(2), 15-27.
Mohd Najib, H., & Ahmad Zamzuri, M. A. (2013). Pengaruh psiko - pembelajaran terhadap pembelajaran dan pencapaian pelajar sijil modular English For Communication di Kolej Komuniti. Seminar Penyelidikan Kolej Komuniti Zon Utara, 375-385 Mei, Sintok EJ ISSN 1313-9739 (2013).
Mohd Rakime, S. (2002). Hubungan kecerdasan emosi dengan pencapaian akademik: Kajian di kalangan pelajar Sarjana Muda Kejuruteraan KUiTTHO. (Unpublished master’s thesis). Batu Pahat: Kolej Universiti Teknologi Tun Hussein OnnMoore, R. K. (2012). A Bayesian explanation of the ‘Uncanny Valley’ effect and related psychological phenomena. Nature Scientific Reports, 2(2), 10-23.
Moore, S. C., & Oaksford, M. (2002). Emotional cognition: From brain to behavior. Amsterdam: John Benjamin’s Publishing Company.
Moreno, A., Joy, M., & Sutinen, E. (2013). Roles of animation tools in understanding programming concepts. Journal of Educational Multimedia and Hypermedia, 22(2), 165-184.
Mori, M. (2012). The uncanny valley. IEEE Robotics & Automation Magazine, 19(2), 98–100.
Morley, J. (1998, January). Trippingly on tangue. Putting serious speech instruction back to TESOL equation. ESAL Magazine, 20-23.
Nor Fadila, M.A., & Adibah, A. R.(2009). Tahap penguasaan bahasa inggeris sebagai persediaan untuk kerjaya dalam kalangan pelajar pendidikan teknikal dan kejuruteraan. Unpublished bachelor's thesis, Universiti Teknologi Malaysia, Skudai, Malaysia.
Pallant, J. (2007). SPSS survival manual: A step-by-step guide to data analysis using SPSS for Windows. Crows Nest West: Allen & Unwin.
Pekrun, R., Goetz, T., Frenzel, N.C., Barchfeld, P., &. Perry, R.P. (2011). Measuring emotions in students’ learning and performance: The achievement emotions questionnaire (AEQ). Contemporary Educational Psychology, 36(1), 36–48.doi:10.1016/j.cedpsych.2010.10.002.
Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002). Academic emotions in students’ self-regulated learning and achievement: A program of quantitative and qualitative research. Educational Psychologist, 37(2), 91-106. Retrieved from http://kops.unikonstanz.de/bitstream/handle/123456789/13885/Pekrun_Goetz_2002_academic%20emotions-.pdf?sequence=2.
Piwek, L., Mckay, L.S. Pollick, F. E. (2014). Empirical evaluation of the uncanny valley hypothesis fails to confirm the predicted effect of motion. Cognition, 130(3), 271-277.
Rozinah, J. (2005). Multimedia dalam pendidikan. Kuala Lumpur: Utusan
Ruthing, J. C., Perry, R. P., Hladky, J. S., Hall, N. C., Pekrun, R., & Chipperfield, J. G. (2011). Perceived control and emotions: Interactive effects on performance in achievement settings. Social Psychology of Education, 11(2), 161-180. doi:10.1007/s11218-007-9040-0.
Saran, M., Saferoglu, G., & Cagiltay, K. (2009). Mobile asisted languange learning: English pronunciation at leaners’ fingertips. Eurasian Journal of Education Research, 34 (3), 97-114.
Saygin, A. P., Charminade, T., & Ishiguro, H. (2010). The perception of humans and robots: uncanny hills in parietal cortex. Proceedings of the 32nd Annual Conference of the Cognitive Science Society, 2716-2720, Mei, Austin EJ ISSN 1322-9299 (2010).
Shyamlee, S. D., Skills, C., & Vidyanagar, V. (2012). Use of technology in English language teaching and learning: An Analysis. International Conference on Language, 150-156 June, Brisbane EJ ISSN 1312-9219 (2012).
Tinwell, A. & Sloan, R.J. S. (2014). Children's perception of uncanny human-like virtual characters. Computers in Human Behavior, 36 (4), 286-296.
Tinwell, A., & Grimshaw, M. (2009). Bridging the uncanny: an impossible traverse? Proceedings of the 13th International MindTrek Conference, 66-73, October, Tempere EJ ISSN 1312-8239 (2009).
Tinwell, A. (2009). Uncanny as usability obstacle: Games computing and creative technologies. Journal Online Communities and Social Computing, 36 (5) 622-631.
Tinwell, A., Grimshaw, M., & Williams, A. (2010). Uncanny behavior in survival horror games. Journal of Gaming & Virtual Worlds, 2(1), 3–25.
Tinwell, A., Grimshaw, M., Abdel Nabi, D., & Williams, A. (2011). Facial expression of emotion and perception of the Uncanny Valley in virtual characters. Computers in Human Behavior, 27(2), 741-749.
Varasarin . P. (2007). An action research study of pronunciation training, language learning strategies and speaking confidence. Unpublished doctoral’s thesis, Victoria University Victoria, England
Wang, H., Han, W., Soong, F. & Huo, Q. (2011). Text Driven 3d photo-realistic talking head. Proceedings of the Interspeech, 307-3308, April, Florence EJ ISSN 1314-9239 (2011).
Wik, P. & Hjalmarrson, A. (2009). Embodied conversational agents in computer asistested languange learning. Speech Communication, 51(10), 1024-1037.
