Understanding the roles of images and intermodal relationships for optimized use of visual and verbal resources in Vietnam’s textbooks for lower secondary levels

Yusnita Febrianti, Thao Vu

Abstract


The study investigates the roles of images and intermodal relationships of both language and images in two English textbooks used in Vietnamese lower secondary schools, namely Tieng Anh and Solutions textbooks to gain insights on the ways to optimise the use of both language and images as resources in teaching and learning activities. Kress and Van Leeuwen’s (1996, 2006) framework on the grammar of visual design is used to analyse the images, looking at the types of image representations and the compositional meanings. The language-image relationships in the books, on the other hand, are analysed using the framework of Intermodal Identification (Unsworth & Cleirigh, 2014). Intermodal identification is built on the notion that language complements the meaning of the image and vice versa. Language identifies image by glossing the image participants which are not encoded in the language elements. Image identifies language in three aspects: intensive to visualise quality such as shape, colour, or texture, possessive to visualise additional participants which are not explicitly addressed in the language and circumstantial to visualise the elements of locations in the language.  While image in textbooks has always been considered essential as a source of teaching and learning materials as well as helping students to learn, this study suggests that the role of image is augmented when juxtaposed with the accompanying language. The study implies the need for further investigation, for example in the classroom action research on how language and image resources can be utilised in teaching and learning activities.  Also, the result of the study may be replicated to analyse language-image relationship in different samples of textbooks.

Keywords: images, language,English textbooks, language-image relationship/interaction

Memahami peran gambar dan hubungan intermodal untuk optimalisasi penggunaan sumber visual dan verbal dalam buku teks bahasa Inggris untuk siswa sekolah menengah di Vietnam

Penelitian ini menyelidiki peran gambar dan hubungan antar moda dari kedua bahasa dan gambar dalam dua buku teks bahasa Inggris yang digunakan di sekolah menengah pertama Vietnam, yaitu buku teks Tieng Anh dan Solutions untuk mendapatkan wawasan tentang cara mengoptimalkan penggunaan bahasa dan gambar sebagai sumber daya di kegiatan belajar mengajar. Kerangka kerja dari Kress dan Van Leeuwen (1996, 2006) tentang tata bahasa desain visual digunakan untuk menganalisis gambar, melihat jenis representasi gambar dan makna komposisi. Kemudian, hubungan bahasa-gambar dalam buku dianalisis menggunakan kerangka Identifikasi Intermodal (Unsworth & Cleirigh, 2014). Identifikasi intermodal dibangun di atas gagasan bahwa bahasa melengkapi makna gambar dan sebaliknya. Bahasa mengidentifikasi gambar dengan mengilapkan peserta gambar yang tidak dikodekan dalam elemen bahasa. Gambar mengidentifikasi bahasa dalam tiga aspek: intensif untuk memvisualisasikan kualitas seperti bentuk, warna, atau tekstur, posesif untuk memvisualisasikan peserta tambahan yang tidak secara eksplisit dibahas dalam bahasa dan sirkumstansial untuk memvisualisasikan elemen lokasi dalam bahasa. Sementara gambar dalam buku teks selalu dianggap penting sebagai sumber bahan ajar dan pembelajaran serta membantu siswa untuk belajar, penelitian ini menunjukkan bahwa peran gambar bertambah ketika disandingkan dengan bahasa yang menyertainya. Penelitian ini menunjukkan pentingnya penelitian lanjutan, misalnya dalam bentuk penelitian tindakan kelas untuk mengetahui bagaimana bahasa dan gambar dapat dimanfaatkan dalam kegiatan belajar mengajar. Juga, hasil penelitian ini dapat direplika untuk menganalisis hubungan bahasa-gambar dalam sampel buku teks yang berbeda.

Kata kunci: bahasa, gambar, buku teks, bahasa Inggris, hubungan/interaksi bahasa-gambar


Full Text:

PDF

References


Bui, T. T. N., & Nguyen, H. (2016). Standardizing English for educational and socio-economic betterment – A critical analysis of English language policy reforms in Vietnam. In R. Kirkpatrick (Ed.), English language education policy in Asia (pp. 363-388). Springer.

Carney, R., & Levin, N. (2002). Pictorial illustrations still improve students' learning from text. Educational Psychology Review, 14(1), 5-26.

Chegeni, N., Kamali, B., Noroozi, A., & Chegeni, N. (2016). General English textbook evaluation: A closer look at "Four Corners". Theory and Practice in Language Studies, 6(12), 2325.

Chen, Y. (2010). Exploring dialogic engagement with readers in multimodal EFL textbooks in China. Visual Communication, 9(4), 485-506.

Falla, T., & Davies, P. (2013). Solutions: Pre-intermediate student's book (2 ed.). Oxford University Press.

Hoang, V. V., Nguyen, T. C., Le, K. D., Phan, C. N., Vu, M. T., Luong, Q. T., & Kaye, D. (2015a). Tieng anh 6-9 sach hoc sinh. Vietnam Education Publishing House.

Hoang, V. V., Nguyen, T. C., Le, K. D., Phan, C. N., Vu, M. T., Luong, Q. T., Kaye, D. (2015b). Tiếng anh 6 sách học sinh Tập 2. Vietnam Education Publishing House.

Hsu, P., & Yang, W. (2007). Print and image integration of science texts and reading comprehension: A systemic functional linguistics perspective. International Journal of Science and Mathematics Education, 5(4), 639-659.

Kress, G. (2000). Multimodality: Challenges to thinking about language. TESOL Quarterly, 34(3), 337-340.

Kress, G. R., & Van Leeuwen, T. (1996). Reading images: The grammar of visual design (1st ed.). Routledge.

Kress, G. R., & Van Leeuwen, T. (2006). Reading Images: The grammar of visual design (2nd ed.). Routledge.

Le, V. C. (2015). English language innovation for the Vietnamese secondary school: The Project 2020. In B. Spolsky & K. Sung (Eds.), Secondary school English in Asia: From policy to practice. Routledge.

Lemke, J. L. (1998). Multiplying meaning: Visual and verbal semiotics in scientific text. In J.R. Martin and R. Veel (Eds.), Reading science: Critical and functional perspectives on discourses of science (pp.87–113). Routledge.

Levin, J. R., & Mayer, R. E. (1993). Understanding illustrations in text. Learning from textbooks: Theory and practice, 95-113.

Mickan, P. (2006). Socialisation, social practices and teaching. In P. Mickan, I. Petrescu, & J. Timoney (Eds.), Social practices, pedagogy and language use: Studies in socialisation (pp. 7-23). Lythrum Press.

Mickan, P. (2017) Text-based research and teaching from a social semiotic perspective: Transformative research and pedagogy. In Mickan, P., & Lopez, E., (Eds) Text-based research and Teaching: A social semiotic perspective on language in use. Palgrave Macmillan.

MOET. (2014). The six-level language proficiency framework for Vietnam. Hanoi, Vietnam.

Mukundan, J. & Kalajahi, S. A. R. (2013). Evaluation of Malaysian English language teaching textbooks. International Journal of Education and Literacy Studies, 1(1), 38-46.

Mukundan, J., & Nimehchisalem, V. (2012). Evaluative criteria of an English language textbook evaluation checklist. Journal of Language Teaching and Research, 3(6), 1128-1134.

O'Halloran, K. (2008). Systemic functional-multimodal discourse analysis (SF-MDA): Constructing ideational meaning using language and visual imagery. Visual Communication, 7(4), 443-475.

Painter, C., Martin, J. R., & Unsworth, L. (2013). Reading visual narratives: Image analysis of children's picture books. Equinox Publishing Ltd.

Peeck, J. (1993). Increasing picture effects in learning from illustrated text. Learning and Instruction, 3(3), 227-238.

Prime Minister Nguyen Tan Dung. (2008). Decision 1400: Teaching and learning foreign language education in the national education system in the period 2008-2020. Hanoi, Vietnam.

Rahmaningtyas, H., Febrianti, Y., & Inayati, N., (2017) Using student-selected texts in speaking classes. In Mickan, P., & Lopez, E., (Eds.), Text-based research and teaching: A social semiotic perspective on language in use (pp. 305-324). Palgrave Macmillan.

Royce,T. (1998). Synergy on the page: Exploring intersemiotic complementarity in page-based multimodal text. JASFL Occasional Papers, 1(1): 25-49.

Royce, T. (2002). Multimodality in the TESOL classroom: Exploring visual–verbal synergy’, TESOL Quarterly, 36(2): 191–205.

Unsworth, L. (2001). Teaching multiliteracies across the curriculum: Changing contexts of text and image in classroom practice. Open University Press.

Unsworth, L. (2006). Multiliteracies and a metalanguage of image/text relations: Implications for teaching English as a first or additional language in the 21st century. TESOL in Context, 16 (Special edition), 147-162.

Unsworth, L. (2014). Multimodal reading comprehension: Curriculum expectations and large-scale literacy testing practices. Pedagogies: An International Journal, 9, 26-44.

Unsworth, L., & Chan, E. (2009). Bridging multimodal literacies and national assessment programs in literacy. Australian Journal of Language and Literacy, 32(3), 245-257.

Unsworth & Cleirigh, C. (2014) Multimodality and reading: The construction of meaning through image-text interaction. In Jewitt, C., & Jewitt, C., (Eds.), The Routledge handbook of multimodal analysis. Routledge.

Unsworth, L., & Ngo, T. (2015). Vai trò của hình ảnh trong sách giáo khoa dạy tiếng Anh ở Việt Nam [The role of visual images in English textbooks in Vietnam]. The Journal of Language and Life, 2015(1), 93-99.

Widiastuti, R., (2017) A Socio-semiotic perspective on a unit of work in an Indonesian textbook. In Mickan, P., & Lopez, E., (Eds), Text-based research and teaching: A social semiotic perspective on language in use (pp. 179-192), Palgrave Macmillan.




DOI: http://dx.doi.org/10.17977/um015v51i12023p54

Refbacks

  • There are currently no refbacks.



Bahasa dan Seni: Jurnal Bahasa, Sastra, Seni, dan Pengajarannya is licensed under
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Web
AnalyticsView My Stats
Based on the Official Letter from the Director General of Higher Education, Research, and Technology, the Ministry of Education, Culture, Research, and Technology No 158/E/KPT/2021, dated December 27, 2021, Bahasa dan Seni: Jurnal Bahasa, Sastra, Seni dan Pengajarannya is granted RANK 2 JOURNAL SCIENTIFIC ACCREDITATION PERIOD I YEAR 2021. This rating status is valid for 5 (five) years up to Vol 53, No 1, 2025.

Dear Sir/Madam

We appreciate your continued confidence and trust in Bahasa dan Seni: Jurnal Bahasa, Sastra, Seni, dan Pengajarannya (JBS). In order to enhance the service, readability, and quality of JBS publications, we will be transitioning to a new website, https://citeus.um.ac.id/jbs, in collaboration with Digital Commons (Elsevier) starting in July 2024.

Sincerely

Yusuf Hanafi
(Editor in chief)


Editorial Office:
Gedung D16 Lantai 2 Fakultas Sastra UM Jl. Semarang 5 Kota Malang, Jawa Timur, Indonesia 65145

Publisher:
Fakultas Sastra, Universitas Negeri Malang, Indonesia
JPtpp is licensed under