Multimodality in Audio-Verbo-Visual Translation
Abstract
Until the end of the 20th century, a part of applied linguistics, translation still focuses primarily on verbal rendering. Language elements are explored extensively in translationstudies.Theexplorationsincludeconceptsofequivalence,shift,modulation, and untranslatability. That texts are not only in the form of verbal languages but also audio, visual, gestural, and digital ones has triggered translation studies to explain phenomenaarisingfromtherenderingofintersemiotictexts.Thisstudyaimstoexplain the application of multimodality in the translation of verbo-visual text including the degree of accuracy, naturalness, and acceptability of Indonesian texts translated from English. The object of this study is English Audio-verbo-visual texts and their translationsinIndonesian.Thetypesoftextsinquestionincludevarioustextualgenres commonly existing in dubbing, subtitling, comic and comic rendering. The data for this study were obtained through documentatary studies and were analyzed using the conceptofphenomenology.Theresultsofthisstudyindicatethateachtexttypehasits owncharacteristicssothatintersemiotictranslationcanbedifferentfromonerendering to another. The multimodality of translation may bridge the transfer of meaning in intersemiotic rendering, especially from English to Indonesian.
Keywords: intersemiotic translation; multimodality; verbo-visual rendering.
References
[1] Aso, I.S. (2012). Beyond words: A multimodal approach to translation applied to global standardised advertising campaigns in international women’s magazines. A thesis for the degree of Doctor of Philosophy. The University of Exeter.
[2] Branco, S,deO. (2014). The application of intersemiotic translation combined with multimodal activities in the English as a foreign language classroom. Available in: http://www.redalyc.org/articulo.oa?id=339831539004
[3] Camiciottoli, B.C., & Fortanet-Gómez, I. (Eds). (2015). Multimodal analysis in academic settings: from research to teaching. New York & London: Routledge Taylor and Francis.
[4] Catford, J.C. (2000). Translation Shifts, in Venuti. (Ed.). The Translation Studies Reader. London & New York: Rourledge (Taylor & Francis e-Library)
[5] Chiaro, D. Issues in audiovisual translation. Translation Studies Portal. www. routledgetranslationstudiesportal.com
[6] Dena, C. (2010). Beyond multimedia, narrative, and game: The contributions of multimodality and polymorphic fictions. In Page (Ed), pp.183-201.
[7] Dezheng, Feng. (2011). Visual Space and Ideology: A Critical Cognitive Analysis of Spatial Orientations in Advertising. In O’Halloran & Smith (Eds.), pp. 55-75
[8] Diani, Giuliana. (2015). Visual Communication in Applied Linguistics Conference Presentations. In Camiciottoli & Fortanet-Gómez (eds.), pp. 83-106.
[9] Díaz-Cintas, Jorge and Anderman, Gunilla. (Eds.). (2009). Audiovisual translation: Language transfer on screen. New York: Palgrave Macmillan.
[10] Dufour, F. & Schulte, R.. (2013). Translation moving toward the digital age. www. utdallas.edu/atec/translations/
[11] Dusi, N. (2015). Intersemiotic translation: Theories, problems, analysis. Semiotica, 206, 181–205. OI: 10.1515/sem-2015-0018
[12] Fortanet-Gómez, Inmaculada & Camiciottoli, Belinda Crawford. (2015). Introduction. In Camiciottoli & Fortanet-Gómez (Eds.), pp. 1-16.
[13] Goebel, Zane. (2011). Enregistering Identity in Indonesian Television Serials: A Multimodal Analysis. In O’Halloran and Smith (Eds.), pp. 95-114.
[14] Hasler, B.S., Salomon, O., Tuchman, P. et al.. (2017). Real-time Gesture Translation in Intercultural Communication. AI & SOCIETY Journal of Knowledge, Culture and Communication, 32(1), 25-35. Doi: https://doi.org/10.1007/s00146-014-0573-4
[15] Hutcheon, M., & Hutcheon, L. (2010). Opera forever and always multimodal. In Page (Ed), pp. 65-77.
[16] Jakobson, R. (1959/2000): On linguistic aspects of translation. In: Lawrence Venuti, ed. The Translation Studies Reader. London: Routledge, 113-118.
[17] Jan-Emil Tveit. (2009). Dubbing versus Subtitling: Old Battleground Revisited. Cintas, Jorge Díaz and Anderman, Gunilla. (Eds.), pp. 85-96.
[18] Ketola, A. (2015). Towards a multimodally oriented theory of translation: A cognitive framework for the translation of illustrated technical texts.Translation Studies, DOI: 10.1080/14781700.2015.1086670
[19] Matkivska, Nataliia. (2014). Audiovisual translation: Conception, types, characters’ speech and translation strategies applied. Studies About Languages, 25, 38-44. http://dx.doi.org/10.5755/j01.sal.0.25.8516
[20] Munday, J. (2008), Introducing TranslationStudiesTheories and applications 2nd Edition. London & New York: Routledge.
[21] Musyoka, E.N., & Karanja, P.N. (2014). Problems of interpreting as a means of Communication: A Study on Interpretation of Kamba to English Pentecostal Church sermon in Machakos Town, Kenya. International Journal of Humanities and Social Science, 4(5), 196-2017. www.ijhssnet.com
[22] Norris, S. (2004). Analyzing multimodal interaction: a methodological Framework. New York & London: Routledge Taylor and Francis.
[23] O’Halloran, K. L., & Smith, B. A. (Eds.). (2011). Multimodal studies: exploring issues and domains. New York & London: Routledge Taylor and Francis.
[24] Page, R. (Ed). (2010). New perspectives on narrative and multimodality. New York & London: Routledge Taylor and Francis.
[25] Petraru, A.M. (2015). Intralingual Translation – A Romanian Perspective. International Journal of Communication Research, 5(1), 31-39. www.ijcr.eu/articole/ 222_06{%}20INTRA LINGUAL% 20TRANSLATION.pdf
[26] Ruiz-Madrid, Noelia & Fortanet-Gómez, Inmaculada. (2015). Contrastive Multimodal Analysis Conference Plenary Lectures in English and in Spanish. In Camiciottoli & Fortanet-Gómez (Eds.), pp. 39-60.
[27] Shuttleworth,. (1997). Dictionary of Translation Studies,
[28] Snell-Hornby. M. (2006). The Turns of Translation Studies: New paradigms or shifting viewpoints? The Netherland & Philadelphia: John Benjamins Publishing.
[29] Van Meerbergen, S. (2008). Dutch picture books in Swedish translation towards a model for multimodal analysis. IN De Crom, D. (ed.). Translation and the transformation of identities. Selected papers of the cetra research seminar in translation studies. http://www.kuleuven.be/cetra/papers/papers.html
[30] Venuti, L. (Ed.). (2000).The translation studies reader. London & New York: Rourledge (Taylor & Francis e-Library).
[31] Wignell, P. (2011). Picture Books for Young Children of Different Ages: The Changing Relationships between Images and Words. In O’Halloran and Smith (Eds.), pp. 202- 219.
[32] Zethsen, K. (2009). Intralingual Translation: An Attempt at Description. Meta, 54(4), 795–812. doi:10.7202/038904ar