-電影《水形物語》的多模態(tài)話語分析

1、The Multimodal Discourse Analysis of the Film The Shape Of Water目錄Abstract摘要Abbreviation1.Introduction1.1.Background of the study1.2.Objective of the study1.3.Outline of the paper2.Literature Review2.1 Studies on the Multimodal Discourse Analysis aboard2.2Studies on the Multimodal Discourse Analysis

2、 at home3.Research Questions and Methods3.1 Research Questions3.2 Research Methods3.3 Data collection and Analysis4.Proposed Results and Discussion4.1 Analysis of the Reprentational Meaning4.1.1 Analysis of the Narrative Process Action Process Reactional process4.1.2 The Analysis of th

3、e Conceptual Process4.2 The Analysis of the Interactive Meaning4.2.1 Contact Demand Offer4.2.2 Social Distance Social Distance between the Represented Participants and the Viewers Social Distance between the Represented Participants4.2.3 Perspective Horizontal Pers

4、pective Vertical Perspective4.2.4 Modality Color Contextualization Illumination4.3 Analysis of the Compositional Meaning4.3.1 Information Value4.3.2 Salience4.4 Synthetic Analysis of Sounds and Images4.4.1 The Analysis of Voiceover, Natural Sounds and Images4.4.2 The Anal

5、ysis of Music and Images5.Conclusion5.1 Research Findings5.2 Implications of the study5.3 Limitations of the paper5.4 Suggestions for Further ResearchReference摘要隨著科學(xué)技術(shù)的迅速發(fā)展，多媒體互聯(lián)網(wǎng)的應(yīng)用越來越普及。人們進(jìn)行信息交流的方式趨向簡單快捷，而視頻的流通滿足了這一點要求。視覺媒體作為一種信息構(gòu)建交流的工具發(fā)揮著越來越重要的作用。因此，傳統(tǒng)的以文本和語言為研究對象的語篇分析己經(jīng)不能滿足對如今多模態(tài)的語篇意義構(gòu)建的分析。為了解決這

6、個問題，語言學(xué)家開始嘗試對不同模態(tài)下的語篇進(jìn)行分析，多模態(tài)話語分析開始出現(xiàn)。多模態(tài)話語是指運用聽覺、視覺、觸覺等多種感覺，通過語言、聲音、圖像、動作等多種手段和符號資源進(jìn)行交際的現(xiàn)象。多模態(tài)話語的研究意義在于，它能將語言與其他符號系統(tǒng)在社會交流實踐中整合起來。隨著語篇變得越來越多模態(tài)化，我們在對其分析時就需要將各種符號模態(tài)考慮進(jìn)來，這樣才能在這個多模態(tài)的時代，得到一個對語篇更加準(zhǔn)確和深刻的理解。本文主要采用案例分析的研究方法。本文基于Kress和Leeuwen提出的圖像具有三種意義表達(dá)方式:表征意義、互動意義和構(gòu)圖意義，對電影水形物語進(jìn)行了研究。該多模態(tài)話語分析方法可以全面分析圖像所要表達(dá)的信

7、息，幫助人們更好地理解及接收信息。本文從這個角度出發(fā)，引用視覺語法為主要理論依據(jù)。本文從網(wǎng)上獲取視頻資源，運用愛奇藝軟件截圖，從電影水形物語中截取了大量圖像，分別對其表征意義、互動意義和構(gòu)圖意義進(jìn)行了詳細(xì)的分析，有助于觀影者更深入地理解該電影。此研究在理論層面不僅拓寬了多模態(tài)話語分析的領(lǐng)域，驗證了系統(tǒng)功能語言學(xué)理論對分析帶有圖像的多模態(tài)電影語篇的可行性和可操作性，也對提高人們多模態(tài)話語識讀能力及為觀眾賞析此電影提供一個新的視角。關(guān)鍵詞:多模態(tài)話語分析；視覺語法；水形物語AbstractWith the rapid development of science and technology, t

8、he application of multimedia Internet is becoming more and more popular. The way people exchange information tends to be simple and quick, and the circulation of video meets this requirement. The visual media is playing an increasingly important role as a tool for information communication. Therefor

9、e, the traditional discourse analysis using text and language as the research object has not been able to satisfy the analysis of the multimodal discourse construction. In order to solve this problem, linguists began to try to analyze discourses in different modalities, and Multimodal Discourse Anal

10、ysis appears in time,Multimodal Discourse refers to the use of auditory, visual, and tactile sensations to communicate through various means such as language, sound, image, and movement, and symbol resources. The research significance of Multimodal Discourse is that it can integrate language with ot

11、her symbol systems in social communication practice. As discourse becomes more and more modal, we need to take into account various symbolic modalities when we analyze it, so that we can get a more accurate and deeper discourse understanding.This study will adopt the method of case study. This paper

12、 based on the theory three kinds of meanings in visual grammar proposed by Kress and Leeuwen: representational meaning, interactive meaning and compositional meaning. The film The Shape of Water is the research material. The multimodal discourse analysis method can comprehensively analyze the inform

13、ation to be expressed in the image and help people to better understand and receive information. From this point of view, this paper cites visual grammar as the main theoretical basis. This video resources is download from the Internet, and shot the images by iqiyi software, intercepts a large numbe

14、r of images from the film The Shape of Water. After data collection, there are nearly 82 images selected and then 29 of them are put into use. Basically, each theory has its own example cited and analyzed. A detailedanalysisofthemeaningoftheinteractionandthemeaningofthecompositionhelps the viewer to

15、 understand the movie more deeply.This research not only broadens the field of Multimodal Discourse Analysis at the theoretical level, but also validates the feasibility and operability of systemic functional linguistic theories for analyzing multimodal film discourses with images. This research als

16、o improves peoples multimodal discourse reading ability and provides a new perspective on appreciating the movie.Keywords: Multimodal discourse analysis; Visual grammar; The Shape of Water1.IntroductionIn this chapter, background, objective and outline of the study will be introduced and hopefully t

17、his part will provide readers with a basic understanding of this study.1.1.Background of the studyIn this research, the film The Shape Of Water is chosen as the study object.The story took place in 1963. During the Cold War, dumb woman Eliza worked in a government lab and was a cleaning lady there.

18、When he was young, a major illness took Elizas voice, and since then she has lived her life in silence. All her friends are old painter and colleague Zelda. One day, a highly alert alert was raised in the laboratory. A mysterious tank filled with water was sent in. Alisha was shocked to find that th

19、e tank had a weird half-human and half-life creature. Under Richards leadership, the team of scientists wanted to extract substances that could make biological weapons from this monster, but in the eyes of Elisa it was nothing more than a lonely life like himself. Over time, Elisa and the monster ac

20、tually had feelings.Here are why the thesis takes this object:The modern society is infused withinformation.Withthedevelopmentofscienceandtechnology,Internetandmediumhasbecome an indispensable part of peoples life as well as their communication. Information is delivered now, instead of by the single

21、 text before, comprehensively by image, video and so on. Therefore, the traditional text analysis can not help the reader fully understand the information.There is a must to build a systemic theoretical principle of Multimodal Discourse Analysis. To meet this demand, Multimodal Discourse Analysis th

22、rived in the west in 1990s.Multimodal discourse refers to those discourses that generate the integrative meaning through the interaction of two or more modes of communication, for example, image, language and sound. After the occurrence of Multimodal Discourse Analysis, many scholars have conducted

23、researches on it. So far, it is still in its initial stage at home and abroad, and most of the researches focus on static images. The most famous scholars who have achieved great reward are Kress and Leeuwen. The book Reading Images written by them proposes the visual grammar which functions as the

24、theoretical framework of image analysis.Based on the three meta-functions of language of Hallidays functional grammar, Kress and Leeuwen suggest that image also has three meanings: representational meaning, interactive meaning and compositional meaning. The visual grammar offers a systemic framework

25、 to analyze images and help readers to understand the information better. This thesis conducts a detailed analysis of the three meanings of a number of pictures from the movie The Shape Of Water, from which the viewers of this movie will benefit in terms of their comprehension.1.2.Objective of the s

26、tudyThis paper attempts to propose a framework to analyze the film The Shape Of Water from the multirnodal perspective, based on the theoretical framework of functional grammar and visual grammar. That is to say, the Multimodal Discourse Analysis of the film is done from the three meanings in visual

27、 grammar, namely the representational meaning, the interactive meaning and the compositional meaning. In addition, visual modalities and auditive modalities are analyzed synthetically with the aim to explore how these various modalities contributes to the overall meaning conveyed by the film.As anal

28、ysis on the single textual discourse played the dominant role in the history of discourse analysis, no attention had been paid to the Multimodal Discourse Analysis until the 1990s. However, with the development of the technology, people represent their meaning with more and more modalities involved

29、in communication, and Multimodal Discourse Analysis is increasingly important in modern society. Since this paper aims to analyze a film as a multimodal discourse, it hopes to shed further light in this field. As the film involves various modalities such as auditory and visual modality, the analysis

30、 of the filmic discourse expands the application area of Multimodal Discourse Analysis, which proves that the theory of systemic functional linguistics can be applied to the multimodal filmic discourse. In addition, the analysis of the film from the multimodal perspective exerts a positive influence

31、 on the viewers comprehension of the meaning of the film.1.3.Outline of the paperThis thesis is composed of five chapters: The first chapter introduces the reason why the thesis takes this object, the background, purpose and significance of the research as well as the organization of the thesis. The

32、 second chapter presents a review of the multimodal discourse analysis. Firstly, theoverviewonthetheoreticalstudiesandtheapplicationofmultimodaldiscourseanalysisathomeandabroad is made. Then the present studies of filmic discourse and the sound montage are presented.The third chapter describes the m

33、ethodology of the thesis including the research questions, data collection and the research procedures.The fourth chapter elaborates and exemplifies through the filmic discourse how the representational meaning, interactive meaning and compositional meaning are achieved through attitudes, the detail

34、ed analysis of various choices such as image act, social distance modality system, information value and salience. Then an analysis about sound modality is made to see how natural sound, voiceover and music in the manifest its function in meaning construction together with image and to explore how t

35、hese modalities contribute to the overall meaning transmitted by the film.The fifth chapter summarizes the major findings of the research and points out the limitations of the present study and puts forward some suggestions for further research.2.Literature Review2.1 Studies on the Multimodal Discou

36、rse Analysis aboardKress and Van Leeuween (1996) argued that multimodal discourse is a discourse that conveys information by combining multiple modes of communication (such as voice, text, image, etc.). Therefore, the key to distinguishing between single mode and multimodal mode lies in there are ho

37、w many symbols involved in the composition of the discourse. According to Gu (1989), modality refers to the way in which humans interact with the external environment (such as people, machines, objects, animals, etc.) through the senses (such as vision and hearing). A single modal mean that living t

38、hings interact with a single sensor, with two modal are called bimodal, and three or more modals are called multimodal. He thought the key to distinguish them lies in how many senses it used. Jayne (2016) evaluated 25 dark tourism websites from several countries, ranging from the darker offerings, s

39、uch as holocaust museums and battlefields, to lighter options, such as ghost tours or curated museums or performances of the macabre. To do this, a Multimodal Discourse Analysis approach is used. Eva (2015) presented the analysis from a multimodal point of view the creation of meaning by means of th

40、e interaction between images and texts in English as a foreign language by University students. The analysis uses the Descriptive framework of multimodality to study the role of images in the creation of meaning. Then, it analyses how students intermingle texts and images to communicate. The results

41、 show that different strategies are used for the communication of unlike types of concepts, and a greater relying on images as concepts increased in abstraction. Matt John (2010) presents a quantitative approach to Multimodal Discourse Analysis for analyzing online collaborative learning. The coding

42、 framework draws together the fields of systematic functional linguistics and Activity Theory to analyze interactions between collaborative-, content- and technology-related discourse. The approach is used to examine how the task subject matter, the activity design, and the choice of interface affec

43、ted interaction and collaboration for a computing course conducted in a web-conferencing environment.2.2 Studies on the Multimodal Discourse Analysis at homeWen (2016) used descriptive analysis and qualitative analysis and analyzed Five representative filmic clips in Red Sorghum. The descriptive ana

44、lysis is the description of the genre of the clips. Qualitative analysis is based on Zhang (2009)s synthetic theoretical framework. Firstly, the form and grammar of each clip are studied. And this dissertation researches how the grammars realize the discourse meaning. Secondly, the relations of form

45、s are researched which contain complementary relation and non-complementary relation. Whats more, the expression level of each clip is studied. Xu (2015) researched eight scenes extracted from Olives Twist in sound and images. He analyzed the discourse meaning generated from the cooperation of diffe

46、rent modalities, and he showed overall outlook presented by the film. Through analysis of language materials, this study comes to the following conclusions: Firstly, in the film discourse, the image can express representational meaning through the choice of vector, while interactive meaning can be r

47、eflected from the different choices of contact social distance, attitude, and modality. It can also express the compositional meaning through the size and the different locations of the participant in the image. Different scenes of film have different expressive purposes; therefore, the selection of

48、 different modes is goal-directed, not arbitrary. While, Tang (2014) found that visual grammar possesses a strong applicability and feasibility on analyzing filmic discourse which takes dynamism into consideration. On the other hand, he found the analysis of multimodal systems enables us to comprehe

49、nsively and exactly understand the meaning of language, and then explores how we achieve the purpose of communication by means of various modes. In the end, it provides us with a new perspective of appreciating film and literature, deepening our understanding and elevating our appreciation and taste

50、 for literature.Weng (2015) based on visual grammar by Kress and Van Leeuwen, makes a multimodal analysis on the film Life of Pi through both quantitative and qualitative researches. The study selects a large number of images from the film and conducts a detailed analysis of the representative meani

51、ng, interactive meaning and compositional meaning of them to explore how the features of filmic discourse are expressed by multi-modalities.3.Research Questions and MethodsIn this chapter, we will introduce the methodology adopted in this thesis. Firstly, the research questions are presented, then t

52、he methods of data collection are described and finally the research procedures will be explained.3.1 Research QuestionsThe thesis attempts to apply the VG and sound montage into the analysis of the meaning of the film discourse, aiming to indentify how meaning is constructed in film with the corpor

53、ation of different modalities.In the process of exploration, the following questions will be addressed.1. How do images in the film reflect their representational meaning, interactive meaning, compositional meaning?2. How does the sound modality (including natural sounds, voiceover and music) convey

54、 meaning and cooperate with images to contribute to the construction of the holistic meaning of the film?3.2 Research MethodsThis study will adopt the method of case study. This paper based on the theory proposed by Kress and Leeuwen three kinds of meanings: representational meaning, interactive mea

55、ning and compositional meaning. The film The Shape of Water is the research material. The multimodal discourse analysis method can comprehensively analyze the information to be expressed in the image and help people to better understand and receive information. From this point of view, this paper ci

56、tes visual grammar as the main theoretical basis. This video resources is download from the Internet, and shot the images by iqiyi software, intercepts a large number of images from the film The Shape of Water. After data collection, there are nearly 82 images selected and then 29 of them are put in

57、to use. Basically, each theory has its own example cited and analyzed. A detailed analysis of the meaning of the interaction and the meaning of the composition helps the viewer to understand the movie more deeply.3.3 Data collection and AnalysisThe corpus of the study consists of the images collecte

58、d by a screenshot software HyperSnap and short videos captured by a software named Format Factory from the film.The research will be conducted as follows:Firstly, the structure of the internal relations of the images (there are two patterns: Narrative process and Conceptual process) will be discusse

59、d to see how images represent the reprentational meaning.Secondly, how images represent the interactive meaning will be studied from the aspects of contact, social distance, perspective and modalityThirdly, how the compositional meaning will be examined through the detailed analysis of various choices such as information value and salience.Finally, under