《多模態(tài)語(yǔ)篇分析》PPT課件.ppt

Multimodal Discourse Analysis,Foreign Linguistics and Applied Linguistics Zheng Lu,What is multimodality?,A mode, according to Kress and Van Leeuwen, is a semiotic system with rules and regularities attached to it. Multiple modes, namely semiotic modes ,can include gestures, posture, proxemics(空間關(guān)系學(xué)), visual images, document layout(設(shè)計(jì)布局), music and architectural design, etc. Meanings are created in texts and interactions in a complex interplay of semiosis across multiple modes but are not limited to written or spoken language.,Multimodal discourse analysis is a fairly new and rapidly developing perspective on discourse. Another interesting perspective on multimodal discourse analysis is that it not merely attempts to integrate all the possible semiotic modes of expressions but also can integrate various other approaches to discourse analysis.,BACKGROUND Multimodal discourse analysis has become popular in the western world since the 1990s. Multimodal discourse analysis relies heavily on Hallidays systemic-functional theory of language. Language is a kind of social semiotic, meanwhile, it has many functions, such as ideational function,(概念功能) interpersonal function(人際功能) and textual function(語(yǔ)篇功能). Language is inseparable from social activities of man.,Before 1990s, researchers all took textual data, namely, static texts to be the primary resource for social interactions, such as Kress and van Leeuwens grammar of images視覺(jué)設(shè)計(jì)的語(yǔ)法 and OTooles investigation of paintings, sculpture and architecture . There is a widespread belief now that textual data is not necessarily the most important mode used for the interpretations of social meaning.,In order to study the complexity of human interaction, we have to work on the analysis of more dynamic interactions, and analyze all modes that the participants are utilizing. Every interaction is multimodal. Although its relatively short history, multimodal discourse analysis has also had an important influence on other approaches and fields, most notably in the area of literacy and the growing interest in digital literacies and the field of human-computer interaction .,Digital literacy is the ability to locate, organize, understand and analyze information using digital technology . Schools are continually updating their curriculum for digital literacy. This often includes computers in the classroom, the use of educational software to teach curriculum, and course materials being available to students online.,隨著多媒體技術(shù)的產(chǎn)生與發(fā)展,如何將自然話語(yǔ)同多種模態(tài)結(jié)合起來(lái)進(jìn)行分析解讀是現(xiàn)代語(yǔ)言學(xué),尤其是話語(yǔ)分析研究領(lǐng)域的重要課題。我國(guó)多模態(tài)話語(yǔ)分析研究主要涉及理論探討、視覺(jué)應(yīng)用、口語(yǔ)語(yǔ)料庫(kù)建設(shè)、教學(xué)應(yīng)用等領(lǐng)域。 國(guó)內(nèi)多模態(tài)話語(yǔ)的研究還處在起始階段，尚未見(jiàn)到專著出版，只有為數(shù)不多的論文，其中包括胡壯麟的“社會(huì)符號(hào)學(xué)中的多模態(tài)化”，李戰(zhàn)子“用系統(tǒng)功能語(yǔ)言學(xué)理論對(duì)多模態(tài)話語(yǔ)理論的研究”,另外朱永生和張德祿等也進(jìn)行了相應(yīng)的研究。,The self is not something that exists first and then enters into relationship with others, but it is, so to speak, an eddy(漩渦 ) in the social current and so still a part of that current.,American women anthropologist Mead 1974:182,Some thoughts on personal identity construction A multimodal perspective,Sigrid Norris,Associate Professor Auckland University of Technology Director: Multimodal Research Centre sigrid.norrisaut.ac.nz Degrees: Ph.D. Linguistics Georgetown University, 2002 M.S. Linguistics Georgetown University, 1997 B.A. Russian Language and Literature George Washington University,1989,Sigrid Norris,OUTLINE,Introduction Some background Theoretic argument Structure Conclusion,. the social actor, speaking on the phone with her employee (multimodal analysis) . new thoughts about consciousness (the point of “I” and “me” identity elements),Introduction,Identity is who and what you are. Identity construction is a widely covered topic in studies of discourse. In this chapter, the authors focus is a methodological one that allows the investigation of identity construction from a slightly new perspective, a multimodal approach.,My writing is first of all an extension of Scollons mediated discourse analysis(中介話語(yǔ)分析 ). Second, this framework is strongly influenced by the work of Kress and van Leeuwen in multimodality . Besides these two merging directions, the framework of multimodal interaction analysis draws on interactional sociolinguistics of Goffman Gumperz ,discourse analysis as in Hamilton or Schiffrin and a historical approach of Wodak.,Some Background,There follows a brief eclectic overview on personal identity construction: Schiffrin or Hamilton -micro discursive constructions ,such as pronoun use and show how individuals establish themselves as belonging to one group or another. Wodak -combining text analysis with narrative and interview analysis on national identity construction and placing it into a historical perspective.,Hall and Bucholztrying to encompass social psychological and socialcultural forces on analyzing a persons use of language. What all of these approaches to identity have in common is their concentration on language (spoken or written). It is this point that creates the opportunity for this chapter on multimodal personal identity construction.,Theoretic argument,Prioritizing of language may limit our understanding of interaction and it also may limit our understanding of personal identity construction . I untilize and build on the micro analytical approach , for example, use to analyze spoken language but take multiple embodied modes such as posture, gesture and head movement into consideration.,Further, I investigate disembodied modes such as layout(布局設(shè)計(jì)) and objects. Identity is not formed in cohesive wholes but as situationally grounded and co-constructed identity elements. When speaking of identity elements I am thinking of an analogy(類比) with chemical elements such as oxygen, hydrogen, or gold. (Please turn to page 134.),gold,Gender identity,oxygen,hydrogen,Occupational identity,Name: Tanya & Lucy Occupation: two co-owners of a web-design business Relationship : colleagues & friends,An example,Image 1 illustrates that the modes of object handling and spoken language take on much weight for Tanya. However, object handling and spoken language are not the only modes that she employs.,Her body pointing away from Lucy,Not to be fixed on any one particular point and may be termed a middle distance gaze.,With legs crossed,Beat gestures Moving her hands up and down 8 times,These beat gestures are rhythmically organized with her spoken language, emphasizing particular words (this in line 2; all in line 3; whatever in line 4; email, and, fax, everything in line 5; always in line 6), and we may interpret these gestures as a way for Tanya to force herself to give clear instructions,Six out of the eight times (lines 3 to 6), Tanya simultaneously performs beats with her head,Head movements start with whatever (in line 3), go through her point of instruction email and fax everything (line 4) and end with always (line 6). Thus, while the hand beats govern the coherence and speed of her utterances, the head beats bracket the actual point that she is trying to get across.,HIGH MODAL DENSITY,Object handling Spoken language Posture Gaze Gesture Head movement,EMPLOYER IDENTITY,When we revisit this picture, we see that Lucy is listening to Tanyas call and chimes(插話) in at the appropriate time, giving Tanya the sentence and then follow up with a phone call, which Tanya repeats without losing her rhythm by saying and then Always follow up with a phone call.,We also notice that layout(布局設(shè)計(jì)) plays a role, with desks, chairs and computers arranged as they are, making it easily possible for Lucy to overhear the conversation and to chime（插話） in when she deems it necessary. Accordingly, Tanya is interacting with two different people simultaneously. While she is interacting with her employee in the foreground of her attention, Tanya then co-constructs her co-owner identity together with Lucy in the mid-ground of her attention awareness .,Because the sheep and the fence appear closer to us, we say theyre in the foreground of the image. The foothills appear far away, so theyre in the background. Midground, as you probably guessed, is how we describe parts of the image that appear to be deeper than the foreground but not so deep as the background.,“M” is for the million things she gave me, “O” means only that shes growing old, “T” if for the tears she shed to save me, “H” is for her heart of purest gold, “E” is for her eyes, with love-light shinning, “R” means right, and right shell always be. Put them all together . They spell “Mother”, a word that means the world to me.,M-O-T-H-E-R By Howard Johnson,M 代表她給予我百萬(wàn)樣?xùn)|西， O 意味著她漸漸老去， T 是她為育我成人而灑落的顆顆淚滴， H 寓意她那金子般至純至真的心靈， E 是她那雙閃耀著慈愛(ài)之光的眼睛， R 使我堅(jiān)信她永遠(yuǎn)正確無(wú)誤的言行。 把這些字母拼在一起就是“母親”， 一個(gè)于我猶如整個(gè)世界一樣的詞語(yǔ)。,An example,The following excerpts that I will look at in detail come from an extensive ethnographic study of two co-owners of a web-design business that I conducted over a period of four months. During this time, I spent most of the days with the two women (whom I will call Tanya and Lucy) during work hours and also spent time with them at their homes. I have met many of their friends, caretakers of