《FACS》附錄一(面部表情編碼系統(tǒng))

1、IndextoVideoExamplesFacialActionCodingSystem FacialActionCodingSystem IndextoVideoExamplesAUsandcombinationsthatareillustratedwithMPEGvideoaresortedinAUorderinthetablebelow.Eachvideoiscross-referencedtothefilenameofthevideoclip,theManualpagecontainingthescoringcommentary,andthesequenceoftheclipinthe

2、continuousMPEGmastervideo(roughlytheorderofappearanceintheManualandinthetableofscoringcommentaries).(Thedigitaltransferoftheoriginalfilmexamplesdoesnotcontainthenewerexamples.)ThevideoclipsareintheExamples/VideodirectoryoftheCDROM.(AnidenticalsetofvideoclipsinQuickTimeformatcanbefoundintheExamples/V

3、ideo/QTdirectory.)ThecontinuousMPEGisintheManualdirectory.Onlineviewerscanclickthehyperlinksinthecolumn“FilenameofVideoClip”toseethevideo,andthelinksinthe“PageNumberofScoringCommentary”toseethecommentary.AUsIllustratedFilenameofVideoClipPageNumberofScoringCommentarySequenceinMPEGMaster1AU1.mpgpage41

4、321+2AU1_2.mpgpage416111+2+4AU1_2_4.mpgpage416121+2+5AU1_2_5.mpgpage416131+4AU1_4.mpgpage415102AU2.mpgpage41334AU4.mpgpage41314+5AU4_5.mpgpage41585AU5.mpgpage41445+7AU5_7.mpgpage41596AU6only.mpgpage414-6+7(i)AU6_7.mpgpage414-6+7(ii)AU6.mpgpage41466+7+12AU67_12page423-6+12(i)AU6_12B.mpgpage422376+12(

5、ii)AU6_12o.mpgpage422-6+15AU6_15.mpgpage424466+4E3,7+43EAU6_7_43.mpgpage416147(i)AU7.mpgpage41457(ii)AU7only.mpgpage414-7+12AU7_12o.mpgpage422-8+26AU8_26.mpgpage429709AU9.mpgpage417159+16+25AU9_16.mpgpage418209+17AU9_17.mpgpage4182210AU10.mpgpage4171610+12+16+25AU101216.mpgpage4234110+12+25AU101225.

6、mpgpage4233910+14AU10_14.mpgpage4203110+15AU10_15.mpgpage4192310+15+17AU101517.mpgpage4192610+16+25AU10_16.mpgpage4182110+17AU10_17.mpgpage4192410+17+23AU101723.mpgpage4276110+20+25AU102025.mpgpage4213310+22+25AU102225.mpgpage4266710+23+25AU102325.mpgpage4265311AU11.mpgpage4213512(i)AU12.mpgpage4213

7、612(ii)AU12only.mpgpage422-12+15AU12_15.mpgpage4244512+15+17AU121517.mpgpage4244712+16+25AU121625.mpgpage4234012+17AU12_17.mpgpage4244412+17+23AU121723.mpgpage4276012+23AU12_23.mpgpage4265412+24AU12_24.mpgpage4265512+26AU12_26.mpgpage4234212+27AU12_27.mpgpage4244313AU13.mpgpage4223814AU14.mpgpage420

8、2814+17AU14_17.mpgpage42032IndextoVideoExamplesFacialActionCodingSystem FacialActionCodingSystem 14+23AU14_23.mpgpage4265615AU15.mpgpage4171815+17AU15_17.mpgpage4192515+17+23AU151723.mpgpage4275715+23AU15_23.mpgpage4286316+20+25AU162025.mpgpage4213416+22+25AU162225.mpgpage4296816+23+25AU162325.mpgpa

9、ge4296916+25(i)AU16.mpgpage4181916+25(ii)AU16ii.mpgpage418-17AU17.mpgpage4171717+23AU17_23.mpgpage4275817+24AU17_24.mpgpage4275918AU18.mpgpage4254818+23AU18_23.mpgpage4286219AD19.mpgpage429-20AU20.mpgpage4192720+23+25AU202325.mpgpage4286620+26AU20_26.mpgpage4202920+27AU20_27.mpgpage4203021AU21.mpgpa

10、ge4297122+23+25AU222325.mpgpage4286522+25AU22_24.mpgpage4254923AU23.mpgpage4255023+26AU23_26.mpgpage4286424AU24.mpgpage4255128AU28.mpgpage4255229AD29.mpgpage430-30AD30.mpgpage430-31AU31.mpgpage430-32AD32.mpgpage430-33AD33.mpgpage430-34AD34.mpgpage431-35AD35.mpgpage431-36AD36.mpgpage431-37AD37.mpgpag

11、e431-38;39AU38_39.mpgpage4317246AU46.mpgpage4157M55M55.mpgpage432-M57M57.mpgpage432-M59M59.mpgpage433-M60M60.mpgpage433-M61M61.mpgpage433-M68M68.mpgpage432-M69M69.mpgpage432-M83M83.mpgpage432-ScoresforReferenceExampleImagesandVideosFacialActionCodingSystem #FacialActionCodingSystem AppendixII：Scores

12、forReferenceExampleImagesandVideosTheexampleimagesandvideosportrayAUstoillustrateAUdescriptionsi.AlthougheveryattemptwasmadetouseexamplesthatshowonlytheAUsintendedtoberepresented,thisgoalwasnotalwaysachievedbecauseofthedifficultyofeliminatingallotheractionsfromtheperformanceoftheintendedAUs.Beloware

13、completeFACSscoresforeachoftheexampleimages.Thesescorescontaintheintensityscore,whichisusuallynotemphasizedintheAUdescriptionsofSectionA,aunilateralprefixifunilateraloranasymmetryscore(ascoringoption)ifasymmetrical.Thesescoresallowthecarefulstudenttodeterminemorepreciselywhatcausescertainappearances

14、intheexampleimages.AnexamplemayinadvertentlycontainascoreforanAUthathasnotbeenpreviouslydiscussed.Ifso,focusontheintendedAUsandreturntotheexamplelaterwhentheasyetunfamiliarAUisdiscussed.Thescoresfortheexampleswillhelptounderstandtherelevanceoftheexamplesforscoringdecisionsmadeinpracticalscoringsitua

15、tionsafterFACStrainingiscomplete.ThecommentariespresenttheevidencefortheAUsscoredandtheintensityassigned,anddiscusswhyotherAUswerenotscored.Anydifficultiesinscoringarehighlighted.Inthescoringofthevideo,thescorespertaintothemaximumextentofthemovementintheclipandincludealltheactionsofsignificance,rega

16、rdlessofthecomplexitiesthatmightbeintroducedbytheeventscoringinChapter11.ExampleImageImageName&PageNumber0page465Ifyouarereadingonline,clickthethumbnailtoviewtheimageinanexternalviewer,clickthepagenumberlinktomovetotheManualpagecontainingtheimage,orclickonthe“(GetNeutral)”linktoseetheneutralforthepe

17、rsoninanexter-nalviewer.FACSScoreRationale0Thefaceisnotshowinganyaction,oftencalledaneutralface.Thefaceisnotactuallyatrestbecausetheeyesareopen,thejawisclosed,etc.,butnoAUcanbescored.ThisneuralfaceisthebaselineforscoringAUsintheexampleimagesofthisperson,andsimilarstatesof“neutral”facesareusedmostoft

18、enasbaselinesinactualscoringsituations,althoughotherbaselinescanalsobeused,asdiscussedinChapter11.1.TheimagesoftheAUexamplesforFACSwerephotographedandscoredforthefirsteditionundertheMinimumRequirementsandCo-occurrencerulesoftheoriginalFACSManual.ForthisversionoftheManual,thesephotoswerescannedintodi

19、gitalimages,recropped,andthenre-scoredusingtheIntensityCriteriaapproach.Differencesinthescoringtechniques,especiallyeliminatingMinimumRequirements,changedtherulesthatoriginallyassessedthequalityofthephotosasexamples.Minordeviationsfromtheintendedactionsoccurintheexamples,buttheportrayalsdonotcontrad

20、icttheAUsdescription.ScoresforReferenceExampleImagesandVideosFacialActionCodingSystem FacialActionCodingSystem #ScoresforReferenceExampleImagesandVideosFacialActionCodingSystem #FacialActionCodingSystem KmMI4ipage466(GetNeutral)V4C+38A4iipage466(GetNeutral)4Dw0page465(GetNeutral)Slighttomarkedvertic

21、alwrinklesappearintheglabellaandtheeyebrowsarepulledtogethermarkedly.Theinnerpartsoftheeyebrowsarepulleddownatraceontherightandslightlyontheleftwithtracesofwrinklingatthecorners.Noticetheskinbunchingthatbeginsabovethemiddleofeacheyebrowandcontinuesmoremedialmakingshallowwaves,asuresignofAU4,andthebu

22、nchingofskinintheglabella.The4meetscriteriafortheClevelonthebasisofthepullingtogether.Becausetheskinbunchingabovetheeyebrowsisatracegreaterontheleft,andthelefteyebrowisloweredatracemore,asymmetryisLIandtheVprefixisassignedtothe4.HowaboutAU1becauseofthearchinthefirsthorizontalwrinkleabovetheglabella?

23、Thischangeisduetothebunchedskinintheglabellabendingthatwrinkleup.ConsideringAU5becauseoftheharshqualityintheeye?Thereisnohardevidencefor5,whichyoucanconfirmbycoveringtheeyebrowswithacard.Thetraceofnostrilflaringinthechangedshapeofthethinnednostrilwingsissufficientfor38A.Severeverticalwrinklesandskin

24、bunchingbetweentheeyebrows,severedrawingtogetheroftheeyebrows,andseveretoextremeeyebrowloweringputthis4attheDintensity.Bothloweringanddrawingtogetheroftheeyebrowshasincreasedfromimage4i,buttheloweringhasincreasedmuchmore.Noticethattheothersignsof4listedforimage4ihavealsoincreased.Thearchinthelowesth

25、orizontalfurrowoftheforeheadhasstraightenedbecauseoftheloweringandpullingdownoftheglabella.Again,thereisnoevidenceofAU5whenlookingcloselyatonlytheeyelid.Thedarkshadowbetweenthelipsshouldnotenticethecodertoscore25because25requirescertainty,buttheyarecertainlyclosed.Theneutralfaceshowstheappearanceofa

26、lowered,slantingeyebrow,apermanentfeature.Also,notethefurrowsbeyondthelipcorners,deepenedpartsofthenasolabialfurrow.Thesefurrowsandthewrinklingintheforeheadareasymmetrical.Theeyecoverfoldisvirtuallyhidden,makingactionof5moredifficulttodetect.w4page465(GetNeutral)4B+38ATheeyebrowsareslightlyloweredan

27、dpulledtogetherandslightverticalwrinklesformbetweentheeyebrows,sufficienttoscore4B.Themarkedthinningandflaringofthenostrilsissufficienttoscore38Ainastillimage.ScoresforReferenceExampleImagesandVideosFacialActionCodingSystem FacialActionCodingSystem 1B+38Apage466(GetNeutral)2page466V2C+38A(GetNeutral

28、)5i5Bpage467(GetNeutral)Theinnercornersoftheeyebrowsareliftedslightly,theskinoftheglabellaandforeheadaboveitisliftedslightly,andwrinklesdeepenslightlyandatraceofnewonesforminthecenteroftheforehead.Someonemightcontendthateitherthewrinklingortheinnerbrowraiseismarked,andthereforethescoreshouldbe1C,but

29、comparethesechangestothoseintheimage1+2belowandotherimageswhereAU1isatmuchgreaterintensityandre-cali-brate.ThereisnosignofAUs2,4,5,6,or7whatsoever.Inthelowerface,nostrilflaringevidentintheraisedandthinnednostrilwingandincreasednostrilsizeismarked,Alevelinastillimage.Theouterpartoftheeyebrowraiseispr

30、onounced.Thewrinklingabovetherightoutereyebrowhasincreasedmarkedly,andthewrinklingontheleftispronounced.Increasedexposureoftheeyecoverfoldandskinispronounced.Thescoreis2C.Thereisnosignthattheinnercornersoftheeyebrowsareraised,althoughtheymaybedrawnlaterally,andwrinklinginthecenteroftheforeheadhasnot

31、changedinshapeorposition.Althoughthesewrinklesmayhavedeepenedsomewhat,thechangesintheouterpartofthewrinklesdueto2canexplainthischange.Thus,AU1iseliminated.Thegreaternumberanddepthofwrinklingontheleftmakestheasymmetrytrace(L1),soassigntheprefixV.Theslightchangesinthenostrilagainindicate38A.AU5ishardt

32、oseeherebecausetheeyebrowsaresetlowandtheeyecoverfoldhaslittleexposure.Theuppereyelidispulledup,themedialpartvirtuallydisappearingintotherevulsionmarginoftheeyecoverfold.MorescleraaroundtheupperpartoftheirisisrevealedTheinnercorneroftheeyeshowsmoremucosaandsclera.Intheneutralphoto,noscleraisexposeda

33、ndtheuppereyelidcoversthetoppartoftheiris,buthere,wecanextrapolatefromtheshapeoftheuppereyelidthatvirtuallytheentireirisisexposed,ifwecouldseeundertheeyecoverfoldobscuringthetopoftheiris.Thischangeissufficienttoscore5Bonthisperson.5iipage467(GetNeutral)5ETheuppereyelidisraisedtoaboutthemaximumandama

34、ximumamountofsclerashowsabovetheiris.Thebulging,staringappearanceispresentwithoutdoubt.Thisevidenceissufficienttoscore5E.Thelowereyelidissomewhatraisedandstraightened,coveringmoreoftheiris,butthisisduetothemaximum5pullinguponthelowereyelid;butthereisno7inthisitem.(A7wouldwrinklethelowereyelidandpull

35、itupontotheeyeball,causingabulgeandstraighteningitmuchmore-seeitem7below.)w5ipage467(GetNeutral)5B+38ATheuppereyelidisraisedtorevealvirtuallytheentiretopoftheiris,sufficienttoscore5Basthetopoftheirisiscoveredinneutral.Slightflaringandthinningofthenostrilsissufficienttoscore38A.ScoresforReferenceExam

36、pleImagesandVideosFacialActionCodingSystem FacialActionCodingSystem #ScoresforReferenceExampleImagesandVideosFacialActionCodingSystem #FacialActionCodingSystem #w5iipage467(GetNeutral)5ETheuppereyelidisraisedtorevealsclerainthemaximumrange,evidentontherightside,sufficienttoscore5E.Noticethatthemaxim

37、um5hasstretchedandliftedthelowereyelidatrace,butthereisnoactionofAU7inthisitem.7page4687CThelowereyelidisraisedmarkedlyandstraightenedslightly,causingslightbulging,andthenarrowingoftheeyeapertureismarkedtopronounced,sufficienttoscore7C.Nootheractionsaredetectableinthisitem.(GetNeutral)ScoresforRefer

38、enceExampleImagesandVideosFacialActionCodingSystem #FacialActionCodingSystem #ScoresforReferenceExampleImagesandVideosFacialActionCodingSystem #FacialActionCodingSystem #6page468(GetNeutral)G7D+6Cw7page468(GetNeutral)4A+7CTheinfraorbitaltriangleisraisedmarkedly,pushingskinbelowtheeyeup,slightlydeepe

39、ningthenasolabialfurrow,andpullinguptheskinoftheupperlipatrace.Markedcrowsfeetwrinklesformattheeyecornersasthelateraltopoftheinfraorbitaltriangleisraisedandthelateralpartoftheeyebrowisloweredslightly,changingtheshapeoftheeyecoverfoldastheouterringoforbicularmuscleconstricts.Thisevidenceissufficientt

40、oscore6C.Eventhoughtheactionof6isexpectedtopushupskinbelowtheeyeandwrinklethelowereyelid,theeyelidinthisitemispulledfarupontheeyeball,beyondtheeffectthat6alonecanproduce,causingseverebulgingandwrinklingofthelowereyelidandnarrowingoftheeyeaperture.Notehowtheskinofthelowereyelidisdrawnmarkedlytotheinn

41、ercorneroftheeye,narrowingseverelytheanglearoundthelacrimalgland.Theuppereyelidislowered,contributingtothechangesintheeyecoverfoldproducedbytheactionof6.Thisevidenceissufficienttoscore7D.Boththewrinklingandthenarrowingdueto7areatracegreaterontheright,orRl,sotheprefixGisassigned.Eventhoughthecornerso

42、fthelipsareturnedupatraceandthenasolabialfurrowbeyondthelipcornersispulledlaterallyatrace,theseeffectsareprobablyduetotheAU6pulling,andnoAU12isscoredhere,lackingevidencefromthemovement.Thelowerlidisraisedandstraightenedmarkedlyontheeyeball,causingpronouncedbulgingandnarrowingoftheeyeaperture,suffici

43、enttoscore7C.Noticehowtheskinofthelowereyelidisdrawnintowardstheinnereyecornerstoaffecttheangleoftheeyelidaroundthelacrimalduct.Atraceofverticalwrinklingbetweentheeyebrows,atraceofbrowlowering,especiallytheright,issufficienttoscore4A.ScoresforReferenceExampleImagesandVideosFacialActionCodingSystem F

44、acialActionCodingSystem w6page468(GetNeutral)43ipage469(GetNeutral)6C+7DTheraiseoftheinfraorbitaltriangleispronounced,thedeepeningofthenasolabialfurrowismarked,andskinoftheupperlipisraisedatrace.Pronouncedcrowsfeetwrinklesformattheeyecornersasthelateraltopoftheinfraorbitaltriangleisraisedseverely,an

45、dtheinfraorbitalfurrowisdeepenedseverely.Thisevidenceissufficienttoscore6C.Theactionof6pushesupskinbelowtheeye,buttheeyelidinthisitemispulledfarupontheeyeball,beyondtheeffectthat6alonecanproduce,causingseverebulgingandwrinklingofthelowereyelidandseverelynarrowingtheeyeaperture.Notehowtheskinofthelow

46、ereyelidisdrawnseverelytotheinnercorneroftheeye,narrowingtheanglearoundthelacrimalgland.Thisevidenceissufficienttoscore7D.Theeyebrowsmaybeloweredatrace,butthe6canexplainthiseffect.43BTheuppereyelidisrelaxedanddroopingdownslightly,sufficienttoscore43B.Notethattheshapeofthelowereyelidislittlechangedfr

47、omneutralandthereisnoadditionalwrinkling.Besuretocomparetheappearanceofrelaxingtheuppereyelidin43tothatresultingfromthetensingoftheorbicularmusclethatisapparentinthe6and7itemsabove.43iipage469(GetNeutral)43DAgain,thisappearanceresultsfromrelaxingtheuppereyelid,andtheeyelidsarealmosttogether(closed),

48、butthegapbetweenthemcanstillbeseen,especiallyinthemedialpartsandaroundthelacrimalgland.Thisevidenceissufficienttoscore43D.Comparethisappearancetothenextitem,whichshowstheeyelidsclosed.43iiipage469(GetNeutral)43ETheeyesareclosedin43E.Noticethatwhentheeyesareclosed,youseetheuppereyelasheslayingonthesk

49、inofthelowerlidandlittleornothingofthelowereyelashes.Noscleraormucosacanbeseen.Noevidenceofanyotheractionispresentinthisexample.7Epage4697EThelowerlidispulledandstretchedmaximallyontheeyeball,hidingmostoftheiris,andbulgingandtensingofthelowereyelidisextreme.Thisevidenceissufficienttoscore7E.(GetNeut

50、ral)Notethatwithoutacounteractingtensionintheupperlid,theeyewouldcloseandbescored7E+43E,butthetensionintheuppereyelidisalwaysactivetokeeptheeyesopen,sothereisnoneedtoscoreAU5insuchanordinarysituation,andtheappearancechangesheredonotmeetanyoftheguidelinesforscoringAU5.Whenboth7and5actsothat5isscored,

51、theappearanceisdifferentfromthisitem,asyoucanseeinthe5+7itembelow.ScoresforReferenceExampleImagesandVideosFacialActionCodingSystem #FacialActionCodingSystem ScoresforReferenceExampleImagesandVideosFacialActionCodingSystem FacialActionCodingSystem #4+5page470(GetNeutral)4C+5Cw4+5page4704C+5B+38A(GetN

52、eutral)Theinnerpartsoftheeyebrowsarepulledtogetherslightlyformingslightverticalwrinkling,andarepulleddownmarkedly,formingslighthorizontalwrinklesattheinnercornersoftheeyebrows,sufficienttoscore4C.Theuppereyelidisraisedandtensedagainstthedownwardmovementoftheeyecoverfoldcausedbytheloweredeyebrows,and

53、moresclerashowsattheupper,sidepartsoftheiris,indicatingAU5.Becausethe5occurswith4,thespecialintensityguidelinesfor5with4areusedtoscoreintensity.Wecanseethatmoreofthetoppartoftheirisisrevealedthaninneutralandtheharshstareisatleastmarked,so5Cisscored.Theeyebrowsaremarkedlyloweredandmarkedverticalwrink

54、lesformbetweentheeyebrows,sufficienttoscore4C.Theuppereyelidappearsraisedfromtheincreasedexposureofscleraaroundtheiris.TensionoftheupperlidagainsttheeyecoverfoldisevidentasAU4pushesdownandAU5pushesup.Theeyeshaveaglarethatisnotpresentinthew4example(covertheeyebrowstocompare).Thisevidenceissufficientt

55、oscore5B.Themarkedthinningandflaringofthenostrilsissufficienttoscore38Ainastillimage.5+7page470(GetNeutral)5D+7CTheuppereyelidisraisedtorevealmuchmorethanahairlineofscleraaroundthetopoftheiris,whichispartiallycoveredinneutral.AtleastasevereamountofsclerabeyondtheguidelinefortheBintensity(virtuallyal

56、lofthetopoftheiris)isrevealed,butnotamaximum,sufficienttoscore5D.Thelowereyelidisraisedandstraightenedmarkedlyontheeyeballformingamarkedbulge,andskinisdrawntotheinnereyecorner,sufficienttoscore7C.1+4ipage4701C+4C+38A(GetNeutral)1+4ii1C+4D+38Apage471(GetNeutral)Theincreaseinwrinklinginthecenterofthef

57、oreheadismarkedtopronounced,andtheraisingoftheinnercornersoftheeyebrowsispronounced,sufficienttoscore1C.Theeyebrowsarepulledtogethermarkedly,andmarkedverticalwrinklingandbulgingappearsbetweenthem.UsingtheguidelinesforAU4inthecombinationof1+4,thisevidenceissufficienttoscore4C.Noticehowstraighttheeyeb

58、rowsarecomparedtotheexampleforAU1,inthistableabove,becausethe4ispullingdownthecenterofeacheyebrowwhilethe1israisingtheinnercorner,whichdecreasesthecurvatureoftheeyebrow.Themarkedlythinnedandflarednostrilsaresufficienttoscore38A.Thesamesignsareapparentinthisitemsasintheprevious,buttheactionsaremorein

59、tense.Theincreaseinhorizontalwrinklinginthecenteroftheforeheadandtheraisingoftheinnercornersoftheeyebrowsarepronounced,aboutthesameasinthepreviousitem.Yet,thereisamorebulging,bunched,andknottedappearancetothecenteroftheforeheadbecausethestrongerAU1iscounteractedbyastrongerAU4,shownintheseverevertica

60、lwrinklingandbulgingandwrinklingbetweentheeyebrows,theseveredrawingtogetheroftheeyebrows,andthegreaterloweringoftheeyebrowcenters.Also,noticethestraightnessoftheeyebrowandeyecoverfold.Thisevidenceissufficienttoscore4D,andthe1remainsintheCintensityrange.Themarkedlythinnedandflarednostrilsaresufficien