Moderation of School-based Assessment(SBA)：基于評(píng)價(jià)學(xué)校適度（SBA）

Moderationof

School-basedAssessment

(SBA)DrGeorgePookDeputySecretaryGeneral,HKEAASchoolLeaders’BriefingSession5March201211.TheCrucialImportanceofSBAtotheEducationReformBroaderrangeofstudentskillsmustbedeveloped(e.g.:inquiry,problemsolving,projectplanning,practicalactivities,in-depthanalysis,reflection,personalinteraction)TheseskillsmustbereflectedintheHKDSEassessmentstructures(curriculum,pedagogyandassessmentcloselyinter-linked)TheseskillscannotbeproperlyaddressedinarestrictedexaminationenvironmentTeachersbestplacedtoassessstudentperformanceontheseskills22.CriticalRequirementforManageabilityofSBAMustbebuiltintoordinaryclassroomteachingSufficientcontrolanddatacollectionmeasures,butwithoutundueadministrativeburdenHolisticviewofimpactonstudentsandschools33.CriticalRequirementforFairnessofSBAAuthenticityofstudentworkModerationofschoolassessments44.PrinciplesofSBAModerationAcceptteacherjudgmentsofrelativestudentperformancewithinaschool(internalstandardization,studentqueries)Moderationdoneperschooltostandardizeacrossschools55.BasicTechniquesofSBAModerationStatisticalThedistributionofaschool’sSBAmarksforasubjectisre-shapedtoreflectthatschool’spatternofmarkdistributionforthatsubject’sexaminationpapersDoneonaschoolgroupbasis,notonindividualbasisExpertjudgmentAnexperienced,externalprofessionalreviewsasampleofaschool’sSBAworkforasubjectBasedonacomparisonoftheoriginalmarksandthisexternalreview,anaveragemarkadjustmenttrendiscalculatedandappliedtotheschool’sSBAmarksforthatsubject66.StatisticalandExpertJudgmentTechniquesforModerationPointstonoteBothtechniquesretaintheoriginalrankorderofthestudentswithinaschool,unlesstheschoolshowsexceptionalanomaliesNeithertechniqueisperfect77.StatisticaltechniqueCharacteristics:Objectiveandprecise,butdoesnottakeproperaccountofthestandardofSBAworkdoneinaschoolReasonablestatisticalbasisforlargeentrysubjects,butnotreliableforsmallentrysubjectsCanbeconductedlargelythroughautomaticprocessing,butthiscannothappenuntilafterexaminationpapermarkinghasbeencompleted88.ExpertjudgmenttechniqueCharacteristics:FocusedonthestandardofstudentworkdoneforSBA,butexpertjudgmentmaynotbeabsolutelyreliable,eventhoughfullyindependentAcceptsthatstudentSBAperformancemaynotbedirectlylinkedtoexaminationpapermarks,butdependsonalimitedsampletoconstructanadjustmentforallcandidatesCanbeconductedwellbeforeexaminationpapersaremarked,butrequireshumanresourceinputforthepreparationandreviewofSBAworksamples99.PrinciplesAppliedtoSBAModerationforHKDSE(1)

Usethepositiveaspectsofbothtechniquescombined(2)RelymoreonstatisticaltechniquewhenstudentperformanceonSBArelatesstronglytoexaminationpaperperformanceforasubject;relymoreonexpertjudgmenttechniquewhenthisisnotthecase1010.TheTwoSBAModerationMethodologiesforHKDSE“StatisticalModeration”ApplythenormalstatisticalmoderationtechniqueComparetheoutcomesperschoolwithexpertjudgmentreviewofSBAworksamplesWheretherearemajordiscrepancies(“outliers”),strongconsiderationgiventoapplyamoderationadjustmentclosertotheexpertjudgmentCurrentlyappliedtomostHKDSEsubjects1110.TheTwoSBAModerationMethodologiesforHKDSEB.“Expertjudgmentmoderation”Experiencedprofessionalsre-markeachsampleofSBAworkThesere-marksdeterminethegroupperformanceleveloftheschoolforthatsubjectStatisticaltechniquesderivedfromgeneraltrendsw