GAE功能介紹對外

GATE功能介紹魯廷明 2009年6月9日2目錄概覽功能介紹本次研究的不足之處概覽（1）GATE

is

a

General

Architecture

for

Text

EngineeringDeveloped

by

the

Natural

Language

Processing

Research

Groupwithin

the

Department

of

Computer

Science

at

the

UniversityofSheffield概覽（2）Language

Resources

(LRs)refers

to

data-only

resources

such

as

document,

corpus.Processing

Resources

(PRs)refers

to

resources

whose

character

is

principally

programmatic

oralgorithmic,

such

as

tokeniser,

POS

tagger.Applicationsmodel

a

control

strategy

for

the

execution

ofPRs.There

are

two

main

types

of

pipeline:Simple

pipelinesCorpus

pipelines概覽（4）documentannottationSetannotationTypefeature功能介紹Tokeniser分功能，每個(gè)Token注包括的屬性有：kind:

Word,

Number,

Symbol,

Punctuation,

SpaceTokenorth:

upperInitial,

allCaps,

lowerCase,

mixedCaps

lengthstringSentence

Spliter實(shí)現(xiàn)分句功能功能介紹Gazetteer辭典lists.def

內(nèi)容包括country.lst:location:countrycountry.lst

內(nèi)容包括ChinaChineChypreColombiaColombie功能介紹Part

of

Speech

Tagger詞性標(biāo)注也有標(biāo)注錯(cuò)誤的：I

will

study

hard

this

year.JJ（adjective，應(yīng)當(dāng)為RB

adverb）功能介紹Semantic

Tagger就是NE

Transducer，命名實(shí)體識(shí)別Orthographic

Coreference

（Orthomatcher）The

Orthomatcher

module

adds

identity

relations

between

namedentities

found

by

the

semantic

tagger,

in

order

to

performcoreference.Pronominal

Coreference將人名、代系起來，比如：John

Smith…h(huán)e…h(huán)im…John…h(huán)e…功能介紹Document

ResetRemove

all

the

annotation

sets

and

their

contents,

apart

fromtheone

containing

the

document

format

analysis

(Original

Markups).功能介紹Verb

Group

ChunkerThe

rules

cover

finite

('is

investigating'),

non-finite

('toinvestigate'),

participles

('investigated'),

and

special

verbconstructs

('is

going

to

investigate').Noun

Phrase

ChunkerMarking

noun

phrases

in

text.功能介紹OntoText

Gazetteer與ANNIE

Gazetteer

結(jié)果相似，但是算法不同。Flexible

GazetteerThe

Flexible

Gazetteer

provides

users

with

the

exibility

to

choosetheir

own

customized

input

and

an

external

Gazetteer.Gazetteer

List

Collector指定標(biāo)注類型的實(shí)體插入到指定Gazetteer的相應(yīng)list中并生成統(tǒng)計(jì)文件（實(shí)體名$次數(shù)）功能介紹Tree

TaggerThe

TreeTagger

is

a

language-independent

part-of-speechtagger.The

TreeTagger

is

a

tool

for

annotating

text

with

part-of-speech

andlemma

information.

It

was

developed

by

Helmut

Schmid

in

the

TC

projectat

the

Institute

for

Computational

Linguistics

of

the

University

ofStuttgart.

The

TreeTagger

has

been

successfully

used

to

tag

German,English,

French,

Italian,

Dutch,

Spanish,

Bulgarian,

Russian,

Greek,Portuguese,

Chinese

and

old

French

texts

and

is

adaptable

to

otherlanguages

if

a

lexicon

and

a

manually

tagged

training

corpusareavailable.分析英語文件成功cd\treetagger\bintag-english.bat

news1.txt但是未能集成到GATE中功能介紹StemmerEach

Token

is

annotated

with

a

new

feature

"stem",

with

thestem

for

that

word

as

its

value.GATE

Morphological

AnalyzerConsidering

one

token

and

its

part

of

speech

tag,

one

at

a

time,

itidentifes

its

lemma

and

an

affix.

These

values

are

than

added

asfeatures

on

the

Token

annotation.MiniPar

ParserIt

takes

one

sentence

as

an

input

and

determines

the

dependencyrelationships

between

the

words

of

a

sentence.功能介紹RASP

ParserRASP

(Robust

Accurate

Statistical

Parsing)

is

a

robust

parsing

system

for

English.包括以下四個(gè)PR:RASP2

TokenizerRASP2

POS

TaggerRASP2

Morphological

AnalyserRASP2

Parser:

creates

multiple

dependency

annotations

to

represent

a

parse

of

each

sentence.RASP

is

only

supported

for

Linux

operating

systems.SUPPLE

ParserSUPPLE

is

a

bottom-up

parser

that

constructs

syntax

trees

and

logical

forms

for

Englishsentences.Need

a

Prolog

interpreter.Stanford

Parser功能介紹Montre

alTra

nsduce

rManyofthekeyfeaturesintroducedintheMontrealTransducer(MT)havenowbeenportedinsomeformintothestandardJAPEtransducer.ThestandardJAPEtransducerislikelytobemorestableandbugswillbexedmorerapidlythanwiththeMT.與standardJAPEtransducer類似，未研究。功能介紹ChinesePl

uginTheChineseplugincontainsasimpleapplicationforChineseNErecognition(chinese.gapp).功能介紹Chem

is

tr

yTaggerThisGATEmoduleisdesignedtotaganumberofchemistryitemsinrunningtext.Currentlythetaggertagscompoundformulas(e.g.SO2,H2O,H2SO4...)ions(e.g.Fe3+,Cl-)andelementnamesandsymbols(e.g.SodiumandNa).Limitedsupportforcompoundnamesisalsoprovided(e.g.sulphurdioxide)butonlywhenfollowedbyacompoundformula(inparenthesisorcommas).功能介紹FlexibleE

xporter可以指定一個(gè)標(biāo)注集的若干標(biāo)注類型，輸出帶這些標(biāo)注的文檔到文件，并可以改變輸出文件中標(biāo)注類型的名稱。An

no

ta

tion

SetTransfer將一種標(biāo)注集中的一部分標(biāo)注轉(zhuǎn)移（或拷貝）到另一個(gè)標(biāo)注集中（然后將這個(gè)部分的標(biāo)注集可以作為其他PRs的輸入，再處理）。Forexample,wemightwishtoperformnamedentityrecognitiononthebodyofanHTMLtext,butnotontheheaders.Aftertokenisingandperforminggazetteerlookuponthewholetext,wewouldusetheAnnotationSetTransfertotransferthoseannotations(createdbythetokeniserandgazetteer)intoanew決道an肌not飾at紡i困ons閑e炎t,鑒猜and跟t肚h腔enr坦要unt片保her收e艷ma隊(duì)in率i爪ngN獲E馬r括es城ou商rc脖e暫s,s要血uch稼a海st港映hes孟e司m慢ant披ic腿t年a仰gge臥ra鋪透ndcor稈ef抗er膚e恒nce駐mo我dul迎es食,o楚n薪珠功能介紹Inform

at

ion

Re

trieva

linG

AT

EThecurrentimplementationisbasedonthemostpopularopensourcefull-textsearchengine–Lucene.CrawlerThecrawlerpluginenablesGATEtobeusedforacorpusthatisbuiltusingawebcrawl.ThecrawleritselfisWebsphinx.ThisisaJAVAbasedmulti-threadedwebcrawlerthatcanbecustomizedforanyapplication.功能介紹GooglePluginThispluginallowstheusertoqueryGoogleandbuildthedocumentcorpusthatcontainsthesearchresultsreturnedbyGoogleforthequery.YahooPluginThispluginallowstheusertoqueryYahooandbuildthedocumentcorpusthatcontainsthesearchresultsreturnedbyYahooforthequery.功能介紹WordNetinGATE執(zhí)行出錯(cuò)。MachineLearningi

nGATEMinorThirdMI

AKT

NLGLexico

n尚不明白用在何處。Ont野o撤Ro元otGa縮慧zet鼠t汁eer畝功能介紹Kea-Au

to

ma

ticKeyphraseDete

ctio

nKeaisatoolforautomaticdetectionofkeyphrases.先訓(xùn)練得到模型，然后可以應(yīng)用。OntotextJapeCCompilerJapecisanalternativeimplementationoftheJAPElanguagewhichworksbycompilingJAPEgrammarsintoJavacode.Comparedtothestandardimplementation,thesecompiledgrammarscanbeseveraltimesfastertorun.功能介紹ANNICANNIC(ANNotation