搜索引擎實(shí)驗(yàn)三

一、實(shí)驗(yàn)?zāi)康?理解搜索引擎中的分詞技術(shù)。二、實(shí)驗(yàn)內(nèi)容 編寫(xiě)程序?qū)崿F(xiàn)對(duì)一段中文文章，利用最長(zhǎng)正匹配算法進(jìn)行分詞三、實(shí)驗(yàn)過(guò)程 3.1分詞程序流程圖開(kāi)始開(kāi)始初始化字典打開(kāi)文本文件文本內(nèi)容是否讀完讀取一行字符字符串是否分析完依次從當(dāng)前位置向后截取不同長(zhǎng)度字符串，截取長(zhǎng)度從大到小。如果匹配如果匹配輸出截取的字符，將當(dāng)前位置修改為截取字符串末尾位置將字符串與字典進(jìn)行匹配無(wú)法再截取結(jié)束3.2分詞程序源代碼booleanf; intDlen=33; Stringdictionary[]={ "生命","最后","余光","仔仔細(xì)細(xì)","檢視","一點(diǎn)","一滴","鮮明", "生動(dòng)","日子","熟悉","面孔","一言一語(yǔ)","生活","裝進(jìn)","裝入", "扉頁(yè)","鐘愛(ài)", "一并","自己","一遍","甘心","二十","收拾","一切", "燦爛","結(jié)束","微笑","昨天","還給","孤單","留給","自己"}; try{ FileInputStreamin=newFileInputStream("d:\\123.txt"); BufferedReaderbreader=newBufferedReader(newInputStreamReader(in,"gb2312")); Stringinputstr,word=null; inti,j,k; while((inputstr=breader.readLine())!=null) { for(i=0;i<inputstr.length();) { f=false; for(j=4;j>1;j--) { word=inputstr.substring(i,i+j); for(k=0;k<Dlen;k++) if(dictionary[k].equals(word)) { f=true; break; } if(f)break; } word=inputstr.substring(i,i+j); if(!(word.equals("，")||word.equals("。")||word.equals("？")||word.equals("！")||word.equals("“")||word.equals("”"))) System.out.print(word+"\n"); i=i+j; } } }catch(FileNotFoundExceptione) {}catch(Exceptione) {