網(wǎng)絡(luò)故障診斷

InternetworkTroubleshooting培訓(xùn)目的掌握普通性缺點(diǎn)判別與處置的流程學(xué)會(huì)運(yùn)用一至兩種工具(軟件)來進(jìn)展缺點(diǎn)診斷學(xué)會(huì)運(yùn)用系統(tǒng)提供的相關(guān)命令來進(jìn)展網(wǎng)絡(luò)缺點(diǎn)診斷了解一些常見的缺點(diǎn)及其能夠的緣由缺點(diǎn)診斷流程缺點(diǎn)診斷流程定義缺點(diǎn)搜集景象估計(jì)能夠性制定行動(dòng)方案實(shí)施行動(dòng)察看結(jié)果反復(fù)過程問題處理,終了景象不存在景象仍存在缺點(diǎn)診斷工具缺點(diǎn)診斷工具儀表萬用表電纜測試儀/光纖測試儀誤碼表數(shù)據(jù)發(fā)生器協(xié)議分析儀缺點(diǎn)診斷工具網(wǎng)管工具HPOVSunNetManagerCAUnicenterTNGIBMTivoli/NetViewCiscoWorks其它工具缺點(diǎn)診斷工具系統(tǒng)命令Cisco路由器系統(tǒng)命令showdebugpingtracelogging缺點(diǎn)診斷工具系統(tǒng)命令Solaris系統(tǒng)命令pingifconfignetstatnslookuparp命令缺點(diǎn)診斷工具其它工具snoopsniffertcpdumparpwatch其它軟件路由器/交換機(jī)的缺點(diǎn)診斷正確了解路由器路由與交換的原理了解Cisco路由器硬件構(gòu)造從路由器診斷命令的輸出中發(fā)現(xiàn)問題為Cisco技術(shù)支持人員提供診斷信息Cisco路由器系統(tǒng)命令Ping命令(user)rtr1-c-1-bjbj>pingsunTranslating"sun"...domainserver(95)[OK]Typeescapesequencetoabort.Sending5,100-byteICMPEchoesto95,timeoutis2seconds:!!!.!Successrateis80percent(4/5),round-tripmin/avg/max=548/853/1204msPing命令(user)Ping擴(kuò)展命令r4#pingProtocol[ip]:TargetIPaddress:31Repeatcount[5]:10Datagramsize[100]:200Timeoutinseconds[2]:3Extendedcommands[n]:ySourceaddressorinterface:32Typeofservice[0]:1SetDFbitinIPheader?[no]:Validatereplydata?[no]:Datapattern[0xABCD]:0x0000Loose,Strict,Record,Timestamp,Verbose[none]:rNumberofhops[9]:Loose,Strict,Record,Timestamp,Verbose[RV]:Sweeprangeofsizes[n]:Typeescapesequencetoabort.Sending10,200-byteICMPEchosto31,timeoutis3seconds:Packethasdatapattern0x0000PackethasIPoptions:Totaloptionbytes=39,paddedlength=40Recordroute:<*>Ping擴(kuò)展命令(con’t)Replytorequest0(4ms).ReceivedpackethasoptionsTotaloptionbytes=40,paddedlength=40Recordroute:323132<*>

EndoflistReplytorequest1(4ms).ReceivedpackethasoptionsTotaloptionbytes=40,paddedlength=40Recordroute:323132<*>

EndoflistReplytorequest2(4ms).ReceivedpackethasoptionsTotaloptionbytes=40,paddedlength=40Recordroute:323132<*>

EndoflistSuccessrateis100percent(10/10),round-tripmin/avg/max=1/4/8msTrace命令(user)rtr1-c-1-bjbj>trace0Typeescapesequencetoabort.Tracingtherouteto(0)11()0msec0msec0msec26620msec16msec16msec32(2)20msec16msec20msec46(2)20msec20msec20msec5(0)20msec*16msecTrace命令(user)Trace擴(kuò)展命令r4#traceProtocol[ip]:TargetIPaddress:31Sourceaddress:32Numericdisplay[n]:5Timeoutinseconds[3]:Probecount[3]:MinimumTimetoLive[1]:2MaximumTimetoLive[30]:PortNumber[33434]:Loose,Strict,Record,Timestamp,Verbose[none]:rNumberofhops[9]:Loose,Strict,Record,Timestamp,Verbose[RV]:Typeescapesequencetoabort.Trace擴(kuò)展命令(Con‘t)Tracingtherouteto312310msecReceivedpackethasoptionsTotaloptionbytes=40,paddedlength=40Recordroute:3231<*>

Endoflist*0msecReceivedpackethasoptionsTotaloptionbytes=40,paddedlength=40Recordroute:3231<*>

EndoflistShow命令rtr1-c-1-bjbj>shintf4/0/0FastEthernet4/0/0isadministrativelydown,lineprotocolisdownHardwareiscyBusFastEthernetInterface,addressis0050.a253.8080(bia0050.a253.8080)Description:<beijingC1-beijingRegion>100MInternetaddressis53/30MTU1500bytes,BW100000Kbit,DLY100usec,rely255/255,load1/255EncapsulationARPA,loopbacknotset,keepaliveset(10sec),fdx,100BaseTX/FXARPtype:ARPA,ARPTimeout04:00:00Lastinput10w6d,output10w6d,outputhangneverLastclearingof"showinterface"counters18w4dQueueingstrategy:fifoOutputqueue0/40,535drops;inputqueue0/75,1716drops5minuteinputrate0bits/sec,0packets/sec5minuteoutputrate0bits/sec,0packets/sec

Show命令(Con‘t)15628691packetsinput,2423133689bytes,0nobufferReceived698983broadcasts,0runts,0giants0inputerrors,0CRC,0frame,0overrun,0ignored,0abort0watchdog,0multicast0inputpacketswithdribbleconditiondetected25793600packetsoutput,4210267836bytes,0underruns0outputerrors,0collisions,3interfaceresets0babbles,0latecollision,0deferred0lostcarrier,0nocarrier0outputbufferscopied,0interrupts,0failuresShow命令rtr1-c-1-bjbj>shints0/0/0Serial0/0/0isup,lineprotocolisupHardwareiscyBusSerialDescription:<bjbj-mci-c-2M-01>toMCI(-SACRAM2048K003)Internetaddressis46/30MTU1500bytes,BW1984Kbit,DLY20000usec,rely255/255,load1/255EncapsulationHDLC,loopbacknotset,keepaliveset(10sec)Lastinput00:00:07,output00:00:07,outputhangneverLastclearingof"showinterface"counters18w4dQueueingstrategy:fifoOutputqueue0/40,455018414drops;inputqueue0/75,124drops5minuteinputrate0bits/sec,0packets/sec5minuteoutputrate15000bits/sec,1packets/sec110103206packetsinput,3264989278bytes,1nobufferReceived0broadcasts,0runts,0giants11447inputerrors,9191CRC,0frame,28overrun,0ignored,2228abort3720562109packetsoutput,503074661bytes,0underruns0outputerrors,0collisions,534interfaceresets0outputbufferscopied,0interrupts,0failures214carriertransitions6921alarmindications,6959remotealarms,7003rxLOF,42rxLOSDCDup,BERinactive,NELRinactive,FELRinactiveShow命令rtr1-c-1-bjbj>shproccpuCPUutilizationforfiveseconds:6%/5%;oneminute:11%;fiveminutes:9%PIDRuntime(ms)InvokeduSecs5Sec1Min5MinTTYProcess12627167202873954159140.57%0.45%0.47%0BGPRouter23058357443100720986350.00%0.91%1.16%0Checkheaps3547204088011330.00%0.00%0.00%0PoolManager40200.00%0.00%0.00%0Timers50100.00%0.00%0.00%0OIRHandler60100.00%0.00%0.00%0IPCZoneManager70100.00%0.00%0.00%0IPCRealmManager85196220447720.00%0.00%0.00%0IPCSeatManager9367268719850.00%0.00%0.00%0ARPInput100100.00%0.00%0.00%0SERIALA'detect110100.00%0.00%0.00%0MicrocodeLoader120100.00%0.00%0.00%0ATMILMIInputShow命令rtr1-c-1-bjbj>shversionCiscoInternetworkOperatingSystemSoftwareIOS(tm)GSSoftware(RSP-JV-M),Version11.1(19)CC1rtr1-c-1-bjbjuptimeis1year,14weeks,2days,16hours,0minutesSystemrestartedbyreloadat01:23:52PRCSunJan311999Systemimagefileis"slot0:rsp-jv-mz.111-19.CC1",bootedviaslot0ciscoRSP4(R5000)processorwith262144K/2072Kbytesofmemory.R5000processor,Implementation35,Revision2.1(512KBLevel2Cache)Lastresetfrompower-onChassisInterface.5VIP2R5Kcontrollers(2FastEthernet)(9Serial)(2HSSI)(2POS).2FastEthernet/IEEE802.3interfaces.9Serialnetworkinterfaces.2HSSInetworkinterfaces.2PacketoverSonetnetworkinterfaces.Configurationregisteris0x102Debug命令r4#debugarpARPpacketdebuggingisonr4#0:33:08:IPARPreqfilteredsrc0800.209f.92b9,dst2ffff.ffff.ffffmartiansource0:33:09:IPARPreqfilteredsrc0800.209f.92b9,dst0ffff.ffff.ffffmartiansource0:33:09:IPARPreqfilteredsrc0800.209f.92b9,dst0ffff.ffff.ffffmartiansource0:33:09:IPARPreqfilteredsrc0800.209f.92b9,dst2ffff.ffff.ffffmartiansource0:33:09:IPARP:rcvdreqsrc680000.21d9.5722,dst6Ethernet00:33:09:IPARPreqfilteredsrc0800.209f.92b9,dst0ffff.ffff.ffffmartiansource0:33:09:IPARPreqfilteredsrc0800.209f.92b9,dst3ffff.ffff.ffffmartiansource0:33:09:IPARPreqfilteredsrc0800.209f.92b9,dst2ffff.ffff.ffffmartiansourceDebug命令r4#debugippacketIPpacketdebuggingisonr4#0:36:49:IP:s=1(Ethernet0),d=55,len118,rcvd00:36:49:IP:s=4(Ethernet0),d=55(Ethernet0),len234,rcvd30:36:49:IP:s=89(Ethernet0),d=55,len140,rcvd00:36:49:IP:s=89(Ethernet0),d=55,len140,rcvd00:36:49:IP:s=36(Ethernet0),d=55,len,rcvd00:36:49:IP:s=28(Ethernet0),d=55,len140,rcvd00:36:49:IP:s=1(Ethernet0),d=55,len118,rcvd00:36:49:IP:s=34(Ethernet0),d=55,len146,rcvd00:36:49:IP:s=0(Ethernet0),d=55(Ethernet0),len231,rcvd30:36:49:IP:s=(Ethernet0),d=55,len146,rcvd00:36:49:IP:s=(Ethernet0),d=55(Ethernet0),len231,redirected0:36:49:IP:s=(Ethernet0),d=55(Ethernet0),g=55,len231,forwardLogging命令Loggingon四種方式console-loggingconsolelevelbuffer-loggingbufferedunixsyslogloggingip-addressloggingtraplevelmonitor-loggingmonitorlevelUNIXSyslog主機(jī)Syslogconfigfile/etc/syslog.confForexample:local7.warn/var/log/local7.warn(makesure“tab〞betweenlocal7.warnand/var/log/local7.warn,notspace)Thefilelocal7.warnmustexistandbewritablesyslogdmustberestartedbyroot ps-ef|grepsyslogd kill-9<pid> syslogd-dErrormessageloggingConsole(資源耗費(fèi)最大)TerminalmonitorsyslogdbufferSyslog優(yōu)先級(jí)Syslog文件Jan915:17:39tech.asiainfosendmail[1]:NOQUEUE:4:fl=0x1,mode=20666:CHR:size=0Jan915:17:39tech.asiainfosendmail[1]:PAA01:from=wangjk,size=160,class=0,pri=30160,nrcpts=1,msgid=<200001090717.PAA01@tech.asiainfo>,relay=wangjk@localhostJan915:17:40tech.asiainfosendmail[1140]:PAA01:to=root,ctladdr=wangjk(237/200),delay=00:00:01,xdelay=00:00:01,mailer=local,stat=SentJan1408:49:41tech.asiainfosendmail[225]:startingdaemon(8.9.3):SMTP+queueing@00:15:00Jan1507:20:02tech.asiainfosendmail[457]:NOQUEUE:Nullconnectionfromlocalhost[]Jan1704:01:41tech.asiainfosendmail[216]:startingdaemon(8.9.3):SMTP+queueing@00:15:00Solaris系統(tǒng)命令Ping命令Ping命令結(jié)果unknownhost--不能解析遠(yuǎn)程主機(jī)的域名networkunreachable--本地主機(jī)沒有到遠(yuǎn)程主機(jī)的相應(yīng)的路由noanswer--沒有得到遠(yuǎn)程主機(jī)的呼應(yīng)hostisalive--得到遠(yuǎn)程主機(jī)的呼應(yīng)tracerouteTime-to-live值由1開場遞增值為1非法的UDP端口默許值為33343tracerouteSource1stGateway2ndGatewayDestinationttl=1decreaseto0returnerrordecreaseto0returnerrordecreaseto1forwarddecreaseto1forwarddecreaseto2forwardreachdestinationportunreachablereturnerrorttl=2ttl=3Ifconfig命令/disk1/shao%ifconfig-alo0:flags=849<UP,LOOPBACK,RUNNING,MULTICAST>mtu8232inetnetmaskff000000hme0:flags=863<UP,BROADCAST,NOTRAILERS,RUNNING,MULTICAST>mtu1500inet11netmaskffff0000broadcast55Nslookup命令/disk1/shao%nslookupDefaultServer:aints1.asiainfoAddress:>asiainfoServer:aints1.asiainfoAddress:Name:asiainfoAddress:Netstat命令/disk3/shao%netstat-rnRoutingTable:DestinationGatewayFlagsRefUseInterface-----------------------------------------------------------------4UGHD0131U3593le031U30le0defaultUG037UH00lo0Netstat命令/disk3/shao%netstat-iNameMtuNet/DestAddressIpktsIerrsOpktsOerrsCollisQueuelo08232loopbacklocalhost42042000le01500tech.asiainfotech81343104631250Arp命令/disk3/shao%arp-aNettoMediaTableDeviceIPAddressMaskFlagsPhysAddr-------------------------------------------------------------le0proxy5508:00:20:7a:fb:82le05500:a0:c9:8a:a8:f9le0ai-nas5500:b0:64:e9:d8:41le05508:00:20:b0:85:18le0aints15500:a0:c9:8d:d9:95le065500:d0:59:08:28:50le005500:00:21:00:92:98le0aints35500:90:27:c3:bb:d5le05508:00:20:9f:92:b9廠家MAC地址列表普通性缺點(diǎn)診斷RouterCrashWhatiscrash?SystemhasdetectedanunrecoverederrorandrestarteditselfWhattocollect?ShowtechShowlogShowenvironmentallDonotreloadrouterbeforegettingallnecessaryinformationRouterHangWhatisrouterhang?Systemencounteredacatastrophicfailurebutcan’trecoveritselfWhattodonext?CheckiftrafficcanstillflowthroughrouterIfyes,disconnectallinterfacestoseeifconsoleisavailable;Ifconsoleisavailable,doshowtech,showlog,showenvironall;ifnot,pressbreakkeytorommonmodeRouterHang(cont.)Ifnotrafficcangetthrough,presscrtl-breakkeytorommonmodeInrommonmode,typethefollowingcommandsandgetalltheoutputK,context,contandwaitingforawhileDothesame:K,context,contRepeataboveforseveraltimes〔Breakmustbeenabledinconfig-registerforbreakingtorommonconfig-register0x2002reloadtotakeeffect〕MemoryProblemsMemoryfragmentationmemorymaygetfragmentedintoverysmallblockssothatallprocessesthatrequirealargerblockcannotgetmemoryoftheblocksizethatitneeds.Memoryleakmemoryleakmeansthataparticular'process'isnotfreeingupanyallocatedmemorywhenthisprocessisdonewithit.ThisprocesskeepstheRAMinuseevenwhenitdoesn'tneedit.LackofMemory局域網(wǎng)缺點(diǎn)診斷有關(guān)的路由器命令ping及trace命令showarpshowinterfaceshowiprouteshowipaccess-listdebug局域網(wǎng)缺點(diǎn)診斷有關(guān)Solaris系統(tǒng)命令arp命令ping/traceroute命令ifconfig命令netstat命令nslookup命令局域網(wǎng)缺點(diǎn)診斷流程本地主機(jī)配置正確?能否ping本地路由器?一切路由器能否可達(dá)?遠(yuǎn)端主機(jī)配置正確?NYYYNNN修正本地主機(jī)配置(address,mask,defaultgateway)修正本地路由器配置及局域網(wǎng)問題修正一切路由器配置及廣域網(wǎng)問題修正遠(yuǎn)端主機(jī)配置景象與缺點(diǎn)判別景象與缺點(diǎn)判別(Con’t)廣域網(wǎng)缺點(diǎn)診斷廣域網(wǎng)缺點(diǎn)診斷相關(guān)的路由器命令showinterfaceserialshowlineshowcontrollerping/traceroutedebug路由協(xié)議缺點(diǎn)診斷普通性命令showipprotocolshowiproutesunmmaryOSPF路由協(xié)議showipospfdatabaseshowipospfinterfaceshowipospfneighborBGP路由協(xié)議showipbgpshowipbgpsummaryshowipbgpcommunityIS-IS路由協(xié)議showclnsneighborshowclnsrouteshowclnsis-neighborshowisisdatabase串行鏈路環(huán)測Debug命令Debug命令debugserialinterfacedebugpppnegotiationdebugserialpacket慎重地運(yùn)用debug命令!Debug命令路由協(xié)議診斷rtr1-c-1-bjbj>shiproutesumRouteSourceNetworksSubnetsOverheadMemory(bytes)connected086321088static01155169772157080isis44152872856984Level1:0Level2:419bgp649997275712937479886411842064External:1463Internal:84113Local:118internal2121288456Total7488214515499799612345672路由協(xié)議診斷-OSPFr1-c-bj>shipospfdatabase

OSPFRouterwithID(2)(ProcessID165)

RouterLinkStates(Area0)

LinkID

ADVRouter

Age

Seq#

ChecksumLinkcount

841

0x800032DB0x38E5

14

1421

0x800017AC0x7AFF

5

0

0

384

0x8000155F0x6F25

3

1

1

1725

0x8000066A0xB478

3

2

2

1558

0x800022160xCD0E

55

3

3

1092

0x80000CBB0xAFB3

2

4

4

1499

0x800049C90x7D75

43

5

5

850

0x800010A80xDE95

8

6

6

1450

0x800037760x228E

38

7

7

764

0x800002150x43BD

18

8

8

463

0x800031F60x1E32

21

路由協(xié)議診斷-OSPFr1-c-bj>shipospfint

FastEthernet0/1/0isup,lineprotocolisup

InternetAddress/29,Area0

ProcessID165,RouterID2,NetworkTypeBROADCAST,Cost:1

TransmitDelayis1sec,StateDR,Priority1

DesignatedRouter(ID)2,Interfaceaddress

BackupDesignatedrouter(ID)1,Interfaceaddress

Timerintervalsconfigured,Hello10,Dead40,Wait40,Retransmit5

Helloduein00:00:09

Index2/2,floodqueuelength0

Next0x0(0)/0x0(0)

Lastfloodscanlengthis3,maximumis40

Lastfloodscantimeis0msec,maximumis4msec

NeighborCountis1,Adjacentneighborcountis1

Adjacentwithneighbor1

(BackupDesignatedRouter)

Suppresshellofor0neighbor(s)

路由協(xié)議診斷-OSPFr1-c-bj>shipospf

neighbor

NeighborID

Pri

State

DeadTime

Address

Interface

1

1

FULL/BDR

00:00:35

FastEthernet0/1/0

4

1

FULL/

-

00:00:35

4

ATM4/0/0.1

7

1

FULL/

-

00:00:37

2

ATM4/0/0.2

0

1

FULL/

-

00:00:36

4

ATM4/0/0.3

1

1

FULL/

-

00:00:37

ATM4/0/0.4

4

1

FULL/

-

00:00:36

ATM4/0/0.5

8

1

FULL/

-

00:00:38

0

ATM4/0/0.6

6

1

FULL/

-

00:00:34

6

ATM4/0/0.7

6

1

FULL/

-

00:00:34

0

ATM4/0/0.8

7

1

FULL/

-

00:00:36

4

ATM4/0/0.9

2

1

FULL/

-

00:00:34

0

ATM4/0/0.10

0

1

FULL/

-

00:00:34

4

ATM4/0/0.11

路由協(xié)議診斷-BGPrtr1-c-1-bjbj>shipbgpBGPtableversionis41226682,localrouterIDisStatuscodes:ssuppressed,ddamped,hhistory,*valid,>best,i-internalOrigincodes:i-IGP,e-EGP,?-incompleteNetworkNextHopMetricLocPrfWeightPath*500699370180i*45500356170180i*i10001492370180i*>i10001492370180i*50069931i*4550035611i*>i69100057271i路由協(xié)議診斷命令-BGPrtr1-c-1-bjbj>shipbgpsumBGPtableversionis41225605,mainroutingtableversion4122560585846networkentries(500146/591202paths)using27630064bytesofmemory64443BGPpathattributeentriesusing8667060bytesofmemory31859BGProute-mapcacheentriesusing509744bytesofmemory19590BGPfilter-listcacheentriesusing313440bytesofmemoryDampeningenabled.120historypaths,376dampenedpaths165904receivedpathsforinboundsoftre