級(jí)互聯(lián)網(wǎng)服務(wù)客戶(hù)數(shù)據(jù)統(tǒng)計(jì)分析系統(tǒng)

第1章緒 內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)開(kāi)發(fā)背 該系統(tǒng)解決的主要問(wèn) 本文的主要工 的組織結(jié) 第2章內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)需求分 內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)概 內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)項(xiàng)目背 內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)項(xiàng)目說(shuō) 2內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)目標(biāo)和解決的問(wèn) 內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)目標(biāo) 內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)解決的問(wèn)題 內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)需求問(wèn)題描 內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)功能性需 內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)非功能性需 第3章內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)架構(gòu)設(shè) 內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)設(shè)計(jì)目標(biāo)和原 整體框 模塊設(shè) 數(shù)據(jù)庫(kù)設(shè) 實(shí)體E-R 數(shù)據(jù)庫(kù) 第4章內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)詳細(xì)設(shè) 界面詳細(xì)設(shè) 各項(xiàng)功能詳細(xì)設(shè) 登錄功 定時(shí)收集數(shù)據(jù)并分 查詢(xún)用戶(hù)列 查詢(xún)app總連接 查詢(xún)app內(nèi)網(wǎng)ip的總連接 查看app的信 異常日志分 第5章內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)的實(shí)現(xiàn)與測(cè) 5.1內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)的界面實(shí) 登錄頁(yè) 查詢(xún)頁(yè) 查詢(xún)異常日志頁(yè) 5.2定時(shí)數(shù)據(jù)功 5.3查詢(xún)列表功 查詢(xún)用戶(hù)列 查詢(xún)App連接數(shù)實(shí) 查詢(xún)App各內(nèi)網(wǎng)ip連接總數(shù)的實(shí) 查詢(xún)App詳細(xì)信息資源統(tǒng)計(jì)的實(shí) 查詢(xún)異常日志功能實(shí) Pojo類(lèi)的實(shí) 輔助工具類(lèi)的實(shí) 5.7異常處 tomcat容器不能正常關(guān)閉線(xiàn)程池問(wèn) 查詢(xún)?nèi)掌谳斎敫袷絾?wèn) 5.8配置信 Mysql配 RedisCluster配 Nginx日志的路徑配 Servlet器的配 LoginFilter器的配 5.9測(cè) 第6章結(jié) 致 參考文 附錄1英文原 附錄2譯 云服務(wù)公司統(tǒng)計(jì)分析系統(tǒng)設(shè)計(jì)與實(shí)傳統(tǒng)的公司對(duì)于內(nèi)部客戶(hù)的數(shù)據(jù)管理往往因?yàn)檫^(guò)于龐大的信息量和較為復(fù)進(jìn)而作出合理的導(dǎo)向和判斷針對(duì)公司的內(nèi)部業(yè)務(wù)需求SpringMVCwebSpringMVCwebStruts+Spring+HibernateSpringValidatorAJAX，可測(cè)試性強(qiáng)，同時(shí)新增功能易于嵌入框架，代碼的可性和系統(tǒng)的可擴(kuò)展性也隨之提高此外內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析系統(tǒng)的開(kāi)發(fā)完成在應(yīng)用層面來(lái)說(shuō)也解決了公司對(duì)于數(shù)據(jù)的分類(lèi)管理和信息的統(tǒng)計(jì)分析問(wèn)題為公司定下下一步方向和做出性決策奠定了有效的理論依據(jù)另外也關(guān)鍵字：數(shù)據(jù)統(tǒng)計(jì)分析系統(tǒng)；SpringMVC；Thetraditionalcompanyforinternalcustomerdatamanagementisoftenbecauseitistoohugeamountofinformationandamorecomplexlogicassociatedwiththedata,andhadtospendalotofhumanandfinancialresourcestocollatestatisticalysisinordertodrawvalidconclusions,andthenmakeareasonablethestrategicorientationandjudgment.Forthecompany'sinternalbusinessneeds,theneedforthecompany'strafficmanagement,userinformation,products,architecture,securityotherservicesrelatedtostatisticsanddisplaythemtothepageintheformofvisualdiagrams,weusetoquicklydesignbasedonSpringMVCframeworkwebsystemsdevelopmentsolutionstocompletionoftheinternaldataysissystem.Finally,theactualresultsshowthatusingSpringMVCframeworktobuildwebprojectscomparedtothemoretraditionaluseofStruts+Spring+Hibernateframework,onlyprovidesaneasy-to-useandflexibleandstabledevelopmentframeworkthatgreatlysimplifiesthedevelopmentcycle,directlyimproveourdevelopmentefficiency,anditsseamlessintegrationwithSpring,learninglowcost,highlyintegratedValidatorandAJAX,testabilityandstrong,andeasytoembedtheframeworkofthenewfeatures,codemaintainabilityandscalabilityofthesystemalsoincreases.Inaddition,thedevelopmentofinternaldataysissystemtocompletetheapplicationlevel,butalsosolvethecompany'smanagementandinformationfortheclassificationstatisticalysisofdata,andestablishesaneffectivetheoreticalbasisforthecompanytosetthedirectionofthenextstepandmakestrategicdecisionsinadditionthecompanyalsoprovidesdeveloperswithagoodcaseofinternaldataysissystemprojectforthedevelopmentofsimilarcompaniesneedtomanagetheprojectonceagainprovideareferencetemplate.:statisticalysissystem;SpringMVC;dataysis;1內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)開(kāi)發(fā)背該系統(tǒng)解決的主要問(wèn)，門(mén)，或者是整合數(shù)據(jù)僅此而已地是管理分析功能。有效的數(shù)據(jù)整合相當(dāng)于，本文的主要的組織2內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)需求分1內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)概內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)項(xiàng)目背excel表格中，再高級(jí)點(diǎn)的過(guò)程可能就將數(shù)據(jù)公司的app信息就繁多冗雜，這里包括用戶(hù)的如用戶(hù)id，，手機(jī)號(hào)，公司名稱(chēng)，所使用的app信息如appId，最近使用的流量，app的總數(shù)，內(nèi)網(wǎng)的ip數(shù)等，出于上述目的，公司安排我進(jìn)行項(xiàng)目的開(kāi)發(fā)，對(duì)數(shù)據(jù)內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)項(xiàng)目說(shuō)ringmcbStruts框架相比，使用該框架是因?yàn)槠浜?jiǎn)單、靈活、快速上手、直接好處是使事件響應(yīng)中的各個(gè)組成部分都模塊化，只負(fù)責(zé)自己的邏輯業(yè)Orvicejspjscss總的來(lái)說(shuō)就是如下圖：圖2-1用戶(hù)的瀏覽器發(fā)出一個(gè)請(qǐng)求經(jīng)過(guò)DispathServlet處理將請(qǐng)求根據(jù)url映射到controller上處理，controller再根據(jù)請(qǐng)求的需要去進(jìn)行數(shù)據(jù)庫(kù)的查js，css返回到瀏覽器，由瀏覽器直接2內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)目標(biāo)和解決的問(wèn)內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)目標(biāo)對(duì)新的用戶(hù)進(jìn)行一個(gè)有效的信息統(tǒng)計(jì)并以表格形式展現(xiàn)對(duì)服務(wù)端系統(tǒng)中總體的app連接數(shù)進(jìn)行定時(shí)統(tǒng)計(jì)并繪制圖表反映對(duì)服務(wù)端系統(tǒng)中總體的app的內(nèi)網(wǎng)ip連接數(shù)進(jìn)行定時(shí)統(tǒng)計(jì)并繪制app對(duì)nginx反向服務(wù)器的日志進(jìn)行分析內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)解決的問(wèn)題來(lái)源類(lèi)似，UserAgent都一樣，并且該行為集中在某個(gè)時(shí)間區(qū)間。app所有的總的連接數(shù)，可以根據(jù)以往的時(shí)間區(qū)間進(jìn)行趨勢(shì)appip的連接數(shù)，目的是判斷當(dāng)天某個(gè)app進(jìn)行全面的分析，可以理解為判斷用戶(hù)的行為，以便我們內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)需求問(wèn)題描內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)功能性需１.源源數(shù)據(jù)服定務(wù)端程信息日志圖2- 系統(tǒng)原理框架設(shè)計(jì)系統(tǒng)的定時(shí)程序定時(shí)向源數(shù)據(jù)請(qǐng)求數(shù)據(jù)，在定時(shí)程序中經(jīng)過(guò)處理再請(qǐng)客戶(hù)端向服務(wù)端發(fā) 請(qǐng)發(fā)送發(fā)送發(fā)送內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)非功能性需第3章內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)架構(gòu)設(shè)1內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)設(shè)計(jì)目標(biāo)和系統(tǒng)采用基于springMVCweb框架區(qū)別于傳統(tǒng)的web框架，springMVC2整體框mysqlspringMVCjsp負(fù)責(zé)，其中可以在jsp中放置某些jscss使得頁(yè)面更加美觀，邏輯控制部分由controllercontrollermodeldaoservicecontrollerservice對(duì)象進(jìn)行各種邏輯的操作，而在service中又進(jìn)行dao層的數(shù)據(jù)獲取處理。3模塊設(shè)Filter用戶(hù)賬圖3- 數(shù)據(jù)庫(kù)實(shí)體圖3- 模塊設(shè)計(jì)4數(shù)據(jù)庫(kù)設(shè)E-R數(shù)據(jù)庫(kù)用戶(hù)信息表用途：用戶(hù)賬號(hào)信值鍵空用戶(hù)是空0個(gè)01970-01-1是0是ip圖3- 數(shù)據(jù)庫(kù)用戶(hù)表用戶(hù)用途：用戶(hù)個(gè)人信鍵否0否0否否號(hào)否否否圖3- 數(shù)據(jù)庫(kù)用戶(hù)表App連接總數(shù)用途：app連接總值鍵否空是0是是0e是1970-01-圖3- 數(shù)據(jù)庫(kù)App連接數(shù)表Appip用途：app內(nèi)網(wǎng)ip連接總否空是是0是是0是1970-01-1圖3- 數(shù)據(jù)庫(kù)App的ip表App用途：app內(nèi)網(wǎng)ip連接總值鍵否空否否0)否0否0否0否0否0否1970-01-1否1970-01-1圖3- 數(shù)據(jù)庫(kù)App信息表第4章內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)詳細(xì)設(shè)1界面詳細(xì)設(shè)App內(nèi)網(wǎng)各ip連接數(shù)查詢(xún)頁(yè)：請(qǐng)求頁(yè)面包含兩個(gè)文本輸入框以及一個(gè)按ip區(qū)分)。App間，以及ip字段和每頁(yè)顯示的條數(shù)，可以得到經(jīng)過(guò)處理后的nginx日志分析，分析的字段包括host，ip，s，useragent，refer，需要這個(gè)頁(yè)面的主要目的是防止機(jī)的干擾，通過(guò)將可疑ip的信息輸入后，觀察分析host，UA和refer信息等等，如果發(fā)現(xiàn)是機(jī)行為就直接將該ip進(jìn)行官網(wǎng)的2各項(xiàng)功能詳細(xì)設(shè)登錄功提供了一個(gè)過(guò)濾器filter，在每次對(duì)系統(tǒng)中任意頁(yè)面資源進(jìn)行時(shí)都必須先進(jìn)行過(guò)濾器的請(qǐng)求，只有在器中通過(guò)了才允許進(jìn)行請(qǐng)求的正常攔截器圖4- 器流程定時(shí)收集數(shù)據(jù)并分定的統(tǒng)計(jì)規(guī)則是每5分鐘一次當(dāng)前時(shí)刻的兩小時(shí)內(nèi)所使用過(guò)的app的總連接valueip：<連接數(shù)>javaredisjedis對(duì)象進(jìn)行對(duì)redis數(shù)據(jù)庫(kù)的，但是經(jīng)過(guò)查看jedis的文檔，我們發(fā)現(xiàn)jedis并不支hash結(jié)構(gòu)的遍歷，所以決定采取一種迂回的戰(zhàn)術(shù)實(shí)現(xiàn)。app信息列表存放在app_stat中，我們可以根據(jù)其中的字段create_time和update_timeappappappappapp和“conn_stat_”進(jìn)行拼接，再根據(jù)需要在java內(nèi)存中轉(zhuǎn)換為我們所需要的數(shù)據(jù)結(jié)構(gòu)以對(duì)象的形mysql中，appconn_stat，appip連接數(shù)的表名是查詢(xún)用戶(hù)列、用戶(hù)的賬號(hào)信息列表在mysql的r表中字包括賬號(hào)名，ip，號(hào)碼，時(shí)間等，該表的用戶(hù)記錄是用戶(hù)在賬號(hào)(包括第三方如時(shí)往該表插入一條記錄客戶(hù)端在進(jìn)行請(qǐng)求時(shí)只需輸入查詢(xún)的起始時(shí)間和結(jié)束時(shí)間,就可以得到在指定時(shí)間區(qū)間內(nèi)的所有用戶(hù)的賬號(hào)信息、查詢(xún)app總連接當(dāng)需要查詢(xún)的app總連接數(shù)時(shí)，我們只需要直接從conn_stat這張表中conn_stat5分鐘采dayapp連接數(shù)。查詢(xún)app內(nèi)網(wǎng)ip的總連接和查詢(xún)app的總連接數(shù)類(lèi)似，當(dāng)需要查詢(xún)的app內(nèi)網(wǎng)ip總連接數(shù)務(wù)中我們提到conn_stat_ip這張表是每5分鐘一次各個(gè)ip總連接數(shù)而在展表不同的ip，所以，我們只需要根據(jù)表的字段day進(jìn)行篩選即可，另外，在默認(rèn)app各個(gè)連接數(shù)。app的信appmysql數(shù)據(jù)庫(kù)中的app_stat表中主要有app的流入流量，流出流量，創(chuàng)建時(shí)間，更新時(shí)間，并且該表中由其他程序記錄每個(gè)app的使用情況。app的信息展示主要是四app異常日志分這個(gè)模塊在整個(gè)統(tǒng)計(jì)分析系統(tǒng)中看來(lái)似乎是很突兀地存在，但是存在即合理事出必有因在之前公司舉辦相關(guān)門(mén)票的活動(dòng)時(shí)我們發(fā)現(xiàn)了機(jī)刷票的行為直接現(xiàn)象在M觀察上述用戶(hù)信息列表時(shí)偶然發(fā)現(xiàn)存在多個(gè)來(lái)自同一個(gè)ip的賬號(hào)緊著我們讓運(yùn)維工作人員查看nginx服務(wù)器日志時(shí)發(fā)現(xiàn)在短時(shí)間內(nèi)有大量的ip進(jìn)行了這個(gè)行為而且其useraget無(wú)一例外都是來(lái)自這個(gè)明顯就是一個(gè)java程序直接調(diào)用我們的接口，再有就是refer[-]果是正常的用戶(hù)進(jìn)行其refer就是官網(wǎng)的url out/sinup這種形式因此依公司的要求讓我完成這個(gè)模塊就可以節(jié)省每次讓運(yùn)維人員人工查看異常日志信息的時(shí)間，M只需要直接輸出異常ip信息和查詢(xún)的時(shí)間區(qū)間就可以查看該ip的志信息。此外，考慮到異常ip志的信息量可能太大，因此我們?cè)黾恿诉x擇了每頁(yè)條數(shù)的功能，可以是10條、100條、1000條不等。第5章內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)的實(shí)現(xiàn)與測(cè)1內(nèi)部數(shù)據(jù)統(tǒng)計(jì)分析管理系統(tǒng)的界面實(shí)登錄頁(yè)否則，任何過(guò)賬號(hào)的url請(qǐng)求資源都將強(qiáng)制跳轉(zhuǎn)到登錄頁(yè)，也就是說(shuō)，即便你事先知道其他頁(yè)面的url，但是你每次進(jìn)行都是無(wú)filter的過(guò)濾器，filter比如在此項(xiàng)目中驗(yàn)證session中是否帶有通過(guò)登錄驗(yàn)證后的合規(guī)標(biāo)識(shí)，再?gòu)?fù)雜點(diǎn)的可以在filter實(shí)現(xiàn)類(lèi)中判斷s的信息以及設(shè)置多個(gè)filter讓每個(gè)filter進(jìn)行web.xmlfilter，如下圖：配置的filter對(duì)應(yīng)的java類(lèi)是loginFilter，是重寫(xiě)doFilter()這個(gè)方法，主要邏輯是除了css、js、images、這些靜態(tài)資源以外的所有請(qǐng)求，在doFilter中取出session的user字段判斷是否為空為空則讓其重定向跳轉(zhuǎn)到login登錄頁(yè)，不為空則說(shuō)明已經(jīng)是登錄用戶(hù)，運(yùn)行通過(guò)請(qǐng)求，代碼如下圖：在login登錄過(guò)程中涉及到頁(yè)面login.jsp以及對(duì)應(yīng)的邏輯控制器1。圖5- 登錄界面查詢(xún)頁(yè)AppAppipApp各個(gè)頁(yè)面的大致樣式風(fēng)格都保持一致，都包括導(dǎo)航菜單欄，標(biāo)題，form表單輸入框，作為唯一的區(qū)別在于數(shù)據(jù)可視化呈現(xiàn)的形式，jsp的頁(yè)面和功能實(shí)現(xiàn)圖5- 用戶(hù)查詢(xún)列表圖5- App連接數(shù)查詢(xún)圖5- App的ip連接數(shù)查詢(xún)圖5- App的資源信息統(tǒng)計(jì)查詢(xún)異常日志頁(yè)ipnginxip5.2定時(shí)數(shù)據(jù)功，數(shù)據(jù)的過(guò)程發(fā)生在程序啟動(dòng)后的定時(shí)器中，和前面描述的一樣信5mysqlredis打交道。，首先我們介紹項(xiàng)目中的定時(shí)器，在定時(shí)器中主要完成的操作是從mysql的app_stat中獲取近兩個(gè)小時(shí)的app列表再把獲取到的app列表在redis數(shù)據(jù)庫(kù)中mysqlappservicedaojava的內(nèi)存中得到app的連接數(shù)以及app的內(nèi)網(wǎng)ip及連接數(shù)用mapservicedaoappappmysql中的conn_statconn_stat_ip這兩張表中，dao5.3查詢(xún)列表功AppAppipAppr234點(diǎn)則是由四個(gè)折線(xiàn)圖組成，下面開(kāi)始詳細(xì)介紹其實(shí)現(xiàn)過(guò)程以及最終的直觀界面。查詢(xún)用戶(hù)列r是由用戶(hù)的過(guò)自動(dòng)往庫(kù)表中插入一條記錄我們只需要根據(jù)輸入itContrllr中需要mysqldaomysqluserLitList<W>tttribut()userLjp。UserListControllerUserListControllerdaouserList.jsp的設(shè)計(jì)和其他的jsp的風(fēng)格都統(tǒng)一，左側(cè)是導(dǎo)航菜單欄，右側(cè)是userListformDiscovery。Jsp中從request中取出的用戶(hù)列表List<WdUser>以及用于分頁(yè)的信息，將List<WdUser>jspjscss，在用到表格的地方只要放置一個(gè)<divclass="dataTable_wrapper">，另外在時(shí)間輸入框js時(shí)間選擇器。.jsp的主要功能負(fù)責(zé)導(dǎo)航菜單欄,userList.jspuserList.jspjsApp連接數(shù)實(shí)pjspConnStatControlleConntatContollrdao數(shù)據(jù)庫(kù)的接口，從conn_stt這張表獲取符合查詢(xún)條件的數(shù)據(jù)列表，然rviceListInteger形式的數(shù)據(jù)以便適應(yīng)在折線(xiàn)圖中的展現(xiàn)。最終ConntContrller返回一個(gè)connStatjsp頁(yè)面給客戶(hù)端呈現(xiàn)。ConnStatControllerservicedaoList<Integer>元素代表一天的最高連接數(shù)，service接口代碼的實(shí)現(xiàn)如下：daomysqlgroupdaoList<Integer>只是滿(mǎn)足了折線(xiàn)縱軸，而折線(xiàn)圖的橫軸日期同樣需要一個(gè)List<String>作為輸入。因此我們需要一個(gè)函數(shù)將日期轉(zhuǎn)換成List<String>,代碼實(shí)現(xiàn)如下：conn_stat.jsp中需要表格的展示和折線(xiàn)圖的展示，需要在jsp中獲取到ConnStatController傳遞的參數(shù)數(shù)據(jù)列表List<Integer>finalList和日期列表List<String>daist，conns_stat.jsp的主要代碼實(shí)現(xiàn)如下：conns_stat.jsp的折線(xiàn)圖需要highchart.js，實(shí)現(xiàn)的代碼如下Appip連接總數(shù)的實(shí)App各內(nèi)網(wǎng)的ipApp總連接數(shù)列表的形式類(lèi)似，代碼框架同樣分為負(fù)責(zé)視圖層的jsp和負(fù)責(zé)邏輯控制層的ConnStatController?？蛻?hù)端瀏覽器發(fā)出查詢(xún)請(qǐng)求，ConnStatController中接受到請(qǐng)求并進(jìn)行參數(shù)的解析，調(diào)用dao層mysql數(shù)據(jù)庫(kù)的接口，從conn_stat_ip這張表中獲取符合查詢(xún)條件的數(shù)據(jù)列表，然后service層中對(duì)數(shù)據(jù)列表進(jìn)行數(shù)據(jù)結(jié)構(gòu)的形式轉(zhuǎn)化，與app總連接數(shù)不同的是，這里需要將數(shù)據(jù)集合轉(zhuǎn)化成一個(gè)Map<String,List<Integer>>形式的數(shù)據(jù)，Mapkeyipvalue是一個(gè)存數(shù)量的List，以便適應(yīng)在折線(xiàn)圖中的展現(xiàn)，最終ConnStatController返回一個(gè)connStatIp.jsp頁(yè)面給客戶(hù)端呈現(xiàn)，其代碼實(shí)現(xiàn)和上一章節(jié)的查詢(xún)總連接數(shù)類(lèi)似，查詢(xún)App詳細(xì)信息資源統(tǒng)計(jì)的實(shí)查詢(xún)App的詳細(xì)信息資源統(tǒng)計(jì)的實(shí)現(xiàn)原理與上面列表查詢(xún)方式大同小異，mysql數(shù)據(jù)庫(kù)中的表app_statjava的內(nèi)存中進(jìn)行數(shù)據(jù)結(jié)構(gòu)的轉(zhuǎn)換，StatsController其中負(fù)責(zé)邏輯處理的部分需要將從mysql中查詢(xún)的數(shù)據(jù)進(jìn)行格式的轉(zhuǎn)換分4個(gè)折線(xiàn)圖中，主要代碼如下：daomysqlstats.jspangularJS對(duì)數(shù)據(jù)進(jìn)行雙向綁定，angularJSstat.jscontroller射到頁(yè)面中，stat.jsstat.jspangular查詢(xún)異常日志功能實(shí)ipnginx日志并進(jìn)行分析，這里和前面的功能模塊都不一樣，我們的數(shù)據(jù)源不是mysql了，而成為了服務(wù)器上的nginx日志，日志的存放形式是按天存放，比如 在日志文件時(shí)，我們編寫(xiě)了一個(gè)類(lèi)r來(lái)行javaio處理，為了避免內(nèi)存占用過(guò)大日志文件的內(nèi)存設(shè)置為5M并且每次按行邏輯處理，rlogReader()在service邏輯控制層我們可以進(jìn)行調(diào)用DataReader的logReader()方法，然后封裝在QueryIpBehaveController此外QueryIpBehaveController需要負(fù)責(zé)對(duì)于輸ip的格式是否正確。ServiceQueryIpBehaveControllerqueryIp.jspcontroller中生成的數(shù)據(jù)信息列List<UserBehaveInfo>jsp的頁(yè)面中即可.Pojo類(lèi)的實(shí)java類(lèi)來(lái)不同的對(duì)象，下面進(jìn)行一一介紹，順序和上一章的各個(gè)模塊保持一致用 用戶(hù)的賬號(hào)信用于app的id值，其他屬性未來(lái)可以擴(kuò)AppAppipAppappId輔助工具類(lèi)的實(shí)ipList用于收集 數(shù)據(jù)的定時(shí)7異常處tomcat容器不能正常關(guān)閉線(xiàn)程池問(wèn)在項(xiàng)目在公司的實(shí)際運(yùn)行過(guò)經(jīng)常發(fā)現(xiàn)tomcat不能很好的關(guān)閉并且安全地退出，時(shí)有進(jìn)程號(hào)還存在不能退出的情況，經(jīng)過(guò)對(duì)tomcat下的系統(tǒng)日志catalina.out以及對(duì)殘留進(jìn)程號(hào)使用jstack追蹤可知是由于非守護(hù)線(xiàn)程不能安全退JVM中，只有所有的非守護(hù)線(xiàn)程退出了守護(hù)線(xiàn)程才能退出，如果存在至少一個(gè)守護(hù)線(xiàn)程則會(huì)導(dǎo)致內(nèi)存溢出，JVM不能正常關(guān)閉。因此，為了解決timerdestroytimer安全退出了。主要的代碼如下：查詢(xún)?nèi)掌谳斎敫袷絾?wèn)2016-05-12，否則程序?qū)?huì)無(wú)法識(shí)別請(qǐng)求時(shí)間的參數(shù)，進(jìn)行報(bào)錯(cuò)處js的5.8配置信Mysql配Mysql使用本地的數(shù)據(jù)庫(kù)，主要使用到的數(shù)據(jù)庫(kù)有兩個(gè)，包括wdcloud和wdstat，在java中配置mysql以便進(jìn)行數(shù)據(jù)庫(kù)的連接操作，配置文件主要涉及到RedisCluster配redis3redisredis節(jié)ip和端口，連接數(shù)Nginx日志的路徑配要在java中使用日志的查詢(xún)功能，必須讓java程序到日志的存放路徑文件Java的日志文件的類(lèi)是Servlet器的配Servlet器的作用是在整個(gè)項(xiàng)目啟動(dòng)時(shí)初始化Servlet和項(xiàng)目退出時(shí)關(guān)閉timertimer的LoginFilter器的配面前必須通過(guò)登錄頁(yè)認(rèn)證能，filter便是解決這個(gè)問(wèn)題的關(guān)鍵，只要我們配置了filter就可以使其全局的所有頁(yè)面并進(jìn)行一個(gè)的校驗(yàn)，只有通過(guò)認(rèn)證才允許其他頁(yè)面，以下是filter的配置：5.9測(cè)對(duì)于測(cè)試的環(huán)節(jié)采用白盒測(cè)試以及黑盒測(cè)試這兩種主要的方式[13]web項(xiàng)目，httpmochajs測(cè)試框架，可以直接http的請(qǐng)求。在登錄頁(yè)輸入錯(cuò)誤的賬號(hào)信在登錄頁(yè)不輸任何強(qiáng)制重定向到登錄頁(yè)登錄后關(guān)閉瀏覽器再進(jìn)入系統(tǒng)其他頁(yè)面強(qiáng)制重定向到登錄得到正確時(shí)間區(qū)間段內(nèi)的正確用戶(hù)列輸入錯(cuò)誤的時(shí)間區(qū)輸入錯(cuò)誤的時(shí)間格式App輸入錯(cuò)誤的時(shí)間區(qū)程序自動(dòng)將先后時(shí)App輸入錯(cuò)誤的時(shí)間格式App內(nèi)網(wǎng)ip連接總數(shù)輸入錯(cuò)誤的時(shí)間區(qū)程序自動(dòng)將先后時(shí)App內(nèi)網(wǎng)ip輸入錯(cuò)誤的時(shí)間格式Nginx輸入錯(cuò)誤的時(shí)間區(qū)程序自動(dòng)將先后時(shí)Nginx輸入錯(cuò)誤的時(shí)間格式NginxipNginx10、100、1000作為每頁(yè)分頁(yè)響應(yīng)頁(yè)面每頁(yè)對(duì)應(yīng) 條AppAppapp第6結(jié)分析系統(tǒng)已實(shí)現(xiàn)預(yù)期目的，實(shí)現(xiàn)了登錄、用戶(hù)信息查詢(xún)、app連接數(shù)查詢(xún)、appip連接數(shù)查詢(xún)、nginx異常日志查詢(xún)等功能，并在實(shí)現(xiàn)以上功能的基礎(chǔ)jav能性需求考慮不夠，系統(tǒng)實(shí)現(xiàn)的細(xì)節(jié)以及算法還有優(yōu)化空間致參考文[1]深入理解Java虛擬機(jī)：機(jī)械工業(yè)BruceEckel Joshua Effectivejava中文 Budi Servlet和JSP學(xué)習(xí)指 ：機(jī)械工業(yè)構(gòu)建高性能Web站點(diǎn)（修訂版）：電子工業(yè)，2012鳥(niǎo)哥鳥(niǎo)哥的Linux私房菜基礎(chǔ)學(xué)習(xí)篇（第三版）：人民郵電Patton·R軟件測(cè)試（第2版 ：機(jī)械工 ，科Java技術(shù)卷1基礎(chǔ)知識(shí)（第9版）：機(jī)謝計(jì)算機(jī)網(wǎng)絡(luò)（第6版）：電子工業(yè)百科（）黑盒測(cè)百科（）RFC2616.RFC機(jī)BaronSchwartz，PeterZaitsev，VadimTkachenko，JeremyD.Zawodny，ArjenLent，DerekJ.Ballin 1英文原ADevelopmentFrameApplicationBasedontheHibernate、theStrutsandtheSpringJ2EEOneprefacealongwiththeJavatechniqueofgradualmatureandperfect.Beestablishmentbusinessenterpriseclassapplicationofstandardterrace,theJ2EEterracegotsubstantialofdevelopment.SeveraltechniqueaskedforhelpfromtoincludeintheJ2EEnorm:EnterpriseJavaBean(EJB),JavaServlets(Servlet),JavaServerPages(JSP),JavaMessageService(JMS)etc.,developmentmanyapplicationsystem.But,alsoappearedsomeprobleminthetraditionJ2EEtheapplicationofthedevelopmenttheprocess:theantinomyofofdatamodelandlogicmodel.Currentlythedatabaseofusagebasicallyandallisrelationtypedatabase,buttheJavabeessentiallyakindofthelanguagewhichfacetoobject,objectatsavingwithreadusageSQLandJDBCcarryonadatabaseoperationandloweredplaitdistanceofefficiencyandsystemofcanmaintenance;traditionofJ2EEapplicationmuchtheadoptionisaccordingtotheEJBheavyweightframe,thiskindofframesuitablefordevelopalargebusinessenterpriseapplication,butusagetheEJBcontainercarryondevelopmentandadjusttotrytoneedtobewasteagreatdealoftime.ForloweringtheOuofcodetomatchsex,exaltationsystemofdevelopmentefficiency,thistextputforwardonekindEEaccordingtotheJ2oftheStrutsframe、theHibernateframeandtheSpringframeapplicationdevelopmentstrategy.TheHibernateData'sholdingoutforlongtimelayerandHibernateisonepieceaccordingtoholdoutforlongtimelayerframe,isakindofrealizationobjectandrelationofthetoolwhichreflecttoshoot(O/RMap),itcarriedontheobjectofthelightweighttopacktotheJDBCandmakeproceduremembercanusageobjectplaitthoughttooperationdatabase.ItnotonlyprovidedtoshootfromJavatoreflectofdataform,butalsoprovidedadataasearchandinstaurationmechanism.OppositeinusageJDBCandSQLtooperationdatabase,useHibernateabilityconsumedlyofexaltationrealizationofefficiency.TheHibernateframeuseallocationoftheformcometothereflectofthedefinitionJavaobjectanddataformtoshootrelation,inthemeatmoredeepoflevelofdataformofrelationexplanationfortherelationssuchasinheritofandcontainmentetc.ofJavaobject.PasstheusageHQLlanguagesentencecomplicationsofrelationthecalculatewayusethewayofobjectdescription,toalargeextentsimplificationlogarithmsaccordingtoofsearch,speeddevelopmentofefficiency.HaveintheHibernateasimplebutkeeptheAPIview,usedfortothedatabasemeanofobjectperformancesearch.Wanttoestablishorthemodificationbetheseobjects,needintheprocedurecarryonwiththemtohandoverwitheachother,thenlHibernatetokeep.So,agreatdealofpackholdoutforlongtimeturnoperationofbusinesslogicnolongerdemandwriteatrivialJDBClanguagesentence,makedatalastlongthusthelayergotbiggestofsimplification.UsetheStrutsrealizationMVCstructureMVC(Model-View-Controller)isputforwardbytheTrygveReenskaug,firstdriveapplicationintheenvironmentSmallTalk-80,ismanytohandoverwitheachotherwithinterfacesystemofconstitutefoundation.Accordingtotheneedofvariableoftheinterfacedesign,MVChandoverwitheachotherconstituteofsystemtoresolveintomodelandseediagram,controllerthreepart.Model(Model)issoftwareprocessingproblemlogicatindependenceinoutsidemanifestationundercontentsandformcircumstanceof,packedthecoredata,logicofproblemandfunctionofcalculationrelation,independenceinconcreteofinterfaceexpressionandI/Ooperation.Seediagram(View)meaninformationandparticularformdemonstrationofmodeldataandlogicrelationandappearancetothecustomer.Itacquireamanifestationinformationfromthemodel,therecanbemanyforhomologyofinformationdissimilarityofmanifestationformorseediagram.Thecontroller(Controller)isaprocessingthecustomerhandoverwithsoftwarewitheachotheroperationof,itsjobiscontrolprovidemodelinanyvarietyofdissemination,insureacustomeramongthemodelofrightnessshouldcontact;Itacceptacustomerofimportation,give°theimportationfeedbackmodel,thenrealizationcomputemodelcontrol,ismakemodelandseediagramtomoderateworkofparts.Usually1seeadiagramrightnessshouldacontroller.Model,seeseparateofdiagramandcontroller,makeamodelbeabletohavemanymanifestationtoseediagram.Ifthecustomerpassacertainseethecontrollerofdiagramchangethedataofmodel,allotherdependenceintheseseeofdatadiagramallshouldreflectionarrivethesevariety.Whenthereforeandregardlessoccurrencewhatdatavariety,controllerallwouldvarietynoticeallyseediagram,causemanifestationofrenewal.Thisisactuallyakindofvarietyofmodel-disseminationmechanism.TheStrutsTheStrutsframeistobetheitemofApacheJakartatoconstituteparttopublishlucktodoattheearlieststage,itinheritedMVCofeachitemcharacteristic,anddidaccordingtothecharacteristicsofJ2EEcorrespondofvarietywithexpand.TheStrutsframewasgoodtocombineJsp,JavaServlet,JavaBean,Taliaetc.technique.IntheStruts,whattoundertakethecontrollerroleintheMVCbeanActionServlet.TheActionServletisaningeneralusecontrolmodule.ThiscontrolmoduleprovidedaprocessingallHTTPclaimwhichsendoutStrutsofentrancepoint.Itsinterceptionwithdistributetheseclaimtoarrivecorrespondofactiontype.(theseactionalloftypeisActionsontype)MoreoverthecontrolmoduleisalsoresponsibleforusingtocorrespondofclaimtheparameterfillActionForm(FromBean),andpassactiontype(ActionBean).Actiontypethebusinesslogicoftheinterviewcore,theninterviewJavaBeanoradjusttouseEJB.Endactiontypecontrolthepowerpassfollow-upJSP,fromJSPbornseediagram.AllthesecontrollogicmakeuseofStruts-config.xmlthecometoallocation.SeediagramintheStrutsframemainfromJSPbornpagecompletion,theStrutsprovideabundantofJSPlabeldatabase,thisisadvantageoustoseparatingperformancelogicandprocedurelogic.Themodeliswith1ortheformexistenceofseveralJavaBean.IntheStruts,mainexistencethreekindsofBean,respectivelyBE:Action,ActionForm,EJBperhapsJavaBean.TheStrutsframehavenoconcretedefinitionmodellayerrealization,inactuallythedevelopment,modellayerusuallyisclosewithbusinesslogicconnectwitheachother,andwanttocarryonoperationtothefirstfloordata.Theunderneath'sintroductionisakindofdevelopmentstrategy,leadtheHibernateintothemodellayerofStrutsframe,usageittocarryonadatatopackwithreflecttoshoot,provideholdoutforlongtimeturnofsupport.4usageHibernateandtheStrutsdevelopmentJ2EEapplication4.1systemstructurediagram3manifestationaccordingtoHibernateandStrutsdevelopmentstrategyofsystemstructurediagram.theSpringSpringisn'tparticularlyawebframeworkbutagenericlightweightapplicationframeworkwithdedicatedwebsupport,andshowthearchitecturaldifferencestoStrutsandWebWorkIncontrasttoStrutsorWebWork,Springisanapplicationframeworkforalllayers:Itoffersabeanconfigurationfoundation,AOPsupport,JDBC transactionsupportetc.Itisaverynon-intrusiveeffort:YourapplicationclassesdonotneedtodependonanySpringclassesifnotnecessary,andyoucanreuseeverypartonitsownifyouliketo.Fromitsverydesign,theframeworkencouragescleanseparationoftiers,mostimportantlywebtierandbusinesslogic.e.g:thevalidationframeworkdoesnotdependonwebcontrollers.Majorgoalsarereusabilityandtestability:Unnecessarycontainerorframeworkdependenciescanbeconsideredavoidableevils.Ofcourse,Spring'sownwebsupportisnicelyintegratedwiththeframework'sgeneralpatterns.Nevertheless,replacingthewebsolutionwithStruts,WebWork,orthelikeiseasy.BothwithSpring'swebsupportoradifferentone,Springallowsforbuildingatruededicatedmiddletierinthewebcontainer,withtheoptiontoreuseexactlythesamebusinesslogicintestenvironmentsorstandaloneapplications.AndwithinJ2EE,yourbusinesslogicwillnotunnecessarilydependoncontainerserviceslikeJTAorEJB-allowingcomplex,well-architectedwebapplicationstorunina"simple"containerlikeTomcatorResin.NotethatSpringdoesn'tgenerallyaimtocompetewithexistingsolutions.ItratherfostersseamlessintegrationwithstandardslikeServlet,JSP,JTA,JNDI,JDBC,andJDO,andwell-suitedtoolslikeHibernate,Velocity,Log4J,andCaucho'sHessian/Burlap.Theframeworkisdesignedtogrowwiththeneedsofyourapplications,intermsoftechnologychoice:Forexample,youwillprobablyuseJTAviaSpring'sJtaTransactionManagerifyouneeddistributedtransactions-butonlythen,asthereareperfectreplacementsforsingledatabases,likeDataSourceTransactionManagerorHibernateTransactionManager.Spring'swebframeworkisdesignedaroundaDispatcherServletthatdispatchesrequeststohandlers,withconfigurablehandlermaps,viewresolution,andlocaleandthemeresolution.ThedefaulthandlerisaverysimpleControllerinterface,justofferinga"ModelAndViewhandleRequest(request,response)"method.Thiscanalreadybeusedforapplicationcontrollers,butyouwillpreferthe WizardFormController.Applicationcontrollerswilltypicallybesubclassesofthose.Notethatyoucanchooseanappropriatebaseclass:Ifyoudon'thaveaform,youdon'tneedaFormController.ThisisamajordifferencetoStruts.Youcantakeanyobjectascommandorformobject:There'snoneedtoimplementaninterfaceorderivefromabaseclass.Spring'sdatabindingishighlyflexible,e.g.ittreatstypemismatchesasvalidationerrorsthatcanbeevaluatedbytheapplication,notassystemerrors.Soyoudon'tneedtoduplicateyourbusinessobjects'propertiesasStringsinyourformobjects,justtobeabletohandleinvalidsubmissions,ortoconverttheStringsproperly.Instead,it'softenpreferabletobinddirectlytoyourbusinessobjects.ThisisanothermajordifferencetoStrutswhichisbuiltaroundrequiredbaseclasseslikeActionandActionForm-foreverytypeofaction.ComparedtoWebWork,Springhasmoredifferentiatedobjectroles:ItsupportsthenotionofaController,anoptionalcommandorformobject,andamodelthatgetspassedtotheview.Themodelwillnormallyincludethecommandorformobjectbutalsoarbitraryreferencedata.Instead,aWebWorkActioncombinesallthoserolesintoonesingleobject.WebWorkdoesallowyoutouseexistingbusinessobjectsaspartofyourform,butjustbymakingthembeanpropertiesoftherespectiveActionclass.Finally,thesameActioninstancethathandlestherequestgetsusedforevaluationandformpopulationintheview.Thus,referencedataneedstobemodelledasbeanpropertiesoftheActiontoo.Regardingviews:Spring'sviewresolutionisextremelyflexible.AControllerimplementationcanevenwriteaviewdirectlytotheresponse,returningnullasModelAndView.Inthenormalcase,aModelAndViewinstanceconsistsofaviewnameandamodelMap,containingbeannamesandcorrespondingobjects(likeacommandorform,referencedata,etc).Viewnameresolutionishighlyconfigurable,eitherviabeannames,viaapropertiesfile,orviayourownViewResolverimplementation.The modelMapallowsforcomplete ionoftheviewtechnology,withoutanyhassle:BeitJSP,Velocity,oranythingelse-everyrenderercanbeintegrateddirectly.ThemodelMapsimplygetstransformedintoanappropriateformat,likeJSPrequestattributesoraVelocitytemplatemodel.Ifyoudon'twanttouseSpring'swebMVCbutintendtoleverageothersolutionsthatSpringoffers,youcanintegratethewebframeworkofyourchoicewithSpringeasily.SimplystartupaSpringrootapplicationcontextviaitsContextLoaderListener,andaccessitviaitsServletContextattribute(orSpring'srespectivehelpermethod)fromwithinaStrutsorWebWorkaction.Notethattherearen'tany"plugins"involved,thereforenodedicatedintegration:Fromtheviewoftheweblayer,you'llsimplyuseSpringasalibrary,withtherootapplicationcontextinstanceasentrypoint.AllyourregisteredbeansandallofSpring'sservicescanbeatyourfingertipsevenwithoutSpring'swebMVC.Springdoesn'tcompetewithStrutsorWebWorkinthisusage,itjustaddressesthemanyareasthatthepurewebframeworksdon't,frombeanconfigurationtodataaccessandtransactionhandling.SoyouareabletoenrichyourapplicationwithaSpringmiddletierand/ordataaccesstier,evenifyoujustwanttousee.g.thetransaction ionwithJDBCorHibernate.Ifjustfocussingonthewebsupport,someofSpring'suniquefeaturesare:.Clearseparationofroles:controllervsvalidatorvscommandobjectvsformobjectvsmodelobject,DispatcherServletvshandlermapvsviewresolver,etc..PowerfulandstraightforwardconfigurationofbothframeworkandapplicationclassesasJavaBeans,includingeasyin-betweenreferencingviaanapplicationcontext,fromwebcontrollerstobusinessobjectsandvalidators..Adaptability,non-intrusiveness:UsewhateverControllersubclassyouneed(plain,command,form,wizard,multiaction,oracustomone)foragivenscenarioinsteadofderivingfromAction/ActionFormforeverything..Reusablebusinesscode,noneedforduplication:YoucanuseexistingbusinessobjectsascommandorformobjectsinsteadofmirroringtheminspecialActionFormsubclasses..Customizablebindingandvalidation:typemismatchesasapplication-levelvalidationerrorsthatkeeptheoffendingvalue,localizeddateandnumberbinding,etcinsteadofString-onlyformobjectswithmanualparsingandconversiontobusinessobjects.Customizablehandlermap,customizableviewresolution:flexiblemodeltransfervianame/valuehandlermapandviewresolutionstrategiesfromsimpletosophisticatedofonesingleWithintheJ2theEEtheapplicationverywidespreadcustomerregisterprocessforexample,elucidationabove-mentionedsystemstructureishowconcreteusage.Theproces