如何選擇自動化測試框架

1、Michael Kelly在Choosing a test automation framework一文中提到測試自動化框架是一組假設、概念和慣例的集合，用于支持自動化測試。（A test automation framework is a set of assumptions, concepts, and practices that provide support for automated software testing.）Michael Kelly把自動化測試框架劃分為5大類：（1）模塊化框架（test script modularity）。（2）函數(shù)庫結構框架（test libra

2、ry architecture）。（3）關鍵字驅動測試框架（keyword-driven/table-driven testing）。（4）數(shù)據驅動測試框架（data-driven testing）。（5）混合型框架（hybrid test automation）。模塊化框架（test script modularity）首先編寫底層的三級腳本，例如：Sub Main Window Set Context, "Caption=Calculator", "" '5 PushButton Click, "ObjectIndex=10&quo

3、t; '+ PushButton Click, "ObjectIndex=20" '6 PushButton Click, "ObjectIndex=14" '= PushButton Click, "ObjectIndex=21" '11 Result = LabelUP (CompareProperties, "Text=11.", "UP=Object Properties") End SubSub Main Window Set Context, &quo

4、t;Caption=Calculator", "" '20 PushButton Click, "ObjectIndex=11" PushButton Click, "ObjectIndex=8" '- PushButton Click, "ObjectIndex=19" '10 PushButton Click, "ObjectIndex=7" PushButton Click, "ObjectIndex=8" '= PushBut

5、ton Click, "ObjectIndex=21" '10 Result = LabelUP (CompareProperties, "Text=10.", "UP=Object Properties") End Sub底層腳本可以作為測試腳本開發(fā)任務，分模塊下發(fā)給每個測試工程師負責開發(fā)。然后用一個二級腳本來組織和整合這幾個底層的腳本，例如下面是計算器的標準視圖下組合底層測試腳本的例子：'Test Script Modularity Framework'Script for Standard ViewSub

6、 Main 'Test Add Functionality CallScript "Test Script Mod Framework - Add" 'Test Subtract Functionality CallScript "Test Script Mod Framework - Substract" 'Test Divide Functionality CallScript "Test Script Mod Framework - Divide" 'Test Multiply Functiona

7、lity CallScript "Test Script Mod Framework - Multiply" End Sub最后，最頂層的測試腳本（一級腳本）再去把二級腳本組織和整合在一起執(zhí)行，例如下面的腳本組合了計算器的標準視圖和科學視圖的測試腳本：'Test Script Modularity Framework'Top level script - represents test caseSub Main 'Test the Standard View CallScript "Test Script Mod Framework - S

8、tandard" 'Test the Scientific View CallScript "Test Script Mod Framework - Scientific" End Sub庫結構框架（test library architecture）把測試腳本做成函數(shù)，通過函數(shù)之間互相調用來組織測試用例。例如下面的一個函數(shù)實現(xiàn)了計算器標準視圖的測試：'Header File'Test Library Architecture Framework"Functions LibraryDeclare Sub StandardViewF

9、unction BasicLib "Functions Library" (OperandOne As Integer, _'Library Source File'Test Library Architecture Framework'Functions LibrarySub StandardViewFunction (OperandOne As Integer, _ OperandTwo As Interger, _ Operation As String) 'Click on first operand Select Case Oper

10、andOne Case 0 PushButton Click, "ObjectIndex=8"Case 1 PushButton Click, "ObjectIndex=7"Case 2 PushButton Click, "ObjectIndex=11"Case 3 PushButton Click, "ObjectIndex=15"Case 4 PushButton Click, "ObjectIndex=6"Case 5 PushButton Click, "ObjectInde

11、x=10"Case 6 PushButton Click, "ObjectIndex=14"Case 7 PushButton Click, "ObjectIndex=5"Case 8 PushButton Click, "ObjectIndex=9"Case 9 PushButton Click, "ObjectIndex=13"End Select 'Click on second operand Select Case OperandOne Case "+" PushBu

12、tton Click, "ObjectIndex=8"Case "-" PushButton Click, "ObjectIndex=7"Case "*" PushButton Click, "ObjectIndex=11"Case "/" PushButton Click, "ObjectIndex=15"End Select 'Click on third operand Select Case OperandOne Case 0 PushBu

13、tton Click, "ObjectIndex=8"Case 1 PushButton Click, "ObjectIndex=7"Case 2 PushButton Click, "ObjectIndex=11"Case 3 PushButton Click, "ObjectIndex=15"Case 4 PushButton Click, "ObjectIndex=6"Case 5 PushButton Click, "ObjectIndex=10"Case 6 Pus

14、hButton Click, "ObjectIndex=14"Case 7 PushButton Click, "ObjectIndex=5"Case 8 PushButton Click, "ObjectIndex=9"Case 9 PushButton Click, "ObjectIndex=13"End Select'=PushButton Click, "ObjectIndex=21"End Sub然后再用另外一個腳本來調用上面的函數(shù)，通過傳入不同的參數(shù)來指定測試不同的內容：&#

15、39;Test Library Architecture Framework'Test Case script'$Include "Functions Library.sbh"Sub Main 'Test the Standard View Window Set Context, "Caption=Calculator", "" 'Test Add Functionalty StandardViewFunction 3,4,"+" Result = LabelVP (CompareP

16、roperties, "Text=7.", "VP=Add") 'Test Subtract Functionalty StandardViewFunction 3,2,"-" Result = LabelVP (CompareProperties, "Text=1.", "VP=Sub") 'Test Multiply Functionalty StandardViewFunction 4,2,"*" Result = LabelVP (ComparePro

17、perties, "Text=8.", "VP=Mult") 'Test Divide Functionalty StandardViewFunction 10,5,"/" Result = LabelVP (CompareProperties, "Text=2.", "VP=Div") End Sub關鍵字驅動框架（keyword-driven/table-driven testing）首先定義關鍵字表格，關鍵字表格一般存儲在測試數(shù)據庫、Excel或文件中。例如下面的表格定義了測試Wi

18、ndows計算器所需要的所有對象、操作、測試數(shù)據：WindowControlActionArgumentsCalculatorMenuView, StandardCalculatorPushbuttonClick1CalculatorPushbuttonClick+CalculatorPushbuttonClick3CalculatorPushbuttonClick=CalculatorVerify Result4CalculatorClearCalculatorPushbuttonClick6CalculatorPushbuttonClick-CalculatorPushbuttonClic

19、k3CalculatorPushbuttonClick=CalculatorVerify Result3然后編寫驅動代碼，讀取上述表格，分析出測試對象、測試操作、測試數(shù)據，編寫高度抽象的測試邏輯，下面是一個框架的偽代碼：Main Script / Program Connect to data tables. Read in row and parse out values. Pass values to appropriate functions. Close connection to data tables. Menu Module Set focus to window. Select

20、 the menu pad option. Return. Pushbutton Module Set focus to window. Push the button based on argument. Return. Verify Result Module Set focus to window. Get contents from label. Compare contents with argument value. Log results. Return.有了驅動框架后，只需要按一定的格式編輯表格的數(shù)據，就可以利用驅動框架遍歷表格中的每一行數(shù)據，執(zhí)行所有測試用例。數(shù)據驅動框架（D

21、ata-Driven Testing）數(shù)據驅動框架與關鍵字驅動框架類似，測試數(shù)據都存儲在數(shù)據庫或Excel文件，但是數(shù)據驅動框架的測試用例、測試步驟和測試邏輯是在測試腳本中編寫的，而不像關鍵字驅動框架一樣放在表格中。例如對于圖中的測試，可以把每個輸入框的數(shù)據進行參數(shù)化，在Excel文件中存儲（如果是使用Rational Robot的話就可以直接使用DataPool）。如果通過錄制產生腳本的話，可得到腳本如下所示：'Data Driven Framework'Test Case ScriptSub Main 'Make An Order Window Set Contex

22、t, "Name=frmOrder", "" 'Card Number EditBox Click, "Name=txtCreditCard", "Coords=16,9" InputKeys "3333444455556666" 'Expiration Date EditBox Click, "Name=txtExpirationDate", "Coords=6,7" InputKeys "3333444455556666&qu

23、ot; 'Place Order PushButton Click, "Name=cmdOrder" 'Confirmation Screen Window SetContext, "Name=frmConfirm", "" PushButton Click, "Name=cmdOK" End Sub我們可以在表格中填寫參數(shù)對應的測試數(shù)據：然后在修改腳本如下：'Data Driven Framework'Test Case Script'$Include "SQAU

24、TIL.SBH"Sub Main Dim Result As Integer Dim DatapoolHandle As Long Dim DatapoolReturnValue As Variant 'Open the datapool DatapoolHandle = SQADatapoolOpen("OrderFormDP") '.Add error checking. 'Loop through the datapool While SQADatapoolFetch(DatapoolHandle) = dqaDpSuccess &#

25、39;Open Order Form Window SetContext, "Name=frmMain", "" PushButton Click, "Name=cmdOrder" Window SetContext, "Name=frmOrder", "" 'Card Number Result = SQADatapoolValue(DatapoolHanle, "Credit Card Number", DatapoolReturnValue) ".Add error checking. EditBox Click, "Name=txtCreditCard", "Coords=16,9" '.Clear Value. InputKeys DatapoolReturnValue 'Expiration Date Result = SQADatapoolValue(DatapoolHandle, "