NFVBENCH-210 Remove TRex restart from behave test scenarios
[nfvbench.git] / behave_tests / features / characterization-full.feature
1 @characterization
2 Feature: characterization
3
4   @throughput
5   Scenario Outline: Run a NDR test for a defined frame size and flow count
6       Given 10 sec run duration
7       And <frame_size> frame size
8       And <flow_count> flow count
9       And ndr rate
10       When NFVbench API is ready
11       Then 3 runs are started and waiting for maximum result
12       And push result to database
13       And extract offered rate result
14
15      Examples: Frame sizes and flow counts
16       | frame_size | flow_count |
17       | 64         | 128        |
18       | 128        | 128        |
19       | 256        | 128        |
20       | 512        | 128        |
21       | 768        | 128        |
22       | 1024       | 128        |
23       | 1280       | 128        |
24       | 1518       | 128        |
25       | IMIX       | 128        |
26       | 9000       | 128        |
27       | 64         | 10k        |
28       | 128        | 10k        |
29       | 256        | 10k        |
30       | 512        | 10k        |
31       | 768        | 10k        |
32       | 1024       | 10k        |
33       | 1280       | 10k        |
34       | 1518       | 10k        |
35       | IMIX       | 10k        |
36       | 9000       | 10k        |
37       | 64         | 100k       |
38       | 128        | 100k       |
39       | 256        | 100k       |
40       | 512        | 100k       |
41       | 768        | 100k       |
42       | 1024       | 100k       |
43       | 1280       | 100k       |
44       | 1518       | 100k       |
45       | IMIX       | 100k       |
46       | 9000       | 100k       |
47
48
49   @latency
50   Scenario Outline: Run a latency test for a defined frame size and throughput percentage
51       Given 10 sec run duration
52       And TRex is restarted
53       And <frame_size> frame size
54       And 100k flow count
55       And <throughput> rate of previous scenario
56       When NFVbench API is ready
57       Then run is started and waiting for result
58       And push result to database
59
60      Examples: Frame sizes and throughput percentages
61       | frame_size | throughput |
62       | 64         | 70%        |
63       | 64         | 90%        |
64       | 768        | 70%        |
65       | 768        | 90%        |
66       | 1518       | 70%        |
67       | 1518       | 90%        |
68       | 9000       | 70%        |
69       | 9000       | 90%        |