NFVBENCH-205 - Add behave tests for characterization and non-regression
[nfvbench.git] / behave_tests / features / characterization-full.feature
1 @characterization
2 Feature: characterization
3
4   @throughput
5   Scenario Outline: Run a NDR test for a defined frame size and flow count
6       Given 10 sec run duration
7       And TRex is restarted
8       And <frame_size> frame size
9       And <flow_count> flow count
10       And ndr rate
11       When NFVbench API is ready
12       Then 3 runs are started and waiting for maximum result
13       And push result to database
14       And extract offered rate result
15
16      Examples: Frame sizes and flow counts
17       | frame_size | flow_count |
18       | 64         | 128        |
19       | 128        | 128        |
20       | 256        | 128        |
21       | 512        | 128        |
22       | 768        | 128        |
23       | 1024       | 128        |
24       | 1280       | 128        |
25       | 1518       | 128        |
26       | IMIX       | 128        |
27       | 9000       | 128        |
28       | 64         | 10k        |
29       | 128        | 10k        |
30       | 256        | 10k        |
31       | 512        | 10k        |
32       | 768        | 10k        |
33       | 1024       | 10k        |
34       | 1280       | 10k        |
35       | 1518       | 10k        |
36       | IMIX       | 10k        |
37       | 9000       | 10k        |
38       | 64         | 100k       |
39       | 128        | 100k       |
40       | 256        | 100k       |
41       | 512        | 100k       |
42       | 768        | 100k       |
43       | 1024       | 100k       |
44       | 1280       | 100k       |
45       | 1518       | 100k       |
46       | IMIX       | 100k       |
47       | 9000       | 100k       |
48
49
50   @latency
51   Scenario Outline: Run a latency test for a defined frame size and throughput percentage
52       Given 10 sec run duration
53       And TRex is restarted
54       And <frame_size> frame size
55       And 100k flow count
56       And <throughput> rate of previous scenario
57       When NFVbench API is ready
58       Then run is started and waiting for result
59       And push result to database
60
61      Examples: Frame sizes and throughput percentages
62       | frame_size | throughput |
63       | 64         | 70%        |
64       | 64         | 90%        |
65       | 768        | 70%        |
66       | 768        | 90%        |
67       | 1518       | 70%        |
68       | 1518       | 90%        |
69       | 9000       | 70%        |
70       | 9000       | 90%        |