Add test case description and modify task file for TC004
[yardstick.git] / docs / userguide / opnfv_yardstick_tc014.rst
1 .. This work is licensed under a Creative Commons Attribution 4.0 International
2 .. License.
3 .. http://creativecommons.org/licenses/by/4.0
4 .. (c) OPNFV, Huawei Technologies Co.,Ltd and others.
5
6 *************************************
7 Yardstick Test Case Description TC014
8 *************************************
9
10 .. _unixbench: https://github.com/kdlucas/byte-unixbench/blob/master/UnixBench
11
12 +-----------------------------------------------------------------------------+
13 |Processing speed                                                             |
14 |                                                                             |
15 +--------------+--------------------------------------------------------------+
16 |test case id  | OPNFV_YARDSTICK_TC014_Processing speed                       |
17 |              |                                                              |
18 +--------------+--------------------------------------------------------------+
19 |metric        | score of single cpu running, score of parallel running       |
20 |              |                                                              |
21 +--------------+--------------------------------------------------------------+
22 |test purpose  | To evaluate the IaaS processing speed with regards to score  |
23 |              | of single cpu running and parallel running                   |
24 |              | The purpose is also to be able to spot trends. Test results, |
25 |              | graphs and similar shall be stored for comparison reasons    |
26 |              | and product evolution understanding between different OPNFV  |
27 |              | versions and/or configurations.                              |
28 |              |                                                              |
29 +--------------+--------------------------------------------------------------+
30 |configuration | file: opnfv_yardstick_tc014.yaml                             |
31 |              |                                                              |
32 |              | run_mode: Run unixbench in quiet mode or verbose mode        |
33 |              | test_type: dhry2reg, whetstone and so on                     |
34 |              |                                                              |
35 |              | For SLA with single_score and parallel_score, both can be    |
36 |              | set by user, default is NA                                   |
37 |              |                                                              |
38 +--------------+--------------------------------------------------------------+
39 |test tool     | unixbench                                                    |
40 |              |                                                              |
41 |              | (unixbench is not always part of a Linux distribution, hence |
42 |              | it needs to be installed. As an example see the              |
43 |              | /yardstick/tools/ directory for how to generate a Linux      |
44 |              | image with unixbench included.)                              |
45 |              |                                                              |
46 +--------------+--------------------------------------------------------------+
47 |references    | unixbench_                                                   |
48 |              |                                                              |
49 |              | ETSI-NFV-TST001                                              |
50 |              |                                                              |
51 +--------------+--------------------------------------------------------------+
52 |applicability | Test can be configured with different test types, dhry2reg,  |
53 |              | whetstone and so on.                                         |
54 |              |                                                              |
55 +--------------+--------------------------------------------------------------+
56 |pre-test      | The test case image needs to be installed into Glance        |
57 |conditions    | with unixbench included in it.                               |
58 |              |                                                              |
59 |              | No POD specific requirements have been identified.           |
60 |              |                                                              |
61 +--------------+--------------------------------------------------------------+
62 |test sequence | description and expected result                              |
63 |              |                                                              |
64 +--------------+--------------------------------------------------------------+
65 |step 1        | The hosts are installed, as a client. unixbench  is          |
66 |              | invoked and logs are produced and stored.                    |
67 |              |                                                              |
68 |              | Result: Logs are stored.                                     |
69 |              |                                                              |
70 +--------------+--------------------------------------------------------------+
71 |test verdict  | Fails only if SLA is not passed, or if there is a test case  |
72 |              | execution problem.                                           |
73 |              |                                                              |
74 +--------------+--------------------------------------------------------------+