Test case to measure processing speed(score) 89/6189/1
authorkubi <jean.gaoliang@huawei.com>
Mon, 11 Jan 2016 14:58:13 +0000 (22:58 +0800)
committerqi liang <liangqi1@huawei.com>
Mon, 11 Jan 2016 15:49:31 +0000 (15:49 +0000)
run unixbench to get the score of processing performance
This patch includes the .yaml for the test case and the .rst for test case description.

JIRA:YARDSTICK-116

Signed-off-by: kubi <jean.gaoliang@huawei.com>
Change-Id: Ic75119d1db19dacc57edfa4dce607e0e29ae8db4
Signed-off-by: kubi <jean.gaoliang@huawei.com>
(cherry picked from commit db643f9a2a416c0888931a347488a51264350c8f)

docs/configguide/yardstick_testcases/03-list-of-tcs.rst
docs/configguide/yardstick_testcases/opnfv_yardstick_tc014.rst [new file with mode: 0644]
tests/opnfv/test_cases/opnfv_yardstick_tc014.yaml [new file with mode: 0644]

index d801bf9..c46d29b 100644 (file)
@@ -27,6 +27,7 @@ Generic NFVI Test Case Descriptions
    opnfv_yardstick_tc009.rst
    opnfv_yardstick_tc010.rst
    opnfv_yardstick_tc012.rst
+   opnfv_yardstick_tc014.rst
    opnfv_yardstick_tc037.rst
    opnfv_yardstick_tc038.rst
    opnfv_yardstick_tc040.rst
diff --git a/docs/configguide/yardstick_testcases/opnfv_yardstick_tc014.rst b/docs/configguide/yardstick_testcases/opnfv_yardstick_tc014.rst
new file mode 100644 (file)
index 0000000..68d36ec
--- /dev/null
@@ -0,0 +1,69 @@
+*************************************
+Yardstick Test Case Description TC014
+*************************************
+
+.. _unixbench: https://github.com/kdlucas/byte-unixbench/blob/master/UnixBench
+
++-----------------------------------------------------------------------------+
+|Processing speed                                                             |
+|                                                                             |
++--------------+--------------------------------------------------------------+
+|test case id  | OPNFV_YARDSTICK_TC014_Processing speed                       |
+|              |                                                              |
++--------------+--------------------------------------------------------------+
+|metric        | score of single cpu running, score of parallel running       |
+|              |                                                              |
++--------------+--------------------------------------------------------------+
+|test purpose  | To evaluate the IaaS processing speed with regards to score  |
+|              | of single cpu running and parallel running                   |
+|              | The purpose is also to be able to spot trends. Test results, |
+|              | graphs and similar shall be stored for comparison reasons    |
+|              | and product evolution understanding between different OPNFV  |
+|              | versions and/or configurations.                              |
+|              |                                                              |
++--------------+--------------------------------------------------------------+
+|configuration | file: opnfv_yardstick_tc014.yaml                             |
+|              |                                                              |
+|              | run_mode: Run unixbench in quiet mode or verbose mode        |
+|              | test_type: dhry2reg, whetstone and so on                     |
+|              |                                                              |
+|              | For SLA with single_score and parallel_score, both can be    |
+|              | set by user, default is NA                                   |
+|              |                                                              |
++--------------+--------------------------------------------------------------+
+|test tool     | unixbench                                                    |
+|              |                                                              |
+|              | (unixbench is not always part of a Linux distribution, hence |
+|              | it needs to be installed. As an example see the              |
+|              | /yardstick/tools/ directory for how to generate a Linux      |
+|              | image with unixbench included.)                              |
+|              |                                                              |
++--------------+--------------------------------------------------------------+
+|references    | unixbench_                                                   |
+|              |                                                              |
+|              | ETSI-NFV-TST001                                              |
+|              |                                                              |
++--------------+--------------------------------------------------------------+
+|applicability | Test can be configured with different test types, dhry2reg,  |
+|              | whetstone and so on.                                         |
+|              |                                                              |
++--------------+--------------------------------------------------------------+
+|pre-test      | The test case image needs to be installed into Glance        |
+|conditions    | with unixbench included in it.                               |
+|              |                                                              |
+|              | No POD specific requirements have been identified.           |
+|              |                                                              |
++--------------+--------------------------------------------------------------+
+|test sequence | description and expected result                              |
+|              |                                                              |
++--------------+--------------------------------------------------------------+
+|step 1        | The hosts are installed, as a client. unixbench  is          |
+|              | invoked and logs are produced and stored.                    |
+|              |                                                              |
+|              | Result: Logs are stored.                                     |
+|              |                                                              |
++--------------+--------------------------------------------------------------+
+|test verdict  | Fails only if SLA is not passed, or if there is a test case  |
+|              | execution problem.                                           |
+|              |                                                              |
++--------------+--------------------------------------------------------------+
diff --git a/tests/opnfv/test_cases/opnfv_yardstick_tc014.yaml b/tests/opnfv/test_cases/opnfv_yardstick_tc014.yaml
new file mode 100644 (file)
index 0000000..f1b9953
--- /dev/null
@@ -0,0 +1,32 @@
+---
+# Yardstick TC014 config file
+# Measure Processing speed using unixbench
+
+schema: "yardstick:task:0.1"
+
+scenarios:
+-
+  type: UnixBench
+  options:
+    run_mode: 'verbose'
+    test_type: 'dhry2reg'
+  host: Chang'e.yardstick-TC014
+
+  runner:
+    type: Iteration
+    iterations: 1
+    interval: 1
+
+context:
+  name: yardstick-TC014
+  image: yardstick-trusty-server
+  flavor: yardstick-flavor
+  user: ec2-user
+
+  servers:
+    Chang'e:
+      floating_ip: true
+
+  networks:
+    test:
+      cidr: '10.0.1.0/24'
\ No newline at end of file