1 .. This work is licensed under a Creative Commons Attribution 4.0 International
3 .. http://creativecommons.org/licenses/by/4.0
4 .. (c) OPNFV, Huawei Technologies Co.,Ltd and others.
6 *************************************
7 Yardstick Test Case Description TC004
8 *************************************
10 .. _cachestat: https://github.com/brendangregg/perf-tools/tree/master/fs
12 +-----------------------------------------------------------------------------+
15 +--------------+--------------------------------------------------------------+
16 |test case id | OPNFV_YARDSTICK_TC004_CACHE Utilization |
18 +--------------+--------------------------------------------------------------+
19 |metric | cache hit, cache miss, hit/miss ratio, buffer size and page |
22 +--------------+--------------------------------------------------------------+
23 |test purpose | The purpose of TC004 is to evaluate the IaaS compute |
24 | | capability with regards to cache utilization.This test case |
25 | | should be run in parallel with other Yardstick test cases |
26 | | and not run as a stand-alone test case. |
28 | | This test case measures cache usage statistics, including |
29 | | cache hit, cache miss, hit ratio, buffer cache size and page |
30 | | cache size, with some wokloads runing on the infrastructure. |
31 | | Both average and maximun values are collected. |
33 | | The purpose is also to be able to spot the trends. |
34 | | Test results, graphs and similar shall be stored for |
35 | | comparison reasons and product evolution understanding |
36 | | between different OPNFV versions and/or configurations. |
38 +--------------+--------------------------------------------------------------+
39 |test tool | cachestat |
41 | | cachestat is a tool using Linux ftrace capabilities for |
42 | | showing Linux page cache hit/miss statistics. |
44 | | (cachestat is not always part of a Linux distribution, hence |
45 | | it needs to be installed. As an example see the |
46 | | /yardstick/tools/ directory for how to generate a Linux |
47 | | image with cachestat included.) |
49 +--------------+--------------------------------------------------------------+
50 |test | cachestat test is invoked in a host VM on a compute blade, |
51 |description | cachestat test requires some other test cases running in the |
52 | | host to stimulate workload. |
54 +--------------+--------------------------------------------------------------+
55 |configuration | File: cachestat.yaml (in the 'samples' directory) |
57 | | Interval is set 1. Test repeat, pausing every 1 seconds |
59 | | Test durarion is set to 60 seconds. |
61 | | SLA is not available in this test case. |
63 +--------------+--------------------------------------------------------------+
64 |applicability | Test can be configured with different: |
67 | | * runner Duration. |
69 | | Default values exist. |
71 +--------------+--------------------------------------------------------------+
72 |usability | This test case is one of Yardstick's generic test. Thus it |
73 | | is runnable on most of the scenarios. |
75 +--------------+--------------------------------------------------------------+
76 |references | cachestat_ |
80 +--------------+--------------------------------------------------------------+
81 |pre-test | The test case image needs to be installed into Glance |
82 |conditions | with cachestat included in the image. |
84 | | No POD specific requirements have been identified. |
86 +--------------+--------------------------------------------------------------+
87 |test sequence | description and expected result |
89 +--------------+--------------------------------------------------------------+
90 |step 1 | A host VM with cachestat installed is booted. |
92 +--------------+--------------------------------------------------------------+
93 |step 2 | Yardstick is connected with the host VM by using ssh. |
94 | | 'cache_stat' bash script is copyied from Jump Host to |
95 | | the server VM via the ssh tunnel. |
97 +--------------+--------------------------------------------------------------+
98 |step 3 | 'cache_stat' script is invoked. Raw cache usage statistics |
99 | | are collected and filtrated. Average and maximum values are |
100 | | calculated and recorded. Logs are produced and stored. |
102 | | Result: Logs are stored. |
104 +--------------+--------------------------------------------------------------+
105 |step 4 | The host VM is deleted. |
107 +--------------+--------------------------------------------------------------+
108 |test verdict | None. Cache utilization results are collected and stored. |
110 +--------------+--------------------------------------------------------------+