Jo¶rgen Karlsson [Wed, 20 Jan 2016 12:33:42 +0000 (13:33 +0100)]
Add apexlake CI script
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
Change-Id: I5dcd45692938afddadbf17650c96fddf1f99dce7
QiLiang [Tue, 19 Jan 2016 10:44:48 +0000 (10:44 +0000)]
Influxdb change tc as measurement
Add host and taget tags (initially for cpuload scenario to
identify where the test run)
JIRA: YARDSTICK-212
Change-Id: I895bd435ec4a5e036e5ae2dc965df23ccfa6bf24
Signed-off-by: QiLiang <liangqi1@huawei.com>
wym_libra [Tue, 19 Jan 2016 18:46:30 +0000 (02:46 +0800)]
Move the test case of TC025 to the test cases folder
Change-Id: Ia3760a4fcc17f810940240d1778939333e8ffdc6
Signed-off-by: wym_libra <yimin.wang@huawei.com>
Jo¶rgen Karlsson [Tue, 19 Jan 2016 11:35:45 +0000 (12:35 +0100)]
Fix EXTERNAL_NETWORK for joid
Change-Id: I31c932a9098933fe139c28a65c3989a0014d0f8d
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
Vincenzo Riccobene [Mon, 18 Jan 2016 15:35:52 +0000 (15:35 +0000)]
Fix Apexlake Documentation
Change-Id: If9519d1660fe21bc13307ce35711424c6e2b8176
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
kubi [Tue, 19 Jan 2016 08:02:05 +0000 (16:02 +0800)]
support os+odl for ipv6
As we known, the network of os+odl scenario is still not available.
so this patch still need to do more debug work.
however, Jan 19th is code freeze day, i think a good way is to merge it at first
when os+odl become available, i will do rest debug work and fix it
Change-Id: I518f759069e74d2e57e40b52dfecaef4b4d26a02
Signed-off-by: kubi <jean.gaoliang@huawei.com>
kubi [Mon, 18 Jan 2016 10:48:22 +0000 (18:48 +0800)]
Create weekly Jenkins Job for Yardstick run in Huawei lab in Santa Clara
Test Case 040 :parser is added into weekly yaml
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Change-Id: I0cb4a9e273b5cac55b9a7a278ea17b1ad78d1ac6
QiLiang [Mon, 18 Jan 2016 07:07:55 +0000 (07:07 +0000)]
HttpDispatcher case_name value update
See details on https://etherpad.opnfv.org/p/yardstick_release_b_troubleshooting
section Questions 6.1
Change-Id: I72268c827a2321859c405f45b7e1e475c0ffb4a0
Signed-off-by: QiLiang <liangqi1@huawei.com>
Vincenzo Riccobene [Fri, 15 Jan 2016 17:19:10 +0000 (17:19 +0000)]
Fixed documentation for ApexLake
Integration of ApexLake documentation into the main docs directory
Change-Id: I3398acc16cc2ff4bb039783fc5bcb6a10afda4e1
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
kubi [Sat, 16 Jan 2016 10:31:42 +0000 (18:31 +0800)]
modify sc lab pod yaml as real configure
Change-Id: I6587794b7206cb3d5f13b6c448670d1c97ecd596
Signed-off-by: kubi <jean.gaoliang@huawei.com>
kubi [Sat, 16 Jan 2016 07:59:10 +0000 (15:59 +0800)]
enable ipv6 test case in sc lab
Change-Id: I4609fcb4427413fd6cde435f7bd062c9dde61949
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Jo¶rgen Karlsson [Fri, 15 Jan 2016 12:18:46 +0000 (13:18 +0100)]
Update test suite files.
Added TC 10, 11 and 14.
Removed TC 1 as it is already included in TC 37
Change-Id: Iea483c4a26c657984769400f2949ca300c2504bd
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
QiLiang [Fri, 15 Jan 2016 06:02:54 +0000 (14:02 +0800)]
Dump test result when test finished
JIRA: -
Change-Id: I8712f1c4a0a063bdf7ba6a425015dea894c34d16
Signed-off-by: QiLiang <liangqi1@huawei.com>
kubi [Fri, 15 Jan 2016 11:40:28 +0000 (19:40 +0800)]
fix some bug in ipv6 to make it run in ci
JIRA:YARDSTICK-187
Change-Id: Ia15d17afdef145f7b230a8a4d25a61eed5cdfd76
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Per Holmgren [Thu, 14 Jan 2016 15:06:34 +0000 (16:06 +0100)]
Adds desription for TC024, the CPU load/mpstat test case
Change-Id: Ifbc571e3e216349d065ac21df1a3f10fe94d4e9a
JIRA: -
wym_libra [Fri, 15 Jan 2016 10:07:01 +0000 (18:07 +0800)]
Correct some typos
Change-Id: Ia9fd31580ff75663514aebbb46a8b87021cb01de
Signed-off-by: wym_libra <yimin.wang@huawei.com>
wym_libra [Thu, 14 Jan 2016 14:53:10 +0000 (22:53 +0800)]
Add test case description and task file for TC011
Add test case description for Packet delay variation between VMs (TC011)
and test case .yaml task file.
** Please note that the SLA value has not yet been determined. **
Change-Id: I68a374224946d46c173ad477c14cb79d573b1eee
Signed-off-by: wym_libra <yimin.wang@huawei.com>
QiLiang [Thu, 14 Jan 2016 08:09:40 +0000 (08:09 +0000)]
HeatContext model update to match heat code update
In Heat Liberty release OS::Nova::Server will always use the user
pre-configured in the image (e.g. "fedora" for stock Fedora cloud
images, "ubuntu" for stock Ubuntu cloud images, "cloud-user" for
stock CentOS cloud images etc)
Change all ec2-user -> ubuntu
Add admin-user in Heat model for backwards compatibility.
Refer below links for detalis:
https://etherpad.opnfv.org/p/yardstick_release_b_troubleshooting
https://github.com/openstack/heat/commit/
e423bec7f10b0f5d07f05d195b3b7860f6bceb00
http://blog.scottlowe.org/2015/04/23/ubuntu-openstack-heat-cloud-init/
JIRA: -
Change-Id: I6b8b2b21daf113a3a86aee1126b0c3e74737ef4f
Signed-off-by: QiLiang <liangqi1@huawei.com>
Vincenzo Riccobene [Thu, 14 Jan 2016 13:55:57 +0000 (13:55 +0000)]
Update results for Test Cases 6, 7, 20, 21
JIRA: YARDSTICK-219
Change-Id: I06143f074592e05cd17b740eb9751414a56c9fde
Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com>
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Jo¶rgen Karlsson [Thu, 14 Jan 2016 14:29:43 +0000 (15:29 +0100)]
Add test suite for Orange POD2
Change-Id: I667a54793be39c74a9f787b055b07fda9b2ba06c
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
Ana C [Wed, 13 Jan 2016 17:43:13 +0000 (18:43 +0100)]
Add template for test results report
This change is a proposal for a report for yardstick test case reesults.
One report for all the executed tests, summarizing the results and the
labs where the tests were executed.
JIRA: -
Change-Id: I7cdfdc82d6ee07d2b9da426f33ce34b86362b5b4
Signed-off-by: Ana C <ana.cunha@ericsson.com>
user [Wed, 13 Jan 2016 17:36:50 +0000 (12:36 -0500)]
Fix small bugs for running Apexlake on Montreal testbed
JIRA: YARDSTICK-219
Change-Id: I5f403e6c922f5e6ea790dc9cdb589cbc98e66ded
Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local>
Jo¶rgen Karlsson [Wed, 13 Jan 2016 14:53:00 +0000 (15:53 +0100)]
ci: add influxdb target options
Change-Id: I50cbbf4d2fe59d688a4951cc8bec3362b098adcb
JIRA:-
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
Jo¶rgen Karlsson [Wed, 13 Jan 2016 15:19:58 +0000 (16:19 +0100)]
Fix flake8 errors
Change-Id: I14f21092f5e97abf0629a92a27062846a6d3130b
JIRA:-
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
Ana C [Tue, 12 Jan 2016 17:02:31 +0000 (18:02 +0100)]
Fix minor format details in tc descriptions
This change fixes minor formating in TC025, remove one extra line in TC028
and update 03-list-of-tcs.
The formating caused the pdf to fail.
Change-Id: I304335277b1fbc33b10d9a07245ebeef0612fc80
Signed-off-by: Ana C <ana.cunha@ericsson.com>
QiLiang [Tue, 12 Jan 2016 22:53:22 +0000 (22:53 +0000)]
Rename tc019/tc025 & fix description for tc005
Added tc019 and tc025 to index of test cases in 03-list-of-tcs.
JIRA: -
Change-Id: I02696dc408d2d5c20becba29c49b3cff2a7049a9
Signed-off-by: QiLiang <liangqi1@huawei.com>
QiLiang [Tue, 12 Jan 2016 22:45:42 +0000 (22:45 +0000)]
Add test case description for TC028-kvm
JIRA: YARDSTICK-188
Change-Id: I16f8c5ac3a3997640ce96a77984c4dbe9ccb2804
Signed-off-by: QiLiang <liangqi1@huawei.com>
qi liang [Tue, 12 Jan 2016 14:12:34 +0000 (14:12 +0000)]
Merge "Add test case description and task file for TC025"
qi liang [Tue, 12 Jan 2016 14:11:59 +0000 (14:11 +0000)]
Merge "Add test case description and task file for TC019"
QiLiang [Tue, 12 Jan 2016 13:21:36 +0000 (13:21 +0000)]
Merge "Workround for openstack nova bug"
QiLiang [Tue, 12 Jan 2016 20:10:40 +0000 (20:10 +0000)]
Workround for openstack nova bug
Notes: if placement_groups policy is "availability"
and > 2 servers in this group may still have this issue.
JIRA: YARDSTICK-200
Signed-off-by: QiLiang <liangqi1@huawei.com>
Ana C [Tue, 12 Jan 2016 10:29:15 +0000 (11:29 +0100)]
Include vTC overview in Yardstick documentation
This change includes the vTC overview in Yardstick configguide, the
original vTC/README has been renamed to 04-vTC-overview and added in the
configguide.
The vTC/abbreviations is deleted, all included in glossary.rst
Index and 03-list-of-tcs are updated.
JIRA:-
Change-Id: Ifc5cf1cc258dee6743af189f347e8adbbec6a32f
Signed-off-by: Ana C <ana.cunha@ericsson.com>
Vincenzo Riccobene [Mon, 11 Jan 2016 17:23:12 +0000 (17:23 +0000)]
Implementation of opnfv-yardstick-tc021 in Yardstick
Includes
- Yardstick Scenario for integration with ApexLake
- Yardstick Task .yaml file
- Documentation
JIRA: YARDSTICK-219
Change-Id: I0554d0a211392902207ba9ceccf0b98dc3c2cdf1
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Jo¶rgen Karlsson [Mon, 11 Jan 2016 10:34:42 +0000 (11:34 +0100)]
Add vTC daily+weekly test suites
Change-Id: Id557b5ef4d686da041b8097e390c7e5b563a0c3c
JIRA:-
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
Vincenzo Riccobene [Mon, 11 Jan 2016 11:39:16 +0000 (11:39 +0000)]
Implementation of opnfv-yardstick-tc020 in Yardstick
Includes
- Yardstick Scenario for integration with ApexLake
- Yardstick Task .yaml file
- Documentation
JIRA: YARDSTICK-219
Change-Id: Ibbba1d9864e788fb6c81cc00c503e9f69e885651
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Vincenzo Riccobene [Mon, 11 Jan 2016 09:45:04 +0000 (09:45 +0000)]
Implementation of yardstick-tc007 in Yardstick
Includes
- Yardstick Scenario for integration with ApexLake
- Yardstick Task .yaml file
- Documentation
JIRA: YARDSTICK-219
Change-Id: Ifa2555336098e68d0fad8045e2f759aed587ad92
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Jo¶rgen Karlsson [Mon, 11 Jan 2016 16:01:47 +0000 (17:01 +0100)]
Add apexlake package path
Workaround/hack to be able to use apexlake packages modules
and run unit tests without having to install apexlake.
Change-Id: Ibfa34f56bdb1cafa60d2090e16544a81badc2e85
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
kubi [Mon, 11 Jan 2016 15:34:45 +0000 (23:34 +0800)]
IPv6 connectivity between nodes on the tenant network
Test case yaml and .rst file for ipv6
Change-Id: Ib9a554dc05445023687efb0ac608c7cbd0da4c21
Signed-off-by: kubi <jean.gaoliang@huawei.com>
kubi [Mon, 11 Jan 2016 14:58:13 +0000 (22:58 +0800)]
Test case to measure processing speed(score)
run unixbench to get the score of processing performance
This patch includes the .yaml for the test case and the .rst for test case description.
JIRA:YARDSTICK-116
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Change-Id: Ic75119d1db19dacc57edfa4dce607e0e29ae8db4
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Vincenzo Riccobene [Mon, 11 Jan 2016 11:59:48 +0000 (11:59 +0000)]
Implementation of yardstick-tc006 in Yardstick
Includes
- Yardstick Scenario for integration with ApexLake
- Yardstick Task .yaml file
- Documentation
JIRA: YARDSTICK-219
Change-Id: Iabde8fa63f346cf1e4a02691f22d1761de79a239
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
kubi [Mon, 11 Jan 2016 13:30:45 +0000 (21:30 +0800)]
Test Case 040 Verify Parser Yang-to-Tosca
running Parser Yang-to-Tosca module as a tool, validating output against expected outcome.
this patch is about task yaml and rst for test case description.
JIRA:YARDSTICK-224
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Change-Id: Id254c5cf45de33b023bef889a58044a21ed0db43
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Jo¶rgen Karlsson [Mon, 11 Jan 2016 10:20:55 +0000 (11:20 +0100)]
Add missing yaml schema for TC037 and TC038
Change-Id: I299eb5a94afb8a29dee89938ff1d7b1bb7f43f3b
JIRA:-
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
QiLiang [Mon, 11 Jan 2016 06:24:12 +0000 (06:24 +0000)]
Add test case description and task file for TC005
JIRA: YARDSTICK-93
Change-Id: I74adef0e6bae52a7080479d7054a92342f7324a7
Signed-off-by: QiLiang <liangqi1@huawei.com>
QiLiang [Wed, 25 Nov 2015 01:23:46 +0000 (09:23 +0800)]
Support run cyclictest on BareMetal
JIRA: YARDSTICK-122
Change-Id: I8144215059a9abea08314a4c1e6a733dcdf0df53
Signed-off-by: QiLiang <liangqi1@huawei.com>
wym_libra [Thu, 31 Dec 2015 12:02:09 +0000 (20:02 +0800)]
The secondi HA test case-shutdown controller
1) add "attacker_baremetal.py" for fault injection
2) modify the monitor to excute on remote node after ssh connection
3) move all shell scripts together
JIRA: YARDSTICK-182
Change-Id: Ibb9dc908224ddb8b99a0140b75c1a046503f6dfb
Signed-off-by: wym_libra <yimin.wang@huawei.com>
wym_libra [Mon, 7 Dec 2015 08:02:18 +0000 (16:02 +0800)]
Rewrite the HA test case (2)
idea: refact the Monitor class in old file "monitor.py" with the base
class and sub-class.
detail:
1) the BaseMonitor is the base class of other monitor
2) each monitor run in independent process
3) there are two monitor("openstack-cmd" and "process") for the first test case
4) MonitorMgr class used to manager monitor process
JIRA: YARDSTICK-149
Change-Id: I2eede94481f740812212e6cb673d175b5f543c15
Signed-off-by: wym_libra <yimin.wang@huawei.com>
kubi [Tue, 29 Dec 2015 03:04:20 +0000 (11:04 +0800)]
running Parser Yang-to-Tosca module as a tool
with jnon and fatih's help, new docker image has been uploaded
so this part is about parser verify
validating output against expected outcome.
Change-Id: If50d241a5338888f14fd11a752dc72678e0c569b
JIRA:YARDSTICK-224
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Jo¶rgen Karlsson [Fri, 8 Jan 2016 15:05:22 +0000 (16:05 +0100)]
Add TC037 to POD test suites
JIRA: YARDSTICK-213
Change-Id: I55ff36b02a0d0e0334505d68d361b8a14d36063c
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
kubi [Thu, 31 Dec 2015 06:38:49 +0000 (14:38 +0800)]
support for ipv6
JIRA:YARDSTICK-187
Change-Id: I1cecd400b4449a09d22d43f4a42e889f00dd4fe7
Signed-off-by: kubi <jean.gaoliang@huawei.com>
kubi [Fri, 8 Jan 2016 04:36:14 +0000 (12:36 +0800)]
support lxml for parser in docker container
this is part1 of patch, this part is to define dockefile,and wait a docker image to be uploaded
JIRA:YARDSTICK-224
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Change-Id: Ia206c54ab2d964a94753abef0767b74d26259081
Ryota MIBU [Fri, 8 Jan 2016 02:45:15 +0000 (11:45 +0900)]
update docs build dir names in .gitignore
Change-Id: Id4b1e2e87ac51b67f392417357b2693c76def457
Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
Ana C [Thu, 7 Jan 2016 14:00:56 +0000 (15:00 +0100)]
Rename folders in yardstick/docs
Adapt the naming of the folders under yardstick/docs to the naming adopted by
the release documentation defined by opnfvdocs.
JIRA: -
Change-Id: Icc57720d585abbbf7252bcbf76e2f2a403cb1732
Signed-off-by: Ana C <ana.cunha@ericsson.com>
Ana C [Thu, 7 Jan 2016 13:00:26 +0000 (14:00 +0100)]
Fix description for TC037 and TC038
Update rst files for TC037 and TC038 for latest template format.
Added TC037 and TC038 to index of test cases in 03-list-of-tcs.
JIRA: -
Change-Id: I32657b564ff1c393f8048a74e676b3f5791d6d0d
Signed-by: Ana C <ana.cunha@ericsson.com>
Kristian Hunt [Mon, 28 Dec 2015 12:26:10 +0000 (14:26 +0200)]
Fix glance yardstick-image cmd in installation doc
Glance image-create command should use --os-image-api-version 1 flag
for the is-public argument.
JIRA: YARDSTICK-68
Change-Id: I43a60a7dac186ae7c586aa98b6e5de9821caee60
Signed-off-by: Kristian Hunt <kristian.hunt@gmail.com>
Jo¶rgen Karlsson [Mon, 4 Jan 2016 13:30:10 +0000 (14:30 +0100)]
Add test case description and task file for TC038
JIRA: YARDSTICK-214
Change-Id: I3a2358e8c36755a684f09524bd6fc8af9bf43f60
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
Jo¶rgen Karlsson [Mon, 4 Jan 2016 12:53:36 +0000 (13:53 +0100)]
Add test case description and task file for TC037
JIRA: YARDSTICK-213
Change-Id: I3f1f521da6a824c96cbc8712a098c61ff6b0540d
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
Ana C [Sat, 26 Dec 2015 14:50:13 +0000 (15:50 +0100)]
Structure test case descriptions
This commit structures the test case descriptions.
The file index.rst lists the subsequent chapters.
01-introduction.rst contains an overview of the project and deliverables.
02-methodology.rst describes the methodology for the generic test cases.
03-list-of-tcs.rst contains a list of merged generic test cases and a
sub-chapter for the feature test cases.
Glossary extracts definitions and abbreviations.
TC001, TC002, TC008, TC009, TC010, TC012 were adapted to work for pdf.
Template testcase_description_v2_template.rst was adapted to work for pdf.
Change-Id: Ia11e27e5d508f1a784e2a412b50739e32b13797f
Signed-off-by: Ana C <ana.cunha@ericsson.com>
QiLiang [Wed, 30 Dec 2015 14:58:53 +0000 (14:58 +0000)]
InfluxDB dispatcher add more tags
- add runner_id tag
- add test case name tag
- add task_id tag
JIRA: YARDSTICK-212
Change-Id: I75c27e23942a6e2189019e94bfe8026a5fd67621
Signed-off-by: QiLiang <liangqi1@huawei.com>
Conflicts:
yardstick/dispatcher/influxdb.py
QiLiang [Wed, 23 Dec 2015 14:13:15 +0000 (22:13 +0800)]
Initial InfluxDB dispatcher
Supports:
- Basic influxDB write with timestamp
- Add general result format func
- Add UT
TODO:
- refine database schema (e.g. add more tags) plan in another patch
JIRA: YARDSTICK-212
Change-Id: I1526568bbd850f1343135420ec59ed1b833bb99f
Signed-off-by: QiLiang <liangqi1@huawei.com>
Vincenzo Riccobene [Tue, 5 Jan 2016 16:53:43 +0000 (16:53 +0000)]
Fix ApexLake setup
Changes the directories where to store apexlake data in order to
allow a non super user to run the setup.
JIRA: YARDSTICK-35
Change-Id: I871b2ab793183887c86666bfe2241e3c26b4f427
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Vincenzo Riccobene [Tue, 5 Jan 2016 15:28:05 +0000 (15:28 +0000)]
Fix some small things in ApexLake tests
JIRA: YARDSTICK-35
Change-Id: I280365dd64d2f6c00befb984acd0d4c9ca2645bd
Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com>
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Fatih Degirmenci [Wed, 6 Jan 2016 21:26:30 +0000 (22:26 +0100)]
Add yardstick daily suite config files for CI PODs
opnfv-jump-1: apex stable/brahmaputra branch
intel-pod5: joid stable/brahmaputra branch
intel-pod2: apex master branch
intel-pod6: joid master branch
intel-pod8: compass master branch
Change-Id: Ia659e10525863ee11854a266df58449c625c7f7c
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
wym_libra [Thu, 10 Dec 2015 07:09:59 +0000 (15:09 +0800)]
Add test case description and task file for TC019
Add test case description for Control node-OpenStack service down (TC019)
and test case .yaml task file.
** Please note that the SLA value has not yet been determined. **
JIRA: YARDSTICK-135
Change-Id: Id512159034929dc197d2c7fdf6cc672ecddfb996
Signed-off-by: wym_libra <yimin.wang@huawei.com>
Vincenzo Riccobene [Mon, 4 Jan 2016 11:18:01 +0000 (11:18 +0000)]
Remove data manager from ApexLake
Since the InfluxBD dispatcher is used to store the data, the apexlake data manager is not required anymore
JIRA: YARDSTICK-35
Change-Id: I8d85161814d83a991ee149532af0437e9c248445
Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com>
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
wu.zhihui [Mon, 4 Jan 2016 03:58:28 +0000 (11:58 +0800)]
Add test suite file for ZTE-NJ LAB.
JIRA: yardstick-210
Change-Id: Ib888b654e742761a8be1b263f643950ea02380f8
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
QiLiang [Thu, 31 Dec 2015 02:11:21 +0000 (02:11 +0000)]
Add Dummy context and scenario type
Dummy Context Usage:
- if no context specified in the task file then automatically use
Dummy Context
- or specify the context with type Dummy in the task file, like
context:
type: Dummy
Note: context without type name default use Heat Context.
(e.g. samples/fio.yaml)
JIRA: -
Change-Id: I7f798a7260bdd6ac24902e2c835a3b121319fd8c
Signed-off-by: QiLiang <liangqi1@huawei.com>
Vincenzo Riccobene [Thu, 24 Dec 2015 13:21:51 +0000 (13:21 +0000)]
Fix small things for integration of ApexLake with Yardstick
Changes small things required for the integration of ApexLake with Yardstick
JIRA: YARDSTICK-35
Change-Id: I6f92d738cb80e34108b76f900382e9c05ecabe70
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Vincenzo Riccobene [Thu, 24 Dec 2015 14:08:58 +0000 (14:08 +0000)]
Complete all the code and files required to run ApexLake
Inludes the last files required by ApexLake for a complete execution.
JIRA: YARDSTICK-35
Change-Id: I4315b8081554c8fad98c8fa72f9e2796ecb9360b
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
kubi [Mon, 14 Dec 2015 11:51:45 +0000 (19:51 +0800)]
add scenario and sample file for Unixbench.
JIRA:YARDSTICK-184
Change-Id: Iedd4a3708e08305b1c8fa7a8e1766ceef03ab8bb
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Vincenzo Riccobene [Wed, 23 Dec 2015 15:14:52 +0000 (15:14 +0000)]
Add some other tests to ApexLake
Include some other tests to reach the required coverage
JIRA: YARDSTICK-35
Change-Id: Ie47b0ca9451d4dcc0f5e31ba98f8c38923689475
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Vincenzo Riccobene [Wed, 23 Dec 2015 13:47:07 +0000 (13:47 +0000)]
Add Benchmarking Unit to ApexLake
Includes benchmarking unit to run benchmarks in ApexLake
Also includes tests.
JIRA: YARDSTICK-35
Change-Id: I67c62efd6cbe0883963e8c4ddc86d003b1d355ac
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Vincenzo Riccobene [Wed, 23 Dec 2015 13:26:15 +0000 (13:26 +0000)]
Add Deployment Unit to ApexLake
Includes the deployment unit module used for deployment by Apexlake
Also includes tests
JIRA: YARDSTICK-35
Change-Id: Ia5c89f3cd03d53b1fc4e418215955fd91aff9d03
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Vincenzo Riccobene [Fri, 18 Dec 2015 16:03:29 +0000 (16:03 +0000)]
Add API to configure and execute ApexLake
Add python module providing API for Yardstick to configure and execute
ApexLake and the test cases for the virtual Traffic Classifier.
Includes documentation.
JIRA: YARDSTICK-215
Change-Id: I87af59c715d789ac78c836123e9ed3d8e0036eec
Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com>
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Kristian Hunt [Thu, 10 Dec 2015 13:35:59 +0000 (14:35 +0100)]
Add test case description and task file for TC010
Add test case description for Memory Latency (TC010) and test case
.yaml task file.
JIRA: YARDSTICK-94
Change-Id: If7fb120868c9901fe097f310aa249e1fbc8a94ee
Signed-off-by: Kristian Hunt <kristian.hunt@gmail.com>
Kristian Hunt [Thu, 17 Dec 2015 11:15:32 +0000 (12:15 +0100)]
Fix lmbench memory read latency stop size
Stop size parameter's type should be float to allow for performing
measurements on only L1 and L2 cache if needed.
JIRA: -
Change-Id: Ibc4d052c343e9dcccf6101c6c949172bb5a0f9e1
Signed-off-by: Kristian Hunt <kristian.hunt@gmail.com>
Per Holmgren [Thu, 17 Dec 2015 15:15:50 +0000 (16:15 +0100)]
To avoid breaking tests when monitor is set
Two runners, Arithemic and Sequence, broke running tests
even if SLA "monitor" was set. Changed these two runners
to work in similar fashion as the other two, i.e. that only
None can break. "assert" still asserts, and "monitor"
just logs but then continues.
Change-Id: Ic441761cad8747e5ecfcd0babe719c1aa23981e7
JIRA: -
Fatih Degirmenci [Mon, 21 Dec 2015 11:54:23 +0000 (12:54 +0100)]
Add yardstick daily task suite for Ericsson POD2
Change-Id: Ic0f7261dc07eb38d014a8790ac13e5310ec4ef8a
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
qi liang [Mon, 21 Dec 2015 01:57:03 +0000 (01:57 +0000)]
Merge "Rewrite the HA test case (1)"
Per Holmgren [Fri, 11 Dec 2015 12:49:55 +0000 (13:49 +0100)]
Adds new Yardstick test case TC009, Network Performance, Packet Loss
Similar to Yardstick TC001. Main difference is that each packet size
is run 10 times before next packet size.
JIRA: YARDSTICK-87
Change-Id: If0f59590dff9c8e5b86760667f01a373afe8aff0
Per Holmgren [Fri, 11 Dec 2015 12:12:04 +0000 (13:12 +0100)]
Adds Yardstick test case TC008, Network Performance Extended Tests
New test case using pktgen tool. Based on TC001, but with additional
packet sizes and more repetitions of each test combination,
respectively. Test case takes approx.3 hours to complete.
Change-Id: Iba2de5efa33d6e2c960772fa5345595f6d7ab4e6
JIRA: YARDSTICK-80
wym_libra [Fri, 18 Dec 2015 08:09:50 +0000 (16:09 +0800)]
Add test case description and task file for TC025
Add test case description for HA of OpenStack Controll Node abnormally
shutdown (TC025) and the sample .yaml task file.
** Please note that the SLA value has not yet been determined. **
JIRA: YARDSTICK-135
Change-Id: I70f1afb0c9cfa5446aac08b7b13e543a9ec20898
Signed-off-by: wym_libra <yimin.wang@huawei.com>
Per Holmgren [Thu, 17 Dec 2015 08:29:21 +0000 (09:29 +0100)]
Changes Arithmetic runner to accept several step parameters
The Arithmetic runner is modified to accept several named
parameters to iterate over in each scenario. Possible to chose
either to iterate through them in a nested-for-loop fashion
(default) or in a tupled loop fashion (combine i:th element
of each input). Still possible to only provide one parameter
to step/iterate over, as before.
All existing yaml files with Arithmetic types have been modified
to run the tests as before, and to provide same results as before
this change. The only change is in sample file pktgen.yaml to
provide a valid example of how to use this modification.
It is also possible to step backwards, i.e. start > stop, with
a negative step parameter value.
(Noticed that tests are terminated when there is SLA error
problems in "monitor" mode. Should be fixed in another commit)
Change-Id: Ib2ebd24b71dd55d6817cee8e67026a0dd13a9e17
JIRA: -
Vincenzo Riccobene [Wed, 16 Dec 2015 15:14:21 +0000 (15:14 +0000)]
Add utility tools to ApexLake
Add utility tools and related tests to ApexLake
Fix also small things in all tests
JIRA: YARDSTICK-35
Change-Id: I76ab79b3b7ba3b48633517477b262f5bcdc743f0
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
wym_libra [Mon, 7 Dec 2015 08:02:18 +0000 (16:02 +0800)]
Rewrite the HA test case (1)
refactor the attacker implement.
1) BaseAttacker is added
2) a simple attacker named "kill-process" inherit the BaseAttacker
3) serviceha.py selects an attacker through the BaseAttacker by attacker name
JIRA: YARDSTICK-149
Change-Id: Ib718d5edc6b5e14bc3ea0592e0146468ff70b43e
Signed-off-by: wym_libra <yimin.wang@huawei.com>
Jo¶rgen Karlsson [Tue, 15 Dec 2015 18:01:36 +0000 (19:01 +0100)]
Add TC001 and TC012 to POD test suites
Change-Id: I39d589bfc0652d51b7e6d9e139b83160bf7f3692
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
Ana C [Fri, 11 Dec 2015 14:56:08 +0000 (15:56 +0100)]
Adapt documentation to latest guidelines
Adapt Yardstick documentation according to the latest guidelines from the
Releng project.
The only change in test case description TC001 and TC002 is to remove logo.
The same for the test case description v2 template.
The previous version of test case description is deleted from repo.
The Yardstick_task_template is edited to keep line lenght 80 char.
This commit also adds index for docs/yardstick and for
docs/user_guides/framework.
The overview for the vTC .rst file has been fixed to enable the .pdf
generation.
Change-Id: Ib6480c3c29ce0f0ee22c9ad717439f6a293ab842
Signed-off-by: Ana C <ana.cunha@ericsson.com>
Jo¶rgen Karlsson [Fri, 11 Dec 2015 14:50:22 +0000 (15:50 +0100)]
Add run_in_background attribute to scenarios
This change adds the possibility to run scenarios as "background
tasks".
Background scenarios/tasks:
- are started before all "normal scenarios"
- runs in parallel with "normal scenarios"
- terminates when all "normal scenarios" have completed
their tasks
They are intended as a way to perform background tasks, e.g. collect
data such as cpuload etc, in parallel with the execution of normal
benchmarking scenarios.
Note that we already have the 'run_in_parallel' attribute but
this attribute has a couple of issues and do not solve all the
uses cases.
Change-Id: I9c5230bfdbbb66030f57b658ce1db87ff2c2d62b
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
Kristian Hunt [Mon, 9 Nov 2015 15:24:03 +0000 (16:24 +0100)]
Add test case description and task file for TC012
Add test case description for Memory Bandwidth (TC012) and test case
.yaml task file.
JIRA: YARDSTICK-113
Change-Id: I6f2b0bb8c920f3ece3a41bac744cc1ec1fd35cbc
Signed-off-by: Kristian Hunt <kristian.hunt@gmail.com>
Vincenzo Riccobene [Fri, 11 Dec 2015 22:00:14 +0000 (22:00 +0000)]
Add support to the test case required by YARDSTICK-146
Add supporto to ApexLake for the test case to validate the vTC instantiation on OpenStack
JIRA: YARDSTICK-146
Change-Id: Ib154bac19ec1c32a508682235478a3c7fc530299
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Vincenzo Riccobene [Fri, 11 Dec 2015 21:42:20 +0000 (21:42 +0000)]
Add support to the test case required by YARDSTICK-145
Add support to ApexLake to the test case that validates the instantiation of the virtual Traffic Classifier within OpenStack
JIRA: YARDSTICK-145
Change-Id: I533712de36de4e40fdec15b2be2348fbb8c29dfc
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Per Holmgren [Wed, 11 Nov 2015 16:11:53 +0000 (17:11 +0100)]
Adds new test case 001 for network performance
This commit contains almost all of Jira #79. Misses still to collect
all results in one single .json file, now everything is written to
/tmp/yardstick.out. However, this may not be needed at all once the
database for test result collection is in place.
Change-Id: I210a477c3b5a110e97a6220e68d3ddc31ccce93a
JIRA: YARDSTICK-79
kubi [Tue, 15 Dec 2015 02:10:20 +0000 (10:10 +0800)]
add test suite for huawei us bare lab
JIRA:YARDSTICK-
Change-Id: I6e43383c1eafa13314ab7678d0e1d42ed063c57f
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Vincenzo Riccobene [Fri, 11 Dec 2015 21:24:56 +0000 (21:24 +0000)]
Add support to the test case required by YARDSTICK-36
Add support to ApexLake for the calculation of the throughput of the vTC in case of
noisy neighbors deployment, through the DPDK pktgen.
JIRA: YARDSTICK-36
Change-Id: I00950f967cac1f12f733a05af8166c757dc02e0a
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Vincenzo Riccobene [Fri, 11 Dec 2015 21:20:40 +0000 (21:20 +0000)]
Add support to the test case required by YARDSTICK-35
Add to ApexLake the support to the calculation of the throughput for the vTC using DPDK pktgen.
JIRA: YARDSTICK-35
Change-Id: I2ead9522648d6955f64fd18c543dabf7f26e2490
Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com>
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Jörgen Karlsson [Mon, 14 Dec 2015 12:23:09 +0000 (12:23 +0000)]
Merge "Rename daily test suite files to match slave names on Jenkins"
Vincenzo Riccobene [Fri, 11 Dec 2015 16:49:43 +0000 (16:49 +0000)]
Add bash script to change VLAN tag on packets
JIRA: YARDSTICK-35
Change-Id: I8cb5c05a0d33aac2bc90aa037843db67d2ab0e36
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Vincenzo Riccobene [Fri, 11 Dec 2015 15:13:24 +0000 (15:13 +0000)]
Add Constant traffic generation LUA script for DPDK and PCAP files
Inlcude a LUA script that generates constant rate traffic for DPDK pktgen
Also include PCAP files of requested size (64, 128, 256, 512, 1024, 1280, 1518)
JIRA: YARDSTICK-35
Change-Id: I25c1a6a8763bd14fdf25450619a5e5bbd8e978db
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
Jo¶rgen Karlsson [Wed, 9 Dec 2015 16:46:08 +0000 (17:46 +0100)]
Create yardstick nova flavor for CI testing
Change-Id: I8aa3128fae8058551df3d1213e2eb234960477fb
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
Jörgen Karlsson [Fri, 11 Dec 2015 11:40:35 +0000 (11:40 +0000)]
Merge "Add full support to the DPDK packet generator"
wym_libra [Tue, 8 Dec 2015 07:47:26 +0000 (15:47 +0800)]
Add 'nodes' attribute to the scenario definition
Defining the 'nodes' attribute which can include more node
not only 'host' and 'target'
Design etherpad link:
https://etherpad.opnfv.org/p/yardstick_framework
JIRA:-
Change-Id: Ida18ebcda1c73c88d208aa11a10696d1063134ef
Signed-off-by: wym_libra <yimin.wang@huawei.com>
Code Review / yardstick.git / log