Rodolfo Alonso Hernandez [Wed, 25 Apr 2018 17:14:02 +0000 (17:14 +0000)]
Merge "OpenStack deployment: delete RS or all VMs"
Rodolfo Alonso Hernandez [Wed, 25 Apr 2018 16:50:25 +0000 (16:50 +0000)]
Merge "Add docker support for Ubuntu 17.10 with Yardstick"
Ross Brattain [Mon, 23 Apr 2018 21:42:35 +0000 (14:42 -0700)]
remove more old apexlake testcases
fix fraser failures
Change-Id: I8bb12a762054a4c3274cc6e0297e948b92700e7e
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Rodolfo Alonso Hernandez [Mon, 23 Apr 2018 16:32:45 +0000 (16:32 +0000)]
Merge "[docs] Updated baremetal instalation instructions"
Rodolfo Alonso Hernandez [Sun, 22 Apr 2018 19:05:00 +0000 (19:05 +0000)]
Merge "MessagingConsumer accepts messages from multiple producers"
Rodolfo Alonso Hernandez [Sat, 21 Apr 2018 08:24:55 +0000 (08:24 +0000)]
Merge "Improve "Libvirt.create_snapshot_qemu" function"
Ross Brattain [Fri, 20 Apr 2018 17:13:32 +0000 (17:13 +0000)]
Merge "extra loopback cleanup"
Ross Brattain [Fri, 20 Apr 2018 16:57:35 +0000 (09:57 -0700)]
disable NSB (DPDK) image load for ARM
we skip the building now but we also need to skip the image loading
JIRA: YARDSTICK-1124
Change-Id: I27c40d6319e74374282203132cfc2c7ebff9b094
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Abhijit Sinha [Fri, 20 Apr 2018 08:52:49 +0000 (08:52 +0000)]
Merge "DPDK: detect dpdk_make_arch based on image arch"
Ross Brattain [Thu, 19 Apr 2018 20:58:26 +0000 (13:58 -0700)]
extra loopback cleanup
try to cleanup in the shell script in case ansible errors
maybe it is hopeless because of docker
JIRA: YARDSTICK-1096
JIRA: YARDSTICK-1054
Change-Id: I759ded4731a7710a194a81530cfb35376eb7800d
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Thu, 19 Apr 2018 05:00:53 +0000 (22:00 -0700)]
disable DPDK images for ARM
We are trying to compile DPDK for the os-nosdn-ovs-ha scenario because we added TC042 "Measure network latency using testpmd and pktgen-dpdk".
However it looks like TC042 is only enabled for compass in opnfv_os-nosdn-kvm_ovs_dpdk-ha
https://gerrit.opnfv.org/gerrit/#/c/54659/1/tests/opnfv/test_suites/opnfv_os-nosdn-kvm_ovs_dpdk-ha_daily.yaml
-
file_name: opnfv_yardstick_tc042.yaml
constraint:
installer: compass
pod: huawei-pod1
We don't actually need TC042 and DPDK or os-nosdn-ovs-ha.
But in order to run TC042 we have to know beforehand that we are going to use DPDK, so we have a conditional in the load_images.sh script that tries to guess when we will need a DPDK image.
The conditional only checks for *[_-]ovs[_-]*
if [[ $DEPLOY_SCENARIO == *[_-]ovs[_-]* ]]; then
ansible-playbook \
-e img_property="nsb" \
-e YARD_IMG_ARCH=${YARD_IMG_ARCH} \
-vvv -i inventory.ini build_yardstick_image.yml
if [ ! -f "${QCOW_NSB_IMAGE}" ]; then
echo "Failed building QCOW NSB image"
exit 1
fi
fi
For this release we won't be able to get DPDK images to compile on ARM, we should fix this conditional and not try to compile.
Also change the shell glob to match *[_-]ovs_dpdk[_-]* to only enable DPDK
images for ovs_dpdk scenarios
JIRA: YARDSTICK-1124
Change-Id: I03142e6b8aa00dc9cdf9b446868fb723cd10198b
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Emma Foley [Thu, 19 Apr 2018 10:23:09 +0000 (10:23 +0000)]
Merge "Update neutron delete_neutron_net function."
Rodolfo Alonso Hernandez [Fri, 13 Apr 2018 17:40:38 +0000 (18:40 +0100)]
MessagingConsumer accepts messages from multiple producers
The messaging consumer now can store a list of PID of several producers.
The notification handler can compare the procedence of a message from
a list of PID.
JIRA: YARDSTICK-1074
Change-Id: I193f83c2b471e5bf1298ac728be52533aded0c1a
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Ross Brattain [Wed, 18 Apr 2018 20:50:05 +0000 (20:50 +0000)]
Merge "add verbose to debug losetup delete"
Ross Brattain [Wed, 18 Apr 2018 20:41:37 +0000 (13:41 -0700)]
DPDK: detect dpdk_make_arch based on image arch
JIRA: YARDSTICK-1124
Change-Id: I26e5854f5117a3b45ac7fa4d4b06f325dcd4d97a
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Wed, 18 Apr 2018 17:19:40 +0000 (17:19 +0000)]
Merge "remove apex lake tc007 from test suites"
Rodolfo Alonso Hernandez [Wed, 18 Apr 2018 15:45:16 +0000 (15:45 +0000)]
Merge "Replace neutron create security group full with shade."
Ross Brattain [Tue, 17 Apr 2018 07:45:17 +0000 (00:45 -0700)]
remove apex lake tc007 from test suites
fixes opnfv_os-nosdn-fdio-noha_daily.yaml failures due
to missing testcase
Change-Id: I5f050d72334da46b94de5fa3662047bf694f7e3e
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Wed, 18 Apr 2018 00:07:43 +0000 (17:07 -0700)]
fix unittest test_deploy_try_retrieve_context_does_not_exist
unittest is failing due to mock being called multiple times.
I assume this is due to parallelization of tests in Jenkins somehow
======================================================================
FAIL: test_deploy_try_retrieve_context_does_not_exist (benchmark.contexts.test_heat.HeatContextTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/mock/mock.py", line 1305, in patched
return func(*args, **keywargs)
File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/yardstick/tests/unit/benchmark/contexts/test_heat.py", line 309, in test_deploy_try_retrieve_context_does_not_exist
mock_path_exists.assert_called_once_with(key_filename)
File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/mock/mock.py", line 947, in assert_called_once_with
raise AssertionError(msg)
AssertionError: Expected 'exists' to be called once. Called 3 times.
----------------------------------------------------------------------
Change-Id: I696c63ef9f7943b841e2d3d533c92f18aa7044da
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Stepan Andrushko [Mon, 16 Apr 2018 11:17:54 +0000 (14:17 +0300)]
OpenStack deployment: delete RS or all VMs
New parameter is added to shell script to delete data for VMs either from
input file or all.
Added disk images removal as per new input parameter.
JIRA: YARDSTICK-1123
Change-Id: I8d2cee4a3a7ad7147f4d59303bab656d80370221
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
Rodolfo Alonso Hernandez [Tue, 16 Jan 2018 15:55:02 +0000 (15:55 +0000)]
Improve "Libvirt.create_snapshot_qemu" function
Improved "Libvirt.create_snapshot_qemu" function:
- Check if the base image is present in the remote host.
If not, try to copy from the execution host.
- Check the execution status. In case the command fails, raise an
exception.
JIRA: YARDSTICK-944
Change-Id: I78bd0d3ed6a1f35ed772c0d192bb240009a580ed
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Shobhi Jain [Fri, 16 Mar 2018 13:07:55 +0000 (13:07 +0000)]
Update neutron delete_neutron_net function.
Update the changes done in patch [1].
JIRA: YARDSTICK-890
[1] https://gerrit.opnfv.org/gerrit/#/c/52361/
Change-Id: Iccbf16d0a2e72919d5092366241ff41686f01a58
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
Shobhi Jain [Fri, 16 Mar 2018 11:56:09 +0000 (11:56 +0000)]
Replace neutron create security group full with shade.
Function create_security_group_full now uses shade client.
Remove openstack util's private 'get_security_groups',
'get_security_group_id' & 'create_security_group' functions as
'create_security_group_full' now uses 'get_security_group' &
'create_security_group' function defined in shade client library.
JIRA: YARDSTICK-890
Change-Id: Ibd5b9ca9b7ce99b3e40c5dcc545f2af672ce2203
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
Emma Foley [Mon, 16 Apr 2018 10:01:28 +0000 (10:01 +0000)]
Merge "Remove tool provisioning in Standalone contexts"
Rex Lee [Mon, 16 Apr 2018 01:48:22 +0000 (01:48 +0000)]
Merge "Bugfix: interface down HA tc050 attack and monitor logistic wrong"
Rodolfo Alonso Hernandez [Wed, 14 Mar 2018 11:27:25 +0000 (11:27 +0000)]
Add MQ consumer, producer and payload base classes
Added MessagingProducer base class. A class implementing this base class
can send a cast message using the MQ service installed in the Yardstick
jumphost (RabbitMQ by default, other MQ could be implemented). The producer
will send messages to an specific topic.
Added MessagingConsumer base class. A class implementing this base class
will be able to receive any message sent by a MessagingPorducer class
publishing messages in the topic subscribed.
By default both Producer and Consumer "fanout" is True. That means every
Consumer will create a fanout Queue attached to the MQ Exchange topic. All
Consumers attached to this topic will receive the message sent by the
Producer [1].
Added Payload base class. To send data through the message queue service,
a Payload derived object should be created. This base class allows to
define the attributes container in the class, convert the object to a dict
and retrieve the object from a dict.
Added a new library, "oslo.messaging", to implement the RPC client and
server.
[1]http://blog.thedigitalcatonline.com/blog/2013/08/21/some-tips-about-amqp-direct-exchanges/
JIRA: YARDSTICK-1074
Change-Id: I63932b5fb3de2bdc1270fc83295630a2a349e2a6
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
rexlee8776 [Thu, 12 Apr 2018 06:53:17 +0000 (06:53 +0000)]
Bugfix: interface down HA tc050 attack and monitor logistic wrong
1. simplify the attack to be one interface
2. move monitor step before attack
3. update rst doc to match
JIRA: YARDSTICK-1120
Change-Id: Icfa21d58e7ccdbeaca8a9a1a3098cceb21c981c3
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Rodolfo Alonso Hernandez [Fri, 13 Apr 2018 07:36:45 +0000 (07:36 +0000)]
Merge "Bugfix: to list all used loop device"
Jing Lu [Fri, 13 Apr 2018 02:46:38 +0000 (02:46 +0000)]
Merge "Bugfix: Can't get image list in API"
ting wu [Thu, 12 Apr 2018 10:31:37 +0000 (12:31 +0200)]
Bugfix: to list all used loop device
Bug fix in script "build_yardstick_image.yml", to
- Use option "-a" to list all used loop devices, to be more compatible.
- Ignore the error and continue, if the debug command failed.
JIRA: YARDSTICK-1121
Change-Id: I24aaebb2ffe3107ca5c619401725aa8c8e1af295
Signed-off-by: ting wu <ting.wu@enea.com>
chenjiankun [Tue, 3 Apr 2018 06:23:42 +0000 (06:23 +0000)]
Bugfix: Can't get image list in API
JIRA: YARDSTICK-1110
To match OpenStack Pike release, we upgrade novaclient from 7.1.1 to 9.1.1.
And the client interface has changed, it no longer has nova_client.images attribute.
So I use shade instead. Later will change all same issue.
Change-Id: Ie4f54069d4346e44e2ad925439930504b945cbad
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
Rodolfo Alonso Hernandez [Wed, 11 Apr 2018 16:12:48 +0000 (16:12 +0000)]
Merge "Bug fix in using Unixbench"
John O Loughlin [Wed, 11 Apr 2018 10:45:43 +0000 (11:45 +0100)]
Add docker support for Ubuntu 17.10 with Yardstick
JIRA: YARDSTICK-1119
Change-Id: I6d9b21667605f1c0a157c2a72e708c36b90e8c3a
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
John O Loughlin [Mon, 9 Apr 2018 13:11:47 +0000 (14:11 +0100)]
Upgrade collectd to version 5.8
Update collectd version to 5.8 as it's the latest stable
and supports GCC 7
JIRA: YARDSTICK-1114
Change-Id: I9147b7277d87047eda729664d5ee3e8ab2c145af
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
Emma Foley [Wed, 11 Apr 2018 13:25:56 +0000 (13:25 +0000)]
Merge "Add support for dpdk 17.05"
John O Loughlin [Wed, 4 Apr 2018 10:53:20 +0000 (11:53 +0100)]
Add support for dpdk 17.05
Add support for dpdk 17.05. Add option to dpdk scripts
to download dpdk 17.08 17.11 and 18.02. These are currently
unsupported due to prox build issues.
JIRA: YARDSTICK-1113
Change-Id: I585566364a4d1f04a696439af96c50c0e9d38033
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
liyin [Wed, 11 Apr 2018 03:32:36 +0000 (03:32 +0000)]
Bug fix in using Unixbench
JIRA: YARDSTICK-1117
This bug will cause the error in running unixbench.
"no such file named ./run"
So we have to fix it.
Change-Id: I141fcb5567fbb0e3df97aee677cb946a25a9788e
Signed-off-by: liyin <liyin11@huawei.com>
rexlee8776 [Tue, 3 Apr 2018 03:39:33 +0000 (03:39 +0000)]
Bugfix: k8 scenario fix
JIRA: YARDSTICK-1109
Change-Id: Ic61a63099c3d2d4af5fa5634299e4b2946d53eaf
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit
3b1316647b50bc3bbb1eb6216aa07fd4dff34edf)
Alexandru Avadanii [Fri, 6 Apr 2018 22:13:42 +0000 (00:13 +0200)]
docker/supervisor.sh: Fix condition block end
Fixes:
18546b4f
Change-Id: I51fcb48e790ff7c57273a3f6712ccb2b9bc4aa32
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit
ead90064d12be552bd334828d41ffffa75fad01b)
Alexandru Avadanii [Fri, 6 Apr 2018 22:13:42 +0000 (00:13 +0200)]
docker/supervisor.sh: Fix condition block end
Fixes:
18546b4f
Change-Id: I51fcb48e790ff7c57273a3f6712ccb2b9bc4aa32
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
Alexandru Avadanii [Fri, 6 Apr 2018 19:26:01 +0000 (21:26 +0200)]
[AArch64] Dockerfile: Fix malformed patch
Change-Id: Ia2dfc6c4def8e71e36747b8f27cbf22700f676b1
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit
161f7d676b4404a5445681a7871e086b751fdafc)
Alexandru Avadanii [Fri, 6 Apr 2018 19:26:01 +0000 (21:26 +0200)]
[AArch64] Dockerfile: Fix malformed patch
Change-Id: Ia2dfc6c4def8e71e36747b8f27cbf22700f676b1
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
Abhijit Sinha [Fri, 6 Apr 2018 14:19:12 +0000 (14:19 +0000)]
Merge "Bugfix: k8 scenario fix"
Chornyi, TarasX [Fri, 23 Mar 2018 14:29:31 +0000 (16:29 +0200)]
[docs] Updated baremetal instalation instructions
JIRA: YARDSTICK-1111
Change-Id: Iefab24f74c87a0855c2d70090ac34256ffa9200c
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
Emma Foley [Mon, 12 Mar 2018 12:42:57 +0000 (12:42 +0000)]
[userguide] Use literalinclude directive in 05-operation
Uses literalinclude directive instead of having a copy of the file content in documentation.
This means that any update to this file is detected, and the most up-to-date content is used.
If a testcase is updated, the updates wil be picked up.
The examples used are ones that are tested reqularly.
JIRA: YARDSTICK-1066
Change-Id: I15d967eb04d1e6f4348683d8746fa9989dceda94
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Emma Foley [Mon, 12 Mar 2018 10:25:50 +0000 (10:25 +0000)]
[docs] update the user guide for "yardstick-operation"
* Add a new chapter: operation which shows how to use Yardstick and
how to create test cases
* Include details on how to reuse and keep VNFs between testcases
JIRA: YARDSTICK-885
JIRA: YARDSTICK-886
Change-Id: I365152e8812427a3c54259adbc18d5ddb216d775
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Emma Foley [Wed, 7 Mar 2018 18:40:28 +0000 (18:40 +0000)]
[docs] Move user guide chapters to make room for new chapter.
* Increment the numbering on chapters
* Fix some of the changes flagged by doc8
Change-Id: Ie03d165297671dfd50b9de339612cdc8bf00b988
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
rexlee8776 [Tue, 3 Apr 2018 03:39:33 +0000 (03:39 +0000)]
Bugfix: k8 scenario fix
JIRA: YARDSTICK-1109
Change-Id: Ic61a63099c3d2d4af5fa5634299e4b2946d53eaf
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
liyin [Sat, 31 Mar 2018 02:38:19 +0000 (02:38 +0000)]
ADD tc042 into CI
JIRA: YARDSTICK-1108
We add this test case in ovs_dpdk-ha and ovs_dpdk-noha testsuites
also add image build into load_images script
Change-Id: I2b0c6b106dd98c3693df18dba46259ff8ef0a76e
Signed-off-by: liyin <liyin11@huawei.com>
Ross Brattain [Mon, 26 Mar 2018 05:06:52 +0000 (22:06 -0700)]
add verbose to debug losetup delete
JIRA: YARDSTICK-1096
JIRA: YARDSTICK-1054
Change-Id: I5a11dbd2638782c5e499cb94dd5882b8bf696e8d
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Thu, 29 Mar 2018 22:56:45 +0000 (22:56 +0000)]
Merge "Fix RabbitMQ service installation and initialization"
Ross Brattain [Thu, 29 Mar 2018 22:52:54 +0000 (22:52 +0000)]
Merge "don't print exceptions in atexit handler"
Ross Brattain [Thu, 29 Mar 2018 22:52:42 +0000 (22:52 +0000)]
Merge "task: don't hide exceptions in Task"
Ross Brattain [Thu, 29 Mar 2018 21:02:49 +0000 (14:02 -0700)]
don't print exceptions in atexit handler
atexit handler calls terminate_all after the regular python execution
path, and it looks like the traceback stack is None somehow.
In this context log.debug("", exc_info=True) doesn't work
it prints out NoneType on Python3 and
causes other problems on Python2.7
remove the exc_info=True from the logging call
JIRA: YARDSTICK-1107
Change-Id: Ida0a0ced7ff5e017e2f8608880e3bb531724af95
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Thu, 29 Mar 2018 06:38:43 +0000 (23:38 -0700)]
add new Fraser scenarios
New scenarios from wiki: https://wiki.opnfv.org/display/SWREL/Fraser+Scenario+Statu
Change-Id: Ifd6e45e73be2bbb99743aa3f4981d22899aab92a
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Wed, 28 Mar 2018 20:04:43 +0000 (20:04 +0000)]
Merge "restore Heat stack failure logs for CI"
Rodolfo Alonso Hernandez [Wed, 21 Mar 2018 11:32:38 +0000 (11:32 +0000)]
Remove tool provisioning in Standalone contexts
In both Standalone contexts, SR-IOV and DPDK, the tool provisioning must
be removed. If the tool, "dpdk-devbind.py", is not in the VNF, the test
should fail because this tool should be provided during the provisioning,
not during the test execution.
JIRA: YARDSTICK-1092
Change-Id: I212c1303fd655f151e9c0efc29aad97fe6d71d1c
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Rodolfo Alonso Hernandez [Wed, 28 Mar 2018 11:13:35 +0000 (12:13 +0100)]
Fix RabbitMQ service installation and initialization
RabbitMQ service added in [1] is not correctly installed and initialized:
- There is an error during the installation process ("\" character
missing).
- In the installation script, the service needs to be started first.
- In the container installation, the service needs to be started via
supervisor.
[1]https://gerrit.opnfv.org/gerrit/#/c/53597/
JIRA: YARDSTICK-1103
Change-Id: Iade3d6ce4b522e6f576af71b7afe5559081f7929
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Rex Lee [Wed, 28 Mar 2018 00:15:36 +0000 (00:15 +0000)]
Merge "Replace neutron create security group rule with shade."
Rex Lee [Wed, 28 Mar 2018 00:06:16 +0000 (00:06 +0000)]
Merge "Dashboard for TC056"
Ross Brattain [Mon, 26 Mar 2018 06:53:18 +0000 (23:53 -0700)]
task: don't hide exceptions in Task
If the Task raised an exception we currently hide it
and replace it with RuntimeError. This is bad.
If an exception occured, then we don't have a result so
re-raise the original exception.
Or we could log the traceback and raise RuntimeError, but
that doesn't seem to be a good idea.
Sample traceback after re-raising original. Without this patch the ValueError is only written
to _write_error_data
2018-03-25 22:57:56,511 yardstick.benchmark.contexts.node node.py:85 DEBUG BareMetals: []
2018-03-25 22:57:56,511 yardstick.benchmark.contexts.node node.py:89 DEBUG Env: {}
2018-03-25 22:57:56,511 yardstick.cmd.commands.task task.py:57 INFO Task FAILED
Traceback (most recent call last):
File "/home/rbbratta/yardstick-upstream/yardstick/yardstick/cmd/commands/task.py", line 54, in do_start
result = Task().start(param, **kwargs)
File "/home/rbbratta/yardstick-upstream/yardstick/yardstick/benchmark/core/task.py", line 103, in start
task_args_fnames)
File "/home/rbbratta/yardstick-upstream/yardstick/yardstick/benchmark/core/task.py", line 321, in _parse_tasks
task_args_fnames[i]
File "/home/rbbratta/yardstick-upstream/yardstick/yardstick/benchmark/core/task.py", line 558, in parse_task
context.init(cfg_attrs)
File "/home/rbbratta/yardstick-upstream/yardstick/yardstick/benchmark/contexts/heat.py", line 131, in init
server = Server(name, self, server_attrs)
File "/home/rbbratta/yardstick-upstream/yardstick/yardstick/benchmark/contexts/model.py", line 210, in __init__
(name, p))
ValueError: server 'trafficgen_1', placement 'pgrp2' is invalid
2018-03-25 22:57:56,512 yardstick.cmd.commands.task task.py:62 INFO Task FAILED
2018-03-25 22:57:56,662 yardstick.benchmark.runners.base base.py:124 DEBUG Terminating all runners
NoneType
JIRA: YARDSTICK-1102
Change-Id: I7e6fa41fc1d36f6d438a1602ab60cb41ffbee1e9
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Mon, 26 Mar 2018 06:51:28 +0000 (23:51 -0700)]
restore Heat stack failure logs for CI
We need to see what Heat failures occured
so that we can debug CI failures.
The only way to do this seems to be to use the
private event_utils.get_events function to
query for all failures
Also since we had a failure go ahead and dump the
Heat template that failed.
Sample output:
2018-03-25 23:50:08,765 [INFO] yardstick.orchestrator.heat heat.py:629 Creating stack 'yardstick-
460ed969' START
2018-03-25 23:50:21,932 [ERROR] yardstick.orchestrator.heat heat.py:644 Resource CREATE failed: BadRequest: resources.yardstick-
460ed969-xe1: Invalid input for operation: physical_network 'nosuch' unknown for flat provider network.
Neutron server returns request_ids: ['req-
6f981f1e-a9e2-4114-af84-
1ee528aed51b']
2018-03-25 23:50:21,933 [ERROR] yardstick.orchestrator.heat heat.py:644 BadRequest: resources.yardstick-
460ed969-xe1: Invalid input for operation: physical_network 'nosuch' unknown for flat provider network.
Neutron server returns request_ids: ['req-
6f981f1e-a9e2-4114-af84-
1ee528aed51b']
2018-03-25 23:50:21,972 [ERROR] yardstick.orchestrator.heat heat.py:645 {'description': '\n'
'All referred generated resources are prefixed with the '
'template\n'
'name (i.e. yardstick-
460ed969).\n',
'heat_template_version': '2013-05-23',
'outputs': {'trafficgen_1.yardstick-
460ed969': {'description': 'VM UUID',
'value': {'get_resource': 'trafficgen_1.yardstick-
460ed969'}},
'trafficgen_1.yardstick-
460ed969-fip': {'description': 'floating '
'ip '
JIRA: YARDSTICK-998
Change-Id: Ia8f4e5ba7e280fb9086519680d5ee90a2b442e6b
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Rodolfo Alonso Hernandez [Tue, 27 Mar 2018 16:47:54 +0000 (16:47 +0000)]
Merge "Improve "Libvirt.virsh_destroy_vm" function"
Rodolfo Alonso Hernandez [Tue, 27 Mar 2018 16:47:50 +0000 (16:47 +0000)]
Merge "Improve "Libvirt.virsh_create_vm" function"
Rodolfo Alonso Hernandez [Tue, 27 Mar 2018 16:47:45 +0000 (16:47 +0000)]
Merge "Improve NSB Standalone XML generation"
Rodolfo Alonso Hernandez [Tue, 27 Mar 2018 16:47:33 +0000 (16:47 +0000)]
Merge "Improve OVS-DPDK setup process"
Rodolfo Alonso Hernandez [Tue, 27 Mar 2018 16:47:26 +0000 (16:47 +0000)]
Merge "Improve OVS-DPDK boot process"
Shobhi Jain [Wed, 14 Mar 2018 11:53:06 +0000 (11:53 +0000)]
Replace neutron create security group rule with shade.
Rename create_secgroup_rule with create_security_group_rule.
Function create_security_group_rule now uses shade client.
JIRA: YARDSTICK-890
Change-Id: Ie0ebac67a281e55dc95c0e3e33ba43de80aba9ec
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
Rodolfo Alonso Hernandez [Tue, 27 Mar 2018 16:46:41 +0000 (16:46 +0000)]
Merge "Replace neutron floating ip deletion with shade."
Rodolfo Alonso Hernandez [Tue, 27 Mar 2018 16:46:31 +0000 (16:46 +0000)]
Merge "Replace neutron floating ip creation with shade."
Rodolfo Alonso Hernandez [Tue, 27 Mar 2018 16:46:22 +0000 (16:46 +0000)]
Merge "Replace neutron router interface deletion with shade."
Shobhi Jain [Tue, 27 Feb 2018 13:19:00 +0000 (13:19 +0000)]
Replace neutron floating ip deletion with shade.
Function delete_floating_ip now uses shade client.
JIRA: YARDSTICK-890
Change-Id: I960630926b664266afbe7be00bb1352243b41be0
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
Rodolfo Alonso Hernandez [Tue, 27 Mar 2018 12:48:37 +0000 (12:48 +0000)]
Merge "env: validate installer_ip from environment"
Rodolfo Alonso Hernandez [Mon, 26 Mar 2018 07:29:46 +0000 (07:29 +0000)]
Merge "Install RabitMQ for RPC messaging between processes"
Ross Brattain [Sat, 24 Mar 2018 01:46:03 +0000 (01:46 +0000)]
Merge "Test case spec for SDN controller resilience in non-HA config"
Ross Brattain [Sat, 24 Mar 2018 01:31:05 +0000 (01:31 +0000)]
Merge "ansible: disable Extra cloud image kernel stub"
Ross Brattain [Sat, 24 Mar 2018 00:04:18 +0000 (00:04 +0000)]
Merge "use basename to delete yardstick image loop devices"
Ross Brattain [Fri, 23 Mar 2018 21:51:18 +0000 (21:51 +0000)]
Merge "TC042 bug fix"
Ross Brattain [Fri, 23 Mar 2018 21:45:43 +0000 (21:45 +0000)]
Merge "Test case description and configuration file for yardstick_tc090:Control Node Openstack Service High Availability - Database Instances"
Ross Brattain [Fri, 23 Mar 2018 18:35:20 +0000 (11:35 -0700)]
use basename to delete yardstick image loop devices
the full path probably isn't matching, so just grep
for the basename
JIRA: YARDSTICK-1096
JIRA: YARDSTICK-1054
Change-Id: I403a7f51310c0856fae0f79d115ba0786b7c417c
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Emma Foley [Fri, 23 Mar 2018 18:13:54 +0000 (18:13 +0000)]
Merge "Added scale-up documentation"
Jack Chan [Fri, 23 Mar 2018 09:18:17 +0000 (09:18 +0000)]
Merge "Bugfix: 'module' object has no attribute 'UnsupportedExtension'"
Rodolfo Alonso Hernandez [Fri, 23 Mar 2018 09:05:56 +0000 (09:05 +0000)]
Merge "Add "Scenario" class wait methods for runners"
Rodolfo Alonso Hernandez [Fri, 23 Mar 2018 08:36:29 +0000 (08:36 +0000)]
Merge "Make "Scenario" class abstract"
chenjiankun [Fri, 23 Mar 2018 07:08:07 +0000 (07:08 +0000)]
Bugfix: 'module' object has no attribute 'UnsupportedExtension'
JIRA: YARDSTICK-1100
This Error occur when run kuberntes test case:
The Key is the pyopenssl dependency, it seems
YARDSTICK-1032(https://jira.opnfv.org/browse/YARDSTICK-1032) encounter
the same problem. Downgrade requests from 2.18.2 to 2.11.1 would solve
this problem.
Here it is the error log:
Traceback (most recent call last):
File "/usr/lib/python2.7/atexit.py", line 24, in _run_exitfuncs
func(*targs, **kargs)
File
"/home/opnfv/repos/yardstick/yardstick/benchmark/core/task.py",
line 301, in atexit_handler
context.undeploy()
File
"/home/opnfv/repos/yardstick/yardstick/benchmark/contexts/kubernetes.py",
line 63, in undeploy
self._delete_ssh_key()
File
"/home/opnfv/repos/yardstick/yardstick/benchmark/contexts/kubernetes.py",
line 133, in _delete_ssh_key
k8s_utils.delete_config_map(self.ssh_key)
File
"/home/opnfv/repos/yardstick/yardstick/common/kubernetes_utils.py",
line 179, in delete_config_map
**kwargs)
File
"/usr/local/lib/python2.7/dist-packages/kubernetes/client/apis/core_v1_api.py",
line 9059, in delete_namespaced_config_map
(data) =
self.delete_namespaced_config_map_with_http_info(name,
namespace, body, **kwargs)
File
"/usr/local/lib/python2.7/dist-packages/kubernetes/client/apis/core_v1_api.py",
line 9159, in delete_namespaced_config_map_with_http_info
collection_formats=collection_formats)
File
"/usr/local/lib/python2.7/dist-packages/kubernetes/client/api_client.py",
line 321, in call_api
_return_http_data_only, collection_formats,
_preload_content,
_request_timeout)
File
"/usr/local/lib/python2.7/dist-packages/kubernetes/client/api_client.py",
line 155, in __call_api
_request_timeout=_request_timeout)
File
"/usr/local/lib/python2.7/dist-packages/kubernetes/client/api_client.py",
line 387, in request
body=body)
File
"/usr/local/lib/python2.7/dist-packages/kubernetes/client/rest.py",
line 256, in DELETE
body=body)
File
"/usr/local/lib/python2.7/dist-packages/kubernetes/client/rest.py",
line 166, in request
headers=headers)
File
"/usr/local/lib/python2.7/dist-packages/urllib3/request.py",
line 66, in request
**urlopen_kw)
File
"/usr/local/lib/python2.7/dist-packages/urllib3/request.py",
line 87, in request_encode_url
return self.urlopen(method, url, **extra_kw)
File
"/usr/local/lib/python2.7/dist-packages/urllib3/poolmanager.py",
line 321, in urlopen
response = conn.urlopen(method, u.request_uri, **kw)
File
"/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py",
line 601, in urlopen
chunked=chunked)
File
"/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py",
line 346, in _make_request
self._validate_conn(conn)
File
"/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py",
line 850, in _validate_conn
conn.connect()
File
"/usr/local/lib/python2.7/dist-packages/urllib3/connection.py",
line 337, in connect
cert = self.sock.getpeercert()
File
"/usr/local/lib/python2.7/dist-packages/urllib3/contrib/pyopenssl.py",
line 348, in getpeercert
'subjectAltName': get_subj_alt_name(x509)
File
"/usr/local/lib/python2.7/dist-packages/urllib3/contrib/pyopenssl.py",
line 202, in get_subj_alt_name
except (x509.DuplicateExtension, x509.UnsupportedExtension,
AttributeError: 'module' object has no attribute 'UnsupportedExtension'
Change-Id: I444dde829c91defb475e045aea094d74fc43e75b
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
Ross Brattain [Fri, 23 Mar 2018 01:41:12 +0000 (01:41 +0000)]
Merge "dump CI failures with kpartx and no /dev/loop devices"
Chornyi, TarasX [Mon, 12 Mar 2018 08:22:14 +0000 (10:22 +0200)]
Added scale-up documentation
Change-Id: I65770a4a879d890c75a2e5774579794fb9b591f6
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
Ross Brattain [Thu, 22 Mar 2018 13:40:46 +0000 (13:40 +0000)]
Merge "Make Sample VNF hugepages size configurable"
Ross Brattain [Tue, 20 Mar 2018 07:58:32 +0000 (00:58 -0700)]
dump CI failures with kpartx and no /dev/loop devices
CI is failing due to unable to find loop device for kpartx
"cmd": [
"kpartx",
"-l",
"/tmp/workspace/yardstick/yardstick-xenial-server.raw"
]
"stderr": "mount: could not find any device /dev/loop#Bad address\ncan't set up loop",
This error occurs when kpartx can't find any loop devices to use
https://build.opnfv.org/ci/job/yardstick-compass-virtual-daily-master/3261/console
JIRA: YARDSTICK-1054
JIRA: YARDSTICK-1096
Change-Id: Ib6131ce29c4f9e81386eb5471dd6107825798620
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Rex Lee [Thu, 22 Mar 2018 12:40:14 +0000 (12:40 +0000)]
Merge "update ci pod in the test suite according to Fraser"
Rex Lee [Thu, 22 Mar 2018 12:37:28 +0000 (12:37 +0000)]
Merge "Bugfix: Error when using API(v1) to run test suite"
chenjiankun [Thu, 22 Mar 2018 12:15:43 +0000 (12:15 +0000)]
Add k8-nosdn-stor4nfv-ha/noha scenario
JIRA: YARDSTICK-1090
We have k8-nosdn-stor4nfv-ha/noha scenario in compass,
so we need to add this files to trigger it.
Change-Id: I79709c53b8542434f7324ad907fa95b4855839d3
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
chenjiankun [Tue, 20 Mar 2018 09:05:31 +0000 (09:05 +0000)]
Bugfix: Error when using API(v1) to run test suite
JIRA: YARDSTICK-1098
The reason is missing TasksHandler parameter to run test suite.
Change-Id: I9dd45caa87d0e39afbf7485443a6e566317f5cea
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
rexlee8776 [Thu, 22 Mar 2018 04:07:35 +0000 (04:07 +0000)]
update ci pod in the test suite according to Fraser
Change-Id: I999b44cc4e0ec1029c6efca224e691298a007689
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Jing Lu [Thu, 22 Mar 2018 08:51:50 +0000 (08:51 +0000)]
Merge "fix Dummy test context name"
Jack Chan [Thu, 22 Mar 2018 08:23:00 +0000 (08:23 +0000)]
Merge "Running Test Case in Latest Yardstick Docker Image shows Error"
Rex Lee [Thu, 22 Mar 2018 08:15:48 +0000 (08:15 +0000)]
Merge "Test case description and configuration file for yardstick_tc091:Control Node Openstack Service High Availability - Heat Api"
rexlee8776 [Thu, 22 Mar 2018 07:41:42 +0000 (07:41 +0000)]
fix Dummy test context name
more dummy test fix base on I0ccb7e9fabdf6bc2890d2e4763f53baee06c87b2
Since I1447fb5ed447691eaeb0a97f928c0b3333799d07, the context name is
a mandatory parameter for every context.
JIRA: YARDSTICK-886
Change-Id: I10ee6bcc0507fa90b6e99261a98a96655fc66947
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Jack Chan [Thu, 22 Mar 2018 02:11:04 +0000 (02:11 +0000)]
Merge "Add k8-nosdn-stor4nfv-ha/noha scenario"
Rodolfo Alonso Hernandez [Mon, 12 Mar 2018 17:03:30 +0000 (17:03 +0000)]
Install RabitMQ for RPC messaging between processes
In NetworkServices Tescases, the TGs (traffic generators) run the traffic in
a separate process. In order to synchronize the traffic injection and the
runner interval loops, an RPC server is needed to publish/subscribe events.
RabbitMQ is a well supported MQ in Linux (used in OpenStack or collectd)
and supported by Python implemented projects like oslo.messaging [1].
RabbitMQ default configuration:
- Port: 5672
- User/password: yardstick/yardstick
[1]https://github.com/openstack/oslo.messaging
JIRA: YARDSTICK-1068
Change-Id: I15db294ee430fb38e574a59b9ce1bf0f8b651a67
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>