Cédric Ollivier [Fri, 3 Aug 2018 08:31:09 +0000 (10:31 +0200)]
Fix typo (ressources)
Change-Id: Ibe131e0cf02493f0f3a82c1e179848605bd0a292
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Fri, 3 Aug 2018 05:58:55 +0000 (05:58 +0000)]
Merge "Fix parse error in tempest_smoke"
Cédric Ollivier [Fri, 3 Aug 2018 04:19:22 +0000 (06:19 +0200)]
Increase Cloudify create_server_timeout
The timeout has been reached when running multiple vnfs in parallel.
Only few additional seconds seemed required here.
Change-Id: I0d6e38e827c581edb617bb0cc13249645468a2aa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Delia Popescu [Thu, 2 Aug 2018 12:50:41 +0000 (15:50 +0300)]
Fix parse error in tempest_smoke
Test failes to parse /etc/rally/rally.conf
(RALLY_CONF_FILE) whith inplace=1 keyword argument
for fileinput
One new space is added in second line
JIRA: ARMBAND-395
Change-Id: I8adb333047f9962f4105a6a74e2f8ef83d5745e0
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
Cédric Ollivier [Thu, 2 Aug 2018 08:26:40 +0000 (10:26 +0200)]
Upgrade Shaker create_server timeout
It ends after a little bit more than 3 minutes in Apex [1].
It increases to 5 minutes like Cloudify.
[1] http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-07-30_11-30-01/functest.log
Change-Id: I8362034107e694ddd5a1e4a1f9e11362100d7cb0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Delia Popescu [Wed, 1 Aug 2018 13:52:33 +0000 (16:52 +0300)]
Remove hw_video_model and hw_firmware_type from metadata
Starting with the Openstack Queens release,
hw_firmware_type=uefi is implied on AArch64 by default
Using virtio-video, now default in nova, should be used
instead of VGA
JIRA: ARMBAND-388
Change-Id: I393093c5a1a9dd9c8259b3987db22650313cf249
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
Cédric Ollivier [Tue, 31 Jul 2018 11:01:14 +0000 (13:01 +0200)]
Add fallback mechanism if vlan
private_v4 and public_v4 are incorrectly set when vlan is used as
overlay.
JIRA: FUNCTEST-996
Change-Id: I120a247e92e0fd295769b2a0eeb15ce82a0eabc8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 31 Jul 2018 10:25:40 +0000 (12:25 +0200)]
Print stderr in logs when calling cmd over ssh
Change-Id: I152ac898661a0e99a6232df86689c70c468ceaa5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 31 Jul 2018 09:01:34 +0000 (11:01 +0200)]
Switch create_server timeout to default value
60s was successfully reached when running all containers (3
containers * 3 branches) in parallel.
It also removes the wait attribute (the current impl will meet
a possible next asynchronous design) which is useless here.
For the time being, only cloudify needs an extra timeout.
Change-Id: Ic7741b4c1a3223be076fb69ef70a3cb6c05456c2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 30 Jul 2018 14:25:04 +0000 (16:25 +0200)]
Update Xtesting to 0.54.0
It protects vs uncaught exceptions and then avoids skipping testcases
in that case (see cloudify_ims and juju_epc in [1]).
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console
Change-Id: I8e39f7e742b9fec2e6f6bab542d5f497159f50ac
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 30 Jul 2018 13:50:44 +0000 (15:50 +0200)]
Delete alt images before removing the account
Else it could raise unauthorized exceptions [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console
Change-Id: Ia9b857069f775e2c8ecc5e07cf39b3a1fb7e3540
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 30 Jul 2018 13:03:42 +0000 (15:03 +0200)]
Protect vs exceptions when creating secrets
cloudify_ims sometimes faces with exceptions when creating secrets
[1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console
Change-Id: I197748bf97752575dc14650e1e1c382774811cce
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 30 Jul 2018 10:45:26 +0000 (12:45 +0200)]
Fix clearwater test results parsing
Before it could extract part of the skipped tests [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/209/console
Change-Id: I7e7564cb7b96705940051fccf0ff1987f34bb962
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 30 Jul 2018 00:20:10 +0000 (02:20 +0200)]
Allow backporting a pylint error
Change-Id: I2df0964d63c80abbc5c5cc438e1fdd32f24fd52f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 30 Jul 2018 00:13:30 +0000 (02:13 +0200)]
Fix clean() in cloudify ims and router
It raised exceptions in both branches [1]
[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/209/console
Change-Id: I87b33cedae768f92296efa4570d2a47cd9cdbdf2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 29 Jul 2018 19:48:18 +0000 (21:48 +0200)]
Release floating ips used by juju_epc
It also cleans flavor_alt and image_alt.
Change-Id: I62296075eca75c3c18caac4a3cddeef1fdb26e1b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 29 Jul 2018 19:40:20 +0000 (21:40 +0200)]
Remove VnfOnBoarding
All the vnfs are now inherating from scenarios.
Change-Id: I63509102067676ca0676b773db542086caa02d84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 23 Jul 2018 13:00:14 +0000 (15:00 +0200)]
Update juju_epc to leverage on new scenarios
It avoids duplicating codes across all OPNFV testcases.
It also fixes the issues when starting mongodb [1] by upgrading juju agent.
It stops supporting keystone v2 as the other testcases.
[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/lastFailedBuild/console
Change-Id: I06cddddef1121292ffb695dcb73aa79a07c23192
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 17 Jul 2018 16:00:37 +0000 (18:00 +0200)]
Leverage vyos_vrouter on Cloudify
It also stop rebooting the VMs.
Change-Id: Ib0f9e1aac1dd8505378b0688930eb41a590a11f1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 27 Jul 2018 12:10:12 +0000 (14:10 +0200)]
Stop redirecting output to json files
Rally may print additional data to console which results in an
invalid json files. The json files are generated via rally instead of
dumping stdout.
It's mandatory to backport the next bugfix [1] in stable/fraser.
[1] https://gerrit.opnfv.org/gerrit/#/c/60265/
Change-Id: Ifbd90e685a7b52c70b3110a46e3c7991eddc05f4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Valentin Boucher [Tue, 24 Jul 2018 16:30:24 +0000 (12:30 -0400)]
Reduce cloudify manager disk size
40 Gb is enough
Change-Id: Iae6a72fcf91fda67bbd036f478e344478d48264f
Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
Cedric Ollivier [Tue, 24 Jul 2018 16:11:17 +0000 (16:11 +0000)]
Merge "Revert "Temporarily disable Snaps CreateRouterSuccessTests""
Cedric Ollivier [Tue, 24 Jul 2018 09:40:24 +0000 (09:40 +0000)]
Merge "New Heat IMS testcase"
Cédric Ollivier [Tue, 24 Jul 2018 09:12:25 +0000 (11:12 +0200)]
Protect vs OS_TENANT_NAME or _ID in shaker
It fixes the possible mismatch if both OS_TENANT and OS_PROJECT are
set [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/lastFailedBuild/console
Change-Id: I66b6e3cf30a34aff1234da00cdd6b40da92089e5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 23 Jul 2018 20:59:11 +0000 (22:59 +0200)]
Detect admin or Admin role
As Keystone roles are case insensitive, Admin is checked as well.
Change-Id: I28a611add7890c3188a289d1e24c043d88c34ea1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 23 Jul 2018 19:51:40 +0000 (21:51 +0200)]
Create heat_stack_owner if required
It allows testing OpenStack Queens and older [1].
It will be improved in a second change for latest OpenStack releases
(if deprecated).
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/174/console
Change-Id: I6e91e8c45d335aa606370c35b0a03b990e22c165
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Valentin Boucher [Thu, 19 Jul 2018 15:35:50 +0000 (11:35 -0400)]
New Heat IMS testcase
In order to validate OpenStack Master deployment
we create this new testcase using OpenStack Heat
as an Orchestrator for Clearwater VNF
JIRA: FUNCTEST-995
Change-Id: I8b7b74a3753c2d4d4614e9a2798283bd3f99d5d2
Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
Cédric Ollivier [Sun, 22 Jul 2018 14:23:52 +0000 (16:23 +0200)]
Revert "Temporarily disable Snaps CreateRouterSuccessTests"
This reverts commit
74c4e99c18d00d80ce7a2c2f0c36e656a842b966.
Change-Id: I6fdfd080e0e3b46e1d65b992e680daefe260add9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 22 Jul 2018 13:34:20 +0000 (15:34 +0200)]
Revert "Temporarily disable HOT including OS::Nova::FloatingIPAssociation"
This reverts commit
59ba5abb31018282bca796ee0c0652d61192c6bf.
Change-Id: I87a01b828668123dc9d96f5ac7823686ff0fb10e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 22 Jul 2018 13:25:07 +0000 (15:25 +0200)]
Add secrets operations in cloudify.py
It tries to prevent race conditions when running cloudify_ims.
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/functest/core/singlevm.py", line 411, in run
if not self.execute():
File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/vnf/ims/cloudify_ims.py", line 120, in execute
self.cfy_client.secrets.create(k, val)
File "/usr/lib/python2.7/site-packages/cloudify_rest_client/secrets.py", line 86, in create
response = self.api.put('/secrets/{0}'.format(key), data=data)
File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 263, in put
timeout=timeout)
File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 233, in do_request
'SSL, but the client does'.format(e)
ConnectionError: ('Connection aborted.', BadStatusLine("''",))
Change-Id: Id2603bbda462b50d3140b6f45894c8810d542e4c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 22 Jul 2018 09:55:31 +0000 (11:55 +0200)]
Add helper to find string in console
It allows checking when cloud-init is finished (see heat_ims).
Change-Id: I951aabff29457d7b7544a809f9fce1f83706035e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 21 Jul 2018 07:42:16 +0000 (09:42 +0200)]
Skip Snaps testcases when OpenStack Rocky
Snaps is testing vs OpenStack Queens following the traditional
release track. Then Snaps testcases must be skipped vs OpenStack
master as deployed by Apex.
Snaps isn't compatible yet with the last Cinder changes (API
microversions) which is out of its current scope [1].
[1] http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-07-19_05-29-02/functest.log
Change-Id: I1e93527d9c87eb11bf7fd0cc9d04597614d32370
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 21 Jul 2018 07:22:39 +0000 (09:22 +0200)]
Add helpers to detect OpenStack versions
It leverages on Nova API Microversions [1].
[1] https://docs.openstack.org/nova/latest/reference/api-microversion-history.html
Change-Id: I60abf9089036e56fcbcd6c2b734666ea20875ceb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Delia Popescu [Fri, 20 Jul 2018 12:31:24 +0000 (15:31 +0300)]
Increase create server timeout for shaker test
Change-Id: Ie0fdfd2bbd93952bcd35a30c96b7980ffeb0d87c
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
Cédric Ollivier [Fri, 20 Jul 2018 11:31:50 +0000 (13:31 +0200)]
Minor change about subnet pool
It reverts the subnet pool to 192.168.120.0/24.
It avoids conflicts with default CPE private subnets.
It also increases cloudify spawning timeout.
Change-Id: I70183cede0690c2cbc74f9c30a38892d829db2c9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 20 Jul 2018 08:45:20 +0000 (10:45 +0200)]
Allow overriding the default role
It allows testing controllers which implements other RBAC policies.
Defining NEW_USER_ROLE=admin will easily raise side effects for
orchestrators such as Juju and Cloudify.
Change-Id: Ia78a25381aeb8aa81fd1872661629e1c08432b8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 20 Jul 2018 08:36:58 +0000 (10:36 +0200)]
Stop Fuel logics in odl
Fuel is setting the right env vars [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/59929/
Change-Id: Ieb0ae1887859e0b7d3f77dfb5100a633b6479a37
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Delia Popescu [Tue, 3 Jul 2018 13:30:10 +0000 (16:30 +0300)]
Cover cinder testcases
JIRA: FUNCTEST-908
Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Ie9662877cba89ea96de4403ee2b736c118a044d5
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
Cédric Ollivier [Wed, 18 Jul 2018 20:41:58 +0000 (22:41 +0200)]
Temporarily disable test_image_signing tests
They don't pass in two different Queens deployments.
The topic will continue upstream.
Change-Id: I43d6b8306aee6934fa1545ec3ed8130bb9b23ee4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 18 Jul 2018 20:14:28 +0000 (22:14 +0200)]
Remove logics about Daisy in odl
Daisy is now setting the right env vars [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/59839/1
Change-Id: If23c0ac0b5ab2f4f4b9515e27d845cb9c4d07ded
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 18 Jul 2018 18:43:32 +0000 (20:43 +0200)]
Switch VMTP_TAG to the new commit id
The related review has been merged [1].
[1] https://review.openstack.org/#/c/580914/
Change-Id: I64dc2a38b08d02ea653582159d2af83fc7e16e31
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 18 Jul 2018 14:00:35 +0000 (16:00 +0200)]
Delete the right dir when building functest-vnf
It reduces a lot the size of the docker image.
Change-Id: Ifd577169697b33dfd89594e8dd3afe4aa34ec7f9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 18 Jul 2018 13:05:47 +0000 (15:05 +0200)]
Increase timeout when creating servers
It takes times to prepare disk on compute nodes (spawning).
The default value is enough for all cirros VMs but it has to be
increased for all cloudify VMs (4.1G).
Change-Id: I3f1fc0142a73c586e9219a2718bfc467cc48e275
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 18 Jul 2018 12:56:42 +0000 (14:56 +0200)]
Force a GET operations on cloudify API
Cloudify is considered as running by the client but sometimes it
failed when listing secrets right after. It adds that check in
cloudify.py.
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/functest/core/singlevm.py", line 391, in run
if not self.execute():
File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/vnf/ims/cloudify_ims.py", line 119, in execute
secrets_list = self.cfy_client.secrets.list()
File "/usr/lib/python2.7/site-packages/cloudify_rest_client/secrets.py", line 113, in list
response = self.api.get('/secrets', params=params)
File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 252, in get
timeout=timeout)
File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 233, in do_request
'SSL, but the client does'.format(e)
ConnectionError: ('Connection aborted.', BadStatusLine("''",))
Change-Id: Ie1b25ff529cfbf9f7476821499da369a46126e81
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 18 Jul 2018 07:27:33 +0000 (09:27 +0200)]
Typo
Change-Id: Ibff3b01c50bfee266d0b99fab5b7baf271d43de4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 17 Jul 2018 16:18:04 +0000 (18:18 +0200)]
Set filename_alt in tempest
Change-Id: I9137ee30bd2107ec23ef6cfea92ccfc5f010410d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 17 Jul 2018 11:19:54 +0000 (13:19 +0200)]
Leverage cloudify_ims on Cloudify
It also defines 2 new methods to avoid duplicating code:
- TenantNetwork1.get_public_auth_url()
- VmReady1.publish_image_alt()
Shaker and Tempest are updated as well.
Change-Id: Ie9095c57c580b95f067d5a8275ad71818b4df335
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 16 Jul 2018 12:30:09 +0000 (14:30 +0200)]
Fix typos in trunk-details
Else neutron_trunk is skipped [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/184/console
Change-Id: I5d63e84414d8fc3af3ef2ac5b4d023fc5e59ef81
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 16 Jul 2018 08:01:56 +0000 (10:01 +0200)]
Rename Patrole config fields
Else it conflicts with the new tempest config fields [1].
It makes sense to switch to includes here.
[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-virtual-daily-master/566/console
Change-Id: If7b3025b4003ea5704c6a3cdeae8cd00f1c5509e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 15 Jul 2018 19:40:53 +0000 (21:40 +0200)]
Temporarily disable CreateInstanceSingleNetworkTests
It can only work if tests are executed via admin (+default domain)
[1].
[1] https://jira.opnfv.org/browse/SNAPS-322
Change-Id: I80dbb46a2197af77fe83ee8768f46bb70b2a810c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 15 Jul 2018 13:11:35 +0000 (15:11 +0200)]
Define env vars for ODL inputs
It's linked to "Add default param for ODL password" [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/59811/
Change-Id: Ib88d9371a2b6febb5c1af69ffda9b3c5024999e9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 15 Jul 2018 12:15:45 +0000 (14:15 +0200)]
Dynamically skip neutron_trunk and barbican
It avoids fasly testcases in failure for end users.
It also removes the neutron_trunk class which is now useless (Queens).
Change-Id: I3f5a1ac84a50e061da6eadcc5c9bafb2e99050db
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 15 Jul 2018 10:43:42 +0000 (12:43 +0200)]
Typo
Change-Id: I55064f83d2a97eaae2a2861d4451ae34e547c40c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 15 Jul 2018 10:22:06 +0000 (12:22 +0200)]
Include neutron_tempest_plugin in tempest-[smoke,full]
Change-Id: I19f9a6ff2f76a4684bf341b2f22ffc4d09dca1cc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 15 Jul 2018 10:19:43 +0000 (12:19 +0200)]
Leverage on Xtesting 0.53
It allows dynamically skipping test cases.
Change-Id: Ida82e76478316fce61dd59dd206e1c03943b084a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 14 Jul 2018 11:37:35 +0000 (13:37 +0200)]
Set swift_operator_role if required
Apex creates member as default role which conflicts with the default
swift_operator_role [1]. It detects the default role in lowercase as
well and write it in rally.conf if required.
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-virtual-suite-master/116/console
Change-Id: Ic4dc98c793207fc32ff35852472742c92db6699c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 14 Jul 2018 03:53:07 +0000 (05:53 +0200)]
Temporarily disable HOT including OS::Nova::FloatingIPAssociation
Change-Id: I31b76c5b3604845367c10f6e5d55c415042f6d47
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 13 Jul 2018 19:54:41 +0000 (21:54 +0200)]
Fix components and vnf testcase dependencies
It completes "Leverage to Xtesting 0.51" [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/59755/
Change-Id: Id36f1d84c305829d14e069b6ec5d056256f42fe1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 13 Jul 2018 06:45:40 +0000 (08:45 +0200)]
Force new project.id when creating new users
Else it raises side effects when both project.id and project.name are
defined (see Apex [1])
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/148/console
Change-Id: I98665ed55a55fdd02e25d8ad17b78d84548b0ec8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 12 Jul 2018 12:30:21 +0000 (14:30 +0200)]
Leverage to Xtesting 0.51
It removes ci_loop which has been useless from Docker slicing.
It can filter now on any env var (e.g. CI_LOOP if required by XCI).
Change-Id: Ibd685edf4636bd251c85466e8b4febcd1e20d312
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 12 Jul 2018 07:52:21 +0000 (09:52 +0200)]
Protect vs former interface format
Compass still set publicURL [1]
[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-fraser/lastFailedBuild/consoleFull
Change-Id: I88c6ca336a7017f97f4c07719156e567d1afb9df
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 12 Jul 2018 04:02:25 +0000 (06:02 +0200)]
Handle certificate in shaker.py
http://artifacts.opnfv.org/logs/functest/huawei-virtual2/2018-07-11_18-47-21/functest.log
Change-Id: I9049a06031db2335410828ecb30e763077360bc3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 12 Jul 2018 03:34:54 +0000 (05:34 +0200)]
Avoid duplicating tempest section in rally.conf
Change-Id: I79598cce2c7dfe0a2e969ddd32735c3eb189fa7a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 11 Jul 2018 18:58:04 +0000 (20:58 +0200)]
Reuse the right detected role name
It completes "Try to get Member or member role" [1][2].
[1] https://gerrit.opnfv.org/gerrit/#/c/59661/
[2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/144/console
Change-Id: Ib38b513906b08d6f85834e03f5415e83b66b733b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 11 Jul 2018 18:32:08 +0000 (20:32 +0200)]
Add tempest section in rally.conf
It completes the previous patch [1][2].
[1] https://gerrit.opnfv.org/gerrit/#/c/59681/
[2] https://build.opnfv.org/ci/view/functest/job/functest-compass-virtual-daily-master/555/console
Change-Id: I93ad9db2c7a8a0691fed8bf58f5e21d8f3dc9c57
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 11 Jul 2018 15:33:44 +0000 (17:33 +0200)]
Clean all possible resources
It checks all openstack resources before cleaning.
It allows removing images even if the test fail quickly.
Change-Id: I1763b8a70fa7ffeb03c435e8e775c7afd1a7adac
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 11 Jul 2018 14:12:57 +0000 (16:12 +0200)]
Check the status of inherited steps
Change-Id: If63c228f2844194279b560515f4ab24a4ee88be0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 11 Jul 2018 12:58:36 +0000 (14:58 +0200)]
Force result = 0 if exception
self.result can be positive due to intermediary steps (scenarios).
Else it can return false positives [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-virtual-suite-master/113/console
Change-Id: Iecadee7f7380fda5273a0668aff1b441647c45aa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Wed, 11 Jul 2018 12:45:42 +0000 (12:45 +0000)]
Merge "Update rally image name regex"
Cedric Ollivier [Wed, 11 Jul 2018 12:45:36 +0000 (12:45 +0000)]
Merge "Print all debug messages in a second file"
Cédric Ollivier [Wed, 11 Jul 2018 09:35:33 +0000 (11:35 +0200)]
Update rally image name regex
The default value doesn't conform with our image names.
Else it downloads the image from internet which may be not possible
(offline testing, proxy or deployment l3 issues [1])
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-virtual-suite-master/113/console
Change-Id: I7d951967784d591e7155fe8582299aaa9b680b10
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 11 Jul 2018 10:10:10 +0000 (12:10 +0200)]
Print all debug messages in a second file
All modules are allowed to print in functest.debug.log.
Change-Id: I9c0be258dba985c9d3171bc2d324464e41e1c584
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Delia Popescu [Wed, 11 Jul 2018 09:18:54 +0000 (12:18 +0300)]
Run script only if volume device is found
Add back volume device name search on instance.
If vol is not attached script should not run.
In the current state, if volume is not found, write_data returns
positive result and read_data cannot find any new file
Change-Id: Ifaa8af1e6d5c66f5ac776c83bebde526e77a9fd8
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
Cédric Ollivier [Wed, 11 Jul 2018 07:18:56 +0000 (09:18 +0200)]
Try to get Member or member role
Keystone roles are case insensitive and Apex declares member which
couldn't be detected. Then conflict occured when creating the
mandatory role [1].
It now searches the default role in lower case too.
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/141/console
Change-Id: I687ecfe768ab4717fdb42a135c4bf9b76733ffd9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Tue, 10 Jul 2018 13:45:20 +0000 (13:45 +0000)]
Merge "Define one logger per key module"
Cédric Ollivier [Mon, 9 Jul 2018 20:39:42 +0000 (22:39 +0200)]
Force region to RegionOne if OS_REGION_NAME is unset
tempest still selects the first one if unset [1].
JIRA: FUNCTEST-990
[1] https://docs.openstack.org/tempest/latest/sampleconf.html
Change-Id: I238d47173c2c4aa1db694028e4d44b80b0e280f1
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
Cedric Ollivier [Tue, 10 Jul 2018 09:54:18 +0000 (09:54 +0000)]
Merge "1) Cleanup floating IPs that are assigned through Juju Deployment. 2) Add SCTP rule explicitly to the retrieved Security Group."
Cédric Ollivier [Tue, 10 Jul 2018 09:48:29 +0000 (11:48 +0200)]
Define one logger per key module
Snaps is printing lots of error messages which makes user confused.
It will decrease the size of functest.log.
Change-Id: I2c7d8ec968350563fbfbd62dcc2fc39b13b39a78
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
Cédric Ollivier [Mon, 9 Jul 2018 20:09:39 +0000 (22:09 +0200)]
Publish cloudify scenario
It eases deploying any vnf via Cloudify.
It also stops duplicating code between vims and vrouter.
Co-Authored-By: Valentin Boucher <valentin.boucher@kontron.com>
Change-Id: I5fe06d91804f4781f6b1301da12862bac793ffbb
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
Cédric Ollivier [Mon, 9 Jul 2018 16:54:23 +0000 (18:54 +0200)]
Force public identity endpoint in Shaker
It conforms with our VNFs by calling public endpoints (from VM).
It fixes by design the issues when testing Compass [1] due to
export OS_INTERFACE=publicURL
[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/180/consoleFull
Change-Id: Iea15506ba5910879d05e61cfd20da2c0878e569b
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
Cedric Ollivier [Mon, 9 Jul 2018 12:35:22 +0000 (12:35 +0000)]
Merge "Refactor tempest common"
Cédric Ollivier [Tue, 5 Jun 2018 19:04:54 +0000 (21:04 +0200)]
Add Vmtp as a new testcase
VMTP is a small python application that will automatically perform
ping connectivity, round trip time measurement (latency) and TCP/UDP
throughput.
JIRA: FUNCTEST-980
Change-Id: I8e94fc52a429f505ac14e14bbb9d0a3b20996ba4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 3 Jul 2018 13:28:38 +0000 (15:28 +0200)]
Refactor tempest common
It also renames two testcases and updates all docs because tests
run in parallel in case of tempest smoke.
To force one thread as before:
run:
module: 'functest.opnfv_tests.openstack.tempest.tempest'
class: 'TempestCommon'
args:
mode: '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$'
option:
- '--concurrency=1'
JIRA: FUNCTEST-989
Change-Id: I1348f5908400a5046be8edf983db4afa12e546c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Sun, 8 Jul 2018 09:19:53 +0000 (09:19 +0000)]
Merge "Cover vping_ssh"
Cédric Ollivier [Sun, 8 Jul 2018 08:57:54 +0000 (10:57 +0200)]
Temporarily disable Snaps CreateRouterSuccessTests
The test could be falsy regarding the possible external network
configs [1]. This patch will be reverted as soon as the bug is closed
[2].
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/246/console
[2] https://jira.opnfv.org/browse/SNAPS-320
Change-Id: I680656b300f0d669e8d96bec6c94a4a804ebbecb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 10 Jun 2018 18:12:05 +0000 (20:12 +0200)]
Cover vping_ssh
Change-Id: I37c52057a45d76e081a1a0145baee96041ca25a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 6 Jul 2018 17:44:35 +0000 (19:44 +0200)]
Fix delete_keypair arg
It uses keypair name instead of id as expected by Shade.
It also increases timers as it boots an ubuntu VM.
Change-Id: I8cd131e7c7a94c8f6b0fcc54a4d75ef8af31b807
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Delia Popescu [Wed, 4 Jul 2018 15:05:40 +0000 (18:05 +0300)]
Set timeout for create, attach and detach volume
Without timeout for volume opperations the testcase
will fail only after functest timeout
Change-Id: I669c7933846574c09fc7db06a2a2ce7d101a44f5
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
Cédric Ollivier [Wed, 4 Jul 2018 13:20:22 +0000 (15:20 +0200)]
Install Robot dependencies in healthcheck
old testcase moved to opnfv/functest-healthcheck.
Change-Id: If8e8fc7d8bc9c97602c05e5a4c048461351cc97e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
valentin boucher [Tue, 3 Jul 2018 14:38:50 +0000 (14:38 +0000)]
Merge "Revert "Disable all new testcases for MS3.1""
soumaya [Mon, 2 Jul 2018 10:08:54 +0000 (15:38 +0530)]
1) Cleanup floating IPs that are assigned through Juju Deployment.
2) Add SCTP rule explicitly to the retrieved Security Group.
Change-Id: I38e5b1267dbcdcf8e5aadb3c06dd784044e774d4
Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
Cédric Ollivier [Tue, 3 Jul 2018 09:50:17 +0000 (11:50 +0200)]
Revert "Disable all new testcases for MS3.1"
This reverts commit
0ff1a51fa53cb74f7a671edc3f1502838294d5c9.
Change-Id: I1ff9cb23978cbfcec6a3284654aaf6b153214a19
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Mon, 2 Jul 2018 08:32:07 +0000 (08:32 +0000)]
Merge "Inherit rally from VmReady1"
Cédric Ollivier [Sun, 1 Jul 2018 09:11:33 +0000 (11:11 +0200)]
Create Member role if required
It seems there is no common role configuration between OPNFV
installers. Then it creates/removes the expected role if required.
Change-Id: I38a92e2522a401f46a59813b9e9443a11d6c7060
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 26 Jun 2018 06:23:25 +0000 (08:23 +0200)]
Inherit rally from VmReady1
It also fixes clean().
Change-Id: I42d1305d5cdb5a717cfa7fce26798ac7102310f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Fri, 29 Jun 2018 18:57:51 +0000 (18:57 +0000)]
Merge "Remove floating ip of second instance in cinder testcase"
Delia Popescu [Fri, 29 Jun 2018 10:59:25 +0000 (13:59 +0300)]
Remove floating ip of second instance in cinder testcase
Change-Id: I30e30f1d35bb83984b63d7308331fc7bfee53955
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
Cédric Ollivier [Fri, 29 Jun 2018 08:05:36 +0000 (10:05 +0200)]
Update patches for all tests based on scenarios
Change-Id: Iff7fd8e6c14bdfb67ae146c5be1e073673a951d8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Delia Popescu [Thu, 28 Jun 2018 10:40:33 +0000 (13:40 +0300)]
Get aarch64 image metadata for cinder and vping testcase
Image metadata for cinder and vping tests is no longer set for ARM
Change-Id: I2ab8e6ce55c6e619b96e49ecec7afe727a902345
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
Cedric Ollivier [Wed, 27 Jun 2018 19:17:10 +0000 (19:17 +0000)]
Merge "Modify config_patch.yaml according to the new snaps config"