functest.git
6 years agoAdd secrets operations in cloudify.py 83/60083/1
Cédric Ollivier [Sun, 22 Jul 2018 13:25:07 +0000 (15:25 +0200)]
Add secrets operations in cloudify.py

It tries to prevent race conditions when running cloudify_ims.

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/functest/core/singlevm.py", line 411, in run
    if not self.execute():
  File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/vnf/ims/cloudify_ims.py", line 120, in execute
    self.cfy_client.secrets.create(k, val)
  File "/usr/lib/python2.7/site-packages/cloudify_rest_client/secrets.py", line 86, in create
    response = self.api.put('/secrets/{0}'.format(key), data=data)
  File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 263, in put
    timeout=timeout)
  File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 233, in do_request
    'SSL, but the client does'.format(e)
ConnectionError: ('Connection aborted.', BadStatusLine("''",))

Change-Id: Id2603bbda462b50d3140b6f45894c8810d542e4c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd helper to find string in console 77/60077/1
Cédric Ollivier [Sun, 22 Jul 2018 09:55:31 +0000 (11:55 +0200)]
Add helper to find string in console

It allows checking when cloud-init is finished (see heat_ims).

Change-Id: I951aabff29457d7b7544a809f9fce1f83706035e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSkip Snaps testcases when OpenStack Rocky 69/60069/1
Cédric Ollivier [Sat, 21 Jul 2018 07:42:16 +0000 (09:42 +0200)]
Skip Snaps testcases when OpenStack Rocky

Snaps is testing vs OpenStack Queens following the traditional
release track. Then Snaps testcases must be skipped vs OpenStack
master as deployed by Apex.

Snaps isn't compatible yet with the last Cinder changes (API
microversions) which is out of its current scope [1].

[1] http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-07-19_05-29-02/functest.log

Change-Id: I1e93527d9c87eb11bf7fd0cc9d04597614d32370
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd helpers to detect OpenStack versions 67/60067/1
Cédric Ollivier [Sat, 21 Jul 2018 07:22:39 +0000 (09:22 +0200)]
Add helpers to detect OpenStack versions

It leverages on Nova API Microversions [1].

[1] https://docs.openstack.org/nova/latest/reference/api-microversion-history.html

Change-Id: I60abf9089036e56fcbcd6c2b734666ea20875ceb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoIncrease create server timeout for shaker test 49/60049/1
Delia Popescu [Fri, 20 Jul 2018 12:31:24 +0000 (15:31 +0300)]
Increase create server timeout for shaker test

Change-Id: Ie0fdfd2bbd93952bcd35a30c96b7980ffeb0d87c
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoMinor change about subnet pool 47/60047/1
Cédric Ollivier [Fri, 20 Jul 2018 11:31:50 +0000 (13:31 +0200)]
Minor change about subnet pool

It reverts the subnet pool to 192.168.120.0/24.
It avoids conflicts with default CPE private subnets.

It also increases cloudify spawning timeout.

Change-Id: I70183cede0690c2cbc74f9c30a38892d829db2c9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAllow overriding the default role 43/60043/1
Cédric Ollivier [Fri, 20 Jul 2018 08:45:20 +0000 (10:45 +0200)]
Allow overriding the default role

It allows testing controllers which implements other RBAC policies.
Defining NEW_USER_ROLE=admin will easily raise side effects for
orchestrators such as Juju and Cloudify.

Change-Id: Ia78a25381aeb8aa81fd1872661629e1c08432b8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoStop Fuel logics in odl 35/60035/1
Cédric Ollivier [Fri, 20 Jul 2018 08:36:58 +0000 (10:36 +0200)]
Stop Fuel logics in odl

Fuel is setting the right env vars [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/59929/

Change-Id: Ieb0ae1887859e0b7d3f77dfb5100a633b6479a37
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoCover cinder testcases 93/59493/8
Delia Popescu [Tue, 3 Jul 2018 13:30:10 +0000 (16:30 +0300)]
Cover cinder testcases

JIRA: FUNCTEST-908

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Ie9662877cba89ea96de4403ee2b736c118a044d5
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoTemporarily disable test_image_signing tests 65/59965/1
Cédric Ollivier [Wed, 18 Jul 2018 20:41:58 +0000 (22:41 +0200)]
Temporarily disable test_image_signing tests

They don't pass in two different Queens deployments.
The topic will continue upstream.

Change-Id: I43d6b8306aee6934fa1545ec3ed8130bb9b23ee4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove logics about Daisy in odl 63/59963/1
Cédric Ollivier [Wed, 18 Jul 2018 20:14:28 +0000 (22:14 +0200)]
Remove logics about Daisy in odl

Daisy is now setting the right env vars [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/59839/1

Change-Id: If23c0ac0b5ab2f4f4b9515e27d845cb9c4d07ded
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSwitch VMTP_TAG to the new commit id 61/59961/1
Cédric Ollivier [Wed, 18 Jul 2018 18:43:32 +0000 (20:43 +0200)]
Switch VMTP_TAG to the new commit id

The related review has been merged [1].

[1] https://review.openstack.org/#/c/580914/

Change-Id: I64dc2a38b08d02ea653582159d2af83fc7e16e31
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDelete the right dir when building functest-vnf 43/59943/1
Cédric Ollivier [Wed, 18 Jul 2018 14:00:35 +0000 (16:00 +0200)]
Delete the right dir when building functest-vnf

It reduces a lot the size of the docker image.

Change-Id: Ifd577169697b33dfd89594e8dd3afe4aa34ec7f9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoIncrease timeout when creating servers 35/59935/1
Cédric Ollivier [Wed, 18 Jul 2018 13:05:47 +0000 (15:05 +0200)]
Increase timeout when creating servers

It takes times to prepare disk on compute nodes (spawning).
The default value is enough for all cirros VMs but it has to be
increased for all cloudify VMs (4.1G).

Change-Id: I3f1fc0142a73c586e9219a2718bfc467cc48e275
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoForce a GET operations on cloudify API 33/59933/1
Cédric Ollivier [Wed, 18 Jul 2018 12:56:42 +0000 (14:56 +0200)]
Force a GET operations on cloudify API

Cloudify is considered as running by the client but sometimes it
failed when listing secrets right after. It adds that check in
cloudify.py.

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/functest/core/singlevm.py", line 391, in run
    if not self.execute():
  File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/vnf/ims/cloudify_ims.py", line 119, in execute
    secrets_list = self.cfy_client.secrets.list()
  File "/usr/lib/python2.7/site-packages/cloudify_rest_client/secrets.py", line 113, in list
    response = self.api.get('/secrets', params=params)
  File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 252, in get
    timeout=timeout)
  File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 233, in do_request
    'SSL, but the client does'.format(e)
ConnectionError: ('Connection aborted.', BadStatusLine("''",))

Change-Id: Ie1b25ff529cfbf9f7476821499da369a46126e81
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoTypo 09/59909/1
Cédric Ollivier [Wed, 18 Jul 2018 07:27:33 +0000 (09:27 +0200)]
Typo

Change-Id: Ibff3b01c50bfee266d0b99fab5b7baf271d43de4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSet filename_alt in tempest 93/59893/5
Cédric Ollivier [Tue, 17 Jul 2018 16:18:04 +0000 (18:18 +0200)]
Set filename_alt in tempest

Change-Id: I9137ee30bd2107ec23ef6cfea92ccfc5f010410d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoLeverage cloudify_ims on Cloudify 81/59881/1
Cédric Ollivier [Tue, 17 Jul 2018 11:19:54 +0000 (13:19 +0200)]
Leverage cloudify_ims on Cloudify

It also defines 2 new methods to avoid duplicating code:
  - TenantNetwork1.get_public_auth_url()
  - VmReady1.publish_image_alt()

Shaker and Tempest are updated as well.

Change-Id: Ie9095c57c580b95f067d5a8275ad71818b4df335
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix typos in trunk-details 55/59855/1
Cédric Ollivier [Mon, 16 Jul 2018 12:30:09 +0000 (14:30 +0200)]
Fix typos in trunk-details

Else neutron_trunk is skipped [1].

[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/184/console

Change-Id: I5d63e84414d8fc3af3ef2ac5b4d023fc5e59ef81
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRename Patrole config fields 45/59845/1
Cédric Ollivier [Mon, 16 Jul 2018 08:01:56 +0000 (10:01 +0200)]
Rename Patrole config fields

Else it conflicts with the new tempest config fields [1].
It makes sense to switch to includes here.

[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-virtual-daily-master/566/console

Change-Id: If7b3025b4003ea5704c6a3cdeae8cd00f1c5509e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoTemporarily disable CreateInstanceSingleNetworkTests 37/59837/1
Cédric Ollivier [Sun, 15 Jul 2018 19:40:53 +0000 (21:40 +0200)]
Temporarily disable CreateInstanceSingleNetworkTests

It can only work if tests are executed via admin (+default domain)
[1].

[1] https://jira.opnfv.org/browse/SNAPS-322

Change-Id: I80dbb46a2197af77fe83ee8768f46bb70b2a810c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDefine env vars for ODL inputs 35/59835/1
Cédric Ollivier [Sun, 15 Jul 2018 13:11:35 +0000 (15:11 +0200)]
Define env vars for ODL inputs

It's linked to "Add default param for ODL password" [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/59811/

Change-Id: Ib88d9371a2b6febb5c1af69ffda9b3c5024999e9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDynamically skip neutron_trunk and barbican 33/59833/2
Cédric Ollivier [Sun, 15 Jul 2018 12:15:45 +0000 (14:15 +0200)]
Dynamically skip neutron_trunk and barbican

It avoids fasly testcases in failure for end users.
It also removes the neutron_trunk class which is now useless (Queens).

Change-Id: I3f5a1ac84a50e061da6eadcc5c9bafb2e99050db
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoTypo 31/59831/1
Cédric Ollivier [Sun, 15 Jul 2018 10:43:42 +0000 (12:43 +0200)]
Typo

Change-Id: I55064f83d2a97eaae2a2861d4451ae34e547c40c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoInclude neutron_tempest_plugin in tempest-[smoke,full] 29/59829/1
Cédric Ollivier [Sun, 15 Jul 2018 10:22:06 +0000 (12:22 +0200)]
Include neutron_tempest_plugin in tempest-[smoke,full]

Change-Id: I19f9a6ff2f76a4684bf341b2f22ffc4d09dca1cc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoLeverage on Xtesting 0.53 27/59827/1
Cédric Ollivier [Sun, 15 Jul 2018 10:19:43 +0000 (12:19 +0200)]
Leverage on Xtesting 0.53

It allows dynamically skipping test cases.

Change-Id: Ida82e76478316fce61dd59dd206e1c03943b084a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSet swift_operator_role if required 19/59819/1
Cédric Ollivier [Sat, 14 Jul 2018 11:37:35 +0000 (13:37 +0200)]
Set swift_operator_role if required

Apex creates member as default role which conflicts with the default
swift_operator_role [1]. It detects the default role in lowercase as
well and write it in rally.conf if required.

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-virtual-suite-master/116/console

Change-Id: Ic4dc98c793207fc32ff35852472742c92db6699c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoTemporarily disable HOT including OS::Nova::FloatingIPAssociation 15/59815/1
Cédric Ollivier [Sat, 14 Jul 2018 03:53:07 +0000 (05:53 +0200)]
Temporarily disable HOT including OS::Nova::FloatingIPAssociation

Change-Id: I31b76c5b3604845367c10f6e5d55c415042f6d47
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix components and vnf testcase dependencies 07/59807/1
Cédric Ollivier [Fri, 13 Jul 2018 19:54:41 +0000 (21:54 +0200)]
Fix components and vnf testcase dependencies

It completes "Leverage to Xtesting 0.51" [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/59755/

Change-Id: Id36f1d84c305829d14e069b6ec5d056256f42fe1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoForce new project.id when creating new users 87/59787/1
Cédric Ollivier [Fri, 13 Jul 2018 06:45:40 +0000 (08:45 +0200)]
Force new project.id when creating new users

Else it raises side effects when both project.id and project.name are
defined (see Apex [1])

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/148/console

Change-Id: I98665ed55a55fdd02e25d8ad17b78d84548b0ec8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoLeverage to Xtesting 0.51 55/59755/3
Cédric Ollivier [Thu, 12 Jul 2018 12:30:21 +0000 (14:30 +0200)]
Leverage to Xtesting 0.51

It removes ci_loop which has been useless from Docker slicing.
It can filter now on any env var (e.g. CI_LOOP if required by XCI).

Change-Id: Ibd685edf4636bd251c85466e8b4febcd1e20d312
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoProtect vs former interface format 31/59731/1
Cédric Ollivier [Thu, 12 Jul 2018 07:52:21 +0000 (09:52 +0200)]
Protect vs former interface format

Compass still set publicURL [1]

[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-fraser/lastFailedBuild/consoleFull

Change-Id: I88c6ca336a7017f97f4c07719156e567d1afb9df
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoHandle certificate in shaker.py 27/59727/1
Cédric Ollivier [Thu, 12 Jul 2018 04:02:25 +0000 (06:02 +0200)]
Handle certificate in shaker.py

http://artifacts.opnfv.org/logs/functest/huawei-virtual2/2018-07-11_18-47-21/functest.log

Change-Id: I9049a06031db2335410828ecb30e763077360bc3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAvoid duplicating tempest section in rally.conf 23/59723/1
Cédric Ollivier [Thu, 12 Jul 2018 03:34:54 +0000 (05:34 +0200)]
Avoid duplicating tempest section in rally.conf

Change-Id: I79598cce2c7dfe0a2e969ddd32735c3eb189fa7a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoReuse the right detected role name 21/59721/1
Cédric Ollivier [Wed, 11 Jul 2018 18:58:04 +0000 (20:58 +0200)]
Reuse the right detected role name

It completes "Try to get Member or member role" [1][2].

[1] https://gerrit.opnfv.org/gerrit/#/c/59661/
[2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/144/console

Change-Id: Ib38b513906b08d6f85834e03f5415e83b66b733b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd tempest section in rally.conf 15/59715/1
Cédric Ollivier [Wed, 11 Jul 2018 18:32:08 +0000 (20:32 +0200)]
Add tempest section in rally.conf

It completes the previous patch [1][2].

[1] https://gerrit.opnfv.org/gerrit/#/c/59681/
[2] https://build.opnfv.org/ci/view/functest/job/functest-compass-virtual-daily-master/555/console

Change-Id: I93ad9db2c7a8a0691fed8bf58f5e21d8f3dc9c57
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoClean all possible resources 93/59693/2
Cédric Ollivier [Wed, 11 Jul 2018 15:33:44 +0000 (17:33 +0200)]
Clean all possible resources

It checks all openstack resources before cleaning.
It allows removing images even if the test fail quickly.

Change-Id: I1763b8a70fa7ffeb03c435e8e775c7afd1a7adac
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoCheck the status of inherited steps 87/59687/2
Cédric Ollivier [Wed, 11 Jul 2018 14:12:57 +0000 (16:12 +0200)]
Check the status of inherited steps

Change-Id: If63c228f2844194279b560515f4ab24a4ee88be0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoForce result = 0 if exception 83/59683/1
Cédric Ollivier [Wed, 11 Jul 2018 12:58:36 +0000 (14:58 +0200)]
Force result = 0 if exception

self.result can be positive due to intermediary steps (scenarios).
Else it can return false positives [1].

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-virtual-suite-master/113/console

Change-Id: Iecadee7f7380fda5273a0668aff1b441647c45aa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Update rally image name regex"
Cedric Ollivier [Wed, 11 Jul 2018 12:45:42 +0000 (12:45 +0000)]
Merge "Update rally image name regex"

6 years agoMerge "Print all debug messages in a second file"
Cedric Ollivier [Wed, 11 Jul 2018 12:45:36 +0000 (12:45 +0000)]
Merge "Print all debug messages in a second file"

6 years agoUpdate rally image name regex 67/59667/3
Cédric Ollivier [Wed, 11 Jul 2018 09:35:33 +0000 (11:35 +0200)]
Update rally image name regex

The default value doesn't conform with our image names.
Else it downloads the image from internet which may be not possible
(offline testing, proxy or deployment l3 issues [1])

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-virtual-suite-master/113/console

Change-Id: I7d951967784d591e7155fe8582299aaa9b680b10
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPrint all debug messages in a second file 69/59669/2
Cédric Ollivier [Wed, 11 Jul 2018 10:10:10 +0000 (12:10 +0200)]
Print all debug messages in a second file

All modules are allowed to print in functest.debug.log.

Change-Id: I9c0be258dba985c9d3171bc2d324464e41e1c584
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRun script only if volume device is found 65/59665/2
Delia Popescu [Wed, 11 Jul 2018 09:18:54 +0000 (12:18 +0300)]
Run script only if volume device is found

Add back volume device name search on instance.
If vol is not attached script should not run.
In the current state, if volume is not found, write_data returns
positive result and read_data cannot find any new file

Change-Id: Ifaa8af1e6d5c66f5ac776c83bebde526e77a9fd8
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoTry to get Member or member role 61/59661/2
Cédric Ollivier [Wed, 11 Jul 2018 07:18:56 +0000 (09:18 +0200)]
Try to get Member or member role

Keystone roles are case insensitive and Apex declares member which
couldn't be detected. Then conflict occured when creating the
mandatory role [1].

It now searches the default role in lower case too.

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/141/console

Change-Id: I687ecfe768ab4717fdb42a135c4bf9b76733ffd9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Define one logger per key module"
Cedric Ollivier [Tue, 10 Jul 2018 13:45:20 +0000 (13:45 +0000)]
Merge "Define one logger per key module"

6 years agoForce region to RegionOne if OS_REGION_NAME is unset 33/59633/2
Cédric Ollivier [Mon, 9 Jul 2018 20:39:42 +0000 (22:39 +0200)]
Force region to RegionOne if OS_REGION_NAME is unset

tempest still selects the first one if unset [1].

JIRA: FUNCTEST-990

[1] https://docs.openstack.org/tempest/latest/sampleconf.html

Change-Id: I238d47173c2c4aa1db694028e4d44b80b0e280f1
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
6 years agoMerge "1) Cleanup floating IPs that are assigned through Juju Deployment. 2) Add...
Cedric Ollivier [Tue, 10 Jul 2018 09:54:18 +0000 (09:54 +0000)]
Merge "1) Cleanup floating IPs that are assigned through Juju Deployment. 2) Add SCTP rule explicitly to the retrieved Security Group."

6 years agoDefine one logger per key module 39/59639/1
Cédric Ollivier [Tue, 10 Jul 2018 09:48:29 +0000 (11:48 +0200)]
Define one logger per key module

Snaps is printing lots of error messages which makes user confused.
It will decrease the size of functest.log.

Change-Id: I2c7d8ec968350563fbfbd62dcc2fc39b13b39a78
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
6 years agoPublish cloudify scenario 29/59629/2
Cédric Ollivier [Mon, 9 Jul 2018 20:09:39 +0000 (22:09 +0200)]
Publish cloudify scenario

It eases deploying any vnf via Cloudify.
It also stops duplicating code between vims and vrouter.

Co-Authored-By: Valentin Boucher <valentin.boucher@kontron.com>
Change-Id: I5fe06d91804f4781f6b1301da12862bac793ffbb
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
6 years agoForce public identity endpoint in Shaker 25/59625/1
Cédric Ollivier [Mon, 9 Jul 2018 16:54:23 +0000 (18:54 +0200)]
Force public identity endpoint in Shaker

It conforms with our VNFs by calling public endpoints (from VM).
It fixes by design the issues when testing Compass [1] due to
export OS_INTERFACE=publicURL

[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/180/consoleFull

Change-Id: Iea15506ba5910879d05e61cfd20da2c0878e569b
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
6 years agoMerge "Refactor tempest common"
Cedric Ollivier [Mon, 9 Jul 2018 12:35:22 +0000 (12:35 +0000)]
Merge "Refactor tempest common"

6 years agoAdd Vmtp as a new testcase 01/58401/7
Cédric Ollivier [Tue, 5 Jun 2018 19:04:54 +0000 (21:04 +0200)]
Add Vmtp as a new testcase

VMTP is a small python application that will automatically perform
ping connectivity, round trip time measurement (latency) and TCP/UDP
throughput.

JIRA: FUNCTEST-980

Change-Id: I8e94fc52a429f505ac14e14bbb9d0a3b20996ba4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRefactor tempest common 91/59491/6
Cédric Ollivier [Tue, 3 Jul 2018 13:28:38 +0000 (15:28 +0200)]
Refactor tempest common

It also renames two testcases and updates all docs because tests
run in parallel in case of tempest smoke.

To force one thread as before:
run:
    module: 'functest.opnfv_tests.openstack.tempest.tempest'
    class: 'TempestCommon'
    args:
        mode: '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$'
        option:
            - '--concurrency=1'

JIRA: FUNCTEST-989

Change-Id: I1348f5908400a5046be8edf983db4afa12e546c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Cover vping_ssh"
Cedric Ollivier [Sun, 8 Jul 2018 09:19:53 +0000 (09:19 +0000)]
Merge "Cover vping_ssh"

6 years agoTemporarily disable Snaps CreateRouterSuccessTests 95/59595/1
Cédric Ollivier [Sun, 8 Jul 2018 08:57:54 +0000 (10:57 +0200)]
Temporarily disable Snaps CreateRouterSuccessTests

The test could be falsy regarding the possible external network
configs [1]. This patch will be reverted as soon as the bug is closed
[2].

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/246/console
[2] https://jira.opnfv.org/browse/SNAPS-320

Change-Id: I680656b300f0d669e8d96bec6c94a4a804ebbecb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoCover vping_ssh 03/58403/2
Cédric Ollivier [Sun, 10 Jun 2018 18:12:05 +0000 (20:12 +0200)]
Cover vping_ssh

Change-Id: I37c52057a45d76e081a1a0145baee96041ca25a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix delete_keypair arg 85/59585/1
Cédric Ollivier [Fri, 6 Jul 2018 17:44:35 +0000 (19:44 +0200)]
Fix delete_keypair arg

It uses keypair name instead of id as expected by Shade.
It also increases timers as it boots an ubuntu VM.

Change-Id: I8cd131e7c7a94c8f6b0fcc54a4d75ef8af31b807
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSet timeout for create, attach and detach volume 49/59549/3
Delia Popescu [Wed, 4 Jul 2018 15:05:40 +0000 (18:05 +0300)]
Set timeout for create, attach and detach volume

Without timeout for volume opperations the testcase
will fail only after functest timeout

Change-Id: I669c7933846574c09fc7db06a2a2ce7d101a44f5
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoInstall Robot dependencies in healthcheck 47/59547/1
Cédric Ollivier [Wed, 4 Jul 2018 13:20:22 +0000 (15:20 +0200)]
Install Robot dependencies in healthcheck

old testcase moved to opnfv/functest-healthcheck.

Change-Id: If8e8fc7d8bc9c97602c05e5a4c048461351cc97e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Revert "Disable all new testcases for MS3.1""
valentin boucher [Tue, 3 Jul 2018 14:38:50 +0000 (14:38 +0000)]
Merge "Revert "Disable all new testcases for MS3.1""

6 years ago1) Cleanup floating IPs that are assigned through Juju Deployment. 27/59427/2
soumaya [Mon, 2 Jul 2018 10:08:54 +0000 (15:38 +0530)]
1) Cleanup floating IPs that are assigned through Juju Deployment.
2) Add SCTP rule explicitly to the retrieved Security Group.

Change-Id: I38e5b1267dbcdcf8e5aadb3c06dd784044e774d4
Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
6 years agoRevert "Disable all new testcases for MS3.1" 83/59483/1
Cédric Ollivier [Tue, 3 Jul 2018 09:50:17 +0000 (11:50 +0200)]
Revert "Disable all new testcases for MS3.1"

This reverts commit 0ff1a51fa53cb74f7a671edc3f1502838294d5c9.

Change-Id: I1ff9cb23978cbfcec6a3284654aaf6b153214a19
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Inherit rally from VmReady1"
Cedric Ollivier [Mon, 2 Jul 2018 08:32:07 +0000 (08:32 +0000)]
Merge "Inherit rally from VmReady1"

6 years agoCreate Member role if required 07/59407/2
Cédric Ollivier [Sun, 1 Jul 2018 09:11:33 +0000 (11:11 +0200)]
Create Member role if required

It seems there is no common role configuration between OPNFV
installers. Then it creates/removes the expected role if required.

Change-Id: I38a92e2522a401f46a59813b9e9443a11d6c7060
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoInherit rally from VmReady1 43/59043/7
Cédric Ollivier [Tue, 26 Jun 2018 06:23:25 +0000 (08:23 +0200)]
Inherit rally from VmReady1

It also fixes clean().

Change-Id: I42d1305d5cdb5a717cfa7fce26798ac7102310f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Remove floating ip of second instance in cinder testcase"
Cedric Ollivier [Fri, 29 Jun 2018 18:57:51 +0000 (18:57 +0000)]
Merge "Remove floating ip of second instance in cinder testcase"

6 years agoRemove floating ip of second instance in cinder testcase 23/59323/1
Delia Popescu [Fri, 29 Jun 2018 10:59:25 +0000 (13:59 +0300)]
Remove floating ip of second instance in cinder testcase

Change-Id: I30e30f1d35bb83984b63d7308331fc7bfee53955
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoUpdate patches for all tests based on scenarios 11/59311/1
Cédric Ollivier [Fri, 29 Jun 2018 08:05:36 +0000 (10:05 +0200)]
Update patches for all tests based on scenarios

Change-Id: Iff7fd8e6c14bdfb67ae146c5be1e073673a951d8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoGet aarch64 image metadata for cinder and vping testcase 91/59191/1
Delia Popescu [Thu, 28 Jun 2018 10:40:33 +0000 (13:40 +0300)]
Get aarch64 image metadata for cinder and vping testcase

Image metadata for cinder and vping tests is no longer set for ARM

Change-Id: I2ab8e6ce55c6e619b96e49ecec7afe727a902345
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoMerge "Modify config_patch.yaml according to the new snaps config"
Cedric Ollivier [Wed, 27 Jun 2018 19:17:10 +0000 (19:17 +0000)]
Merge "Modify config_patch.yaml according to the new snaps config"

6 years agoModify config_patch.yaml according to the new snaps config 85/59085/2
Cédric Ollivier [Wed, 27 Jun 2018 13:16:31 +0000 (15:16 +0200)]
Modify config_patch.yaml according to the new snaps config

It allows verifying ovs scenarios via snaps.

JIRA: FUNCTEST-984

Change-Id: I0fedadc0b9e265c424ae3221469b8d28b9a68afa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Take shaker arm64 image into account"
Cedric Ollivier [Tue, 26 Jun 2018 17:58:27 +0000 (17:58 +0000)]
Merge "Take shaker arm64 image into account"

6 years agoMerge "Disable all new testcases for MS3.1"
Cedric Ollivier [Tue, 26 Jun 2018 17:58:05 +0000 (17:58 +0000)]
Merge "Disable all new testcases for MS3.1"

6 years agoTake shaker arm64 image into account 53/59053/2
Cédric Ollivier [Tue, 26 Jun 2018 15:51:09 +0000 (17:51 +0200)]
Take shaker arm64 image into account

Change-Id: Ia1da6e97027df2cfa923f5ba076731e4a2817b1f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDisable all new testcases for MS3.1 41/59041/4
Cédric Ollivier [Tue, 26 Jun 2018 14:28:27 +0000 (16:28 +0200)]
Disable all new testcases for MS3.1

It has been decided in TSC release meeting.

Change-Id: I0a62f18c5b11fe31ac72fc301c5444e8d89b6fff
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Remove list_zones() which requires dns"
Cedric Ollivier [Mon, 25 Jun 2018 18:26:33 +0000 (18:26 +0000)]
Merge "Remove list_zones() which requires dns"

6 years agoRemove list_zones() which requires dns 03/59003/1
Cédric Ollivier [Mon, 25 Jun 2018 18:01:28 +0000 (20:01 +0200)]
Remove list_zones() which requires dns

Change-Id: I271545a654a1a508c8b47a3fa4dcf72ad314a154
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix role name for tenantnetwork 75/58975/3
Delia Popescu [Mon, 25 Jun 2018 10:32:42 +0000 (13:32 +0300)]
Fix role name for tenantnetwork

Role name _member_ is no longer available
The test returnes OpenstackCloudException that
role _member_ is not found

Change-Id: I37c8dfe6c4da04009ccabbc49e12c2123d92832b
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoMove odl into healthcheck 69/58969/3
Cédric Ollivier [Mon, 25 Jun 2018 05:17:17 +0000 (07:17 +0200)]
Move odl into healthcheck

It should be included in healthcheck as all basic tests.

Change-Id: I48439fe6385a9056eed8b779290f20633d59b0fd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoImplement connection_check via shade too 61/58961/4
Cédric Ollivier [Mon, 25 Jun 2018 04:07:26 +0000 (06:07 +0200)]
Implement connection_check via shade too

SNAPS connection_check tests are merged into api_check.
It would ease debugging deployment as well [1]

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/127/console

Change-Id: I30254a46c3dc6874881d687e36903c6b7878d63d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMove vping_* and cinder_test into healthcheck 57/58957/1
Cédric Ollivier [Mon, 25 Jun 2018 03:09:05 +0000 (05:09 +0200)]
Move vping_* and cinder_test into healthcheck

Change-Id: I193c6dcdf90fe8eac46884fe5a5a329b0e5a7322
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd dedug data when creating project/user 55/58955/1
Cédric Ollivier [Mon, 25 Jun 2018 02:58:11 +0000 (04:58 +0200)]
Add dedug data when creating project/user

https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/127/console

Change-Id: I233cef05560eba5f238b0eea3e2c56cb3c882931
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoForce the use of public endpoints in shaker.py 53/58953/2
Cédric Ollivier [Sun, 24 Jun 2018 17:43:01 +0000 (19:43 +0200)]
Force the use of public endpoints in shaker.py

It now leverages on the new user created and gets the public endpoint.

Change-Id: Iead106e614a73708cb13e33b49a2f438766a3056
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix hardcoded values in cinder_test 51/58951/1
Cédric Ollivier [Sun, 24 Jun 2018 11:54:01 +0000 (13:54 +0200)]
Fix hardcoded values in cinder_test

Only Fuel attaches a kdrive in all cases and then increase the device
numbers. cinder_test now leverages on VOLUME_DEVICE_NAME as tempest.

It also updates the testcase to leverage on the right scenario.

Change-Id: Ib5cd17f69411f608f1b79e704604dc481581ebe0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoImprove scenarios to reduce duplicate codes 49/58949/1
Cédric Ollivier [Sun, 24 Jun 2018 09:37:10 +0000 (11:37 +0200)]
Improve scenarios to reduce duplicate codes

Change-Id: I71f79b9ac8314ac979d4b1009f662baa7c93a4fd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix hardcoded value 47/58947/1
Cédric Ollivier [Sun, 24 Jun 2018 08:44:12 +0000 (10:44 +0200)]
Fix hardcoded value

Change-Id: I070e1404a4b0dba4733f38e2de32e1fa77254ddc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDecrease the log level when connecting in singlevm 41/58941/1
Cédric Ollivier [Sat, 23 Jun 2018 05:35:27 +0000 (07:35 +0200)]
Decrease the log level when connecting in singlevm

https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/172/console

Change-Id: I0fd3bb833d306626c0eb6393fff3d0fca0579100
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix user/project create operations 39/58939/1
Cédric Ollivier [Sat, 23 Jun 2018 10:30:07 +0000 (12:30 +0200)]
Fix user/project create operations

os_client_config creates a singleton which forbids the previous
processing. It also cleans remaining resources and allows
publishing public images (needed by Tempest)

Change-Id: I3a0ad8664b263d3ee8599efe2973465006d5750b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate tempest to inherit from VmReady1 15/58915/6
Cédric Ollivier [Fri, 22 Jun 2018 12:35:53 +0000 (14:35 +0200)]
Update tempest to inherit from VmReady1

It also copies tempest.conf due to side effects raised by
Barbican plugins.

Change-Id: Ie87680f5d2e68527a5a61aac302838afc339dde8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPublish vmready scenarios 91/58891/3
Cédric Ollivier [Thu, 21 Jun 2018 20:47:45 +0000 (22:47 +0200)]
Publish vmready scenarios

It will simplify code in juju_epc, tempest, etc.

Change-Id: I195ae1d7d75f1c2f2eba76ae3c5307153e9b9759
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Update patches"
Cedric Ollivier [Thu, 21 Jun 2018 20:07:51 +0000 (20:07 +0000)]
Merge "Update patches"

6 years agoUpdate patches 87/58887/1
Cédric Ollivier [Thu, 21 Jun 2018 19:43:55 +0000 (21:43 +0200)]
Update patches

It patches specific values for singlevm1 and singlevm2 (arm64, ovs
and fdio).

Change-Id: Ibbd827b52520410bbbfa231eec23b08aeb511e0b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd the Barbican test suite 81/58881/2
Cédric Ollivier [Thu, 21 Jun 2018 16:11:09 +0000 (18:11 +0200)]
Add the Barbican test suite

It eases verifying the functionality of a barbican installation.

Change-Id: Iac2144ae6ba4d61b2b37bb5c7a0359edb3f222a6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoInstall third-party requirements again 77/58877/1
Cédric Ollivier [Thu, 21 Jun 2018 16:20:16 +0000 (18:20 +0200)]
Install third-party requirements again

Change-Id: Ic04969a56a4e35d5caf12a6a9bc0323bcf3a26d2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoIntegrate Shaker as a new testcase 01/58501/15
Cédric Ollivier [Wed, 13 Jun 2018 12:57:56 +0000 (14:57 +0200)]
Integrate Shaker as a new testcase

Shaker wraps around popular system network testing tools like iperf,
iperf3 and netperf (with help of flent).

Change-Id: Idd82ffd9642c90335ad156e899c0330473260f15
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPublish singlevm scenarios 59/58659/12
Cédric Ollivier [Mon, 18 Jun 2018 12:18:59 +0000 (14:18 +0200)]
Publish singlevm scenarios

They ease creating all ressources to execute command in a new VM
reachable via ssh. This scenarios should be reused by other
more advanced ones (shaker, vping, cinder, etc.).

Change-Id: If23866827c64a7afbdd8ff596dbc33710ee4ee20
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPublish tenantnetwork scenarios 55/58655/10
Cédric Ollivier [Mon, 18 Jun 2018 11:52:42 +0000 (13:52 +0200)]
Publish tenantnetwork scenarios

They ease creating all tenant network ressources.
These scenarios should be reused by other more complex ones.

Change-Id: I4ce1872065bde92408d34f2ca8823ce98275d8d5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Add functest in upper-constraints"
Cedric Ollivier [Tue, 19 Jun 2018 15:24:52 +0000 (15:24 +0000)]
Merge "Add functest in upper-constraints"

6 years agoAdd functest in upper-constraints 21/58721/2
Cédric Ollivier [Tue, 19 Jun 2018 12:36:46 +0000 (14:36 +0200)]
Add functest in upper-constraints

It's required by OPNFV Features such as sfc.
Functest is removed from constraints in Dockerfile else it would
conflict with the local dir.

Change-Id: I2df5cd151b43eb1a4f0320510183d0f28cdf84c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>