functest.git
6 years agoAvoid downloading git history 65/61665/9
Cédric Ollivier [Fri, 31 Aug 2018 13:58:14 +0000 (15:58 +0200)]
Avoid downloading git history

It decreases container build duration.
depth 1 is set only when TAG is not a commit id because
github.com doesn't advertise commit ids.

It switches to git.openstack.org as much as possible.

Change-Id: I3ad7a38eda0f7023302d71bb55de23828120f599
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoEnsure len(project_name) < 64 73/61573/1
Cédric Ollivier [Thu, 30 Aug 2018 05:47:48 +0000 (07:47 +0200)]
Ensure len(project_name) < 64

https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/259/console
https://build.opnfv.org/ci/view/functest/job/functest-fuel-baremetal-daily-master/428/console

Change-Id: Ib64878962a71b6b45ef039fce8bfaa43172b2498
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Create new project/user for tempest tests"
Cedric Ollivier [Wed, 29 Aug 2018 18:12:27 +0000 (18:12 +0000)]
Merge "Create new project/user for tempest tests"

6 years agoCreate new project/user for tempest tests 19/61519/1
Juha Kosonen [Wed, 29 Aug 2018 10:59:49 +0000 (13:59 +0300)]
Create new project/user for tempest tests

JIRA: FUNCTEST-1009

Change-Id: I6b9bca3827ba6cc804c25689a896ca63eec6a78b
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoMerge "Support pre-Provisioned credentials"
Cedric Ollivier [Wed, 29 Aug 2018 09:16:16 +0000 (09:16 +0000)]
Merge "Support pre-Provisioned credentials"

6 years agoSupport pre-Provisioned credentials 85/61485/1
Cédric Ollivier [Tue, 28 Aug 2018 21:49:16 +0000 (23:49 +0200)]
Support pre-Provisioned credentials

If USE_DYNAMIC_CREDENTIALS = False, Functest is expected for
/home/opnfv/functest/data/accounts.yaml which contains the set of
pre-existing credentials to use for testing [1].

It also sets admin_domain_scope and default_credentials_domain_name.

[1] https://docs.openstack.org/tempest/latest/configuration.html

Change-Id: Ie7b81f0c56049260ca99b8e3a6d58cb8a2660659
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Remove installer type from rally blacklist"
Cedric Ollivier [Tue, 28 Aug 2018 15:47:35 +0000 (15:47 +0000)]
Merge "Remove installer type from rally blacklist"

6 years agoMerge "Remove installer type from tempest blacklist"
Cedric Ollivier [Tue, 28 Aug 2018 15:47:30 +0000 (15:47 +0000)]
Merge "Remove installer type from tempest blacklist"

6 years agoMerge "Allow adding a specific role to users created by tempest"
Cedric Ollivier [Tue, 28 Aug 2018 14:59:04 +0000 (14:59 +0000)]
Merge "Allow adding a specific role to users created by tempest"

6 years agoAllow adding a specific role to users created by tempest 69/61469/2
Cédric Ollivier [Tue, 28 Aug 2018 12:52:03 +0000 (14:52 +0200)]
Allow adding a specific role to users created by tempest

It may allow bypassing RBAC policies if required.

Change-Id: I3b7ad44d7b80f8ea757846afdcd787b686c52856
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove installer type from tempest blacklist 67/61467/2
Juha Kosonen [Tue, 28 Aug 2018 12:32:22 +0000 (15:32 +0300)]
Remove installer type from tempest blacklist

Enables utilization of blacklist also on non-OPNFV environments since
there is no link to installer type.

JIRA: FUNCTEST-1008

Change-Id: I3a012b8b7e7dbd049f8794dff3c9d56dcc1cadad
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoMerge "Protect vs TypeErrors when cleaning stacks"
Cedric Ollivier [Tue, 28 Aug 2018 11:55:50 +0000 (11:55 +0000)]
Merge "Protect vs TypeErrors when cleaning stacks"

6 years agoRemove installer type from rally blacklist 63/61463/1
Juha Kosonen [Tue, 28 Aug 2018 11:49:24 +0000 (14:49 +0300)]
Remove installer type from rally blacklist

Enables utilization of blacklist also on non-OPNFV environments since
there is no link to installer type.

JIRA: FUNCTEST-1008

Change-Id: I3eb4377af153480794c1a71c5d7ef3e78dacacb9
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoProtect vs TypeErrors when cleaning stacks 57/61457/2
Cédric Ollivier [Tue, 28 Aug 2018 09:29:35 +0000 (11:29 +0200)]
Protect vs TypeErrors when cleaning stacks

It protects vs exceptions raised by shade when cleaning stacks.

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/vnf/ims/heat_ims.py", line 226, in clean
    self.cloud.delete_stack(self.stack.id, wait=True)
  File "/usr/lib/python2.7/site-packages/shade/openstackcloud.py", line 1416, in delete_stack
    marker=marker)
  File "/usr/lib/python2.7/site-packages/shade/_heat/event_utils.py", line 90, in poll_for_events
    stack_status = stack['stack_status']
TypeError: 'NoneType' object has no attribute '__getitem__'

Change-Id: I1a0ed0cd669d5234ca1ff3b6bbc9d1b13f14b02f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix snaps commit id 47/61447/1
Cédric Ollivier [Tue, 28 Aug 2018 07:39:55 +0000 (09:39 +0200)]
Fix snaps commit id

Snaps is part of main Functest testcases (Healthcheck).
A fixed version has to be pulled.

We will switch later to snaps packages instead of commit ids.

Change-Id: Ibbc3f1009233ccfb67463b49203b756ea86d3121
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSupport VIO (VMware in OpenStack) 31/61431/1
Cédric Ollivier [Mon, 27 Aug 2018 18:24:47 +0000 (20:24 +0200)]
Support VIO (VMware in OpenStack)

It allows converting all images to vmdk and then patching all
testcases. DEPLOY_SCENARIO should match vio to do so.

convert_images.sh has to be called as prerequisite.

JIRA: FUNCTEST-992
JIRA: FUNCTEST-993

Change-Id: Ie35bf80af1cd9610a8c416ec01b81b61c6148cfe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUse only one image in heat_ims 29/61429/1
Cédric Ollivier [Mon, 27 Aug 2018 18:23:23 +0000 (20:23 +0200)]
Use only one image in heat_ims

It calls VmReady2.run instead of publishing alt image.

Change-Id: If24741fbc5bf7fa3f61ef39a054b148ce53fc4fc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAvoid duplicating jjb names 95/61395/1
Cédric Ollivier [Sun, 26 Aug 2018 09:30:11 +0000 (11:30 +0200)]
Avoid duplicating jjb names

It allows loading functest and functest-kubernetes jjbs in one
Jenkins.

Change-Id: Ia52e84583bc25aad0d1508096b536cbd5585d261
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSet juju wait version 83/61383/2
Cédric Ollivier [Sat, 25 Aug 2018 09:58:42 +0000 (11:58 +0200)]
Set juju wait version

It's mandatory before releasing.

Change-Id: Iac7b49fb1061b39ee6683e7b30f163cfc2060a95
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSet Neutron and Barbican tempest plugins commit ids 81/61381/1
Cédric Ollivier [Sat, 25 Aug 2018 09:53:58 +0000 (11:53 +0200)]
Set Neutron and Barbican tempest plugins commit ids

They are mandatory before releasing.

Change-Id: I2980536e28d183343ff0a9520ca9ee663e437fee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove INSTALLER_TYPE logics in odl 79/61379/2
Cédric Ollivier [Sat, 25 Aug 2018 08:51:32 +0000 (10:51 +0200)]
Remove INSTALLER_TYPE logics in odl

JIRA: APEX-621
JIRA: COMPASS-606

Change-Id: I76dde66aefc67f80b40496f705f2864ea9355dcf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate pip to last version 77/61377/2
Cédric Ollivier [Sat, 25 Aug 2018 08:46:29 +0000 (10:46 +0200)]
Update pip to last version

It allows downloading refs (gerrit reviews).

Change-Id: I303f9b753f560fdf945997c7a86e1e29fbd59a06
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFully remove CreateInstanceSingleNetworkTests 75/61375/1
Cédric Ollivier [Sat, 25 Aug 2018 08:23:38 +0000 (10:23 +0200)]
Fully remove CreateInstanceSingleNetworkTests

It's linked to a specific configuration on purpose which doesn't meet
all OpenStack deployments [1].

JIRA: SNAPS-322

Change-Id: I372f8ed56600e1846383d1da76720a0d3783e901
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Auto Generated INFO.yaml file"
Cedric Ollivier [Sat, 25 Aug 2018 08:08:37 +0000 (08:08 +0000)]
Merge "Auto Generated INFO.yaml file"

6 years agoMerge "Integrate Stor4NFV feature openstack test case"
Cedric Ollivier [Sat, 25 Aug 2018 07:49:37 +0000 (07:49 +0000)]
Merge "Integrate Stor4NFV feature openstack test case"

6 years agoAuto Generated INFO.yaml file 63/51563/8
agardner [Fri, 2 Feb 2018 22:59:21 +0000 (17:59 -0500)]
Auto Generated INFO.yaml file

INFO.yaml meant to be machine readable.
This file was auto generated from an ldap lookup
and your projects INFO file.

Meeting times are not currently filled out.
please ammend this patchset to complete

Going forward comitter promotions should be done
against this file.

PTLs:
Must be merged for you to gain delete access on
testresults.opnfv.org

Change-Id: Icbe20cdc100c37203a305617fa931ef9e76e4e12
Signed-off-by: agardner <agardner@linuxfoundation.org>
6 years agoIntegrate Stor4NFV feature openstack test case 81/61281/3
Qiaowei Ren [Thu, 23 Aug 2018 06:03:52 +0000 (14:03 +0800)]
Integrate Stor4NFV feature openstack test case

Change-Id: I245d0fbe8f026a24138ede4041caae4dccc15cc0
Signed-off-by: Qiaowei Ren <qiaowei.ren@intel.com>
6 years agoMerge "Create new project/user for snaps tests"
valentin boucher [Fri, 24 Aug 2018 12:59:36 +0000 (12:59 +0000)]
Merge "Create new project/user for snaps tests"

6 years agoCreate new project/user for snaps tests 19/61319/2
Juha Kosonen [Fri, 24 Aug 2018 07:41:49 +0000 (10:41 +0300)]
Create new project/user for snaps tests

JIRA: FUNCTEST-1003

Change-Id: Ic55998977386f95f619a355d22bd285782fe81f0
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoCreate output directory 85/61285/2
Georg Kunz [Thu, 23 Aug 2018 11:56:42 +0000 (13:56 +0200)]
Create output directory

The rally.conf gets copied before the target directory has been created.

JIRA: FUNCTEST-1007
JIRA: DOVETAIL-730

Change-Id: Ie774fce994ada644c1163600e6c62e1231fde443
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
6 years agoExecute refstack_defcore in ci/run.yaml 61/61261/1
Cédric Ollivier [Wed, 22 Aug 2018 07:58:16 +0000 (09:58 +0200)]
Execute refstack_defcore in ci/run.yaml

Change-Id: Ib65203e74244d87f7ac6b24f6e6abf723c57a786
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoTemporarily disable shelve 19/61219/1
Cédric Ollivier [Tue, 21 Aug 2018 22:06:28 +0000 (00:06 +0200)]
Temporarily disable shelve

They are blocking in Orange Openlab as the support is missing.
A dynamic check has to be implemented before activating it.

Change-Id: I8d87251fa4589f96d3515e411aeec5e79b7e7960
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix fixed_network_name in tempest.conf 17/61217/1
Cédric Ollivier [Tue, 21 Aug 2018 21:31:56 +0000 (23:31 +0200)]
Fix fixed_network_name in tempest.conf

It also copies rally.conf and tempest.log in res_dir.

Change-Id: Ib907a29ba3f47ca861d3af8afc0ee74446222e89
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoci/download_images.sh: Reduce wget dot reporting 79/53479/2
Alexandru Avadanii [Sun, 11 Mar 2018 22:34:57 +0000 (23:34 +0100)]
ci/download_images.sh: Reduce wget dot reporting

Downloading large images outputs a lot of useless dots to show
progress. Switch to 1M per dot (from 1K).

Change-Id: I00e3d09ef28e7722798eeadc27649a96398aac32
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
6 years agoPublish Functest daily and gate jobs 95/61095/3
Cédric Ollivier [Sun, 19 Aug 2018 11:37:31 +0000 (13:37 +0200)]
Publish Functest daily and gate jobs

As opposed to the Releng ones, they are designed to be easily
executed by endusers as well. They can be considered as a first step
towards a full Functest CI/CD toolchain deployed via docker-compose.

All components testcases are enabled here.

They hugely leverage on templates to load the right yamls per branch
and multijobs to run testcases in parallel. Many steps are proposed
allowing running part of the chain.

Executors have to be increased to allow running them (it was tested
vs 10 and more).

At first, all docker images are downloaded to avoid different
versions between testcases.

They will be improved in a second change to ensure that only one node
is selected and to take all Functest env vars into account.

Change-Id: I99c7b8ee5d0ddbb00102b3147739b5e8b5c65c23
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd vgpu in global testcases.yaml 93/61093/1
Cédric Ollivier [Sun, 19 Aug 2018 11:02:50 +0000 (13:02 +0200)]
Add vgpu in global testcases.yaml

It completes the patch introducing vgpu [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/60713/

Change-Id: Ib2a22dd656d365e87a37a239f0a0ee747c95b117
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoTypos (ressources) 91/61091/1
Cédric Ollivier [Sun, 19 Aug 2018 10:43:11 +0000 (12:43 +0200)]
Typos (ressources)

Change-Id: Ifcf1d4bd48b64bc9175c3b0d594f897f4f3f5e7d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate Xtesting to 0.58.0 89/61089/1
Cédric Ollivier [Mon, 20 Aug 2018 04:16:57 +0000 (06:16 +0200)]
Update Xtesting to 0.58.0

It returns the right status if exception in constructor.

Change-Id: I163c0cbb2e1f07b2ada4a5ba28e217906946fa2c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSplit modules in apidoc 79/61079/1
Cédric Ollivier [Sat, 18 Aug 2018 16:02:54 +0000 (18:02 +0200)]
Split modules in apidoc

Change-Id: Iff2bd9377efb4e8abde35ef3fc38aca120feccaf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix rtd requirement order 75/61075/1
Cédric Ollivier [Sat, 18 Aug 2018 11:30:37 +0000 (13:30 +0200)]
Fix rtd requirement order

Change-Id: Ie2fbd978ed0bb9772d66eb367f1bdad32c5afd61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd rtd-requirements 71/61071/1
Cédric Ollivier [Sat, 18 Aug 2018 09:25:03 +0000 (11:25 +0200)]
Add rtd-requirements

It's required by rtd which doesn't leverage on PBR.

Change-Id: Ia7ac5ecbb626d5c8b4c9095a1238db55e20790b0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoGenerate API doc rst files 67/61067/1
Cédric Ollivier [Sat, 18 Aug 2018 06:56:58 +0000 (08:56 +0200)]
Generate API doc rst files

It also fixes few docstrings

Change-Id: I10bae7b7fab40edd931dd55ab8859946e3b38a71
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPublish Functest doc online 63/61063/1
Cédric Ollivier [Sat, 18 Aug 2018 06:09:53 +0000 (08:09 +0200)]
Publish Functest doc online

It reverts Sphinx theme to the default one as it's hugely better for
API docs.

Change-Id: Ic489e9b65d67d71fadb8ef78176a04cc382a3f5d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate refstack test version to 2018.02 53/55853/3
Linda Wang [Tue, 17 Apr 2018 03:54:26 +0000 (03:54 +0000)]
Update refstack test version to 2018.02

To conform with Openstack Queens

Change-Id: I7d65a1d7fe7c9a30e2c00a8a0eac2ab3fe1b9428
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoClean /etc/rally.conf 33/61033/1
Cédric Ollivier [Fri, 17 Aug 2018 09:22:14 +0000 (11:22 +0200)]
Clean /etc/rally.conf

Else rally_sanity may print logs in tempest_smoke res dir.

Change-Id: Iae97d533e9b99dcf8da70229b0675228472bfe52
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate restack defcore sync 19/61019/3
Cédric Ollivier [Thu, 16 Aug 2018 17:52:32 +0000 (19:52 +0200)]
Update restack defcore sync

It stops depending on refstack_client which cannot work till
OpenStack Queens.

JIRA: FUNCTEST-977

Change-Id: I2340643de82ab10d8fb83fb3a7fbfd1f412b2d7b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Allow overriding rally-tag if OpenStack master"
Cedric Ollivier [Wed, 15 Aug 2018 09:17:07 +0000 (09:17 +0000)]
Merge "Allow overriding rally-tag if OpenStack master"

6 years agoMerge "Create new project/user for rally test"
Cedric Ollivier [Wed, 15 Aug 2018 09:16:59 +0000 (09:16 +0000)]
Merge "Create new project/user for rally test"

6 years agoAllow overriding rally-tag if OpenStack master 63/60963/1
Cédric Ollivier [Tue, 14 Aug 2018 21:07:43 +0000 (23:07 +0200)]
Allow overriding rally-tag if OpenStack master

It allows setting a newer rally-openstack tag in ollivier containers
to include "Fix the gates about cinder" [1].

TypeError: create() got an unexpected keyword argument 'source_replica'

[1] https://github.com/openstack/rally-openstack/commit/67882d55ca453d6aa863d279ec4cfc2b52c80f0a
[2] https://bugs.launchpad.net/rally/+bug/1785519

Change-Id: I5ed1002f345b0a9c51783850d09d0f336d0ed3d9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate to Xtesting 0.57 49/60949/1
Cédric Ollivier [Tue, 14 Aug 2018 16:29:36 +0000 (18:29 +0200)]
Update to Xtesting 0.57

It protects vs unset POD_ARCH (It completes "Disable Vmtp if POD_ARCH
= aarch64" [1])

[1] https://gerrit.opnfv.org/gerrit/#/c/60927/

Change-Id: I343c7a9047fe09aad7b9a39d0d045ac709f07a7a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoCreate new project/user for rally test 35/60935/2
Juha Kosonen [Tue, 14 Aug 2018 13:00:58 +0000 (16:00 +0300)]
Create new project/user for rally test

FUNCTEST-1002

Change-Id: Id19b9aa70aeded6d99978084b3de4a63e31a81ad
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoRemove all lxd refs 47/60947/1
Cédric Ollivier [Tue, 14 Aug 2018 12:28:03 +0000 (14:28 +0200)]
Remove all lxd refs

All Joid runs are stopped, then these scenarios can't be maintained.

Change-Id: Ida7c8c86cbd377024047d4abbbc1806ad65afc8a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSet rally-openstack tag 31/60931/1
Cédric Ollivier [Tue, 14 Aug 2018 11:09:00 +0000 (13:09 +0200)]
Set rally-openstack tag

It also updates rally to the latest tag.
Then it will allow updating pip if required (to clone refs).

Change-Id: I6edb172954672780f627370b0dd0acf0754da635
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoConforms Vmtp with create_server_timeout 29/60929/1
Cédric Ollivier [Tue, 14 Aug 2018 10:57:44 +0000 (12:57 +0200)]
Conforms Vmtp with create_server_timeout

https://build.opnfv.org/ci/view/functest/job/functest-fuel-baremetal-daily-master/387/console

Change-Id: I3ef130bf5ad4b46f26776feeaa434ca528965f36
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDisable Vmtp if POD_ARCH = aarch64 27/60927/1
Cédric Ollivier [Tue, 14 Aug 2018 10:56:15 +0000 (12:56 +0200)]
Disable Vmtp if POD_ARCH = aarch64

Vmtp package delivers amd64 binaries in both architectures.

JIRA: ARMBAND-396

Change-Id: I4c6e010e47c8aa9adfafb373c261262d23ef382a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAllow setting two image extra properties per testcase 11/60911/1
Cédric Ollivier [Mon, 13 Aug 2018 19:59:22 +0000 (21:59 +0200)]
Allow setting two image extra properties per testcase

It conforms with the flavor extra specs model [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/60713/

Change-Id: I1555a313aaf56ae47f9ad2a4529eb8b94e636c00
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate all patch configs 91/60891/1
Cédric Ollivier [Mon, 13 Aug 2018 11:31:38 +0000 (13:31 +0200)]
Update all patch configs

It takes all new testcases into account.
It allows running vnfs vs dpdk scenarios too.

Change-Id: I789f6bb1c3df891b1a94f2a674c15085f81f2f23
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate to Xtesting 0.56 79/60879/1
Cédric Ollivier [Sun, 12 Aug 2018 10:35:37 +0000 (12:35 +0200)]
Update to Xtesting 0.56

Change-Id: Ia7eb5f6c7448bcd760ebb19e2ad66ba183242e83
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Test OpenStack vGPU feature"
Cedric Ollivier [Sat, 11 Aug 2018 08:53:15 +0000 (08:53 +0000)]
Merge "Test OpenStack vGPU feature"

6 years agoFix rally args when serial (tempest_scenario) 71/60871/1
Cédric Ollivier [Sat, 11 Aug 2018 08:32:16 +0000 (10:32 +0200)]
Fix rally args when serial (tempest_scenario)

Change-Id: I04c2389310d1377452a171da9bf50fde67e94e7c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoTest OpenStack vGPU feature 13/60713/7
Valentin Boucher [Tue, 7 Aug 2018 16:30:50 +0000 (12:30 -0400)]
Test OpenStack vGPU feature

XCI will be able to deploy this feature
on top of pharos lab with GPU so we have test it

This test can be improved in the future with OpenCL tests etc

|        DEPLOY_SCENARIO        |       os-nosdn-vgpu-ha     |

+-------------------+-------------------+------------------+----------------+
|     TEST CASE     |      PROJECT      |     DURATION     |     RESULT     |
+-------------------+-------------------+------------------+----------------+
|        vgpu       |      functest     |      01:00       |      PASS      |
+-------------------+-------------------+------------------+----------------+

Change-Id: I50618f47097a0257b1834b3966054d20458715df
Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
6 years agoMerge "Publish rally logs to ease debugging."
Cedric Ollivier [Fri, 10 Aug 2018 16:50:17 +0000 (16:50 +0000)]
Merge "Publish rally logs to ease debugging."

6 years agoMerge "Remove explicit Rally task validation"
Cedric Ollivier [Fri, 10 Aug 2018 16:22:52 +0000 (16:22 +0000)]
Merge "Remove explicit Rally task validation"

6 years agoPublish rally logs to ease debugging. 91/60791/2
Cédric Ollivier [Thu, 9 Aug 2018 14:22:12 +0000 (16:22 +0200)]
Publish rally logs to ease debugging.

It also redirect stderr to stdout as tempest mainly prints in stderr.

JIRA: FUNCTEST-999

Change-Id: I64bfa31b01aa2ce5444b6e0f0ac46f8cde8dbaa3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove explicit Rally task validation 51/60851/1
Juha Kosonen [Fri, 10 Aug 2018 13:43:24 +0000 (16:43 +0300)]
Remove explicit Rally task validation

Utilize the output of Rally task execution since it internally
validates the task.

Use Popen.communicate to get the output from the running Rally task.

Change-Id: I9b1299bc26129ff4f89adccec611c78195a3ab02
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoSwitch to vmtp commit id 29/60829/1
Cédric Ollivier [Fri, 10 Aug 2018 10:09:23 +0000 (12:09 +0200)]
Switch to vmtp commit id

The patch "Reuse the router passed as config if available" [1] was
merged.

[1] https://review.openstack.org/#/c/588459/

Change-Id: Iad8a1ff694f0bff3e13922a6c248dbe49b313a11
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Fix method name in Vmtp"
Cedric Ollivier [Thu, 9 Aug 2018 15:59:05 +0000 (15:59 +0000)]
Merge "Fix method name in Vmtp"

6 years agoFix method name in Vmtp 79/60779/1
Juha Kosonen [Thu, 9 Aug 2018 12:53:31 +0000 (15:53 +0300)]
Fix method name in Vmtp

Change-Id: Ie23628f39979e3497c81e23d99f30e0dc7564055
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoAdd networking-sfc Tempest test suite 73/60773/1
Cédric Ollivier [Thu, 9 Aug 2018 11:34:19 +0000 (13:34 +0200)]
Add networking-sfc Tempest test suite

Change-Id: I6f1452469cb5ffaf9b538ba87edaa174977b91c4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd networking-bgpvpn Tempest test suite 71/60771/1
Cédric Ollivier [Thu, 9 Aug 2018 11:27:36 +0000 (13:27 +0200)]
Add networking-bgpvpn Tempest test suite

Change-Id: If3191d8e8c16854aa059e6483b3c0ea704777c05
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd timeout when running shaker 55/60755/1
Cédric Ollivier [Wed, 8 Aug 2018 23:11:22 +0000 (01:11 +0200)]
Add timeout when running shaker

Else shaker may run until job timeout if deployment misconfigurations [1]

[1] https://jira.opnfv.org/browse/FUNCTEST-998

JIRA: FUNCTEST-998

Change-Id: I948ff8ffeeccdab637927614193d2c2ef03fe5c8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoInstall Tempest master if OpenStack master 53/60753/1
Cédric Ollivier [Wed, 8 Aug 2018 22:44:56 +0000 (00:44 +0200)]
Install Tempest master if OpenStack master

It seems that gates override the upper-constraints in case of Tempest
[1][2].

[1] http://logs.openstack.org/80/585180/3/check/tempest-full/aa8b698/controller/logs/pip2-freeze.txt.gz
[2] http://artifacts.opnfv.org/logs/functest/lf-virtual3/2018-08-08_16-26-16/tempest_smoke/tempest-report.html

JIRA: FUNCTEST-1000

Change-Id: I48530083b453a4a6d6027763210259050b4d0040
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoConform with OpenStack gates 49/60749/1
Cédric Ollivier [Wed, 8 Aug 2018 21:21:00 +0000 (23:21 +0200)]
Conform with OpenStack gates

It adds testcases and updates regexes to conform with OpenStack gates:
  - tempest-full
  - neutron-tempest-plugin-api

It should be noted that tempest-smoke is no longer run in gates and
two testcases are available for tempest-full as we can't manage
Tempest combine.

Criteria is set to 100% for tempest_full (it works in OpenStack
gates).

JIRA: FUNCTEST-1000

Change-Id: I77a0f533255483bdf61f0a5f60c9c437ce843591
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix swift operator role 91/60691/2
Cédric Ollivier [Tue, 7 Aug 2018 10:06:41 +0000 (12:06 +0200)]
Fix swift operator role

[1] https://build.opnfv.org/ci/view/functest/job/functest-fuel-armband-baremetal-daily-master/35/console

Change-Id: I7236bf5a74f36941f499da32c5c77dcd0b98b6f1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate Xtesting to 0.55.0 81/60681/2
Cédric Ollivier [Tue, 7 Aug 2018 03:54:51 +0000 (05:54 +0200)]
Update Xtesting to 0.55.0

It allows calling one skipped test via run_tests (parallel testing).

Change-Id: I04e5c69f2129e28f1451815938cd5d0f8bbe9e44
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoChange juju_epc cidr 97/60597/1
Cédric Ollivier [Mon, 6 Aug 2018 09:46:52 +0000 (11:46 +0200)]
Change juju_epc cidr

juju cannot bootstrap if cidr already exists which now happens only
if a shared network with the same cidr is defined (it should be
considered as a bug about juju).

By allocation its own cidr, it protects vs remaining rally or tempest
remaining shared networks or vs parallel testing.

juju_epc can already run twice in parallel as it creates a new
project and a private network.

Change-Id: I76c4971d631f763307315478e6cf5a383c91ed36
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMake synchronous Shade calls 77/60577/1
Cédric Ollivier [Sat, 4 Aug 2018 13:10:27 +0000 (15:10 +0200)]
Make synchronous Shade calls

It makes difficult to find the issues (floating ip, boot, ssh
connection, etc...) for a small benefit regarding the current
testcase implementations.

It increases the default floating ip timeout because it has been
reached when running Functest multiple times in parallel. It may
be the root cause when running singlevm vs XCI (in that case,
neutron api and agents are hosted in a nested vm).

Change-Id: Ia97e04902321644c207c59987283754318aee5e5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSetup tempest_smoke images for arm64 61/60561/3
Delia Popescu [Fri, 3 Aug 2018 11:33:37 +0000 (14:33 +0300)]
Setup tempest_smoke images for arm64

Configure the images to be used for tempest_smoke
testcase for ARM

JIRA: ARMBAND-395

Change-Id: Ia13507d70fd05ef541a5154886d52fa388731cee
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoMerge "Fix timeout (switch to synchronous calls)"
Cedric Ollivier [Fri, 3 Aug 2018 10:38:54 +0000 (10:38 +0000)]
Merge "Fix timeout (switch to synchronous calls)"

6 years agoProtect VMTP vs cidr conflicts 41/60441/5
Cédric Ollivier [Tue, 31 Jul 2018 14:04:36 +0000 (16:04 +0200)]
Protect VMTP vs cidr conflicts

It now runs vtmp via a new admin member. Else it fails due to cidr
already used.

It only creates a router and both tenant networks are still created
by VMTP.

Change-Id: I05ed41a3b7a01ee97c720176c404929bf8ea97a0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix timeout (switch to synchronous calls) 55/60555/1
Cédric Ollivier [Fri, 3 Aug 2018 10:00:15 +0000 (12:00 +0200)]
Fix timeout (switch to synchronous calls)

It completes "Switch create_server timeout to default value" [1]
which forbids waiting more that 180s (create_server was asynchronous).

[1] https://gerrit.opnfv.org/gerrit/#/c/60423/2

Change-Id: Icbf9ee48024fe9e10571c2bb7ca895d5828fb561
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix typo (ressources) 53/60553/1
Cédric Ollivier [Fri, 3 Aug 2018 08:31:09 +0000 (10:31 +0200)]
Fix typo (ressources)

Change-Id: Ibe131e0cf02493f0f3a82c1e179848605bd0a292
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Fix parse error in tempest_smoke"
Cedric Ollivier [Fri, 3 Aug 2018 05:58:55 +0000 (05:58 +0000)]
Merge "Fix parse error in tempest_smoke"

6 years agoIncrease Cloudify create_server_timeout 45/60545/1
Cédric Ollivier [Fri, 3 Aug 2018 04:19:22 +0000 (06:19 +0200)]
Increase Cloudify create_server_timeout

The timeout has been reached when running multiple vnfs in parallel.
Only few additional seconds seemed required here.

Change-Id: I0d6e38e827c581edb617bb0cc13249645468a2aa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix parse error in tempest_smoke 19/60519/2
Delia Popescu [Thu, 2 Aug 2018 12:50:41 +0000 (15:50 +0300)]
Fix parse error in tempest_smoke

Test failes to parse /etc/rally/rally.conf
(RALLY_CONF_FILE) whith inplace=1 keyword argument
for fileinput
One new space is added in second line

JIRA: ARMBAND-395

Change-Id: I8adb333047f9962f4105a6a74e2f8ef83d5745e0
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoUpgrade Shaker create_server timeout 05/60505/1
Cédric Ollivier [Thu, 2 Aug 2018 08:26:40 +0000 (10:26 +0200)]
Upgrade Shaker create_server timeout

It ends after a little bit more than 3 minutes in Apex [1].
It increases to 5 minutes like Cloudify.

[1] http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-07-30_11-30-01/functest.log

Change-Id: I8362034107e694ddd5a1e4a1f9e11362100d7cb0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove hw_video_model and hw_firmware_type from metadata 81/60481/1
Delia Popescu [Wed, 1 Aug 2018 13:52:33 +0000 (16:52 +0300)]
Remove hw_video_model and hw_firmware_type from metadata

Starting with the Openstack Queens release,
hw_firmware_type=uefi is implied on AArch64 by default
Using virtio-video, now default in nova, should be used
instead of VGA

JIRA: ARMBAND-388

Change-Id: I393093c5a1a9dd9c8259b3987db22650313cf249
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoAdd fallback mechanism if vlan 31/60431/1
Cédric Ollivier [Tue, 31 Jul 2018 11:01:14 +0000 (13:01 +0200)]
Add fallback mechanism if vlan

private_v4 and public_v4 are incorrectly set when vlan is used as
overlay.

JIRA: FUNCTEST-996

Change-Id: I120a247e92e0fd295769b2a0eeb15ce82a0eabc8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPrint stderr in logs when calling cmd over ssh 29/60429/2
Cédric Ollivier [Tue, 31 Jul 2018 10:25:40 +0000 (12:25 +0200)]
Print stderr in logs when calling cmd over ssh

Change-Id: I152ac898661a0e99a6232df86689c70c468ceaa5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSwitch create_server timeout to default value 23/60423/2
Cédric Ollivier [Tue, 31 Jul 2018 09:01:34 +0000 (11:01 +0200)]
Switch create_server timeout to default value

60s was successfully reached when running all containers (3
containers * 3 branches) in parallel.

It also removes the wait attribute (the current impl will meet
a possible next asynchronous design) which is useless here.

For the time being, only cloudify needs an extra timeout.

Change-Id: Ic7741b4c1a3223be076fb69ef70a3cb6c05456c2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate Xtesting to 0.54.0 79/60379/1
Cédric Ollivier [Mon, 30 Jul 2018 14:25:04 +0000 (16:25 +0200)]
Update Xtesting to 0.54.0

It protects vs uncaught exceptions and then avoids skipping testcases
in that case (see cloudify_ims and juju_epc in [1]).

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console

Change-Id: I8e39f7e742b9fec2e6f6bab542d5f497159f50ac
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDelete alt images before removing the account 63/60363/3
Cédric Ollivier [Mon, 30 Jul 2018 13:50:44 +0000 (15:50 +0200)]
Delete alt images before removing the account

Else it could raise unauthorized exceptions [1].

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console

Change-Id: Ia9b857069f775e2c8ecc5e07cf39b3a1fb7e3540
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoProtect vs exceptions when creating secrets 59/60359/1
Cédric Ollivier [Mon, 30 Jul 2018 13:03:42 +0000 (15:03 +0200)]
Protect vs exceptions when creating secrets

cloudify_ims sometimes faces with exceptions when creating secrets
[1].

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console

Change-Id: I197748bf97752575dc14650e1e1c382774811cce
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix clearwater test results parsing 41/60341/1
Cédric Ollivier [Mon, 30 Jul 2018 10:45:26 +0000 (12:45 +0200)]
Fix clearwater test results parsing

Before it could extract part of the skipped tests [1].

[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/209/console

Change-Id: I7e7564cb7b96705940051fccf0ff1987f34bb962
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAllow backporting a pylint error 29/60329/1
Cédric Ollivier [Mon, 30 Jul 2018 00:20:10 +0000 (02:20 +0200)]
Allow backporting a pylint error

Change-Id: I2df0964d63c80abbc5c5cc438e1fdd32f24fd52f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix clean() in cloudify ims and router 27/60327/1
Cédric Ollivier [Mon, 30 Jul 2018 00:13:30 +0000 (02:13 +0200)]
Fix clean() in cloudify ims and router

It raised exceptions in both branches [1]

[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/209/console

Change-Id: I87b33cedae768f92296efa4570d2a47cd9cdbdf2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRelease floating ips used by juju_epc 19/60319/2
Cédric Ollivier [Sun, 29 Jul 2018 19:48:18 +0000 (21:48 +0200)]
Release floating ips used by juju_epc

It also cleans flavor_alt and image_alt.

Change-Id: I62296075eca75c3c18caac4a3cddeef1fdb26e1b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove VnfOnBoarding 17/60317/2
Cédric Ollivier [Sun, 29 Jul 2018 19:40:20 +0000 (21:40 +0200)]
Remove VnfOnBoarding

All the vnfs are now inherating from scenarios.

Change-Id: I63509102067676ca0676b773db542086caa02d84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate juju_epc to leverage on new scenarios 19/60119/3
Cédric Ollivier [Mon, 23 Jul 2018 13:00:14 +0000 (15:00 +0200)]
Update juju_epc to leverage on new scenarios

It avoids duplicating codes across all OPNFV testcases.

It also fixes the issues when starting mongodb [1] by upgrading juju agent.
It stops supporting keystone v2 as the other testcases.

[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/lastFailedBuild/console

Change-Id: I06cddddef1121292ffb695dcb73aa79a07c23192
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoLeverage vyos_vrouter on Cloudify 91/59891/9
Cédric Ollivier [Tue, 17 Jul 2018 16:00:37 +0000 (18:00 +0200)]
Leverage vyos_vrouter on Cloudify

It also stop rebooting the VMs.

Change-Id: Ib0f9e1aac1dd8505378b0688930eb41a590a11f1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>