functest.git
6 years agoSimplify logging 89/57889/3
Panagiotis Karalis [Fri, 25 May 2018 09:22:47 +0000 (12:22 +0300)]
Simplify logging

In order to collect logs from features running through
functest framework (mainly for troubleshooting purposes),
the logging mechanism has been updated accordingly.

It should be noted that feature logs are printed in functest.log.
All logs are now printed in functest.log whatever the namespace.

JIRA: SFC-125

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I6cb32e5553749023d490d553ae4653750c52e844
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPrint vping output instead of Paramiko object 87/57987/1
Cédric Ollivier [Mon, 28 May 2018 07:04:12 +0000 (09:04 +0200)]
Print vping output instead of Paramiko object

Change-Id: Iddc1abdf443e482e8748434a4ba7d85709d8cd0e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Stop rolling snaps (bypass bugfixes)"
Cedric Ollivier [Sun, 27 May 2018 08:23:09 +0000 (08:23 +0000)]
Merge "Stop rolling snaps (bypass bugfixes)"

6 years agoStop rolling snaps (bypass bugfixes) 69/57969/1
Cédric Ollivier [Sun, 27 May 2018 07:58:58 +0000 (09:58 +0200)]
Stop rolling snaps (bypass bugfixes)

Snaps now requires admin role for creating routers [1].

[1] https://git.opnfv.org/snaps/commit/?id=5a81c2abb920cfe5ea975c37b390838d586a98b1

Change-Id: Ia9a5225e0e31fa3e1c50abb3814e12c98d53e76c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Add cinder_test testcase"
Cedric Ollivier [Sat, 26 May 2018 19:56:26 +0000 (19:56 +0000)]
Merge "Add cinder_test testcase"

6 years agoAdd cinder_test testcase 57/57257/16
Delia Popescu [Thu, 10 May 2018 09:13:08 +0000 (12:13 +0300)]
Add cinder_test testcase

Create 2 instances with Floating IPs
Attach data volume to instance 1
Write data on the volume
Detach volume from instance 1
Attach volume to instance 2
Read data from volume

JIRA: FUNCTEST-908

Change-Id: I10efdfb3b7f9d7e6ab5c6a538052437585d52fb0
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoSet image metadata in tempest 17/57817/2
Cédric Ollivier [Thu, 24 May 2018 13:13:26 +0000 (15:13 +0200)]
Set image metadata in tempest

It applied the same operations as [1].
Only one config is used between rally, tempest and vping.

[1] https://gerrit.opnfv.org/gerrit/#/c/57613/

Change-Id: I4d5fd2117d404b7eaa79326e21a35272232d0b92
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoBypass Cloudify tenancy issues 77/57677/3
Cédric Ollivier [Tue, 22 May 2018 12:39:32 +0000 (14:39 +0200)]
Bypass Cloudify tenancy issues

It creates a second user to bypass possible bugs and correctly
exits on failure if it cannot connect to manager via ssh.

It leverages on the _member_ user as much as possible.
It also switches all flavor names to avoid conflicts.

It also increases debug logs.

Change-Id: I59cb071248b5ae50952b9f16eb29f7be3f3644ae
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoLeverage on _member_ user 49/57749/1
Cédric Ollivier [Wed, 23 May 2018 11:45:30 +0000 (13:45 +0200)]
Leverage on _member_ user

It leverages on the _member_ user as much as possible.
It also switches all flavor names to avoid conflicts.

It also increases debug logs.

Change-Id: Ica595b0aba81e845ddb1c858fd5d0deb69872319
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Refactor task results manipulation in rally"
Cedric Ollivier [Sun, 20 May 2018 21:42:19 +0000 (21:42 +0000)]
Merge "Refactor task results manipulation in rally"

6 years agoRefactor task results manipulation in rally 65/57465/2
Juha Kosonen [Wed, 16 May 2018 11:18:41 +0000 (14:18 +0300)]
Refactor task results manipulation in rally

Use data provided by report generation since the output of task
results is not available as valid JSON if task didn't finish
gracefully.

JIRA: FUNCTEST-966

Change-Id: Ieb906bc209cc26055babd5f4e6b2bb556724f9a8
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoMerge "Fix UserConfig objects"
Cedric Ollivier [Wed, 16 May 2018 13:59:19 +0000 (13:59 +0000)]
Merge "Fix UserConfig objects"

6 years agoFix UserConfig objects 45/57445/2
Cédric Ollivier [Wed, 16 May 2018 08:48:08 +0000 (10:48 +0200)]
Fix UserConfig objects

UserConfig is expecting domain_name as arg instead of domain.
Else all vnfs cannot work against non Default domains.

Change-Id: I4bb53df9d9c03524b19ec32f8d346d94ba78d188
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Updated documentation for juju_epc tests"
Cedric Ollivier [Wed, 16 May 2018 07:13:58 +0000 (07:13 +0000)]
Merge "Updated documentation for juju_epc tests"

6 years agoUpdated documentation for juju_epc tests 71/57371/2
soumaya [Mon, 14 May 2018 16:35:46 +0000 (22:05 +0530)]
Updated documentation for juju_epc tests

Change-Id: If9399b7b385cb2660e76fcd42776c0dfcb4f7677
Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
6 years agoFine-tuning the juju-epc codebase for better error-handling 19/57319/4
soumaya [Fri, 11 May 2018 11:44:14 +0000 (17:14 +0530)]
Fine-tuning the juju-epc codebase for better error-handling

The changes are mostly basic/cosmetic in nature.
 - Add some additional info in loggers.
 - Remove timeout from few commands(such as juju deploy)
 - Add exception logging for few commands(such as juju bootstrap).
 - Change rsync to cp for feature file transfer within ABot.

Change-Id: Ibeaae17f1c25d04b7830ed42719b70e6c99228cf
Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
6 years agoMerge "Update ODL testcase to OpenStack Shade"
Cedric Ollivier [Mon, 14 May 2018 14:16:30 +0000 (14:16 +0000)]
Merge "Update ODL testcase to OpenStack Shade"

6 years agoUpdate cirros image version for ARM architecture 51/57351/2
Delia Popescu [Mon, 14 May 2018 09:03:34 +0000 (12:03 +0300)]
Update cirros image version for ARM architecture

Change-Id: Ia7a65a4f83798cb80ca7470d475c2c2d8c9fb6ea
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoUpdate ODL testcase to OpenStack Shade 41/57341/1
Cédric Ollivier [Sat, 12 May 2018 14:10:10 +0000 (16:10 +0200)]
Update ODL testcase to OpenStack Shade

Change-Id: I7832b5ed274e181449f9db9fb03a2d27038520ae
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoLeverage on local descriptor 35/57335/1
Cédric Ollivier [Fri, 11 May 2018 17:15:18 +0000 (19:15 +0200)]
Leverage on local descriptor

It simply seems dummy.

Change-Id: Ifb83dd0310f523f211911a35e7b481f9da6f9704
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoInstall Cloudify descritors in functest-vnf 21/57321/1
Cédric Ollivier [Fri, 11 May 2018 12:22:12 +0000 (14:22 +0200)]
Install Cloudify descritors in functest-vnf

It completes [1] to fix gates [2] and stops getting thirdparty vnf
master (dependencies).

It also prints data to ease debugging.

[1] https://github.com/Orange-OpenSource/opnfv-cloudify-clearwater/commit/abd39d772c77317a25745feaaf312165e7588346
[2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/110/console

Change-Id: Ib317a491e54820f4edb01fcecfca9d2a08b40c0f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd image extra properties back in vping_base 17/57217/4
Delia Popescu [Wed, 9 May 2018 12:31:22 +0000 (15:31 +0300)]
Add image extra properties back in vping_base

Image extra properties are missing for ARM
Set image_url for ARM
JIRA: ARMBAND-383

Change-Id: I0e2730c3f22214ad61d72424ea76173f1783d0ca
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoMerge "Switch to project domain name"
Cedric Ollivier [Mon, 7 May 2018 16:43:20 +0000 (16:43 +0000)]
Merge "Switch to project domain name"

6 years agoMerge "Improve ssh timeout in vping_ssh"
Cedric Ollivier [Mon, 7 May 2018 16:42:51 +0000 (16:42 +0000)]
Merge "Improve ssh timeout in vping_ssh"

6 years agoSwitch to project domain name 23/57123/1
Cédric Ollivier [Mon, 7 May 2018 14:32:37 +0000 (16:32 +0200)]
Switch to project domain name

At least Fuel, Apex and Joid don't export OS_PROJECT_DOMAIN_ID.
https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/353/console

Change-Id: I8441d2de1841d5a9ce78c6929fd78da01c45548c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Make volumes appear as SCSI devices in aarch64"
Cedric Ollivier [Mon, 7 May 2018 14:05:23 +0000 (14:05 +0000)]
Merge "Make volumes appear as SCSI devices in aarch64"

6 years agoImprove ssh timeout in vping_ssh 13/57113/1
Cédric Ollivier [Mon, 7 May 2018 14:02:00 +0000 (16:02 +0200)]
Improve ssh timeout in vping_ssh

It seems that 10s is not enough for Fuel.

Change-Id: I46d3d2c9091946befb0e056a8c8cc56c59087471
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSimplify vping_ssh 97/57097/2
Cédric Ollivier [Sun, 6 May 2018 22:57:23 +0000 (00:57 +0200)]
Simplify vping_ssh

It directly calls ping from the ssh socket.
It fixes a possible missing security rule.

It stops blocking if vpings are in failure.

Change-Id: I64092a155bb134fa8b7d31d0d13f695e019540d1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Functest fail to parse refstack results"
Cedric Ollivier [Sat, 5 May 2018 18:06:18 +0000 (18:06 +0000)]
Merge "Functest fail to parse refstack results"

6 years agoSwitch to Shade in rally 63/57063/2
Juha Kosonen [Fri, 4 May 2018 13:30:44 +0000 (16:30 +0300)]
Switch to Shade in rally

Use Shade for managing OpenStack resources in rally.

Change-Id: Ic8b7aaef6886f6ca4930b2ea463317b75ed8d3c9
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoImplement get_external_network via shade 87/57087/2
Cédric Ollivier [Sat, 5 May 2018 17:07:42 +0000 (19:07 +0200)]
Implement get_external_network via shade

It fixes the current issues as EXTERNAL_NETWORK is mainly unset by
all Installers [1].

[1] https://build.opnfv.org/ci/view/functest/job/functest-fuel-armband-baremetal-arm-daily-fraser/31/console

Change-Id: I8ee62623701c15b9ff962d0a0e07a77934ff03ac
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFunctest fail to parse refstack results 49/57049/1
xudan [Fri, 4 May 2018 08:40:06 +0000 (04:40 -0400)]
Functest fail to parse refstack results

1. The regular expression can't work well for refstack results
2. Refer to http://testresults.opnfv.org/test/api/v1/results?project=functest&case_name=refstack_defcore&last=1
3. There are 88 success test cases but the list of success is empty
4. Refstack test case name is not always begin with {0}, it maybe any number
5. The test case whose name has the keyword 'fail' will also be list in 'failures'

Change-Id: I5187aaaabdca762256be9162cc85ba42263169bc
Signed-off-by: xudan <xudan16@huawei.com>
6 years agoMake volumes appear as SCSI devices in aarch64 69/56769/2
Charalampos Kominos [Fri, 27 Apr 2018 09:19:56 +0000 (11:19 +0200)]
Make volumes appear as SCSI devices in aarch64

Adding volumes in openstack by default uses virtio_blk and the
devices appear as /dev/vdX. In aarch64 however a qemu pci slot
is already in use so the tests cannot assign more than one volume
to a VM. Forcing the drives to use virtio-scsi solves the issue
and allows more volumes to be attached as /dev/sdX. The variable
defining the drive is VOLUME_DEVICE_NAME and is passed as
environmental variable when the container is created.

JIRA: ARMBAND-376

Change-Id: Ia688cff338ff319e22a3b26796fa197297c23ce0
Signed-off-by: Charalampos Kominos <Charalampos.Kominos@enea.com>
6 years agoRewrite TempestResourcesManager 83/56883/3
Cédric Ollivier [Sun, 29 Apr 2018 13:56:33 +0000 (15:56 +0200)]
Rewrite TempestResourcesManager

It now leverages on OpenStack Shade to allow gating OpenStack master
as asked by TSC. Switching to OpenStack master (OpenStack SDK Rocky)
requires to change only one line.

It stops dedicating the network to the user possibly created because
the support is incomplete (the users have to be registed in
tempest.conf and the multiprocessing has to be enforced).

It also writes the second image and the second flavor in tempest.conf.

Change-Id: I9fe2c90a6073ebc240e9aa8fdf2ef93d5dd5f15f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRewrite vping_ssh and vping_userdata 73/56873/3
Cédric Ollivier [Sat, 28 Apr 2018 22:28:39 +0000 (00:28 +0200)]
Rewrite vping_ssh and vping_userdata

They now leverage on shade to allow gating OpenStack master as asked
by TSC. Switching to OpenStack master (openstacksdk) requires to
change only one line.

It deletes the related unit tests as they have to be fully rewritten.
They will be added in another change.

Change-Id: I0c60681d6e1c0944960770429ef972947dd85321
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSet image_url as filename 71/56871/1
Cédric Ollivier [Fri, 27 Apr 2018 11:39:21 +0000 (13:39 +0200)]
Set image_url as filename

It will be reused as soon as vping switches to openstacksdk.

Change-Id: Ib84f4b35b22ead1741579ec9140d3626f9102469
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Add debug logs in cloudify_ims"
valentin boucher [Tue, 24 Apr 2018 13:53:15 +0000 (13:53 +0000)]
Merge "Add debug logs in cloudify_ims"

6 years agoMerge "Switch from deploy utils to the right objects"
Cedric Ollivier [Tue, 24 Apr 2018 12:05:02 +0000 (12:05 +0000)]
Merge "Switch from deploy utils to the right objects"

6 years agoMerge "Add Rally GnocchiResource scenarios"
Juha Kosonen [Tue, 24 Apr 2018 08:34:32 +0000 (08:34 +0000)]
Merge "Add Rally GnocchiResource scenarios"

6 years agoAdd Rally GnocchiResource scenarios 23/56323/1
Juha Kosonen [Tue, 24 Apr 2018 07:15:14 +0000 (10:15 +0300)]
Add Rally GnocchiResource scenarios

New scenarios:

GnocchiResource.create_resource (rally_full)
GnocchiResource.create_delete_resource (rally_sanity, rally_full)

Change-Id: Ica03bdd60224d97ef0ec0d45c2cd25c295723ffc
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoCheck shell scripts via bashate 97/56297/1
Cédric Ollivier [Mon, 23 Apr 2018 21:24:26 +0000 (23:24 +0200)]
Check shell scripts via bashate

It also removes functest/cli/functest-complete.sh.

Change-Id: I5d9313be6a155b4adf1b82ce2b111ec06823cd8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSwitch from deploy utils to the right objects 83/56183/4
Cédric Ollivier [Sat, 21 Apr 2018 10:52:29 +0000 (12:52 +0200)]
Switch from deploy utils to the right objects

It also prints the full exceptions and removes useless casts.

Change-Id: I19ff1ae90670833f998c0d17592da82207235229
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd debug logs in cloudify_ims 85/56285/1
Cédric Ollivier [Mon, 23 Apr 2018 17:28:10 +0000 (19:28 +0200)]
Add debug logs in cloudify_ims

Change-Id: I47c6d598ce52f292bf2abdd2e9ecbadff6250712
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Update graphs in userguide"
Cedric Ollivier [Mon, 23 Apr 2018 11:44:08 +0000 (11:44 +0000)]
Merge "Update graphs in userguide"

6 years agoMerge "Fix tier/testcases list"
Juha Kosonen [Mon, 23 Apr 2018 08:53:07 +0000 (08:53 +0000)]
Merge "Fix tier/testcases list"

6 years agoBypass NoneType errors when creating router in rally 95/56195/1
Cédric Ollivier [Sat, 21 Apr 2018 22:24:52 +0000 (00:24 +0200)]
Bypass NoneType errors when creating router in rally

It converts private subnet name to str as it's mandary till [1].
It could be reverted as soon as [2] is merged in snaps.

[1] https://gerrit.opnfv.org/gerrit/#/c/56091/
[2] https://gerrit.opnfv.org/gerrit/#/c/56171/

Change-Id: Ia728415207f8ecb5b5ac55982f82337c45671c4c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoBypass NoneType errors when creating router 89/56189/1
Cédric Ollivier [Sat, 21 Apr 2018 14:18:17 +0000 (16:18 +0200)]
Bypass NoneType errors when creating router

It converts private subnet name to str as it's mandary till [1].
It could be reverted as soon as [2] is merged in snaps.

[1] https://gerrit.opnfv.org/gerrit/#/c/56091/
[2] https://gerrit.opnfv.org/gerrit/#/c/56171/

Change-Id: I849944fa9d4d2be21fe1a37b76c4cfd231b6d56f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd timeouts in juju_epc 81/56181/1
Cédric Ollivier [Sat, 21 Apr 2018 10:46:38 +0000 (12:46 +0200)]
Add timeouts in juju_epc

juju_epc still hangs if OpenStack isn't well deployed [1].
As releng doesn't publish logs if the job is aborted, timeout has to
be added mostly everywhere.

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/31/console

Change-Id: I0296cd811bda0234aab98f184b3ab247a5b32017
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate graphs in userguide 75/56175/3
Linda Wang [Sat, 21 Apr 2018 07:45:54 +0000 (07:45 +0000)]
Update graphs in userguide

1. Functest structural concept
2. Clearwater architecture

Change-Id: I88e39d6d08f1eb28a389d2b8a7a1669295f6aa49
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoFix tier/testcases list 73/56173/2
Linda Wang [Sat, 21 Apr 2018 02:34:36 +0000 (02:34 +0000)]
Fix tier/testcases list

Change-Id: I15da2df4905efbca4415739fd7c6391b51168c82
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoMerge "Update version in setup.cfg (Gambia)"
Cedric Ollivier [Fri, 20 Apr 2018 14:11:56 +0000 (14:11 +0000)]
Merge "Update version in setup.cfg (Gambia)"

6 years agoMerge "Last Release updates before tag (master)"
Cedric Ollivier [Fri, 20 Apr 2018 13:57:03 +0000 (13:57 +0000)]
Merge "Last Release updates before tag (master)"

6 years agoUpdate version in setup.cfg (Gambia) 53/56153/1
Cédric Ollivier [Fri, 20 Apr 2018 13:53:44 +0000 (15:53 +0200)]
Update version in setup.cfg (Gambia)

Change-Id: I81ad97a441a050ed9469e178dac8e9dc57c5e72d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate configguide 33/56033/5
Linda Wang [Thu, 19 Apr 2018 04:08:17 +0000 (04:08 +0000)]
Update configguide

JIRA: FUNCTEST-959

Change-Id: Id75689154a63b7258d753f26bb5ff01c0b06012e
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoLast Release updates before tag (master) 31/56131/1
Cédric Ollivier [Fri, 20 Apr 2018 08:49:17 +0000 (10:49 +0200)]
Last Release updates before tag (master)

Change-Id: Icbe6943d574ab5878833fb0cfbc8cd05c65756d6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Update test results in userguide"
Cedric Ollivier [Fri, 20 Apr 2018 07:55:40 +0000 (07:55 +0000)]
Merge "Update test results in userguide"

6 years agoMerge "Update log config for Restapi"
Cedric Ollivier [Fri, 20 Apr 2018 07:55:29 +0000 (07:55 +0000)]
Merge "Update log config for Restapi"

6 years agoMerge "Fix image paths in cloudify_ims_perf.yaml"
Juha Kosonen [Fri, 20 Apr 2018 06:36:15 +0000 (06:36 +0000)]
Merge "Fix image paths in cloudify_ims_perf.yaml"

6 years agoMerge "Add Kubernetes test details to functest userguide"
Juha Kosonen [Fri, 20 Apr 2018 06:31:35 +0000 (06:31 +0000)]
Merge "Add Kubernetes test details to functest userguide"

6 years agoMerge "Add Kubernetes test results to functest userguide"
Juha Kosonen [Fri, 20 Apr 2018 06:28:34 +0000 (06:28 +0000)]
Merge "Add Kubernetes test results to functest userguide"

6 years agoFix image paths in cloudify_ims_perf.yaml 13/56113/1
Cédric Ollivier [Fri, 20 Apr 2018 05:25:57 +0000 (07:25 +0200)]
Fix image paths in cloudify_ims_perf.yaml

Change-Id: If58b5f2021df8a0de672a30459b5b0b12f3fcef2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate log config for Restapi 95/56095/1
Linda Wang [Fri, 20 Apr 2018 04:09:36 +0000 (04:09 +0000)]
Update log config for Restapi

Change-Id: I3117489d489fe7e948c81f62ccfd04a13351780a
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoUpdate test results in userguide 31/56031/4
Linda Wang [Thu, 19 Apr 2018 03:15:06 +0000 (03:15 +0000)]
Update test results in userguide

JIRA: FUNCTEST-958

Change-Id: I45fcdac6c645e52db9d664b7bd96319bbac49a63
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoAdd Kubernetes test details to functest userguide 23/56023/3
Konrad Djimeli [Thu, 19 Apr 2018 00:52:05 +0000 (01:52 +0100)]
Add Kubernetes test details to functest userguide

Change-Id: I032bfe5f079c185d6217800b4a4d16e94c29b05c
Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>
6 years agoMerge "Introduce Rally scenarios for Gnocchi"
Cedric Ollivier [Thu, 19 Apr 2018 19:07:27 +0000 (19:07 +0000)]
Merge "Introduce Rally scenarios for Gnocchi"

6 years agoUse timeout to wrap juju-wait 67/56067/1
Cédric Ollivier [Thu, 19 Apr 2018 15:33:47 +0000 (17:33 +0200)]
Use timeout to wrap juju-wait

It allows getting logs as releng doesn't push them if global timeout.

Change-Id: I4bbb3818feff37d29b4ccd586f3e940380feef2e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd Kubernetes test results to functest userguide 29/56029/2
Konrad Djimeli [Thu, 19 Apr 2018 02:47:51 +0000 (03:47 +0100)]
Add Kubernetes test results to functest userguide

Change-Id: I8b9d7a449ea3b123993c6619b368a4afb0dd2e3e
Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>
6 years agoIntroduce Rally scenarios for Gnocchi 61/56061/1
Juha Kosonen [Thu, 19 Apr 2018 12:20:55 +0000 (15:20 +0300)]
Introduce Rally scenarios for Gnocchi

Added scenarios for testing:

- capabilities
- status
- archive policy
- archive policy rule
- resource
- resource type
- metric

Change-Id: I79f4f0b2bd4d206588ea3edbce8037d1cb993646
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoAdd "Functest Gates presentation" 19/56019/5
Cédric Ollivier [Wed, 18 Apr 2018 21:33:00 +0000 (23:33 +0200)]
Add "Functest Gates presentation"

It should be presented during next "Weekly Technical Community
Discussion".

Change-Id: Id275aeb8e93bd4bd0b2d91be67a63d1763723451
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoClone rally-openstack in functest-smoke 63/55963/1
Cédric Ollivier [Wed, 18 Apr 2018 09:50:16 +0000 (11:50 +0200)]
Clone rally-openstack in functest-smoke

It allows getting latest changes verifying Gnocchi.
Former neutron tempest tests are also removed.

Change-Id: I5910ca012b72b1c5bfb9b0f52591cc9e03051f47
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoCheck app workload in juju_epc 35/55935/1
Cédric Ollivier [Tue, 17 Apr 2018 21:59:32 +0000 (23:59 +0200)]
Check app workload in juju_epc

It avoids interpreting rsync errors in case of deployment failures.
Mysql is still unchecked.

Change-Id: I01b4470b86637d0fc322c422f05240a928305158
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoGet debug data before cleaning juju_epc 27/55927/1
Cédric Ollivier [Tue, 17 Apr 2018 20:10:43 +0000 (22:10 +0200)]
Get debug data before cleaning juju_epc

It could help us to detect the issue when testing Apex (nosdn).
It should be only printed on exceptions instead but this proposal is
safer and straightforward.

Change-Id: I2cccc737e3b3572af72c2653bf32bc02f9ab9077
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSet scp debug flag in juju_epc 21/55921/1
Cédric Ollivier [Tue, 17 Apr 2018 19:20:28 +0000 (21:20 +0200)]
Set scp debug flag in juju_epc

Change-Id: Ic57d05416ac7c8bc459363ea479237101c22f27e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate Xtesting to 0.41 11/55911/1
Cédric Ollivier [Tue, 17 Apr 2018 13:59:29 +0000 (15:59 +0200)]
Update Xtesting to 0.41

It includes an enhancement about logger (needed by sdnvpn).

Change-Id: I05173d2f5b86e12f6badc83e9ee71ecd5898ecee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoEnable sdnvpn (Gambia Release) 05/55905/1
Cédric Ollivier [Tue, 17 Apr 2018 13:45:20 +0000 (15:45 +0200)]
Enable sdnvpn (Gambia Release)

sdnvpn has been synced to OpenStack Queens [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/55531/

Change-Id: I468752394da12023083d83f92c91b09ecf964a26
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Add Kubernetes tests to userguide"
Linda Wang [Tue, 17 Apr 2018 06:58:25 +0000 (06:58 +0000)]
Merge "Add Kubernetes tests to userguide"

6 years agoAdd Kubernetes tests to userguide 29/55629/7
Konrad Djimeli [Fri, 13 Apr 2018 02:02:10 +0000 (03:02 +0100)]
Add Kubernetes tests to userguide

Change-Id: Iaa278269650449b2be19de6382e4e35896001984
Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>
6 years agoFix emails and copyrights in all conf.py 67/55767/1
Cédric Ollivier [Sun, 15 Apr 2018 10:35:27 +0000 (12:35 +0200)]
Fix emails and copyrights in all conf.py

Change-Id: Idbd735443ec106f14e088c1469701507c28d7545
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpates Installer results (master jobs) 63/55763/1
Cédric Ollivier [Sun, 15 Apr 2018 10:13:23 +0000 (12:13 +0200)]
Upates Installer results (master jobs)

Change-Id: I3bf93c2c76b1c0f624d605be2c9534ac23558ee7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate configguide (latest results) 59/55759/1
Cédric Ollivier [Sun, 15 Apr 2018 09:55:53 +0000 (11:55 +0200)]
Update configguide (latest results)

Change-Id: I5eb2f3b0096e57c9f72c07a8adea3bbe4aae3ec7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove odl_netvirt testcase 51/55751/2
Cédric Ollivier [Sun, 15 Apr 2018 09:11:50 +0000 (11:11 +0200)]
Remove odl_netvirt testcase

Its dendencies have not been met since Danube [1].

[1] https://build.opnfv.org/ci/job/apex-os-odl_l3-nofeature-noha-baremetal-danube/

Change-Id: I1a5bb4acd9e7e14dbf519132847521b5138f4cd6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFilter only on scenarios if possible 49/55749/1
Cédric Ollivier [Sun, 15 Apr 2018 08:55:33 +0000 (10:55 +0200)]
Filter only on scenarios if possible

If a scenario is defined, setting installers as dependencies makes
the maintenance more difficult.

Change-Id: I3d0dc51ec3b9ccf3270ad1ec8253d6ee7e4a99a0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSet same dependencies for all vping test cases 47/55747/2
Cédric Ollivier [Sun, 15 Apr 2018 08:47:40 +0000 (10:47 +0200)]
Set same dependencies for all vping test cases

It allows a fair comparison between odl and nosdn scenarios.
Gluon could also be safely removed as scenario filter.

https://build.opnfv.org/ci/job/functest-compass-baremetal-daily-master/88/console

Change-Id: I0a9268d2038c79320e372d1d35d276560555aa7d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPrint the stack traceback when cleaning juju_epc 41/55741/1
Cédric Ollivier [Sat, 14 Apr 2018 17:33:01 +0000 (19:33 +0200)]
Print the stack traceback when cleaning juju_epc

Change-Id: If32557a4384cafd67b7c294f8c0592ee2769b1a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoInstall new neutron-tempest-plugin 21/55721/1
Cédric Ollivier [Fri, 13 Apr 2018 20:57:29 +0000 (22:57 +0200)]
Install new neutron-tempest-plugin

Change-Id: Id43e7cd5efa4a78397238bf27ef7e6b476704557
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove duplicated installation 19/55719/1
Cédric Ollivier [Fri, 13 Apr 2018 20:56:47 +0000 (22:56 +0200)]
Remove duplicated installation

Change-Id: Ib6d969460e6674ec892b7d657b184c2dcf614ea0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDisable refstack_defcore due to testr 13/55713/1
Cédric Ollivier [Fri, 13 Apr 2018 20:25:01 +0000 (22:25 +0200)]
Disable refstack_defcore due to testr

refstack_client is hardcoded to testr when normalizing tests list.
It's disabled till refstack_client conforms with OpenStack Queens
(.testr.conf was removed from tempest).

Change-Id: I10c7059e049017db994003eb5d42da83e1d5a839
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDisable volume in Patrole 0.3 by default 09/55709/2
Cédric Ollivier [Fri, 13 Apr 2018 19:32:43 +0000 (21:32 +0200)]
Disable volume in Patrole 0.3 by default

Else it fails without /etc/cinder/policy.json.

Change-Id: Iaa5fb5b42626f2fbe00c3a89fa3edf4eae4ac166
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Fix role processing in Patrole"
Cedric Ollivier [Fri, 13 Apr 2018 15:42:53 +0000 (15:42 +0000)]
Merge "Fix role processing in Patrole"

6 years agoMerge "Pass kwargs in TempestCommon:configure()"
Cedric Ollivier [Fri, 13 Apr 2018 15:42:36 +0000 (15:42 +0000)]
Merge "Pass kwargs in TempestCommon:configure()"

6 years agoUpdate regex to get verification_id 83/55683/1
Cédric Ollivier [Fri, 13 Apr 2018 14:56:04 +0000 (16:56 +0200)]
Update regex to get verification_id

Rally changes the sentence which our testcase was unable to parse.

Change-Id: I9bab3109adc37d349c6fbec73cea9052d09cedb1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Update Patrole to 0.3"
valentin boucher [Fri, 13 Apr 2018 13:37:34 +0000 (13:37 +0000)]
Merge "Update Patrole to 0.3"

6 years agoUpdate Patrole to 0.3 77/55677/1
Cédric Ollivier [Fri, 13 Apr 2018 13:00:15 +0000 (15:00 +0200)]
Update Patrole to 0.3

Change-Id: Ifde367b312d9a7d56fccf4f3ba0c155f30b1cb6f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Switch to stestr"
valentin boucher [Fri, 13 Apr 2018 12:44:12 +0000 (12:44 +0000)]
Merge "Switch to stestr"

6 years agoSwitch to stestr 51/55651/3
Cédric Ollivier [Fri, 13 Apr 2018 08:37:29 +0000 (10:37 +0200)]
Switch to stestr

It also updates rally and installs rally-openstack.
It completes the update to OpenStack Queens.

Change-Id: Iabf436ac6e7facfa21a3d7c8a3dfaffa9142da98
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoEnable sfc 65/55665/1
Cédric Ollivier [Fri, 13 Apr 2018 09:35:32 +0000 (11:35 +0200)]
Enable sfc

Sfc has been synchronized to OpenStack queens.

Change-Id: I144d2c96777a3fc2c1b84101f1b7cdb085f90d50
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoEnable Doctor and Barometer 45/55645/1
Cédric Ollivier [Fri, 13 Apr 2018 08:01:35 +0000 (10:01 +0200)]
Enable Doctor and Barometer

They are now synchronized with OpenStack stable/queens.

Change-Id: Ia333268e17e997c32d0f8f0b658397048c64c0ab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Print the stack traceback when cleaning"
Cedric Ollivier [Fri, 13 Apr 2018 07:56:01 +0000 (07:56 +0000)]
Merge "Print the stack traceback when cleaning"

6 years agoPrint the stack traceback when cleaning 19/55619/2
Cédric Ollivier [Thu, 12 Apr 2018 19:49:33 +0000 (21:49 +0200)]
Print the stack traceback when cleaning

Change-Id: I8279844f0e42378b4fe550696608054cd7418a12
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix role processing in Patrole 11/55611/2
Cédric Ollivier [Thu, 12 Apr 2018 18:58:01 +0000 (20:58 +0200)]
Fix role processing in Patrole

Role has to be listed in tempest.conf before calling testr.
It also saves the right config file.

Change-Id: Ifd122f31d0bfe3e9b3f93c6d62526acce96953d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>