functest.git
5 years agoUpdate rally image name regex 67/59667/3
Cédric Ollivier [Wed, 11 Jul 2018 09:35:33 +0000 (11:35 +0200)]
Update rally image name regex

The default value doesn't conform with our image names.
Else it downloads the image from internet which may be not possible
(offline testing, proxy or deployment l3 issues [1])

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-virtual-suite-master/113/console

Change-Id: I7d951967784d591e7155fe8582299aaa9b680b10
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoTry to get Member or member role 61/59661/2
Cédric Ollivier [Wed, 11 Jul 2018 07:18:56 +0000 (09:18 +0200)]
Try to get Member or member role

Keystone roles are case insensitive and Apex declares member which
couldn't be detected. Then conflict occured when creating the
mandatory role [1].

It now searches the default role in lower case too.

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/141/console

Change-Id: I687ecfe768ab4717fdb42a135c4bf9b76733ffd9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoMerge "Define one logger per key module"
Cedric Ollivier [Tue, 10 Jul 2018 13:45:20 +0000 (13:45 +0000)]
Merge "Define one logger per key module"

5 years agoForce region to RegionOne if OS_REGION_NAME is unset 33/59633/2
Cédric Ollivier [Mon, 9 Jul 2018 20:39:42 +0000 (22:39 +0200)]
Force region to RegionOne if OS_REGION_NAME is unset

tempest still selects the first one if unset [1].

JIRA: FUNCTEST-990

[1] https://docs.openstack.org/tempest/latest/sampleconf.html

Change-Id: I238d47173c2c4aa1db694028e4d44b80b0e280f1
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
5 years agoMerge "1) Cleanup floating IPs that are assigned through Juju Deployment. 2) Add...
Cedric Ollivier [Tue, 10 Jul 2018 09:54:18 +0000 (09:54 +0000)]
Merge "1) Cleanup floating IPs that are assigned through Juju Deployment. 2) Add SCTP rule explicitly to the retrieved Security Group."

5 years agoDefine one logger per key module 39/59639/1
Cédric Ollivier [Tue, 10 Jul 2018 09:48:29 +0000 (11:48 +0200)]
Define one logger per key module

Snaps is printing lots of error messages which makes user confused.
It will decrease the size of functest.log.

Change-Id: I2c7d8ec968350563fbfbd62dcc2fc39b13b39a78
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
5 years agoPublish cloudify scenario 29/59629/2
Cédric Ollivier [Mon, 9 Jul 2018 20:09:39 +0000 (22:09 +0200)]
Publish cloudify scenario

It eases deploying any vnf via Cloudify.
It also stops duplicating code between vims and vrouter.

Co-Authored-By: Valentin Boucher <valentin.boucher@kontron.com>
Change-Id: I5fe06d91804f4781f6b1301da12862bac793ffbb
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
5 years agoForce public identity endpoint in Shaker 25/59625/1
Cédric Ollivier [Mon, 9 Jul 2018 16:54:23 +0000 (18:54 +0200)]
Force public identity endpoint in Shaker

It conforms with our VNFs by calling public endpoints (from VM).
It fixes by design the issues when testing Compass [1] due to
export OS_INTERFACE=publicURL

[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/180/consoleFull

Change-Id: Iea15506ba5910879d05e61cfd20da2c0878e569b
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
5 years agoMerge "Refactor tempest common"
Cedric Ollivier [Mon, 9 Jul 2018 12:35:22 +0000 (12:35 +0000)]
Merge "Refactor tempest common"

5 years agoAdd Vmtp as a new testcase 01/58401/7
Cédric Ollivier [Tue, 5 Jun 2018 19:04:54 +0000 (21:04 +0200)]
Add Vmtp as a new testcase

VMTP is a small python application that will automatically perform
ping connectivity, round trip time measurement (latency) and TCP/UDP
throughput.

JIRA: FUNCTEST-980

Change-Id: I8e94fc52a429f505ac14e14bbb9d0a3b20996ba4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoRefactor tempest common 91/59491/6
Cédric Ollivier [Tue, 3 Jul 2018 13:28:38 +0000 (15:28 +0200)]
Refactor tempest common

It also renames two testcases and updates all docs because tests
run in parallel in case of tempest smoke.

To force one thread as before:
run:
    module: 'functest.opnfv_tests.openstack.tempest.tempest'
    class: 'TempestCommon'
    args:
        mode: '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$'
        option:
            - '--concurrency=1'

JIRA: FUNCTEST-989

Change-Id: I1348f5908400a5046be8edf983db4afa12e546c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoMerge "Cover vping_ssh"
Cedric Ollivier [Sun, 8 Jul 2018 09:19:53 +0000 (09:19 +0000)]
Merge "Cover vping_ssh"

5 years agoTemporarily disable Snaps CreateRouterSuccessTests 95/59595/1
Cédric Ollivier [Sun, 8 Jul 2018 08:57:54 +0000 (10:57 +0200)]
Temporarily disable Snaps CreateRouterSuccessTests

The test could be falsy regarding the possible external network
configs [1]. This patch will be reverted as soon as the bug is closed
[2].

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/246/console
[2] https://jira.opnfv.org/browse/SNAPS-320

Change-Id: I680656b300f0d669e8d96bec6c94a4a804ebbecb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoCover vping_ssh 03/58403/2
Cédric Ollivier [Sun, 10 Jun 2018 18:12:05 +0000 (20:12 +0200)]
Cover vping_ssh

Change-Id: I37c52057a45d76e081a1a0145baee96041ca25a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoFix delete_keypair arg 85/59585/1
Cédric Ollivier [Fri, 6 Jul 2018 17:44:35 +0000 (19:44 +0200)]
Fix delete_keypair arg

It uses keypair name instead of id as expected by Shade.
It also increases timers as it boots an ubuntu VM.

Change-Id: I8cd131e7c7a94c8f6b0fcc54a4d75ef8af31b807
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoSet timeout for create, attach and detach volume 49/59549/3
Delia Popescu [Wed, 4 Jul 2018 15:05:40 +0000 (18:05 +0300)]
Set timeout for create, attach and detach volume

Without timeout for volume opperations the testcase
will fail only after functest timeout

Change-Id: I669c7933846574c09fc7db06a2a2ce7d101a44f5
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoInstall Robot dependencies in healthcheck 47/59547/1
Cédric Ollivier [Wed, 4 Jul 2018 13:20:22 +0000 (15:20 +0200)]
Install Robot dependencies in healthcheck

old testcase moved to opnfv/functest-healthcheck.

Change-Id: If8e8fc7d8bc9c97602c05e5a4c048461351cc97e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Revert "Disable all new testcases for MS3.1""
valentin boucher [Tue, 3 Jul 2018 14:38:50 +0000 (14:38 +0000)]
Merge "Revert "Disable all new testcases for MS3.1""

6 years ago1) Cleanup floating IPs that are assigned through Juju Deployment. 27/59427/2
soumaya [Mon, 2 Jul 2018 10:08:54 +0000 (15:38 +0530)]
1) Cleanup floating IPs that are assigned through Juju Deployment.
2) Add SCTP rule explicitly to the retrieved Security Group.

Change-Id: I38e5b1267dbcdcf8e5aadb3c06dd784044e774d4
Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
6 years agoRevert "Disable all new testcases for MS3.1" 83/59483/1
Cédric Ollivier [Tue, 3 Jul 2018 09:50:17 +0000 (11:50 +0200)]
Revert "Disable all new testcases for MS3.1"

This reverts commit 0ff1a51fa53cb74f7a671edc3f1502838294d5c9.

Change-Id: I1ff9cb23978cbfcec6a3284654aaf6b153214a19
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Inherit rally from VmReady1"
Cedric Ollivier [Mon, 2 Jul 2018 08:32:07 +0000 (08:32 +0000)]
Merge "Inherit rally from VmReady1"

6 years agoCreate Member role if required 07/59407/2
Cédric Ollivier [Sun, 1 Jul 2018 09:11:33 +0000 (11:11 +0200)]
Create Member role if required

It seems there is no common role configuration between OPNFV
installers. Then it creates/removes the expected role if required.

Change-Id: I38a92e2522a401f46a59813b9e9443a11d6c7060
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoInherit rally from VmReady1 43/59043/7
Cédric Ollivier [Tue, 26 Jun 2018 06:23:25 +0000 (08:23 +0200)]
Inherit rally from VmReady1

It also fixes clean().

Change-Id: I42d1305d5cdb5a717cfa7fce26798ac7102310f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Remove floating ip of second instance in cinder testcase"
Cedric Ollivier [Fri, 29 Jun 2018 18:57:51 +0000 (18:57 +0000)]
Merge "Remove floating ip of second instance in cinder testcase"

6 years agoRemove floating ip of second instance in cinder testcase 23/59323/1
Delia Popescu [Fri, 29 Jun 2018 10:59:25 +0000 (13:59 +0300)]
Remove floating ip of second instance in cinder testcase

Change-Id: I30e30f1d35bb83984b63d7308331fc7bfee53955
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoUpdate patches for all tests based on scenarios 11/59311/1
Cédric Ollivier [Fri, 29 Jun 2018 08:05:36 +0000 (10:05 +0200)]
Update patches for all tests based on scenarios

Change-Id: Iff7fd8e6c14bdfb67ae146c5be1e073673a951d8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoGet aarch64 image metadata for cinder and vping testcase 91/59191/1
Delia Popescu [Thu, 28 Jun 2018 10:40:33 +0000 (13:40 +0300)]
Get aarch64 image metadata for cinder and vping testcase

Image metadata for cinder and vping tests is no longer set for ARM

Change-Id: I2ab8e6ce55c6e619b96e49ecec7afe727a902345
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoMerge "Modify config_patch.yaml according to the new snaps config"
Cedric Ollivier [Wed, 27 Jun 2018 19:17:10 +0000 (19:17 +0000)]
Merge "Modify config_patch.yaml according to the new snaps config"

6 years agoModify config_patch.yaml according to the new snaps config 85/59085/2
Cédric Ollivier [Wed, 27 Jun 2018 13:16:31 +0000 (15:16 +0200)]
Modify config_patch.yaml according to the new snaps config

It allows verifying ovs scenarios via snaps.

JIRA: FUNCTEST-984

Change-Id: I0fedadc0b9e265c424ae3221469b8d28b9a68afa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Take shaker arm64 image into account"
Cedric Ollivier [Tue, 26 Jun 2018 17:58:27 +0000 (17:58 +0000)]
Merge "Take shaker arm64 image into account"

6 years agoMerge "Disable all new testcases for MS3.1"
Cedric Ollivier [Tue, 26 Jun 2018 17:58:05 +0000 (17:58 +0000)]
Merge "Disable all new testcases for MS3.1"

6 years agoTake shaker arm64 image into account 53/59053/2
Cédric Ollivier [Tue, 26 Jun 2018 15:51:09 +0000 (17:51 +0200)]
Take shaker arm64 image into account

Change-Id: Ia1da6e97027df2cfa923f5ba076731e4a2817b1f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDisable all new testcases for MS3.1 41/59041/4
Cédric Ollivier [Tue, 26 Jun 2018 14:28:27 +0000 (16:28 +0200)]
Disable all new testcases for MS3.1

It has been decided in TSC release meeting.

Change-Id: I0a62f18c5b11fe31ac72fc301c5444e8d89b6fff
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Remove list_zones() which requires dns"
Cedric Ollivier [Mon, 25 Jun 2018 18:26:33 +0000 (18:26 +0000)]
Merge "Remove list_zones() which requires dns"

6 years agoRemove list_zones() which requires dns 03/59003/1
Cédric Ollivier [Mon, 25 Jun 2018 18:01:28 +0000 (20:01 +0200)]
Remove list_zones() which requires dns

Change-Id: I271545a654a1a508c8b47a3fa4dcf72ad314a154
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix role name for tenantnetwork 75/58975/3
Delia Popescu [Mon, 25 Jun 2018 10:32:42 +0000 (13:32 +0300)]
Fix role name for tenantnetwork

Role name _member_ is no longer available
The test returnes OpenstackCloudException that
role _member_ is not found

Change-Id: I37c8dfe6c4da04009ccabbc49e12c2123d92832b
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoMove odl into healthcheck 69/58969/3
Cédric Ollivier [Mon, 25 Jun 2018 05:17:17 +0000 (07:17 +0200)]
Move odl into healthcheck

It should be included in healthcheck as all basic tests.

Change-Id: I48439fe6385a9056eed8b779290f20633d59b0fd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoImplement connection_check via shade too 61/58961/4
Cédric Ollivier [Mon, 25 Jun 2018 04:07:26 +0000 (06:07 +0200)]
Implement connection_check via shade too

SNAPS connection_check tests are merged into api_check.
It would ease debugging deployment as well [1]

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/127/console

Change-Id: I30254a46c3dc6874881d687e36903c6b7878d63d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMove vping_* and cinder_test into healthcheck 57/58957/1
Cédric Ollivier [Mon, 25 Jun 2018 03:09:05 +0000 (05:09 +0200)]
Move vping_* and cinder_test into healthcheck

Change-Id: I193c6dcdf90fe8eac46884fe5a5a329b0e5a7322
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd dedug data when creating project/user 55/58955/1
Cédric Ollivier [Mon, 25 Jun 2018 02:58:11 +0000 (04:58 +0200)]
Add dedug data when creating project/user

https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/127/console

Change-Id: I233cef05560eba5f238b0eea3e2c56cb3c882931
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoForce the use of public endpoints in shaker.py 53/58953/2
Cédric Ollivier [Sun, 24 Jun 2018 17:43:01 +0000 (19:43 +0200)]
Force the use of public endpoints in shaker.py

It now leverages on the new user created and gets the public endpoint.

Change-Id: Iead106e614a73708cb13e33b49a2f438766a3056
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix hardcoded values in cinder_test 51/58951/1
Cédric Ollivier [Sun, 24 Jun 2018 11:54:01 +0000 (13:54 +0200)]
Fix hardcoded values in cinder_test

Only Fuel attaches a kdrive in all cases and then increase the device
numbers. cinder_test now leverages on VOLUME_DEVICE_NAME as tempest.

It also updates the testcase to leverage on the right scenario.

Change-Id: Ib5cd17f69411f608f1b79e704604dc481581ebe0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoImprove scenarios to reduce duplicate codes 49/58949/1
Cédric Ollivier [Sun, 24 Jun 2018 09:37:10 +0000 (11:37 +0200)]
Improve scenarios to reduce duplicate codes

Change-Id: I71f79b9ac8314ac979d4b1009f662baa7c93a4fd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix hardcoded value 47/58947/1
Cédric Ollivier [Sun, 24 Jun 2018 08:44:12 +0000 (10:44 +0200)]
Fix hardcoded value

Change-Id: I070e1404a4b0dba4733f38e2de32e1fa77254ddc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDecrease the log level when connecting in singlevm 41/58941/1
Cédric Ollivier [Sat, 23 Jun 2018 05:35:27 +0000 (07:35 +0200)]
Decrease the log level when connecting in singlevm

https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/172/console

Change-Id: I0fd3bb833d306626c0eb6393fff3d0fca0579100
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix user/project create operations 39/58939/1
Cédric Ollivier [Sat, 23 Jun 2018 10:30:07 +0000 (12:30 +0200)]
Fix user/project create operations

os_client_config creates a singleton which forbids the previous
processing. It also cleans remaining resources and allows
publishing public images (needed by Tempest)

Change-Id: I3a0ad8664b263d3ee8599efe2973465006d5750b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate tempest to inherit from VmReady1 15/58915/6
Cédric Ollivier [Fri, 22 Jun 2018 12:35:53 +0000 (14:35 +0200)]
Update tempest to inherit from VmReady1

It also copies tempest.conf due to side effects raised by
Barbican plugins.

Change-Id: Ie87680f5d2e68527a5a61aac302838afc339dde8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPublish vmready scenarios 91/58891/3
Cédric Ollivier [Thu, 21 Jun 2018 20:47:45 +0000 (22:47 +0200)]
Publish vmready scenarios

It will simplify code in juju_epc, tempest, etc.

Change-Id: I195ae1d7d75f1c2f2eba76ae3c5307153e9b9759
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Update patches"
Cedric Ollivier [Thu, 21 Jun 2018 20:07:51 +0000 (20:07 +0000)]
Merge "Update patches"

6 years agoUpdate patches 87/58887/1
Cédric Ollivier [Thu, 21 Jun 2018 19:43:55 +0000 (21:43 +0200)]
Update patches

It patches specific values for singlevm1 and singlevm2 (arm64, ovs
and fdio).

Change-Id: Ibbd827b52520410bbbfa231eec23b08aeb511e0b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd the Barbican test suite 81/58881/2
Cédric Ollivier [Thu, 21 Jun 2018 16:11:09 +0000 (18:11 +0200)]
Add the Barbican test suite

It eases verifying the functionality of a barbican installation.

Change-Id: Iac2144ae6ba4d61b2b37bb5c7a0359edb3f222a6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoInstall third-party requirements again 77/58877/1
Cédric Ollivier [Thu, 21 Jun 2018 16:20:16 +0000 (18:20 +0200)]
Install third-party requirements again

Change-Id: Ic04969a56a4e35d5caf12a6a9bc0323bcf3a26d2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoIntegrate Shaker as a new testcase 01/58501/15
Cédric Ollivier [Wed, 13 Jun 2018 12:57:56 +0000 (14:57 +0200)]
Integrate Shaker as a new testcase

Shaker wraps around popular system network testing tools like iperf,
iperf3 and netperf (with help of flent).

Change-Id: Idd82ffd9642c90335ad156e899c0330473260f15
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPublish singlevm scenarios 59/58659/12
Cédric Ollivier [Mon, 18 Jun 2018 12:18:59 +0000 (14:18 +0200)]
Publish singlevm scenarios

They ease creating all ressources to execute command in a new VM
reachable via ssh. This scenarios should be reused by other
more advanced ones (shaker, vping, cinder, etc.).

Change-Id: If23866827c64a7afbdd8ff596dbc33710ee4ee20
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPublish tenantnetwork scenarios 55/58655/10
Cédric Ollivier [Mon, 18 Jun 2018 11:52:42 +0000 (13:52 +0200)]
Publish tenantnetwork scenarios

They ease creating all tenant network ressources.
These scenarios should be reused by other more complex ones.

Change-Id: I4ce1872065bde92408d34f2ca8823ce98275d8d5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Add functest in upper-constraints"
Cedric Ollivier [Tue, 19 Jun 2018 15:24:52 +0000 (15:24 +0000)]
Merge "Add functest in upper-constraints"

6 years agoAdd functest in upper-constraints 21/58721/2
Cédric Ollivier [Tue, 19 Jun 2018 12:36:46 +0000 (14:36 +0200)]
Add functest in upper-constraints

It's required by OPNFV Features such as sfc.
Functest is removed from constraints in Dockerfile else it would
conflict with the local dir.

Change-Id: I2df5cd151b43eb1a4f0320510183d0f28cdf84c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Clean requirements"
Cedric Ollivier [Tue, 19 Jun 2018 09:08:38 +0000 (09:08 +0000)]
Merge "Clean requirements"

6 years agoClean requirements 07/58707/1
Cédric Ollivier [Tue, 19 Jun 2018 05:46:19 +0000 (07:46 +0200)]
Clean requirements

It cleans dependencies asked by removed modules.

Change-Id: I3a2013bd5a77e4b99219475fc2c1fc3dc06787be
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix pylint errors 03/58703/1
Cédric Ollivier [Tue, 19 Jun 2018 05:14:42 +0000 (07:14 +0200)]
Fix pylint errors

They are highlighted by the last pylint version.

Change-Id: I473212a413013492716993fb536903b13bff66ed
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd minimal docstings in clearwater_ims_base.py 81/58681/1
Cédric Ollivier [Mon, 18 Jun 2018 17:48:29 +0000 (19:48 +0200)]
Add minimal docstings in clearwater_ims_base.py

It will allow forcing 10/10 in any new patchset.

Change-Id: I4cc52a9fb66fdd2c0dcbf9915be262acedac8672
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Leverage on new opnfv/functest-tempest"
valentin boucher [Mon, 18 Jun 2018 14:39:50 +0000 (14:39 +0000)]
Merge "Leverage on new opnfv/functest-tempest"

6 years agoMerge "Config flavor metadata via functest - docs update"
Cedric Ollivier [Mon, 18 Jun 2018 08:00:55 +0000 (08:00 +0000)]
Merge "Config flavor metadata via functest - docs update"

6 years agoLeverage on new opnfv/functest-tempest 35/58635/1
Cédric Ollivier [Sun, 17 Jun 2018 07:53:13 +0000 (09:53 +0200)]
Leverage on new opnfv/functest-tempest

It simplifies components, features and smoke containers and they can
now leverage on tempest.

Change-Id: Ie5564b8ba8a58670827af74371194d2583801f1b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAllow overriding the default OPENSTACK_TAG 33/58633/1
Cédric Ollivier [Sun, 17 Jun 2018 10:29:12 +0000 (12:29 +0200)]
Allow overriding the default OPENSTACK_TAG

It allows building containers vs other upper-constraints and then
reusing our Dockerfiles for an older or newer OpenStack versions.

Change-Id: I160e6f7175a11684846cad86c3d47269c88a08ea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRun unit tests as travis-ci job 31/58631/1
Cédric Ollivier [Sun, 17 Jun 2018 08:31:15 +0000 (10:31 +0200)]
Run unit tests as travis-ci job

tox doesn't run perm and py35:
  - travis-ci doesn't set the classical umask
  - ubuntu 14.04 doesn't provide any python 3.5 package

Change-Id: I72ba109b183f079a833a4bab4ab4853d4870ce49
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix invalid method names in vnfs 29/58629/1
Cédric Ollivier [Sun, 17 Jun 2018 11:36:12 +0000 (13:36 +0200)]
Fix invalid method names in vnfs

Change-Id: Icff1a53ffd7b59d46543b79571b45872a9f243c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMock os.makedirs() in test_odl.py 27/58627/1
Cédric Ollivier [Sun, 17 Jun 2018 09:41:08 +0000 (11:41 +0200)]
Mock os.makedirs() in test_odl.py

os.makedirs() is called before calling robot.run.

Change-Id: Id651428343510683cd616d8101d22a73ccbf3dad
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRun unit tests vs different upper-constraints 25/58625/1
Cédric Ollivier [Sun, 17 Jun 2018 08:15:01 +0000 (10:15 +0200)]
Run unit tests vs different upper-constraints

It allows setting different upper-constraints (i.e. run unit test vs
OpenStack master).

Change-Id: Ie4f433a9f6b4c68a43ea259abb0f95270fc908ad
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd functest-tempest container 19/58619/2
Cédric Ollivier [Sun, 17 Jun 2018 07:18:13 +0000 (09:18 +0200)]
Add functest-tempest container

It avoids duplicating operations between functest-smoke,
functest-components, functest-vnf...

It eases building new containers for new tempest-based testcases.

Change-Id: I73b973588f4eb70d1e5874d06d030c5a5d729e95
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate travis-ci config 17/58617/1
Cédric Ollivier [Sat, 16 Jun 2018 16:07:25 +0000 (18:07 +0200)]
Update travis-ci config

It stop cross-compiling for arm and creating functest-parser
manifests.

Change-Id: Ic9567232d876e36b3adbff4bc1d4d23ff9ef3b81
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix pylint warnings in clearwater_ims_base 15/58615/1
Cédric Ollivier [Fri, 15 Jun 2018 15:55:23 +0000 (17:55 +0200)]
Fix pylint warnings in clearwater_ims_base

Change-Id: I663bd2826e43ce888990b012df27ca94e2d49a8d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove parser container 73/58573/5
Cédric Ollivier [Fri, 15 Jun 2018 06:22:38 +0000 (08:22 +0200)]
Remove parser container

Parser conflicts with OpenStack project namespaces due to bad fork
conception. Functest should stop maintaining containers to bypass
issues created by Parser (2 releases).

Change-Id: If52084dc9cb7165a6f53051ad84604bc999dd69c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove cloudify_ims_perf 71/58571/5
Cédric Ollivier [Fri, 15 Jun 2018 06:19:18 +0000 (08:19 +0200)]
Remove cloudify_ims_perf

All that modules are uncovered, unverified and deprecated.
They will be safely reverted as soon as they are updated, verified by
gates and unit tests are added.

Change-Id: Iac0893f9f0ccb485d91cd17305e744aff9bf9414
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove cli and api 69/58569/5
Cédric Ollivier [Fri, 15 Jun 2018 06:15:10 +0000 (08:15 +0200)]
Remove cli and api

cli has been deprecated for a while and restapi is uncovered and
unverified. This patch will be partially reverted as soon as next
unit tests cover functest/api.

It partially updates troubleshooting docs which has to be completed
in a second change [1].

[1] https://jira.opnfv.org/browse/FUNCTEST-982

Change-Id: I08e0bd212fcf5f5c5c220eb2500a6b0a6ff46df7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSupport py3 in uncovered packages 59/58559/2
Cédric Ollivier [Thu, 14 Jun 2018 19:20:59 +0000 (21:20 +0200)]
Support py3 in uncovered packages

It has to be noted that cloudify_rest_client doesn't support py3 then
next unit tests vs cloudify-based testcases would be excluded.

Change-Id: I0b0e64929d1238665c778ce51fd6abd5ccf06b6c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd py3 support in tempest and rally 57/58557/1
Cédric Ollivier [Thu, 14 Jun 2018 18:51:41 +0000 (20:51 +0200)]
Add py3 support in tempest and rally

Change-Id: I009d38a0db409ab4ec641cba9173ab2386d0ce2a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoConfig flavor metadata via functest - docs update 77/58477/2
Panagiotis Karalis [Wed, 13 Jun 2018 08:40:41 +0000 (11:40 +0300)]
Config flavor metadata via functest - docs update

Related to the merged patch :
"SNAPS via functest with flavor metadata configurable"

Functest documents are updated accordingly.

Change-Id: I874f041935f64b7240a5ec5de6e9c89b0f4a09fd
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
6 years agoMerge "Abort vping_userdata test if IP address is missing"
Cedric Ollivier [Wed, 13 Jun 2018 17:25:07 +0000 (17:25 +0000)]
Merge "Abort vping_userdata test if IP address is missing"

6 years agoAbort vping_userdata test if IP address is missing 57/58457/3
Juha Kosonen [Tue, 12 Jun 2018 13:35:19 +0000 (16:35 +0300)]
Abort vping_userdata test if IP address is missing

Do not start checking the result of ping test if the first instance has
no IP address.

JIRA: FUNCTEST-976

Change-Id: I2da3154e63a6a97f86efe8274be84abc437aa133
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoFix result parsing in cloudify_ims 85/58485/1
Cédric Ollivier [Wed, 13 Jun 2018 12:56:23 +0000 (14:56 +0200)]
Fix result parsing in cloudify_ims

The previous regex failed when errors are listed [1].

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/194/console

Change-Id: I57c8bfb8968555c3d43267a06f2bb9a2b95a3268
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSNAPS via functest with flavor metadata configurable 21/58321/5
Panagiotis Karalis [Thu, 7 Jun 2018 13:11:33 +0000 (16:11 +0300)]
SNAPS via functest with flavor metadata configurable

The required data for the SNAPS flavors are sent through
the config_functest yaml file in order for the SNAPS scenarios to be
configured accordingly.
If the config_functest yaml file includes empty flavor_extra_specs
or there is not included this parameter, the SNAPS scenarios will be
executed using the hardcoded value.

Change-Id: I4ef46d1fe93497d658414170a72c4520d8f37808
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
6 years agoRevert "Stop rolling snaps (bypass bugfixes)" 49/58449/1
Cédric Ollivier [Tue, 12 Jun 2018 12:02:37 +0000 (14:02 +0200)]
Revert "Stop rolling snaps (bypass bugfixes)"

This reverts commit 8c285c3fb56ce144ff7eb095b6fa401e29a03fc4.

Change-Id: I2acc1cdc7fe2d12c6eb3d100f76c2dc3e502522f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate cloudify-rest-client to 4.3.2 97/58397/1
Cédric Ollivier [Sun, 10 Jun 2018 12:00:22 +0000 (14:00 +0200)]
Update cloudify-rest-client to 4.3.2

Change-Id: I8ac0becb57897233c2a12781dc022d9fdfd32f85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSelect the right quaff repo 87/58387/1
Cédric Ollivier [Sat, 9 Jun 2018 12:47:51 +0000 (14:47 +0200)]
Select the right quaff repo

Change-Id: I0aa090bf1f8c6220918ebc1b041bab4a43d444b5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoForce unf_ext 0.0.7.4 85/58385/1
Cédric Ollivier [Sat, 9 Jun 2018 12:01:44 +0000 (14:01 +0200)]
Force unf_ext 0.0.7.4

Else it cannot compile vs arm [1][2]

[1] https://build.opnfv.org/ci/job/functest-vnf-docker-build-arm64-master/231/console
[2] https://github.com/sile/unf/pull/2/commits/74ed3e3b1ec31474cf9b8d8a90aee535607fdfe8

Change-Id: I8b0890c3b7a2a148975635c0f4eafbcc5568fc00
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoStop using a forked obsolete repo 83/58383/3
Cédric Ollivier [Sat, 9 Jun 2018 08:53:41 +0000 (10:53 +0200)]
Stop using a forked obsolete repo

It leverages on the official clearwater live test instead.
It now parses the output directly.

Change-Id: Ia7746c13362323daf72b3536d294401f0b7ae42f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSwitch to Python3 divide in cloudify_ims 73/58273/2
Cédric Ollivier [Wed, 6 Jun 2018 07:28:38 +0000 (09:28 +0200)]
Switch to Python3 divide in cloudify_ims

The code simply asks for python3 divide else only live_test = 100% is
considered as successful [1].

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/169/console

Change-Id: I84690d20791cd3d6a68823eec40f0e4b0f876b72
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSwitch from OS_ENDPOINT_TYPE to OS_INTERFACE 69/58269/2
Cédric Ollivier [Tue, 5 Jun 2018 19:31:43 +0000 (21:31 +0200)]
Switch from OS_ENDPOINT_TYPE to OS_INTERFACE

It also set endpoint_type to public in tempest.conf if unset.

JIRA: FUNCTEST-975

Change-Id: I91bd1d7171b4bcf58dbe818696d5b864d5036619
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoReturn true if at least one passed test 63/58263/2
Cédric Ollivier [Tue, 5 Jun 2018 18:29:04 +0000 (20:29 +0200)]
Return true if at least one passed test

JIRA: FUNCTEST-974

Change-Id: I9915dbb91516baf5307a577c41ede5dca51a2f07
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate clearwater to 129 53/58153/1
Cédric Ollivier [Fri, 1 Jun 2018 15:31:03 +0000 (17:31 +0200)]
Update clearwater to 129

It switches to Sprint Ulmo [1] which fixes deployment issues in
Orange ONAP Openlab.

[1] http://www.projectclearwater.org/sprint-ulmo-release-note/

Change-Id: I3c32faf4e26e64bb12438238cf1ba66b9771da0d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Update read and write data path in cinder test"
Cedric Ollivier [Fri, 1 Jun 2018 10:29:45 +0000 (10:29 +0000)]
Merge "Update read and write data path in cinder test"

6 years agoUpdate read and write data path in cinder test 19/58019/4
Delia Popescu [Tue, 29 May 2018 08:46:37 +0000 (11:46 +0300)]
Update read and write data path in cinder test

Update the path for read/write data
Fix a false possitive result on read_data
Fix read device name
Unmount volume after writing data

JIRA: FUNCTEST-908

Change-Id: I555b5a3daaeff3aa58891e65c0b70094372c04c9
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoFix tempest result parsing 99/58099/1
Juha Kosonen [Wed, 30 May 2018 14:04:55 +0000 (17:04 +0300)]
Fix tempest result parsing

Detailed results of verifier are in tempest-error.log.

Change-Id: Id5dbdfd3389d1b79dba2bebc5f5ffa7811ef06c8
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoBypass Cloudify's upper-constraints issues 95/58095/1
Cédric Ollivier [Wed, 30 May 2018 13:18:35 +0000 (15:18 +0200)]
Bypass Cloudify's upper-constraints issues

It installs cmd2 via yum instead as last cmd2 release only supports
python3.

Change-Id: I495d71f11ed48ba47e1aa27965675d4bef7c141e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix _do_execute() return code in vping_ssh 73/58073/1
Cédric Ollivier [Wed, 30 May 2018 07:32:00 +0000 (09:32 +0200)]
Fix _do_execute() return code in vping_ssh

Change-Id: I781e51bb56f6cdac8b347e7fd85e70c07eb69e23
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSimplify logging 89/57889/3
Panagiotis Karalis [Fri, 25 May 2018 09:22:47 +0000 (12:22 +0300)]
Simplify logging

In order to collect logs from features running through
functest framework (mainly for troubleshooting purposes),
the logging mechanism has been updated accordingly.

It should be noted that feature logs are printed in functest.log.
All logs are now printed in functest.log whatever the namespace.

JIRA: SFC-125

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I6cb32e5553749023d490d553ae4653750c52e844
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPrint vping output instead of Paramiko object 87/57987/1
Cédric Ollivier [Mon, 28 May 2018 07:04:12 +0000 (09:04 +0200)]
Print vping output instead of Paramiko object

Change-Id: Iddc1abdf443e482e8748434a4ba7d85709d8cd0e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Stop rolling snaps (bypass bugfixes)"
Cedric Ollivier [Sun, 27 May 2018 08:23:09 +0000 (08:23 +0000)]
Merge "Stop rolling snaps (bypass bugfixes)"

6 years agoStop rolling snaps (bypass bugfixes) 69/57969/1
Cédric Ollivier [Sun, 27 May 2018 07:58:58 +0000 (09:58 +0200)]
Stop rolling snaps (bypass bugfixes)

Snaps now requires admin role for creating routers [1].

[1] https://git.opnfv.org/snaps/commit/?id=5a81c2abb920cfe5ea975c37b390838d586a98b1

Change-Id: Ia9a5225e0e31fa3e1c50abb3814e12c98d53e76c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>