functest.git
6 years agoPrecise vyos_vrouter logs 45/55445/2
Cédric Ollivier [Wed, 11 Apr 2018 18:57:02 +0000 (20:57 +0200)]
Precise vyos_vrouter logs

Aborting was written even if it worked after rebooting the vm [1].

[1] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/41/console

Change-Id: Idb29624b8793df5d77d401b375aa3b3176778ddf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Take all cmd status into account in juju_epc"
Cedric Ollivier [Wed, 11 Apr 2018 13:56:56 +0000 (13:56 +0000)]
Merge "Take all cmd status into account in juju_epc"

6 years agoMerge "Leverage on SDN_CONTROLLER_IP if fuel"
Cedric Ollivier [Wed, 11 Apr 2018 12:26:16 +0000 (12:26 +0000)]
Merge "Leverage on SDN_CONTROLLER_IP if fuel"

6 years agoMerge "Remove obsolete apex processing in juju_epc"
Cedric Ollivier [Wed, 11 Apr 2018 12:25:26 +0000 (12:25 +0000)]
Merge "Remove obsolete apex processing in juju_epc"

6 years agoTake all cmd status into account in juju_epc 15/55415/1
Cédric Ollivier [Wed, 11 Apr 2018 12:21:19 +0000 (14:21 +0200)]
Take all cmd status into account in juju_epc

It also puts output in functest.log instead of /dev/stdout.

Change-Id: I3a4b5f81edd20a529821c5a684b3ab269b7c6796
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoLeverage on SDN_CONTROLLER_IP if fuel 97/55397/1
Cédric Ollivier [Wed, 11 Apr 2018 06:51:42 +0000 (08:51 +0200)]
Leverage on SDN_CONTROLLER_IP if fuel

It conforms with [1].

[1] https://jira.opnfv.org/browse/FUEL-352

Change-Id: Idae142de8de09203509c73c35c2e7fea5a5d880b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove obsolete apex processing in juju_epc 91/55391/1
Cédric Ollivier [Wed, 11 Apr 2018 06:22:13 +0000 (08:22 +0200)]
Remove obsolete apex processing in juju_epc

It has been useless since [1] was merged

[1] https://jira.opnfv.org/browse/APEX-570

Change-Id: Id89b75d8cad9e180a02189450e13fa1e61b1239c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdated from global requirements 67/55367/1
Cédric Ollivier [Tue, 10 Apr 2018 19:44:00 +0000 (21:44 +0200)]
Updated from global requirements

Change-Id: I1eddb148ee6d1b85d3247260f9501f948ef6254f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Update userguide"
Cedric Ollivier [Tue, 10 Apr 2018 15:31:11 +0000 (15:31 +0000)]
Merge "Update userguide"

6 years agoUpdate userguide 67/54367/2
Linda Wang [Fri, 23 Mar 2018 03:43:08 +0000 (03:43 +0000)]
Update userguide

Change-Id: I2725ffcb4101496c2019d22215b1585fa3444775
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoRewrite 2 key changes in Release Notes 51/55251/1
Cédric Ollivier [Mon, 9 Apr 2018 16:22:50 +0000 (18:22 +0200)]
Rewrite 2 key changes in Release Notes

Change-Id: I58a168987caa207c80e84caa86e1d9880f726b22
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Run all VNFs vs SDN scenarios"
Cedric Ollivier [Mon, 9 Apr 2018 13:46:51 +0000 (13:46 +0000)]
Merge "Run all VNFs vs SDN scenarios"

6 years agoMerge "Add a key benefits section in Release Notes"
Cedric Ollivier [Mon, 9 Apr 2018 12:05:19 +0000 (12:05 +0000)]
Merge "Add a key benefits section in Release Notes"

6 years agoMerge "[fuel] Unite OpenDaylight ports"
Cedric Ollivier [Mon, 9 Apr 2018 10:08:19 +0000 (10:08 +0000)]
Merge "[fuel] Unite OpenDaylight ports"

6 years agoRun all VNFs vs SDN scenarios 13/55213/3
Cédric Ollivier [Mon, 9 Apr 2018 09:05:19 +0000 (11:05 +0200)]
Run all VNFs vs SDN scenarios

It allows a fair comparison between Neutron standalone and SDN
controllers. They should run successfully at least vs Daisy [1].

[1] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/lastSuccessfulBuild/

Change-Id: Iac34cd4d6eb070be0abe081fbc815e971675faef
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd a key benefits section in Release Notes 11/55211/2
Cédric Ollivier [Mon, 9 Apr 2018 08:47:03 +0000 (10:47 +0200)]
Add a key benefits section in Release Notes

It also precises the side effects if test cases are in failure.

Change-Id: Id4a2a3428da33deed51415fce5d98b81e64d35fe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Remove Ceilometer test scenarios"
Cedric Ollivier [Mon, 9 Apr 2018 09:49:15 +0000 (09:49 +0000)]
Merge "Remove Ceilometer test scenarios"

6 years ago[fuel] Unite OpenDaylight ports 15/55215/2
Michael Polenchuk [Mon, 9 Apr 2018 09:09:03 +0000 (13:09 +0400)]
[fuel] Unite OpenDaylight ports

ODL Oxygen has only 1 connector by default,
so unite web and rest ports together.

Change-Id: Idd5bdd5da3dcc85fa25b82ab2d19107b2d005974
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
6 years agoRemove Ceilometer test scenarios 05/55205/1
Juha Kosonen [Mon, 9 Apr 2018 06:29:43 +0000 (09:29 +0300)]
Remove Ceilometer test scenarios

The API utilized by Rally in Ceilometer scenarios was deprecated in
OpenStack Pike and scenarios were blacklisted. Remove these scenarios
from respository.

JIRA: FUNCTEST-949

Change-Id: I6f100cdb18853d177fd88ea7bd539f9837914f25
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoUpdate Release Note 87/55187/1
Cédric Ollivier [Sun, 8 Apr 2018 12:29:29 +0000 (14:29 +0200)]
Update Release Note

It also publishes last results per installer which have to be
updated before the release.

Change-Id: Ie72e8656935598653c56ef5c980f5f133457450a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoStop building functest-features(arm64) via travis-ci 25/55125/1
Cédric Ollivier [Sat, 7 Apr 2018 11:00:56 +0000 (13:00 +0200)]
Stop building functest-features(arm64) via travis-ci

It simply raises timeout which can't be increased.

Change-Id: Iba564873ccf7f50922641fad8987b1d7447f7ed2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoCheck .travis.yml via yamllint 23/55123/1
Cédric Ollivier [Sat, 7 Apr 2018 10:46:03 +0000 (12:46 +0200)]
Check .travis.yml via yamllint

Change-Id: I6f526c4c153ac6769a36c10e6480563c4345cfba
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate build.sh 17/55117/1
Cédric Ollivier [Sat, 7 Apr 2018 08:37:20 +0000 (10:37 +0200)]
Update build.sh

opnfv/functest-patrole and opnfv/functest-restapi were removed.

Change-Id: I68bf77eabf1851fd4aba826b950463e91bed8c10
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove domino and promise from upper-constraints 71/54971/2
Cédric Ollivier [Thu, 5 Apr 2018 07:50:44 +0000 (09:50 +0200)]
Remove domino and promise from upper-constraints

This projects have been inactive and should not be part of the next
releases.

Change-Id: I653c328aed0a4d3fe0bdb47be034bbccb9a16dcd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoBypass mismatches between pbr and readthedocs 07/54907/2
Cédric Ollivier [Wed, 4 Apr 2018 05:30:05 +0000 (07:30 +0200)]
Bypass mismatches between pbr and readthedocs

Change-Id: I09400b3b337e6fe8dbc53a52dab925d38227a80a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoCheck API doc via doc8 69/54869/2
Cédric Ollivier [Wed, 4 Apr 2018 04:50:19 +0000 (06:50 +0200)]
Check API doc via doc8

It also cleans unseless dirs.

Change-Id: I13be1359b36c49e8f199087fe2a23818c6d1b6e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix Functest Internship Reports 67/54867/4
Cédric Ollivier [Wed, 4 Apr 2018 04:24:12 +0000 (06:24 +0200)]
Fix Functest Internship Reports

It allows building these documentations via tox.
rst files are now checked via doc8.

Change-Id: I06096d466b672e4c171240c918d1c91e1b3dfd13
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix Functest Developer Guide 65/54865/3
Cédric Ollivier [Wed, 4 Apr 2018 03:45:36 +0000 (05:45 +0200)]
Fix Functest Developer Guide

It allows building this documentation via tox.
rst files are now checked via doc8.

Change-Id: I4f45dc2b6657466b05e7ceec60a751656552584e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix Functest User Guide 63/54863/3
Cédric Ollivier [Wed, 4 Apr 2018 03:31:23 +0000 (05:31 +0200)]
Fix Functest User Guide

It allows building this documentation via tox.
rst files are now checked via doc8.

Intro is moved into a new file.

Change-Id: If1dbe2cbde2f39ca4948ada2b2743594bc387dbc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix Functest Config Guide 31/54831/4
Cédric Ollivier [Tue, 3 Apr 2018 18:29:37 +0000 (20:29 +0200)]
Fix Functest Config Guide

It allows building this documentation via tox.
rst files are now checked via doc8.

Intro is moved into a new file.

Change-Id: Ic5c0108cf1cbb0fc69f7e2cc73cf2fb69e44baa1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix Functest Release Notes 67/54767/6
Cédric Ollivier [Tue, 3 Apr 2018 04:47:10 +0000 (06:47 +0200)]
Fix Functest Release Notes

It allows building this documentation via tox.
rst files are now checked via doc8.

Change-Id: I4cfec11b06319b5ccdcff5f7f14475375e778c01
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove NetVirt from installer dependencies 01/54701/4
Cédric Ollivier [Mon, 2 Apr 2018 02:54:07 +0000 (04:54 +0200)]
Remove NetVirt from installer dependencies

Change-Id: Idb937b3ed4896208048b90b705dc3e6db6104b60
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove opnfv/functest-restapi 09/54709/2
Cédric Ollivier [Fri, 30 Mar 2018 20:21:37 +0000 (22:21 +0200)]
Remove opnfv/functest-restapi

REST api server should run on top of all Functest containers by
overriding the default command.

We can safely remove it and meet the Docker Slicing approach.

Change-Id: Ibcc56490c931ae701bd31c52650081a115183e22
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoControl vping cleanup step via --noclean 21/54721/1
Linda Wang [Mon, 2 Apr 2018 09:25:14 +0000 (09:25 +0000)]
Control vping cleanup step via --noclean

Change-Id: Ic43b100348e77fd96aab9abc5a9ec4a0b47a2f87
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoAdd dependency for clover_k8s testcase 45/54545/3
QiLiang [Wed, 28 Mar 2018 09:08:18 +0000 (17:08 +0800)]
Add dependency for clover_k8s testcase

Clover testcase hook patch:
  https://gerrit.opnfv.org/gerrit/#/c/54541/

functest-kubernetes patch:
  https://gerrit.opnfv.org/gerrit/#/c/54543/

Tiny fix: remove -e for stor4nfv-tests

Change-Id: I68faafa2098ed304fbec2bcd647b258073b4f0c2
Signed-off-by: QiLiang <liangqi1@huawei.com>
6 years agoAllow check and verify as CI_LOOP values 33/54533/1
Cédric Ollivier [Tue, 27 Mar 2018 21:12:23 +0000 (23:12 +0200)]
Allow check and verify as CI_LOOP values

It's required by the new promotion model [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/54501/

Change-Id: Ie12aae1c24e05a61b2afd5bbf92a97f2c71fd395
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate Gambia Challenges presentation 49/54449/1
Cédric Ollivier [Sun, 25 Mar 2018 16:18:26 +0000 (18:18 +0200)]
Update Gambia Challenges presentation

It will be interesting to verify installers via
opnfv/functest-components too.

Change-Id: Ib5da2e35bce5f8a7013ad42b82b2f0e416129863
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd "Gambia Challenges" presentation 27/54427/1
Cédric Ollivier [Sat, 24 Mar 2018 16:17:16 +0000 (17:17 +0100)]
Add "Gambia Challenges" presentation

Change-Id: I16350b90f8bd8c5db7cad4aa28704b9bc908996c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Add Stor4NFV in upper-constraints.txt"
valentin boucher [Tue, 20 Mar 2018 12:11:26 +0000 (12:11 +0000)]
Merge "Add Stor4NFV in upper-constraints.txt"

6 years agoMerge "Implement trunk ports - Documentation part"
Cedric Ollivier [Tue, 20 Mar 2018 10:47:48 +0000 (10:47 +0000)]
Merge "Implement trunk ports - Documentation part"

6 years agoAdd Stor4NFV in upper-constraints.txt 57/53957/3
Qiaowei Ren [Fri, 16 Mar 2018 07:43:59 +0000 (15:43 +0800)]
Add Stor4NFV in upper-constraints.txt

This centralized file is reused by functest-kubernetes.

Change-Id: Id0d9d4bb4be4368ee8181f73e8c5626414d6291d
Signed-off-by: Qiaowei Ren <qiaowei.ren@intel.com>
6 years agoStop redirecting dnsmasq messages 87/54187/1
Cédric Ollivier [Tue, 20 Mar 2018 10:25:30 +0000 (11:25 +0100)]
Stop redirecting dnsmasq messages

Else dnsmasq is defunct: "dnsmasq: junk found in command line".

It partially reverts "Mute log in vnfs" [1] from the time being to
allow gating.

[1] https://gerrit.opnfv.org/gerrit/#/c/54043/

Change-Id: I660904b9e542f776f554562df2808db751cb9d2e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoImplement trunk ports - Documentation part 07/54107/3
Panagiotis Karalis [Mon, 19 Mar 2018 13:05:03 +0000 (15:05 +0200)]
Implement trunk ports - Documentation part

The tempest testcases have been integrated from Neutron trunk testcases.
The relevant documentation has been updated.

JIRA: FUNCTEST-926

Change-Id: I56cbd0ebb211a283e4e11df28ad6d1520d18e25a
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
6 years agoMerge "Put TestResults.json in the right dir"
Linda Wang [Tue, 20 Mar 2018 08:38:58 +0000 (08:38 +0000)]
Merge "Put TestResults.json in the right dir"

6 years agoMerge "Fix apidoc builds"
Linda Wang [Tue, 20 Mar 2018 08:38:13 +0000 (08:38 +0000)]
Merge "Fix apidoc builds"

6 years agoMerge "Remove unused code in vyos_vrouter"
Linda Wang [Tue, 20 Mar 2018 08:21:45 +0000 (08:21 +0000)]
Merge "Remove unused code in vyos_vrouter"

6 years agoMerge "Update the details of tempest results"
Cedric Ollivier [Tue, 20 Mar 2018 07:16:48 +0000 (07:16 +0000)]
Merge "Update the details of tempest results"

6 years agoUpdate the details of tempest results 79/54079/2
Linda Wang [Mon, 19 Mar 2018 07:40:11 +0000 (07:40 +0000)]
Update the details of tempest results

Change-Id: Idb18c7784e44030a48208ea64c21cde2536a3387
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoPut TestResults.json in the right dir 37/54137/2
Cédric Ollivier [Mon, 19 Mar 2018 21:35:10 +0000 (22:35 +0100)]
Put TestResults.json in the right dir

https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/26/console

Change-Id: Icfdc0030d517b1885a94c2815aeb35257fdfd590
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix apidoc builds 35/54135/4
Cédric Ollivier [Mon, 19 Mar 2018 20:36:49 +0000 (21:36 +0100)]
Fix apidoc builds

Change-Id: Id5846d0c66a52fa72b6cd32333f18c485877aa8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove unused code in vyos_vrouter 31/54131/2
Cédric Ollivier [Mon, 19 Mar 2018 17:39:17 +0000 (18:39 +0100)]
Remove unused code in vyos_vrouter

Change-Id: I0fcfa886bfb5133d5e4b3face1e649e4cf8b9fc0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoConform with vyos descritor updates 27/54127/1
Cédric Ollivier [Mon, 19 Mar 2018 16:56:42 +0000 (17:56 +0100)]
Conform with vyos descritor updates

The new inputs [1] must be set else the testcase simply fails [2].

JIRA: FUNCTEST-936

[1] https://github.com/oolorg/opnfv-vnf-vyos-blueprint/commit/794f8a0594ed4c461c7d1d08d6b0ef9fb12004e2
[2] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/12/console

Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I1113581feac7d4dc901ba197caed4fddd5994929

6 years agoUpdate xtesting to 0.31 91/54091/2
Cédric Ollivier [Mon, 19 Mar 2018 09:29:57 +0000 (10:29 +0100)]
Update xtesting to 0.31

It mainly fixes regex when INSTALLER_TYPE is unset [1]

[1] https://gerrit.opnfv.org/gerrit/#/c/54089/

Change-Id: I57430e87ec7b988337697417e319cf4f9b207e0d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAllow exceptions when deleting a missing verifier 45/54045/1
Cédric Ollivier [Sun, 18 Mar 2018 09:32:38 +0000 (10:32 +0100)]
Allow exceptions when deleting a missing verifier

Change-Id: I2e48bdcf9bce872a4a7855f9f6cd05d2b4897244
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMute log in vnfs 43/54043/1
Cédric Ollivier [Sat, 17 Mar 2018 22:28:34 +0000 (23:28 +0100)]
Mute log in vnfs

It also configures the nameserver when creating the subnet in
juju_epc.

Change-Id: I163ba99cd56f44ca3c3464398e182152b3ab74dd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRefactor refstack to limit instructions 41/54041/2
Cédric Ollivier [Sat, 17 Mar 2018 20:45:41 +0000 (21:45 +0100)]
Refactor refstack to limit instructions

Change-Id: I3cd490d18898d0ee6f48e4c19d7ed65c0cf0c275
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMute all rally messages 39/54039/2
Cédric Ollivier [Sat, 17 Mar 2018 20:44:44 +0000 (21:44 +0100)]
Mute all rally messages

The are now printed in functest.log only.

JIRA: FUNCTEST-950

Change-Id: I1fdd0e0f1be19fc5e7536326acb6a66645610696
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDecrease log levels when trying to connect 37/54037/1
Cédric Ollivier [Sat, 17 Mar 2018 13:25:15 +0000 (14:25 +0100)]
Decrease log levels when trying to connect

Only the last attempt should be printed in console.

Change-Id: Ic1ed5887195c98c64ade4558ac20ebd814e38bab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPrecise tempest regex 29/54029/1
Cédric Ollivier [Fri, 16 Mar 2018 22:26:24 +0000 (23:26 +0100)]
Precise tempest regex

It stops running neutron tests which matched the former regex.

Change-Id: Ica5a0d1f4858d01533156c98da87f9ed4662489f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRefactor Patrole to limit instructions 25/54025/1
Cédric Ollivier [Fri, 16 Mar 2018 21:39:56 +0000 (22:39 +0100)]
Refactor Patrole to limit instructions

Change-Id: Ie0ab079b1f674587ff3d68bf170df2296303780e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSet api_extensions = all for NeutronTrunk only 23/54023/1
Cédric Ollivier [Fri, 16 Mar 2018 21:38:55 +0000 (22:38 +0100)]
Set api_extensions = all for NeutronTrunk only

Change-Id: I6c019094a9cea86f5990752463a3690d4f00df0c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSet project_name arg when creating users 37/53937/3
Cédric Ollivier [Fri, 16 Mar 2018 06:14:40 +0000 (07:14 +0100)]
Set project_name arg when creating users

It also print snaps_creds to ease debugging [1].

[1] https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/22/console

Change-Id: I5b0d0dcffe3e45d8fa7d1d7d8ce19172fc42aaa1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDisable features in nofeature scenario 35/53935/2
Cédric Ollivier [Fri, 16 Mar 2018 02:36:07 +0000 (03:36 +0100)]
Disable features in nofeature scenario

Only Funtest testcases are verifying the referent scenarios.

Change-Id: I29dfa012e9cba39216fdd58e5fd59255844f335b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Create 2 images and flavors for tempest tests"
Cedric Ollivier [Thu, 15 Mar 2018 15:25:21 +0000 (15:25 +0000)]
Merge "Create 2 images and flavors for tempest tests"

6 years agoRemove the image for orchestra tests 61/53861/1
Linda Wang [Thu, 15 Mar 2018 09:26:15 +0000 (09:26 +0000)]
Remove the image for orchestra tests

Change-Id: I80797fc08c03795c6e1ec604306f77da7ecefc19
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoCreate 2 images and flavors for tempest tests 13/53613/8
Linda Wang [Tue, 13 Mar 2018 01:36:40 +0000 (01:36 +0000)]
Create 2 images and flavors for tempest tests

Also
1. remove the obsolete function: generate_test_accounts_file
2. Use patch mechanism to get config

Change-Id: I455ac37de71519bcaf9a51e5f1de1b9bc83b9ba6
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoSet blocking of patrole false 25/53825/2
Linda Wang [Thu, 15 Mar 2018 02:15:56 +0000 (02:15 +0000)]
Set blocking of patrole false

Change-Id: Ia6f0c6fec30af5c4124f21b2bdaa3084bced6f9e
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoMerge "Refactor TempestCommon to simplify subclasses"
valentin boucher [Wed, 14 Mar 2018 14:53:23 +0000 (14:53 +0000)]
Merge "Refactor TempestCommon to simplify subclasses"

6 years agoRefactor TempestCommon to simplify subclasses 53/53753/2
Cédric Ollivier [Wed, 14 Mar 2018 07:37:21 +0000 (08:37 +0100)]
Refactor TempestCommon to simplify subclasses

Change-Id: I8d265b6939861fd9d02a3d0f31aef53b9bfcb035
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoGet odl ip from env on Compass 49/53749/2
Linda Wang [Wed, 14 Mar 2018 04:17:05 +0000 (04:17 +0000)]
Get odl ip from env on Compass

Change-Id: I9ed2cdeef461c27381ecdfd56e5347ded61b5cb8
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoMerge "Implement trunk ports testcase"
Linda Wang [Wed, 14 Mar 2018 03:05:12 +0000 (03:05 +0000)]
Merge "Implement trunk ports testcase"

6 years agoLeverage on VOLUME_DEVICE_NAME if Fuel 23/53723/1
Cédric Ollivier [Tue, 13 Mar 2018 20:21:53 +0000 (21:21 +0100)]
Leverage on VOLUME_DEVICE_NAME if Fuel

As Fuel sets VOLUME_DEVICE_NAME [1], the specific conditional
instruction can be removed.

[1] https://build.opnfv.org/ci/job/functest-fuel-baremetal-daily-master/18/console

Change-Id: Iee3fd7c969cf31c8017b73c6ffd646f0e33a9e73
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoBypass APEX-570 when publishing image metadata 97/53697/2
Cédric Ollivier [Tue, 13 Mar 2018 15:27:39 +0000 (16:27 +0100)]
Bypass APEX-570 when publishing image metadata

This temporarily fix aims at testing juju_epc vs a non default region
name [1]. It must be removed as soon as APEX is fixed [2].

It completes the previous patch which only modified credentials [3].

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/lastFailedBuild/console
[2] https://jira.opnfv.org/browse/APEX-570
[3] https://gerrit.opnfv.org/gerrit/#/c/53465/

Change-Id: I3e1e64ad7147ee5cdf899eb2500f8b825b818619
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoImplement trunk ports testcase 21/52521/23
Panagiotis Karalis [Fri, 23 Feb 2018 12:56:25 +0000 (14:56 +0200)]
Implement trunk ports testcase

The tempest testcases have been integrated from Neutron trunk
testcases. It also enables every Neutron extension which may raise
side effects [1].

[1] https://docs.openstack.org/tempest/latest/sampleconf.html

JIRA: FUNCTEST-926

Change-Id: I05015acf119f504ce0a5539d677719de874594ad
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
6 years agoMerge "Add patrole in smoke"
Cedric Ollivier [Tue, 13 Mar 2018 12:14:05 +0000 (12:14 +0000)]
Merge "Add patrole in smoke"

6 years agoAdd patrole in smoke 59/53659/3
Cédric Ollivier [Tue, 13 Mar 2018 10:08:36 +0000 (11:08 +0100)]
Add patrole in smoke

It also removes the former container which had helped when
checking possible regex issues.

I should be noted that patrole is already part of
opnfv/functest-restapi.

Change-Id: I76783bc3d121dfcef5b709f21a5e474354e93705
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix tempest_custom 39/53639/1
Linda Wang [Tue, 13 Mar 2018 07:54:10 +0000 (07:54 +0000)]
Fix tempest_custom

Change-Id: I684c06eae899d9bc468e0be6a1537f9c942e86ce
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoRemove orchestra testcases 91/53591/1
Cédric Ollivier [Mon, 12 Mar 2018 16:32:04 +0000 (17:32 +0100)]
Remove orchestra testcases

They are incompatible with Pike and they have to be removed without
any deep update.

The testcases will be re-renabled if updated before 03/16/18.

Change-Id: Ibf656db6ba4177eae44feb41cd5d314b7408d4de
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Stopping setting identity-feature-enabled if Patrole"
Cedric Ollivier [Mon, 12 Mar 2018 14:42:35 +0000 (14:42 +0000)]
Merge "Stopping setting identity-feature-enabled if Patrole"

6 years agoMerge changes from topic 'refactor_tempest'
Cedric Ollivier [Mon, 12 Mar 2018 14:42:23 +0000 (14:42 +0000)]
Merge changes from topic 'refactor_tempest'

* changes:
  Rewrite refstack testcase
  Fix many pylint warnings

6 years agoMerge changes from topic 'refactor_tempest'
Cedric Ollivier [Mon, 12 Mar 2018 14:38:42 +0000 (14:38 +0000)]
Merge changes from topic 'refactor_tempest'

* changes:
  Refactor configure_tempest_patrole()
  Improve tempest files management

6 years agoStopping setting identity-feature-enabled if Patrole 29/53529/1
Cédric Ollivier [Mon, 12 Mar 2018 12:32:14 +0000 (13:32 +0100)]
Stopping setting identity-feature-enabled if Patrole

It avoids differing from all other tempest-based testcases for a
useless config option.

Change-Id: I02e1786f0ba3c1f7da11f258e80f57ca624247f9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Add patrole in opnfv/functest-restapi"
valentin boucher [Mon, 12 Mar 2018 12:22:56 +0000 (12:22 +0000)]
Merge "Add patrole in opnfv/functest-restapi"

6 years agoRewrite refstack testcase 63/53463/6
Cédric Ollivier [Sun, 11 Mar 2018 11:44:01 +0000 (12:44 +0100)]
Rewrite refstack testcase

It now leverages on rally to factorize code between all tempest-based
testcases.

refstack-client is also added as requirement.

JIRA: FUNCTEST-942

Change-Id: Ieee845327f8736582d77b898edd6c9edd00667e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix many pylint warnings 75/53475/1
Cédric Ollivier [Sun, 11 Mar 2018 18:16:09 +0000 (19:16 +0100)]
Fix many pylint warnings

Only pylint warnings in vnf modules has to be fixed now.

Change-Id: Ie71230072a51bb72ec0b1d4fef2652494d29948e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoBypass APEX-570 to allow gating juju_epc 65/53465/1
Cédric Ollivier [Sun, 11 Mar 2018 12:05:18 +0000 (13:05 +0100)]
Bypass APEX-570 to allow gating juju_epc

This temporarily fix aims at testing juju_epc vs a non default region
name [1]. It must be removed as soon as APEX is fixed [2].

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/lastFailedBuild/console
[2] https://jira.opnfv.org/browse/APEX-570

Change-Id: I0724b694efb43709d43da6a30e11d1daafee47d8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRefactor configure_tempest_patrole() 61/53461/1
Cédric Ollivier [Sun, 11 Mar 2018 08:48:16 +0000 (09:48 +0100)]
Refactor configure_tempest_patrole()

Change-Id: I1c34b3bce68a7d57d63fb2e5e4b6aa003dda8f61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoImprove tempest files management 57/53457/1
Cédric Ollivier [Sat, 10 Mar 2018 20:06:37 +0000 (21:06 +0100)]
Improve tempest files management

Calling apply_tempest_blacklist() is no longer mandatory.

Change-Id: Id9a4e970c8acca066a36be89920745127867cd63
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd patrole in opnfv/functest-restapi 53/53453/1
Cédric Ollivier [Sat, 10 Mar 2018 13:35:53 +0000 (14:35 +0100)]
Add patrole in opnfv/functest-restapi

Change-Id: I983898c27477986d9a5610e1df966fd00a8bc785
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoEnhance patrole configurations 51/53451/2
Cédric Ollivier [Sat, 10 Mar 2018 12:34:43 +0000 (13:34 +0100)]
Enhance patrole configurations

It allows listing the OpenStack services tested or setting test
exlusions (e.g. tests requiring GRE as overlay).

It should be noted that Keystone and Nova can't currently be tested
without their default policy.json.

Change-Id: I8909694b4ffc315959504441f5ea0b1f3023fe7c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd one missing res dir in refstack 33/53433/1
Cédric Ollivier [Fri, 9 Mar 2018 20:01:15 +0000 (21:01 +0100)]
Add one missing res dir in refstack

It completes "Allow overriding tempest output dir" [1]

[1] https://gerrit.opnfv.org/gerrit/#/c/53241/

Change-Id: I236a1eb708de324dd42440897e317ce2d0787ffc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove duplicate ubuntu trusty/14.04 os image 11/53311/1
Valentin Boucher [Thu, 8 Mar 2018 14:21:39 +0000 (09:21 -0500)]
Remove duplicate ubuntu trusty/14.04 os image

VNF testcase use some Operating System image
2 of those are the same but not with the same name

Change-Id: Ide5ae683f606f7f58535c0a59cec45e4a30d225c
Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
6 years agoAdd neutron and glance policy.json for patrole 23/53223/6
Cédric Ollivier [Wed, 7 Mar 2018 09:26:26 +0000 (10:26 +0100)]
Add neutron and glance policy.json for patrole

It only runs tests about neutron and glance because their policy.json
can be still downloaded. Installers could override them via docker
volumes if needed.

Several tests about provider networks are currently excluded because
GRE is selected.

Change-Id: Ic4e2274e3f53e66be0174e117993e8c307b96bf9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAllow overriding tempest output dir 41/53241/3
Cédric Ollivier [Wed, 7 Mar 2018 13:02:08 +0000 (14:02 +0100)]
Allow overriding tempest output dir

Change-Id: I31a5d2772bab168b3cb4e6b0713d6e95aa5b6fd7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSet ODL tests and refstack client refs 21/53221/1
Cédric Ollivier [Wed, 7 Mar 2018 04:57:33 +0000 (05:57 +0100)]
Set ODL tests and refstack client refs

To prepare F-release, we should set git commit ids for these
dependencies which follow the rolling release model (master).

Change-Id: I3c791040ea5ec700cfa845ae642e6d862c49281f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd a new env var for nameserver 73/53073/3
Linda Wang [Mon, 5 Mar 2018 03:14:23 +0000 (03:14 +0000)]
Add a new env var for nameserver

We should still consider that the nameserver must be handled by all
installers instead [1]:
  - by configuring one or more DNS resolvers in dhcp_agent.ini
  - by asking a local resolv

It eases setting the nameserver in testcases and then allows gating
them. 8.8.8.8 is still defined by default.

[1] https://docs.openstack.org/neutron/pike/admin/config-dns-res.html

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Id58dd5ebee612a0fce2ebc40f089769e60899416
Signed-off-by: Linda Wang <wangwulin@huawei.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDefine a new env var for volume device name 95/53195/2
Cédric Ollivier [Wed, 7 Mar 2018 01:15:20 +0000 (02:15 +0100)]
Define a new env var for volume device name

It eases modifying the volume device name written in tempest config.
Fuel jobs should be adapted to set the right value (vdc) which
differs from default (vdb).

Change-Id: I09212018f94daa800ede815bd3586cceed0d54e7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Fix Rally scenario parameters representation"
Cedric Ollivier [Mon, 5 Mar 2018 16:26:34 +0000 (16:26 +0000)]
Merge "Fix Rally scenario parameters representation"

6 years agoFix Rally scenario parameters representation 01/53101/1
Juha Kosonen [Mon, 5 Mar 2018 15:17:53 +0000 (17:17 +0200)]
Fix Rally scenario parameters representation

Use printable format of string in scenario input parameters.

JIRA: FUNCTEST-946

Change-Id: Ic4826506a6f030e749fecdc7f880e9f911f9c987
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoMerge "Load SfcFunctest instead of running a bash script"
Cedric Ollivier [Mon, 5 Mar 2018 14:49:55 +0000 (14:49 +0000)]
Merge "Load SfcFunctest instead of running a bash script"