functest.git
7 years agoFix rally cinder scenarios 17/46717/1
Juha Kosonen [Sat, 4 Nov 2017 16:24:55 +0000 (18:24 +0200)]
Fix rally cinder scenarios

Remove network and servers context and set image and flavor as a
scenario parameters.

Change-Id: I5181ccce61c4f58af3737619d1b7d259cf539937
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
7 years agoRemove the constraint of INSTALLER_TYPE 55/46655/1
Linda Wang [Fri, 3 Nov 2017 08:54:06 +0000 (08:54 +0000)]
Remove the constraint of INSTALLER_TYPE

Revert the patch: https://gerrit.opnfv.org/gerrit/#/c/45167
When run on non-opnfv deployment, there is no such concept of INSTALLER_TYPE.

Change-Id: I3d420334c9329f7565cf22a0c314a4ffdb410d36
Signed-off-by: Linda Wang <wangwulin@huawei.com>
7 years agoAdd new neutron scenarios for rally sanity/full 63/46563/1
Juha Kosonen [Thu, 2 Nov 2017 14:25:00 +0000 (16:25 +0200)]
Add new neutron scenarios for rally sanity/full

Included several new NeutronNetworks and NeutronSecurityGroup
scenarios introduced by the recent Rally version.

Change-Id: I87ad0947ab6b4e1faf8fcad9006dbe34251c313b
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
7 years agoMerge "Update INFO file"
Cedric Ollivier [Thu, 2 Nov 2017 07:57:43 +0000 (07:57 +0000)]
Merge "Update INFO file"

7 years agoAdopt new config schema for rally 0.10 41/46541/3
Linda Wang [Thu, 2 Nov 2017 02:17:37 +0000 (02:17 +0000)]
Adopt new config schema for rally 0.10

The new config schema is used by Rally 0.10:
https://raw.githubusercontent.com/openstack/rally/master/samples/deployments/existing-keystone-v3.json

JIRA: FUNCTEST-883

Change-Id: I67c0081e23d7a763934ef2f8ce09f122c33af902
Signed-off-by: Linda Wang <wangwulin@huawei.com>
7 years agoUpdate INFO file 37/46537/1
valentin boucher [Wed, 1 Nov 2017 20:11:43 +0000 (20:11 +0000)]
Update INFO file

Change-Id: Ib55a58f24a0a363929b58bfaa8e3c38e74396e11
Signed-off-by: valentin boucher <valentin.boucher@kontron.com>
7 years agoAdd new nova scenarios for rally sanity/full 33/46533/1
Juha Kosonen [Wed, 1 Nov 2017 18:11:36 +0000 (20:11 +0200)]
Add new nova scenarios for rally sanity/full

Several new NovaServers and NovaServerGroups scenarios available along
with the recent Rally update.

Change-Id: Iee27174923da5a1a25991d8ab5e18f1d404b09ef
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
7 years agoMerge "Add new glance scenarios for rally 0.10"
Linda Wang [Wed, 1 Nov 2017 09:06:28 +0000 (09:06 +0000)]
Merge "Add new glance scenarios for rally 0.10"

7 years agoAdd new glance scenarios for rally 0.10 61/46461/2
Linda Wang [Tue, 31 Oct 2017 07:10:17 +0000 (07:10 +0000)]
Add new glance scenarios for rally 0.10

Some new glance scenarios have been added in Rally stable/0.10 [1].

[1]: https://github.com/openstack/rally/releases/tag/0.10.0

Co-Authored-By: Juha Kosonen <juha.kosonen@nokia.com>
Change-Id: I91ffe31b8cc5c94991c9bdd6e33b756c447d82ce
Signed-off-by: Linda Wang <wangwulin@huawei.com>
7 years agoRemove some obsolete scenarios for rally 0.10 59/46459/1
Linda Wang [Tue, 31 Oct 2017 06:35:33 +0000 (06:35 +0000)]
Remove some obsolete scenarios for rally 0.10

Nova-Network are not alive any more and have been removed
in Rally stable/0.10 [1].
[1]: https://github.com/openstack/rally/releases/tag/0.10.0

JIRA: FUNCTEST-883

Change-Id: I45a20504589003a39ff27770709de6881e69aee3
Signed-off-by: Linda Wang <wangwulin@huawei.com>
7 years agoUpdate Rally to 0.10 11/46411/4
Cédric Ollivier [Mon, 30 Oct 2017 08:52:34 +0000 (09:52 +0100)]
Update Rally to 0.10

It requires to sync os-faults with OpenStack requirements as it's
out-of-tree too. The last os-faults version is selected as well.

Change-Id: I0c582070a937b6ba6cba5b0c17673f42ea5d6dec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoBump os-faults version to 0.1.15 35/46235/3
Linda Wang [Thu, 26 Oct 2017 02:29:08 +0000 (02:29 +0000)]
Bump os-faults version to 0.1.15

For Rally stable/0.9, os-faults version has been constrained
as ">=0.1.15,<0.2.0" [1].

[1]: https://github.com/openstack/rally/blob/stable/0.9/requirements.txt

JIRA: PROMISE-88

Change-Id: Ifeb36e1debf23edf6d914e9db60be11d4ca557cd
Signed-off-by: Linda Wang <wangwulin@huawei.com>
7 years agoUpdate INFO file 99/46199/2
Jose Lausuch [Wed, 25 Oct 2017 07:25:46 +0000 (09:25 +0200)]
Update INFO file

Change-Id: I8200c124598794f5e7b380ff238e81c21531620c
Signed-off-by: Jose Lausuch <jalausuch@suse.com>
7 years agoWrap Functest Ascii Diagram in literal text block 53/46053/1
Trevor Bramwell [Fri, 20 Oct 2017 18:16:34 +0000 (11:16 -0700)]
Wrap Functest Ascii Diagram in literal text block

Sphinx currently thinks this diagram is a table and outputing a warning.
Using '::' provides a hint to sphinx that the ascii diagram is literal
text and not a table.

Change-Id: Ie005cc059b9e97aacda0d75d0213b18477e55d38
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
7 years agoSave Euphrates results in repo 27/46027/2
Morgan Richomme [Fri, 20 Oct 2017 10:04:54 +0000 (12:04 +0200)]
Save Euphrates results in repo

Change-Id: I6e7fb1d4b81572a151f47fc071a1ae27f1b41e97
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
7 years agoGet the right git commit ids for ubuntu image 41/45941/2
Linda Wang [Fri, 20 Oct 2017 03:46:17 +0000 (03:46 +0000)]
Get the right git commit ids for ubuntu image

Complement https://gerrit.opnfv.org/gerrit/#/c/45017

Change-Id: If52dee7c16dcc8606e72ebc198bc36e713792418
Signed-off-by: Linda Wang <wangwulin@huawei.com>
7 years agoTake into account a feedback from the meeting 61/45861/1
Cédric Ollivier [Thu, 19 Oct 2017 18:30:07 +0000 (20:30 +0200)]
Take into account a feedback from the meeting

Change-Id: Ia221d08003588aae045604a18ce1ecc833f0e34e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoMerge "Switch from BashFeature to Feature of bgpvpn testcase"
Jose Lausuch [Thu, 19 Oct 2017 13:59:38 +0000 (13:59 +0000)]
Merge "Switch from BashFeature to Feature of bgpvpn testcase"

7 years agoMerge "Release notes for Euphrates 5.0"
Cedric Ollivier [Thu, 19 Oct 2017 12:16:07 +0000 (12:16 +0000)]
Merge "Release notes for Euphrates 5.0"

7 years agoRelease notes for Euphrates 5.0 11/45611/8
Jose Lausuch [Wed, 18 Oct 2017 19:15:52 +0000 (21:15 +0200)]
Release notes for Euphrates 5.0

Change-Id: Icdce56bdacba8530cc2f35c8f3c6b1acfd4bf522
Signed-off-by: Jose Lausuch <jalausuch@suse.com>
7 years agoSwitch from BashFeature to Feature of bgpvpn testcase 93/45493/2
Jose Lausuch [Wed, 18 Oct 2017 09:26:21 +0000 (11:26 +0200)]
Switch from BashFeature to Feature of bgpvpn testcase

With the adaptation in SDNVPN project [1], Functest
can run the tests within python instead of a bash call.

This also fixes pushing the details section to the DB:
JIRA: SDNVPN-183

[1] https://gerrit.opnfv.org/gerrit/#/c/45491/

Change-Id: I7116aa9d5ffe2a816719997771e4f4ecebbcd083
Signed-off-by: Jose Lausuch <jalausuch@suse.com>
7 years agoMerge "Harmonization titles of the testing project"
Morgan Richomme [Wed, 18 Oct 2017 16:02:45 +0000 (16:02 +0000)]
Merge "Harmonization titles of the testing project"

7 years agoFix another typos in dockerslicing.md 63/45563/1
Cédric Ollivier [Wed, 18 Oct 2017 14:28:15 +0000 (16:28 +0200)]
Fix another typos in dockerslicing.md

Change-Id: I16f28649b000e9370e7c71f36668c417854fb91e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoFix 1 typo in dockerslicing.md 29/45529/1
Cédric Ollivier [Wed, 18 Oct 2017 12:53:03 +0000 (14:53 +0200)]
Fix 1 typo in dockerslicing.md

Change-Id: I0bb4c46d3b554cca1dfcaafbf564d9871957c346
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoMerge "Complete dockerslicing.md"
Cedric Ollivier [Wed, 18 Oct 2017 12:13:15 +0000 (12:13 +0000)]
Merge "Complete dockerslicing.md"

7 years agoHarmonization titles of the testing project 51/45451/3
Morgan Richomme [Wed, 18 Oct 2017 06:46:34 +0000 (08:46 +0200)]
Harmonization titles of the testing project

Change-Id: I9ebb488d77274219fca556760f0408a2bb1f6880
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
7 years agoComplete dockerslicing.md 81/45381/5
Cédric Ollivier [Tue, 17 Oct 2017 18:06:41 +0000 (20:06 +0200)]
Complete dockerslicing.md

It mainly precises that all requirements were not synchronized over
the OPNFV projects in Danube and adds 2 OPNFV project poposals.

Change-Id: I2e89f9cdf3db58d41acaa31560232807988bd84a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoUpdate blacklist about migration tests for rally 17/45317/2
Linda Wang [Tue, 17 Oct 2017 09:25:06 +0000 (09:25 +0000)]
Update blacklist about migration tests for rally

The test NovaServers.boot_and_migrate_server needs at least 2 compute
nodes:
https://github.com/openstack/rally/blob/stable/0.9/rally/plugins/openstack/scenarios/nova/servers.py#L763-L765

Change-Id: I4ddf99188094ced57225d886037b00e91f3b68e6
Signed-off-by: Linda Wang <wangwulin@huawei.com>
7 years agoMerge "Enhance the compatibility judgement of INSTALLER"
Cedric Ollivier [Tue, 17 Oct 2017 04:52:33 +0000 (04:52 +0000)]
Merge "Enhance the compatibility judgement of INSTALLER"

7 years agoUpdate Docker slicing presentation 39/45239/1
Cédric Ollivier [Mon, 16 Oct 2017 15:22:39 +0000 (17:22 +0200)]
Update Docker slicing presentation

It conforms with Euphrates.

Change-Id: I44b65ce75147381c7d437881c6c8da9cfe3aab21
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoUpdate requests to 2.13.0 in virtualenvs 97/45197/1
Cédric Ollivier [Mon, 16 Oct 2017 09:42:47 +0000 (11:42 +0200)]
Update requests to 2.13.0 in virtualenvs

It completes "Force requests===2.13.0" [1] which only updated all
Docker files.

[1] https://gerrit.opnfv.org/gerrit/#/c/45077/

Change-Id: I416e01d86e82eb9e267a31463e75b6a4e11485c4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoEnhance the compatibility judgement of INSTALLER 67/45167/1
Linda Wang [Mon, 16 Oct 2017 02:34:03 +0000 (02:34 +0000)]
Enhance the compatibility judgement of INSTALLER

When the env INSTALLER_TYPE is None, while the var installer in
dependencies is not None, the current test case should not be run.

Change-Id: If1b67f16f39d5c44b2c3729819dd665faed41b73
Signed-off-by: Linda Wang <wangwulin@huawei.com>
7 years agoUpdate project field of fds testcase to fastdatastacks 05/45105/2
juraj.linkes [Sat, 14 Oct 2017 08:21:18 +0000 (10:21 +0200)]
Update project field of fds testcase to fastdatastacks

Fds testcases is defined under project fastdatastacks, not
functest. The fix is required for testcase results uploads.

Change-Id: Ided0701048d0b4c0257c62d600893672960d83df
Signed-off-by: juraj.linkes <jlinkes@cisco.com>
7 years agoForce requests===2.13.0 77/45077/1
Cédric Ollivier [Fri, 13 Oct 2017 20:43:30 +0000 (22:43 +0200)]
Force requests===2.13.0

It overrides OpenStack's upper-constraints to allow rally to work vs
a self signed certificate.

It will be pushed to the right OpenStack project after the patch is
confirmed by CI. Euphrates will be released too early regarding the
full upstream cycle required.

JIRA: FUNCTEST-876

Change-Id: I52656f8b98fced103f13dde039082806636c680a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoFix former default values in build.sh 23/45023/1
Cédric Ollivier [Fri, 13 Oct 2017 12:57:18 +0000 (14:57 +0200)]
Fix former default values in build.sh

Change-Id: I56abd4b22444615cbe27e13475d9f00a98e62cd7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoGet the right git commit ids 17/45017/1
Cédric Ollivier [Fri, 13 Oct 2017 12:29:14 +0000 (14:29 +0200)]
Get the right git commit ids

Co-Authored-By: Linda Wang <wangwulin@huawei.com>
Change-Id: I08ad30156049ac0814fcebfc0f116176331c1dd3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoConform with Docker ARCH names 99/44999/1
Cédric Ollivier [Fri, 13 Oct 2017 08:38:38 +0000 (10:38 +0200)]
Conform with Docker ARCH names

It switches Docker tags:
  - x86_64 -> amd64
  - aarch64 -> arm64

Change-Id: I05575dd728e7502a891a3ee3015f81ac8e3f7a92
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoMerge changes I11fdef41,I2b6cf113
Cedric Ollivier [Thu, 12 Oct 2017 14:00:15 +0000 (14:00 +0000)]
Merge changes I11fdef41,I2b6cf113

* changes:
  Allow building aarch64 images
  Publish Docker Slicing Presentation

7 years agoAllow building aarch64 images 01/44801/4
Cédric Ollivier [Wed, 11 Oct 2017 03:29:11 +0000 (05:29 +0200)]
Allow building aarch64 images

It must be noted that Docker automated build cannot create these
images as the prerequisites are unmet to cross-compile [1].

It also publishes a travis config file [2].

[1] https://www.kernel.org/doc/html/v4.11/admin-guide/binfmt-misc.html
[2] https://travis-ci.org/collivier/functest/builds/286932633

Change-Id: I11fdef410cc40989132205a098410175f789fdef
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoPublish Docker Slicing Presentation 81/44681/2
Cédric Ollivier [Tue, 10 Oct 2017 13:44:00 +0000 (15:44 +0200)]
Publish Docker Slicing Presentation

It published the presentation done in the Functest Breakout during
last OPNFV Summit (2017 in Beijing) [1].

Minor changes are planned to update it in a second change.

Git now ignores pdf which may be generated via reveal.js.

[1] http://testresults.opnfv.org/functest/dockerslicing/

Change-Id: I2b6cf113c672320bf1bc34442bb267fd99012546
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoUpdate userguide and configguide 47/44747/6
Linda Wang [Wed, 11 Oct 2017 02:36:17 +0000 (02:36 +0000)]
Update userguide and configguide

Mainly remove the duplicated declaration of cloudify_ims_perf.

Change-Id: Ic23cee0e2dbb863cfddc98b08eabdab7d52e0476
Signed-off-by: Linda Wang <wangwulin@huawei.com>
7 years agoMerge "Fix fail of vRouter on Orange POD"
Morgan Richomme [Wed, 11 Oct 2017 08:57:22 +0000 (08:57 +0000)]
Merge "Fix fail of vRouter on Orange POD"

7 years agoFix fail of vRouter on Orange POD 41/44641/3
root [Tue, 10 Oct 2017 11:08:40 +0000 (11:08 +0000)]
Fix fail of vRouter on Orange POD

1. Functest docker container environment has no attribute 'OS_REGION_NAME'
2. vRouter was get the 'OS_REGION_NAME' but not used it.
3. Deleting use 'OS_REGION_NAME' part of vRouter.
4. Utility lib of vRouter use Nova client.
5. Modifying Nova client authentication step for auth api v3.
6. Doing test of modified vRouter on Orange POD.

Change-Id: I062549e5ca48fb4825b53448a4e2ffc8c1f8ec40
Signed-off-by: root <shuya.nakama@okinawaopenlabs.org>
7 years agoMerge "Include tempest_custom in the documentation"
Jose Lausuch [Wed, 11 Oct 2017 07:56:55 +0000 (07:56 +0000)]
Merge "Include tempest_custom in the documentation"

7 years agoInclude tempest_custom in the documentation 89/44689/5
Jose Lausuch [Tue, 10 Oct 2017 14:17:15 +0000 (16:17 +0200)]
Include tempest_custom in the documentation

Change-Id: I86300fff399d1bc73eeeed76b5057e3f6d2f85f3
Signed-off-by: Jose Lausuch <jalausuch@suse.com>
7 years agoMerge "Fix the format issue of documentation"
Jose Lausuch [Tue, 10 Oct 2017 14:42:25 +0000 (14:42 +0000)]
Merge "Fix the format issue of documentation"

7 years agoFix the format issue of documentation 45/44645/6
Linda Wang [Tue, 10 Oct 2017 11:29:42 +0000 (11:29 +0000)]
Fix the format issue of documentation

Also update the structure of functest code.

Change-Id: Id3fa012d6c3204a0a8d7e6e4ba3159c52b68c6f5
Signed-off-by: Linda Wang <wangwulin@huawei.com>
7 years agoMerge "Modify the egg name for parser"
Morgan Richomme [Tue, 10 Oct 2017 13:21:09 +0000 (13:21 +0000)]
Merge "Modify the egg name for parser"

7 years agoMerge "Complete framework documentation part for VNF"
Jose Lausuch [Tue, 10 Oct 2017 12:20:35 +0000 (12:20 +0000)]
Merge "Complete framework documentation part for VNF"

7 years agoModify the egg name for parser 59/44659/2
shangxdy [Tue, 10 Oct 2017 12:08:13 +0000 (20:08 +0800)]
Modify the egg name for parser

Currently the egg name for heat-translator has been changed
to nfv-heattranslator in parser project, this patch will modify
the docker file.
related patches:
https://gerrit.opnfv.org/gerrit/#/c/41261/

Change-Id: I2d5d214c722fc133aa015a1c9620a49709db17bb
Signed-off-by: shangxdy <shang.xiaodong@zte.com.cn>
7 years agoComplete framework documentation part for VNF 61/44561/5
Morgan Richomme [Mon, 9 Oct 2017 11:53:25 +0000 (13:53 +0200)]
Complete framework documentation part for VNF

Change-Id: I4c59adfe1cfec278e0b267cc7a05e8addd45d034
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
7 years agoAdd UEFI image extra properties for CentOS image for aarch64 65/44565/1
Delia Popescu [Mon, 9 Oct 2017 12:24:45 +0000 (15:24 +0300)]
Add UEFI image extra properties for CentOS image for aarch64

Add extra properties for CentOS image when using aarch64
architecture with UEFI boot mode

Signed-off-by: Delia Popescu <delia.popescu@enea.com>
Change-Id: Ie8aa7482627cbb3c31c6c72a31a0e37e86a409c4

7 years agoMerge "Update Config Guide"
Morgan Richomme [Thu, 5 Oct 2017 16:12:55 +0000 (16:12 +0000)]
Merge "Update Config Guide"

7 years agoUpdate Config Guide 25/44125/3
Jose Lausuch [Tue, 3 Oct 2017 08:46:58 +0000 (10:46 +0200)]
Update Config Guide

Change-Id: If7295f553f203171f5a6efebc8d553d5dca8433a
Signed-off-by: Jose Lausuch <jalausuch@suse.com>
7 years agoLive migration support determination in rally 45/44345/1
Juha Kosonen [Thu, 5 Oct 2017 09:53:08 +0000 (12:53 +0300)]
Live migration support determination in rally

Live migration test cases were excluded if tempest was not executed
before rally since tempest config file is created during the execution
of tempest.

Remove the dependency to config file and define the support based on
the number of computes as done in tempest.

Change-Id: I57c18b7c57e6a4bc8bfbdfb4beb5f8d67c6269c4
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
7 years agoMerge changes Ic06d47b4,I7e8be6cd,Ia62e0f00
Morgan Richomme [Tue, 3 Oct 2017 06:35:52 +0000 (06:35 +0000)]
Merge changes Ic06d47b4,I7e8be6cd,Ia62e0f00

* changes:
  Disable vyos_vrouter
  Report duration and result when vping fails
  Create a router in both vping scenarii

7 years agoDisable vyos_vrouter 95/43995/1
Cédric Ollivier [Tue, 3 Oct 2017 04:29:23 +0000 (06:29 +0200)]
Disable vyos_vrouter

It's postponed to 5.1.

Change-Id: Ic06d47b4b5df167044363b40aea0c7932b550be7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoReport duration and result when vping fails 93/43993/1
Cédric Ollivier [Tue, 3 Oct 2017 04:16:20 +0000 (06:16 +0200)]
Report duration and result when vping fails

It completes "Bug fix: vping_userdata test status was not properly
reported" [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/43911/

Change-Id: I7e8be6cd564a24ca174e63cfc295861c51cae8ed
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoCreate a router in both vping scenarii 75/43975/1
Cédric Ollivier [Mon, 2 Oct 2017 22:27:36 +0000 (00:27 +0200)]
Create a router in both vping scenarii

It fixes vping_userdata as it allows getting metadata due to the
gateway defined for the subnet.

It could be noted that DHCP can add the route needed if no gateway is
defined and if force_metadata is set in dhcp_agent.ini.

Change-Id: Ia62e0f00e3d2caee6262dd9cd9966d1f21fe40d5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoAdd icmp rules for clearwaterims case 31/43931/2
Michael Pauls [Mon, 2 Oct 2017 17:36:42 +0000 (19:36 +0200)]
Add icmp rules for clearwaterims case

icmp rules must be enabled since a ping is used internally
to check that other components are up and reachable

Change-Id: I1ae3c301f30455c57193ddfe1757e971f5612c18
Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
7 years agoBug fix: vping_userdata test status was not properly reported 11/43911/2
Morgan Richomme [Mon, 2 Oct 2017 15:11:13 +0000 (17:11 +0200)]
Bug fix: vping_userdata test status was not properly reported

vping_base is calling vping_userdata
vping_user data could return only EX_TESTCASE_FAILED or EX_OK
by default vping_base always returns EX_OK (based on self.result=100..)
it returned EX_RUN_ERROR only if upper class report EX_RUN_ERROR

that is why vping_userdata was always PASS even if the trace "Ping OK"
cannot be retrieved from the Nova console

it seems that when running the vping_userdata, we systematically got
 Failed to read iid from metadata

Change-Id: If72441dd93bffada5c7a5399c87db68d7ebeebed
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
7 years agoAdd ${DOCKER_TAG} in Docker hooks 51/43851/1
Cédric Ollivier [Mon, 2 Oct 2017 11:12:40 +0000 (13:12 +0200)]
Add ${DOCKER_TAG} in Docker hooks

It eases creating Docker images based on branches or tags.

Change-Id: Id84513c53cad72a1fcd0debf06579481609b8bc2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoEnable promise on all fuel and joid scenarii 13/43813/1
Cédric Ollivier [Mon, 2 Oct 2017 07:56:02 +0000 (09:56 +0200)]
Enable promise on all fuel and joid scenarii

Change-Id: I9735788fbbe715968560570543d1dc9d55e065b7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoMerge "remove icmp rules from secgroups"
Morgan Richomme [Sun, 1 Oct 2017 15:28:21 +0000 (15:28 +0000)]
Merge "remove icmp rules from secgroups"

7 years agoRemove tempest_custom from testcases configs 79/43779/1
Cédric Ollivier [Sat, 30 Sep 2017 12:00:37 +0000 (14:00 +0200)]
Remove tempest_custom from testcases configs

Change-Id: I1237eaada5257a8c01753837a5820d840b51bff1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoFix userdata issue for vping and orchestra 93/43693/4
Linda Wang [Sat, 30 Sep 2017 02:29:30 +0000 (02:29 +0000)]
Fix userdata issue for vping and orchestra

1. When creating VM, the type of the param userdata should be str, to
   conform with that in snaps [1].
2. Remove the infinite loop for vping in userdata
3. Fix the criteria for vping_userdata and vping_ssh

[1]: https://git.opnfv.org/snaps/tree/snaps/openstack/utils/nova_utils.py#n92

Change-Id: I262a7ebb93ec90bb6f8f3acb5d564f210abcfc4b
Signed-off-by: Linda Wang <wangwulin@huawei.com>
7 years agoremove icmp rules from secgroups 09/43609/3
Michael Pauls [Fri, 29 Sep 2017 11:03:00 +0000 (13:03 +0200)]
remove icmp rules from secgroups

Change-Id: I8f7d2170eee9777be6455d38eaff703338b155fa
Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
7 years agoForce python2 when creating venv for refstack 51/43551/3
Linda Wang [Fri, 29 Sep 2017 05:15:59 +0000 (05:15 +0000)]
Force python2 when creating venv for refstack

python3 has been selected since it was installed for doctor [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/41823/

JIRA: FUNCTEST-875

Change-Id: I942122b46dc0ebe594306877f5a0350f876d7c01
Signed-off-by: Linda Wang <wangwulin@huawei.com>
7 years agoMerge "Switch to OS_PROJECT_NAME"
Cedric Ollivier [Thu, 28 Sep 2017 14:40:09 +0000 (14:40 +0000)]
Merge "Switch to OS_PROJECT_NAME"

7 years agoMerge "Fix connection error due to invalid lib version usage."
Cedric Ollivier [Thu, 28 Sep 2017 13:16:55 +0000 (13:16 +0000)]
Merge "Fix connection error due to invalid lib version usage."

7 years agoFix connection error due to invalid lib version usage. 53/43453/1
Benoit HERARD [Thu, 28 Sep 2017 11:31:29 +0000 (13:31 +0200)]
Fix connection error due to invalid lib version usage.

Connection timeouts on "requests" objects was developped with
requests 2.18 but target runtime is 2.12.
Advanced timeout management of 2.18 is not available in 2.12.

Change-Id: Ie6d81b91d4bcc0d73cffd007d9e46cdb19e47597
Signed-off-by: Benoit HERARD <benoit.herard@orange.com>
7 years agoMerge "Update Functest documentation for Euphrates"
Jose Lausuch [Thu, 28 Sep 2017 11:03:03 +0000 (11:03 +0000)]
Merge "Update Functest documentation for Euphrates"

7 years agoSwitch to OS_PROJECT_NAME 41/43441/1
Cédric Ollivier [Thu, 28 Sep 2017 10:42:30 +0000 (12:42 +0200)]
Switch to OS_PROJECT_NAME

It simply conforms with OpenStack keystone v3.

JIRA: FUNCTEST-877

Change-Id: I989a6eb4d8564948927c184a899b62ca763ef824
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoUpdate Functest documentation for Euphrates 83/41683/13
Morgan Richomme [Tue, 12 Sep 2017 09:39:11 +0000 (11:39 +0200)]
Update Functest documentation for Euphrates

- Better description of Alpine docker (default artifact)
- Reorganization of config and user guide
- Upgrade of the developer guide

Change-Id: Ie8e10f027bfcdb01c992cd161a1af2d6d6e29536
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
7 years agoAdd log details on SDK first connection. 87/43287/2
Benoit HERARD [Wed, 27 Sep 2017 12:01:28 +0000 (14:01 +0200)]
Add log details on SDK first connection.

On first call to energy recording API, if API
is unreachable, SDK don't do anything anymore.
This change add logs on error for this first connection.

Change-Id: I88892c769d6208c6ddf5d714d438ab584826844e
Signed-off-by: Benoit HERARD <benoit.herard@orange.com>
7 years agoFix timeout for socket connection 07/43107/2
Linda Wang [Tue, 26 Sep 2017 03:31:51 +0000 (03:31 +0000)]
Fix timeout for socket connection

Change-Id: I0688761ba7224f40f79310295efadd9b40bfeefb
Signed-off-by: Linda Wang <wangwulin@huawei.com>
7 years agoDisable Promise testsuite on Fuel installer 11/43011/5
Charalampos Kominos [Mon, 25 Sep 2017 13:43:04 +0000 (15:43 +0200)]
Disable Promise testsuite on Fuel installer

When promise reads API v3.0 from the creds file it automatically
uses v2.0. which is deprecated and not used by fuel. Therefore
promise is removed from the functest suite

JIRA: ARMBAND-314

Change-Id: I22b875c198c1922fd4ddb06c81c05884b5248eb4
Signed-off-by: Charalampos Kominos <Charalampos.Kominos@enea.com>
7 years agoMerge "Fix creds still used by vrouter"
Morgan Richomme [Mon, 25 Sep 2017 06:31:51 +0000 (06:31 +0000)]
Merge "Fix creds still used by vrouter"

7 years agoFix creds still used by vrouter 03/42903/1
root [Mon, 25 Sep 2017 01:44:10 +0000 (01:44 +0000)]
Fix creds still used by vrouter

1. 'CloudifyVrouter' object has no attribute 'creds'
2. 'CloudifyVrouter' object was still use 'creds'
3. Doing test of modified vyos_vrouter on our labs.

Refer to following commit.
 https://gerrit.opnfv.org/gerrit/#/c/41249/

Change-Id: Id1b4dfa4c35aba9bbb4fd64ef58446d3e99468df
Signed-off-by: root <shuya.nakama@okinawaopenlabs.org>
7 years agoMerge "Support https when testing ODL"
Cedric Ollivier [Fri, 22 Sep 2017 05:21:00 +0000 (05:21 +0000)]
Merge "Support https when testing ODL"

7 years agoSupport https when testing ODL 91/42491/3
Cédric Ollivier [Wed, 20 Sep 2017 08:52:33 +0000 (10:52 +0200)]
Support https when testing ODL

It conforms with the last change on ODL tests [1].
Neutron endpoint is passed via robot args instead of Neutron ip.
Keystone url (based on OS_AUTH_URL) is passed too to replace Keystone
ip.

[1] https://git.opendaylight.org/gerrit/#/c/63293/

Change-Id: Ie44f55304a438b1b0289ec69ac2241664be70e80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoMerge "Adding orchestra test cases to orchestra project"
Morgan Richomme [Thu, 21 Sep 2017 11:53:56 +0000 (11:53 +0000)]
Merge "Adding orchestra test cases to orchestra project"

7 years agoAdding orchestra test cases to orchestra project 19/42619/2
Morgan Richomme [Thu, 21 Sep 2017 07:14:01 +0000 (09:14 +0200)]
Adding orchestra test cases to orchestra project

Orchestra introduced 2 VNF test cases:

 * orchestra_openims
 * orchestra_clearwaterims

In the configuration, the 2 projects are still assigned to functest project
This patch associate the cases with their real project

Change-Id: I81f6d6fb473916f0f91a5b3795b3ed433c283fb4
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
7 years agoRemove void return value mocks in rally unit tests 21/42621/1
Juha Kosonen [Thu, 21 Sep 2017 08:23:42 +0000 (11:23 +0300)]
Remove void return value mocks in rally unit tests

Change-Id: I369b98fb9120830b1868f438c7da2a039a60d890
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
7 years agoRemove false hooks for functest-parser 81/42581/1
Cédric Ollivier [Wed, 20 Sep 2017 22:59:29 +0000 (00:59 +0200)]
Remove false hooks for functest-parser

Change-Id: I58f186b249083fc13e4bcfc4e933fd11f5d4b20e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoAdd python3-dev and python3-pip in former Dockerfile 53/42553/2
Cédric Ollivier [Wed, 20 Sep 2017 19:02:23 +0000 (21:02 +0200)]
Add python3-dev and python3-pip in former Dockerfile

Otherwise the former container cannot be built as Doctor requires a
full updated python3 env.

Change-Id: Ic90c13abad33e7cb15e7e51dcaac83b9ddf3930b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoMerge "Enable Doctor testcase"
Cedric Ollivier [Wed, 20 Sep 2017 17:27:43 +0000 (17:27 +0000)]
Merge "Enable Doctor testcase"

7 years agoMerge "Dedicated flavors for rally tests"
Jose Lausuch [Wed, 20 Sep 2017 12:40:10 +0000 (12:40 +0000)]
Merge "Dedicated flavors for rally tests"

7 years agoRemove white space when listing testcases 07/42507/1
Linda Wang [Wed, 20 Sep 2017 10:08:09 +0000 (10:08 +0000)]
Remove white space when listing testcases

Change-Id: I2f3c7a9301a6b2dcb03a90175be23223f6a6229a
Signed-off-by: Linda Wang <wangwulin@huawei.com>
7 years agoDedicated flavors for rally tests 77/42477/2
Juha Kosonen [Wed, 20 Sep 2017 07:15:07 +0000 (10:15 +0300)]
Dedicated flavors for rally tests

Create flavors and use them in rally scenarios instead of expecting
certain flavors to pre-exist.

Change-Id: I77c94ab80fcabd7b80ffb36f9856a48121858009
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
7 years agoMerge "Remove restriction to fuel on vyosvrouter case in Alpine"
Cedric Ollivier [Tue, 19 Sep 2017 20:01:50 +0000 (20:01 +0000)]
Merge "Remove restriction to fuel on vyosvrouter case in Alpine"

7 years agoRemove restriction to fuel on vyosvrouter case in Alpine 11/42411/1
Morgan Richomme [Tue, 19 Sep 2017 13:48:16 +0000 (15:48 +0200)]
Remove restriction to fuel on vyosvrouter case in Alpine

It was done in old docker but not reported in Alpine

Change-Id: I3479ad996b64187f58e97cc3b4a4b2ceefeec287
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
7 years agoAdd swagger support for Rest API 67/41667/6
Linda Wang [Tue, 12 Sep 2017 07:37:19 +0000 (07:37 +0000)]
Add swagger support for Rest API

JIRA: FUNCTEST-854

Change-Id: Ic010604d3ba0cc46092cf2a1ae8bb41afa73c920
Signed-off-by: Linda Wang <wangwulin@huawei.com>
7 years agoSelect ansible 2.3.2.0 99/42399/1
Cédric Ollivier [Tue, 19 Sep 2017 09:39:43 +0000 (11:39 +0200)]
Select ansible 2.3.2.0

Badly the ansible version is not defined in OpenStack's
upper-constaints.txt. It must be added in the OPNFV one.

Otherwise, rally fails [1]

[1] https://build.opnfv.org/ci/job/functest-fuel-baremetal-daily-master/1866/console

Change-Id: Id6814376ce96d35db65f6290d0a31283a15de0b2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoMerge "Return Functest status to Jenkins"
Cedric Ollivier [Tue, 19 Sep 2017 07:10:53 +0000 (07:10 +0000)]
Merge "Return Functest status to Jenkins"

7 years agoMerge "Fix image name in rally scenarios"
Cedric Ollivier [Tue, 19 Sep 2017 00:14:41 +0000 (00:14 +0000)]
Merge "Fix image name in rally scenarios"

7 years agoMerge "Enable parser testcase"
Cedric Ollivier [Mon, 18 Sep 2017 18:01:59 +0000 (18:01 +0000)]
Merge "Enable parser testcase"

7 years agoReturn Functest status to Jenkins 45/42245/3
Cédric Ollivier [Mon, 18 Sep 2017 12:16:07 +0000 (14:16 +0200)]
Return Functest status to Jenkins

It avoids mixing Functest and Features CI issues by simply exiting the
status of Functest testcases. The result of third-party testcases are
printed into console but are no longer taken into account into the
global status.

Change-Id: I040ff54780db2ddb6d81993839fee09f5e472323
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoFix image name in rally scenarios 39/42239/1
Juha Kosonen [Mon, 18 Sep 2017 10:39:31 +0000 (13:39 +0300)]
Fix image name in rally scenarios

Change-Id: I0a78a16d44c1e0e0b2edec2e43954c1f08e8bb09
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
7 years agoincrease timeout of NFVO installation 31/42231/1
Michael Pauls [Mon, 18 Sep 2017 09:19:04 +0000 (11:19 +0200)]
increase timeout of NFVO installation

some pods are less powerful and require more time for the
installation of the orchestrator

Change-Id: Iebd39c0ef8f3dcfa7fecb1e507b2f05890b5c490
Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>