functest.git
6 years agoEnable invalid-name warnings in tempest modules 45/52045/1
Juha Kosonen [Mon, 12 Feb 2018 14:54:53 +0000 (16:54 +0200)]
Enable invalid-name warnings in tempest modules

Do not suppress pylint invalid-name warnings but conform the naming
convention.

Change-Id: I324d25b3081fe8a366249559b343c1b9cacadb21
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoMerge "Fix pylint errors/warnings in tempest modules"
Cedric Ollivier [Mon, 12 Feb 2018 13:37:29 +0000 (13:37 +0000)]
Merge "Fix pylint errors/warnings in tempest modules"

6 years agoDecrease log level in Energy messages 27/52027/1
Cédric Ollivier [Mon, 12 Feb 2018 09:04:58 +0000 (10:04 +0100)]
Decrease log level in Energy messages

Energy could be safely disabled if one env var is missing.
No error message should be printed in console [1].

It could be enhanced in a second step to print the reasons (missing
or incorrect env vars) instead of the full stack.

[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/766/console

Change-Id: I9c405edae16d186f02c632113de1317c89703991
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRun all daily testcases if CI_LOOP is unset 83/51983/1
Cédric Ollivier [Sat, 10 Feb 2018 11:57:35 +0000 (12:57 +0100)]
Run all daily testcases if CI_LOOP is unset

Then CI_LOOP is no longer mandatory and it bypasses the current
jenkins jobs's issue [1][2][3].

[1] https://gerrit.opnfv.org/gerrit/#/c/51981/
[2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/763/console
[3] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/764/console

Change-Id: I73629079d70e0f43e609d3861490573e10fd216c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRead the env file only if exists 75/51975/1
Cédric Ollivier [Fri, 9 Feb 2018 20:41:17 +0000 (21:41 +0100)]
Read the env file only if exists

Change-Id: I8e718e583a5a47a089755c31e623a44732e5ba1e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoEnsure logging is disabled when unit testing feature 71/51971/2
Cédric Ollivier [Fri, 9 Feb 2018 19:46:41 +0000 (20:46 +0100)]
Ensure logging is disabled when unit testing feature

Change-Id: Ibe08477a8b50a6c9b71ab4e5b0ebaaab36692b08
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUnlink robotframework from constants 59/51959/3
Cédric Ollivier [Fri, 9 Feb 2018 15:22:36 +0000 (16:22 +0100)]
Unlink robotframework from constants

Change-Id: Ic2c6c84c3824ec3fa208824ae67f1769d4e18c4f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Remove one obsolete var"
Cedric Ollivier [Fri, 9 Feb 2018 16:12:13 +0000 (16:12 +0000)]
Merge "Remove one obsolete var"

6 years agoMerge "Unlink feature from constants"
Cedric Ollivier [Fri, 9 Feb 2018 16:12:01 +0000 (16:12 +0000)]
Merge "Unlink feature from constants"

6 years agoMerge "Unlink vnf from constants"
Cedric Ollivier [Fri, 9 Feb 2018 16:11:49 +0000 (16:11 +0000)]
Merge "Unlink vnf from constants"

6 years agoMerge "Unlink run_tests from constants"
Cedric Ollivier [Fri, 9 Feb 2018 16:11:38 +0000 (16:11 +0000)]
Merge "Unlink run_tests from constants"

6 years agoFix pylint errors/warnings in tempest modules 63/51963/1
Juha Kosonen [Fri, 9 Feb 2018 15:35:46 +0000 (17:35 +0200)]
Fix pylint errors/warnings in tempest modules

JIRA: FUNCTEST-913

Change-Id: I37b25bbcf43fb1d6f7de0c815ad49070d1e1af12
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoMerge "Unlink Energy from functest utils and constants"
Cedric Ollivier [Fri, 9 Feb 2018 15:34:42 +0000 (15:34 +0000)]
Merge "Unlink Energy from functest utils and constants"

6 years agoMerge "Move get_dict_by_test() into run_tests.py"
Cedric Ollivier [Fri, 9 Feb 2018 15:34:36 +0000 (15:34 +0000)]
Merge "Move get_dict_by_test() into run_tests.py"

6 years agoMerge "Conform with OpenStackUser.get_os_creds() in juju_epc"
Cedric Ollivier [Fri, 9 Feb 2018 15:34:29 +0000 (15:34 +0000)]
Merge "Conform with OpenStackUser.get_os_creds() in juju_epc"

6 years agoMerge "Get neutron endpoint via snaps in odl"
Cedric Ollivier [Fri, 9 Feb 2018 15:31:02 +0000 (15:31 +0000)]
Merge "Get neutron endpoint via snaps in odl"

6 years agoRemove one obsolete var 55/51955/5
Cédric Ollivier [Fri, 9 Feb 2018 09:32:45 +0000 (10:32 +0100)]
Remove one obsolete var

Else it simply forces the config file into xtesting.

Change-Id: I33153997f2aa422e50cea011f6a4e7eb567a83d7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUnlink feature from constants 53/51953/5
Cédric Ollivier [Fri, 9 Feb 2018 09:20:09 +0000 (10:20 +0100)]
Unlink feature from constants

Saving results dir as class attribute seems better in the context of
xtesting.

Change-Id: If40303d07d3be9bdc09d990f560cbeda429fd642
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUnlink vnf from constants 51/51951/7
Cédric Ollivier [Fri, 9 Feb 2018 09:14:37 +0000 (10:14 +0100)]
Unlink vnf from constants

It generates a default description which all testcases can easily
override.

Change-Id: I81b97c394cf064088767cc934295602f01a7f739
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUnlink run_tests from constants 49/51949/3
Cédric Ollivier [Fri, 9 Feb 2018 07:49:04 +0000 (08:49 +0100)]
Unlink run_tests from constants

run_tests.py doesn't read any functest config file what is mandatory
for xtesting.

Change-Id: I49f672c54a606acead75f573d1ce496c81fb235a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUnlink Energy from functest utils and constants 43/51943/2
Cédric Ollivier [Fri, 9 Feb 2018 06:02:45 +0000 (07:02 +0100)]
Unlink Energy from functest utils and constants

It requires an update of releng jobs which have to export
ENERGY_RECORDER_API_URL = http://energy.opnfv.fr/resources

Change-Id: Iecd5d49b4d4c961c9dc51e43e54df1fcd4027266
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMove get_dict_by_test() into run_tests.py 41/51941/1
Cédric Ollivier [Fri, 9 Feb 2018 06:01:16 +0000 (07:01 +0100)]
Move get_dict_by_test() into run_tests.py

It also removes functest_utils.get_criteria_by_test()

Change-Id: I3f265642acd053755e32f8e92f1086b93517c247
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoConform with OpenStackUser.get_os_creds() in juju_epc 29/51929/3
Cédric Ollivier [Thu, 8 Feb 2018 21:01:49 +0000 (22:01 +0100)]
Conform with OpenStackUser.get_os_creds() in juju_epc

UserSettings are not linked to any project then abot has to be passed
as arg when calling get_os_creds. Else it returns the project
registered in credentials instead of the one created by this testcase.

Change-Id: Ia0658cc9af155df06de3d14e21e5288dad6367f9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Move source_credentials() into run_tests.py"
Cedric Ollivier [Fri, 9 Feb 2018 01:50:28 +0000 (01:50 +0000)]
Merge "Move source_credentials() into run_tests.py"

6 years agoMerge "Refactor tempest resource manager"
Cedric Ollivier [Thu, 8 Feb 2018 20:48:09 +0000 (20:48 +0000)]
Merge "Refactor tempest resource manager"

6 years agoGet neutron endpoint via snaps in odl 23/51923/3
Cédric Ollivier [Thu, 8 Feb 2018 19:37:20 +0000 (20:37 +0100)]
Get neutron endpoint via snaps in odl

Change-Id: Iaf0e451e7f6bd7d22459f8d3509b39773527cfea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMove source_credentials() into run_tests.py 13/51913/4
Cédric Ollivier [Thu, 8 Feb 2018 17:55:08 +0000 (18:55 +0100)]
Move source_credentials() into run_tests.py

It's also renamed source_envfile().

Change-Id: I0e7c38c2def125961f86dc2bc9a63cfb6ad87c03
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRefactor tempest resource manager 89/51889/2
Juha Kosonen [Thu, 8 Feb 2018 08:24:26 +0000 (10:24 +0200)]
Refactor tempest resource manager

Split resource creation into several methods.

Implements partly JIRA: FUNCTEST-913

Change-Id: Ic0dd5782c604498066c636deef10b0c18c1cb48d
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoAdd variablefile as possible robot.run() args 51/51851/2
Cédric Ollivier [Wed, 7 Feb 2018 15:08:05 +0000 (16:08 +0100)]
Add variablefile as possible robot.run() args

Change-Id: Ic80840957b4d9c3c4a1615696a2851f3f5bf7bf4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRevert "Temporary disable one unstable snaps test" 59/51859/1
Cédric Ollivier [Wed, 7 Feb 2018 18:06:57 +0000 (19:06 +0100)]
Revert "Temporary disable one unstable snaps test"

This reverts commit 728e77ab3dbf075a21829a56d83cf34751bcdef6.

Change-Id: I6e5d3fa2cdf423b3c4c149108afbd9a18f0fc4b3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoTemporary disable one unstable snaps test 49/51849/1
Cédric Ollivier [Wed, 7 Feb 2018 14:42:04 +0000 (15:42 +0100)]
Temporary disable one unstable snaps test

Else all verify jobs are failing [1]

[1] https://jira.opnfv.org/browse/SNAPS-263

Change-Id: Ic2dca7f2387af1f98d3720b8db05dc3ccd54098c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove dns server from juju_epc config 33/51833/1
Cédric Ollivier [Wed, 7 Feb 2018 07:16:31 +0000 (08:16 +0100)]
Remove dns server from juju_epc config

The dns server shoud be set by the Cloud provider via Neutron configs.
Snaps is currently enforcing 8.8.8.8 as default too.

Change-Id: I3e9a25d8bbfbab4cd1d44e394235b329df86e82e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Disable orchestra_* testcases"
Linda Wang [Wed, 7 Feb 2018 01:58:35 +0000 (01:58 +0000)]
Merge "Disable orchestra_* testcases"

6 years agoFix rally cinder volume attach scenarios 59/51759/1
Juha Kosonen [Tue, 6 Feb 2018 11:50:05 +0000 (13:50 +0200)]
Fix rally cinder volume attach scenarios

Add network id to following scenarios:

CinderVolumes.create_snapshot_and_attach_volume
CinderVolumes.create_nested_snapshots_and_attach_volume

JIRA: FUNCTEST-929

Change-Id: If95babebf9ea6205684494395bdfd72d5203f4bf
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoDisable orchestra_* testcases 49/51749/1
Cédric Ollivier [Tue, 6 Feb 2018 07:05:20 +0000 (08:05 +0100)]
Disable orchestra_* testcases

They can be simply disabled and they unsuccessfully run vs Daily only.

In a second step, moving the related python modules in a new
orchestra repository could be a good solution simply because they
don't reach our coding criteria.

The best way is still to update them according to our rules and to
check all installers thanks to these two vnfs.

Change-Id: If36b16f0ed95d7039db9455a32c18f7fd1a739ef
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoStop printing data sent to DB 29/51729/1
Cédric Ollivier [Mon, 5 Feb 2018 22:02:49 +0000 (23:02 +0100)]
Stop printing data sent to DB

https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/lastFailedBuild/console

Change-Id: I0f794159d05fe21f659ecf3b5a9fa407620b723d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix docstrings 83/51683/2
Cédric Ollivier [Mon, 5 Feb 2018 16:13:53 +0000 (17:13 +0100)]
Fix docstrings

Else sphinx can't parse snaps_suite_builder.py and IxRestUtils.py.

Change-Id: Iab231a043120154bce708263474b9f9926c1f715
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSwitch to the readthedocs theme for api docs 73/51673/2
Cédric Ollivier [Mon, 5 Feb 2018 10:20:11 +0000 (11:20 +0100)]
Switch to the readthedocs theme for api docs

It also adds a requirement file for external doc tools wich couldn't
handle upper constraints.

Change-Id: Idf8f43e5e1a845055ce248f1dc8b8d676a3ac37b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove yamllint from upper-constraints.txt 71/51671/2
Cédric Ollivier [Mon, 5 Feb 2018 12:41:44 +0000 (13:41 +0100)]
Remove yamllint from upper-constraints.txt

OpenStack doesn't list test requirements in upper constraints [1].

[́1] https://github.com/openstack/requirements/blob/stable/pike/upper-constraints.txt

Change-Id: I7472158d385beb311c159563bc3bb973c4a2d4c7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd build_sphinx section in setup.cfg 69/51669/2
Cédric Ollivier [Mon, 5 Feb 2018 10:36:33 +0000 (11:36 +0100)]
Add build_sphinx section in setup.cfg

Change-Id: Ieac48a1a213bc5cd62a42dab1c74c80761e82fd1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoBlacklist Quotas.nova_update_and_delete test 79/51679/1
Juha Kosonen [Mon, 5 Feb 2018 15:23:34 +0000 (17:23 +0200)]
Blacklist Quotas.nova_update_and_delete test

Excluded since the test occasionally fails due to race condition issue
on quota manipulation in nova [1].

[1] https://bugs.launchpad.net/nova/+bug/1552622

Change-Id: Ib979c1e371727aa3adea9dc0b5955e7ed24881cf
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoMerge "Add modules docstrings in snaps"
Juha Kosonen [Mon, 5 Feb 2018 14:13:19 +0000 (14:13 +0000)]
Merge "Add modules docstrings in snaps"

6 years agoIncrease Rally full criteria 55/51655/1
Cédric Ollivier [Mon, 5 Feb 2018 09:43:52 +0000 (10:43 +0100)]
Increase Rally full criteria

Even if several tests are currently under investigation, it seems
relevant to expect a full success here.

Change-Id: I6a8c5fb5a7dd4bfb5c3a2e7a93de1c0bec77c878
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd modules docstrings in snaps 47/51647/1
Linda Wang [Mon, 5 Feb 2018 04:05:22 +0000 (04:05 +0000)]
Add modules docstrings in snaps

JIRA: FUNCTEST-922

Change-Id: I058486427fe55e1d1ce939fce20d75ff7afde85c
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoUpdate results printed in configguide.rst 33/51633/2
Cédric Ollivier [Sun, 4 Feb 2018 13:21:22 +0000 (14:21 +0100)]
Update results printed in configguide.rst

It updates the entry points and all results.
It also takes into account that:
  - juju_epc was added
  - fds was moved to features

It should be noted that refstack_defcore, parser and several vnfs are
failing from the time being.

Change-Id: I918a7767005569f03115749ad121a6c7a04c04a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix links in configguide.rst 27/51627/3
Cédric Ollivier [Sat, 3 Feb 2018 20:49:04 +0000 (21:49 +0100)]
Fix links in configguide.rst

It also removes trailing whitespaces.

Change-Id: I6a7e4aaff700a85ff1c0c2741624e9359441e0ac
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix JujuEpc prepare() and deploy_orchestrator() 19/51419/7
Cédric Ollivier [Wed, 31 Jan 2018 21:20:42 +0000 (22:20 +0100)]
Fix JujuEpc prepare() and deploy_orchestrator()

It bypasses a known unfixed Juju bug [1] by creating a second
'_member_' user [1]. An 'admin' user is still required to create
flavors and by snaps when listing virtual machines.
It highlights a possible bug in user_creator.get_os_creds().

It partially rewrites the testcase by cleaning instance attributes and
by taking several os.system() returns into account. It sets the new
password automatically generated [2] and starts switching from
openstack utils to snaps in vEPC.

This patchset must be completed by unit tests and by another patch
fully switching to snaps in the last methods.

It should be noted that the testcase sets 8.8.8.8 as dns server which
could raise side effects.

[1] https://bugs.launchpad.net/juju/+bug/1710848
[2] https://gerrit.opnfv.org/gerrit/#/c/50747/

Change-Id: Id18b4b185aa1825196e91f6692338169f51faea8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Do not use shell to execute commands in tempest"
Linda Wang [Sat, 3 Feb 2018 05:02:51 +0000 (05:02 +0000)]
Merge "Do not use shell to execute commands in tempest"

6 years agoMerge "Stop setting ext net in config"
Cedric Ollivier [Fri, 2 Feb 2018 23:12:14 +0000 (23:12 +0000)]
Merge "Stop setting ext net in config"

6 years agoMerge "Install vEPC dependencies in Dockerfile"
Cedric Ollivier [Fri, 2 Feb 2018 23:12:07 +0000 (23:12 +0000)]
Merge "Install vEPC dependencies in Dockerfile"

6 years agoDo not use shell to execute commands in tempest 95/51495/1
Juha Kosonen [Fri, 2 Feb 2018 11:27:33 +0000 (13:27 +0200)]
Do not use shell to execute commands in tempest

Change-Id: I4d699481fdc63058c12ca9cfe18138e87025e9b3
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoStop setting ext net in config 91/51491/2
Cédric Ollivier [Fri, 2 Feb 2018 07:22:00 +0000 (08:22 +0100)]
Stop setting ext net in config

It simply relies on the related env var as expected.

Change-Id: Ibbb1a2ab2cccdff8cafe6f409af383a24778b1f5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Fix a typo in docstring"
Linda Wang [Fri, 2 Feb 2018 02:26:38 +0000 (02:26 +0000)]
Merge "Fix a typo in docstring"

6 years agoRename a common credential file for OS and K8S 83/51283/5
Linda Wang [Mon, 29 Jan 2018 07:37:37 +0000 (07:37 +0000)]
Rename a common credential file for OS and K8S

Change-Id: Ib8d24be4b29ab1de00d5dd5e3442146b2437cb94
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoInstall vEPC dependencies in Dockerfile 59/51459/2
Cédric Ollivier [Thu, 1 Feb 2018 13:44:47 +0000 (14:44 +0100)]
Install vEPC dependencies in Dockerfile

It also cleans sources and packages.

Change-Id: Ie3a1a836c27af295b93386e8df63c0ae5accde84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Use snaps_utils to get credentials in tempest"
Serena Feng [Thu, 1 Feb 2018 13:52:46 +0000 (13:52 +0000)]
Merge "Use snaps_utils to get credentials in tempest"

6 years agoFix a typo in docstring 17/51417/1
Cédric Ollivier [Wed, 31 Jan 2018 21:22:44 +0000 (22:22 +0100)]
Fix a typo in docstring

Change-Id: I4826240a56141771df202b9b3b416d64d2db2cf4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd tempest and rally in functest-features 13/51413/1
Cédric Ollivier [Wed, 31 Jan 2018 17:57:46 +0000 (18:57 +0100)]
Add tempest and rally in functest-features

SDNVPN also requires these packages.
It would be refactored in a second step when xtesting is published.

Change-Id: I069ecf8d60dc0ee1a755d0974913b686f4c7ae61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Removal of deprecated SNAPS-OO classes in juju_epc"
Cedric Ollivier [Wed, 31 Jan 2018 13:03:22 +0000 (13:03 +0000)]
Merge "Removal of deprecated SNAPS-OO classes in juju_epc"

6 years agoUse snaps_utils to get credentials in tempest 93/51393/2
Juha Kosonen [Wed, 31 Jan 2018 11:54:46 +0000 (13:54 +0200)]
Use snaps_utils to get credentials in tempest

Change-Id: I1d240d5edd536d71c87a7dff4e2676715697d0e2
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoMerge "Fix pylint errors/warnings in rally"
Cedric Ollivier [Wed, 31 Jan 2018 09:33:25 +0000 (09:33 +0000)]
Merge "Fix pylint errors/warnings in rally"

6 years agoMerge "proper instance status handling"
Juha Kosonen [Wed, 31 Jan 2018 07:05:01 +0000 (07:05 +0000)]
Merge "proper instance status handling"

6 years agoRemoval of deprecated SNAPS-OO classes in juju_epc 63/51363/3
Cédric Ollivier [Tue, 30 Jan 2018 18:40:20 +0000 (19:40 +0100)]
Removal of deprecated SNAPS-OO classes in juju_epc

It completes the first commit about that topic [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/47617/

Change-Id: I1a55b45f0535ae98681546d4d24bb424cf892aa8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix pylint errors/warnings in rally 07/51307/6
Juha Kosonen [Mon, 29 Jan 2018 13:57:11 +0000 (15:57 +0200)]
Fix pylint errors/warnings in rally

JIRA: FUNCTEST-906

Change-Id: I484f9a291d5adbedb855450e4ff067dfa4a3b2ae
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoMerge "Remove duplicated code related to snaps creds"
Cedric Ollivier [Tue, 30 Jan 2018 19:11:27 +0000 (19:11 +0000)]
Merge "Remove duplicated code related to snaps creds"

6 years agoRemove duplicated code related to snaps creds 51/51351/1
Juha Kosonen [Tue, 30 Jan 2018 12:59:05 +0000 (14:59 +0200)]
Remove duplicated code related to snaps creds

Add support for providing credentials in snaps_utils.

JIRA: FUNCTEST-916

Change-Id: I3e027229d213d3791a115920f7012309cc027712
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoFix pylint errors about refstack 95/51295/2
Linda Wang [Mon, 29 Jan 2018 10:26:16 +0000 (10:26 +0000)]
Fix pylint errors about refstack

JIRA: FUNCTEST-907

Change-Id: Ib08a88523c700d35894b9b89b7585425a02065c3
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoMerge "Create subnet and net within the same project"
Cedric Ollivier [Mon, 29 Jan 2018 15:29:56 +0000 (15:29 +0000)]
Merge "Create subnet and net within the same project"

6 years agoMerge "Enable epc unit tests"
Cedric Ollivier [Mon, 29 Jan 2018 13:46:57 +0000 (13:46 +0000)]
Merge "Enable epc unit tests"

6 years agoMerge "Fix warnings in all snaps-related modules"
Cedric Ollivier [Mon, 29 Jan 2018 13:46:50 +0000 (13:46 +0000)]
Merge "Fix warnings in all snaps-related modules"

6 years agoMerge "Fix pylint errors in several utils modules"
Cedric Ollivier [Mon, 29 Jan 2018 13:46:44 +0000 (13:46 +0000)]
Merge "Fix pylint errors in several utils modules"

6 years agoMerge "Avoid duplicating get_parameter_from_yaml"
Cedric Ollivier [Mon, 29 Jan 2018 13:46:38 +0000 (13:46 +0000)]
Merge "Avoid duplicating get_parameter_from_yaml"

6 years agoMerge "Fix last Pylint error in Functest"
Cedric Ollivier [Mon, 29 Jan 2018 13:46:23 +0000 (13:46 +0000)]
Merge "Fix last Pylint error in Functest"

6 years agoEnable epc unit tests 05/51305/1
Cédric Ollivier [Mon, 29 Jan 2018 12:45:43 +0000 (13:45 +0100)]
Enable epc unit tests

It adds the missing __init__.py to activate vepc unit tests.
They are disabled because they are currently false (otherwise
it would block next changes).

Change-Id: I65b32490efde4cc8f6b3d9e6ee19257dcf02c2dd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix the connect issue when checking deployment 75/51275/2
Linda Wang [Mon, 29 Jan 2018 01:26:17 +0000 (01:26 +0000)]
Fix the connect issue when checking deployment

Socket.connect() requires only one param with type tuple.

Change-Id: I63aa4633e80bde3ad5e1b5af9d67d8f46eb84571
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoCreate subnet and net within the same project 77/51277/1
Linda Wang [Mon, 29 Jan 2018 01:39:58 +0000 (01:39 +0000)]
Create subnet and net within the same project

It is required to create a network and subnet within the same project
for some SUTs.

Change-Id: Icd02edb0aebee93713f315cdbbeb021e9ae82dae
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoFix warnings in all snaps-related modules 59/51259/1
Cédric Ollivier [Sun, 28 Jan 2018 10:30:47 +0000 (11:30 +0100)]
Fix warnings in all snaps-related modules

It also adds vping/__init__.py to stop skipping vping unit tests.
It removes the useless import os which is not required for mock (here
the mock patch was simply false).

It should be noted that the code is partially duplicated between
snaps_test_runner.py and vping_base_base.py. A small part of code has
been rewritten to fix that without multi inheritance.

Change-Id: I2e3e181ad7dab8aa41afb1e63d0b6795ff0d1610
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Refactor rally report generation"
Cedric Ollivier [Sat, 27 Jan 2018 10:02:12 +0000 (10:02 +0000)]
Merge "Refactor rally report generation"

6 years agoFix pylint errors in several utils modules 95/51195/5
Cédric Ollivier [Fri, 26 Jan 2018 13:29:01 +0000 (14:29 +0100)]
Fix pylint errors in several utils modules

All utils which are moving to xtesting are now fixed.
It remains OpenStack and Functest utils (+ the related unit tests)
which doesn't move to the new package.

Change-Id: If13c627c8444c62d5c6bf9c8057d6413aa0e56c7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAvoid duplicating get_parameter_from_yaml 13/51213/2
Cédric Ollivier [Fri, 26 Jan 2018 16:41:02 +0000 (17:41 +0100)]
Avoid duplicating get_parameter_from_yaml

It switches to this helper which was locally copied.

Change-Id: Iaa30d83e8c0e2d4472f4ef8fe1da4943e424ebb3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix last Pylint error in Functest 93/51193/2
Cédric Ollivier [Fri, 26 Jan 2018 08:49:49 +0000 (09:49 +0100)]
Fix last Pylint error in Functest

It also fixes all pylint warnings in router and the related unit
tests. tox.ini is updated to ensure that no error is introduced.

Change-Id: Iddd74b0dac7b6581d72b04369140006c9e19f998
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRefactor rally report generation 85/51185/1
Juha Kosonen [Fri, 26 Jan 2018 10:37:57 +0000 (12:37 +0200)]
Refactor rally report generation

- statistic data based on Rally results report
- fix statistics calculations
- use PrettyTable in generating the report

Change-Id: Ic84adc5e30d446aea1f3045ba997c3ddf895e9f5
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoproper instance status handling 79/51179/1
Periyasamy Palanisamy [Fri, 26 Jan 2018 08:56:12 +0000 (09:56 +0100)]
proper instance status handling

This would fix the exception happening in the SDNVPN CI testsuite.
Example: http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-01-21_17-18-06/bgpvpn.log

Change-Id: Ie22dcdbba5299177d4e98e5995433553df5bfa68
Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
6 years agoFix pylint warnings/errors in cli 49/51049/2
Cédric Ollivier [Tue, 23 Jan 2018 10:19:41 +0000 (11:19 +0100)]
Fix pylint warnings/errors in cli

cli_testcase and cli_tier have been refactored to avoid duplicating
code. Then functest/cli and funtest/unit/cli can be added to the list
of modules rated 10/10.

Change-Id: Iec90e806397248a10f39080ec554e3f0a6eda7c1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDelete functest_vacation.py 47/51047/1
Cédric Ollivier [Wed, 24 Jan 2018 12:49:55 +0000 (13:49 +0100)]
Delete functest_vacation.py

Change-Id: Id0e2769a1989e6778ae41f67ed634e2e5002a83d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge RegexMatch into test_cli_env.py 45/51045/1
Cédric Ollivier [Wed, 24 Jan 2018 12:33:20 +0000 (13:33 +0100)]
Merge RegexMatch into test_cli_env.py

It also deletes SubstrMatch which is not called (then uncovered).

Change-Id: Ifde1e2491ab5e0e75652eb4b25b359e859c2aa95
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDisable all missing-docstring warnings in unit tests 83/50883/1
Cédric Ollivier [Sun, 21 Jan 2018 20:20:25 +0000 (21:20 +0100)]
Disable all missing-docstring warnings in unit tests

Change-Id: I22b7bbdab5f000b4ade6c2ba3a4029c146887cbd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPartially rewrite test_run_tests.py 81/50881/1
Cédric Ollivier [Sun, 21 Jan 2018 20:11:48 +0000 (21:11 +0100)]
Partially rewrite test_run_tests.py

It mainly fixes pylint issues and leverages on decorators.
It should be noted that run_tests.py is not fully covered (see
xtesting requirements).

Change-Id: I114b67c3c5bfe61d72d004829af513e2014ad8b8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFully test and cover functest/ci/tier_* 71/50871/7
Cédric Ollivier [Sun, 21 Jan 2018 00:02:20 +0000 (01:02 +0100)]
Fully test and cover functest/ci/tier_*

It also fixes check_deployment.py and ci unit tests which were wrong
when testing exceptions.

Now ci modules are rated 10/10 and fully covered.

Change-Id: I30dca491b44cc54aa1abc0d0433c00b4dcabfdc4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMove push_results_to_db to TestCase 57/49757/7
Cédric Ollivier [Sat, 20 Jan 2018 13:41:32 +0000 (14:41 +0100)]
Move push_results_to_db to TestCase

It removes the link between TestCase and Functest utils (xtesting).
It should be noted that testresults url can only be set by env var.

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Ie072c675890d0ae2e63619c599d2684a8c7d762d
Signed-off-by: Jose Lausuch <jalausuch@suse.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoConfigure password for the user in vnf 47/50747/9
Linda Wang [Thu, 18 Jan 2018 03:38:46 +0000 (03:38 +0000)]
Configure password for the user in vnf

For some SUTs, the password for creating user is not allowed to
be the same as user name, and some even is required to contain
at least 8 characters and three types of characters for security.

It also turns yamllint warnings into errors and fixes the remaining
warnings.

Change-Id: Icf25a7b9ff1c8cee55899198f1e519c9209877ff
Signed-off-by: Linda Wang <wangwulin@huawei.com>
6 years agoMerge "Fix Rally output retrieval"
Linda Wang [Wed, 17 Jan 2018 01:12:45 +0000 (01:12 +0000)]
Merge "Fix Rally output retrieval"

6 years agoFix Rally output retrieval 03/50703/1
Juha Kosonen [Tue, 16 Jan 2018 14:45:46 +0000 (16:45 +0200)]
Fix Rally output retrieval

Read stdout until nothing left instead of stopping once the child
process is terminated.

Change-Id: I46a2eb93fd614e2e7ff676727eb9dc132c29d03f
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
6 years agoUpdate set of region identity attribut 77/50677/1
Samuel Bartel [Tue, 16 Jan 2018 09:12:16 +0000 (10:12 +0100)]
Update set of region identity attribut

Use OS_REGION_NAME environment variable if defined

Change-Id: Ifcdfc468fa4931ab62ac0f3ead103e15af7c0de6
Signed-off-by: Samuel Bartel <samuel.bartel@orange.com>
6 years agoBuild functest-parser for arm64 via travis-ci 71/50471/3
Cédric Ollivier [Thu, 11 Jan 2018 17:03:11 +0000 (18:03 +0100)]
Build functest-parser for arm64 via travis-ci

Even if clearwater-live-test dependencies have been updated [1], the
next containers can be built for ARM (ruby raises SEGFAULT via
qemu-user-static):
  - functest-vnf
  - functest-restapi

The related manifest is also updated.

[1] https://gerrit.opnfv.org/gerrit/#/c/50295/8

Change-Id: Ie1eb78436a3da5eb7b5c1028b7f8323e8c3e73a2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Switch to absolute paths in Dockerfiles"
Cedric Ollivier [Fri, 12 Jan 2018 19:10:59 +0000 (19:10 +0000)]
Merge "Switch to absolute paths in Dockerfiles"

6 years agoSwitch to absolute paths in Dockerfiles 75/50475/2
Cédric Ollivier [Fri, 12 Jan 2018 06:29:05 +0000 (07:29 +0100)]
Switch to absolute paths in Dockerfiles

It updates functest-smoke and functest-restapi.

Change-Id: If4d48f8a6ead1b9b7726a9b7b7baf6b51340a926
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoDelete the updated Alpine image 83/50483/1
Cédric Ollivier [Fri, 12 Jan 2018 08:52:28 +0000 (09:52 +0100)]
Delete the updated Alpine image

It completes "Update Alpine to 3.7" [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/49741/

Change-Id: If836a7ca80f5869c9ffeea65a1c0eacf1042ffab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Build vnf and restapi containers for ARM"
Cedric Ollivier [Thu, 11 Jan 2018 16:56:57 +0000 (16:56 +0000)]
Merge "Build vnf and restapi containers for ARM"

6 years agoBuild vnf and restapi containers for ARM 95/50295/8
Delia Popescu [Tue, 9 Jan 2018 09:54:52 +0000 (11:54 +0200)]
Build vnf and restapi containers for ARM

The root cause of the problem was the installation
of unf_ext packet. The Gemfile.lock in
https://github.com/boucherv-orange/clearwater-live-test
asked for version 0.0.6 and this version was not found for arm.
When it tried to build the package, the conversion from int
to char error was thrown (issue reported here
https://github.com/knu/ruby-unf_ext/issues/15).

As now version 0.0.7.4 is selected, then the vnf docker
images are built without any other errors.

Gemfile.lock was updated in the original repo,
this fix enables vnf and restapi containers build for ARM.

JIRA: FUNCTEST-899

Change-Id: Id2c5fe82cb3705f58a8175fcf0a17f443e9b7d9d
Signed-off-by: Delia Popescu <delia.popescu@enea.com>