functest-xtesting.git
3 years agoUpdate site.gate.yml accordint to latest XtestingCI changes 09/72009/1
Cédric Ollivier [Fri, 12 Feb 2021 12:03:28 +0000 (13:03 +0100)]
Update site.gate.yml accordint to latest XtestingCI changes

Change-Id: Iaaad4fff95b3df7564c5277eed80db182f8e3e19
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6e2fa509cb5d9f4929b91b443fb354d0092bce82)

3 years agoFix arch in .travis-ci.yml 99/71999/1
Cédric Ollivier [Fri, 12 Feb 2021 08:39:20 +0000 (09:39 +0100)]
Fix arch in .travis-ci.yml

Change-Id: I0b56d7d2e9714034e54f42426ada1806036ec47f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoCreate dummy xtesting-mts:arm 94/71994/1
Cédric Ollivier [Thu, 11 Feb 2021 17:44:03 +0000 (18:44 +0100)]
Create dummy xtesting-mts:arm

Change-Id: Ib6cc1236aa46b7fb1fd9dfa96750894d87c3563e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 239dc4006e01b78b5a3bda9faec604f19bcf87e7)

3 years agoUpgrade system first 43/71943/1
Cédric Ollivier [Wed, 10 Feb 2021 00:24:09 +0000 (01:24 +0100)]
Upgrade system first

Change-Id: I9ee2ac74785212f8fa6f4ca84dabfcf0ebd3ed18
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 416589195799adc49c5163522313f9e9321c4449)

3 years agoUpdate ansible-lint verification 04/71904/1
Cédric Ollivier [Tue, 9 Feb 2021 18:01:56 +0000 (19:01 +0100)]
Update ansible-lint verification

Change-Id: I1f0e2a4dc3d2410a409c990605a9086a5776ca34
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 218ff87511f5675386c7c1948d64e24a101091f2)

3 years agoTake pylint's len-as-condition into account 97/71897/1
Cédric Ollivier [Tue, 9 Feb 2021 15:46:33 +0000 (16:46 +0100)]
Take pylint's len-as-condition into account

Change-Id: Ib19de453857a2732d9c70a24539a96cd7129613d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8fc7c92cd3a8704aff806c2b9c500369b7360759)

3 years agoUse pip==20.2.4 in tox venv 31/71731/1
Cédric Ollivier [Thu, 10 Dec 2020 18:06:19 +0000 (19:06 +0100)]
Use pip==20.2.4 in tox venv

pip 20.3 is disruptive and would lead to big changes in stable
branches.

Change-Id: Ifc4abd2d1f28bfb63ba66796e1690b398c1e4760
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9c9f1888d682cf1b794c956d7f6ab448cb42c6d7)

3 years agoCleanup previous run output files 30/71430/1
Vincent Mahe [Tue, 15 Sep 2020 15:41:38 +0000 (17:41 +0200)]
Cleanup previous run output files

Signed-off-by: Vincent Mahe <v.mahe@orange.com>
Change-Id: I9ec39012457ae1a5f7017d41d79237d7a1e300d4
(cherry picked from commit 43d5772accb16742f09ddbc3d89ff5c315a2c0a4)

3 years agoSplit Gates in a dedicated site.yml 54/71354/1
Cédric Ollivier [Mon, 9 Nov 2020 16:41:47 +0000 (17:41 +0100)]
Split Gates in a dedicated site.yml

Change-Id: I4a6efc8993f3569fa993cba3a1ba472780de41b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate upper-constraints 39/71239/1
Cédric Ollivier [Tue, 6 Oct 2020 21:35:51 +0000 (23:35 +0200)]
Update upper-constraints

It take the new requirements just published into account.

Change-Id: I52477b277a703b5354afaa38f92b103271b2efed
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoChange version of MTS software to 6.6.21 32/71232/1
Vincent Mahe [Tue, 15 Sep 2020 11:47:29 +0000 (13:47 +0200)]
Change version of MTS software to 6.6.21

Signed-off-by: Vincent Mahe <v.mahe@orange.com>
Change-Id: I846d5adf55d1f20e3adf50fccbbb431dda7f55d6
(cherry picked from commit 16ae15d57395430b0113f44d850c9eb06fe1cb3b)

4 years agoFix BRANCH in stable/leguer 10/71210/1
Cédric Ollivier [Sun, 4 Oct 2020 13:41:51 +0000 (15:41 +0200)]
Fix BRANCH in stable/leguer

Change-Id: I4314155b7cae6efff868bf614c8029bb82e2f3b2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoPrepare Xtesting Leguer containers 01/71201/1
Cédric Ollivier [Sun, 4 Oct 2020 10:17:29 +0000 (12:17 +0200)]
Prepare Xtesting Leguer containers

Change-Id: I4c7b01c5502b426f52e8492a5c322f0659900b0b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSet default branch in .gitreview 00/71200/1
Cédric Ollivier [Sun, 4 Oct 2020 10:13:02 +0000 (12:13 +0200)]
Set default branch in .gitreview

Change-Id: If11674eee0917dc907173e9d332348eb54066d18
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoProtect mts vs py2 64/70964/1
Cédric Ollivier [Sat, 5 Sep 2020 14:24:37 +0000 (16:24 +0200)]
Protect mts vs py2

Change-Id: I7a9aa9267a81161b10b1d625efbaa924187f8690
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRemove all order in testcases.yaml 52/70952/1
Cédric Ollivier [Sat, 5 Sep 2020 10:42:34 +0000 (12:42 +0200)]
Remove all order in testcases.yaml

Change-Id: I7ff541ebe5b99f2bc66cbf725530fdff55504435
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoWrap long env values 31/70931/2
Cédric Ollivier [Sat, 5 Sep 2020 10:19:34 +0000 (12:19 +0200)]
Wrap long env values

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-healthcheck-kali-k8s_smoke-run/162/console

Change-Id: If6837a85f54309ad7c221144570c10eb1615993d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoFix duration calculation 30/70930/2
Cédric Ollivier [Sat, 5 Sep 2020 10:10:29 +0000 (12:10 +0200)]
Fix duration calculation

It falsy printed 00:60

Change-Id: Ib2852268a6833b353232c80e9013b6926058479c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRemove order in testcases.yaml 29/70929/1
Cédric Ollivier [Sat, 5 Sep 2020 09:35:05 +0000 (11:35 +0200)]
Remove order in testcases.yaml

It's not used and asked for useless configuration data.

Change-Id: Ie1713873aa880bed74bc3c9c4c08da5b30ea3bbb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoMake testcases descriptions optional 28/70928/1
Cédric Ollivier [Sat, 5 Sep 2020 08:55:05 +0000 (10:55 +0200)]
Make testcases descriptions optional

Change-Id: If0e45f10816edd2199c589bb5fbfc03fbc0a4b77
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSuppress admin password in default logs 06/70906/3
ajay33 [Mon, 31 Aug 2020 08:40:28 +0000 (14:10 +0530)]
Suppress admin password in default logs

Currently, OS_PASSWORD is getting printed in the console of
Functest. This password is secret and must not be printed in
default log file.

This patch suppresses the logging of OS_PASSWORD unless
users ask for debug logs.

Signed-off-by: mahajanajay33@gmail.com
Change-Id: Ib83a12eb09a8551b30b352858649932a5ca842e4

4 years agoMerge "Stop building xtesting-mts for arm32"
Cedric Ollivier [Thu, 6 Aug 2020 04:49:32 +0000 (04:49 +0000)]
Merge "Stop building xtesting-mts for arm32"

4 years agoStop building xtesting-mts for arm32 79/70679/1
Cédric Ollivier [Thu, 6 Aug 2020 04:28:35 +0000 (06:28 +0200)]
Stop building xtesting-mts for arm32

It raised TravisCI timeouts [1].

[1] https://travis-ci.org/github/collivier/functest-xtesting/jobs/715338705

Change-Id: Ifa4e0957386961a6cde2b2ea7877d808d6e46d70
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdated from global requirements 75/70675/1
Cédric Ollivier [Wed, 5 Aug 2020 23:39:53 +0000 (01:39 +0200)]
Updated from global requirements

Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I19049637a64628e266de4e5bdd825435ca0bebe3

4 years agoInstall py3-wheel in xtesting 73/70673/1
Cédric Ollivier [Wed, 5 Aug 2020 15:08:14 +0000 (17:08 +0200)]
Install py3-wheel in xtesting

It fixes all deprecated warnings.

Change-Id: Ide9b140e56555fba3b5bc94c71df15d4627b72cd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoBuild arm* xtesting-mts on TravisCI 67/70667/1
Cédric Ollivier [Wed, 5 Aug 2020 14:33:54 +0000 (16:33 +0200)]
Build arm* xtesting-mts on TravisCI

Change-Id: I594092992020a3eb228fbf62807a64c94f4a3fdd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoFix bash mistakes 66/70666/1
Cédric Ollivier [Wed, 5 Aug 2020 14:05:11 +0000 (16:05 +0200)]
Fix bash mistakes

Change-Id: I204d7bb0ee7ce7ad727ae20601f0140670c9f0b9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSet CFLAGS="-O0" when cross-compiling lxml 65/70665/1
Cédric Ollivier [Wed, 5 Aug 2020 13:49:30 +0000 (15:49 +0200)]
Set CFLAGS="-O0" when cross-compiling lxml

Change-Id: I57ae3a76d1838ccde2699a1a206487079c7f2fae
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoAdd MTS driver 14/70214/20
Vincent Mahe [Mon, 25 May 2020 16:32:58 +0000 (18:32 +0200)]
Add MTS driver

It creates a new container xtesting-mts to avoid increase core
container size.

Signed-off-by: Vincent Mahe <v.mahe@orange.com>
Change-Id: I59544023e1235747e140a442815778a133bf6acf

4 years agoUpdate to alpine3.12 87/70287/4
Cédric Ollivier [Sat, 6 Jun 2020 15:49:54 +0000 (17:49 +0200)]
Update to alpine3.12

https://alpinelinux.org/posts/Alpine-3.12.0-released.html

Change-Id: Ie7b89399e5e32732d81b3e6293055f1fa8b10012
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoDrop py27 94/70294/1
Cédric Ollivier [Sun, 7 Jun 2020 07:31:45 +0000 (09:31 +0200)]
Drop py27

We can no longer support py27 due to rally or bashate here.

Change-Id: I716d388df227b9cb54c9c71b072c7aa01577f3fe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdated from global requirements 53/70053/1
Cédric Ollivier [Wed, 29 Apr 2020 10:41:11 +0000 (12:41 +0200)]
Updated from global requirements

Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I56dd1b8370ebe3e8e7f378a1fb3a9966a3c3d806

4 years agoFix behave-html-formatter py conditions 98/69998/1
Cédric Ollivier [Mon, 27 Apr 2020 20:23:12 +0000 (22:23 +0200)]
Fix behave-html-formatter py conditions

https://pypi.org/project/behave-html-formatter/0.9.4/

Change-Id: I3c7d6f043a7e1df1529cf31152ac09e871ccdd3f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoPost-processed data from DB 97/69797/1
Cédric Ollivier [Tue, 17 Mar 2020 13:28:38 +0000 (14:28 +0100)]
Post-processed data from DB

It removes base_url to match the location in archive.

It forces a relative path by removing first "/".
It makes sense but it may raise side effects in dovetail webportal.

Change-Id: Idca69a99fed54ddf69334a865bae15b0a08220fc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoPublish Xtesting2020 52/69552/1
Cédric Ollivier [Tue, 14 Jan 2020 16:28:36 +0000 (17:28 +0100)]
Publish Xtesting2020

Change-Id: Ife0d97eba3b09b54c0904128896998d8524db905
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoPublish CNTT Snezka RC Cookbook 34/69534/1
Cédric Ollivier [Sat, 11 Jan 2020 18:08:27 +0000 (19:08 +0100)]
Publish CNTT Snezka RC Cookbook

http://testresults.opnfv.org/functest/cntt_rc_cookbook/

Change-Id: Ie100ddcf4a0ad1b8ba01a10ae91d2a6f40587c3c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSwitch to multiarch binfmt 01/69501/1
Cédric Ollivier [Sat, 4 Jan 2020 20:16:04 +0000 (21:16 +0100)]
Switch to multiarch binfmt

It allows building arm containers as proposed by arm32v6 et arm32v7.

Change-Id: Icaca973f70c167ec8eb59df882638683fe35e40e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSelect arm32v6 et arm64v8 repos 00/69500/1
Cédric Ollivier [Sat, 4 Jan 2020 18:02:55 +0000 (19:02 +0100)]
Select arm32v6 et arm64v8 repos

They are the official repos [1].
multiarch repo doesn't support Alpine 3.11 and Raspberry PI 1 (arm32v6).

[1] https://hub.docker.com/_/alpine/

Change-Id: I2d73ef867c9714ecddba433295f822cf29b27b90
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoFix tox env list in travis-ci 99/69499/1
Cédric Ollivier [Sat, 4 Jan 2020 16:31:08 +0000 (17:31 +0100)]
Fix tox env list in travis-ci

https://travis-ci.org/collivier/functest-xtesting/jobs/632680250

Change-Id: I49fb0e399b2c0a31af21f5216b0576335773b8ab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoAdd python3.8-distutils when verifying vs travis-ci 97/69497/1
Cédric Ollivier [Sat, 4 Jan 2020 16:07:35 +0000 (17:07 +0100)]
Add python3.8-distutils when verifying vs travis-ci

https://travis-ci.org/collivier/functest-xtesting/jobs/632675948

Change-Id: I87caca2810c966c6b8219b7dc044f02ac7b8e561
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate Alpine to 3.11 92/69492/5
Cédric Ollivier [Sat, 4 Jan 2020 12:54:26 +0000 (13:54 +0100)]
Update Alpine to 3.11

It also updates Python to 3.8 (default version).

https://alpinelinux.org/posts/Alpine-3.11.0-released.html

Change-Id: I1401c37adb71a6f7d37bd8724b93a058ecb68557
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoFix behave driver and its related unit tests 93/69493/1
Cédric Ollivier [Sat, 4 Jan 2020 15:30:07 +0000 (16:30 +0100)]
Fix behave driver and its related unit tests

Change-Id: I466d655162c1ddd5f4e3ef0e356a27007bfaea0f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoCompress Campaign data (zip) 31/69431/1
Cédric Ollivier [Sun, 22 Dec 2019 20:09:53 +0000 (21:09 +0100)]
Compress Campaign data (zip)

Change-Id: I7b46a88a181293297cc764026f2804d36a59955a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoDump DB and artifacts for third-party certification 99/69399/7
Cédric Ollivier [Thu, 19 Dec 2019 06:13:12 +0000 (07:13 +0100)]
Dump DB and artifacts for third-party certification

It conforms with Kubernetes Conformance [1] model and could be reused
by OVP or any third-party CNTT-based certification.

It publishes the final archive in the S3 repository.

XtestingCI will generate the final job calling this feature.

[1] https://github.com/cncf/k8s-conformance

Change-Id: I7394c9d52d2cc9370eae125ca5398ff734e5b8d6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoDisable false ansible list warnings 70/69270/1
Cédric Ollivier [Sat, 7 Dec 2019 11:59:47 +0000 (12:59 +0100)]
Disable false ansible list warnings

git commit has to be executed via shell module [1].

[1] https://github.com/ansible/ansible/issues/50334

Change-Id: I0ad8abe12bd592cb2a790ec3373452d46573776a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoMock os.path.join in push_to_db 08/69208/1
Cédric Ollivier [Sat, 30 Nov 2019 12:08:20 +0000 (13:08 +0100)]
Mock os.path.join in push_to_db

Change-Id: I8d0c8f9ef4688454a6d2992ab1a20d871814e23f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoMerge "Postprocess the TestAPI href returned"
Cedric Ollivier [Sat, 30 Nov 2019 10:31:42 +0000 (10:31 +0000)]
Merge "Postprocess the TestAPI href returned"

4 years agoPostprocess the TestAPI href returned 03/69203/2
Cédric Ollivier [Sat, 30 Nov 2019 09:44:46 +0000 (10:44 +0100)]
Postprocess the TestAPI href returned

[1] returned http://localhost:8082

[1] https://build.opnfv.org/ci/job/airship-opnfv-functest-healthcheck-latest-connection_check-run/58/console

Change-Id: Ifc0e37a97442193a77762ecc2928b100e27028cd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRun update package index before installing pkg in Circle CI. 16/69116/1
Cédric Ollivier [Wed, 27 Nov 2019 10:20:41 +0000 (11:20 +0100)]
Run update package index before installing pkg in Circle CI.

Change-Id: Id160a5bc68c2201db124773bf6eee8b6bb4cb7fc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoForbid multipart upload if google storage 25/68925/2
Cédric Ollivier [Mon, 18 Nov 2019 19:16:49 +0000 (20:16 +0100)]
Forbid multipart upload if google storage

Google Storage doesn't support S3 multipart uploads
https://docs.aws.amazon.com/AmazonS3/latest/dev/mpuoverview.html
https://cloud.google.com/storage/docs/composite-objects

5 * 1024 ** 5 is the multipart upload limit.
https://docs.aws.amazon.com/AmazonS3/latest/dev/qfacts.html

Change-Id: Iec3a5cd70ea6e912272ea231eecde6ee4f51ce4f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoAdd ContentType when publishing artifacts 05/68905/1
Cédric Ollivier [Sat, 16 Nov 2019 15:21:44 +0000 (16:21 +0100)]
Add ContentType when publishing artifacts

The default value 'application/octet-stream' is mostly
incorrect and forces downloading all links.

https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-hunter-connection_check-run/436/console

Change-Id: Ia680654f5e9f67154504264bc380f0a8d6a74d85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoImprove file scanning when publishing artifacts 31/68831/2
Cédric Ollivier [Sat, 9 Nov 2019 16:34:24 +0000 (17:34 +0100)]
Improve file scanning when publishing artifacts

Else it copies files from other testcases if the full suite is
executed sequentially.

Change-Id: Ic61472e47b655c34823a6fcb3ed3615e8f84a4c1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoAdd links in testcase details 27/68827/1
Cédric Ollivier [Sat, 9 Nov 2019 14:47:14 +0000 (15:47 +0100)]
Add links in testcase details

It allows finding easily reports thanks to DB.

Change-Id: Ib5c4400c186fd320ae87e7fd3d4404b65e996a82
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoPrint Test API links in console 20/68820/2
Cédric Ollivier [Sat, 9 Nov 2019 13:04:16 +0000 (14:04 +0100)]
Print Test API links in console

It adds TEST_DB_EXT_URL to print the right links in case of NAT or SSH
port forwardings.

Change-Id: If85b00de7325909facc903fba13a3fd59a1e705f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoAdd S3 env vars in env.py 19/68819/1
Cédric Ollivier [Sat, 9 Nov 2019 12:59:16 +0000 (13:59 +0100)]
Add S3 env vars in env.py

It completes the previous commits adding S3 support:
https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68760
https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68796

Change-Id: Iaaeb02ef2d9c6cdb7ff6c2c52e7086c751119871
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoGenerate Html and Xunit Behave reports 17/68817/2
Cédric Ollivier [Sat, 9 Nov 2019 11:28:24 +0000 (12:28 +0100)]
Generate Html and Xunit Behave reports

Change-Id: I7d5f31502ba61b61a0b1c885fe8828211bc0bc0a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoCreate Bucket if it doesn't exist 96/68796/2
Cédric Ollivier [Wed, 6 Nov 2019 23:29:38 +0000 (00:29 +0100)]
Create Bucket if it doesn't exist

Xtesting Ansible Role no longer creates bucket after starting Minio
[1].

[1] https://github.com/collivier/ansible-role-xtesting/commit/8c62525bb0d0b5f8dcc2c4436711d5d075de8811

Change-Id: I1ad473ce55f9c00df8e558fdc67f571ee0a1875c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoPublish artifacts to S3 repository 60/68760/4
Cédric Ollivier [Sat, 2 Nov 2019 11:18:22 +0000 (12:18 +0100)]
Publish artifacts to S3 repository

It simplifies Jenkins or Gitlab jobs by automatically publishing all
artifacts via the framework.

It leverages on Amazon Web Services (AWS) SDK [1] which supports the
current cases (OPNFV, Xtesting Ansible role [2], etc.).

[1] https://boto3.amazonaws.com/v1/documentation/api/latest/index.html?id=docs_gateway
[2] https://github.com/collivier/ansible-role-xtesting

Change-Id: I66e380c4da29fb0f973472a2c59ae0ea3c44fcfd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoOverride default Xtesting Ansible role values 82/68382/1
Cédric Ollivier [Thu, 22 Aug 2019 11:48:03 +0000 (13:48 +0200)]
Override default Xtesting Ansible role values

It ease maintaining the Xtesting branches.

Change-Id: Iaaeed0eb4331908266163746350e4163c102238a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoImprove dependency list (CircleCI) 34/68334/1
Cédric Ollivier [Sat, 10 Aug 2019 12:44:33 +0000 (14:44 +0200)]
Improve dependency list (CircleCI)

Change-Id: I8bee760092a40b3143cfbdd7ae5277a7c8cc4b0b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoRun Xtesting unit tests via CircleCI 33/68333/1
Cédric Ollivier [Sat, 10 Aug 2019 08:45:11 +0000 (10:45 +0200)]
Run Xtesting unit tests via CircleCI

It runs tox and published the artifacts.
It's worth mentioning that all docker images are already built via
Travis CI (amd64, arm and arm64) [1].

https://travis-ci.org/collivier/functest-xtesting

Change-Id: Icc57b6c45062425181230f3ebbdc5d3f7a925f99
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoRun perm when verifying changes 99/68299/1
Cédric Ollivier [Sat, 3 Aug 2019 11:46:52 +0000 (13:46 +0200)]
Run perm when verifying changes

umask is now correct in lf-virtual1 (0022).

Change-Id: I073a48eddaf1e26bcb3bbeeb232eb69d4a03a124
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoOverride the right default testcases.yaml 82/68282/1
Cédric Ollivier [Sat, 27 Jul 2019 19:39:31 +0000 (21:39 +0200)]
Override the right default testcases.yaml

Else robot and behave are skipped.

Change-Id: Ib306b51d4d254fcacca86a9eaa56f4b751e370cb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoFix remaining py36 testenv 76/68276/1
Cédric Ollivier [Sat, 27 Jul 2019 14:52:18 +0000 (16:52 +0200)]
Fix remaining py36 testenv

Change-Id: Ifa6bfc7beb992cc9094435b734bbca68fcc5a931
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoFix ssl issues in travis-ci 72/68272/1
Cédric Ollivier [Sat, 27 Jul 2019 12:33:16 +0000 (14:33 +0200)]
Fix ssl issues in travis-ci

https://travis-ci.org/collivier/functest-xtesting/builds/564133127

Change-Id: Ic0b8f20edfcccceda3d7226789f16e875af0bdb9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoOverride the new testcases.yaml 65/68265/2
Cédric Ollivier [Fri, 26 Jul 2019 16:11:43 +0000 (18:11 +0200)]
Override the new testcases.yaml

Change-Id: I5a075f6adc2a014a5f2a04602d29783a91b86bfe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdated from global requirements 54/68254/7
Cédric Ollivier [Wed, 24 Jul 2019 08:37:03 +0000 (10:37 +0200)]
Updated from global requirements

Change-Id: Ia65aef5331aa9848d58a6db9800b755f226fe8bf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoSwitch to Python 3.7 and Alpine 3.10 62/68262/6
Cédric Ollivier [Fri, 26 Jul 2019 10:58:04 +0000 (12:58 +0200)]
Switch to Python 3.7 and Alpine 3.10

It also allows building docs as doc8 is broken due to latest
OpenStack's upper-constraints.

pylint is updated to 2.3.1 (lastest py3.7 version)

It disables perm as umask is currently false on lf-virtual1.

Change-Id: I8568eeafa44c5dba72e206c532c1f50e3ad547f2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoAdding first patch for behave feature 06/68206/3
Deepak Chandella [Fri, 5 Jul 2019 17:01:36 +0000 (22:31 +0530)]
Adding first patch for behave feature

Change-Id: Ic975c301103b49cdec2bd26746b708388f21e892
Signed-off-by: Deepak Chandella <deepak.chandella@orange.com>
5 years agoMerge "Remove energy modules"
Cedric Ollivier [Fri, 14 Jun 2019 14:13:49 +0000 (14:13 +0000)]
Merge "Remove energy modules"

5 years agoRemove energy modules 45/68045/4
Cédric Ollivier [Fri, 14 Jun 2019 09:14:56 +0000 (11:14 +0200)]
Remove energy modules

The public recorder api has been down for a while.

Change-Id: Ib879ef3b9ef56338c10cfcdeb733451c6f7573a6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdated from global requirements 96/67996/1
Cédric Ollivier [Tue, 4 Jun 2019 18:06:14 +0000 (20:06 +0200)]
Updated from global requirements

Change-Id: I6f8705e701aac7432d7340d4949ace06339af3a3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoRun bandit when verifying changes 46/67946/3
Cédric Ollivier [Sat, 25 May 2019 09:03:40 +0000 (11:03 +0200)]
Run bandit when verifying changes

It reports only MEDIUM issues or higher like nova [1].
It selects bandit 1.1.0 as defined in nova and neutron lower
constraints [2].

[1] https://github.com/openstack/nova/blob/master/tox.ini#L221
[2] https://github.com/openstack/nova/blob/master/lower-constraints.txt#L8

Change-Id: I52524df867d99fae75798475c762a5f8253dacfa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoSet utf-8 in decode and encode calls 36/67936/1
Cédric Ollivier [Sat, 25 May 2019 07:55:02 +0000 (09:55 +0200)]
Set utf-8 in decode and encode calls

It eases backporting in iruya and hunter as a few logs can't be
decoded as ascii [1].

[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console

Change-Id: I09c793469bdf4a679e6ed5a268e705efa5f2a20f
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
5 years agoFix unit tests (py36) 39/67839/1
Cédric Ollivier [Sun, 12 May 2019 11:33:24 +0000 (13:33 +0200)]
Fix unit tests (py36)

It completes the patch "Update to Python3" [1] which was not fully
verified in Functest Gates [2].

[1] https://gerrit.opnfv.org/gerrit/#/c/67782/
[2] https://travis-ci.org/collivier/functest-xtesting/jobs/531380395

Change-Id: Icd0d743e14ca1430828907cefba10b50489020a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoStop setting utf-8 in decode/encode calls 38/67838/1
Cédric Ollivier [Sun, 12 May 2019 10:23:30 +0000 (12:23 +0200)]
Stop setting utf-8 in decode/encode calls

It's the default value.

Change-Id: I301f750cabc41a1564a700ae8d7328f195a4ae9b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoRename HelloWorld.txt to HelloWorld.robot 27/67827/1
Cédric Ollivier [Sat, 11 May 2019 08:21:01 +0000 (10:21 +0200)]
Rename HelloWorld.txt to HelloWorld.robot

It takes the following warning into account [1] "Automatically parsing
other than '*.robot' files is deprecated"

[1] https://build.opnfv.org/ci/job/xtesting-opnfv-xtesting-latest-fifth-run/150/console

Change-Id: Ibe01eea7eb83c8724d6b4afe3a487ad813fed30d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdate to Python3 82/67782/4
Cédric Ollivier [Tue, 7 May 2019 08:42:23 +0000 (10:42 +0200)]
Update to Python3

Now Xtesting containers use Python3 instead of python2.
https://mail.python.org/pipermail/python-dev/2018-March/152348.html

It also updates robotframework to latest release.

Change-Id: I57e0d8b1af9aeaae0c445941a9bdf0b8bd346834
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoEnable debug messages via env var 89/67689/1
Cédric Ollivier [Wed, 24 Apr 2019 19:08:37 +0000 (21:08 +0200)]
Enable debug messages via env var

It stops printing in xtesting.debug.log by default.
It decreases testing duration via Raspberry PI without additional
tasks [1].

[1] https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI

Change-Id: I2eded47a7a150a45330a69f3262fc7ca6fdb7463
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdate to opendev.org in tox.ini 60/67660/1
Cédric Ollivier [Sun, 21 Apr 2019 18:54:22 +0000 (20:54 +0200)]
Update to opendev.org in tox.ini

It completes the previous commit [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/67651/

Change-Id: I5298e406d7973572034242224b867ba8fd79e60f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdate all OpenStack refs to opendev.org 51/67651/1
Cédric Ollivier [Sun, 21 Apr 2019 17:41:01 +0000 (19:41 +0200)]
Update all OpenStack refs to opendev.org

Change-Id: Iefb247bcfbc490fd64bd9a78b4cacffca1603126
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdated from global requirements 23/67623/1
Cédric Ollivier [Thu, 18 Apr 2019 23:27:11 +0000 (01:27 +0200)]
Updated from global requirements

Change-Id: I12a51ae31601ef82f2a2f92f4642795a3a5a32db
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoAdd python3.6-dev 57/67557/1
Cédric Ollivier [Sat, 13 Apr 2019 14:15:18 +0000 (16:15 +0200)]
Add python3.6-dev

It's mandatory for building all python packages [1].

[1] https://travis-ci.org/collivier/functest-xtesting/builds/519646504

Change-Id: I71afe76a33a68f9bf0550c80003aa04ac76c9774
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoRun tox in .travis-ci 52/67552/1
Cédric Ollivier [Sat, 13 Apr 2019 11:24:17 +0000 (13:24 +0200)]
Run tox in .travis-ci

It installs python3 via ppa to run unit tests vs py36.
It completes the OPNFV gates which can't verify them.

Change-Id: I6942f12ec7daf50e62173290e55df87af9e35d5a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoMerge "Build Raspberry PI image via travis-ci"
Cedric Ollivier [Sat, 13 Apr 2019 09:27:07 +0000 (09:27 +0000)]
Merge "Build Raspberry PI image via travis-ci"

5 years agoBuild Raspberry PI image via travis-ci 48/67548/1
Cédric Ollivier [Fri, 12 Apr 2019 19:19:21 +0000 (21:19 +0200)]
Build Raspberry PI image via travis-ci

Change-Id: I91ced3f779921ed26bb91daa971692620311feaf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoPublish the presentation for ONS 2019 70/67470/2
Cédric Ollivier [Wed, 3 Apr 2019 04:46:19 +0000 (06:46 +0200)]
Publish the presentation for ONS 2019

It highlights the reuse of OPNFV frameworks from infrastructure
verification to e2e network service testing [1].

[1] http://testresults.opnfv.org/functest/ons2019/

Change-Id: Icc3d99329f01b68a2bf8639708abbf9415036414
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoFix manifest-tool builds 65/67365/2
Cédric Ollivier [Sun, 24 Mar 2019 12:47:59 +0000 (13:47 +0100)]
Fix manifest-tool builds

It now selects the last release to allow compiling it [1]

[1] https://travis-ci.org/collivier/functest-xtesting/jobs/510384544

Change-Id: I4fdff1df75f39b3b2bc70c3ee9c9910adbe9f0ff
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoMerge "Update Alpine tag in build.sh"
Cedric Ollivier [Sat, 23 Mar 2019 17:53:52 +0000 (17:53 +0000)]
Merge "Update Alpine tag in build.sh"

5 years agoUpdate Alpine tag in build.sh 47/67347/1
Cédric Ollivier [Sat, 23 Mar 2019 17:18:58 +0000 (18:18 +0100)]
Update Alpine tag in build.sh

It completes the previous commit updating Alpine.

Change-Id: Ic7bb294eeebad360278dcb75f841efec8e87c03b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoMerge "Update to Apine 3.9"
Juha Kosonen [Tue, 19 Mar 2019 07:06:56 +0000 (07:06 +0000)]
Merge "Update to Apine 3.9"

5 years agoUpdate to Apine 3.9 92/67292/1
Cédric Ollivier [Mon, 18 Mar 2019 20:17:22 +0000 (21:17 +0100)]
Update to Apine 3.9

It updates to the latest Alpine release [1]

[1] https://www.alpinelinux.org/posts/Alpine-3.9.0-released.html

Change-Id: I5c7bd64333fb38fcc7aa0c315de2bcd40435ed0a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdated from global requirements 43/67143/1
Cédric Ollivier [Thu, 28 Feb 2019 13:35:10 +0000 (14:35 +0100)]
Updated from global requirements

Change-Id: I6a2c5a16efdba81dda01fe21ad79f734dad3fd32
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoFix default host in ansible (127.0.0.1) 15/66415/1
Cédric Ollivier [Tue, 15 Jan 2019 20:26:02 +0000 (21:26 +0100)]
Fix default host in ansible (127.0.0.1)

Change-Id: Ief3656032a808a66fcb701272d5a4c3ecdca1427
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoRemove former ci jobs 85/66385/1
Cédric Ollivier [Mon, 14 Jan 2019 17:57:56 +0000 (18:57 +0100)]
Remove former ci jobs

They can now be generated via the new ansible role.

Change-Id: I4c8fdf209fd4f9fd8b10342a86453ff5e1cb5b09
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoMerge "Fix typo"
Cedric Ollivier [Fri, 4 Jan 2019 02:06:36 +0000 (02:06 +0000)]
Merge "Fix typo"

5 years agoMerge "Remove url from logs"
Cedric Ollivier [Fri, 4 Jan 2019 01:48:47 +0000 (01:48 +0000)]
Merge "Remove url from logs"

5 years agoFix typo 81/66181/1
Cédric Ollivier [Fri, 4 Jan 2019 01:44:49 +0000 (02:44 +0100)]
Fix typo

Change-Id: I501ca227374e782286920bf0cab09ba1a4355f46
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoRemove url from logs 73/66173/1
Cédric Ollivier [Thu, 3 Jan 2019 23:44:42 +0000 (00:44 +0100)]
Remove url from logs

It can be false in case of NAT.

Change-Id: Id1f4b59eeaf466545cc906bd86c2917b8df2b7a6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdated from global requirements 03/66103/1
Cédric Ollivier [Thu, 27 Dec 2018 19:03:03 +0000 (20:03 +0100)]
Updated from global requirements

Change-Id: Ic9fb51a1ab37d105d4040c5ea0bee442cdad5696
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>