functest-xtesting.git
5 years agoPublish artifacts to S3 repository 63/68763/4
Cédric Ollivier [Sat, 2 Nov 2019 11:18:22 +0000 (12:18 +0100)]
Publish artifacts to S3 repository

It simplifies Jenkins or Gitlab jobs by automatically publishing all
artifacts via the framework.

It leverages on Amazon Web Services (AWS) SDK [1] which supports the
current cases (OPNFV, Xtesting Ansible role [2], etc.).

[1] https://boto3.amazonaws.com/v1/documentation/api/latest/index.html?id=docs_gateway
[2] https://github.com/collivier/ansible-role-xtesting

Change-Id: I66e380c4da29fb0f973472a2c59ae0ea3c44fcfd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d012f3ac3ec4aa2730532be095956867d797aefb)

5 years agoOverride default Xtesting Ansible role values 87/68387/1
Cédric Ollivier [Thu, 22 Aug 2019 11:48:03 +0000 (13:48 +0200)]
Override default Xtesting Ansible role values

It ease maintaining the Xtesting branches.

Change-Id: Iaaeed0eb4331908266163746350e4163c102238a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4bef764e2b3976f73e91fed7bca97b40d4123522)

5 years agoAdd **kwargs in Energy wrapper() 73/68373/1
Cédric Ollivier [Wed, 21 Aug 2019 12:38:19 +0000 (14:38 +0200)]
Add **kwargs in Energy wrapper()

It's asked by few Functest testcases (rally_full).

Change-Id: Ia1c91c9284f703d239542a1ed929f67eae15ca6c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6bacb465e3075a3288db140abeab8daca4d256d0)

5 years agoRun Xtesting unit tests via CircleCI 36/68336/1
Cédric Ollivier [Sat, 10 Aug 2019 08:45:11 +0000 (10:45 +0200)]
Run Xtesting unit tests via CircleCI

It runs tox and published the artifacts.
It's worth mentioning that all docker images are already built via
Travis CI (amd64, arm and arm64) [1].

https://travis-ci.org/collivier/functest-xtesting

Change-Id: Icc57b6c45062425181230f3ebbdc5d3f7a925f99
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4be2e13c066fe5952b3a6339d27cd603e0fbaa18)

5 years agoRun perm when verifying changes 01/68301/1
Cédric Ollivier [Sat, 3 Aug 2019 11:46:52 +0000 (13:46 +0200)]
Run perm when verifying changes

umask is now correct in lf-virtual1 (0022).

Change-Id: I073a48eddaf1e26bcb3bbeeb232eb69d4a03a124
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6fcd58709c2aeb123dad6f86a103ae5f3af282e1)

5 years agoFix ssl issues in travis-ci 74/68274/1
Cédric Ollivier [Sat, 27 Jul 2019 12:33:16 +0000 (14:33 +0200)]
Fix ssl issues in travis-ci

https://travis-ci.org/collivier/functest-xtesting/builds/564133127

Change-Id: Ic0b8f20edfcccceda3d7226789f16e875af0bdb9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9c9be693530188872b9b945a4666e6bd98e94af2)

5 years agoEnable py36 unit tests 70/68270/1
Cédric Ollivier [Fri, 26 Jul 2019 10:58:04 +0000 (12:58 +0200)]
Enable py36 unit tests

It benefits from the swith to lf-virtual1.

Change-Id: I9f99f24a5e3c8ef6374e049d7117aa7d5aa4d442
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a8287fbdee4a75f1a8bd54f0c9072bc637242e03)

5 years agoUpdated from global requirements 56/68256/1
Cédric Ollivier [Wed, 24 Jul 2019 09:15:38 +0000 (11:15 +0200)]
Updated from global requirements

Change-Id: I2ce5bcf72fb95114b21a80cf51c5e848ac3c0b35
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdated from global requirements 98/67998/1
Cédric Ollivier [Tue, 4 Jun 2019 18:19:16 +0000 (20:19 +0200)]
Updated from global requirements

Change-Id: I0f6fc79125ff275a3df5b3d289cd7b2e501006f2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoRun bandit when verifying changes 48/67948/3
Cédric Ollivier [Sat, 25 May 2019 09:03:40 +0000 (11:03 +0200)]
Run bandit when verifying changes

It reports only MEDIUM issues or higher like nova [1].
It selects bandit 1.1.0 as defined in nova and neutron lower
constraints [2].

[1] https://github.com/openstack/nova/blob/master/tox.ini#L221
[2] https://github.com/openstack/nova/blob/master/lower-constraints.txt#L8

Change-Id: I52524df867d99fae75798475c762a5f8253dacfa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c659caccbf1f55db4e6e3cb31bf088ac57751e86)

5 years agoSet utf-8 in decode and encode calls 38/67938/1
Cédric Ollivier [Sat, 25 May 2019 07:55:02 +0000 (09:55 +0200)]
Set utf-8 in decode and encode calls

It eases backporting in iruya and hunter as a few logs can't be
decoded as ascii [1].

[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console

Change-Id: I09c793469bdf4a679e6ed5a268e705efa5f2a20f
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
(cherry picked from commit 12aa6e34ec1f388a40cb5a00826729f7c0d6f201)

5 years agoFix unit tests (py36) 20/67920/2
Cédric Ollivier [Sun, 12 May 2019 11:33:24 +0000 (13:33 +0200)]
Fix unit tests (py36)

It completes the patch "Update to Python3" [1] which was not fully
verified in Functest Gates [2].

[1] https://gerrit.opnfv.org/gerrit/#/c/67782/
[2] https://travis-ci.org/collivier/functest-xtesting/jobs/531380395

Change-Id: Icd0d743e14ca1430828907cefba10b50489020a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 934e90a269ea6b65e38578ac3f9a8bf7fc5212b1)

5 years agoStop setting utf-8 in decode/encode calls 19/67919/2
Cédric Ollivier [Sun, 12 May 2019 10:23:30 +0000 (12:23 +0200)]
Stop setting utf-8 in decode/encode calls

It's the default value.

Change-Id: I301f750cabc41a1564a700ae8d7328f195a4ae9b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0d308f4db3434ae6f8147f0f452e5c542429e636)

5 years agoUpdate to Python3 18/67918/2
Cédric Ollivier [Tue, 7 May 2019 08:42:23 +0000 (10:42 +0200)]
Update to Python3

Now Xtesting containers use Python3 instead of python2.
https://mail.python.org/pipermail/python-dev/2018-March/152348.html

It also updates robotframework to latest release.

Change-Id: I57e0d8b1af9aeaae0c445941a9bdf0b8bd346834
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6f8aa2785e0239dbed22fcb4d093a5bc110bcc3c)

5 years agoRename HelloWorld.txt to HelloWorld.robot 29/67829/1
Cédric Ollivier [Sat, 11 May 2019 08:21:01 +0000 (10:21 +0200)]
Rename HelloWorld.txt to HelloWorld.robot

It takes the following warning into account [1] "Automatically parsing
other than '*.robot' files is deprecated"

[1] https://build.opnfv.org/ci/job/xtesting-opnfv-xtesting-latest-fifth-run/150/console

Change-Id: Ibe01eea7eb83c8724d6b4afe3a487ad813fed30d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 74d0cd9b2c43a730c76ea3f03d0db8510a3be831)

5 years agoUpdate to opendev.org in tox.ini 62/67662/1
Cédric Ollivier [Sun, 21 Apr 2019 18:54:22 +0000 (20:54 +0200)]
Update to opendev.org in tox.ini

It completes the previous commit [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/67651/

Change-Id: I5298e406d7973572034242224b867ba8fd79e60f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b0fd44ea0320e95e2fcbfa0007f11fdf8e29dc76)

5 years agoUpdate all OpenStack refs to opendev.org 54/67654/1
Cédric Ollivier [Sun, 21 Apr 2019 17:41:01 +0000 (19:41 +0200)]
Update all OpenStack refs to opendev.org

Change-Id: Iefb247bcfbc490fd64bd9a78b4cacffca1603126
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d25d66ff328a91f4e75264768740409d6aac711d)

5 years agoUpdated from global requirements 25/67625/1
Cédric Ollivier [Thu, 18 Apr 2019 23:36:28 +0000 (01:36 +0200)]
Updated from global requirements

Change-Id: I58d3894b8a33f5b9d83bbf7880bbfa43b2995b7d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoAdd python3.6-dev 58/67558/1
Cédric Ollivier [Sat, 13 Apr 2019 14:15:18 +0000 (16:15 +0200)]
Add python3.6-dev

It's mandatory for building all python packages [1].

[1] https://travis-ci.org/collivier/functest-xtesting/builds/519646504

Change-Id: I71afe76a33a68f9bf0550c80003aa04ac76c9774
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 3fe94a30a171912be79f3bde3ffa4208567af87d)

5 years agoRun tox in .travis-ci 54/67554/1
Cédric Ollivier [Sat, 13 Apr 2019 11:24:17 +0000 (13:24 +0200)]
Run tox in .travis-ci

It installs python3 via ppa to run unit tests vs py36.
It completes the OPNFV gates which can't verify them.

Change-Id: I6942f12ec7daf50e62173290e55df87af9e35d5a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit be261aeeef79961a2cb1ac018a7df86e20ee7de4)

5 years agoFix 1 typo in .travis.yml 51/67551/2
Cédric Ollivier [Sat, 13 Apr 2019 09:59:01 +0000 (11:59 +0200)]
Fix 1 typo in .travis.yml

It completes the previous commit [1][2]

[1] https://gerrit.opnfv.org/gerrit/#/c/67550/
[2] https://travis-ci.org/collivier/functest-xtesting/jobs/519601390

Change-Id: Ib0465d8d005ae8336f35056860aad7cd38995f34
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoBuild Raspberry PI image via travis-ci 50/67550/1
Cédric Ollivier [Fri, 12 Apr 2019 19:19:21 +0000 (21:19 +0200)]
Build Raspberry PI image via travis-ci

Change-Id: I91ced3f779921ed26bb91daa971692620311feaf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 108be5e77a4832cd648474e4c3398fdaae9829ea)

5 years agoFix manifest-tool builds 66/67366/2
Cédric Ollivier [Sun, 24 Mar 2019 12:47:59 +0000 (13:47 +0100)]
Fix manifest-tool builds

It now selects the last release to allow compiling it [1]

[1] https://travis-ci.org/collivier/functest-xtesting/jobs/510384544

Change-Id: I4fdff1df75f39b3b2bc70c3ee9c9910adbe9f0ff
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 838fc2ffe26f06cb11455145b7e73c452e85c15d)

5 years agoUpdate Alpine tag in build.sh 50/67350/1
Cédric Ollivier [Sat, 23 Mar 2019 17:18:58 +0000 (18:18 +0100)]
Update Alpine tag in build.sh

It completes the previous commit updating Alpine.

Change-Id: Ic7bb294eeebad360278dcb75f841efec8e87c03b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8629e7e49e555f83f3c178b44bf10e74c8997c48)

5 years agoUpdate to Apine 3.9 49/67349/1
Cédric Ollivier [Mon, 18 Mar 2019 20:17:22 +0000 (21:17 +0100)]
Update to Apine 3.9

It updates to the latest Alpine release [1]

[1] https://www.alpinelinux.org/posts/Alpine-3.9.0-released.html

Change-Id: I5c7bd64333fb38fcc7aa0c315de2bcd40435ed0a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 32287765f2a2f08b9608fff92e2e262898f4e789)

5 years agoFix default host in ansible (127.0.0.1) 17/66417/1
Cédric Ollivier [Tue, 15 Jan 2019 20:26:02 +0000 (21:26 +0100)]
Fix default host in ansible (127.0.0.1)

Change-Id: Ief3656032a808a66fcb701272d5a4c3ecdca1427
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit dd85f3feb6149b20b165ad6150bbe743d434f7a0)

5 years agoRemove former ci jobs 87/66387/1
Cédric Ollivier [Mon, 14 Jan 2019 17:57:56 +0000 (18:57 +0100)]
Remove former ci jobs

They can now be generated via the new ansible role.

Change-Id: I4c8fdf209fd4f9fd8b10342a86453ff5e1cb5b09
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 05807a01d3aeb8716bc277e8e6802bad7e5bb3fd)

5 years agoConform with new tag configs 91/66191/4
Cédric Ollivier [Fri, 4 Jan 2019 02:07:11 +0000 (03:07 +0100)]
Conform with new tag configs

It allows generating gate jobs.

Change-Id: I327a2eedf0ca0f0666d32405fe2dc0558688292f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoFix typo 85/66185/1
Cédric Ollivier [Fri, 4 Jan 2019 01:44:49 +0000 (02:44 +0100)]
Fix typo

Change-Id: I501ca227374e782286920bf0cab09ba1a4355f46
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a4f9b0ab9fd886b26d538c68e07d073642c62923)

5 years agoRemove url from logs 83/66183/1
Cédric Ollivier [Thu, 3 Jan 2019 23:44:42 +0000 (00:44 +0100)]
Remove url from logs

It can be false in case of NAT.

Change-Id: Id1f4b59eeaf466545cc906bd86c2917b8df2b7a6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 20e96ac57df21108cd23feea709e734907866fb6)

5 years agoApply operations via sixer 85/66085/1
Cédric Ollivier [Thu, 27 Dec 2018 15:40:50 +0000 (16:40 +0100)]
Apply operations via sixer

Change-Id: I7609f83da73d0ac03fc0d270d42f44708335995c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d66b6c6d89059055e67ac939c258b0dc6fac9825)

5 years agoAllow printing bash cmd output in console 71/66071/1
Cédric Ollivier [Sun, 16 Dec 2018 16:50:38 +0000 (17:50 +0100)]
Allow printing bash cmd output in console

It switches to Popen to print real-time console.
Console has to be enabled per testcase (testcases.yaml).

Change-Id: Id36b42c8409262f7c443e98ae2bcc465984b287f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit ebe4291c4457d84cb8425999cfa12371c1c7ce40)

5 years agoGenerate reports for unit tests 67/66067/1
Cédric Ollivier [Wed, 26 Dec 2018 10:23:02 +0000 (11:23 +0100)]
Generate reports for unit tests

It now leverages on subunit to generate html and xml reports.

Change-Id: I3f5a4fe5547e743b122b63e0b8530c9d9677cdbd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 07d8b10d394d1632742c16e4f1f45a29879cf7c1)

5 years agoVerify the Ansible playbook via ansible-lint 89/65889/1
Cédric Ollivier [Sat, 15 Dec 2018 14:58:56 +0000 (15:58 +0100)]
Verify the Ansible playbook via ansible-lint

Change-Id: I9e6778b935a0a8d6e76cb4f1f16ef08c811eee73
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e3d5138f69bbffdff063019dc35c4b760b2c9564)

5 years agoDeploy CI/CD toolchains for any Xtesting-based project 87/65887/1
Cédric Ollivier [Mon, 10 Dec 2018 20:38:43 +0000 (21:38 +0100)]
Deploy CI/CD toolchains for any Xtesting-based project

It allows deploying the CI/CD toolchain via ansible for all projects
based on Xtesting (e.g. OPNFV Functest, ONAP robot tests, etc.).

It deploys Jenkins, Minio and S3www and loads all jobs in Jenkins.
Last components (MongoDB, TestAPI and dashboard) will be deployed in
the next update of the ansible role.

To deploy the testing toolchain:
$ ansible-galaxy install collivier.xtesting
$ ansible-playbook ansible/site.yml

Change-Id: I5a8ddb45fc354c9a22c52f0d42ce2e0181f345b7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit da22164eda930726eef5e827885e9f1798c4d7e7)

5 years agoVerify missing yaml files via yamllint 77/65877/1
Cédric Ollivier [Sat, 15 Dec 2018 14:45:13 +0000 (15:45 +0100)]
Verify missing yaml files via yamllint

Change-Id: I0cd412cd49cac62b393658bf55e0e32def908c85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7206ac5bbdb6e8dc5a947a9fdc2300805f0b048c)

5 years agoEnable robot sample in the container 83/65683/1
Cédric Ollivier [Sun, 9 Dec 2018 08:55:56 +0000 (09:55 +0100)]
Enable robot sample in the container

The testcase is disabled by default in package as the location
depends on OS. But it can be safely enabled in the Alpine container.

Change-Id: I8d1befd09b8d823010dfce7fbb18eddb864fd6e6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 49575b34b9b3ed410c8da635eacdd64bb28c6d2a)

5 years agoSet shell=True in subprocess.check_call 15/65515/2
Cédric Ollivier [Wed, 28 Nov 2018 21:37:17 +0000 (22:37 +0100)]
Set shell=True in subprocess.check_call

It allows running multiple shell instructions (see third).

Change-Id: I132813c51d42f0fb4bc729d315c468d426f2fb3c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit eae8283aaadeb77884406ded028f2e414659c3b3)

5 years agoStop returning values in run() 11/65511/1
Cédric Ollivier [Wed, 28 Nov 2018 21:09:03 +0000 (22:09 +0100)]
Stop returning values in run()

Runner only checks status via is_successful().

Change-Id: I12647449b037223ac4e3c6ee577610d4430d0bf5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0afe15823d98871a09ae88840a2d3538137299a8)

6 years agoTemporarily disable py36 59/63759/3
Cédric Ollivier [Fri, 19 Oct 2018 14:11:59 +0000 (16:11 +0200)]
Temporarily disable py36

Verify servers haven't been updated yet to support py36.

Change-Id: Id2999a94f9c2c03432412a4b40a4b3c593aaffb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a78e7647742d23eba2f4bc2585fee3eeaf3547fb)

6 years agoFix a wierd pylint error 73/63773/2
Cédric Ollivier [Fri, 19 Oct 2018 14:30:59 +0000 (16:30 +0200)]
Fix a wierd pylint error

Change-Id: Ia213e3e1beb80e62f6691c79544b1a0e0e3bb81e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9b3774344894b076dc0824630523f93f0943ee67)

6 years agoUpdate python3 to python3.6 47/63647/1
Cédric Ollivier [Wed, 17 Oct 2018 11:44:35 +0000 (13:44 +0200)]
Update python3 to python3.6

Change-Id: I845f8eb0544dc32febec7a17ac7c05412eb31198
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit afe26643a41820904e9cef8f057a2b18395d562e)

6 years agoUpdate ci/globals.yaml (hunter) 93/62393/2
Cédric Ollivier [Sun, 16 Sep 2018 10:30:27 +0000 (12:30 +0200)]
Update ci/globals.yaml (hunter)

Change-Id: Ieb243916c96fca4534237f8f46914dfec8311221
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge changes I83c64de0,I61c3e3af into stable/hunter
Cedric Ollivier [Thu, 13 Sep 2018 09:41:46 +0000 (09:41 +0000)]
Merge changes I83c64de0,I61c3e3af into stable/hunter

* changes:
  Update .travis.yml
  Fix BRANCH in Dockerfile

6 years agoUpdate .travis.yml 23/62223/1
Cédric Ollivier [Thu, 13 Sep 2018 09:14:58 +0000 (11:14 +0200)]
Update .travis.yml

It takes the new tag into account.

Change-Id: I83c64de06ca89112633bb1f024f143d0c554db28
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix BRANCH in Dockerfile 21/62221/1
Cédric Ollivier [Thu, 13 Sep 2018 09:07:12 +0000 (11:07 +0200)]
Fix BRANCH in Dockerfile

Change-Id: I61c3e3af5e3ed55ac5a7c04853e739d004867b48
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdated from global requirements 57/62157/1
Cédric Ollivier [Wed, 12 Sep 2018 19:25:08 +0000 (21:25 +0200)]
Updated from global requirements

Change-Id: I2f0ef84d98d6db190eeef9110ca76956c9872642
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPrepare hunter docker images 43/62143/1
Cédric Ollivier [Wed, 12 Sep 2018 18:19:38 +0000 (20:19 +0200)]
Prepare hunter docker images

Change-Id: I294843fa62b20163ac111d713f83c0201cfcfad9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRewrite git clone 75/61775/1
Cédric Ollivier [Mon, 3 Sep 2018 18:43:23 +0000 (20:43 +0200)]
Rewrite git clone

Change-Id: I0e17233faaf8eddb263e90cb82b65335f1c9cf40
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPublish daily and gating jjbs 07/61707/1
Cédric Ollivier [Sat, 1 Sep 2018 20:26:42 +0000 (22:26 +0200)]
Publish daily and gating jjbs

Change-Id: I1050741ce34e151be30404275670e83fc2a40d1a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate to Alpine 3.8 05/61705/1
Cédric Ollivier [Sat, 1 Sep 2018 20:36:27 +0000 (22:36 +0200)]
Update to Alpine 3.8

https://alpinelinux.org/posts/Alpine-3.8.0-released.html

Change-Id: I73fba49c3d1bbf018e94e67c835c4049c34209b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove former samples/testcases.yaml 95/61595/1
Cédric Ollivier [Thu, 30 Aug 2018 12:47:37 +0000 (14:47 +0200)]
Remove former samples/testcases.yaml

Change-Id: I1487c73ae4c6e2801c7952689c8d9fe49613db95
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoStop verifying ResultWriter.write_results exit codes 41/61541/1
Cédric Ollivier [Wed, 29 Aug 2018 14:08:14 +0000 (16:08 +0200)]
Stop verifying ResultWriter.write_results exit codes

ResultWriter.write_results() returns false if one test fails.
It's skipped by run() because the report is correctly generated.

[1] https://robot-framework.readthedocs.io/en/2.9.2/_modules/robot/reporting/resultwriter.html

Change-Id: If29059b272679ed89a1189e0bb52997c83401b94
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoChange output dir 13/61513/1
Cédric Ollivier [Wed, 29 Aug 2018 09:26:24 +0000 (11:26 +0200)]
Change output dir

It now reads case_name instead of selecting an hardcoded value
(robot).

Change-Id: I1dfb0daa2eb52f526abdf1664bf5ac36549509a6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate RobotFramework config 83/61483/1
Cédric Ollivier [Tue, 28 Aug 2018 19:42:04 +0000 (21:42 +0200)]
Update RobotFramework config

It completes "Leverage on abc and stevedore".

Change-Id: Ieb8e7dee79cd4a8a1e93e2db9945577754e35aa8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoInitialize testcase results to EX_TESTCASE_FAILED 85/61085/1
Cédric Ollivier [Mon, 20 Aug 2018 03:55:57 +0000 (05:55 +0200)]
Initialize testcase results to EX_TESTCASE_FAILED

Else the testcase returns EX_OK if exceptions in __init__()

Change-Id: I5f23e91a3ecda22a429a006af56592ee86084038
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Protect vs None when calling regex"
Cedric Ollivier [Tue, 14 Aug 2018 16:30:24 +0000 (16:30 +0000)]
Merge "Protect vs None when calling regex"

6 years agoProtect vs None when calling regex 45/60945/1
Cédric Ollivier [Tue, 14 Aug 2018 16:23:41 +0000 (18:23 +0200)]
Protect vs None when calling regex

Change-Id: I93d22442c28e674433234d7729838944962bdbe2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoLeverage on abc and stevedore 81/60881/2
Cédric Ollivier [Fri, 10 Aug 2018 10:55:10 +0000 (12:55 +0200)]
Leverage on abc and stevedore

Change-Id: I7b3c4c0c5dd0c9e6fb3e52c3fff5221d4b831b02
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSkip the selected testcase too 33/60833/4 0.56
Cédric Ollivier [Fri, 10 Aug 2018 11:04:11 +0000 (13:04 +0200)]
Skip the selected testcase too

It completes "Allow calling a skip test" [1]

[1] https://gerrit.opnfv.org/gerrit/60655

Change-Id: I02499aed56e6b23563165ea1f17b476e12408823
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoGenerate robot reports 77/60677/2
Cédric Ollivier [Tue, 7 Aug 2018 05:16:57 +0000 (07:16 +0200)]
Generate robot reports

Change-Id: Ib9efe14bce6227f9609200c12ded4470bd0be969
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAllow calling a skip test 55/60655/2
Cédric Ollivier [Tue, 7 Aug 2018 03:06:23 +0000 (05:06 +0200)]
Allow calling a skip test

run_tests shouldn't return an incorrect value if the test is skipped.
Else it simply forbids running tests in parallel (one test per
thread).

Change-Id: I07efca28dbf6cf1c29ec8e5c999e38cfe3ad0aad
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoStop skipping testcases if one raises exceptions 67/60367/1
Cédric Ollivier [Mon, 30 Jul 2018 14:08:41 +0000 (16:08 +0200)]
Stop skipping testcases if one raises exceptions

https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console

Change-Id: Ic412c5b55169f599bd9cdb623f349dd2220940db
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoStop printing exceptions twice 25/59825/1 0.53
Cédric Ollivier [Sun, 15 Jul 2018 09:30:40 +0000 (11:30 +0200)]
Stop printing exceptions twice

Change-Id: Ife772d33741e7023ed72afeb0f74ed8b461e0033
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix results when only one skipped test 23/59823/1
Cédric Ollivier [Sun, 15 Jul 2018 09:22:05 +0000 (11:22 +0200)]
Fix results when only one skipped test

Change-Id: Id6c8029b8be1e3a01979feb45daebad08710fe20
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAllow dynamically skipping testcases 21/59821/2 0.52
Cédric Ollivier [Sun, 15 Jul 2018 07:49:57 +0000 (09:49 +0200)]
Allow dynamically skipping testcases

Change-Id: I7cf47f0625bdb8345fef43b24c51bd84ef4486ea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSkip testcases by any env var 39/59739/3 0.51
Cédric Ollivier [Thu, 12 Jul 2018 08:48:17 +0000 (10:48 +0200)]
Skip testcases by any env var

It also removes CI_LOOP which is releng centric.
It can be passed as dependency if required.

Change-Id: I146bb97950cb88062451158b7cc6a16c7f9d47a2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoImprove dependency management 29/59729/3
Cédric Ollivier [Thu, 12 Jul 2018 06:31:31 +0000 (08:31 +0200)]
Improve dependency management

It avoids declaring dependencies if needed.
Negative regex are correcty managed as well.

Change-Id: I0e978823526246bc4a5192e63a8a893a4add0e2a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove Feature logger 91/57891/3 0.42
Panagiotis Karalis [Fri, 25 May 2018 09:27:12 +0000 (12:27 +0300)]
Remove Feature logger

This class atttribute is removed as it's quite useless (it forces one
module per project). All messages are now printed to xtesting.log
whatever the namespace and all warnings are printed in console.

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I6860eaf427093ea21b3bd78650bec7939e947b2d
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoCheck shell scripts via bashate 61/56361/2
Cédric Ollivier [Tue, 24 Apr 2018 12:31:54 +0000 (14:31 +0200)]
Check shell scripts via bashate

Change-Id: I33df0017945a32946c46bff0768624901e13f6f1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoCreate a static method to configure logger 67/55867/2 0.41
Cédric Ollivier [Tue, 17 Apr 2018 07:48:15 +0000 (09:48 +0200)]
Create a static method to configure logger

It helps OPNFV Features to configure their multiple loggers as
self.logger is not suitable in case of multiple modules.

Change-Id: I5794a3e323d70abfdd85db89a9890488828efd88
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate to stable/queens 99/55499/1 0.40
Cédric Ollivier [Thu, 12 Apr 2018 02:34:08 +0000 (04:34 +0200)]
Update to stable/queens

Change-Id: I2a8d624df52c0c705d5fbc662f11948bdc51d765
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdated from global requirements 95/55495/1
Cédric Ollivier [Thu, 12 Apr 2018 02:16:32 +0000 (04:16 +0200)]
Updated from global requirements

Change-Id: If9959fb71b9970a27f607ec1c491bf790adfe499
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoExclude doc/reveal.js from perm 37/55437/1
Cédric Ollivier [Wed, 11 Apr 2018 18:01:33 +0000 (20:01 +0200)]
Exclude doc/reveal.js from perm

Change-Id: I6c81163d55217a374269ee7d2aae63a854c9fdeb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdated from global requirements 73/55373/1
Cédric Ollivier [Tue, 10 Apr 2018 20:01:29 +0000 (22:01 +0200)]
Updated from global requirements

Change-Id: I8fae672c01c3fa9d99842827436e2e94cfac2be8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoCheck README.rst by doc8 51/55151/1
Cédric Ollivier [Sat, 7 Apr 2018 16:53:54 +0000 (18:53 +0200)]
Check README.rst by doc8

Change-Id: I9ac9fa26d49fd9cd01844e5579255cfadbd8b276
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoCheck API doc via doc8 71/54871/1
Cédric Ollivier [Wed, 4 Apr 2018 05:00:49 +0000 (07:00 +0200)]
Check API doc via doc8

It also cleans unseless dirs.

Change-Id: I52ddc9e2adcd13c95e4a8939397686f50b9e6c4c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoIgnore output dirs and files 89/54689/1
Cédric Ollivier [Sat, 31 Mar 2018 11:10:17 +0000 (13:10 +0200)]
Ignore output dirs and files

Change-Id: I5d8bbee73489e723dec4a1962c3b95943a038efc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix software names (uppercase letters) 87/54687/1
Cédric Ollivier [Sat, 31 Mar 2018 10:57:56 +0000 (12:57 +0200)]
Fix software names (uppercase letters)

Change-Id: I1eba2a3594b050e4c50ac081a653011fa1e98426
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate Xtesting presentation 23/54423/1
Cédric Ollivier [Sat, 24 Mar 2018 15:58:12 +0000 (16:58 +0100)]
Update Xtesting presentation

Change-Id: Ida18f3fd0138eb70bb2dd6b512cec5bef470b685
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPublish xtesting presentation 13/54413/2
Cédric Ollivier [Fri, 23 Mar 2018 20:55:22 +0000 (21:55 +0100)]
Publish xtesting presentation

Change-Id: Ia33a17ed5868bf61f088feea1a608603fdeb28dc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix regex when INSTALLER_TYPE is unset 89/54089/2
Cédric Ollivier [Mon, 19 Mar 2018 08:51:37 +0000 (09:51 +0100)]
Fix regex when INSTALLER_TYPE is unset

Change-Id: I0ec012185f3c90b2a2c82b6f204ce332f3fa9c7f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate api/index.rst 55/54055/1
Cédric Ollivier [Sun, 18 Mar 2018 18:30:22 +0000 (19:30 +0100)]
Update api/index.rst

It mainly copies the wiki main page [1].

[1] https://wiki.opnfv.org/display/functest/Xtesting

Change-Id: Iaedfa2bbf83976654a626640b38d8cc27131d3d4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd classifiers (pypi) 49/54049/1 0.24
Cédric Ollivier [Sun, 18 Mar 2018 10:38:18 +0000 (11:38 +0100)]
Add classifiers (pypi)

Change-Id: Ifabc4b33e56d37e097724cee2afd1c1da2438f9c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd README.rst (pypi) 47/54047/1
Cédric Ollivier [Sun, 18 Mar 2018 10:29:23 +0000 (11:29 +0100)]
Add README.rst (pypi)

Change-Id: I4248c86ee51b9458d367440670a0abaf3ec7c87f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd a travis-ci config file 93/53493/2
Cédric Ollivier [Mon, 12 Mar 2018 07:19:57 +0000 (08:19 +0100)]
Add a travis-ci config file

It also fixes a typo in build.sh.

Change-Id: Id9ac580d3b6268dd8e2326cecef57db213ef1a11
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Add build.sh for functest-xtesting"
Cedric Ollivier [Fri, 9 Mar 2018 09:45:29 +0000 (09:45 +0000)]
Merge "Add build.sh for functest-xtesting"

6 years agoAdd build.sh for functest-xtesting 35/53235/5
Delia Popescu [Wed, 7 Mar 2018 10:04:18 +0000 (12:04 +0200)]
Add build.sh for functest-xtesting

JIRA: FUNCTEST-948

Change-Id: If174ac0cc5716ccd6f5bcd6b5627feb222d05b0b
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
6 years agoAdd tags support using include options 21/53321/1
mrichomme [Thu, 8 Mar 2018 15:23:38 +0000 (16:23 +0100)]
Add tags support using include options

Change-Id: Ibfd8645e2ec7da7d05ae806b5bc1f5a90bfc39a2
Signed-off-by: mrichomme <morgan.richomme@orange.com>
6 years agoAdd py3 support in samples 83/53183/1
Cédric Ollivier [Tue, 6 Mar 2018 20:12:22 +0000 (21:12 +0100)]
Add py3 support in samples

Change-Id: I402be2f5921577985218306161a6efe1b9d62a48
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoReturn all status when running tiers 53/53053/1 0.22
Cédric Ollivier [Sun, 4 Mar 2018 10:56:30 +0000 (11:56 +0100)]
Return all status when running tiers

Change-Id: I31a062304d47c055c14e5afe8f560c3048b071f4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoStop filtering the project when calculating results 35/53035/1 0.21
Cédric Ollivier [Sat, 3 Mar 2018 10:55:44 +0000 (11:55 +0100)]
Stop filtering the project when calculating results

Change-Id: Ia0917426775831176206f4bb300d513cc3190e08
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove Functest-related env vars 01/52901/1
Cédric Ollivier [Thu, 1 Mar 2018 03:06:54 +0000 (04:06 +0100)]
Remove Functest-related env vars

Change-Id: If1b44ad61db58fd3d02817373255c6467f515e85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoLeverage on tags for all versions 93/52893/1
Cédric Ollivier [Thu, 1 Mar 2018 02:12:35 +0000 (03:12 +0100)]
Leverage on tags for all versions

Change-Id: I7e8c1a9f97711c935b61696b348183b382c15d12
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSet universal wheels 81/52881/1 0.2
Cédric Ollivier [Thu, 1 Mar 2018 01:20:10 +0000 (02:20 +0100)]
Set universal wheels

Change-Id: I856b02ff26808cc56ecee62570f5370795abc178
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoEnsure py27 and py35 supports 67/52867/1
Cédric Ollivier [Wed, 28 Feb 2018 18:44:53 +0000 (19:44 +0100)]
Ensure py27 and py35 supports

Change-Id: Ia1cd423be2e55ab7539bcd2551c53792c08b976a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd mandatory package infos (PyPI) 55/52855/2
Cédric Ollivier [Wed, 28 Feb 2018 17:51:45 +0000 (18:51 +0100)]
Add mandatory package infos (PyPI)

Change-Id: I2ab4eb5f2916ee26cd3be48eb4fa2074d020967c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoSwitch from /home/opnfv/functest to /var/lib/xtesting 53/52853/2
Cédric Ollivier [Wed, 28 Feb 2018 17:46:13 +0000 (18:46 +0100)]
Switch from /home/opnfv/functest to /var/lib/xtesting

Functest containers will have to create symlinks to allow publishing
artifacts.

All classes create the mandatory dirs.

Change-Id: Ia1f215005d553dd6d64685e4d8a3f5c843c5db7a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove obsolete Alpine packages 39/52839/1
Cédric Ollivier [Wed, 28 Feb 2018 15:13:05 +0000 (16:13 +0100)]
Remove obsolete Alpine packages

Change-Id: Ibaaaab6af46cf3bf76be5442f5e155de592e727e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoPublish Dockerfile and samples 13/52813/6
Cédric Ollivier [Wed, 28 Feb 2018 10:51:16 +0000 (11:51 +0100)]
Publish Dockerfile and samples

Change-Id: Ie776fea631f04bb42d8ae80bc658318d8644d0e5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>