Cédric Ollivier [Tue, 17 Mar 2020 13:28:38 +0000 (14:28 +0100)]
Post-processed data from DB
It removes base_url to match the location in archive.
It forces a relative path by removing first "/".
It makes sense but it may raise side effects in dovetail webportal.
Change-Id: Idca69a99fed54ddf69334a865bae15b0a08220fc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 14 Jan 2020 16:28:36 +0000 (17:28 +0100)]
Publish Xtesting2020
Change-Id: Ife0d97eba3b09b54c0904128896998d8524db905
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 11 Jan 2020 18:08:27 +0000 (19:08 +0100)]
Publish CNTT Snezka RC Cookbook
http://testresults.opnfv.org/functest/cntt_rc_cookbook/
Change-Id: Ie100ddcf4a0ad1b8ba01a10ae91d2a6f40587c3c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 4 Jan 2020 20:16:04 +0000 (21:16 +0100)]
Switch to multiarch binfmt
It allows building arm containers as proposed by arm32v6 et arm32v7.
Change-Id: Icaca973f70c167ec8eb59df882638683fe35e40e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 4 Jan 2020 18:02:55 +0000 (19:02 +0100)]
Select arm32v6 et arm64v8 repos
They are the official repos [1].
multiarch repo doesn't support Alpine 3.11 and Raspberry PI 1 (arm32v6).
[1] https://hub.docker.com/_/alpine/
Change-Id: I2d73ef867c9714ecddba433295f822cf29b27b90
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 4 Jan 2020 16:31:08 +0000 (17:31 +0100)]
Fix tox env list in travis-ci
https://travis-ci.org/collivier/functest-xtesting/jobs/
632680250
Change-Id: I49fb0e399b2c0a31af21f5216b0576335773b8ab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 4 Jan 2020 16:07:35 +0000 (17:07 +0100)]
Add python3.8-distutils when verifying vs travis-ci
https://travis-ci.org/collivier/functest-xtesting/jobs/
632675948
Change-Id: I87caca2810c966c6b8219b7dc044f02ac7b8e561
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 4 Jan 2020 12:54:26 +0000 (13:54 +0100)]
Update Alpine to 3.11
It also updates Python to 3.8 (default version).
https://alpinelinux.org/posts/Alpine-3.11.0-released.html
Change-Id: I1401c37adb71a6f7d37bd8724b93a058ecb68557
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 4 Jan 2020 15:30:07 +0000 (16:30 +0100)]
Fix behave driver and its related unit tests
Change-Id: I466d655162c1ddd5f4e3ef0e356a27007bfaea0f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 22 Dec 2019 20:09:53 +0000 (21:09 +0100)]
Compress Campaign data (zip)
Change-Id: I7b46a88a181293297cc764026f2804d36a59955a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 19 Dec 2019 06:13:12 +0000 (07:13 +0100)]
Dump DB and artifacts for third-party certification
It conforms with Kubernetes Conformance [1] model and could be reused
by OVP or any third-party CNTT-based certification.
It publishes the final archive in the S3 repository.
XtestingCI will generate the final job calling this feature.
[1] https://github.com/cncf/k8s-conformance
Change-Id: I7394c9d52d2cc9370eae125ca5398ff734e5b8d6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 7 Dec 2019 11:59:47 +0000 (12:59 +0100)]
Disable false ansible list warnings
git commit has to be executed via shell module [1].
[1] https://github.com/ansible/ansible/issues/50334
Change-Id: I0ad8abe12bd592cb2a790ec3373452d46573776a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 30 Nov 2019 12:08:20 +0000 (13:08 +0100)]
Mock os.path.join in push_to_db
Change-Id: I8d0c8f9ef4688454a6d2992ab1a20d871814e23f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Sat, 30 Nov 2019 10:31:42 +0000 (10:31 +0000)]
Merge "Postprocess the TestAPI href returned"
Cédric Ollivier [Sat, 30 Nov 2019 09:44:46 +0000 (10:44 +0100)]
Postprocess the TestAPI href returned
[1] returned http://localhost:8082
[1] https://build.opnfv.org/ci/job/airship-opnfv-functest-healthcheck-latest-connection_check-run/58/console
Change-Id: Ifc0e37a97442193a77762ecc2928b100e27028cd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 27 Nov 2019 10:20:41 +0000 (11:20 +0100)]
Run update package index before installing pkg in Circle CI.
Change-Id: Id160a5bc68c2201db124773bf6eee8b6bb4cb7fc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 18 Nov 2019 19:16:49 +0000 (20:16 +0100)]
Forbid multipart upload if google storage
Google Storage doesn't support S3 multipart uploads
https://docs.aws.amazon.com/AmazonS3/latest/dev/mpuoverview.html
https://cloud.google.com/storage/docs/composite-objects
5 * 1024 ** 5 is the multipart upload limit.
https://docs.aws.amazon.com/AmazonS3/latest/dev/qfacts.html
Change-Id: Iec3a5cd70ea6e912272ea231eecde6ee4f51ce4f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 16 Nov 2019 15:21:44 +0000 (16:21 +0100)]
Add ContentType when publishing artifacts
The default value 'application/octet-stream' is mostly
incorrect and forces downloading all links.
https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-hunter-connection_check-run/436/console
Change-Id: Ia680654f5e9f67154504264bc380f0a8d6a74d85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 9 Nov 2019 16:34:24 +0000 (17:34 +0100)]
Improve file scanning when publishing artifacts
Else it copies files from other testcases if the full suite is
executed sequentially.
Change-Id: Ic61472e47b655c34823a6fcb3ed3615e8f84a4c1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 9 Nov 2019 14:47:14 +0000 (15:47 +0100)]
Add links in testcase details
It allows finding easily reports thanks to DB.
Change-Id: Ib5c4400c186fd320ae87e7fd3d4404b65e996a82
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 9 Nov 2019 13:04:16 +0000 (14:04 +0100)]
Print Test API links in console
It adds TEST_DB_EXT_URL to print the right links in case of NAT or SSH
port forwardings.
Change-Id: If85b00de7325909facc903fba13a3fd59a1e705f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 9 Nov 2019 12:59:16 +0000 (13:59 +0100)]
Add S3 env vars in env.py
It completes the previous commits adding S3 support:
https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68760
https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68796
Change-Id: Iaaeb02ef2d9c6cdb7ff6c2c52e7086c751119871
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 9 Nov 2019 11:28:24 +0000 (12:28 +0100)]
Generate Html and Xunit Behave reports
Change-Id: I7d5f31502ba61b61a0b1c885fe8828211bc0bc0a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 6 Nov 2019 23:29:38 +0000 (00:29 +0100)]
Create Bucket if it doesn't exist
Xtesting Ansible Role no longer creates bucket after starting Minio
[1].
[1] https://github.com/collivier/ansible-role-xtesting/commit/
8c62525bb0d0b5f8dcc2c4436711d5d075de8811
Change-Id: I1ad473ce55f9c00df8e558fdc67f571ee0a1875c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 2 Nov 2019 11:18:22 +0000 (12:18 +0100)]
Publish artifacts to S3 repository
It simplifies Jenkins or Gitlab jobs by automatically publishing all
artifacts via the framework.
It leverages on Amazon Web Services (AWS) SDK [1] which supports the
current cases (OPNFV, Xtesting Ansible role [2], etc.).
[1] https://boto3.amazonaws.com/v1/documentation/api/latest/index.html?id=docs_gateway
[2] https://github.com/collivier/ansible-role-xtesting
Change-Id: I66e380c4da29fb0f973472a2c59ae0ea3c44fcfd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 22 Aug 2019 11:48:03 +0000 (13:48 +0200)]
Override default Xtesting Ansible role values
It ease maintaining the Xtesting branches.
Change-Id: Iaaeed0eb4331908266163746350e4163c102238a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 10 Aug 2019 12:44:33 +0000 (14:44 +0200)]
Improve dependency list (CircleCI)
Change-Id: I8bee760092a40b3143cfbdd7ae5277a7c8cc4b0b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 10 Aug 2019 08:45:11 +0000 (10:45 +0200)]
Run Xtesting unit tests via CircleCI
It runs tox and published the artifacts.
It's worth mentioning that all docker images are already built via
Travis CI (amd64, arm and arm64) [1].
https://travis-ci.org/collivier/functest-xtesting
Change-Id: Icc57b6c45062425181230f3ebbdc5d3f7a925f99
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 3 Aug 2019 11:46:52 +0000 (13:46 +0200)]
Run perm when verifying changes
umask is now correct in lf-virtual1 (0022).
Change-Id: I073a48eddaf1e26bcb3bbeeb232eb69d4a03a124
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 27 Jul 2019 19:39:31 +0000 (21:39 +0200)]
Override the right default testcases.yaml
Else robot and behave are skipped.
Change-Id: Ib306b51d4d254fcacca86a9eaa56f4b751e370cb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 27 Jul 2019 14:52:18 +0000 (16:52 +0200)]
Fix remaining py36 testenv
Change-Id: Ifa6bfc7beb992cc9094435b734bbca68fcc5a931
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 27 Jul 2019 12:33:16 +0000 (14:33 +0200)]
Fix ssl issues in travis-ci
https://travis-ci.org/collivier/functest-xtesting/builds/
564133127
Change-Id: Ic0b8f20edfcccceda3d7226789f16e875af0bdb9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 26 Jul 2019 16:11:43 +0000 (18:11 +0200)]
Override the new testcases.yaml
Change-Id: I5a075f6adc2a014a5f2a04602d29783a91b86bfe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 24 Jul 2019 08:37:03 +0000 (10:37 +0200)]
Updated from global requirements
Change-Id: Ia65aef5331aa9848d58a6db9800b755f226fe8bf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 26 Jul 2019 10:58:04 +0000 (12:58 +0200)]
Switch to Python 3.7 and Alpine 3.10
It also allows building docs as doc8 is broken due to latest
OpenStack's upper-constraints.
pylint is updated to 2.3.1 (lastest py3.7 version)
It disables perm as umask is currently false on lf-virtual1.
Change-Id: I8568eeafa44c5dba72e206c532c1f50e3ad547f2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Deepak Chandella [Fri, 5 Jul 2019 17:01:36 +0000 (22:31 +0530)]
Adding first patch for behave feature
Change-Id: Ic975c301103b49cdec2bd26746b708388f21e892
Signed-off-by: Deepak Chandella <deepak.chandella@orange.com>
Cedric Ollivier [Fri, 14 Jun 2019 14:13:49 +0000 (14:13 +0000)]
Merge "Remove energy modules"
Cédric Ollivier [Fri, 14 Jun 2019 09:14:56 +0000 (11:14 +0200)]
Remove energy modules
The public recorder api has been down for a while.
Change-Id: Ib879ef3b9ef56338c10cfcdeb733451c6f7573a6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 4 Jun 2019 18:06:14 +0000 (20:06 +0200)]
Updated from global requirements
Change-Id: I6f8705e701aac7432d7340d4949ace06339af3a3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 25 May 2019 09:03:40 +0000 (11:03 +0200)]
Run bandit when verifying changes
It reports only MEDIUM issues or higher like nova [1].
It selects bandit 1.1.0 as defined in nova and neutron lower
constraints [2].
[1] https://github.com/openstack/nova/blob/master/tox.ini#L221
[2] https://github.com/openstack/nova/blob/master/lower-constraints.txt#L8
Change-Id: I52524df867d99fae75798475c762a5f8253dacfa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 25 May 2019 07:55:02 +0000 (09:55 +0200)]
Set utf-8 in decode and encode calls
It eases backporting in iruya and hunter as a few logs can't be
decoded as ascii [1].
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console
Change-Id: I09c793469bdf4a679e6ed5a268e705efa5f2a20f
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
Cédric Ollivier [Sun, 12 May 2019 11:33:24 +0000 (13:33 +0200)]
Fix unit tests (py36)
It completes the patch "Update to Python3" [1] which was not fully
verified in Functest Gates [2].
[1] https://gerrit.opnfv.org/gerrit/#/c/67782/
[2] https://travis-ci.org/collivier/functest-xtesting/jobs/
531380395
Change-Id: Icd0d743e14ca1430828907cefba10b50489020a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 12 May 2019 10:23:30 +0000 (12:23 +0200)]
Stop setting utf-8 in decode/encode calls
It's the default value.
Change-Id: I301f750cabc41a1564a700ae8d7328f195a4ae9b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 11 May 2019 08:21:01 +0000 (10:21 +0200)]
Rename HelloWorld.txt to HelloWorld.robot
It takes the following warning into account [1] "Automatically parsing
other than '*.robot' files is deprecated"
[1] https://build.opnfv.org/ci/job/xtesting-opnfv-xtesting-latest-fifth-run/150/console
Change-Id: Ibe01eea7eb83c8724d6b4afe3a487ad813fed30d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 7 May 2019 08:42:23 +0000 (10:42 +0200)]
Update to Python3
Now Xtesting containers use Python3 instead of python2.
https://mail.python.org/pipermail/python-dev/2018-March/152348.html
It also updates robotframework to latest release.
Change-Id: I57e0d8b1af9aeaae0c445941a9bdf0b8bd346834
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 24 Apr 2019 19:08:37 +0000 (21:08 +0200)]
Enable debug messages via env var
It stops printing in xtesting.debug.log by default.
It decreases testing duration via Raspberry PI without additional
tasks [1].
[1] https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI
Change-Id: I2eded47a7a150a45330a69f3262fc7ca6fdb7463
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 21 Apr 2019 18:54:22 +0000 (20:54 +0200)]
Update to opendev.org in tox.ini
It completes the previous commit [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/67651/
Change-Id: I5298e406d7973572034242224b867ba8fd79e60f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 21 Apr 2019 17:41:01 +0000 (19:41 +0200)]
Update all OpenStack refs to opendev.org
Change-Id: Iefb247bcfbc490fd64bd9a78b4cacffca1603126
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 18 Apr 2019 23:27:11 +0000 (01:27 +0200)]
Updated from global requirements
Change-Id: I12a51ae31601ef82f2a2f92f4642795a3a5a32db
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 13 Apr 2019 14:15:18 +0000 (16:15 +0200)]
Add python3.6-dev
It's mandatory for building all python packages [1].
[1] https://travis-ci.org/collivier/functest-xtesting/builds/
519646504
Change-Id: I71afe76a33a68f9bf0550c80003aa04ac76c9774
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 13 Apr 2019 11:24:17 +0000 (13:24 +0200)]
Run tox in .travis-ci
It installs python3 via ppa to run unit tests vs py36.
It completes the OPNFV gates which can't verify them.
Change-Id: I6942f12ec7daf50e62173290e55df87af9e35d5a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Sat, 13 Apr 2019 09:27:07 +0000 (09:27 +0000)]
Merge "Build Raspberry PI image via travis-ci"
Cédric Ollivier [Fri, 12 Apr 2019 19:19:21 +0000 (21:19 +0200)]
Build Raspberry PI image via travis-ci
Change-Id: I91ced3f779921ed26bb91daa971692620311feaf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 3 Apr 2019 04:46:19 +0000 (06:46 +0200)]
Publish the presentation for ONS 2019
It highlights the reuse of OPNFV frameworks from infrastructure
verification to e2e network service testing [1].
[1] http://testresults.opnfv.org/functest/ons2019/
Change-Id: Icc3d99329f01b68a2bf8639708abbf9415036414
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 24 Mar 2019 12:47:59 +0000 (13:47 +0100)]
Fix manifest-tool builds
It now selects the last release to allow compiling it [1]
[1] https://travis-ci.org/collivier/functest-xtesting/jobs/
510384544
Change-Id: I4fdff1df75f39b3b2bc70c3ee9c9910adbe9f0ff
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Sat, 23 Mar 2019 17:53:52 +0000 (17:53 +0000)]
Merge "Update Alpine tag in build.sh"
Cédric Ollivier [Sat, 23 Mar 2019 17:18:58 +0000 (18:18 +0100)]
Update Alpine tag in build.sh
It completes the previous commit updating Alpine.
Change-Id: Ic7bb294eeebad360278dcb75f841efec8e87c03b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Juha Kosonen [Tue, 19 Mar 2019 07:06:56 +0000 (07:06 +0000)]
Merge "Update to Apine 3.9"
Cédric Ollivier [Mon, 18 Mar 2019 20:17:22 +0000 (21:17 +0100)]
Update to Apine 3.9
It updates to the latest Alpine release [1]
[1] https://www.alpinelinux.org/posts/Alpine-3.9.0-released.html
Change-Id: I5c7bd64333fb38fcc7aa0c315de2bcd40435ed0a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 28 Feb 2019 13:35:10 +0000 (14:35 +0100)]
Updated from global requirements
Change-Id: I6a2c5a16efdba81dda01fe21ad79f734dad3fd32
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 15 Jan 2019 20:26:02 +0000 (21:26 +0100)]
Fix default host in ansible (127.0.0.1)
Change-Id: Ief3656032a808a66fcb701272d5a4c3ecdca1427
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 14 Jan 2019 17:57:56 +0000 (18:57 +0100)]
Remove former ci jobs
They can now be generated via the new ansible role.
Change-Id: I4c8fdf209fd4f9fd8b10342a86453ff5e1cb5b09
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Fri, 4 Jan 2019 02:06:36 +0000 (02:06 +0000)]
Merge "Fix typo"
Cedric Ollivier [Fri, 4 Jan 2019 01:48:47 +0000 (01:48 +0000)]
Merge "Remove url from logs"
Cédric Ollivier [Fri, 4 Jan 2019 01:44:49 +0000 (02:44 +0100)]
Fix typo
Change-Id: I501ca227374e782286920bf0cab09ba1a4355f46
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 3 Jan 2019 23:44:42 +0000 (00:44 +0100)]
Remove url from logs
It can be false in case of NAT.
Change-Id: Id1f4b59eeaf466545cc906bd86c2917b8df2b7a6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 27 Dec 2018 19:03:03 +0000 (20:03 +0100)]
Updated from global requirements
Change-Id: Ic9fb51a1ab37d105d4040c5ea0bee442cdad5696
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 27 Dec 2018 15:40:50 +0000 (16:40 +0100)]
Apply operations via sixer
Change-Id: I7609f83da73d0ac03fc0d270d42f44708335995c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 16 Dec 2018 16:50:38 +0000 (17:50 +0100)]
Allow printing bash cmd output in console
It switches to Popen to print real-time console.
Console has to be enabled per testcase (testcases.yaml).
Change-Id: Id36b42c8409262f7c443e98ae2bcc465984b287f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 26 Dec 2018 10:23:02 +0000 (11:23 +0100)]
Generate reports for unit tests
It now leverages on subunit to generate html and xml reports.
Change-Id: I3f5a4fe5547e743b122b63e0b8530c9d9677cdbd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 26 Dec 2018 09:50:13 +0000 (10:50 +0100)]
Fix OpenStack version (master) in tox.ini
Change-Id: I4a5c3a85870ce515d64be5efb25b016908b56164
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 15 Dec 2018 14:58:56 +0000 (15:58 +0100)]
Verify the Ansible playbook via ansible-lint
Change-Id: I9e6778b935a0a8d6e76cb4f1f16ef08c811eee73
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 15 Dec 2018 14:45:13 +0000 (15:45 +0100)]
Verify missing yaml files via yamllint
Change-Id: I0cd412cd49cac62b393658bf55e0e32def908c85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 10 Dec 2018 20:38:43 +0000 (21:38 +0100)]
Deploy CI/CD toolchains for any Xtesting-based project
It allows deploying the CI/CD toolchain via ansible for all projects
based on Xtesting (e.g. OPNFV Functest, ONAP robot tests, etc.).
It deploys Jenkins, Minio and S3www and loads all jobs in Jenkins.
Last components (MongoDB, TestAPI and dashboard) will be deployed in
the next update of the ansible role.
To deploy the testing toolchain:
$ ansible-galaxy install collivier.xtesting
$ ansible-playbook ansible/site.yml
Change-Id: I5a8ddb45fc354c9a22c52f0d42ce2e0181f345b7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 9 Dec 2018 08:55:56 +0000 (09:55 +0100)]
Enable robot sample in the container
The testcase is disabled by default in package as the location
depends on OS. But it can be safely enabled in the Alpine container.
Change-Id: I8d1befd09b8d823010dfce7fbb18eddb864fd6e6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 28 Nov 2018 21:37:17 +0000 (22:37 +0100)]
Set shell=True in subprocess.check_call
It allows running multiple shell instructions (see third).
Change-Id: I132813c51d42f0fb4bc729d315c468d426f2fb3c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
f99cef18b6dd3eff6703c4d748fae415fea78ae2)
Cédric Ollivier [Wed, 28 Nov 2018 21:09:03 +0000 (22:09 +0100)]
Stop returning values in run()
Runner only checks status via is_successful().
Change-Id: I12647449b037223ac4e3c6ee577610d4430d0bf5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 19 Oct 2018 14:11:59 +0000 (16:11 +0200)]
Temporarily disable py36
Verify servers haven't been updated yet to support py36.
Change-Id: Id2999a94f9c2c03432412a4b40a4b3c593aaffb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 19 Oct 2018 14:30:59 +0000 (16:30 +0200)]
Fix a wierd pylint error
Change-Id: Ia213e3e1beb80e62f6691c79544b1a0e0e3bb81e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 17 Oct 2018 11:44:35 +0000 (13:44 +0200)]
Update python3 to python3.6
Change-Id: I845f8eb0544dc32febec7a17ac7c05412eb31198
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Wed, 12 Sep 2018 19:40:00 +0000 (19:40 +0000)]
Merge "Updated from global requirements"
Cédric Ollivier [Wed, 12 Sep 2018 19:31:32 +0000 (21:31 +0200)]
Updated from global requirements
Change-Id: I8eb758bb28904ed9504cba4eef5a94026a0e34bc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 12 Sep 2018 19:27:51 +0000 (21:27 +0200)]
Follow OpenStack master
Change-Id: I9b3ead197d54061adddbf47b6b94bbeb79c81793
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 3 Sep 2018 18:43:23 +0000 (20:43 +0200)]
Rewrite git clone
Change-Id: I0e17233faaf8eddb263e90cb82b65335f1c9cf40
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 1 Sep 2018 20:26:42 +0000 (22:26 +0200)]
Publish daily and gating jjbs
Change-Id: I1050741ce34e151be30404275670e83fc2a40d1a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 1 Sep 2018 20:36:27 +0000 (22:36 +0200)]
Update to Alpine 3.8
https://alpinelinux.org/posts/Alpine-3.8.0-released.html
Change-Id: I73fba49c3d1bbf018e94e67c835c4049c34209b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 30 Aug 2018 12:47:37 +0000 (14:47 +0200)]
Remove former samples/testcases.yaml
Change-Id: I1487c73ae4c6e2801c7952689c8d9fe49613db95
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 29 Aug 2018 14:08:14 +0000 (16:08 +0200)]
Stop verifying ResultWriter.write_results exit codes
ResultWriter.write_results() returns false if one test fails.
It's skipped by run() because the report is correctly generated.
[1] https://robot-framework.readthedocs.io/en/2.9.2/_modules/robot/reporting/resultwriter.html
Change-Id: If29059b272679ed89a1189e0bb52997c83401b94
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 29 Aug 2018 09:26:24 +0000 (11:26 +0200)]
Change output dir
It now reads case_name instead of selecting an hardcoded value
(robot).
Change-Id: I1dfb0daa2eb52f526abdf1664bf5ac36549509a6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 28 Aug 2018 19:42:04 +0000 (21:42 +0200)]
Update RobotFramework config
It completes "Leverage on abc and stevedore".
Change-Id: Ieb8e7dee79cd4a8a1e93e2db9945577754e35aa8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 20 Aug 2018 03:55:57 +0000 (05:55 +0200)]
Initialize testcase results to EX_TESTCASE_FAILED
Else the testcase returns EX_OK if exceptions in __init__()
Change-Id: I5f23e91a3ecda22a429a006af56592ee86084038
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Tue, 14 Aug 2018 16:30:24 +0000 (16:30 +0000)]
Merge "Protect vs None when calling regex"
Cédric Ollivier [Tue, 14 Aug 2018 16:23:41 +0000 (18:23 +0200)]
Protect vs None when calling regex
Change-Id: I93d22442c28e674433234d7729838944962bdbe2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 10 Aug 2018 10:55:10 +0000 (12:55 +0200)]
Leverage on abc and stevedore
Change-Id: I7b3c4c0c5dd0c9e6fb3e52c3fff5221d4b831b02
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 10 Aug 2018 11:04:11 +0000 (13:04 +0200)]
Skip the selected testcase too
It completes "Allow calling a skip test" [1]
[1] https://gerrit.opnfv.org/gerrit/60655
Change-Id: I02499aed56e6b23563165ea1f17b476e12408823
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 7 Aug 2018 05:16:57 +0000 (07:16 +0200)]
Generate robot reports
Change-Id: Ib9efe14bce6227f9609200c12ded4470bd0be969
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 7 Aug 2018 03:06:23 +0000 (05:06 +0200)]
Allow calling a skip test
run_tests shouldn't return an incorrect value if the test is skipped.
Else it simply forbids running tests in parallel (one test per
thread).
Change-Id: I07efca28dbf6cf1c29ec8e5c999e38cfe3ad0aad
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 30 Jul 2018 14:08:41 +0000 (16:08 +0200)]
Stop skipping testcases if one raises exceptions
https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console
Change-Id: Ic412c5b55169f599bd9cdb623f349dd2220940db
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 15 Jul 2018 09:30:40 +0000 (11:30 +0200)]
Stop printing exceptions twice
Change-Id: Ife772d33741e7023ed72afeb0f74ed8b461e0033
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 15 Jul 2018 09:22:05 +0000 (11:22 +0200)]
Fix results when only one skipped test
Change-Id: Id6c8029b8be1e3a01979feb45daebad08710fe20
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Code Review / functest-xtesting.git / log