releng-xci.git
6 years agoBug fix: Remove use_prebuilt_images condition 71/63171/1
Manuel Buil [Thu, 4 Oct 2018 13:22:54 +0000 (15:22 +0200)]
Bug fix: Remove use_prebuilt_images condition

The creation or not of the IPA image does not depend on the value of the
use_prebuilt_images. This variable is intended to control the following
call to bifrost-create-dib-image role.

I added a few comments to clarify what we are doing in each call to the
bifrost-create-dib-image role

Change-Id: Id66e1a969ca279a055640481719f118744eedf38
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years ago[Baremetal] Include a baremetal variable 89/60789/22
Manuel Buil [Thu, 9 Aug 2018 14:06:42 +0000 (16:06 +0200)]
[Baremetal] Include a baremetal variable

It switches between parts of the code which are specific for baremetal
or non-baremetal. Those parts come with this patch:

https://gerrit.opnfv.org/gerrit/#/c/60797

It also selects different variables when calling the opnfv-virtual.yml
playbook:

https://gerrit.opnfv.org/gerrit/#/c/60795

It decides the value of BAREMETAL based on the vendor value of the pdf

Change-Id: I8e6171f4f21db7f814a472e6ed1bacb30220b4ec
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years ago[baremetal] idf for opnfv_vm and update the pdf 87/60787/19
Manuel Buil [Thu, 9 Aug 2018 13:53:40 +0000 (15:53 +0200)]
[baremetal] idf for opnfv_vm and update the pdf

Physical hardware PODs provide a pdf and a idf to describe hardware and other
information (e.g. what is the purpose for each interface). To reuse the
same code for opnfv vm and also become consistent, we should also describe
the opnfv vm with an idf and a pdf. This patch simplifies what needs to
be done for baremetal, especially for this (future) patch:

https://gerrit.opnfv.org/gerrit/#/c/60797/11

As we add an idf, we should update dynamic_inventory and how we create
the opnfv vm. Obviously, he opnfv_vm.yml gets removed.

Change-Id: I930728474631fc214e4a9adc8581e0c16d230176
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoAdd idf and pdf to the xci-create-virtual.yml 97/62697/3
Manuel Buil [Fri, 21 Sep 2018 09:55:13 +0000 (11:55 +0200)]
Add idf and pdf to the xci-create-virtual.yml

This patch complements this other:

https://gerrit.opnfv.org/gerrit/#/c/62575/2

We require the pdf and the idf (when doing baremetal) in the create-vm
role, so we should propagate that variable to the playbook that triggers
those roles

Change-Id: I15806d386db4e6b11192829f2dbc61662bffec2b
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoMerge "xci: Add ability to pass command line options to xci-deploy.sh"
Markos Chandras [Thu, 20 Sep 2018 12:32:57 +0000 (12:32 +0000)]
Merge "xci: Add ability to pass command line options to xci-deploy.sh"

6 years agoMerge "Docs transition"
Fatih Degirmenci [Thu, 20 Sep 2018 08:14:40 +0000 (08:14 +0000)]
Merge "Docs transition"

6 years agoxci: Add ability to pass command line options to xci-deploy.sh 75/62575/2
Markos Chandras [Wed, 19 Sep 2018 15:28:10 +0000 (16:28 +0100)]
xci: Add ability to pass command line options to xci-deploy.sh

We now support multiple PDF files so instead of introducing another
env variable, we can simply pass this information as command line
arguments to xci-deploy.sh. We can extend the script to allow more
options line verbosity, scenario name, functest details etc so we
can get rid of multiple env variables.

Change-Id: I6c4a8d6e8b70e91746a659de923fee19019ed5e0
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoMerge "[Baremetal] Add ericsson-pod2 pdf and idf"
Manuel Buil [Wed, 19 Sep 2018 14:39:54 +0000 (14:39 +0000)]
Merge "[Baremetal] Add ericsson-pod2 pdf and idf"

6 years agoSwitch to Functest Hunter 35/62435/3
Fatih Degirmenci [Mon, 17 Sep 2018 08:59:26 +0000 (10:59 +0200)]
Switch to Functest Hunter

A new var FUNCTEST_VERSION is introduced to jobs to control the
version to use for Functest.

Change-Id: Ice7aa9f910db2353ce3d0bef198bef9fa3efe9fd
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoMerge "xci: Drop custom XCI certificates"
Fatih Degirmenci [Sun, 16 Sep 2018 13:01:31 +0000 (13:01 +0000)]
Merge "xci: Drop custom XCI certificates"

6 years agoxci: Drop custom XCI certificates 23/62323/1
Markos Chandras [Fri, 14 Sep 2018 15:33:11 +0000 (16:33 +0100)]
xci: Drop custom XCI certificates

OSM requires a CA even when we create a self-signed certificate. We
don't actually need to do that since HAproxy and friends can create the
whole chain for us, so we can finally get rid of this playbook.

installer-type:osa
deploy-scenario:os-nosdn-nofeature

Change-Id: I14a3adbe3492cd6c562c5167c42dd45756e8e3dd
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoDocs transition 33/61933/3
Fatih Degirmenci [Thu, 6 Sep 2018 20:34:52 +0000 (22:34 +0200)]
Docs transition

Changes are made by following
    https://docs.opnfv.org/en/latest/how-to-use-docs/local-build-transition.html

Change-Id: If0ee2031894d4dbd54098548640b8cc71481e49f
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
6 years agoEnable post-deployment for k8s based scenarios 75/62175/3
Fatih Degirmenci [Thu, 13 Sep 2018 05:33:48 +0000 (23:33 -0600)]
Enable post-deployment for k8s based scenarios

k8-calico-onap scenario will have post deployment tasks to
install ONAP using OOM so post-deployment tasks are required
to do that.

deploy-scenario:k8-calico-nofeature
installer-type:kubespray

Change-Id: I67c8188cb573f6fc5c80e15a9101cacca1b7b10e
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoxci: osa: Bump SHA for os_neutron 35/62135/1
Manuel Buil [Wed, 12 Sep 2018 16:34:32 +0000 (18:34 +0200)]
xci: osa: Bump SHA for os_neutron

We require the following patch to deploy ODL when using Ubuntu

https://review.openstack.org/#/c/597003/1

This SHA bump adds it

Change-Id: I0382a4c3946aeff2ddd86a932055dd770c520c74
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoxci: osa: Bump the SHA for the openstack_openrc role 53/62053/1
Markos Chandras [Mon, 10 Sep 2018 12:58:26 +0000 (13:58 +0100)]
xci: osa: Bump the SHA for the openstack_openrc role

Previous bump missed the latest SHA for this role and yardstick
started failing again due to the incomplete openrc file.

Change-Id: I73f024250c73a42a6c2a36acaf8b1f8c6867dd2a
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: osa: Update OSA SHAs to the HEAD of the Rocky branch 87/61987/1
Markos Chandras [Fri, 7 Sep 2018 15:06:59 +0000 (16:06 +0100)]
xci: osa: Update OSA SHAs to the HEAD of the Rocky branch

Change-Id: I012f829c124d665d7d8d9ebb6b18a72d6d73258f
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoMerge "playbooks: configure-opnfvhost: Ensure we copy only the tracked files"
Markos Chandras [Thu, 6 Sep 2018 07:10:09 +0000 (07:10 +0000)]
Merge "playbooks: configure-opnfvhost: Ensure we copy only the tracked files"

6 years agoMerge "xci: infra: bifrost: Allow DNS overrides"
Markos Chandras [Thu, 6 Sep 2018 07:10:04 +0000 (07:10 +0000)]
Merge "xci: infra: bifrost: Allow DNS overrides"

6 years agoMerge "Fix the default scenario name for K8S Yardstick testing"
Markos Chandras [Wed, 5 Sep 2018 13:40:18 +0000 (13:40 +0000)]
Merge "Fix the default scenario name for K8S Yardstick testing"

6 years agoMerge "Revert "Set OS_INSECURE to true for Yardstick""
Markos Chandras [Wed, 5 Sep 2018 13:39:43 +0000 (13:39 +0000)]
Merge "Revert "Set OS_INSECURE to true for Yardstick""

6 years agoRevert "Set OS_INSECURE to true for Yardstick" 53/61853/1
Fatih Degirmenci [Wed, 5 Sep 2018 13:39:29 +0000 (13:39 +0000)]
Revert "Set OS_INSECURE to true for Yardstick"

The issue is fixed upstream.

This reverts commit 40ecfaf96e73520f3a2358c46cd97c1f6c3b58c6.

Change-Id: I8268372173721157d239c1978cdfe8d035613854

6 years agoMerge "xci: osa: Update openrc role"
Markos Chandras [Wed, 5 Sep 2018 13:38:57 +0000 (13:38 +0000)]
Merge "xci: osa: Update openrc role"

6 years agoxci: osa: Update openrc role 47/61847/1
Markos Chandras [Wed, 5 Sep 2018 11:21:20 +0000 (12:21 +0100)]
xci: osa: Update openrc role

This update fixes the values for OS_INSECURE and OS_VERIFY

Change-Id: I7d49bd493bde18f40122721188b006052cf7a901
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoSet OS_INSECURE to true for Yardstick 45/61845/1
Fatih Degirmenci [Wed, 5 Sep 2018 11:19:31 +0000 (13:19 +0200)]
Set OS_INSECURE to true for Yardstick

Change-Id: I0ec6755cb9f9a5b79b359d544082f966903d42bd
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoFix the default scenario name for K8S Yardstick testing 43/61843/2
Fatih Degirmenci [Wed, 5 Sep 2018 11:07:26 +0000 (13:07 +0200)]
Fix the default scenario name for K8S Yardstick testing

deploy-scenario:k8-nosdn-nofeature
installer-type:kubespray

Change-Id: Ieb531b66bd36bbf8c28f755a52a98f0b41ae5efa
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoMerge "Enable yardstick k8s"
Fatih Degirmenci [Wed, 5 Sep 2018 08:38:36 +0000 (08:38 +0000)]
Merge "Enable yardstick k8s"

6 years agoEnable yardstick k8s 27/61827/1
Fatih Degirmenci [Tue, 4 Sep 2018 21:59:07 +0000 (23:59 +0200)]
Enable yardstick k8s

installer-type:kubespray
deploy-scenario:k8-nosdn-nofeature

Change-Id: If81aef632b064565fbf5c308909b44ff7409c33e
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoFix openrc OS_CACERT for yardstick docker container 25/61825/1
Fatih Degirmenci [Tue, 4 Sep 2018 21:48:52 +0000 (23:48 +0200)]
Fix openrc OS_CACERT for yardstick docker container

The openrc should contain the path to OS_CACERT within container, not
on opnfv vm.

Change-Id: Ief4cb4ae647ff0f2cd4f3ebe8a2993bb71b0363f
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoCreate script to run yardstick 41/61641/7
Fatih Degirmenci [Fri, 31 Aug 2018 10:04:40 +0000 (12:04 +0200)]
Create script to run yardstick

The created script runs the yardstick in similar way the functest
script does.

installer-type:osa
deploy-scenario:os-nosdn-nofeature

Change-Id: Ic03445ec03fcfec8dc0d09f638e7cb1187fef883
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoxci: infra: bifrost: Allow DNS overrides 37/61637/4
Markos Chandras [Fri, 31 Aug 2018 09:34:56 +0000 (10:34 +0100)]
xci: infra: bifrost: Allow DNS overrides

Deployers may want to use a different DNS server so allow them to
override the ipv4_nameserver option. If the variable is not set,
then we use the libvirt DNS if we are behind a proxy, otherwise
we default to the Google DNS.

Change-Id: I96cf63758902d4aae3d155b2e8beef650449ebc9
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoplaybooks: configure-opnfvhost: Ensure we copy only the tracked files 63/61663/8
Markos Chandras [Fri, 31 Aug 2018 12:33:40 +0000 (13:33 +0100)]
playbooks: configure-opnfvhost: Ensure we copy only the tracked files

This prevents rsync spending time copying temporary files which may have
been created during a CI run.

deploy-scenario:os-nosdn-nofeature
installer-type:osa

Change-Id: Ie02e0dbfc06b8fac40d6b90c4c99e361ecf1c0b2
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: osa: Restore self-signed XCI certificate 71/61771/5
Markos Chandras [Mon, 3 Sep 2018 16:21:52 +0000 (17:21 +0100)]
xci: osa: Restore self-signed XCI certificate

This reverts commit cc583f30f881ba956fb4f1402aa4dd1608b27da2.

We still need to have control over the generated certificates so lets
keep creating our own.

deploy-scenario:os-nosdn-nofeature
installer-type:osa

Change-Id: I9e730bce2dba578ca0b561b168eaf1c2eca1282d

6 years agoxci: osa: Update ansible role for configuring the proxy server 67/61767/3
Markos Chandras [Mon, 3 Sep 2018 15:58:40 +0000 (16:58 +0100)]
xci: osa: Update ansible role for configuring the proxy server

The old role has disappeared so we have to use another one.

Change-Id: I8533912a19680e93a9cf061109019a0801485936
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoRename functest-prepare role to prepare-tests 39/61639/4
Fatih Degirmenci [Fri, 31 Aug 2018 08:52:00 +0000 (10:52 +0200)]
Rename functest-prepare role to prepare-tests

This change renames functest prepare-tole to prepare tests and makes other
adjustments to the role to move common test preparation steps to its own
script so we can prepare for Functest and Yardstick at one go.

Similar things are required to be prepared for running Functest and Yardstick
such as
- installed packages
- external network creation
- creation of run-functest.sh and run-yardstick scripts from templates
- preparation of environment variables

This change will fail verification until the changes below is submitted.
    https://gerrit.opnfv.org/gerrit/#/c/61645/

Change-Id: Id1020d3e61abd3f087863c06a132c5021339d655
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoMerge "Revert "xci: osa: Disable haproxy ssl configuration""
Markos Chandras [Mon, 3 Sep 2018 09:07:21 +0000 (09:07 +0000)]
Merge "Revert "xci: osa: Disable haproxy ssl configuration""

6 years agoRevert "xci: osa: Disable haproxy ssl configuration" 73/61473/11
Markos Chandras [Tue, 28 Aug 2018 13:55:28 +0000 (14:55 +0100)]
Revert "xci: osa: Disable haproxy ssl configuration"

This reverts commit 42501f0ef7e0f0729b1c780102fb9713ef383fb3.

This also removes the entire SSL management code and we let the
haproxy_server role generate the certificates for us.

We also need to bump the openrc role to include an upstream patch
which fixes the openrc template file.

deploy-scenario:os-nosdn-nofeature
installer-type:osa

Change-Id: I9bb590c9f1d5bc63519cfb4794dc15f794cc5b07
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: Bump Bifrost components to the HEAD of Rocky release 43/61643/4
Markos Chandras [Fri, 31 Aug 2018 10:14:51 +0000 (11:14 +0100)]
xci: Bump Bifrost components to the HEAD of Rocky release

The bifrost and ironic SHAs are from the Stein release which is still
in early days of development. We should use Rocky SHAs for the time
being. However, bifrost from Rocky does not support Ansible > 2.4 so
we have to use bifrost from master branch but all the ironic components
have to be from the Rocky release.

Change-Id: I1acb28e4a292c774d681519517be19a2da230851
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoMerge "Download only necessary images for functest-smoke"
Fatih Degirmenci [Fri, 31 Aug 2018 09:48:46 +0000 (09:48 +0000)]
Merge "Download only necessary images for functest-smoke"

6 years agoMerge "xci: roles: create-vm-nodes: Always provision VM nodes"
Markos Chandras [Fri, 31 Aug 2018 09:26:04 +0000 (09:26 +0000)]
Merge "xci: roles: create-vm-nodes: Always provision VM nodes"

6 years agoDownload only necessary images for functest-smoke 23/61623/1
Fatih Degirmenci [Fri, 31 Aug 2018 06:41:23 +0000 (08:41 +0200)]
Download only necessary images for functest-smoke

Functest download_images.sh script downloads images that are
not needed for functest-smoke so we only download the necessary
images to cut the time down.

deploy-scenario:os-nosdn-nofeature
installer-type:osa

Change-Id: I0be643c4ccd4b8009e68433f5d635231afd2550a
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoxci: Bump Kubespray SHA and sync Ansible versions 07/61607/1
Fatih Degirmenci [Thu, 30 Aug 2018 20:18:43 +0000 (22:18 +0200)]
xci: Bump Kubespray SHA and sync Ansible versions

This change
- bumps kubespray version to 8b3ce6e418ccf48171eb5b3888ee1af84f8d71ba, taking
Kubernetes version from 1.10.2 to 1.10.4.
- pins Ansible version used by Kubespray to same Ansible version as the rest.
The var kept as is in case if we need to pin Kubespray to a different Ansible
version in future.

installer-type:kubespray
deploy-scenario:k8-calico-nofeature

Change-Id: Iefbe82f0b9b10296e4362bca07630047c56630ac
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoMerge "xci: Bump OSA and bifrost SHAs"
Markos Chandras [Thu, 30 Aug 2018 20:07:27 +0000 (20:07 +0000)]
Merge "xci: Bump OSA and bifrost SHAs"

6 years agoxci: Bump OSA and bifrost SHAs 05/61605/3
Markos Chandras [Thu, 30 Aug 2018 16:21:13 +0000 (17:21 +0100)]
xci: Bump OSA and bifrost SHAs

This change
- bumps OSA SHA to b9d9269528ecbe04b2638a73c2b0f49839f27422
- bumps bifrost SHA to 0d0cfd908d10a670668619c575fd338d1ff328b7
- Pins Ansible to 2.5.8. OSA is using 2.5.5 which has a bug in the pause
  module so we need to use something newer.

Change-Id: Idf05bbef880db11de4a41464ae5080aa21a0613c
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoMerge "Install xz utility on deployment host"
Fatih Degirmenci [Thu, 30 Aug 2018 16:33:21 +0000 (16:33 +0000)]
Merge "Install xz utility on deployment host"

6 years ago[Baremetal] Add ericsson-pod2 pdf and idf 85/60785/5
Manuel Buil [Thu, 9 Aug 2018 13:51:25 +0000 (15:51 +0200)]
[Baremetal] Add ericsson-pod2 pdf and idf

Provide the idf and pdf for ericsson-pod2 deployment
This is aligned with the pdf and idf from pharos lab:

https://github.com/opnfv/pharos/blob/master/labs/ericsson/idf-pod2.yaml
https://github.com/opnfv/pharos/blob/master/labs/ericsson/pod2.yaml

Change-Id: Ic5b62a5751e5977affbbeb94937738434de5b3ab
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoxci: roles: create-vm-nodes: Always provision VM nodes 15/61515/8
Markos Chandras [Wed, 29 Aug 2018 09:43:50 +0000 (10:43 +0100)]
xci: roles: create-vm-nodes: Always provision VM nodes

The role used to get the output of 'virsh list --all' to determine how
many VMs are present and shut off in the system. This takes *all* VMs
on the system into consideration so it may skip creation of some or all
of the XCI VMs if we happen to have other VMs present. We can improve
the situation by simply dropping this check and always provision the
VMs we want. If the VM is already present, then the module will simply
do a sanity check of its configuration. This allows XCI to run alongside
other VMs.

Change-Id: I54255a1959509671c0305f48f23a55b6e900684f
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoMerge "Move OSM variables to os-nosdn-osm scenario"
Fatih Degirmenci [Tue, 28 Aug 2018 11:39:13 +0000 (11:39 +0000)]
Merge "Move OSM variables to os-nosdn-osm scenario"

6 years agoAlign idfs and separate admin and management 23/60923/3
Manuel Buil [Tue, 14 Aug 2018 06:25:06 +0000 (08:25 +0200)]
Align idfs and separate admin and management

According to OpenStack admin is the network for pxe boot and mgmt is the
network for OpenStack services to communicate. We were using both in XCI
indistinctly

Change-Id: I3959e767098ac2be7161a5e84735fde9ab129784
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoMerge "Modify idf to be aligned with the rest of idfs"
Manuel Buil [Fri, 24 Aug 2018 08:21:25 +0000 (08:21 +0000)]
Merge "Modify idf to be aligned with the rest of idfs"

6 years ago[xci] integrate istio in XCI 71/58471/9
wutianwei [Wed, 13 Jun 2018 03:53:14 +0000 (11:53 +0800)]
[xci] integrate istio in XCI

using kubespary to deploy the istio, kubespary support to deploy istio

installer-type:kubespray
deploy-scenario:k8-nosdn-istio

Change-Id: Id8c04936187c89fafa921dada382a0e9e11aab27
Signed-off-by: wutianwei <wutianwei1@huawei.com>
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoPrint OpenStack login information at the end 87/61187/2
Fatih Degirmenci [Tue, 21 Aug 2018 12:55:28 +0000 (14:55 +0200)]
Print OpenStack login information at the end

The info is logged to the console before post-deployment tasks and
this makes it seeing the deployment status and login info inconvenient.
This change moves the logging to the end, after post-deployment.

Change-Id: Ic7e232a0b8343e666f54087fbcc09481ab59ca90
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoMove OSM variables to os-nosdn-osm scenario 07/61207/1
Fatih Degirmenci [Tue, 21 Aug 2018 20:09:24 +0000 (22:09 +0200)]
Move OSM variables to os-nosdn-osm scenario

This change removes OSM variables from releng-xci repo since they
are declared in os-nosdn-osm scenario itself in releng-xci-scenarios
repo.

In order for this change to be verified, below change must be submitted.
    https://gerrit.opnfv.org/gerrit/#/c/61205/

installer-type:osa
deploy-scenario:os-nosdn-osm

Change-Id: I9f3a1dbdfecfb2bb08cc215758bdc52aefcdf697
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoInstall xz utility on deployment host 89/61189/1
Fatih Degirmenci [Tue, 21 Aug 2018 15:27:30 +0000 (17:27 +0200)]
Install xz utility on deployment host

Functest Smoke test requires additional images to be available
during testing. One of the images is decompressed using xz and we
need this to be available on deployment host in order to be able
to have the images available for Functest execution.

Change-Id: I5647b3bef37fc55e8c5cc9aec5d0b2c3ea628b8a
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoModify idf to be aligned with the rest of idfs 95/60895/9
Manuel Buil [Mon, 13 Aug 2018 13:43:34 +0000 (15:43 +0200)]
Modify idf to be aligned with the rest of idfs

Change our idf to be more aligned with lf's idf. Adapt
dynamic_inventory.py to the change

Change-Id: Ib8f6d1684a00a8eb5ae06d5d04d308d4325cd444
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoxci: Bump OSA and bifrost SHAs 41/57441/37
Fatih Degirmenci [Tue, 12 Jun 2018 15:39:04 +0000 (17:39 +0200)]
xci: Bump OSA and bifrost SHAs

This change
- bumps OSA SHA to cbfdb7dc295ff702044b807336fab067d84a3f20
    (mostly based on Rocky RC1)
- bumps bifrost SHA to c1c6fb7487d5b967624400623fd35aabf303b917
- pins Ansible to 2.4.6.0
- switches to ollivier/functest-healtcheck since OS is bumped to Rocky

Change-Id: Icc14e3e794b489dafd78b426c54051a3732ccb1a
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoUpdate SHA for ODL 17/61017/1
Manuel Buil [Thu, 16 Aug 2018 17:34:13 +0000 (19:34 +0200)]
Update SHA for ODL

Deployment not working because of a bug. This bug gets fixed with the
new SHA

Change-Id: I91c6df6bf7ea10492265466ebdfbf4264492936b
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoxci: Restrict virtualbmc to version 1.3 53/60853/1
Markos Chandras [Fri, 10 Aug 2018 13:37:22 +0000 (16:37 +0300)]
xci: Restrict virtualbmc to version 1.3

Version 1.4 brings in additional dependencies and it's currently
not used in OpenStack anyway. So lets stick to 1.3 for now.

Change-Id: I2489168cae12f7fa3271c2de7d4fcf37bdb97810
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoForce remove ~/.vbmc folder in case if it doesn't exist 49/60849/1
Fatih Degirmenci [Fri, 10 Aug 2018 13:32:51 +0000 (15:32 +0200)]
Force remove ~/.vbmc folder in case if it doesn't exist

Change-Id: If87afa892a0c39d082cb1563e1c019f46b742169
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoMerge changes from topic 'extend-suse-support-id-skip-verify'
Markos Chandras [Fri, 10 Aug 2018 13:14:38 +0000 (13:14 +0000)]
Merge changes from topic 'extend-suse-support-id-skip-verify'

* changes:
  xci: xci-destroy-env.sh: Update virtualbmc path
  xci: create-vm-nodes: Install virtualbmc in the XCI virtualenv
  xci: osa: Drop openSUSE mirror variables

6 years agoMerge "Integrate os-nosdn-osm scenario"
Fatih Degirmenci [Fri, 10 Aug 2018 13:09:09 +0000 (13:09 +0000)]
Merge "Integrate os-nosdn-osm scenario"

6 years agoMerge "xci-lib: Allow more openSUSE IDs"
Manuel Buil [Fri, 10 Aug 2018 13:00:41 +0000 (13:00 +0000)]
Merge "xci-lib: Allow more openSUSE IDs"

6 years agoxci: xci-destroy-env.sh: Update virtualbmc path 43/60843/1
Markos Chandras [Fri, 10 Aug 2018 12:16:10 +0000 (15:16 +0300)]
xci: xci-destroy-env.sh: Update virtualbmc path

Bifrost no longer installs on the deployment host so we don't need
to look into the bifrost venv for a vbmc installation. Moreover, XCI
uses virtualenv by default, so we should only look there for vbmc.
Finally, we should clear vbmc config files from previous deployments
since that could leave artifacts behind.

Change-Id: I4cd35636a65e1823c9e4ca9a7c5b17d4b103c6a2
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: create-vm-nodes: Install virtualbmc in the XCI virtualenv 41/60841/1
Markos Chandras [Fri, 10 Aug 2018 12:04:49 +0000 (15:04 +0300)]
xci: create-vm-nodes: Install virtualbmc in the XCI virtualenv

XCI prepares a virtualenv for us, so we should install virtualbmc
in it.

Change-Id: I320d1c7cad9c5c821269b55252cb7ab4f5136f40
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: osa: Drop openSUSE mirror variables 37/60837/1
Markos Chandras [Fri, 10 Aug 2018 11:52:22 +0000 (14:52 +0300)]
xci: osa: Drop openSUSE mirror variables

we let downloads.opensuse.org redirect us to a good one since
the hardcoded one does not appear to work anymore. Ansible gets
upset if we feed it an empty variables file, so we set a couple
of variables there to make it happy.

Change-Id: I887522ebc71dd866d544e75beeff47af6111e059
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci-lib: Allow more openSUSE IDs 31/60831/1
Markos Chandras [Fri, 10 Aug 2018 10:24:00 +0000 (13:24 +0300)]
xci-lib: Allow more openSUSE IDs

Leap 15 is using ID=opensuse-leap and Tumbleweed is using
ID=opensuse-tumbleweed so we should extend the regexp to match
these distributions as well. This allows XCI to support more
openSUSE variants as deployment hosts.

Change-Id: I8bf8e7b15fc00c45807ff92fbc14d7ec79ec4bcb
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoIntegrate os-nosdn-osm scenario 45/58945/22
Fatih Degirmenci [Sat, 23 Jun 2018 23:04:10 +0000 (01:04 +0200)]
Integrate os-nosdn-osm scenario

This change integrates os-nosdn-osm scenario.

The installation of OSM is done as post-deployment. This is achieved by
the addition of the new playbook named post-deployment.yml in scenario
role folder.

This mechanism is available for all OpenStack scenarios. If anything
needs to be done for a specific scenario as part of the post-deployment,
it can be achieved by creating playbook post-deployment.yml.

If post-deployment.yml exists in scenario role, the framework will run
it once the regular deployment playbooks are run successfully. If the
file does not exist, it will be skipped.

The location of the post-deployment.yml is
    releng-xci-scenarios/<scenario>/role/<scenario>/tasks/post-deployment.yml

This is only implemented for OpenStack scenarios currently and similar
mechanism is needed for K8S scenarios as well which will be implemented
in a separate change.

installer-type:osa
deploy-scenario:os-nosdn-osm

Change-Id: I16780abffca39699eb2f38f662479f0e4d551504
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoMerge "scripts: start-new-vm: Do not upgrade packages on the host"
Manuel Buil [Thu, 9 Aug 2018 06:38:17 +0000 (06:38 +0000)]
Merge "scripts: start-new-vm: Do not upgrade packages on the host"

6 years agoscripts: start-new-vm: Do not upgrade packages on the host 37/60737/1
Markos Chandras [Wed, 8 Aug 2018 11:49:34 +0000 (14:49 +0300)]
scripts: start-new-vm: Do not upgrade packages on the host

Upgrading the host could bring undesired side effects so we should
not do that as part of CI deployment.

Change-Id: Ib776cdf96943e22155c2dd47fdadb3e8a86f6143
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoResize OPNFV VM Disk 31/60731/1
Fatih Degirmenci [Wed, 8 Aug 2018 09:23:10 +0000 (11:23 +0200)]
Resize OPNFV VM Disk

OPNFV VM creation is separated from the rest of the nodes, resulting
in its disk being left without resizing. It is important to resize
its disk to the value defined in its PDF opnfv_vm.yml so the installation
of the other tools does not fail due to lack of space.

Change-Id: I8300e6e355d11788cc983fcebca56076e89918e1
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agodocs: Remove info about the flavor aio 97/58597/2
Fatih Degirmenci [Fri, 15 Jun 2018 19:57:31 +0000 (21:57 +0200)]
docs: Remove info about the flavor aio

The flavor aio is disabled by change https://gerrit.opnfv.org/gerrit/#/c/58595/
so it is important to update the documentation accordingly.

The expectation is to put it back if/when aio is properly verified.

Change-Id: I12a60e819e20f053c38acee9e8276252d2cab267
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoMerge "xci: osa: Disable haproxy ssl configuration"
Markos Chandras [Thu, 5 Jul 2018 07:51:11 +0000 (07:51 +0000)]
Merge "xci: osa: Disable haproxy ssl configuration"

6 years agoMerge "Disable the flavor aio and set default flavor to mini"
Markos Chandras [Wed, 4 Jul 2018 06:33:23 +0000 (06:33 +0000)]
Merge "Disable the flavor aio and set default flavor to mini"

6 years agoxci: osa: Disable haproxy ssl configuration 35/59535/1
Markos Chandras [Tue, 3 Jul 2018 14:04:01 +0000 (15:04 +0100)]
xci: osa: Disable haproxy ssl configuration

The self-signed certificates are causing troubles so until we implement
a proper certificate chain in XCI we should disable the SSL endpoints.

Change-Id: Ife4ef78de1569121c435a806924a3f90917fd85b
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoDisable the flavor aio and set default flavor to mini 95/58595/2
Fatih Degirmenci [Fri, 15 Jun 2018 19:40:47 +0000 (21:40 +0200)]
Disable the flavor aio and set default flavor to mini

The flavor all-in-one (aio) hasn't been maintained well and
the stability of it is in question. This change disables the
flavor aio and sets the default flavor to mini.

It is important for XCI to enable the aio back in order to help
users who want to try XCI but don't have big enough machine to
go for bigger flavors. However, we need to verify all flavors
for acceptable user experience so the flavor can only be enabled
back once this happens.

Change-Id: I053c8fec78876dea71439f1f1bd737a105254ad4
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoUse PDF to set up the XCI VMs 79/57079/69
Manuel Buil [Fri, 4 May 2018 21:11:35 +0000 (23:11 +0200)]
Use PDF to set up the XCI VMs

This patch is doing the first work item of the spec:

https://github.com/opnfv/releng-xci/blob/master/docs/specs/infra_manager.rst

It creates the required VMs by XCI to afterwards deploy the VIM. It does that
by reading the pdf provided by the user.

- It is currently assumed that the OS for the VM will be installed in the first
disk of the node described by the pdf

- It is assumed that the opnfv VM characteristics are not described in the pdf
but in a similar document called opnfv_vm.yml

- All references to csv from bifrost-create-vm-nodes were removed

Change-Id: I46a85284e4ce7df21cbf66f66619b35f74251e68
Signed-off-by: Manuel Buil <mbuil@suse.com>
Co-Authored-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: playbooks: manage-ssh-keys: Create regular user and SSH keys 85/58985/2
Markos Chandras [Mon, 25 Jun 2018 11:17:31 +0000 (12:17 +0100)]
xci: playbooks: manage-ssh-keys: Create regular user and SSH keys

We may need to perform non-root tasks on the nodes, so we should have a
regular user present as well.

Change-Id: I0b824f1875ce04fe67424fc96e754e06da53be8d
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: var: opnfv_vm: Add descriptor file for OPNFV VM node 83/58983/2
Manuel Buil [Mon, 25 Jun 2018 10:28:41 +0000 (11:28 +0100)]
xci: var: opnfv_vm: Add descriptor file for OPNFV VM node

The OPNFV VM acts as a sandbox for installing and running bifrost so
it is pdf agnostic. As such, we use its own descriptor file to provision
this node.

Change-Id: Ice33dc744c04147f9c746285c583de56b8353cc3
Co-Authored-by: Markos Chandras <mchandras@suse.de>
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoxci: xci-lib.sh: Install shade and python-pyyaml on the deployment node 81/58981/2
Markos Chandras [Mon, 25 Jun 2018 10:21:30 +0000 (11:21 +0100)]
xci: xci-lib.sh: Install shade and python-pyyaml on the deployment node

In preparation for using PDF/IDF to deploy nodes in XCI, we need to have
shade and python-pyyaml on the host since these are requirements for the
OpenStack Ansible modules (eg os_ironic) and the dynamic inventories.

Change-Id: Ie26af0dc58599af6e29a47d91707976dcf16ac6d
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: roles: create-vm-nodes: Add role for creating XCI VM nodes 79/58979/2
Manuel Buil [Mon, 25 Jun 2018 09:57:02 +0000 (10:57 +0100)]
xci: roles: create-vm-nodes: Add role for creating XCI VM nodes

Add a new role based on the bifrost one to create nodes for the bifrost
virtual deployments. This role will install and configure libvirt on the
host, download a prebuilt OPNFV VM image and deploy the OPNFV VM using
that image. Moreover, it will create the rest of the nodes for the
virtual deployment which will be configured by bifrost later on.

Change-Id: I9fbd084261351d3b53ae373060f43df046191c5e
Co-Authored-by: Markos Chandras <mchandras@suse.de>
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoPin functest-healthcheck docker image to known sha 09/59009/4
Fatih Degirmenci [Mon, 25 Jun 2018 19:32:00 +0000 (21:32 +0200)]
Pin functest-healthcheck docker image to known sha

Functest changes have significant impact which blocks everything in XCI so this
change pins the image to a known sha to get the original set of healthcheck
testcases until the impacts are analysed and concerns are raised to Functest
and the wider OPNFV Community and addressed based on community consensus.

Pinned version of functest-healthcheck contains the test cases below.
- connection_check
- api_check
- snaps_health_check

deploy-scenario:os-nosdn-nofeature
installer-type:osa

Change-Id: Ic9222af8c27e58491b7b60a7504df9d792b5e753
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoMerge "xci: vm: start-new-vm: Copy deployment image to clean VM"
Markos Chandras [Mon, 25 Jun 2018 12:34:44 +0000 (12:34 +0000)]
Merge "xci: vm: start-new-vm: Copy deployment image to clean VM"

6 years agoxci: vm: start-new-vm: Copy deployment image to clean VM 01/58901/1
Markos Chandras [Fri, 22 Jun 2018 08:10:18 +0000 (09:10 +0100)]
xci: vm: start-new-vm: Copy deployment image to clean VM

In order to save us some time and bandwidth we can copy the deployment
image to the clean VM in order to be used by bifrost to prepare the
virtual machines. Moreover, we also put our key there so we can ssh
as the root user.

Change-Id: Id21e19aaefde71862c21180129c664c1bf121c32
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agospec: create k8-calico-onap scenario 15/56815/7
Victor Morales [Fri, 27 Apr 2018 19:29:45 +0000 (12:29 -0700)]
spec: create k8-calico-onap scenario

Spec file for the addition of a new XCI scenario which deploys Open
Networking Automation Platform (ONAP) on top Kubernetes deployment
through ONAP Operations Manager (OOM) tool.

Change-Id: I01385fdeeb942154d9cce630552bd3e7713d3cdb
Signed-off-by: Victor Morales <victor.morales@intel.com>
Signed-off-by: Jack Morgan <jack.morgan@intel.com>
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoMerge "xci: dynamic_inventory: Add new entry for deployment_host"
Markos Chandras [Fri, 15 Jun 2018 09:07:41 +0000 (09:07 +0000)]
Merge "xci: dynamic_inventory: Add new entry for deployment_host"

6 years agoAdd k8-odl-coe spec 21/58021/8
Daniel Farrell [Tue, 5 Jun 2018 13:54:33 +0000 (09:54 -0400)]
Add k8-odl-coe spec

This spec proposes adding an XCI senerio that uses OpenDaylight COE and
NetVirt with Kubernetes for pod networking.

Change-Id: I3418542cf22df0f4d04e167903f2bb59151fa0a6
Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
6 years agoxci: dynamic_inventory: Add new entry for deployment_host 45/58445/1
Markos Chandras [Tue, 12 Jun 2018 09:25:00 +0000 (10:25 +0100)]
xci: dynamic_inventory: Add new entry for deployment_host

The deployment host is normally the host which runs the various
playbooks so we add a new entry in the inventory for localhost.

Change-Id: I43baddf4fabd69579c1a02f55ece230a062c2d9b
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoMerge "roles: bootstrap-host: Ensure DNS info from IDF is respected"
Markos Chandras [Thu, 7 Jun 2018 13:30:03 +0000 (13:30 +0000)]
Merge "roles: bootstrap-host: Ensure DNS info from IDF is respected"

6 years agoxci: osa: switch back from GitHub to OpenStack OSA repos 77/57077/7
Markos Chandras [Fri, 4 May 2018 19:20:46 +0000 (20:20 +0100)]
xci: osa: switch back from GitHub to OpenStack OSA repos

Switching to github.com for the gitclones did not make much of a
difference since we are still seeing randomg SSL failures during git
clones. So we can switch back to git://git.openstack.org hoping that
the git protocol will be more efficient than https. Moreover some
projects are moving away from github mirroring and this breaks our
tests.

Change-Id: I8188ec7cbfbf16eeb4634bd9a44b12a104ce1059
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoroles: bootstrap-host: Ensure DNS info from IDF is respected 13/58213/4
Markos Chandras [Mon, 4 Jun 2018 19:59:38 +0000 (20:59 +0100)]
roles: bootstrap-host: Ensure DNS info from IDF is respected

We are configuring static IPs in the various nodes but we don't do
anything for DNS assuming that DNS is being configured by another
entity. However, the IDF file already contains DNS information for us
so we should use that instead. Moreover, we update the IDF file to use
the gateway as DNS instead of the Google one in order to make it more
usable on restricted networks.

Change-Id: Ieba58ec9558080a1296e204c4f99bae859e9daef
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: OSA: Bump Queens SHAs to fix spice-html5 repo relocation 85/58285/2
Markos Chandras [Wed, 6 Jun 2018 11:24:54 +0000 (12:24 +0100)]
xci: OSA: Bump Queens SHAs to fix spice-html5 repo relocation

The spice-html5 repository moved from github to its own gitlab hosting
and that broke everything. As such, we update the OSA roles which
contain the correct URL for the new repository.

Change-Id: I3e2883c0436c9c93d2a8a338343ca3a75a1431e4
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: xci-lib.sh: Use the OSA requirements file for pip components 77/58177/1
Markos Chandras [Mon, 4 Jun 2018 10:31:46 +0000 (11:31 +0100)]
xci: xci-lib.sh: Use the OSA requirements file for pip components

OpenStack-Ansible maintains a requirements file which ensure that a
working combination of pip/setuptools/wheels/virtualenv can be mixed up
with distro packages so it's beneficial to take that into consideration
when building our environment.

Change-Id: Ic5398de3e464e1526f8d9fb6b6460907ac30084a
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoMerge "xci: kubespray: Use bootstrap role for k8s deployments"
Markos Chandras [Fri, 1 Jun 2018 09:51:53 +0000 (09:51 +0000)]
Merge "xci: kubespray: Use bootstrap role for k8s deployments"

6 years agoReorder scenarios in opnfv-scenario-requirements.yml 95/57795/1
Fatih Degirmenci [Wed, 23 May 2018 21:45:33 +0000 (14:45 -0700)]
Reorder scenarios in opnfv-scenario-requirements.yml

Put OpenStack scenarios and Kubernetes scenarios together.

installer-type:kubespray
deploy-scenario:k8-canal-nofeature

Change-Id: I6a47b0b3703e30ac9a2be53012687217a085ee88
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoMerge "Unpin all XCI scenarios for development"
Fatih Degirmenci [Wed, 23 May 2018 17:58:25 +0000 (17:58 +0000)]
Merge "Unpin all XCI scenarios for development"

6 years agoMerge changes from topic 'move-sourcing-files'
Markos Chandras [Wed, 23 May 2018 08:39:23 +0000 (08:39 +0000)]
Merge changes from topic 'move-sourcing-files'

* changes:
  xci: Move the rest of functions to xci-lib.sh
  xci: file: xci-lib.sh: Avoid sourcing xci-lib.sh twice
  xci: Move sourcing of configuration files to the install-lib.sh

6 years agoUnpin all XCI scenarios for development 65/57565/3
Fatih Degirmenci [Fri, 18 May 2018 07:09:26 +0000 (09:09 +0200)]
Unpin all XCI scenarios for development

Change-Id: I73a7c58a27c9018d0b131dc3c8bb65da91488c35
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agointegrate k8-contiv-nofeature scenario in XCI 25/57625/2
wutianwei [Mon, 21 May 2018 02:04:24 +0000 (10:04 +0800)]
integrate k8-contiv-nofeature scenario in XCI

Change-Id: I5f18e1060cb45246a15584fdd69c6c6bd3427001
Signed-off-by: wutianwei <wutianwei1@huawei.com>
6 years agoxci: kubespray: Use bootstrap role for k8s deployments 45/56145/8
Markos Chandras [Fri, 20 Apr 2018 12:37:32 +0000 (13:37 +0100)]
xci: kubespray: Use bootstrap role for k8s deployments

The bootstrap role configures NTP and networking on hosts so we
should use it on k8s deployments as well.

installer-type:kubespray
deploy-scenario:k8-nosdn-nofeature

Change-Id: I04bd1e1c2c325baabfb836bd8cca60c5f59344c7
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: Move the rest of functions to xci-lib.sh 67/57567/3
Markos Chandras [Fri, 18 May 2018 07:13:30 +0000 (08:13 +0100)]
xci: Move the rest of functions to xci-lib.sh

The xci-deploy.sh contains several functions used throughout in the
XCI deployment so we should move thse to xci-lib.sh file.

Change-Id: Iae6751619beea85b894900e5cd2f91a433410f66
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: file: xci-lib.sh: Avoid sourcing xci-lib.sh twice 85/55085/3
Markos Chandras [Fri, 6 Apr 2018 19:33:11 +0000 (20:33 +0100)]
xci: file: xci-lib.sh: Avoid sourcing xci-lib.sh twice

The file can be sourced from multiple places so we need to avoid
sourcing it twice.

Change-Id: I7d47f3d7e461d90d5456c95a1f7a791b4e3a2bde
Signed-off-by: Markos Chandras <mchandras@suse.de>