releng-xci.git
5 years agoPromote Panagiotis Karalis as XCI committer 29/68429/1
Fatih Degirmenci [Thu, 22 Aug 2019 16:57:26 +0000 (18:57 +0200)]
Promote Panagiotis Karalis as XCI committer

Panos has been an active contributor to XCI, working with XCI itself
and supporting Dovetail to use XCI. Some of his contributions
can be seen on Gerrit and on OPNFV maillists.

https://gerrit.opnfv.org/gerrit/#/q/owner:panos.pkaralis%2540gmail.com
https://lists.opnfv.org/g/opnfv-tech-discuss/search?d=0&ev=false&q=panos+xci&startdate=2018-08-22&enddate=2019-08-22

Change-Id: Iada997f82836a0c5424e6bce90c31fbf1424b03c
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
5 years agoMerge "Provide osh support for baremetal"
Manuel Buil [Mon, 26 Aug 2019 12:11:08 +0000 (12:11 +0000)]
Merge "Provide osh support for baremetal"

5 years agoMerge "Support for py3"
Manuel Buil [Fri, 23 Aug 2019 13:55:39 +0000 (13:55 +0000)]
Merge "Support for py3"

5 years agoProvide osh support for baremetal 83/68383/3
Manuel Buil [Thu, 22 Aug 2019 11:53:00 +0000 (13:53 +0200)]
Provide osh support for baremetal

Add osh into the idf description so that we can deploy osh in baremetal
environments

deploy-scenario:k8-calico-nofeature
installer-type:osh

Change-Id: Id0830ac4744122d149736b1d515af8a1dcbe9eb2
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoSupport for py3 77/68377/2
Manuel Buil [Thu, 22 Aug 2019 07:50:31 +0000 (09:50 +0200)]
Support for py3

This patch provides support for py3 in the deployment host and the OPNFV
VM. Some extra changes will need to happen in the future when distros
disclose how they will react to the py2 expiration.

* virtualbmc version is upgraded to 1.5 because 1.3 is not compatible with
py3
* The dynamic inventory is slightly modified because it was using
functionality that changes in py3
* pip3 check is removed as Ansible now works with py3

deploy-scenario:k8-calico-nofeature
installer-type:osh

Change-Id: I34178ebc357b0a299c0017d6f9e596b815c77b3b
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoFix bug for baremetal deployments 89/68389/2
Manuel Buil [Thu, 22 Aug 2019 16:06:59 +0000 (18:06 +0200)]
Fix bug for baremetal deployments

OSH cannot be deployed because the name is currently a string instead of
a variable that should be interpreted by ansible

deploy-scenario:k8-calico-nofeature
installer-type:osh

Change-Id: Ib0ec71d181d62ee1830861427ca6d4f64625fb4e
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoSeparate vxlan traffic 49/68349/4
Manuel Buil [Wed, 14 Aug 2019 08:05:49 +0000 (10:05 +0200)]
Separate vxlan traffic

Currently, all traffic is going through the untagged interface. However,
we are creating interfaces for the different traffic. This patch moves
the private traffic (VM-VM), which normally uses vxlan tunnels, to the
interface created for that

deploy-scenario:k8-calico-nofeature
installer-type:osh

Change-Id: I680698d0bf7ab8045d4ca8f7b5bea8c1e1881d71
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoFix the labels for noha 48/68348/2
Manuel Buil [Tue, 13 Aug 2019 13:45:59 +0000 (15:45 +0200)]
Fix the labels for noha

Both nodes are openstack-helm-node-class=primary. That creates problems
when deploying neutron because two l3 agents and dhcp agents are
deployed which sometimes results in problems

deploy-scenario:k8-calico-nofeature
installer-type:osh

Change-Id: Id13ee3cf308f5120061176302573739d7c5a5ed3
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoSet the correct labels for noha 46/68346/5
Manuel Buil [Mon, 12 Aug 2019 10:18:21 +0000 (12:18 +0200)]
Set the correct labels for noha

In noha mode, node1 and node2 is used for controller and compute roles.
This patch changes that making node1 only controller and node2 only
compute.
It also modifies a bit the syntax to make it more ansible friendly

deploy-scenario:k8-calico-nofeature
installer-type:osh

Change-Id: I3f40f59ea3c167914ea4c810f7dda60c75fb7175
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoFix noha deployment 29/68329/2
Manuel Buil [Fri, 9 Aug 2019 14:31:30 +0000 (16:31 +0200)]
Fix noha deployment

JIRA:XCI-11

noha was not passing the tempest test, however, nobody is testing that
test upstream. We should use the test that it being really tested
upstream

deploy-scenario:k8-calico-nofeature
installer-type:osh
xci-flavor:noha

Change-Id: I551e966e81a93120e96027b32096ec18b21bd3bd
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoMerge "Fix problems when redeploying with osh"
Manuel Buil [Thu, 8 Aug 2019 08:44:33 +0000 (08:44 +0000)]
Merge "Fix problems when redeploying with osh"

5 years agoFix problems when redeploying with osh 26/68326/2
nikoskarandreas [Wed, 7 Aug 2019 14:19:05 +0000 (10:19 -0400)]
Fix problems when redeploying with osh

When deploying manually after a previous deployment, keys and fingerprints of the VMs clash with the stored ones.

This patch clears the relevant files and also fixes an issue with keepalived role which failes ansible lint when already cached.

deploy-scenario:k8-calico-nofeature
installer-type:osh

Signed-off-by: nikoskarandreas <nick@intracom-telecom.com>
Change-Id: I9331a5b7d0ac66a35064dfe7f62dd78a461e570c

5 years agoMerge "os-nosdn-nofeature can be supported by osh"
Fatih Degirmenci [Wed, 7 Aug 2019 06:16:30 +0000 (06:16 +0000)]
Merge "os-nosdn-nofeature can be supported by osh"

5 years agoMerge "Remove hardcoded ips"
Manuel Buil [Tue, 6 Aug 2019 20:28:26 +0000 (20:28 +0000)]
Merge "Remove hardcoded ips"

5 years agoMerge "Move variable definition to vars"
Manuel Buil [Tue, 6 Aug 2019 20:27:36 +0000 (20:27 +0000)]
Merge "Move variable definition to vars"

5 years agoMerge "Add the required dashes in yaml files"
Manuel Buil [Tue, 6 Aug 2019 20:26:47 +0000 (20:26 +0000)]
Merge "Add the required dashes in yaml files"

5 years agombuil's id was wrong, and he was removed. 22/68322/1
Aric Gardner [Tue, 6 Aug 2019 19:08:06 +0000 (15:08 -0400)]
mbuil's id was wrong, and he was removed.

The id was wrong so updating the INFO.yaml
removed his rights.

I have added him by hand for now.

Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: Ib8bd94cae10b2ded36d4d162bb28b2edc24ddf64

5 years agoos-nosdn-nofeature can be supported by osh 21/68321/2
Manuel Buil [Tue, 6 Aug 2019 18:54:40 +0000 (20:54 +0200)]
os-nosdn-nofeature can be supported by osh

The latest patches in xci provided support for the basic scenario
os-nosdn-nofeature when using the osh installer

deploy-scenario:k8-calico-nofeature
installer-type:osh

Change-Id: Ia37718ae73b91da223bd26715208bb3975a15998
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoRemove hardcoded ips 15/68315/8
Manuel Buil [Mon, 5 Aug 2019 12:06:28 +0000 (14:06 +0200)]
Remove hardcoded ips

We should use the Ansible variables whenever possible instead of
hardcoding values like IPs

deploy-scenario:k8-calico-nofeature
installer-type:osh

Change-Id: Iee5f179b0b36d2fcbf9b2eca82a3c31cefd83229
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoMove variable definition to vars 17/68317/2
Manuel Buil [Tue, 6 Aug 2019 07:55:52 +0000 (09:55 +0200)]
Move variable definition to vars

Ansible best practices recommend doing the definition of variables in
the vars directory instead of directly in the tasks

deploy-scenario:k8-calico-nofeature
installer-type:osh

Change-Id: Ia5e215f8492a901b8c75ac06ee23258249f7f09a
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoAdd the required dashes in yaml files 12/68312/4
Manuel Buil [Mon, 5 Aug 2019 11:37:19 +0000 (13:37 +0200)]
Add the required dashes in yaml files

deploy-scenario:k8-calico-nofeature
installer-type:osh

Change-Id: I0423ab27186316d40c93cce847d7cb9fa7308df1
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoMerge "Update committer list for releng-xci"
Manuel Buil [Tue, 6 Aug 2019 07:31:21 +0000 (07:31 +0000)]
Merge "Update committer list for releng-xci"

5 years agoSupport of opensuse in OSH-XCI 44/68244/20
Nikos Mimigiannis [Thu, 18 Jul 2019 09:01:51 +0000 (12:01 +0300)]
Support of opensuse in OSH-XCI

deploy-scenario:k8-calico-nofeature
installer-type:osh

Change-Id: Ie198ee7e25579f1438561f71fd965518b067fe42
Signed-off-by: Nikos Mimigiannis <nmimi@intracom-telecom.com>
5 years agoIntroduction of Openstack-helm as installer 83/67083/24
nikoskarandreas [Fri, 22 Feb 2019 11:04:29 +0000 (13:04 +0200)]
Introduction of Openstack-helm as installer

This patch creates a new installer tree in xci that uses
openstack-helm to deploy openstack on a kubernetes cluster.

USAGE: Export INSTALLER_TYPE=osh, DEPLOY_SCENARIO=k8-calico-nofeature
and XCI_FLAVOR=noha or mini and run xci-deploy.sh as in documentation.

deploy-scenario:k8-calico-nofeature
installer-type:osh

Change-Id: I212f70eb51c2a38c798c11367d2ebb8bf5f4a1de
Signed-off-by: nikoskarandreas <nick@intracom-telecom.com>
5 years agoMove to newer versions of Bifrost repos 89/68289/3
Manuel Buil [Tue, 30 Jul 2019 13:50:10 +0000 (15:50 +0200)]
Move to newer versions of Bifrost repos

Change-Id: Id0b7becd47534de8b80df93e85daf399bc613aec
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoRemove source install 94/68294/1
Manuel Buil [Wed, 31 Jul 2019 14:35:44 +0000 (16:35 +0200)]
Remove source install

We should try to use pip ansible module as much as possible. If we use
pip in the command line we run into issues when moving towards a newer
version of bifrost

Change-Id: Ib606e0cc0e754f0a9ca07bf7724b7f8d70976b2d
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoUpdate committer list for releng-xci 88/68288/1
Fatih Degirmenci [Tue, 30 Jul 2019 11:53:32 +0000 (13:53 +0200)]
Update committer list for releng-xci

Yolanda, Peri, and Tianwei stepped down from the project
as committers.

Change-Id: Ie320028332a38e8cd323fe821cc215dff61c3931
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
5 years agoPin ara version to 0.16.4 02/68002/5
Nikos Mimigiannis [Wed, 5 Jun 2019 09:31:18 +0000 (12:31 +0300)]
Pin ara version to 0.16.4

The ara module just released an update
which changes how the module can be imported.
As a result, the xci-deploy script immediately
fails when trying to setup the virtualenv.
This patch sets ara to its previous
version (ara==0.16.4).

Change-Id: Ic54d18dc877857389e8b36bbf2e8bf4b70bc2812
Signed-off-by: Nikos Mimigiannis <nmimi@intracom-telecom.com>
5 years agoBug fix: use pod4-nodeN to refer to the nodes 91/67391/1
Manuel Buil [Tue, 26 Mar 2019 08:56:35 +0000 (09:56 +0100)]
Bug fix: use pod4-nodeN to refer to the nodes

lfpod4 uses pod4-nodeN notation and that was missing for the kubespray
deployer

Change-Id: If5b0a600b65f830c96ff8888986e0ef8decaada6
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoMerge "Add idf and pdf for lfpod4"
Fatih Degirmenci [Tue, 26 Mar 2019 08:28:21 +0000 (08:28 +0000)]
Merge "Add idf and pdf for lfpod4"

5 years agoAdd idf and pdf for lfpod4 75/67375/2
Manuel Buil [Mon, 25 Mar 2019 13:34:31 +0000 (14:34 +0100)]
Add idf and pdf for lfpod4

Change-Id: I6086d13450f95a5c901270c7d4b69a0aa127f129
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoBug fix: don't force rc=0 on first command 03/67303/3
Manuel Buil [Tue, 19 Mar 2019 15:10:53 +0000 (16:10 +0100)]
Bug fix: don't force rc=0 on first command

When working with an interface that uses vlan, the vlan is created when
executing the ifup command. As we previously execute the command:

/sbin/ip addr flush dev {{ item }}

it will not return code 0 because the interface does not exist yet.
Consequently, the second part of the command (ifup) is never executed
and the new network config is never triggered.

This patch removes the requirement to get a rc=0 in the first command to
run the second one.

Note that /sbin/ip addr flush dev {{ item }} must be run before ifup
when working with non-vlan interfaces that already have an ip, otherwise
ifup fails in Ubuntu

Change-Id: Ieac273a49b78104f24d4c1ba81c263b450a40a9f
Signed-off-by: Manuel Buil <mbuil@suse.com>
5 years agoFix bug in the inventory generator 98/67298/4
Manuel Buil [Tue, 19 Mar 2019 12:52:19 +0000 (13:52 +0100)]
Fix bug in the inventory generator

The dns keys should only appear in case the idf provides a dns entry for
the network. Otherwise, it should not exist at all. If it exists, even
if the value is empty, ansible will transform it in a variable and

"item.network.dns is defined"

will return true:

https://github.com/opnfv/releng-xci/blob/master/xci/playbooks/roles/bootstrap-host/templates/osa/debian.interface.j2#L35

A docstring is also added to explain what is the purpose of the class

Signed-off-by: Manuel Buil <mbuil@suse.com>
Change-Id: Ib8afa06cecb54f384083060073fa463c7f8d313f

5 years agoUse functest:hunter for openstack/rocky 36/67336/2
Fatih Degirmenci [Fri, 22 Mar 2019 10:30:24 +0000 (11:30 +0100)]
Use functest:hunter for openstack/rocky

deploy-scenario:os-nosdn-nofeature
installer-type:osa

Change-Id: Icebfbbd151c53b9ca3f38c7fdb107cb1f51b2b3e
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoIncrease timeout 77/67177/1
Manuel Buil [Tue, 5 Mar 2019 14:17:43 +0000 (15:17 +0100)]
Increase timeout

Baremetal is failing because ironic takes long to transfer the image to the
hard drive of the nodes

Change-Id: Ief704e92307d1ea7fe55ee0268abae49e0126503
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoAdd the baremetal case to README 71/67171/2
Manuel Buil [Mon, 4 Mar 2019 16:19:45 +0000 (17:19 +0100)]
Add the baremetal case to README

Change-Id: I3977c3d99b06b2548259e8765c262eb996ba30cf
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoFix typo 27/67027/1
Manuel Buil [Thu, 14 Feb 2019 11:26:13 +0000 (12:26 +0100)]
Fix typo

The name of the file should have baremetal not barematal

Change-Id: I15d70b69943e8ce3032c76d1cd7bc7272a6b8d56
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoSHA Bump for stable/rocky 95/66195/4
Manuel Buil [Fri, 4 Jan 2019 11:44:44 +0000 (12:44 +0100)]
SHA Bump for stable/rocky

Moving to the newer SHAs of stable/rocky

installer-type:osa

Change-Id: I89de6554d5e3bef8b2b49c6a3e621d3ca3a6f4dc
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoAdd network details for k8s 93/65493/2
Manuel Buil [Thu, 29 Nov 2018 10:12:16 +0000 (11:12 +0100)]
Add network details for k8s

To read the idf when the installer is kubespray, we need the network
details too

Change-Id: Idb9b0a4338a224e146abc78690067659bc94c302
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoRename Ericsson POD2 PDF/IDF 01/65301/1
Fatih Degirmenci [Wed, 21 Nov 2018 10:57:59 +0000 (11:57 +0100)]
Rename Ericsson POD2 PDF/IDF

The PDF/IDF filenames to use during deployments in CI will be generated
dynamically based on which slave the job is running on with the help of
the SLAVE_NAME environment variable Jenkins injects into job environment.

It will probably look like this

pdf=var/pdf.yml
idf=var/idf.yml
if [[ "$SLAVE_NAME" !~ virtual ]]; then
  pdf=var/${SLAVE_NAME}-pdf.yml
  pdf=var/${SLAVE_NAME}-idf.yml
fi

./xci-deploy.sh -i $idf -p $pdf

deploy-scenario:os-nosdn-nofeature
installer-type:osa

Change-Id: Ief319ee36292ca888b97e4059a26337ee98dfef2
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoxci: bifrost: Respect IDF DNS details during node configuration 93/64693/3
Markos Chandras [Wed, 7 Nov 2018 16:31:08 +0000 (16:31 +0000)]
xci: bifrost: Respect IDF DNS details during node configuration

The IDF files contain DNS information so we should respect that when
we configure the various XCI nodes. The DNS information is also a
list instead of a string so treat it as such.

Change-Id: I1c4d5eb600baaca35b2838dcafa7a75e59bf6783
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoMerge "[baremetal] Provide networking for suse nodes"
Manuel Buil [Wed, 7 Nov 2018 14:21:07 +0000 (14:21 +0000)]
Merge "[baremetal] Provide networking for suse nodes"

6 years agoMerge "[Baremetal] Provide networking for Ubuntu nodes"
Manuel Buil [Tue, 6 Nov 2018 17:56:01 +0000 (17:56 +0000)]
Merge "[Baremetal] Provide networking for Ubuntu nodes"

6 years agoMerge "Bug fix: NFS clients pointing to wrong server"
Manuel Buil [Tue, 6 Nov 2018 16:11:25 +0000 (16:11 +0000)]
Merge "Bug fix: NFS clients pointing to wrong server"

6 years agoMerge "Simplify the serial config"
Manuel Buil [Tue, 6 Nov 2018 15:35:59 +0000 (15:35 +0000)]
Merge "Simplify the serial config"

6 years agoBug fix: NFS clients pointing to wrong server 97/64297/4
Manuel Buil [Wed, 31 Oct 2018 09:36:01 +0000 (10:36 +0100)]
Bug fix: NFS clients pointing to wrong server

We are deploying the NFS server in computes. In all flavors, node2
takes the role of compute00 and thus the NFS server is in
172.29.244.12. Therefore, the openstack config for ha is wrong

Change-Id: I5e82ddd670b44e291c0b866ba4fde57e74b68643
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years ago[Baremetal] Provide networking for Ubuntu nodes 99/60799/37
Manuel Buil [Thu, 9 Aug 2018 15:07:23 +0000 (17:07 +0200)]
[Baremetal] Provide networking for Ubuntu nodes

When deploying baremetal, the traffic should be segmented using the
different interfaces instead of through vlans. All the config is done
based on idf and pdf information.

When doing non-baremetal, opnfv and nodes get the same config. When
doing baremetal, opnfv and nodes get a different network config

Change-Id: I23aa576bc782c7c69d511a5558827110c37b558a
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years ago[baremetal] Provide networking for suse nodes 39/63739/14
Manuel Buil [Fri, 19 Oct 2018 07:43:42 +0000 (09:43 +0200)]
[baremetal] Provide networking for suse nodes

When deploying baremetal, the traffic should be segmented using the
different interfaces instead of through vlans. All the config is done
based on idf and pdf information.

When doing non-baremetal, opnfv and nodes get the same config.
When doing baremetal, opnfv and nodes get a different network config

Apart from that, if vlan_id is defined in the name, there is no need
for VLAN_ID in the interface descriptor. This simplifies things

Change-Id: Iddbb90af807b43e247e5ee11fe735df9e823d4bf
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoMerge "xci: files: Also collect BIFROST env variables for bug reports"
Manuel Buil [Mon, 5 Nov 2018 13:18:37 +0000 (13:18 +0000)]
Merge "xci: files: Also collect BIFROST env variables for bug reports"

6 years agoxci: files: Also collect BIFROST env variables for bug reports 73/64373/2
Markos Chandras [Thu, 1 Nov 2018 09:50:09 +0000 (09:50 +0000)]
xci: files: Also collect BIFROST env variables for bug reports

Bifrost is exposing quite a few variables so we need to collect them
as well.

Change-Id: I7e7ca7a093f35a0acb53af360e58444f6c1de7e4
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoSimplify the serial config 33/64333/2
Manuel Buil [Wed, 31 Oct 2018 17:44:37 +0000 (18:44 +0100)]
Simplify the serial config

The current configuration only dumps the booting info into a file and
the pty does not work (i.e. virsh console opnfv returns a failure
because it cannot find a character device). After some investigations,
it is apparently impossible to have both active:

https://github.com/Mirantis/virtlet/issues/249

Therefore, we should remove the pty part of the xml. To connect to the
VM in case of network problems, we can always use vnc.

Apart from that, the console part is not necessary as libvirt will
create that one for us

Change-Id: I80a59163b4ba4e6bff34cb5378893201e93ddb87
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoxci: Bump kubespray version to 2.7.0 23/64423/1
Markos Chandras [Fri, 2 Nov 2018 10:58:55 +0000 (10:58 +0000)]
xci: Bump kubespray version to 2.7.0

installer-type:kubespray
deploy-scenario:k8-nosdn-nofeature

Change-Id: I6b59df5112e9b3459bf3147557f5f22fe0fb778b
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: osa: Bump SHAs to the HEAD of the Rocky branch 21/64421/1
Markos Chandras [Fri, 2 Nov 2018 10:56:16 +0000 (10:56 +0000)]
xci: osa: Bump SHAs to the HEAD of the Rocky branch

Change-Id: I50c367433dc8cf8964c291c916ea939e25f638cb
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: Add missing update_cache statements 75/64375/1
Markos Chandras [Thu, 1 Nov 2018 09:55:48 +0000 (09:55 +0000)]
xci: Add missing update_cache statements

When we install packages from the distro repos we need to make sure
that the database is updated. This also takes SUSE's zypper pkg manager
into consideration which can benefit from the same Ansible option.

Change-Id: I7a2206bfc5827b9ccb448278759711c560bb4679
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoBug fix: Fetch vm names from idf 29/64229/8
Manuel Buil [Tue, 30 Oct 2018 14:37:39 +0000 (15:37 +0100)]
Bug fix: Fetch vm names from idf

Currently we were taking the names of the nodes to be generated from the
NODE_NAMES variable whereas ansible was fetching the names from the
dynamic_inventory.py which uses idf. This resulted in problems: when
doing ha, ansible was provisioning a compute as a controller and
vicebersa.

This patch forces create_nodes role to fetch the name from idf and thus
align with the naming schema of ansible

deploy-scenario:k8-calico-nofeature
installer-type:kubespray

Change-Id: Id1473727405701fd9ed0cb2f1394ee8676cec337
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoRemove variable for driver 79/64279/3
Manuel Buil [Tue, 30 Oct 2018 20:20:50 +0000 (21:20 +0100)]
Remove variable for driver

Right now, we only support ipmi hosts (either virtual or physical) and
that is why our json is always describing the ipmi parameters. It does
not make sense that we have a variable which would allow to change that

Change-Id: I7b88aca5930a73d68342e3d4cf21f9e96286c4d7
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoBug fix: Wrong reference to vm_host_groups 75/64275/4
Manuel Buil [Tue, 30 Oct 2018 20:11:19 +0000 (21:11 +0100)]
Bug fix: Wrong reference to vm_host_groups

The variable should be host_group which is generated at line 32 and 35

Change-Id: I7add3af73198ec0638dee0c8f189a3a372a78ee8
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoChange variable in start-new-vm.sh 95/63195/3
Manuel Buil [Fri, 5 Oct 2018 08:45:47 +0000 (10:45 +0200)]
Change variable in start-new-vm.sh

Since the patch:

https://gerrit.opnfv.org/gerrit/#/c/63173/

The variable BIFROST_USE_PREBUILT_IMAGES has changed to
BIFROST_CREATE_IMAGE_VIA_DIB. As jenkins does not trigger testing jobs
when editing file in xci/scripts/, this change is done in a separate
patch

Change-Id: I3bc285936fae5b7514272ca0ad2418b60446e4aa
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoMerge "SHA bump for bifrost"
Markos Chandras [Fri, 26 Oct 2018 13:55:19 +0000 (13:55 +0000)]
Merge "SHA bump for bifrost"

6 years agoMerge "Reduce complexity when using bifrost roles"
Markos Chandras [Fri, 26 Oct 2018 13:54:17 +0000 (13:54 +0000)]
Merge "Reduce complexity when using bifrost roles"

6 years agoMerge "Bug fix: match only the scenario name"
Markos Chandras [Fri, 26 Oct 2018 13:48:03 +0000 (13:48 +0000)]
Merge "Bug fix: match only the scenario name"

6 years agoBug fix: match only the scenario name 63/64063/2
Manuel Buil [Fri, 26 Oct 2018 09:36:22 +0000 (11:36 +0200)]
Bug fix: match only the scenario name

Since this week we have two sfc scenarios:

- os-odl-sfc
- os-odl-sfc_osm

When $DEPLOY_SCENARIO=os-odl-sfc, using the current code testing_role
gets two values:
os-odl-sfc
os-odl-sfc_osm

This patch adds '$' character to prevent matching scenarios which
concatenate characters after $DEPLOY_SCENARIO

Change-Id: Ia0782362da04e8b3ecd2ec6f13ccc8c404797fda
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoReduce complexity when using bifrost roles 73/63173/6
Manuel Buil [Thu, 4 Oct 2018 13:33:04 +0000 (15:33 +0200)]
Reduce complexity when using bifrost roles

We are using two variables which have a similar scope:
- create_image_via_dib
- use_prebuilt_images

We could use one of them and not both. create_image_via_dib is selected
because it also exists in upstream bifrost

use_prebuilt_images = false is the same as create_image_via_dib = true
use_prebuilt_images = true is the same as create_image_via_dib = false

Change-Id: Ieaab78f1dc2d199746a2b13ebc82e9dc615d92e9
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoos_neutron SHA bump 51/64051/1
Manuel Buil [Fri, 26 Oct 2018 07:46:36 +0000 (09:46 +0200)]
os_neutron SHA bump

We need a commit for SFC scenario:

https://github.com/openstack/openstack-ansible-os_neutron/commit/200fa4a7aaa15a6d6758418eafffe093174d2f72

Change-Id: Ia497a49a910d16eaf3c7ee896f0f75aab812bd7a
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoSHA bump for bifrost 25/64025/2
Manuel Buil [Thu, 25 Oct 2018 14:35:08 +0000 (16:35 +0200)]
SHA bump for bifrost

We need it for baremetal support in opensuse:

https://github.com/openstack/bifrost/commit/0f605cd723a68e2c2bb9b30a15a08e5aba777bd5

We move all related repos from Rocky to master (problems if we SHA bump ironic, etc in
Rocky while Bifrost in master)

Change-Id: Icf0dd58c6fc6cc8f221d37a6ed3f3746f6577716
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoMerge "Introduce the Barbican in XCI for SFC-HA scenario"
Markos Chandras [Thu, 25 Oct 2018 15:49:09 +0000 (15:49 +0000)]
Merge "Introduce the Barbican in XCI for SFC-HA scenario"

6 years agoIntegrate os-odl-sfc_osm scenario into XCI 07/63507/13
Venkata Harshavardhan Reddy Allu [Mon, 15 Oct 2018 00:54:05 +0000 (06:24 +0530)]
Integrate os-odl-sfc_osm scenario into XCI

https://gerrit.opnfv.org/gerrit/#/c/63505/

The os-odl-sfc_osm scenario has been verified in the previous
patchsets of this commit. This patch needs to be merged after
adding OS variables to the post-deployment playbook.

https://gerrit.opnfv.org/gerrit/#/c/63135/

installer-type:osa
deploy-scenario:os-odl-sfc_osm

Change-Id: I14e83357c9e1db6e31890b5f126b9e405e124594
Signed-off-by: Venkata Harshavardhan Reddy Allu <venkataharshavardhan_ven@srmuniv.edu.in>
6 years agoxci: Add OS variables to the post-deployment playbook 35/63135/5
Venkata Harshavardhan Reddy Allu [Wed, 3 Oct 2018 17:16:24 +0000 (22:46 +0530)]
xci: Add OS variables to the post-deployment playbook

OSM needs access to OpenStack credentials and authentication url.
This patch would provide that using the xci_flavor specific
user_variables.yml file. This patch is necessary to complete the
initial integration of OSM.

installer-type:osa
deploy-scenario:os-nosdn-osm

Change-Id: Ic228b323fc69ce46c8093f6dfbc116d8c71a0391
Signed-off-by: Venkata Harshavardhan Reddy Allu <venkataharshavardhan_ven@srmuniv.edu.in>
6 years agoIntroduce the Barbican in XCI for SFC-HA scenario 77/62877/5
Panagiotis Karalis [Wed, 19 Sep 2018 14:45:09 +0000 (17:45 +0300)]
Introduce the Barbican in XCI for SFC-HA scenario

The barbican OS component is introduced for SFC HA deployed scenario.
The reason behind is that In HA scenarios we need Openstack Barbican to
gather and store the fernet keys so Tacker can access them and be able to
register new VIMs.

deploy-scenario:os-odl-sfc
installer-type:osa

JIRA: SFC-131

Change-Id: Ife416fb2a7dc04ddadc93f962695aee4ed448501
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
6 years agoMerge "[Baremetal] Add baremetal support to create-nodes"
Manuel Buil [Thu, 18 Oct 2018 10:26:33 +0000 (10:26 +0000)]
Merge "[Baremetal] Add baremetal support to create-nodes"

6 years agoxci: osa: Bump SHAs to the HEAD of the Rocky branch 19/62419/18
Manuel Buil [Mon, 17 Sep 2018 10:19:01 +0000 (12:19 +0200)]
xci: osa: Bump SHAs to the HEAD of the Rocky branch

Since Rocky, networking-odl depends on ceilometer and requires it to be
installed. Therefore, all odl scenarios need to have ceilometer
deployed. Once that is done, we can unfreeze n-odl repo.

Besides, we need to introduce a SHA bump for neutron and ceilometer to
include the latest changes to support this fix

Ceilometer should be git cloned always, otherwise repo_build will fail
as ceilometer is now part of requirements.txt

[mchandras: Instead of just bumping selective network related roles,
lets just do a complete sha bump for stable/rocky]

deploy-scenario:os-odl-sfc
installer-type:osa

Change-Id: I81a39436e4ff648faabda4e82fce1d3f14615741
Signed-off-by: Manuel Buil <mbuil@suse.com>
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoMerge "Add ODL variables to env file"
Manuel Buil [Thu, 18 Oct 2018 10:13:10 +0000 (10:13 +0000)]
Merge "Add ODL variables to env file"

6 years agoAdd ODL variables to env file 75/63175/12
Manuel Buil [Thu, 4 Oct 2018 13:56:42 +0000 (15:56 +0200)]
Add ODL variables to env file

ODL testcases in functest require new variables:

https://git.opnfv.org/functest/tree/functest/utils/env.py#n22

Otherwise the test fails because it cannot contact ODL

To find those variables, we fetch the ml2_conf.ini file from the neutron
container and then we parse the values. This is only run when the
scenario has odl

deploy-scenario:os-odl-sfc
installer-type:osa

Change-Id: If175bb7642e66e151b30e1ccd1b9040aa3481d8f
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years ago[Baremetal] Add baremetal support to create-nodes 97/60797/35
Manuel Buil [Thu, 9 Aug 2018 14:52:46 +0000 (16:52 +0200)]
[Baremetal] Add baremetal support to create-nodes

Information about baremetal servers is collected for ironic to do
the provisioning. Two main things are done:

1 - baremetalhoststojson.yml fills the json config file fed to ironic
so that it knows how to boot the blades. In the baremetal case, the
create_vm.yml playbook will only create opnfv vm. The variable
vms_to_create holds that information. The variable baremetal_nodes
specifies the physical nodes (empty when non baremetal deployments)

2 - For PXE to work, we create a file called baremetalstaticips that
has the mapping between mac address from servers and its ip. That file
is moved into the dnsmasq config directory

Change-Id: I0e788db1deb50769c183b71524a68ac0b925f8aa
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years ago[baremetal] Add two interfaces to the opnfv vm 93/63193/3
Manuel Buil [Fri, 5 Oct 2018 07:52:06 +0000 (09:52 +0200)]
[baremetal] Add two interfaces to the opnfv vm

opnfv vm requires connectivity to two physical interfaces of the host.
These interfaces are:
 1 - admin, where DHCP requests will arrive from blades to do PXE boot
 2 - mgmt, which connects to the mgmt of the blades to do the ansible
   configuration

To achive this, it is required:
 1 - Two libvirt networks that connect to two different linux bridges.
   The important physical interfaces are connected to them. The
   interfaces name is fetched from the idf
 2 - Two templates representing the new libvirt networks
   (net-mgmt.xml.j2 and net-admin.xml.j2)
 3 - Two interfaces defined in vm.xml.j2

Change-Id: I9037aa36802cfde44717b9394bab79b22d7dfaab
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years ago[Baremetal] Modify interaction with bifrost roles 95/60795/19
Manuel Buil [Thu, 9 Aug 2018 14:29:24 +0000 (16:29 +0200)]
[Baremetal] Modify interaction with bifrost roles

Change some of the variables when calling opnfv-virtual.yml and
baremetal=true:

1 - We want to configure DHCP mapping between ip and mac when doing
baremetal. The create-nodes role will generate a file with that
mapping for us (baremetalstaticips)

2 - Don't download the standard IPA image but build one with Fedora
(only one that works in ericsson-pod2) when doing baremetal

3 - Wait for the blade to complete its booting. Its ssh port becomes
available with the IPA provision but that is not the final state.
We need to wait until the required distro gets installed.
When not doing baremetal, this is fine as the VMs boot very fast with
the chosen distro but for baremetal it takes a while (ericsson-pod2
servers take around 2 minutes to finish all BIOS booting). The playbook
wait-for-baremetal.yml does this.

Change-Id: I5536517209ff7f46ec034554d29566707778e397
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoMerge "Simplify external networking for os"
Fatih Degirmenci [Sat, 13 Oct 2018 12:48:23 +0000 (12:48 +0000)]
Merge "Simplify external networking for os"

6 years agoSimplify external networking for os 69/63269/2
Manuel Buil [Mon, 8 Oct 2018 09:51:34 +0000 (11:51 +0200)]
Simplify external networking for os

We were right now creating an overlay network with gateway in the opnfv
vm. This makes floating ips work but if we need internet connection from
vms, things get complicated and messy.

As we are only using up to 7 ips from the 192.168.122.0/24, we can
consider it the provider network for openstack and use ips starting from
192.168.122.100 as floating ips or ips for routing (doing SNAT as
always)

Change-Id: I09af663069ae95a9d265d98f1531778eb37134e2
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoFix idf for k8s 81/63281/9
Manuel Buil [Mon, 8 Oct 2018 16:14:06 +0000 (18:14 +0200)]
Fix idf for k8s

deploy-scenario:k8-calico-nofeature
installer-type:kubespray

Change-Id: If1c9f5908f39f9c09efb86e27a3f3883b4cd75b9
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoUpdate bifrost SHAs 51/63451/2
Manuel Buil [Fri, 12 Oct 2018 15:51:23 +0000 (17:51 +0200)]
Update bifrost SHAs

There is a bug when ironic communicates with rabbitmq due to a parameter
deprecation. This patch fixes it:

https://review.openstack.org/#/c/609499/

And we can take the opportunity to update all SHAs

THere is a problem:

"Unable to retrieve file contents\nCould not find or access '/home/opnfv/releng-xci/xci/infra/bifrost/playbooks/roles/common/venv_python_path.yml'"}

That file is in:

/home/opnfv/releng-xci/.cache/repos/bifrost/playbooks/roles/common/venv_python_path.yml

As I am not sure how to fix the ansible PATH, for the time being, I just
added to where Ansible is searching for it

Change-Id: I8e60f43ed7fc78a8925efaa36e41b0d872ea9a74
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoMerge "[Baremetal] - Change roles and playbooks names"
Manuel Buil [Thu, 4 Oct 2018 15:30:59 +0000 (15:30 +0000)]
Merge "[Baremetal] - Change roles and playbooks names"

6 years agoBug fix: Remove use_prebuilt_images condition 71/63171/1
Manuel Buil [Thu, 4 Oct 2018 13:22:54 +0000 (15:22 +0200)]
Bug fix: Remove use_prebuilt_images condition

The creation or not of the IPA image does not depend on the value of the
use_prebuilt_images. This variable is intended to control the following
call to bifrost-create-dib-image role.

I added a few comments to clarify what we are doing in each call to the
bifrost-create-dib-image role

Change-Id: Id66e1a969ca279a055640481719f118744eedf38
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years ago[Baremetal] - Change roles and playbooks names 31/63131/3
Manuel Buil [Wed, 3 Oct 2018 16:18:05 +0000 (18:18 +0200)]
[Baremetal] - Change roles and playbooks names

A few playbooks and the create-vm-nodes role should change the name to
reflect the new reality once the baremetal patches are merged. The
playbooks that must change the name are:

- xci-prepare-virtual.yml
- xci-create-virtual.yml

Change-Id: Iaed1f93561fa9d39c7916e0643a5445cdddf4f97
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years ago[Baremetal] Include a baremetal variable 89/60789/22
Manuel Buil [Thu, 9 Aug 2018 14:06:42 +0000 (16:06 +0200)]
[Baremetal] Include a baremetal variable

It switches between parts of the code which are specific for baremetal
or non-baremetal. Those parts come with this patch:

https://gerrit.opnfv.org/gerrit/#/c/60797

It also selects different variables when calling the opnfv-virtual.yml
playbook:

https://gerrit.opnfv.org/gerrit/#/c/60795

It decides the value of BAREMETAL based on the vendor value of the pdf

Change-Id: I8e6171f4f21db7f814a472e6ed1bacb30220b4ec
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years ago[baremetal] idf for opnfv_vm and update the pdf 87/60787/19
Manuel Buil [Thu, 9 Aug 2018 13:53:40 +0000 (15:53 +0200)]
[baremetal] idf for opnfv_vm and update the pdf

Physical hardware PODs provide a pdf and a idf to describe hardware and other
information (e.g. what is the purpose for each interface). To reuse the
same code for opnfv vm and also become consistent, we should also describe
the opnfv vm with an idf and a pdf. This patch simplifies what needs to
be done for baremetal, especially for this (future) patch:

https://gerrit.opnfv.org/gerrit/#/c/60797/11

As we add an idf, we should update dynamic_inventory and how we create
the opnfv vm. Obviously, he opnfv_vm.yml gets removed.

Change-Id: I930728474631fc214e4a9adc8581e0c16d230176
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoAdd idf and pdf to the xci-create-virtual.yml 97/62697/3
Manuel Buil [Fri, 21 Sep 2018 09:55:13 +0000 (11:55 +0200)]
Add idf and pdf to the xci-create-virtual.yml

This patch complements this other:

https://gerrit.opnfv.org/gerrit/#/c/62575/2

We require the pdf and the idf (when doing baremetal) in the create-vm
role, so we should propagate that variable to the playbook that triggers
those roles

Change-Id: I15806d386db4e6b11192829f2dbc61662bffec2b
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoMerge "xci: Add ability to pass command line options to xci-deploy.sh"
Markos Chandras [Thu, 20 Sep 2018 12:32:57 +0000 (12:32 +0000)]
Merge "xci: Add ability to pass command line options to xci-deploy.sh"

6 years agoMerge "Docs transition"
Fatih Degirmenci [Thu, 20 Sep 2018 08:14:40 +0000 (08:14 +0000)]
Merge "Docs transition"

6 years agoxci: Add ability to pass command line options to xci-deploy.sh 75/62575/2
Markos Chandras [Wed, 19 Sep 2018 15:28:10 +0000 (16:28 +0100)]
xci: Add ability to pass command line options to xci-deploy.sh

We now support multiple PDF files so instead of introducing another
env variable, we can simply pass this information as command line
arguments to xci-deploy.sh. We can extend the script to allow more
options line verbosity, scenario name, functest details etc so we
can get rid of multiple env variables.

Change-Id: I6c4a8d6e8b70e91746a659de923fee19019ed5e0
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoMerge "[Baremetal] Add ericsson-pod2 pdf and idf"
Manuel Buil [Wed, 19 Sep 2018 14:39:54 +0000 (14:39 +0000)]
Merge "[Baremetal] Add ericsson-pod2 pdf and idf"

6 years agoSwitch to Functest Hunter 35/62435/3
Fatih Degirmenci [Mon, 17 Sep 2018 08:59:26 +0000 (10:59 +0200)]
Switch to Functest Hunter

A new var FUNCTEST_VERSION is introduced to jobs to control the
version to use for Functest.

Change-Id: Ice7aa9f910db2353ce3d0bef198bef9fa3efe9fd
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoMerge "xci: Drop custom XCI certificates"
Fatih Degirmenci [Sun, 16 Sep 2018 13:01:31 +0000 (13:01 +0000)]
Merge "xci: Drop custom XCI certificates"

6 years agoxci: Drop custom XCI certificates 23/62323/1
Markos Chandras [Fri, 14 Sep 2018 15:33:11 +0000 (16:33 +0100)]
xci: Drop custom XCI certificates

OSM requires a CA even when we create a self-signed certificate. We
don't actually need to do that since HAproxy and friends can create the
whole chain for us, so we can finally get rid of this playbook.

installer-type:osa
deploy-scenario:os-nosdn-nofeature

Change-Id: I14a3adbe3492cd6c562c5167c42dd45756e8e3dd
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoDocs transition 33/61933/3
Fatih Degirmenci [Thu, 6 Sep 2018 20:34:52 +0000 (22:34 +0200)]
Docs transition

Changes are made by following
    https://docs.opnfv.org/en/latest/how-to-use-docs/local-build-transition.html

Change-Id: If0ee2031894d4dbd54098548640b8cc71481e49f
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
6 years agoEnable post-deployment for k8s based scenarios 75/62175/3
Fatih Degirmenci [Thu, 13 Sep 2018 05:33:48 +0000 (23:33 -0600)]
Enable post-deployment for k8s based scenarios

k8-calico-onap scenario will have post deployment tasks to
install ONAP using OOM so post-deployment tasks are required
to do that.

deploy-scenario:k8-calico-nofeature
installer-type:kubespray

Change-Id: I67c8188cb573f6fc5c80e15a9101cacca1b7b10e
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoxci: osa: Bump SHA for os_neutron 35/62135/1
Manuel Buil [Wed, 12 Sep 2018 16:34:32 +0000 (18:34 +0200)]
xci: osa: Bump SHA for os_neutron

We require the following patch to deploy ODL when using Ubuntu

https://review.openstack.org/#/c/597003/1

This SHA bump adds it

Change-Id: I0382a4c3946aeff2ddd86a932055dd770c520c74
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoxci: osa: Bump the SHA for the openstack_openrc role 53/62053/1
Markos Chandras [Mon, 10 Sep 2018 12:58:26 +0000 (13:58 +0100)]
xci: osa: Bump the SHA for the openstack_openrc role

Previous bump missed the latest SHA for this role and yardstick
started failing again due to the incomplete openrc file.

Change-Id: I73f024250c73a42a6c2a36acaf8b1f8c6867dd2a
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: osa: Update OSA SHAs to the HEAD of the Rocky branch 87/61987/1
Markos Chandras [Fri, 7 Sep 2018 15:06:59 +0000 (16:06 +0100)]
xci: osa: Update OSA SHAs to the HEAD of the Rocky branch

Change-Id: I012f829c124d665d7d8d9ebb6b18a72d6d73258f
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoMerge "playbooks: configure-opnfvhost: Ensure we copy only the tracked files"
Markos Chandras [Thu, 6 Sep 2018 07:10:09 +0000 (07:10 +0000)]
Merge "playbooks: configure-opnfvhost: Ensure we copy only the tracked files"

6 years agoMerge "xci: infra: bifrost: Allow DNS overrides"
Markos Chandras [Thu, 6 Sep 2018 07:10:04 +0000 (07:10 +0000)]
Merge "xci: infra: bifrost: Allow DNS overrides"