releng-xci.git
7 years agoEnable tempest 37/47637/3
Fatih Degirmenci [Wed, 22 Nov 2017 07:59:27 +0000 (08:59 +0100)]
Enable tempest

Change-Id: I0fb12e4c2612f953998880a94b13655fa9ee0d8c
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoMerge "Use RUN_TEMPEST global env"
Fatih Degirmenci [Thu, 23 Nov 2017 09:53:49 +0000 (09:53 +0000)]
Merge "Use RUN_TEMPEST global env"

7 years agoMerge "Add the libvirt DNS to resolv.conf"
Markos Chandras [Thu, 23 Nov 2017 09:50:07 +0000 (09:50 +0000)]
Merge "Add the libvirt DNS to resolv.conf"

7 years agoAdd the libvirt DNS to resolv.conf 83/46683/4
Victor Morales [Fri, 3 Nov 2017 16:35:14 +0000 (09:35 -0700)]
Add the libvirt DNS to resolv.conf

This change adds the gateway into the resolv.conf for helping
to resolve some routes faster during the execution of start-new-vm.sh
main script.

Change-Id: I08f361f5e55589f388e6ff6613d213eb79bbbce9
Signed-off-by: Victor Morales <victor.morales@intel.com>
7 years agoUse RUN_TEMPEST global env 07/47607/3
Victor Morales [Tue, 21 Nov 2017 10:17:42 +0000 (02:17 -0800)]
Use RUN_TEMPEST global env

The RUN_TEMPEST global environment has been defined in *user-vars*
but never used in the playbooks. This change pretends to enable the
use of that value.

Change-Id: I49ca092546494c0cdcb015a549828bf79fa5f889
Signed-off-by: Victor Morales <victor.morales@intel.com>
7 years agoAdd br-vlan-veth to the br-vlan bridge in openSUSE 43/47643/2
Manuel Buil [Wed, 22 Nov 2017 09:45:07 +0000 (10:45 +0100)]
Add br-vlan-veth to the br-vlan bridge in openSUSE

br-vlan-eth was created but not added to any bridge, therefore floating ips
were not working as it was impossible for the OVS in the compute to get the
ARP messages coming from the gateway of the public network

Change-Id: Ia0828b7e96359dc10012ac52bf0e5d4f2c5419cb
Signed-off-by: Manuel Buil <mbuil@suse.com>
7 years agoxci: config: pinned-versions: Bump Bifrost SHA 97/47497/3
Markos Chandras [Mon, 20 Nov 2017 10:12:44 +0000 (10:12 +0000)]
xci: config: pinned-versions: Bump Bifrost SHA

Change-Id: I9df869fa82f4486b104f4330b83e8300362afb54
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoRemove the share flag 77/47577/3
Manuel Buil [Tue, 21 Nov 2017 11:41:24 +0000 (12:41 +0100)]
Remove the share flag

When creating the external network for functest testing purposes, it does not
need to be shareable between tenants because functest uses routers and floating
ips. Therefore, better remove it to avoid confusion

Change-Id: I18a1fd34a52ddae2527ee3580a9d1a2b649e61b6
Signed-off-by: Manuel Buil <mbuil@suse.com>
7 years agoxci: Use the dib pip-and-virtualenv element 75/47575/6
Markos Chandras [Tue, 21 Nov 2017 09:35:49 +0000 (09:35 +0000)]
xci: Use the dib pip-and-virtualenv element

The element will ensure that we have a reasonable set of pip
and virtualenv packages in place as well as pick the right
python version for the distribution. We also make sure that
we use python2 everywhere.

Change-Id: I8a83af9acffbd8d6d583832956e1685100ec508a
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "playbooks: configure-opnfvhost: Be explicit when copying user files"
Markos Chandras [Mon, 20 Nov 2017 10:11:46 +0000 (10:11 +0000)]
Merge "playbooks: configure-opnfvhost: Be explicit when copying user files"

7 years agoMerge "XCI: Bump OpenStack Ansible SHAs"
Markos Chandras [Mon, 20 Nov 2017 10:11:40 +0000 (10:11 +0000)]
Merge "XCI: Bump OpenStack Ansible SHAs"

7 years agoMerge "xci: file: install-ansible.sh: Update script from latest Bifrost"
Markos Chandras [Mon, 20 Nov 2017 09:51:25 +0000 (09:51 +0000)]
Merge "xci: file: install-ansible.sh: Update script from latest Bifrost"

7 years agoplaybooks: configure-opnfvhost: Be explicit when copying user files 17/47417/1
Markos Chandras [Fri, 17 Nov 2017 13:36:09 +0000 (13:36 +0000)]
playbooks: configure-opnfvhost: Be explicit when copying user files

The flavors may contain deployment specific user_variables.yml files
so we should only copy the generic one in the common tasks and leave
the rest for scenarios to copy them if necessary.

Change-Id: I39e3e090dc40d4f13bb42028a24e8574e19cf6dd
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoXCI: Bump OpenStack Ansible SHAs 15/47415/1
Markos Chandras [Fri, 17 Nov 2017 13:10:20 +0000 (13:10 +0000)]
XCI: Bump OpenStack Ansible SHAs

Change-Id: If5e4ff731b2bf59e44b753ce0574f25639694162
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "add os-nosdn-ovs scenario"
Markos Chandras [Fri, 17 Nov 2017 12:32:57 +0000 (12:32 +0000)]
Merge "add os-nosdn-ovs scenario"

7 years agoxci: file: install-ansible.sh: Update script from latest Bifrost 77/46177/8
Markos Chandras [Tue, 24 Oct 2017 15:24:10 +0000 (17:24 +0200)]
xci: file: install-ansible.sh: Update script from latest Bifrost

Update our own copy of the Ansible installation script to take some
Bifrost fixes into consideration. We also upgrade the pip and setuptools
to the latest available version if possible.

Change-Id: I5e51099b2698f0b03922d1364e83bc91cfadc00c
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoadd os-nosdn-ovs scenario 47/43447/11
Periyasamy Palanisamy [Thu, 28 Sep 2017 11:04:36 +0000 (13:04 +0200)]
add os-nosdn-ovs scenario

This scenario is to install ovs on neutron agent and compute nodes for
providing networking capabilities without being managed by Opendaylight.

Change-Id: Iacc2f61ce1ffca248acdca378a23d65a91452828
Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
7 years agoMerge "Fix permissions on SUSE network script"
Fatih Degirmenci [Tue, 14 Nov 2017 13:57:25 +0000 (13:57 +0000)]
Merge "Fix permissions on SUSE network script"

7 years agoMerge "Integrate ceph in XCI"
Markos Chandras [Tue, 14 Nov 2017 09:08:55 +0000 (09:08 +0000)]
Merge "Integrate ceph in XCI"

7 years agoFix permissions on SUSE network script 51/46951/2
Manuel Buil [Thu, 9 Nov 2017 14:57:58 +0000 (15:57 +0100)]
Fix permissions on SUSE network script

We were not getting the eth12 interface in the computes because the
network-config-suse file did not have executable rights:

-rw-r--r-- 1 root root   300 Nov  9 14:40 network-config-suse

Change-Id: Ia796123b331b67bc442d3506b944f0430f7a5f32
Signed-off-by: Manuel Buil <mbuil@suse.com>
7 years agoMerge "Bump OpenStack Ansible SHAs"
Markos Chandras [Fri, 3 Nov 2017 05:40:06 +0000 (05:40 +0000)]
Merge "Bump OpenStack Ansible SHAs"

7 years agoBump OpenStack Ansible SHAs 31/46431/3
Markos Chandras [Mon, 30 Oct 2017 16:42:19 +0000 (16:42 +0000)]
Bump OpenStack Ansible SHAs

We also need to allow root logins when the ansible-hardening role
is applied which are disabled by default.

Change-Id: I71f881305bafdd884d541cd34796a6fed8eee157
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoFix yum update repos 61/46361/1
Victor Morales [Sat, 28 Oct 2017 02:47:44 +0000 (19:47 -0700)]
Fix yum update repos

The *yum update* fails during the installation of ansible in centos
because it tries to update openssh-server among other packages.
This commit change fixes the command to only update the repository
information. The --assumeno argument is not required.

Change-Id: I26870462888742b3200097322d5316ac00febfc5

7 years agoMerge "Enable OPENSTACK_OSA_DEV_PATH for AIO"
Markos Chandras [Fri, 27 Oct 2017 10:17:53 +0000 (10:17 +0000)]
Merge "Enable OPENSTACK_OSA_DEV_PATH for AIO"

7 years agoMerge "Fix typo in xci-deploy.sh comments"
Markos Chandras [Fri, 27 Oct 2017 07:13:32 +0000 (07:13 +0000)]
Merge "Fix typo in xci-deploy.sh comments"

7 years agoEnable OPENSTACK_OSA_DEV_PATH for AIO 71/46271/1
Victor Morales [Thu, 26 Oct 2017 19:43:27 +0000 (12:43 -0700)]
Enable OPENSTACK_OSA_DEV_PATH for AIO

The task for synchronize source code between the host and opnfv guest
instance was not implemented for All-in-One flavor. This change
uses the same task that is used in other flavors.

Change-Id: I9733544a22de4867c399eb57dfe90c0915350171
Signed-off-by: Victor Morales <victor.morales@intel.com>
7 years agoMerge changes from topic 'add-role-hooks'
Markos Chandras [Thu, 26 Oct 2017 09:49:20 +0000 (09:49 +0000)]
Merge changes from topic 'add-role-hooks'

* changes:
  xci: playbooks: Add generic playbook for scenarios to plug their roles
  xci: Clone all XCI scenarios in advance similar to a-r-r
  xci: xci-deploy.sh: Allow scenarios to overrides XCI variables.

7 years agoIntegrate ceph in XCI 03/42503/18
wutianwei [Wed, 20 Sep 2017 06:31:14 +0000 (14:31 +0800)]
Integrate ceph in XCI

Openstack ansible support to deploy ceph.
The purpose of this patch is to configure the ceph,
just like we configure other openstack components.

The default is to not deploy ceph.
If you want to deploy ceph you just need to
export XCI_CEPH_ENABLED=true before running xci-deploy.sh.
When deployed successfully, the openstack storage will use ceph.

Change-Id: Ifd8d16fdce2914b6316842e72bbfd93228ea059d
Signed-off-by: wutianwei <wutianwei1@huawei.com>
7 years agoMerge "Drop Ironic DB using non-default password"
Markos Chandras [Wed, 25 Oct 2017 09:35:44 +0000 (09:35 +0000)]
Merge "Drop Ironic DB using non-default password"

7 years agoFix typo in xci-deploy.sh comments 91/46191/1
Victor Morales [Wed, 25 Oct 2017 01:19:20 +0000 (18:19 -0700)]
Fix typo in xci-deploy.sh comments

Change-Id: Iac117beb3d4a8df85ad2453c97982adf90958833
Signed-off-by: Victor Morales <victor.morales@intel.com>
7 years agodocs: Add ONAP into the diagram 95/46095/1
Fatih Degirmenci [Sat, 21 Oct 2017 09:50:53 +0000 (11:50 +0200)]
docs: Add ONAP into the diagram

Change-Id: If6a0c9d498324a5edec38a442f5c3d23f9796130
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoDrop Ironic DB using non-default password 65/46065/1
Victor Morales [Fri, 20 Oct 2017 19:06:29 +0000 (12:06 -0700)]
Drop Ironic DB using non-default password

The current implementation relays on the fact that the existing mysql
deployment the root user can remove has access to the root user
without its password. It's possible to drop the Ironic database using
the same credentials that were used during its creation.

Change-Id: I4b26455e06e5f024d2bd8c42065367838bb4aa0f
Signed-off-by: Victor Morales <victor.morales@intel.com>
7 years agoMerge "Create the basic structure for generic scenarios"
Fatih Degirmenci [Thu, 19 Oct 2017 16:13:19 +0000 (16:13 +0000)]
Merge "Create the basic structure for generic scenarios"

7 years agoxci: playbooks: Add generic playbook for scenarios to plug their roles 85/44885/7
Markos Chandras [Thu, 12 Oct 2017 08:50:38 +0000 (09:50 +0100)]
xci: playbooks: Add generic playbook for scenarios to plug their roles

The new bootstrap-scenarios.yml playbook is aimed to be used by
scenarios to configure themselves right before we proceed with
the bootstrapping. This way we can avoid having scenario specific
stuff into the generic code.

Change-Id: I3026013719a50458c65405439712270f25f569ff
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: Clone all XCI scenarios in advance similar to a-r-r 81/44881/8
Markos Chandras [Thu, 12 Oct 2017 08:11:59 +0000 (09:11 +0100)]
xci: Clone all XCI scenarios in advance similar to a-r-r

In order to plug the scenarios' roles properly, we need to have all
roles physically present in advance. As such, add a
opnfv-scenario-requirements.yml file which can be used to populate the
roles directory with all the scenarios.

Change-Id: I0cdadb63849e4565c31559817660d23217879053
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: start-new-vm.sh: Remove empty line 61/45361/1
Markos Chandras [Tue, 17 Oct 2017 16:05:53 +0000 (17:05 +0100)]
xci: scripts: start-new-vm.sh: Remove empty line

The empty line is wrong and it may cause some issues so drop it.

Change-Id: I4120e00df1dd9b7061dc1175e0ea6db8e0a9df88
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: xci-deploy.sh: Allow scenarios to overrides XCI variables. 97/44797/9
Markos Chandras [Wed, 11 Oct 2017 14:13:04 +0000 (15:13 +0100)]
xci: xci-deploy.sh: Allow scenarios to overrides XCI variables.

Scenario may want to override variables exported by the XCI so
allow them to define their own 'xci_overrides' file in the root directory
of the role to do so.

Change-Id: I6648eb43831a2aecc08d745a8c0fc191ce56e1b2
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agodocs: Add XCI overview document 55/43955/7
Fatih Degirmenci [Mon, 2 Oct 2017 21:10:51 +0000 (23:10 +0200)]
docs: Add XCI overview document

Change-Id: I23405aec19a7e9bfce1c58d770b80b1c9c550d00
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoMerge "xci: AIO: Disable tempest on AIO"
Markos Chandras [Tue, 17 Oct 2017 07:41:44 +0000 (07:41 +0000)]
Merge "xci: AIO: Disable tempest on AIO"

7 years agoMerge "xci: scripts: start-new-vm.sh: Make VM specs configurable"
Aric Gardner [Mon, 16 Oct 2017 20:04:04 +0000 (20:04 +0000)]
Merge "xci: scripts: start-new-vm.sh: Make VM specs configurable"

7 years agoxci: scripts: start-new-vm.sh: Skip all qcow2 files 21/45221/2
Markos Chandras [Mon, 16 Oct 2017 13:18:02 +0000 (14:18 +0100)]
xci: scripts: start-new-vm.sh: Skip all qcow2 files

We may have qcow2 files around from previous deployments so make sure
they are not copied to the newly created VM.

Change-Id: I35a8d72355ffff4678b611e09aedc8667f29a7f1
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: AIO: Disable tempest on AIO 31/45031/2
Markos Chandras [Fri, 13 Oct 2017 12:58:39 +0000 (13:58 +0100)]
xci: AIO: Disable tempest on AIO

In a similar fashion to the rest of the flavors, we disable the
tempest tests.

Change-Id: Id4a9912d87d1dabe3e433456f4b145d319e174d5
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoCreate the basic structure for generic scenarios 95/44895/2
Fatih Degirmenci [Thu, 12 Oct 2017 09:12:26 +0000 (11:12 +0200)]
Create the basic structure for generic scenarios

Change-Id: I158d4e61e627e47ffa89d8229280011a2b615cac
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: scripts: start-new-vm.sh: Make VM specs configurable 07/45007/1
Markos Chandras [Fri, 13 Oct 2017 10:22:39 +0000 (11:22 +0100)]
xci: scripts: start-new-vm.sh: Make VM specs configurable

We should be able to configure the VM specs so we can fit it
in smaller environments.

Change-Id: I56850df2f6842b6ef757500fecdc21bd1382b7e7
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "Create the prepare-tests playbook"
Fatih Degirmenci [Tue, 10 Oct 2017 17:36:27 +0000 (17:36 +0000)]
Merge "Create the prepare-tests playbook"

7 years agoMerge "xci: Bump bifrost SHA"
Markos Chandras [Tue, 10 Oct 2017 10:09:25 +0000 (10:09 +0000)]
Merge "xci: Bump bifrost SHA"

7 years agoMerge "xci: scripts: start-new-vm.sh: Do not run multiple package manager processes"
Markos Chandras [Tue, 10 Oct 2017 08:45:03 +0000 (08:45 +0000)]
Merge "xci: scripts: start-new-vm.sh: Do not run multiple package manager processes"

7 years agoMerge "xci: scripts: start-new-vm.sh: Add option to clean VM on failure"
Markos Chandras [Tue, 10 Oct 2017 08:44:57 +0000 (08:44 +0000)]
Merge "xci: scripts: start-new-vm.sh: Add option to clean VM on failure"

7 years agoMerge "xci: playbooks: configure-opnfvhost: Copy all user_*.yml files"
Markos Chandras [Tue, 10 Oct 2017 08:44:34 +0000 (08:44 +0000)]
Merge "xci: playbooks: configure-opnfvhost: Copy all user_*.yml files"

7 years agoMerge "xci: scripts: start-new-vm.sh: Do not destroy user's configuration file"
Markos Chandras [Tue, 10 Oct 2017 08:44:29 +0000 (08:44 +0000)]
Merge "xci: scripts: start-new-vm.sh: Do not destroy user's configuration file"

7 years agoCreate the prepare-tests playbook 35/43635/9
Manuel Buil [Fri, 29 Sep 2017 14:10:17 +0000 (16:10 +0200)]
Create the prepare-tests playbook

This playbook should be executed in case we want to use the osa deployment
as platform for testing a scenario. The playbook currently includes a call
to the prepare-functest role which installs and sets-up everything to run
functest based tests

Change-Id: Ibb59825e64c5889f36fd3bfb38a4d23b67b11866
Signed-off-by: Manuel Buil <mbuil@suse.com>
7 years agoxci: scripts: start-new-vm.sh: Do not run multiple package manager processes 57/44557/2
Markos Chandras [Mon, 9 Oct 2017 10:18:41 +0000 (11:18 +0100)]
xci: scripts: start-new-vm.sh: Do not run multiple package manager processes

Package managers get upset if multiple instances run in parallel since
the last one will fail to aquire some sort of DB locking and fail. As
such, lets fix that and only run one package manager process at any
time.

Change-Id: I4ab13f61eee861ef70cb4115403d0e239ec14308
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: start-new-vm.sh: Add option to clean VM on failure 41/44541/2
Markos Chandras [Thu, 5 Oct 2017 16:28:35 +0000 (17:28 +0100)]
xci: scripts: start-new-vm.sh: Add option to clean VM on failure

Sometimes we may want to remove the clean VM in case of failure. This
is mostly true for CI tests because developers do not normally have access
to the deployed VMs to debug problems since they can easily recreate the
same environment using this script. If they ever want direct access to
the slaves then that option can easily be turned off and retrigger the
job. In the meantime, this patch allows slaves to free resources when a
job fails instead of keeping the broken tests around.

Change-Id: I07d56661e45fc64e1ec0db7a359522e4ebd2891a
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: start-new-vm.sh: Do not destroy user's configuration file 47/44447/5
Markos Chandras [Fri, 6 Oct 2017 09:29:28 +0000 (10:29 +0100)]
xci: scripts: start-new-vm.sh: Do not destroy user's configuration file

As we move towards making this script useful for developers, we
shouldn't destroy the existing ssh configuration file but rather
create a new one just for XCI. This also move the destruction of
previous instances sooner, even before building the OS image so we
can free resources as soon as possible. Finally, this also uses the
hostname to ssh to the new VM instead of its IP to ensure that
everything is setup up properly on the physical host.

Change-Id: I185befd8943fdb8ebcdb635aefb4d4b03473258b
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "Made minor edits througout the document"
Fatih Degirmenci [Fri, 6 Oct 2017 19:29:07 +0000 (19:29 +0000)]
Merge "Made minor edits througout the document"

7 years agoMade minor edits througout the document 05/44405/2
rpaik [Fri, 6 Oct 2017 05:32:26 +0000 (22:32 -0700)]
Made minor edits througout the document

Change-Id: I35aefb46661a89615b207398341705dd483b6797
Signed-off-by: rpaik <rpaik@linuxfoundation.org>
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: playbooks: configure-opnfvhost: Copy all user_*.yml files 51/44451/1
Markos Chandras [Fri, 6 Oct 2017 09:44:16 +0000 (10:44 +0100)]
xci: playbooks: configure-opnfvhost: Copy all user_*.yml files

OpenStack-Ansible can make use of all the user_*.yml files so scenarios
can make use of this facility to override the default ones we provide
for every flavor. As such, lets copy all the user_*.yml files to the
deployment host.

Change-Id: I5ddce48677f66a3ff3ec127f0fc0163f9f45b200
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agobifrost: bifrost-provision.sh: Always initialize XCI_ANSIBLE_VERBOSITY 41/44441/1
Markos Chandras [Fri, 6 Oct 2017 09:06:00 +0000 (10:06 +0100)]
bifrost: bifrost-provision.sh: Always initialize XCI_ANSIBLE_VERBOSITY

The XCI_ANSIBLE_VERBOSITY is normally exported by the XCI bootstrapping
process. However, sometimes it's necessary to run bifrost-provision.sh
by itself so we can debug machine provisioning. As a result of which,
we need to initialize this variable properly so we don't fail with
'unbound variable' errors.

Change-Id: I81c59cf8eb3369c001e952c2c0a2846ed8d95cdf
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: Bump bifrost SHA 21/44021/7
Markos Chandras [Tue, 3 Oct 2017 07:35:47 +0000 (08:35 +0100)]
xci: Bump bifrost SHA

The latest bifrost code contains a fix when setting up DNS from a glean
configuration drive and also a few virtualenv improvements. This allows
us to get rid of all the workarounds we had in the past to switch
Ansible versions in the middle of the XCI deployment.

Change-Id: If49e290315ec96efdc07d04ff6624439c53aee19
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoRemove the quotes from the external network name 59/44359/3
Manuel Buil [Thu, 5 Oct 2017 13:38:06 +0000 (15:38 +0200)]
Remove the quotes from the external network name

If we leave the quotes, functest will search for a neutron network with the
name "ext-net" instead of ext-net and will fail

Change-Id: I4ef62fa6ea69573f5872b864402ddb8644ce432d
Signed-off-by: Manuel Buil <mbuil@suse.com>
7 years agoxci: scripts: build-dib-os.sh: chmod and chown files using sudo 39/44339/4
Markos Chandras [Thu, 5 Oct 2017 09:01:09 +0000 (10:01 +0100)]
xci: scripts: build-dib-os.sh: chmod and chown files using sudo

Some of the files may be owned by root so we need to ensure that
everything is reset properly. Moreover, only clean the image files
for the one we are building.

Change-Id: I45b78db6715534187f19d9f513e8288fd076cb6b
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "Install docker-py when running xci as part of CI"
Markos Chandras [Thu, 5 Oct 2017 08:51:40 +0000 (08:51 +0000)]
Merge "Install docker-py when running xci as part of CI"

7 years agoMerge changes from topics 'copy-hidden-skip-verify', 'xci-cache-skip-verify'
Markos Chandras [Thu, 5 Oct 2017 08:18:12 +0000 (08:18 +0000)]
Merge changes from topics 'copy-hidden-skip-verify', 'xci-cache-skip-verify'

* changes:
  xci: scripts: start-new-vm.sh: Copy hidden files and directories
  xci: scripts: vm: Add ability to use cached images for clean VM

7 years agoInstall docker-py when running xci as part of CI 01/44101/7
Manuel Buil [Tue, 3 Oct 2017 15:18:48 +0000 (17:18 +0200)]
Install docker-py when running xci as part of CI

docker-py package is required by the docker_container module in ansible:

http://docs.ansible.com/ansible/latest/docker_container_module.html#docker-container

Change-Id: Ib051ae09c84cfa973ef814852e78626499471d0f
Signed-off-by: Manuel Buil <mbuil@suse.com>
7 years agoxci: file: ansible-role-requirements.yml: Bump SHA for lxc_hosts 19/44219/1
Markos Chandras [Wed, 4 Oct 2017 14:24:47 +0000 (15:24 +0100)]
xci: file: ansible-role-requirements.yml: Bump SHA for lxc_hosts

Bump the SHA for lxc_hosts so we can start using lxc-2.X.X on SUSE
hosts.

Change-Id: Ia4830996a66b5694a9d22f8cd067ca12163939a3
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoFix the figure size in user guide 15/44215/2
Fatih Degirmenci [Wed, 4 Oct 2017 12:20:34 +0000 (14:20 +0200)]
Fix the figure size in user guide

Change-Id: I550860f574765a3035e9025e254f6d7ba110e0e4
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: scripts: start-new-vm.sh: Copy hidden files and directories 97/44197/1
Markos Chandras [Wed, 4 Oct 2017 08:51:14 +0000 (09:51 +0100)]
xci: scripts: start-new-vm.sh: Copy hidden files and directories

Fix the rsync command to also copy the hidden files and directories.
Copying the .git directory allows us to quickly inspect any file
changes when investigating bug reports and other problems.

Change-Id: I4e6feeea77d5c3b23362a216206c5970b4900169
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: vm: Add ability to use cached images for clean VM 49/44049/5
Markos Chandras [Tue, 3 Oct 2017 09:25:28 +0000 (10:25 +0100)]
xci: scripts: vm: Add ability to use cached images for clean VM

Make it possible to use the hosted dib images from artifacts.opnfv.org
instead of building a new one on every CI run. This way, we can reduce
the time it takes to start the actual XCI deployment.

Change-Id: Idb1f5e3929cc14502c3f7383a61d2fbd0a6eefaf
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: start-new-vm.sh: Set JENKINS_HOME on local runs 19/44119/1
Markos Chandras [Tue, 3 Oct 2017 15:51:53 +0000 (16:51 +0100)]
xci: scripts: start-new-vm.sh: Set JENKINS_HOME on local runs

If we are creating a new virtual machine for local testing, then we
should set JENKINS_HOME since some playbooks use this variable to
determine if the deployment happens on a CI or not. That script aims
to simulate a CI deployment so it should have this variable set.

Change-Id: I1165c8b2cd467ba92fcf6f6c178a69b07834894e
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: xci-deploy.sh: Extend regexp when collecting env variables 71/44071/1
Markos Chandras [Tue, 3 Oct 2017 12:26:36 +0000 (13:26 +0100)]
xci: xci-deploy.sh: Extend regexp when collecting env variables

Not all variables start with XCI, OPNFV or OPENSTACK so extend the
regexp to look for more variables.

Change-Id: If3693d65eec697f6c81c608da3be5799333c28d7
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: start-new-vm.sh: Do not break on idle SSH connections 67/44067/2
Markos Chandras [Tue, 3 Oct 2017 12:21:03 +0000 (13:21 +0100)]
xci: scripts: start-new-vm.sh: Do not break on idle SSH connections

Add ServerAliveInterval and ServerAliveCountMax directives in order
to try and keep SSH connections alive. This aims to solve ssh timeouts
like the following one on busy hypervisors:

packet_write_wait: Connection to UNKNOWN port 0: Broken pipe

Change-Id: I58029b41226098d6a44181434ad8653f72384e9d
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "xci: xci-deploy: Add simple error handler"
Markos Chandras [Tue, 3 Oct 2017 12:12:44 +0000 (12:12 +0000)]
Merge "xci: xci-deploy: Add simple error handler"

7 years agoxci: xci-deploy: Add simple error handler 51/43951/2
Markos Chandras [Mon, 2 Oct 2017 20:25:01 +0000 (21:25 +0100)]
xci: xci-deploy: Add simple error handler

Add a simple function to collect useful information when submitting
bug reports.

Change-Id: If24b76d2742edffa2269d39dcc998675d1388214
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "xci: scripts: start-new-vm.sh: Use Docker to build OS images"
Markos Chandras [Mon, 2 Oct 2017 21:47:00 +0000 (21:47 +0000)]
Merge "xci: scripts: start-new-vm.sh: Use Docker to build OS images"

7 years agoMerge "docs: Fix env var OPNFV_RELENG_DEV_PATH"
Markos Chandras [Mon, 2 Oct 2017 21:35:30 +0000 (21:35 +0000)]
Merge "docs: Fix env var OPNFV_RELENG_DEV_PATH"

7 years agoMerge "Add the name for CentOS NFS server package"
Markos Chandras [Mon, 2 Oct 2017 21:35:08 +0000 (21:35 +0000)]
Merge "Add the name for CentOS NFS server package"

7 years agoMerge "xci: xci-deploy.sh: Fix variable names for bifrost and OSA"
Markos Chandras [Mon, 2 Oct 2017 19:51:35 +0000 (19:51 +0000)]
Merge "xci: xci-deploy.sh: Fix variable names for bifrost and OSA"

7 years agodocs: Fix env var OPNFV_RELENG_DEV_PATH 47/43947/1
Fatih Degirmenci [Mon, 2 Oct 2017 19:26:33 +0000 (21:26 +0200)]
docs: Fix env var OPNFV_RELENG_DEV_PATH

Change-Id: I95fd4efe4d1a47ce682489ffd7c2ce588a1764e5
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: scripts: start-new-vm.sh: Use Docker to build OS images 31/43831/6
Markos Chandras [Thu, 28 Sep 2017 15:03:01 +0000 (16:03 +0100)]
xci: scripts: start-new-vm.sh: Use Docker to build OS images

Use a docker container to build the OS images so we can build images and
start new virtual machines on all supported operating systems. This way
all developers can now launch a virtual machine to quickly reproduce
Jenkins results which should assist with debugging problems.

Since the container runs with elevated privileges it's best to ensure
that we have exclusive access to devices. Finally, we remove the
build-dib-os.sh script which is now part of the container itself.

The build image process now becomes more stable since it runs on clean
evnironment all the time so the only external factor is the upstream
distribution repositories.

Change-Id: I6b443192419ee2546a23430f421b152766d16333
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: xci-deploy.sh: Fix variable names for bifrost and OSA 09/43909/1
Markos Chandras [Mon, 2 Oct 2017 15:14:16 +0000 (16:14 +0100)]
xci: xci-deploy.sh: Fix variable names for bifrost and OSA

The correct variable name is OPENSTACK_{BIFROST,OSA}_DEV_PATH instead of
OPNFV_{BIFROST,OSA}_DEV_PATH.

JIRA: RELENG-312

Change-Id: I6c1349434d2ff8f82e1bccd1a758467c3ee0a61f
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "Install python-openstackclient by default"
Markos Chandras [Mon, 2 Oct 2017 14:34:31 +0000 (14:34 +0000)]
Merge "Install python-openstackclient by default"

7 years agoMerge "xci: install-ansible.sh: Fix distribution detection"
Markos Chandras [Mon, 2 Oct 2017 13:03:48 +0000 (13:03 +0000)]
Merge "xci: install-ansible.sh: Fix distribution detection"

7 years agoMerge "xci: scripts: start-new-vm.sh: Fix default test case"
Markos Chandras [Mon, 2 Oct 2017 13:03:40 +0000 (13:03 +0000)]
Merge "xci: scripts: start-new-vm.sh: Fix default test case"

7 years agoAdd the name for CentOS NFS server package 53/43853/1
Tapio Tallgren [Mon, 2 Oct 2017 11:30:27 +0000 (14:30 +0300)]
Add the name for CentOS NFS server package

Change-Id: I5a8ff4c358ab9f1d548c9cc834faa2465ec63d41
Signed-off-by: Tapio Tallgren <tapio.tallgren@nokia.com>
7 years agoInstall python-openstackclient by default 65/43665/4
Fatih Degirmenci [Fri, 29 Sep 2017 23:40:04 +0000 (01:40 +0200)]
Install python-openstackclient by default

It is important to have the client installed for the ease of the
users so they can use the client for trying out their new deployment.

Change-Id: I091c1e23ff320cb9fcdb2743998483a6bc1fcdad
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: scripts: start-new-vm.sh: Fix default test case 19/43819/1
Markos Chandras [Mon, 2 Oct 2017 08:09:18 +0000 (09:09 +0100)]
xci: scripts: start-new-vm.sh: Fix default test case

Export XCI_FLAVOR to mini to minic the CI. Moreover, fix the
script to not use relative paths.

Change-Id: I16947c596b8bbff20371b6d345dffd215f76aecc
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "Update .gitignore for documentation"
Fatih Degirmenci [Mon, 2 Oct 2017 07:27:13 +0000 (07:27 +0000)]
Merge "Update .gitignore for documentation"

7 years agoMerge "Add documentation for user guide and sandbox"
Markos Chandras [Mon, 2 Oct 2017 06:56:53 +0000 (06:56 +0000)]
Merge "Add documentation for user guide and sandbox"

7 years agoxci: install-ansible.sh: Fix distribution detection 09/43809/2
Markos Chandras [Mon, 2 Oct 2017 06:39:26 +0000 (07:39 +0100)]
xci: install-ansible.sh: Fix distribution detection

Relying on the installed package manager to detect the distribution
is not reliable since it's possible to install multiple package managers
at the same time. As such, lets simply use the information in the
os-release files.

Change-Id: Ic170d2aee1398d5c82403c3469365822bf053de7
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: file: ansible-role-requirements: Bump SHA for rabbitmq-server 97/43797/1
Markos Chandras [Sun, 1 Oct 2017 19:47:39 +0000 (20:47 +0100)]
xci: file: ansible-role-requirements: Bump SHA for rabbitmq-server

The rabbitmq-server contains some fixes for SUSE so lets just bump this
role instead of switching the entire OSA pin SHA so close to the Euphrates
release.

Change-Id: Ic034ed4bd9e290cadc5336d781b0e24036d5cd46
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoAdd documentation for user guide and sandbox 75/43675/3
Fatih Degirmenci [Sat, 30 Sep 2017 00:27:08 +0000 (02:27 +0200)]
Add documentation for user guide and sandbox

This change adds the user guide and sandbox information.
The documentation is created by using the information we
have on Wiki and README.rst.

Wiki pages and README.rst will be removed once all the
documentation is moved to docs.opnfv.org.

Parts of the README.rst such as more advanced ways to use
the sandbox will be placed in developer guide and it is
accessible by a link placed in user guide.

Change-Id: I7214a53d7ab39125d2164c5b3468b1ba18933b31
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoUpdate .gitignore for documentation 61/43661/1
Fatih Degirmenci [Fri, 29 Sep 2017 20:57:09 +0000 (22:57 +0200)]
Update .gitignore for documentation

Change-Id: I39a8b8a874345f90cd60f34ca10422b20f66e32b
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoMerge "Check if /etc/ssl/certs exists before creating it"
Markos Chandras [Fri, 29 Sep 2017 14:23:30 +0000 (14:23 +0000)]
Merge "Check if /etc/ssl/certs exists before creating it"

7 years agoCreate the structure for the documentation 33/40533/2
Fatih Degirmenci [Mon, 28 Aug 2017 23:34:29 +0000 (01:34 +0200)]
Create the structure for the documentation

This change puts the initial structure for the documentation.

Change-Id: I4ff075874815bfcd1834049ae205a02b72bae75f
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoCheck if /etc/ssl/certs exists before creating it 81/42481/5
Tapio Tallgren [Wed, 20 Sep 2017 07:19:12 +0000 (10:19 +0300)]
Check if /etc/ssl/certs exists before creating it

In CentOS and Suse, /etc/ssl/certs is a symbolic link to
/etc/ssl/pki/tls/certs.  The Ansible module "file" will fail if it is asked to
create a directory which is already a symbolic link.

This patch will check if /etc/ssl/certs exists before trying to create it.

The same check is done both on the host and the opnfv guest VM.

Also, /etc/certs is only writable by root, so we need a "become: true" clause
to be able to modify it in localhost (but not in opnvf VM).

Change-Id: Iab6c3c162548f84ad6082829e4a7c2ab63d2cfa0
Signed-off-by: Tapio Tallgren <tapio.tallgren@nokia.com>
7 years agoMerge changes from topic 'fix-vm-on-jenkins'
Markos Chandras [Fri, 29 Sep 2017 08:27:21 +0000 (08:27 +0000)]
Merge changes from topic 'fix-vm-on-jenkins'

* changes:
  xci: xci-deploy.sh: Apply workaround for checking db cluster on SUSE
  xci: playbooks: synchronize-time: Fix service name for openSUSE
  xci: configure-opnfvhost: Do not run 'remove-folders'
  xci: scripts: build-dib-os.sh: Pin diskimage-builder
  xci: configure-opnfvhost: Do not check /etc/ssl/certs on SUSE

7 years agoxci: xci-deploy.sh: Apply workaround for checking db cluster on SUSE 63/43463/1
Markos Chandras [Thu, 28 Sep 2017 13:22:34 +0000 (14:22 +0100)]
xci: xci-deploy.sh: Apply workaround for checking db cluster on SUSE

The mysql socket path is wrong on SUSE which leads to problems when
trying to verify the status of the db cluster. Apply workaround until
it's fixed upstream

controller00_galera_container-56c89184 | FAILED | rc=1 >>
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2 "No such file or directory")

Change-Id: I23192f4079526ae7820a1db023a097a651a09140
Link: https://review.openstack.org/508154
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: playbooks: synchronize-time: Fix service name for openSUSE 23/43423/1
Markos Chandras [Thu, 28 Sep 2017 08:31:54 +0000 (09:31 +0100)]
xci: playbooks: synchronize-time: Fix service name for openSUSE

In openSUSE, the chrony service is 'chronyd'.

Change-Id: Ifb946b0ba49783108a84dd5b998d9d45f5c9df51
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoEnsure the pinned versions of components match to the pinned OSA 65/42165/3
Fatih Degirmenci [Sun, 17 Sep 2017 21:45:44 +0000 (23:45 +0200)]
Ensure the pinned versions of components match to the pinned OSA

The versions for the OpenStack services and global requirements
need to be pinned alongside with the OSA SHA1 and the role versions
to ensure we pinned everything.

This change is required for osa-periodic jobs as well since that
job will use sources-branch-updater.sh script and the script updates
these files to ensure things are pinned correctly.

    modified:   ansible-role-requirements.yml
    modified:   global-requirement-pins.txt
    modified:   playbooks/defaults/repo_packages/openstack_services.yml
    modified:   releasenotes/notes/glance-init-config-overrides-d1c8c3dcc50c109a.yaml
    modified:   releasenotes/notes/neutron-init-config-overrides-9d1d2b3b908705ed.yaml
    modified:   releasenotes/notes/trove-init-config-overrides-a78ed428a32adef8.yaml

By doing this change, we do not need to have any
magic to capture updates to those files. Just updating the files
we keep in xci/file folder will be sufficient and they get copied
over during the playbook execution.

Change-Id: Iae0db22574a0368e896132469a8587d1457ce177
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: configure-opnfvhost: Do not run 'remove-folders' 09/43409/1
Markos Chandras [Tue, 26 Sep 2017 08:08:08 +0000 (09:08 +0100)]
xci: configure-opnfvhost: Do not run 'remove-folders'

The OPNFV node is brand new and it doesn't have any traces
of XCI directories so there is no point in running the
'remove-folders' role.

Change-Id: Ic9b9203cc14abda2dab406de6a5feeef6a1b7e2a
Signed-off-by: Markos Chandras <mchandras@suse.de>