releng-xci.git
7 years agoMerge "Create the basic structure for generic scenarios"
Fatih Degirmenci [Thu, 19 Oct 2017 16:13:19 +0000 (16:13 +0000)]
Merge "Create the basic structure for generic scenarios"

7 years agoxci: scripts: start-new-vm.sh: Remove empty line 61/45361/1
Markos Chandras [Tue, 17 Oct 2017 16:05:53 +0000 (17:05 +0100)]
xci: scripts: start-new-vm.sh: Remove empty line

The empty line is wrong and it may cause some issues so drop it.

Change-Id: I4120e00df1dd9b7061dc1175e0ea6db8e0a9df88
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agodocs: Add XCI overview document 55/43955/7
Fatih Degirmenci [Mon, 2 Oct 2017 21:10:51 +0000 (23:10 +0200)]
docs: Add XCI overview document

Change-Id: I23405aec19a7e9bfce1c58d770b80b1c9c550d00
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoMerge "xci: AIO: Disable tempest on AIO"
Markos Chandras [Tue, 17 Oct 2017 07:41:44 +0000 (07:41 +0000)]
Merge "xci: AIO: Disable tempest on AIO"

7 years agoMerge "xci: scripts: start-new-vm.sh: Make VM specs configurable"
Aric Gardner [Mon, 16 Oct 2017 20:04:04 +0000 (20:04 +0000)]
Merge "xci: scripts: start-new-vm.sh: Make VM specs configurable"

7 years agoxci: scripts: start-new-vm.sh: Skip all qcow2 files 21/45221/2
Markos Chandras [Mon, 16 Oct 2017 13:18:02 +0000 (14:18 +0100)]
xci: scripts: start-new-vm.sh: Skip all qcow2 files

We may have qcow2 files around from previous deployments so make sure
they are not copied to the newly created VM.

Change-Id: I35a8d72355ffff4678b611e09aedc8667f29a7f1
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: AIO: Disable tempest on AIO 31/45031/2
Markos Chandras [Fri, 13 Oct 2017 12:58:39 +0000 (13:58 +0100)]
xci: AIO: Disable tempest on AIO

In a similar fashion to the rest of the flavors, we disable the
tempest tests.

Change-Id: Id4a9912d87d1dabe3e433456f4b145d319e174d5
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoCreate the basic structure for generic scenarios 95/44895/2
Fatih Degirmenci [Thu, 12 Oct 2017 09:12:26 +0000 (11:12 +0200)]
Create the basic structure for generic scenarios

Change-Id: I158d4e61e627e47ffa89d8229280011a2b615cac
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: scripts: start-new-vm.sh: Make VM specs configurable 07/45007/1
Markos Chandras [Fri, 13 Oct 2017 10:22:39 +0000 (11:22 +0100)]
xci: scripts: start-new-vm.sh: Make VM specs configurable

We should be able to configure the VM specs so we can fit it
in smaller environments.

Change-Id: I56850df2f6842b6ef757500fecdc21bd1382b7e7
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "Create the prepare-tests playbook"
Fatih Degirmenci [Tue, 10 Oct 2017 17:36:27 +0000 (17:36 +0000)]
Merge "Create the prepare-tests playbook"

7 years agoMerge "xci: Bump bifrost SHA"
Markos Chandras [Tue, 10 Oct 2017 10:09:25 +0000 (10:09 +0000)]
Merge "xci: Bump bifrost SHA"

7 years agoMerge "xci: scripts: start-new-vm.sh: Do not run multiple package manager processes"
Markos Chandras [Tue, 10 Oct 2017 08:45:03 +0000 (08:45 +0000)]
Merge "xci: scripts: start-new-vm.sh: Do not run multiple package manager processes"

7 years agoMerge "xci: scripts: start-new-vm.sh: Add option to clean VM on failure"
Markos Chandras [Tue, 10 Oct 2017 08:44:57 +0000 (08:44 +0000)]
Merge "xci: scripts: start-new-vm.sh: Add option to clean VM on failure"

7 years agoMerge "xci: playbooks: configure-opnfvhost: Copy all user_*.yml files"
Markos Chandras [Tue, 10 Oct 2017 08:44:34 +0000 (08:44 +0000)]
Merge "xci: playbooks: configure-opnfvhost: Copy all user_*.yml files"

7 years agoMerge "xci: scripts: start-new-vm.sh: Do not destroy user's configuration file"
Markos Chandras [Tue, 10 Oct 2017 08:44:29 +0000 (08:44 +0000)]
Merge "xci: scripts: start-new-vm.sh: Do not destroy user's configuration file"

7 years agoCreate the prepare-tests playbook 35/43635/9
Manuel Buil [Fri, 29 Sep 2017 14:10:17 +0000 (16:10 +0200)]
Create the prepare-tests playbook

This playbook should be executed in case we want to use the osa deployment
as platform for testing a scenario. The playbook currently includes a call
to the prepare-functest role which installs and sets-up everything to run
functest based tests

Change-Id: Ibb59825e64c5889f36fd3bfb38a4d23b67b11866
Signed-off-by: Manuel Buil <mbuil@suse.com>
7 years agoxci: scripts: start-new-vm.sh: Do not run multiple package manager processes 57/44557/2
Markos Chandras [Mon, 9 Oct 2017 10:18:41 +0000 (11:18 +0100)]
xci: scripts: start-new-vm.sh: Do not run multiple package manager processes

Package managers get upset if multiple instances run in parallel since
the last one will fail to aquire some sort of DB locking and fail. As
such, lets fix that and only run one package manager process at any
time.

Change-Id: I4ab13f61eee861ef70cb4115403d0e239ec14308
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: start-new-vm.sh: Add option to clean VM on failure 41/44541/2
Markos Chandras [Thu, 5 Oct 2017 16:28:35 +0000 (17:28 +0100)]
xci: scripts: start-new-vm.sh: Add option to clean VM on failure

Sometimes we may want to remove the clean VM in case of failure. This
is mostly true for CI tests because developers do not normally have access
to the deployed VMs to debug problems since they can easily recreate the
same environment using this script. If they ever want direct access to
the slaves then that option can easily be turned off and retrigger the
job. In the meantime, this patch allows slaves to free resources when a
job fails instead of keeping the broken tests around.

Change-Id: I07d56661e45fc64e1ec0db7a359522e4ebd2891a
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: start-new-vm.sh: Do not destroy user's configuration file 47/44447/5
Markos Chandras [Fri, 6 Oct 2017 09:29:28 +0000 (10:29 +0100)]
xci: scripts: start-new-vm.sh: Do not destroy user's configuration file

As we move towards making this script useful for developers, we
shouldn't destroy the existing ssh configuration file but rather
create a new one just for XCI. This also move the destruction of
previous instances sooner, even before building the OS image so we
can free resources as soon as possible. Finally, this also uses the
hostname to ssh to the new VM instead of its IP to ensure that
everything is setup up properly on the physical host.

Change-Id: I185befd8943fdb8ebcdb635aefb4d4b03473258b
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "Made minor edits througout the document"
Fatih Degirmenci [Fri, 6 Oct 2017 19:29:07 +0000 (19:29 +0000)]
Merge "Made minor edits througout the document"

7 years agoMade minor edits througout the document 05/44405/2
rpaik [Fri, 6 Oct 2017 05:32:26 +0000 (22:32 -0700)]
Made minor edits througout the document

Change-Id: I35aefb46661a89615b207398341705dd483b6797
Signed-off-by: rpaik <rpaik@linuxfoundation.org>
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: playbooks: configure-opnfvhost: Copy all user_*.yml files 51/44451/1
Markos Chandras [Fri, 6 Oct 2017 09:44:16 +0000 (10:44 +0100)]
xci: playbooks: configure-opnfvhost: Copy all user_*.yml files

OpenStack-Ansible can make use of all the user_*.yml files so scenarios
can make use of this facility to override the default ones we provide
for every flavor. As such, lets copy all the user_*.yml files to the
deployment host.

Change-Id: I5ddce48677f66a3ff3ec127f0fc0163f9f45b200
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agobifrost: bifrost-provision.sh: Always initialize XCI_ANSIBLE_VERBOSITY 41/44441/1
Markos Chandras [Fri, 6 Oct 2017 09:06:00 +0000 (10:06 +0100)]
bifrost: bifrost-provision.sh: Always initialize XCI_ANSIBLE_VERBOSITY

The XCI_ANSIBLE_VERBOSITY is normally exported by the XCI bootstrapping
process. However, sometimes it's necessary to run bifrost-provision.sh
by itself so we can debug machine provisioning. As a result of which,
we need to initialize this variable properly so we don't fail with
'unbound variable' errors.

Change-Id: I81c59cf8eb3369c001e952c2c0a2846ed8d95cdf
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: Bump bifrost SHA 21/44021/7
Markos Chandras [Tue, 3 Oct 2017 07:35:47 +0000 (08:35 +0100)]
xci: Bump bifrost SHA

The latest bifrost code contains a fix when setting up DNS from a glean
configuration drive and also a few virtualenv improvements. This allows
us to get rid of all the workarounds we had in the past to switch
Ansible versions in the middle of the XCI deployment.

Change-Id: If49e290315ec96efdc07d04ff6624439c53aee19
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoRemove the quotes from the external network name 59/44359/3
Manuel Buil [Thu, 5 Oct 2017 13:38:06 +0000 (15:38 +0200)]
Remove the quotes from the external network name

If we leave the quotes, functest will search for a neutron network with the
name "ext-net" instead of ext-net and will fail

Change-Id: I4ef62fa6ea69573f5872b864402ddb8644ce432d
Signed-off-by: Manuel Buil <mbuil@suse.com>
7 years agoxci: scripts: build-dib-os.sh: chmod and chown files using sudo 39/44339/4
Markos Chandras [Thu, 5 Oct 2017 09:01:09 +0000 (10:01 +0100)]
xci: scripts: build-dib-os.sh: chmod and chown files using sudo

Some of the files may be owned by root so we need to ensure that
everything is reset properly. Moreover, only clean the image files
for the one we are building.

Change-Id: I45b78db6715534187f19d9f513e8288fd076cb6b
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "Install docker-py when running xci as part of CI"
Markos Chandras [Thu, 5 Oct 2017 08:51:40 +0000 (08:51 +0000)]
Merge "Install docker-py when running xci as part of CI"

7 years agoMerge changes from topics 'copy-hidden-skip-verify', 'xci-cache-skip-verify'
Markos Chandras [Thu, 5 Oct 2017 08:18:12 +0000 (08:18 +0000)]
Merge changes from topics 'copy-hidden-skip-verify', 'xci-cache-skip-verify'

* changes:
  xci: scripts: start-new-vm.sh: Copy hidden files and directories
  xci: scripts: vm: Add ability to use cached images for clean VM

7 years agoInstall docker-py when running xci as part of CI 01/44101/7
Manuel Buil [Tue, 3 Oct 2017 15:18:48 +0000 (17:18 +0200)]
Install docker-py when running xci as part of CI

docker-py package is required by the docker_container module in ansible:

http://docs.ansible.com/ansible/latest/docker_container_module.html#docker-container

Change-Id: Ib051ae09c84cfa973ef814852e78626499471d0f
Signed-off-by: Manuel Buil <mbuil@suse.com>
7 years agoxci: file: ansible-role-requirements.yml: Bump SHA for lxc_hosts 19/44219/1
Markos Chandras [Wed, 4 Oct 2017 14:24:47 +0000 (15:24 +0100)]
xci: file: ansible-role-requirements.yml: Bump SHA for lxc_hosts

Bump the SHA for lxc_hosts so we can start using lxc-2.X.X on SUSE
hosts.

Change-Id: Ia4830996a66b5694a9d22f8cd067ca12163939a3
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoFix the figure size in user guide 15/44215/2
Fatih Degirmenci [Wed, 4 Oct 2017 12:20:34 +0000 (14:20 +0200)]
Fix the figure size in user guide

Change-Id: I550860f574765a3035e9025e254f6d7ba110e0e4
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: scripts: start-new-vm.sh: Copy hidden files and directories 97/44197/1
Markos Chandras [Wed, 4 Oct 2017 08:51:14 +0000 (09:51 +0100)]
xci: scripts: start-new-vm.sh: Copy hidden files and directories

Fix the rsync command to also copy the hidden files and directories.
Copying the .git directory allows us to quickly inspect any file
changes when investigating bug reports and other problems.

Change-Id: I4e6feeea77d5c3b23362a216206c5970b4900169
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: vm: Add ability to use cached images for clean VM 49/44049/5
Markos Chandras [Tue, 3 Oct 2017 09:25:28 +0000 (10:25 +0100)]
xci: scripts: vm: Add ability to use cached images for clean VM

Make it possible to use the hosted dib images from artifacts.opnfv.org
instead of building a new one on every CI run. This way, we can reduce
the time it takes to start the actual XCI deployment.

Change-Id: Idb1f5e3929cc14502c3f7383a61d2fbd0a6eefaf
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: start-new-vm.sh: Set JENKINS_HOME on local runs 19/44119/1
Markos Chandras [Tue, 3 Oct 2017 15:51:53 +0000 (16:51 +0100)]
xci: scripts: start-new-vm.sh: Set JENKINS_HOME on local runs

If we are creating a new virtual machine for local testing, then we
should set JENKINS_HOME since some playbooks use this variable to
determine if the deployment happens on a CI or not. That script aims
to simulate a CI deployment so it should have this variable set.

Change-Id: I1165c8b2cd467ba92fcf6f6c178a69b07834894e
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: xci-deploy.sh: Extend regexp when collecting env variables 71/44071/1
Markos Chandras [Tue, 3 Oct 2017 12:26:36 +0000 (13:26 +0100)]
xci: xci-deploy.sh: Extend regexp when collecting env variables

Not all variables start with XCI, OPNFV or OPENSTACK so extend the
regexp to look for more variables.

Change-Id: If3693d65eec697f6c81c608da3be5799333c28d7
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: start-new-vm.sh: Do not break on idle SSH connections 67/44067/2
Markos Chandras [Tue, 3 Oct 2017 12:21:03 +0000 (13:21 +0100)]
xci: scripts: start-new-vm.sh: Do not break on idle SSH connections

Add ServerAliveInterval and ServerAliveCountMax directives in order
to try and keep SSH connections alive. This aims to solve ssh timeouts
like the following one on busy hypervisors:

packet_write_wait: Connection to UNKNOWN port 0: Broken pipe

Change-Id: I58029b41226098d6a44181434ad8653f72384e9d
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "xci: xci-deploy: Add simple error handler"
Markos Chandras [Tue, 3 Oct 2017 12:12:44 +0000 (12:12 +0000)]
Merge "xci: xci-deploy: Add simple error handler"

7 years agoxci: xci-deploy: Add simple error handler 51/43951/2
Markos Chandras [Mon, 2 Oct 2017 20:25:01 +0000 (21:25 +0100)]
xci: xci-deploy: Add simple error handler

Add a simple function to collect useful information when submitting
bug reports.

Change-Id: If24b76d2742edffa2269d39dcc998675d1388214
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "xci: scripts: start-new-vm.sh: Use Docker to build OS images"
Markos Chandras [Mon, 2 Oct 2017 21:47:00 +0000 (21:47 +0000)]
Merge "xci: scripts: start-new-vm.sh: Use Docker to build OS images"

7 years agoMerge "docs: Fix env var OPNFV_RELENG_DEV_PATH"
Markos Chandras [Mon, 2 Oct 2017 21:35:30 +0000 (21:35 +0000)]
Merge "docs: Fix env var OPNFV_RELENG_DEV_PATH"

7 years agoMerge "Add the name for CentOS NFS server package"
Markos Chandras [Mon, 2 Oct 2017 21:35:08 +0000 (21:35 +0000)]
Merge "Add the name for CentOS NFS server package"

7 years agoMerge "xci: xci-deploy.sh: Fix variable names for bifrost and OSA"
Markos Chandras [Mon, 2 Oct 2017 19:51:35 +0000 (19:51 +0000)]
Merge "xci: xci-deploy.sh: Fix variable names for bifrost and OSA"

7 years agodocs: Fix env var OPNFV_RELENG_DEV_PATH 47/43947/1
Fatih Degirmenci [Mon, 2 Oct 2017 19:26:33 +0000 (21:26 +0200)]
docs: Fix env var OPNFV_RELENG_DEV_PATH

Change-Id: I95fd4efe4d1a47ce682489ffd7c2ce588a1764e5
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: scripts: start-new-vm.sh: Use Docker to build OS images 31/43831/6
Markos Chandras [Thu, 28 Sep 2017 15:03:01 +0000 (16:03 +0100)]
xci: scripts: start-new-vm.sh: Use Docker to build OS images

Use a docker container to build the OS images so we can build images and
start new virtual machines on all supported operating systems. This way
all developers can now launch a virtual machine to quickly reproduce
Jenkins results which should assist with debugging problems.

Since the container runs with elevated privileges it's best to ensure
that we have exclusive access to devices. Finally, we remove the
build-dib-os.sh script which is now part of the container itself.

The build image process now becomes more stable since it runs on clean
evnironment all the time so the only external factor is the upstream
distribution repositories.

Change-Id: I6b443192419ee2546a23430f421b152766d16333
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: xci-deploy.sh: Fix variable names for bifrost and OSA 09/43909/1
Markos Chandras [Mon, 2 Oct 2017 15:14:16 +0000 (16:14 +0100)]
xci: xci-deploy.sh: Fix variable names for bifrost and OSA

The correct variable name is OPENSTACK_{BIFROST,OSA}_DEV_PATH instead of
OPNFV_{BIFROST,OSA}_DEV_PATH.

JIRA: RELENG-312

Change-Id: I6c1349434d2ff8f82e1bccd1a758467c3ee0a61f
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "Install python-openstackclient by default"
Markos Chandras [Mon, 2 Oct 2017 14:34:31 +0000 (14:34 +0000)]
Merge "Install python-openstackclient by default"

7 years agoMerge "xci: install-ansible.sh: Fix distribution detection"
Markos Chandras [Mon, 2 Oct 2017 13:03:48 +0000 (13:03 +0000)]
Merge "xci: install-ansible.sh: Fix distribution detection"

7 years agoMerge "xci: scripts: start-new-vm.sh: Fix default test case"
Markos Chandras [Mon, 2 Oct 2017 13:03:40 +0000 (13:03 +0000)]
Merge "xci: scripts: start-new-vm.sh: Fix default test case"

7 years agoAdd the name for CentOS NFS server package 53/43853/1
Tapio Tallgren [Mon, 2 Oct 2017 11:30:27 +0000 (14:30 +0300)]
Add the name for CentOS NFS server package

Change-Id: I5a8ff4c358ab9f1d548c9cc834faa2465ec63d41
Signed-off-by: Tapio Tallgren <tapio.tallgren@nokia.com>
7 years agoInstall python-openstackclient by default 65/43665/4
Fatih Degirmenci [Fri, 29 Sep 2017 23:40:04 +0000 (01:40 +0200)]
Install python-openstackclient by default

It is important to have the client installed for the ease of the
users so they can use the client for trying out their new deployment.

Change-Id: I091c1e23ff320cb9fcdb2743998483a6bc1fcdad
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: scripts: start-new-vm.sh: Fix default test case 19/43819/1
Markos Chandras [Mon, 2 Oct 2017 08:09:18 +0000 (09:09 +0100)]
xci: scripts: start-new-vm.sh: Fix default test case

Export XCI_FLAVOR to mini to minic the CI. Moreover, fix the
script to not use relative paths.

Change-Id: I16947c596b8bbff20371b6d345dffd215f76aecc
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "Update .gitignore for documentation"
Fatih Degirmenci [Mon, 2 Oct 2017 07:27:13 +0000 (07:27 +0000)]
Merge "Update .gitignore for documentation"

7 years agoMerge "Add documentation for user guide and sandbox"
Markos Chandras [Mon, 2 Oct 2017 06:56:53 +0000 (06:56 +0000)]
Merge "Add documentation for user guide and sandbox"

7 years agoxci: install-ansible.sh: Fix distribution detection 09/43809/2
Markos Chandras [Mon, 2 Oct 2017 06:39:26 +0000 (07:39 +0100)]
xci: install-ansible.sh: Fix distribution detection

Relying on the installed package manager to detect the distribution
is not reliable since it's possible to install multiple package managers
at the same time. As such, lets simply use the information in the
os-release files.

Change-Id: Ic170d2aee1398d5c82403c3469365822bf053de7
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: file: ansible-role-requirements: Bump SHA for rabbitmq-server 97/43797/1
Markos Chandras [Sun, 1 Oct 2017 19:47:39 +0000 (20:47 +0100)]
xci: file: ansible-role-requirements: Bump SHA for rabbitmq-server

The rabbitmq-server contains some fixes for SUSE so lets just bump this
role instead of switching the entire OSA pin SHA so close to the Euphrates
release.

Change-Id: Ic034ed4bd9e290cadc5336d781b0e24036d5cd46
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoAdd documentation for user guide and sandbox 75/43675/3
Fatih Degirmenci [Sat, 30 Sep 2017 00:27:08 +0000 (02:27 +0200)]
Add documentation for user guide and sandbox

This change adds the user guide and sandbox information.
The documentation is created by using the information we
have on Wiki and README.rst.

Wiki pages and README.rst will be removed once all the
documentation is moved to docs.opnfv.org.

Parts of the README.rst such as more advanced ways to use
the sandbox will be placed in developer guide and it is
accessible by a link placed in user guide.

Change-Id: I7214a53d7ab39125d2164c5b3468b1ba18933b31
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoUpdate .gitignore for documentation 61/43661/1
Fatih Degirmenci [Fri, 29 Sep 2017 20:57:09 +0000 (22:57 +0200)]
Update .gitignore for documentation

Change-Id: I39a8b8a874345f90cd60f34ca10422b20f66e32b
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoMerge "Check if /etc/ssl/certs exists before creating it"
Markos Chandras [Fri, 29 Sep 2017 14:23:30 +0000 (14:23 +0000)]
Merge "Check if /etc/ssl/certs exists before creating it"

7 years agoCreate the structure for the documentation 33/40533/2
Fatih Degirmenci [Mon, 28 Aug 2017 23:34:29 +0000 (01:34 +0200)]
Create the structure for the documentation

This change puts the initial structure for the documentation.

Change-Id: I4ff075874815bfcd1834049ae205a02b72bae75f
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoCheck if /etc/ssl/certs exists before creating it 81/42481/5
Tapio Tallgren [Wed, 20 Sep 2017 07:19:12 +0000 (10:19 +0300)]
Check if /etc/ssl/certs exists before creating it

In CentOS and Suse, /etc/ssl/certs is a symbolic link to
/etc/ssl/pki/tls/certs.  The Ansible module "file" will fail if it is asked to
create a directory which is already a symbolic link.

This patch will check if /etc/ssl/certs exists before trying to create it.

The same check is done both on the host and the opnfv guest VM.

Also, /etc/certs is only writable by root, so we need a "become: true" clause
to be able to modify it in localhost (but not in opnvf VM).

Change-Id: Iab6c3c162548f84ad6082829e4a7c2ab63d2cfa0
Signed-off-by: Tapio Tallgren <tapio.tallgren@nokia.com>
7 years agoMerge changes from topic 'fix-vm-on-jenkins'
Markos Chandras [Fri, 29 Sep 2017 08:27:21 +0000 (08:27 +0000)]
Merge changes from topic 'fix-vm-on-jenkins'

* changes:
  xci: xci-deploy.sh: Apply workaround for checking db cluster on SUSE
  xci: playbooks: synchronize-time: Fix service name for openSUSE
  xci: configure-opnfvhost: Do not run 'remove-folders'
  xci: scripts: build-dib-os.sh: Pin diskimage-builder
  xci: configure-opnfvhost: Do not check /etc/ssl/certs on SUSE

7 years agoxci: xci-deploy.sh: Apply workaround for checking db cluster on SUSE 63/43463/1
Markos Chandras [Thu, 28 Sep 2017 13:22:34 +0000 (14:22 +0100)]
xci: xci-deploy.sh: Apply workaround for checking db cluster on SUSE

The mysql socket path is wrong on SUSE which leads to problems when
trying to verify the status of the db cluster. Apply workaround until
it's fixed upstream

controller00_galera_container-56c89184 | FAILED | rc=1 >>
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2 "No such file or directory")

Change-Id: I23192f4079526ae7820a1db023a097a651a09140
Link: https://review.openstack.org/508154
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: playbooks: synchronize-time: Fix service name for openSUSE 23/43423/1
Markos Chandras [Thu, 28 Sep 2017 08:31:54 +0000 (09:31 +0100)]
xci: playbooks: synchronize-time: Fix service name for openSUSE

In openSUSE, the chrony service is 'chronyd'.

Change-Id: Ifb946b0ba49783108a84dd5b998d9d45f5c9df51
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoEnsure the pinned versions of components match to the pinned OSA 65/42165/3
Fatih Degirmenci [Sun, 17 Sep 2017 21:45:44 +0000 (23:45 +0200)]
Ensure the pinned versions of components match to the pinned OSA

The versions for the OpenStack services and global requirements
need to be pinned alongside with the OSA SHA1 and the role versions
to ensure we pinned everything.

This change is required for osa-periodic jobs as well since that
job will use sources-branch-updater.sh script and the script updates
these files to ensure things are pinned correctly.

    modified:   ansible-role-requirements.yml
    modified:   global-requirement-pins.txt
    modified:   playbooks/defaults/repo_packages/openstack_services.yml
    modified:   releasenotes/notes/glance-init-config-overrides-d1c8c3dcc50c109a.yaml
    modified:   releasenotes/notes/neutron-init-config-overrides-9d1d2b3b908705ed.yaml
    modified:   releasenotes/notes/trove-init-config-overrides-a78ed428a32adef8.yaml

By doing this change, we do not need to have any
magic to capture updates to those files. Just updating the files
we keep in xci/file folder will be sufficient and they get copied
over during the playbook execution.

Change-Id: Iae0db22574a0368e896132469a8587d1457ce177
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: configure-opnfvhost: Do not run 'remove-folders' 09/43409/1
Markos Chandras [Tue, 26 Sep 2017 08:08:08 +0000 (09:08 +0100)]
xci: configure-opnfvhost: Do not run 'remove-folders'

The OPNFV node is brand new and it doesn't have any traces
of XCI directories so there is no point in running the
'remove-folders' role.

Change-Id: Ic9b9203cc14abda2dab406de6a5feeef6a1b7e2a
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: build-dib-os.sh: Pin diskimage-builder 03/43403/2
Markos Chandras [Thu, 28 Sep 2017 07:15:41 +0000 (08:15 +0100)]
xci: scripts: build-dib-os.sh: Pin diskimage-builder

diskimage-builder does very frequent releases and sometimes things
break. There is no particular reason to always fetch the latest version
so lets do it in a controlled way after proper testing.

Change-Id: Ie9685a9a15fa7fefa1c5ecea49090ac9d92e63ff
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: configure-opnfvhost: Do not check /etc/ssl/certs on SUSE 97/43397/3
Markos Chandras [Thu, 28 Sep 2017 07:01:45 +0000 (08:01 +0100)]
xci: configure-opnfvhost: Do not check /etc/ssl/certs on SUSE

This is similar to Ibc188b76f47c4f7d1c5aa452a21e838420d65e6a
/etc/ssl/certs is a symlink so skip this task on SUSE.

Change-Id: Iae38640501748dc3dd802ce795acfaeefd836c97
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge changes from topic 'fix-vm-on-jenkins'
Markos Chandras [Thu, 28 Sep 2017 07:43:34 +0000 (07:43 +0000)]
Merge changes from topic 'fix-vm-on-jenkins'

* changes:
  xci: scripts: start-new-vm.sh: Fix paths for default XCI test
  xci: Replace ANSIBLE_VERBOSITY with XCI_ANSIBLE_VERBOSITY
  xci: scripts: start-new-vm.sh: Print dib output when running on CI
  xci: scripts: start-new-vm.sh: Use 'unsafe' cache for the clean vm disk
  xci: xci-deploy.sh: Make sure all local Ansible installations are gone
  xci: scripts: start-new-vm.sh: Do not allow multiple build-dib-os processes

7 years agoxci: scripts: start-new-vm.sh: Fix paths for default XCI test 17/43317/8
Markos Chandras [Wed, 27 Sep 2017 14:56:25 +0000 (15:56 +0100)]
xci: scripts: start-new-vm.sh: Fix paths for default XCI test

The XCI test is located in ~/releng-xci inside the new VM so we need
to look there for an existing one or for executing it after the default
one has been created and copied to the remote host.

Change-Id: Ieb195293da7832bcb5d29c8a28cc3477205f2e5e
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: Replace ANSIBLE_VERBOSITY with XCI_ANSIBLE_VERBOSITY 03/43203/10
Markos Chandras [Tue, 26 Sep 2017 14:55:23 +0000 (15:55 +0100)]
xci: Replace ANSIBLE_VERBOSITY with XCI_ANSIBLE_VERBOSITY

The ANSIBLE_VERBOSITY env variable is actually used internally by
Ansible and exporting it actually makes Ansible super verbose even if
the variable is empty. This feature is going away in the future so we
introduce our own XCI_ANSIBLE_VERBOSITY variable which is simply passed
to the command line to control verbosity in a proper and deterministic
way.

Change-Id: I8a32eeb1a86b4cb0a9872a51bbe9f9624d096e39
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: start-new-vm.sh: Print dib output when running on CI 63/43163/16
Markos Chandras [Tue, 26 Sep 2017 08:22:58 +0000 (09:22 +0100)]
xci: scripts: start-new-vm.sh: Print dib output when running on CI

Until we are able to fetch the dib images from external resources, we
need to build them as part of the job. diskimage-builder can sometimes
fail so we need to be able to see the log for debug purposes.

Change-Id: Iab8bfba08daa7095cf76537f629c8e7bf6330b17
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: start-new-vm.sh: Use 'unsafe' cache for the clean vm disk 81/43281/9
Markos Chandras [Wed, 27 Sep 2017 10:28:43 +0000 (11:28 +0100)]
xci: scripts: start-new-vm.sh: Use 'unsafe' cache for the clean vm disk

This is not a production virtual machine and we don't care
if we lose data in case it's killed unexpectedly so we can just
ignore the 'flush' commands from the guest. This will also improve
the overall I/O in the VMs.

Change-Id: Ib486a073f667e22f4a1e65a220ac553874f708cc
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: xci-deploy.sh: Make sure all local Ansible installations are gone 75/42975/11
Markos Chandras [Fri, 22 Sep 2017 17:37:58 +0000 (18:37 +0100)]
xci: xci-deploy.sh: Make sure all local Ansible installations are gone

We need to ensure that all Ansible installations are gone before we
install it again so we can ensure that a local or system wide
installation will not take precedence over the one we try to install.

Change-Id: I9daf66d661697baf63340ba4af1cd58fbd81f143
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: start-new-vm.sh: Do not allow multiple build-dib-os processes 51/43351/7
Markos Chandras [Wed, 27 Sep 2017 15:46:07 +0000 (16:46 +0100)]
xci: scripts: start-new-vm.sh: Do not allow multiple build-dib-os processes

apt-get is really unhappy when another instance is running and fails
with the following error:

E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)
E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?

Change-Id: I2fe343fdab8438cb112cce0a4f81c7e3977c55f9
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoRemove the quotes from the IP 41/43341/1
Manuel Buil [Wed, 27 Sep 2017 19:00:38 +0000 (21:00 +0200)]
Remove the quotes from the IP

Functest complains that it cannot connect to the installer because it does
not understand the ip or hostname. The cause for this is the quotes in the
template

Change-Id: I75c30b7f1bbcee3f968692b4347ceb13ab1131d2
Signed-off-by: Manuel Buil <mbuil@suse.com>
7 years agoMerge "xci: scripts: Fix script to run on Jenkins CI"
Fatih Degirmenci [Wed, 27 Sep 2017 08:50:00 +0000 (08:50 +0000)]
Merge "xci: scripts: Fix script to run on Jenkins CI"

7 years agoCreate a role which prepares xci for functest 69/42069/11
Manuel Buil [Fri, 15 Sep 2017 12:20:39 +0000 (14:20 +0200)]
Create a role which prepares xci for functest

Functest requires xci deployment to have:

- A public neutron network
- A subnet attached to the public neutron network
- The gateway from the subnet attached to one interface

The network and subnet creation are done via a script
instead of using Ansible OpenStack module in order to
get things working asap.

These three tasks are implemented in a role

This patch depends on a pending patch:

https://gerrit.opnfv.org/gerrit/#/c/39517/2

Change-Id: I0635227153087fd9e25b76f0859f82bf48bfb930
Signed-off-by: Manuel Buil <mbuil@suse.com>
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: scripts: Fix script to run on Jenkins CI 35/43035/18
Markos Chandras [Mon, 25 Sep 2017 19:40:11 +0000 (20:40 +0100)]
xci: scripts: Fix script to run on Jenkins CI

A couple of tweaks are necessary to get it working with Jenkins
- Jenkins jobs could contain the 'xci' string so make the regexp
more accurate.
- Rename VMs to use a more accurate name
- Fix ssh public key location
- Create a fresh /etc/hosts since distro may not have one.
- Set hostname on VM

Change-Id: I332a424bc8b2de98d7b326c192996b7b12c79dd7
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: file: Update package metadata before installing packages 57/43057/1
Markos Chandras [Mon, 25 Sep 2017 21:00:59 +0000 (22:00 +0100)]
xci: file: Update package metadata before installing packages

We may have old or no metadata for packages at all so package
installations may fail. As such, lets sync with upstream mirrors
before we try to install any packages.

Change-Id: I15f73e46d4f0cae2c50d23a92e0f4da83821039e
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "xci: scripts: Add script to use clean virtual machines for testing"
Markos Chandras [Mon, 25 Sep 2017 19:34:07 +0000 (19:34 +0000)]
Merge "xci: scripts: Add script to use clean virtual machines for testing"

7 years agoMerge "bugfix: Correct the role in aio configure-opnfvhost.yml"
Markos Chandras [Mon, 25 Sep 2017 12:07:31 +0000 (12:07 +0000)]
Merge "bugfix: Correct the role in aio configure-opnfvhost.yml"

7 years agoxci: scripts: Add script to use clean virtual machines for testing 43/42743/6
Markos Chandras [Fri, 22 Sep 2017 07:54:18 +0000 (08:54 +0100)]
xci: scripts: Add script to use clean virtual machines for testing

These scripts will prepare a clean OS image based on diskimage-builder
and launch a new VM with it. The purpose of that is to use this virtual
machine as a 'host' to run XCI on it. This way we can ensure that all
tests are being executed on the same clean environment which is ideal
for reproducing and debugging purposes. We also commit the ssh keypair
so we can build it in the image and use it to control the virtual
machine without user interaction. Needless to say that this keypair MUST
NOT be used for anything else apart from the dib build process.

Change-Id: Idec0fc06c82435adc1a4d569b8e578616998de5f
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agobugfix: Correct the role in aio configure-opnfvhost.yml 87/42987/1
Fatih Degirmenci [Mon, 25 Sep 2017 09:24:30 +0000 (11:24 +0200)]
bugfix: Correct the role in aio configure-opnfvhost.yml

Change-Id: Ie70800f6cbc07c505739a870be304d9153941dec
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoLog Horizon URL, admin username and password on console. 57/40557/16
Taseer Ahmed [Tue, 29 Aug 2017 05:03:37 +0000 (10:03 +0500)]
Log Horizon URL, admin username and password on console.

Added so that user need not traverse files for these parameters

JIRA: RELENG-221

Change-Id: I1c445ea34ef9494d5bef3a6cba0c8d40bacba29f
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
7 years agoMerge "Install docker and shade on opnfv host"
Fatih Degirmenci [Fri, 22 Sep 2017 16:57:40 +0000 (16:57 +0000)]
Merge "Install docker and shade on opnfv host"

7 years agoMerge "Reduce no of cpus allocated per node"
Markos Chandras [Fri, 22 Sep 2017 15:38:11 +0000 (15:38 +0000)]
Merge "Reduce no of cpus allocated per node"

7 years agoMerge changes from topic 'split-variable-creation-to-task'
Markos Chandras [Fri, 22 Sep 2017 15:37:16 +0000 (15:37 +0000)]
Merge changes from topic 'split-variable-creation-to-task'

* changes:
  xci: configure-localhost: Do not check /etc/ssl/certs on SUSE
  xci: xci-deploy.sh: Ensure env_reset is not present

7 years agoMerge changes from topic 'split-variable-creation-to-task'
Markos Chandras [Fri, 22 Sep 2017 15:37:09 +0000 (15:37 +0000)]
Merge changes from topic 'split-variable-creation-to-task'

* changes:
  xci: Move the destroy-env.sh script to xci-deploy.sh
  xci: provision-vm-nodes.yml: Merge plays

7 years agoMerge "Override ansible role versions only if OSA version is not master"
Markos Chandras [Fri, 22 Sep 2017 14:16:18 +0000 (14:16 +0000)]
Merge "Override ansible role versions only if OSA version is not master"

7 years agoMerge changes from topic 'split-variable-creation-to-task'
Markos Chandras [Fri, 22 Sep 2017 14:06:10 +0000 (14:06 +0000)]
Merge changes from topic 'split-variable-creation-to-task'

* changes:
  xci: playbooks: Include distribution var files dynamically
  bifrost: scripts: Look for virtualbmc on bifrost virtualenv
  xci: Gain elevated privileges to remove the XCI_DEVEL_ROOT directory
  xci: Move VM provisioning to xci-deploy.sh

7 years agoReduce no of cpus allocated per node 41/42741/2
Fatih Degirmenci [Fri, 22 Sep 2017 08:50:29 +0000 (10:50 +0200)]
Reduce no of cpus allocated per node

Change-Id: I62c167621e2b28a57b1ef7647d105ea73dbb0291
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoInstall docker and shade on opnfv host 55/42755/2
Fatih Degirmenci [Fri, 22 Sep 2017 11:09:21 +0000 (13:09 +0200)]
Install docker and shade on opnfv host

Docker is needed for running tests against the deployment.
Shade is needed for managing OpenStack via Ansible.

This change adds tasks to install docker and shade on opnfv
host if it is run as part of CI.

Users should be free to install these if they want so it is
not installed for them by default.

Change-Id: Idfd0f02312cc5e1b0180ed2408755a8c730b987b
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoAdd the internal_vip(172.29.236.222) to used_ip 17/41517/3
wutianwei [Mon, 11 Sep 2017 09:14:37 +0000 (17:14 +0800)]
Add the internal_vip(172.29.236.222) to used_ip

The IP in used_ip will not be used later
otherwise internal_vip may be assigned to lxc container,
which will cause issue during deploying

Change-Id: I9834dfa9b218b4dd23e20c8d57e05bb806dafa7b
Signed-off-by: wutianwei <wutianwei1@huawei.com>
7 years agoxci: configure-localhost: Do not check /etc/ssl/certs on SUSE 95/42695/7
Markos Chandras [Wed, 20 Sep 2017 07:52:32 +0000 (08:52 +0100)]
xci: configure-localhost: Do not check /etc/ssl/certs on SUSE

/etc/ssl/certs is a symlink so skip this task on SUSE.

Change-Id: Ibc188b76f47c4f7d1c5aa452a21e838420d65e6a
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: Move the destroy-env.sh script to xci-deploy.sh 97/42397/8
Markos Chandras [Tue, 19 Sep 2017 16:04:55 +0000 (17:04 +0100)]
xci: Move the destroy-env.sh script to xci-deploy.sh

There is no particular need to execute the bash script using Ansible.
Lets move it to the xci-deploy.sh script instead.

Change-Id: I0fa91195d9c3647bb4766d76c28892e2f13e1e98
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: playbooks: Include distribution var files dynamically 87/42287/10
Markos Chandras [Mon, 18 Sep 2017 14:50:16 +0000 (15:50 +0100)]
xci: playbooks: Include distribution var files dynamically

This is a continuation of I0a49e2ed8d811bb40a99612462752f8691133e0f
We need to convert these two plays to include the variable files
dynamically similar to the rest of the playbook.

Change-Id: I43203651ccafb03e015bfe4d1b075a7ee96b5adc
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: xci-deploy.sh: Ensure env_reset is not present 07/42407/8
Markos Chandras [Tue, 19 Sep 2017 10:43:35 +0000 (11:43 +0100)]
xci: xci-deploy.sh: Ensure env_reset is not present

We are making use of 'sudo -E' to preserve environment variables
when using 'sudo' so we need to make sure that we don't use env_reset
in the configuration file.

Change-Id: I45a818da6c5c090ece67898e54f2dc4ba48cb452
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: provision-vm-nodes.yml: Merge plays 05/42405/8
Markos Chandras [Tue, 19 Sep 2017 10:36:23 +0000 (11:36 +0100)]
xci: provision-vm-nodes.yml: Merge plays

There is no need to have multiple plays executed on a single host group
so merge them all together into a single one.

Change-Id: Ie190cdecfbdcba48f75b21aa5930e1d9b8392aa0
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agobifrost: scripts: Look for virtualbmc on bifrost virtualenv 79/42279/9
Markos Chandras [Mon, 18 Sep 2017 14:33:54 +0000 (15:33 +0100)]
bifrost: scripts: Look for virtualbmc on bifrost virtualenv

Since I94874d600a29247b7826324cc111901995df90dc, bifrost installs pip
packages in virtualenv so we need to look there for virtualbmc if it's
not currently installed on the host.

Change-Id: Ia4c7e8a75c020dc00b920956495831cc77457876
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: Gain elevated privileges to remove the XCI_DEVEL_ROOT directory 93/42693/7
Markos Chandras [Tue, 19 Sep 2017 20:59:25 +0000 (21:59 +0100)]
xci: Gain elevated privileges to remove the XCI_DEVEL_ROOT directory

This is similar to 0927671781f6875926dac2e5f4bb10816e67070c. We need
elevated privileges to remove the XCI_DEVEL_ROOT directory so move this
role to its own play.

Change-Id: Ice4f030eeb28cd24a6166f11a5a792ab3df8880c
Signed-off-by: Markos Chandras <mchandras@suse.de>