releng-xci.git
6 years agoxci: Install the ARA callback plugin 13/54113/6
Markos Chandras [Mon, 19 Mar 2018 14:15:00 +0000 (14:15 +0000)]
xci: Install the ARA callback plugin

The ARA Ansible plugin can be used to visualize the entire XCI run so
lets install it by default and generate a report at the end of the
execution.

Change-Id: I66c3230b371001c110e81755c5f0dad4b1756606
Link: https://github.com/openstack/ara
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: files: install-lib.sh: Install pip packages as user 15/54215/2
Markos Chandras [Tue, 20 Mar 2018 17:34:35 +0000 (17:34 +0000)]
xci: files: install-lib.sh: Install pip packages as user

We can avoid "polluting" the system with all the pip packages we install
so we could just install them in the user's home directory.

Change-Id: I5b3369175535e8ab74c2591d1284c743391fd718
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: files: Move Ansible installation to a library file 99/54099/3
Markos Chandras [Mon, 19 Mar 2018 09:37:29 +0000 (09:37 +0000)]
xci: files: Move Ansible installation to a library file

Installing Ansible is just one of the functions we need during XCI
deployment, as such move it to a library file which can contain more
functions in the future.

Change-Id: I708a4e51b2b1d624d6827a8c99f3719b59227ec0
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoClean up opnfv ansible vars and switch to lowercase 17/54217/8
Fatih Degirmenci [Tue, 20 Mar 2018 19:16:56 +0000 (20:16 +0100)]
Clean up opnfv ansible vars and switch to lowercase

This change removes the variables that are not used in any of the
playbooks/roles from opnfv ansible vars.

Apart from that, all caps ansible vars replaced with lowercase ones
and impacted playbooks/roles are updated.

installer-type:osa
deploy-scenario:os-nosdn-nofeature

Change-Id: I99ebdc155b3903176ac5940b64cef0c0f3aa0f0d
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
6 years agoAdd proxy support 83/45383/20
Victor Morales [Mon, 5 Feb 2018 18:45:46 +0000 (10:45 -0800)]
Add proxy support

In some cases the XCI development environment can be located behind a
corporate proxy resulting in a additional layer to consider to
configure. These changes pretend to include proxy support for all
linux distros in all the posible flavors.

Change-Id: Iab469268809ac471d09e244bb3ccd83de1a41b88
Signed-off-by: Victor Morales <victor.morales@intel.com>
6 years agoxci: Move cleanup script outside of bifrost 21/54121/4
Markos Chandras [Mon, 19 Mar 2018 16:22:47 +0000 (16:22 +0000)]
xci: Move cleanup script outside of bifrost

The cleanup script has grown quite a bit over time and it now does more
things than cleaning up old 'bifrost' artifacts to move it to the global
files directory so it can be used by all installers.

Change-Id: Ibf70ff255f14e798216cedc71fb7c5f5476b964a
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoMerge changes from topic 'allow-deployment-overrides'
Markos Chandras [Tue, 20 Mar 2018 17:28:50 +0000 (17:28 +0000)]
Merge changes from topic 'allow-deployment-overrides'

* changes:
  xci: infra: bifrost: Avoid installing Ansible twice
  Add initial support for multiple infra deployers

6 years agoxci: infra: bifrost: Avoid installing Ansible twice 19/54119/3
Markos Chandras [Mon, 19 Mar 2018 16:15:09 +0000 (16:15 +0000)]
xci: infra: bifrost: Avoid installing Ansible twice

We already install Ansible globally and we also install another version
of it in the bifrost venv. Even though the OSA Ansible may move faster
than the bifrost one, we normally pin both projects so we can move them
when they can work with the same Ansible version. As such, lets make the
deployment a little bit faster by simply not installing Ansible twice.

Change-Id: I121ef5979607b62e76300db1bc6d51fc27362d5b
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoMerge "display the correct deploy scenario for the functest run"
Markos Chandras [Tue, 20 Mar 2018 13:17:57 +0000 (13:17 +0000)]
Merge "display the correct deploy scenario for the functest run"

6 years agoMerge "Access the K8s dashboard and configure the CLI in opnfv host"
Fatih Degirmenci [Tue, 20 Mar 2018 10:20:35 +0000 (10:20 +0000)]
Merge "Access the K8s dashboard and configure the CLI in opnfv host"

6 years agoAdd initial support for multiple infra deployers 47/53947/4
Markos Chandras [Thu, 15 Mar 2018 16:51:37 +0000 (16:51 +0000)]
Add initial support for multiple infra deployers

bifrost is currently the only way to deploy the infrastructure but
in the future other solutions will be added so we need to do some
preparation for XCI integration.

Change-Id: I961dd42157c924d88747074ddba6a318f8b537ac
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agodisplay the correct deploy scenario for the functest run 57/53657/14
Periyasamy Palanisamy [Tue, 13 Mar 2018 10:00:12 +0000 (11:00 +0100)]
display the correct deploy scenario for the functest run

Change-Id: I0b8a6d9409d95033839bdc5b3fbe9d1cbbdf4b7c
Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
6 years agoAccess the K8s dashboard and configure the CLI in opnfv host 03/52003/7
wutianwei [Fri, 9 Feb 2018 01:20:45 +0000 (09:20 +0800)]
Access the K8s dashboard and configure the CLI in opnfv host

1. Add the type: NodePort in dashboard service. the default is ClustIP,
   which cannot access from outside.
2. Print the url ,user, password for user to access dashboard.
3. configure the kubectl CLI in opnfv host.

Change-Id: I6cb6e6f7547412139ece0c40a85de67a9edce0ef
Signed-off-by: wutianwei <wutianwei1@huawei.com>
6 years agoPass the OSA version to functest container 01/54101/2
Manuel Buil [Mon, 19 Mar 2018 11:25:15 +0000 (12:25 +0100)]
Pass the OSA version to functest container

OPNFV scenarios are forced to support at least two versions of OSA.
If there are API changes between two supported versions of OpenStack,
the testing code must have two versions. However, without knowing what
OpenStack version is deployed, it is impossible to automate the
decision of which testing code to use

Change-Id: I3ca8c6f33c05826a5d69417da774b7218bbd59e2
Signed-off-by: Manuel Buil <mbuil@suse.com>
6 years agoMerge "kubespray: Do not grep log text to determine failure"
Markos Chandras [Mon, 19 Mar 2018 08:41:37 +0000 (08:41 +0000)]
Merge "kubespray: Do not grep log text to determine failure"

6 years agoMerge "xci: playbooks: Drop .gitignore file"
Markos Chandras [Mon, 19 Mar 2018 08:41:09 +0000 (08:41 +0000)]
Merge "xci: playbooks: Drop .gitignore file"

6 years agoMerge "xci: osa: Simplify OpenStack host playbooks"
Fatih Degirmenci [Sat, 17 Mar 2018 13:13:03 +0000 (13:13 +0000)]
Merge "xci: osa: Simplify OpenStack host playbooks"

6 years agoMerge "xci: osa: Drop haproxy workaround"
Fatih Degirmenci [Sat, 17 Mar 2018 10:33:40 +0000 (10:33 +0000)]
Merge "xci: osa: Drop haproxy workaround"

6 years agoxci: osa: Simplify OpenStack host playbooks 79/53979/4
Markos Chandras [Fri, 16 Mar 2018 11:45:14 +0000 (11:45 +0000)]
xci: osa: Simplify OpenStack host playbooks

The configure-targethost playbook is configuring all the OSA hosts so
we can simplify all that by introducing a new 'openstack' host group
with the controller and the compute nodes and configure all of them
in parallel.

Change-Id: I21f8709e7649b041575dab45fc4e070aa01e0a6f
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: osa: Drop haproxy workaround 81/53981/2
Markos Chandras [Fri, 16 Mar 2018 12:03:13 +0000 (12:03 +0000)]
xci: osa: Drop haproxy workaround

There is no reference on the actual upstream problem so lets assume
this is fixed and drop the workaround we had locally.

Change-Id: I3f71ea2e6fdc67e342f014e572f74760a78d3816
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: scripts: start-new-vm.sh: Make DEFAULT_XCI_TEST stricter 91/53991/2
Markos Chandras [Fri, 16 Mar 2018 12:52:37 +0000 (12:52 +0000)]
xci: scripts: start-new-vm.sh: Make DEFAULT_XCI_TEST stricter

The DEFAULT_XCI_TEST value wasn't checked and it could actually contain
anything leading to all sort of failures so we need to check it against
well known values.

Change-Id: Ib12c944adebfbcb3097b42af98d2bacefbd8374c
Signed-off-by: Markos Chandras <mchandras@suse.de>
6 years agoxci: scripts: start-new-vm.sh: Ensure we enter the correct root directory 89/53989/2
Markos Chandras [Fri, 16 Mar 2018 12:46:41 +0000 (12:46 +0000)]
xci: scripts: start-new-vm.sh: Ensure we enter the correct root directory

All clean VM operations should be performed within the root directory of
the releng-xci repo so make sure we are there.

Change-Id: I96f9d91439210faa1ac7f0e43db3992776293e9e
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: Copy XCI environment to deployment hosts 75/53975/8
Markos Chandras [Fri, 16 Mar 2018 11:05:56 +0000 (11:05 +0000)]
xci: Copy XCI environment to deployment hosts

The XCI hosts may need some of the XCI env variables to perform
certain tasks so dump the XCI environment to /root/xci.env file and
make that available to every host on the deployment.

Change-Id: I286a01ca7da8ff206438c261798167f5e4daf7f2
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "docs: Add info about kubernetes support"
Fatih Degirmenci [Fri, 16 Mar 2018 08:32:25 +0000 (08:32 +0000)]
Merge "docs: Add info about kubernetes support"

7 years agoxci: playbooks: Drop .gitignore file 51/53951/1
Markos Chandras [Fri, 16 Mar 2018 07:53:26 +0000 (07:53 +0000)]
xci: playbooks: Drop .gitignore file

There is probably no good reason anymore to be so strict with file
inclusions in the roles directory so drop the .gitignore file.

Change-Id: I84569c8c82c4aeb5da6c6e39e02ff514566e5213
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoRemove qemu-kvm duplicate package 09/53909/1
Victor Morales [Fri, 16 Mar 2018 06:49:11 +0000 (02:49 -0400)]
Remove qemu-kvm duplicate package

The qemu-kvm package was duplicated for opensuse distro in the
start-new-vm.sh script. It doesn't affect its functionality but
reduce the list of additional packages to install.

Change-Id: Id5f24793295d7ccd9b19b64a07b24a1150a780aa
Signed-off-by: Victor Morales <victor.morales@intel.com>
7 years agodocs: Add info about kubernetes support 97/53497/2
wutianwei [Mon, 12 Mar 2018 08:37:22 +0000 (16:37 +0800)]
docs: Add info about kubernetes support

1. Introduce the installer used to deploy kubernetes
2. Introduce XCI how to deploy the kubernetes

Change-Id: I052b4547d763d19b8d6136a48d4804443921b021
Signed-off-by: wutianwei <wutianwei1@huawei.com>
7 years agoRemove opnfv vm from known_hosts 83/53883/1
Fatih Degirmenci [Thu, 15 Mar 2018 14:32:40 +0000 (15:32 +0100)]
Remove opnfv vm from known_hosts

Change-Id: If53b51fc26d642afa39c5e618afcd23fab395acc
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoMerge "Do not grep log text to determine failure"
Fatih Degirmenci [Wed, 14 Mar 2018 18:58:39 +0000 (18:58 +0000)]
Merge "Do not grep log text to determine failure"

7 years agoMerge "xci: Merge configure-network and syncronize-time roles"
Markos Chandras [Wed, 14 Mar 2018 08:01:27 +0000 (08:01 +0000)]
Merge "xci: Merge configure-network and syncronize-time roles"

7 years agoMerge "xci: config: evn-vars: Dynamically determine the Ansible version"
Markos Chandras [Wed, 14 Mar 2018 07:57:05 +0000 (07:57 +0000)]
Merge "xci: config: evn-vars: Dynamically determine the Ansible version"

7 years agoMerge "xci: Fix group for the OPFNV host"
Markos Chandras [Wed, 14 Mar 2018 07:56:52 +0000 (07:56 +0000)]
Merge "xci: Fix group for the OPFNV host"

7 years agokubespray: Do not grep log text to determine failure 51/53751/2
Fatih Degirmenci [Wed, 14 Mar 2018 07:36:56 +0000 (08:36 +0100)]
kubespray: Do not grep log text to determine failure

Pipefail should be sufficient to determine the failure so this
change gets rid of grepping the logs for failure and unreachable
to leave the evaluation to bash itself.

Change-Id: I0fcd6016ddc19eb11b3eb2402347032a11c5a32a
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoMerge "Set VM node names and log the installer version based on installer"
Fatih Degirmenci [Tue, 13 Mar 2018 23:30:47 +0000 (23:30 +0000)]
Merge "Set VM node names and log the installer version based on installer"

7 years agoMerge "xci: osa: Switch git repositories to github.com"
Markos Chandras [Tue, 13 Mar 2018 16:39:44 +0000 (16:39 +0000)]
Merge "xci: osa: Switch git repositories to github.com"

7 years agoxci: Merge configure-network and syncronize-time roles 65/53665/3
Markos Chandras [Tue, 13 Mar 2018 10:30:16 +0000 (10:30 +0000)]
xci: Merge configure-network and syncronize-time roles

Those roles were too small and only used as part of the host
bootstrapping process. As such, we merge them into a common
'bootstrap-host' role which can be used to prepare the hosts
after the initial deployment

Change-Id: Ifc84cf40b98ced91b31aae699dc28e9642380550
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: Fix group for the OPFNV host 73/53573/4
Markos Chandras [Tue, 13 Mar 2018 16:28:46 +0000 (16:28 +0000)]
xci: Fix group for the OPFNV host

Ansible gets upset if we use the same name for a host and a group so
add the OPNFV host to the deployment group. This fixes the following
warning:

[WARNING]: Found both group and host with same name: opnfv

Change-Id: Idbaff712d40e8234721332aee6d10d5ba44c62ce
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge changes from topics 'allow-pass-ansible-arguments', 'allow-pass-ansible-argumen...
Markos Chandras [Tue, 13 Mar 2018 16:20:20 +0000 (16:20 +0000)]
Merge changes from topics 'allow-pass-ansible-arguments', 'allow-pass-ansible-arguments-force-verify'

* changes:
  xci: OSA: Fix warning about missing inventory file
  xci: Pass the XCI_PATH variable to all Ansible calls
  xci: Rename XCI_ANSIBLE_VERBOSITY to XCI_ANSIBLE_PARAMS

7 years agoxci: osa: Switch git repositories to github.com 67/53667/1
Markos Chandras [Tue, 13 Mar 2018 12:03:55 +0000 (12:03 +0000)]
xci: osa: Switch git repositories to github.com

CI sometimes fails with the following error

"msg": "fatal: unable to access 'https://git.openstack.org/openstack/dragonflow/':
Failed to connect to git.openstack.org port 443: Connection timed out"

We assume that the upstream OpenStack mirrors may get very busy at times
or the connectivity between the CI and the OpenStack repos is not very
stable. As such, lets switch to github.com for the majority of OSA
repositories such as the roles and the services which may improve the
situation.

Change-Id: Ia4668d692077a785c76adeda128eb4cf9f4516a7
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoDo not grep log text to determine failure 01/53601/2
Fatih Degirmenci [Mon, 12 Mar 2018 20:10:48 +0000 (21:10 +0100)]
Do not grep log text to determine failure

Pipefail should be sufficient to determine the failure so this
change gets rid of grepping the logs for failure and unreachable
to leave the evaluation to bash itself.

Change-Id: Ie928438c1503b086159276af4308f5549b58cb71
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoSet VM node names and log the installer version based on installer 05/53605/1
Fatih Degirmenci [Mon, 12 Mar 2018 22:22:55 +0000 (23:22 +0100)]
Set VM node names and log the installer version based on installer

The VM nodes are named using OpenStack terminology but since we
now have Kubernetes scenario, it is appropriate to name the nodes
accordingly.

Apart from that, we normally log the version of OSA which is not
correct for kubernetes deployments. Logging Kubespray version would
be correct for this scenario.

Change-Id: I3964574c8592450f9fa3126f19e27bb78fd9d174
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoMerge "Combine vars setting installer type in INSTALLER_TYPE"
Fatih Degirmenci [Mon, 12 Mar 2018 18:02:33 +0000 (18:02 +0000)]
Merge "Combine vars setting installer type in INSTALLER_TYPE"

7 years agoMerge "Combine vars setting installer type in INSTALLER_TYPE"
Fatih Degirmenci [Mon, 12 Mar 2018 18:02:27 +0000 (18:02 +0000)]
Merge "Combine vars setting installer type in INSTALLER_TYPE"

7 years agoremove .ansible directory 77/53577/3
Periyasamy Palanisamy [Mon, 12 Mar 2018 15:16:13 +0000 (16:16 +0100)]
remove .ansible directory

It's needed to remove .ansible directory which could be a leftovers by
some other ansible execution enviroment which would affect XCI
deployment.

Change-Id: Ic334ef1ca53878721762b23b238fe9a8aeefa0e0
Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
7 years agoxci: config: evn-vars: Dynamically determine the Ansible version 67/53567/1
Markos Chandras [Thu, 8 Mar 2018 16:55:52 +0000 (16:55 +0000)]
xci: config: evn-vars: Dynamically determine the Ansible version

There is no good reason why we should pin the Ansible version without
the ability to override it. OpenStack Ansible is doing a great work
testing Ansible releases as early as possible so we could benefit from
that work and use whatever Ansible our pinned OSA uses.

Change-Id: I4677dbefc68f7140417ece34d013ca9674baab43
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoCombine vars setting installer type in INSTALLER_TYPE 61/53561/2
Fatih Degirmenci [Mon, 12 Mar 2018 13:35:22 +0000 (14:35 +0100)]
Combine vars setting installer type in INSTALLER_TYPE

Change-Id: Ie196d1df537d09f0f91e43ab5e0305a45d543815
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoCombine vars setting installer type in INSTALLER_TYPE 59/53559/2
Fatih Degirmenci [Mon, 12 Mar 2018 13:34:18 +0000 (14:34 +0100)]
Combine vars setting installer type in INSTALLER_TYPE

Change-Id: I330bc036f901d4ba61bc94ee6e085cadf54b4d8b
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoxci: OSA: Fix warning about missing inventory file 19/53519/1
Markos Chandras [Mon, 12 Mar 2018 10:40:39 +0000 (10:40 +0000)]
xci: OSA: Fix warning about missing inventory file

This is similar to 346079ea1b8dbda0c5e282c18f30cbac7e907d1e
("xci: Fix warning about missing inventory file")

This playbook only affects localhost so make it explicit. Fixes:

[WARNING]: Host file not found: inventory
[WARNING]: provided hosts list is empty, only localhost is available

Change-Id: If8548a36498ea3191de33cff94acbaee6ed04ce3
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: Pass the XCI_PATH variable to all Ansible calls 09/53509/2
Markos Chandras [Mon, 12 Mar 2018 09:50:06 +0000 (09:50 +0000)]
xci: Pass the XCI_PATH variable to all Ansible calls

The XCI_PATH variable is used by various playbooks to find the root
directory of the XCI repository so it's much cleaner to pass it on every
Ansible call.

Change-Id: Ifc0b77fa767e48bd1dc6daa44c6251c02983fd4d
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: Rename XCI_ANSIBLE_VERBOSITY to XCI_ANSIBLE_PARAMS 07/53507/1
Markos Chandras [Mon, 12 Mar 2018 09:47:55 +0000 (09:47 +0000)]
xci: Rename XCI_ANSIBLE_VERBOSITY to XCI_ANSIBLE_PARAMS

We don't quite need a specific env variable just for Ansible
verbosity so we can rename this variable to make it clear that
it can be used to pass any Ansible option to XCI.

Change-Id: Ie20517d4b563bfc6daeb27848168d36da7014cee
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: Drop the python-crypto dependency 05/53505/1
Markos Chandras [Mon, 12 Mar 2018 09:40:10 +0000 (09:40 +0000)]
xci: Drop the python-crypto dependency

The upstream pw-token-gen tool doesn't need python-crypto anymore since
e9f957861b4160640f6debb2b939084ec43b43b2 ("Make pw-token-gen.py more
random") so we no longer need to install that package.

Change-Id: Ib53f246db999ff8ecfed2e3f62143c780c483fbd
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "xci: Fix warning about missing inventory file"
Markos Chandras [Mon, 12 Mar 2018 08:44:12 +0000 (08:44 +0000)]
Merge "xci: Fix warning about missing inventory file"

7 years agoMerge "xci: roles: configure-network: Avoid passing empty string to module"
Markos Chandras [Mon, 12 Mar 2018 08:44:06 +0000 (08:44 +0000)]
Merge "xci: roles: configure-network: Avoid passing empty string to module"

7 years agoMerge changes from topic 'set-proper-constrains'
Markos Chandras [Mon, 12 Mar 2018 08:44:00 +0000 (08:44 +0000)]
Merge changes from topic 'set-proper-constrains'

* changes:
  xci: OSA: Ensure proper constrains are applied to pip installations
  xci: Move functest required packages to the functest role

7 years agoMerge "xci: scripts: vm: Update package manager cache and ignore errors"
Markos Chandras [Mon, 12 Mar 2018 08:43:53 +0000 (08:43 +0000)]
Merge "xci: scripts: vm: Update package manager cache and ignore errors"

7 years agoxci: scripts: vm: Update package manager cache and ignore errors 49/53449/1
Markos Chandras [Sat, 10 Mar 2018 09:59:00 +0000 (09:59 +0000)]
xci: scripts: vm: Update package manager cache and ignore errors

We need to make sure that the local package cache is updated before we
try to install packages. Moreover, from time to time, something in the
repos may be broken so we don't want to break the CI job. As such, make
that step non-fatal as simply send the output to stdout so we can see
what's wrong.

Change-Id: I148e3b5435c604bb0d54339935255740c8ce07c0
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: roles: configure-network: Avoid passing empty string to module 25/53425/3
Markos Chandras [Fri, 9 Mar 2018 16:31:13 +0000 (16:31 +0000)]
xci: roles: configure-network: Avoid passing empty string to module

The package module gets upset if we pass it an empty string as a package
name

Mar 09 15:15:33 TASK [configure-network : Ensure networking packages are present] **************
Mar 09 15:15:49 fatal: [opnfv]: FAILED! => {"changed": false, "failed":
true, "msg": "No package matching '' found available, installed or
updated", "rc": 126, "results": ["iproute-3.10.0-87.el7.x86_64 providing
iproute is already installed", "No package matching '' found available,
installed or updated"]}

As such, lets pass an existing package for non-Debian distros to make
the module happy.

Change-Id: Ib1128057097193278cfe50f79daf35332b54e781
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: OSA: Ensure proper constrains are applied to pip installations 05/53305/15
Markos Chandras [Thu, 8 Mar 2018 12:37:07 +0000 (12:37 +0000)]
xci: OSA: Ensure proper constrains are applied to pip installations

We need to make sure that the pip packages that we install are
compatible with the OSA components.

Change-Id: I87e80dc9b8fb862d9f9039d835b0908f752de3ca
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: Move functest required packages to the functest role 89/53389/8
Markos Chandras [Fri, 9 Mar 2018 09:17:16 +0000 (09:17 +0000)]
xci: Move functest required packages to the functest role

The docker packages that we install in the OPNFV VM are needed by
functest so add them to the related role.

Change-Id: I6ebe76fd030859f757d41ecf20c30ab76888ee9c
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "bifrost: Do not run virsh commands if it's not installed"
Markos Chandras [Sat, 10 Mar 2018 09:48:28 +0000 (09:48 +0000)]
Merge "bifrost: Do not run virsh commands if it's not installed"

7 years agoMerge "bifrost: Move DIB configuration variables to bifrost"
Markos Chandras [Sat, 10 Mar 2018 09:48:17 +0000 (09:48 +0000)]
Merge "bifrost: Move DIB configuration variables to bifrost"

7 years agoMerge "bifrost: Optimize the OPNFV bifrost playbook"
Markos Chandras [Sat, 10 Mar 2018 09:48:08 +0000 (09:48 +0000)]
Merge "bifrost: Optimize the OPNFV bifrost playbook"

7 years agoxci: Fix warning about missing inventory file 15/53415/2
Markos Chandras [Fri, 9 Mar 2018 14:24:00 +0000 (14:24 +0000)]
xci: Fix warning about missing inventory file

We no longer have a global inventory file and we don't need one right
now since the bootstrapping opearations happen on the localhost anyway
so we could be explicit and get rid of the following warning:

[WARNING]: Host file not found: inventory
[WARNING]: provided hosts list is empty, only localhost is available

Change-Id: I5cfe7b0971397665cf9eae9c54985c44c4506449
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "xci: roles: configure-network: Wait for connection when configuring the network"
Fatih Degirmenci [Fri, 9 Mar 2018 17:20:46 +0000 (17:20 +0000)]
Merge "xci: roles: configure-network: Wait for connection when configuring the network"

7 years agobifrost: Optimize the OPNFV bifrost playbook 91/53391/3
Markos Chandras [Fri, 9 Mar 2018 10:09:42 +0000 (10:09 +0000)]
bifrost: Optimize the OPNFV bifrost playbook

We could combine several plays into a single one when they are executed
to the same set of nodes. This has the added benefit that we avoid all
the Ansible warm-up operations when a new play is started.

Change-Id: Ibcad07d1b74f1d7cc5a9c60e4b2a6130fb6178fd
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agobifrost: Do not run virsh commands if it's not installed 19/53419/1
Markos Chandras [Fri, 9 Mar 2018 14:37:16 +0000 (14:37 +0000)]
bifrost: Do not run virsh commands if it's not installed

Check if 'virsh' is available before trying to remove the VMs:

Fixes the following warning

./scripts/destroy-env.sh: line 36: virsh: command not found
./scripts/destroy-env.sh: line 37: virsh: command not found
./scripts/destroy-env.sh: line 36: virsh: command not found
./scripts/destroy-env.sh: line 37: virsh: command not found
./scripts/destroy-env.sh: line 36: virsh: command not found
./scripts/destroy-env.sh: line 37: virsh: command not found

Change-Id: I9c82c8b8b40462584c6324871284ba12d660ae9d
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agobifrost: Move DIB configuration variables to bifrost 13/53413/1
Markos Chandras [Fri, 9 Mar 2018 14:15:16 +0000 (14:15 +0000)]
bifrost: Move DIB configuration variables to bifrost

The DIB variables only make sense on bifrost so they should live in the
bifrost provision script.

Change-Id: I05baca7b9c6889a0d401a9288998991324d270af
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: roles: configure-network: Wait for connection when configuring the network 35/53335/7
Markos Chandras [Thu, 8 Mar 2018 19:51:51 +0000 (19:51 +0000)]
xci: roles: configure-network: Wait for connection when configuring the network

Ansible some times loses connection with the host after we configure its
network interface. This shouldn't happen since the host is actually up
and running. As a result of which, we need to fire-and-forget the
restart of the network service and then try to reach the SSH port. We
also need to make sure that all required packages are installed.
Finally, we drop the 'ignore_errors' parameter since we really need to
know when the networking configuration has failed.

Change-Id: I366192737b5c4e01964eaf187396eababbdc808e
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "xci: Rename provision-vm-nodes playbook"
Markos Chandras [Fri, 9 Mar 2018 10:47:50 +0000 (10:47 +0000)]
Merge "xci: Rename provision-vm-nodes playbook"

7 years agoMerge "Add subproject INFO.yaml"
Fatih Degirmenci [Fri, 9 Mar 2018 10:24:27 +0000 (10:24 +0000)]
Merge "Add subproject INFO.yaml"

7 years agoxci: Rename provision-vm-nodes playbook 85/53385/1
Markos Chandras [Fri, 9 Mar 2018 09:51:52 +0000 (09:51 +0000)]
xci: Rename provision-vm-nodes playbook

The provision-vm-nodes playbook doesn't do any VM provisioning. It
basically just bootstraps the bifrost repository so rename it to
make it clear what this is about.

Change-Id: I1c10bc6135686c5197d553a885412a94312a41bc
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agobifrost: Ensure OS images are present in the PXE directory 01/53301/1
Markos Chandras [Thu, 8 Mar 2018 11:39:42 +0000 (11:39 +0000)]
bifrost: Ensure OS images are present in the PXE directory

The XCI deployment script may wipe the PXE directories so we need
to place the OS images after this has happened so we don't download them
every time.

Change-Id: Iccf943bc75592e7f5dddea59dfee14b2b080e7ef
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoAdd subproject INFO.yaml 29/52729/4
Fatih Degirmenci [Tue, 27 Feb 2018 11:39:56 +0000 (11:39 +0000)]
Add subproject INFO.yaml

This change adds INFO.yaml for releng-xci Gerrit Project which is
constructed by subset of committers of Releng project who are active in
xci. New committers to releng-xci Gerrit Project will be nominated
on Gerrit via separate changes and voted by releng-xci committers that
are listed within releng-xci/INFO.yaml file as of today.

A single mail with all the nominations will be sent to opnfv-tsc and
opnfv-tech-discuss mailing lists announcing nominations. A followup
mail will also be sent to announce the results.

Change-Id: I1d49585276304b29ac86b03aff5fd45974a02ccc
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agobifrost: Use the pre-built XCI OS images instead of dib 53/53253/1
Markos Chandras [Wed, 7 Mar 2018 16:36:03 +0000 (16:36 +0000)]
bifrost: Use the pre-built XCI OS images instead of dib

We already have images for all 3 distros which we could simply re-use
for all the XCI VM deployments instead of building new ones everytime
with DIB. The images will be copied to the new VM from the cache
directory if they are available otherwise we will simply download them
during the XCI execution phase.

Change-Id: I2a8391650558511668654c6b54a10db316f867a2
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "Bump bifrost sha and set UPPER_CONSTRAINTS_FILE"
Markos Chandras [Wed, 7 Mar 2018 17:40:09 +0000 (17:40 +0000)]
Merge "Bump bifrost sha and set UPPER_CONSTRAINTS_FILE"

7 years agoMerge "Remove opnfv vm from known_hosts"
Fatih Degirmenci [Wed, 7 Mar 2018 16:02:20 +0000 (16:02 +0000)]
Merge "Remove opnfv vm from known_hosts"

7 years agoBump bifrost sha and set UPPER_CONSTRAINTS_FILE 39/53239/2
Fatih Degirmenci [Wed, 7 Mar 2018 13:11:17 +0000 (14:11 +0100)]
Bump bifrost sha and set UPPER_CONSTRAINTS_FILE

The lack of UC means that pip is attempting to install libvirt-python 4.1.0,
which is failing on Ubuntu due to
    https://bugs.launchpad.net/openstack-requirements/+bug/1753539.
Currently upper-constraints limits libvirt-python to 4.0.0, which does not
have this issue.

Change-Id: Idc97a0d9928cebafc9167614723236d2584cc93f
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoxci: Make few of OpenStack-Ansible components optional 93/52993/4
Markos Chandras [Fri, 2 Mar 2018 14:06:53 +0000 (14:06 +0000)]
xci: Make few of OpenStack-Ansible components optional

Ironic and Horizon are not quite needed for a functional deployment
and they are not currently required by functest so we can remove them
from the default deployment.

Change-Id: I171483f7b774951f84687529e98cb519afa48043
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: Bump SHAs to the latest stable/queens 91/52991/1
Fatih Degirmenci [Fri, 2 Mar 2018 13:49:13 +0000 (13:49 +0000)]
xci: Bump SHAs to the latest stable/queens

Rocky is still in early stages of development so bump SHAs to the
latest version for Queens.

Change-Id: I0721e6188889c3548c266c042414397385b85ca2
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoMerge "Pin kubespray to working sha"
Fatih Degirmenci [Fri, 2 Mar 2018 10:37:13 +0000 (10:37 +0000)]
Merge "Pin kubespray to working sha"

7 years agoPin kubespray to working sha 27/52927/2
Fatih Degirmenci [Thu, 1 Mar 2018 10:02:22 +0000 (10:02 +0000)]
Pin kubespray to working sha

Kubespray works fine on supported distros so it is important we pin
the sha and bump it in a controlled manner since people might be trying
xci/k8 scenario and we want them to have working versions.

Apart from that, scenario specific verify/merge jobs are being created
at the moment and we need a working version to test the CI/testing side
of things.

Change-Id: I8702ed697057386449dc99d8cd14391de18f345a
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoRemove opnfv vm from known_hosts 49/52949/1
Fatih Degirmenci [Thu, 1 Mar 2018 18:05:17 +0000 (18:05 +0000)]
Remove opnfv vm from known_hosts

Change-Id: I21998a31a26a201d767734d574ade8db7fd50c92
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoDo not fail the if virsh command fails 43/52943/1
Fatih Degirmenci [Thu, 1 Mar 2018 14:31:03 +0000 (14:31 +0000)]
Do not fail the if virsh command fails

Change-Id: Id9c55b45719399c6c78c0d3d8b97926a2907b7f8
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoos-odl-bgpvpn scenario support 05/48705/14
Periyasamy Palanisamy [Tue, 12 Dec 2017 09:22:43 +0000 (10:22 +0100)]
os-odl-bgpvpn scenario support

- Integrate XCI with outband od-odl-bgpvpn role
- Install python-neutronclient on opnfv vm for the
  openstack bgpvpn specific cli commands

Change-Id: Ib737349e2b2429bd366881f1e3657daf8c5c30ac
Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
7 years agoBe quiet while downloading images 57/52857/3
Fatih Degirmenci [Wed, 28 Feb 2018 18:48:25 +0000 (18:48 +0000)]
Be quiet while downloading images

Change-Id: I8848d5bae22a408482d51a84636d230d25ca22be
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agofunctest: Move run-functest.sh execution out of ansible 17/52817/4
Fatih Degirmenci [Wed, 28 Feb 2018 11:37:52 +0000 (11:37 +0000)]
functest: Move run-functest.sh execution out of ansible

Ansible throws out the log at the end of task execution which
makes it hard to read. This change renames the role to prepare-functest
and then takes the script execution out which will be executed by
releng/jjb/xci/xci-run-functest.sh.

Change-Id: Icf399ce4f04357814ed7109cd11113a9decddc50
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoEnsure the ssh config files are created per distro 61/52861/2
Fatih Degirmenci [Wed, 28 Feb 2018 18:25:14 +0000 (18:25 +0000)]
Ensure the ssh config files are created per distro

If 2 jobs for different distros start on the same host, the
generated xci-vm-config files might be rewritten by both jobs
causing trouble for the other. This change creates ssh config
per distro to prevent potential issues.

Change-Id: If6c0a86fd51bf3ba920e9206849ed1537894c7e1
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoFix the proxy command and hostname for opnfv vm in ssh config 37/52837/1
Fatih Degirmenci [Wed, 28 Feb 2018 15:11:38 +0000 (15:11 +0000)]
Fix the proxy command and hostname for opnfv vm in ssh config

Change-Id: Ic036a4f5ef8b24b88154f9314957339d3954839a
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoxci: script: start-new-vm: Switch to using 'curl' instead of 'wget' 71/52771/2
Markos Chandras [Tue, 27 Feb 2018 16:13:04 +0000 (16:13 +0000)]
xci: script: start-new-vm: Switch to using 'curl' instead of 'wget'

curl supports the 'retry' argument to handle all sorts of connection
problems so we can use it to retry if we encounter a broken connection.

Change-Id: I3c8afd2be36ee36c5477f05495704bbbee5b9757
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoxci: scripts: start-new-vm: Mask the pgrep exit code 35/52735/1
Markos Chandras [Tue, 27 Feb 2018 12:10:17 +0000 (12:10 +0000)]
xci: scripts: start-new-vm: Mask the pgrep exit code

pgrep will exit with non-zero exit code if it didn't find a matching
process. This breaks the script since we set 'errexit' so we need to
mask it by simply piping it to a 'cat' command.

Change-Id: I80dcf06b597a769242bd59d628bbd8e09f0f199e
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "xci: scripts: vm: start-new-vm.sh: Re-arrange debug messages"
Markos Chandras [Tue, 27 Feb 2018 10:34:17 +0000 (10:34 +0000)]
Merge "xci: scripts: vm: start-new-vm.sh: Re-arrange debug messages"

7 years agoMerge "xci: config: env-vars: Allow git urls overrides"
Markos Chandras [Mon, 26 Feb 2018 21:59:27 +0000 (21:59 +0000)]
Merge "xci: config: env-vars: Allow git urls overrides"

7 years agoRename var XCI_LOOP to CI_LOOP to align with Functest 67/52167/2
Fatih Degirmenci [Wed, 14 Feb 2018 20:25:31 +0000 (21:25 +0100)]
Rename var XCI_LOOP to CI_LOOP to align with Functest

Change-Id: I1d58f55a1bda258cc3afbfb81e2dd5a1c8e792a1
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
7 years agoMerge changes I15f5d41f,I7c7125ac
Fatih Degirmenci [Mon, 26 Feb 2018 10:34:39 +0000 (10:34 +0000)]
Merge changes I15f5d41f,I7c7125ac

* changes:
  Export CI_LOOP as expected by Functest
  Export an new var related to Energy

7 years agoMerge "XCI: k8s: Add support for CentOS distro"
Markos Chandras [Mon, 26 Feb 2018 10:28:22 +0000 (10:28 +0000)]
Merge "XCI: k8s: Add support for CentOS distro"

7 years agoMerge "xci: osa: configure-opnvhost: Set time in the opnfv node"
Markos Chandras [Mon, 26 Feb 2018 09:41:48 +0000 (09:41 +0000)]
Merge "xci: osa: configure-opnvhost: Set time in the opnfv node"

7 years agoMerge "xci: Switch default CPU model to 'host-model'"
Markos Chandras [Mon, 26 Feb 2018 09:41:40 +0000 (09:41 +0000)]
Merge "xci: Switch default CPU model to 'host-model'"

7 years agoExport CI_LOOP as expected by Functest 85/51985/4
Cédric Ollivier [Sat, 10 Feb 2018 12:04:00 +0000 (13:04 +0100)]
Export CI_LOOP as expected by Functest

CI_LOOP is hardcoded to daily (the common default value) [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/51981/

Change-Id: I15f5d41f7f10a5c8fddcc4a4d303552ef45c5fb2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoExport an new var related to Energy 47/51947/4
Cédric Ollivier [Fri, 9 Feb 2018 06:34:31 +0000 (07:34 +0100)]
Export an new var related to Energy

It conforms with "Unlink Energy from functest utils and constants":
https://gerrit.opnfv.org/gerrit/#/c/51943/

Depends-On: Iecd5d49b4d4c961c9dc51e43e54df1fcd4027266
Change-Id: I7c7125ac2fee9a2e8f24dcf060bdaab1b39ae552
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoxci: osa: configure-opnvhost: Set time in the opnfv node 39/52539/1
Markos Chandras [Fri, 23 Feb 2018 16:41:39 +0000 (16:41 +0000)]
xci: osa: configure-opnvhost: Set time in the opnfv node

Set the time properly in the opnfv node like we do for the target hosts

Change-Id: I97d9f875dbb37db3cedd87e5915bc5b5f9a7a0ad
Signed-off-by: Markos Chandras <mchandras@suse.de>