gerrit.opnfv Code Review - kuberef.git/log

Update documentation for Jerma release

This patch updates the content of documentation for the
upcoming OPNFV Jerma release.

Change-Id: I9618f2a14cfb85f464ca8817ac86d6b9e011ab1c
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/71478
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Victor Morales <chipahuac@hotmail.com>
Reviewed-by: Michael Pedersen <michaelx.pedersen@intel.com>

Adding scripts for running RC2 testcases

This patch adds support for running RC2 Functest
testcases suite on the K8s cluster deployed by
Kuberef deployer.

It leverages on Gitlab CI/CD variables to prepare
next Docker runners (for the time being, the
deployment script wrongly forces Shell runners).

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I7652aa817ad9b434235abf0fab9ba63f4ad2f23e
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/71188
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Cedric Ollivier <cedric.ollivier@orange.com>

Add support for deploying to Equinix Metal bare-metal servers

Adds an additional hw_config which is simplified (equinix-metal).
Adds support for skipping HW provisioning (pre-provisioned through EM).
Usage: deploy.sh [k8s]
Adds a few new helper functions, and updates existing to support changes.

Signed-off-by: Michael S. Pedersen <michaelx.pedersen@intel.com>
Signed-off-by: Victor Morales <v.morales@samsung.com>
Change-Id: I2f84c662d183ba224e0edd8a218abe8b46c1fe45
Signed-off-by: Victor Morales <v.morales@samsung.com>
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/71301
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Rihab Banday <rihab.banday@ericsson.com>
Reviewed-by: Victor Morales <chipahuac@hotmail.com>

Switch to older settings for ansible playbooks and
VM creation steps

This change introduces two (older) settings needed for
CentOS 7 which were removed by recent patches that were
tested only on Ubuntu 16.04. These settings have been
already tested on Ubtunu 16.04.

Change-Id: I3039d650b59869d45e11afdda8827c850f686195
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>
Co-Authored-By: Victor Morales <v.morales@samsung.com>
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/71233
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Georg Kunz <georg.kunz@ericsson.com>

Fix linting issues

This change fixes some linting issues accumulated from previous
patchsets and ignored by the CI jobs.

Signed-off-by: Victor Morales <v.morales@samsung.com>
Change-Id: I0bf2e67aee786505e9c01570d4d8d99df62b1f9f
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/71377
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Tested-by: Georg Kunz <georg.kunz@ericsson.com>
Reviewed-by: Georg Kunz <georg.kunz@ericsson.com>
Reviewed-by: Michael Pedersen <michaelx.pedersen@intel.com>

Refactor functions.sh script

This change refactors some common instructions used by the functions.sh
script.

Signed-off-by: Victor Morales <v.morales@samsung.com>
Change-Id: Ic8cf3cfdd4a46d6fc32f45e4021a07cadc027736
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/71378
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Georg Kunz <georg.kunz@ericsson.com>
Reviewed-by: Michael Pedersen <michaelx.pedersen@intel.com>
Reviewed-by: Rihab Banday <rihab.banday@ericsson.com>

Added structure for OPNFV documentation

Having this structure in place is a requirement for passing release
milestone M2. This change does not modify the content of the
current documentation / deployment guide.

Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
Change-Id: I07e8820901970da1199f4a474161e49f25707ecc
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/71298
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Michael Pedersen <michaelx.pedersen@intel.com>
Reviewed-by: Sofia Wallin <sofia.wallin@est.tech>

Modify setup_network function to add support for Node 3-5

This change modifies setup_network function to add support
for configuring networking for pod 19 node 3,4 and 5.

Change-Id: I9cbdedfe57b86b0b64f96a51ede0ad7b2490d797
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/71243
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Georg Kunz <georg.kunz@ericsson.com>
Reviewed-by: Victor Morales <chipahuac@hotmail.com>

Update check of libvirt(d) group

Current check assumes whitespaces on either side of group name.
This patch removes that assumption

Signed-off-by: Michael S. Pedersen <michaelx.pedersen@intel.com>
Change-Id: I4802420530be05831b8611b812c9866055cac714
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/71257
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Victor Morales <chipahuac@hotmail.com>
Reviewed-by: Georg Kunz <georg.kunz@ericsson.com>

Add yq checker

The yq parser is required by the deploy.env file to extract values from
PDF and IDF files. This change ensures that binary is present.

Signed-off-by: Victor Morales <v.morales@samsung.com>
Change-Id: I5400bc4910ea88da74fab188bf1cfdbebe3cbed1
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/71230
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Rihab Banday <rihab.banday@ericsson.com>
Reviewed-by: Georg Kunz <georg.kunz@ericsson.com>

Updated PDF and IDF for Intel POD 19

This change updates the config files for Intel
POD 19 based on recent hardware updates. Additionally it
adds config for node 3, 4 and 5.

Change-Id: I3a8caf6c8f273567057e325ab27d65f8920ba4ad
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/71234
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Victor Morales <chipahuac@hotmail.com>
Reviewed-by: Georg Kunz <georg.kunz@ericsson.com>

Adding .gitlab-ci.yml for GitLab

This patch introduces .gitlab-ci.yml file to
test the e2e deployment and RC2 testcases suite
in GitLab.

Change-Id: If9e39d42a433611e35ced296c60dcb4d2ffbe5a2
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/70894
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Tested-by: Georg Kunz <georg.kunz@ericsson.com>
Reviewed-by: Victor Morales <chipahuac@hotmail.com>
Reviewed-by: Georg Kunz <georg.kunz@ericsson.com>

Rendering BMRA inventory from IDF and PDF via ansible

This patch adds a simple playbook which renders the BMRA inventory
from the supplied set of PDF and IDF.

Signed-off-by: Georg Kunz <georg.kunz@est.tech>
Change-Id: I2cd555440ad51594d5a2b482bfad085769d0e4e0
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/70892
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Rihab Banday <rihab.banday@ericsson.com>

Separate tox dependencies

Having tox dependencies in a separate file can help to easily track
changes and licenses of them. This change creates a
`test-requirements.txt` for listing those dependencies.

Signed-off-by: Victor Morales <v.morales@samsung.com>
Change-Id: I779055d0d885c7f92c359dab6dae62344ae74600
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/71023
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Rihab Banday <rihab.banday@ericsson.com>

Disable Ansible host key checking in BMRA container

This change avoids the need to copy SSH keys to the
provisioned hosts during BMRA provisioning by loading
the respective env variable inside the BMRA container.

Change-Id: I30cef25f65492da26435259b7f028f79c3b8cb01
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/71081
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Michael Pedersen <michael.soelvkaer@gmail.com>
Reviewed-by: Georg Kunz <georg.kunz@est.tech>

Replace worker node specific config file by a common file

This change replaces the BMRA node1.yml file by a common config
file under group_vars which includes overrides for all the
worker nodes in a cluster.

Change-Id: I305fd227ba0032f80cbf1daa9019fdfd881baa30
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/71074
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Michael Pedersen <michael.soelvkaer@gmail.com>
Reviewed-by: Georg Kunz <georg.kunz@est.tech>

Implementing jump VM create via ansible

This patch reimplements the creation of the jump VM as ansible
playbook. The advantage of this approach is a more deterministic
behavior and the ability to render configuration files using
templates based on the pdf and idf.

Moreover, this patch allows to overwrite the VENDOR variable.
This is necessary to allow deployment in different labs via
CI.

The BMRA configuration has not yet been transformed to ansible
template and needs to follow in subsequent patches.

Signed-off-by: Georg Kunz <georg.kunz@est.tech>
Signed-off-by: Victor Morales <v.morales@samsung.com>
Change-Id: I2cde41dcecec7480bddf71ed864f06244a89f1f3
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/70882
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Victor Morales <chipahuac@hotmail.com>

Fixing broken copy of BMRA host_vars

The host_vars directory is not correctly copied during deployment
resulting in a deployment failure.

Signed-off-by: Georg Kunz <georg.kunz@est.tech>
Change-Id: Ic56c9073d7f535245aafe9b962b627622052a9a0
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/70893
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Rihab Banday <rihab.banday@ericsson.com>

Adding checks for installation prerequisites

This patch adds a few preliminary checks for installation prerequisites,
currently covering software dependencies and runtime prerequisites. More
checks need to be added over time.

Signed-off-by: Georg Kunz <georg.kunz@est.tech>
Change-Id: Ic59b99873983511b74ebdce06d3aeb2ade318a76
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/70841
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Victor Morales <chipahuac@hotmail.com>
Reviewed-by: Rihab Banday <rihab.banday@ericsson.com>

Extending PDF and IDF of Ericsson pod2 to all nodes

Pod2 of the Ericsson OPNFV lab should be used for CI jobs deploying RI2
on all 5 nodes. This adds the missing hardware infos for provisinioning
all 5 nodes.

Note: The BMRA deployment still considers only 2 nodes. This will be addressed
in a separate patch.

Signed-off-by: Georg Kunz <georg.kunz@est.tech>
Change-Id: Ie31365cf04f6fc041d3173099e7c2e8f7020d6b8
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/71022
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Victor Morales <chipahuac@hotmail.com>
Reviewed-by: Rihab Banday <rihab.banday@ericsson.com>

Fix PyYAML error caused by net-attach-defs-create role in BMRA

This change modifies net-attach-defs-create role to fix PyYAML
errors discovered during installation of openshift package on
remote nodes.

Change-Id: I45d9fef77942b8bec0bfc5fb50d8be53c96adb75
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/70839
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Georg Kunz <georg.kunz@est.tech>

Fixing linting errors

Fixing linting errors raised by shellcheck.

Signed-off-by: Georg Kunz <georg.kunz@est.tech>
Change-Id: I3996b81d930724cf37a855649c615782d756d809
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/70895
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Reviewed-by: Rihab Banday <rihab.banday@ericsson.com>

Fix linting issues

The CI job has been enabled and there are some issues reported by
tox and shellcheck. This change fixes them.

Signed-off-by: Victor Morales <v.morales@samsung.com>
Change-Id: I2678dbfeffdce61aa330aa9bba36010622f7227e
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/70890
Tested-by: jenkins-ci <jenkins-opnfv-ci@opnfv.org>
Tested-by: Georg Kunz <georg.kunz@est.tech>
Reviewed-by: Rihab Banday <rihab.banday@ericsson.com>
Reviewed-by: Georg Kunz <georg.kunz@est.tech>

PDF and IDF for Ericsson pod 2 to be used in CI

Pod 2 is meant to be used for verification deployment jobs. This
patch adds the PDF and IDF config files for this pod.

Signed-off-by: Georg Kunz <georg.kunz@est.tech>
Change-Id: I33231547921e82cf77c7051e6ba0319ffb66a09a
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/70826
Reviewed-by: Victor Morales <chipahuac@hotmail.com>
Tested-by: Rihab Banday <rihab.banday@ericsson.com>

Always copy configuration data inside jump VM

This helps to pick up changes between redeploys.

Signed-off-by: Georg Kunz <georg.kunz@est.tech>
Signed-off-by: Victor Morales <v.morales@samsung.com>
Change-Id: I4a1b23ad4187f63cbb2b638f62fb463ed2b37af5
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/70706
Reviewed-by: Victor Morales <chipahuac@hotmail.com>
Reviewed-by: Rihab Banday <rihab.banday@ericsson.com>
Tested-by: Rihab Banday <rihab.banday@ericsson.com>

Dockerfile of the container that installs BMRA

This change adds a Dockerfile for building a container with
all the dependencies required to install BMRA. Currently, the
tooling uses a pre-built image, but this file can be useful
during troubleshooting issues.

Change-Id: Ibe086da10f3ece069327cee521af6f7fbe990a8f
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>
Reviewed-on: https://gerrit.opnfv.org/gerrit/c/kuberef/+/70838
Reviewed-by: Victor Morales <chipahuac@hotmail.com>
Reviewed-by: Georg Kunz <georg.kunz@est.tech>
Tested-by: Georg Kunz <georg.kunz@est.tech>

Ignore E006 bashate rule

The E006 bashate rule enforces to use less than 80 characters per line.
Even when this is a good practice to be enforced most of the time makes
development process harder so we can skip it for now.

Signed-off-by: Victor Morales <v.morales@samsung.com>
Change-Id: Id0468b707bda01d719af36c57c6d1ce54246dae1

Merge ""Better" pattern matching for name of jump VM"

Merge "Disable strict host checking everywhere"

Merge "Adding Deployment Guide"

Merge "Set Jumpbox root's password"

Fix minor bugs observed in hw_config files

This patch fixes minor bugs observed in hw_config files:

1. Rename admin network to public in Intel's IDF to have
consistent network naming schemes across IDF's.

2. Remove arbitary/unverified VLAN's from Intel's PDF.

3. Move shebang to top to fix linting error.

Change-Id: Ibad63e80431880ef5558864bf890dd1877400b08
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>

Adding Deployment Guide

This patch adds a deployment guide that describes the steps to initiate
the deployment.

Change-Id: I1835c0b6eee5945990ae078a20d2e2c92516c6b1
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>

Set Jumpbox root's password

Every OS has different root's passwords which complicates the
throubleshooting process. This change sets the root password of
the jumpbox to what's defined in the ROOT_PASSWORD env variable.

Signed-off-by: Victor Morales <v.morales@samsung.com>
Change-Id: I7b926f9500de9341a660b86ccb1c9eafbfaf6053

Disable strict host checking everywhere

Disable stricty host key checking for all SSH commands.

Signed-off-by: Georg Kunz <georg.kunz@est.tech>
Change-Id: Id08a4e2ef3f441b2a3ba20868c4e3af7fc04c1c5

"Better" pattern matching for name of jump VM

The pattern currently used matches also non-exact hits, such as
"jumphost" and "xci-jumphost". This tweak attempts to achieve better
exact word matches. Note: the -w option of grep does not seem to do
the trick as well.

Signed-off-by: Georg Kunz <georg.kunz@est.tech>
Change-Id: I8cb98a5540a41f5e6044efe12584403b7f4398df

Update env variable extraction and VM creation steps

This change uses YAML parser to extract environmental variables from PDF
and IDF. Additionally it merges the VM creation step with the main
functions script.

Change-Id: I2089b7a84f15e892d57fbadf06252db8769f0fbf
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>

Merge "Remove creation of httpboot folder"

Merge "Remove double quotes around EOF"

Remove creation of httpboot folder

Remove creation of httpboot folder and manual copy
of CentOS 7 image as the support is now added
upstream by [1] and [2].

[1] https://gerrit.nordix.org/c/infra/provisioner/bifrost/+/5547
[2] https://gerrit.nordix.org/c/infra/stack/ironic/+/5550

Change-Id: I3eae2816091e2631d2170f9950fedd2f13e84db7
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>

Remove double quotes around EOF

The double quotes introduced by linting tool
around EOF in functions.sh causes issues during
deployment in CentOS. This change removes the double quotes.

Change-Id: I23f4739e9bfbde296c48d4cf260b8483a844fd0b
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>

Improve wait instruction

The time that the jumpbox takes can be different every time that is
created so waiting for a specific state can help during the creation.

Signed-off-by: Victor Morales <v.morales@samsung.com>
Change-Id: Idee038556bc669594660a308e405e79fe13ba118

Merge "Implement linting process"

Merge "Adding pdf and idf for Ericsson pod 1"

Implement linting process

This commit pretends to make changes required by yamllint and shellcheck
tools.

Signed-off-by: Victor Morales <v.morales@samsung.com>
Change-Id: I73b0a3b54f89b2692c1c3af7940a3acf1124fadb

Adding pdf and idf for Ericsson pod 1

This adds the pod descriptor file and installer descriptor file
for Ericsson pod 1.

Signed-off-by: Georg Kunz <georg.kunz@est.tech>
Change-Id: Ie518f71a35b657ef4a7b17464cb8f0e4116a3771

Merge "Drop VM_IP environment variable"

Drop VM_IP environment variable

It's not necessary to declare this variable because the IP address
of the jumpbox can retrieved calling the get_vm_ip function.

Signed-off-by: Victor Morales <v.morales@samsung.com>
Change-Id: I92f29a70ea1924eb105d66781d9d313427e2d1f0

Adding gitignore file to repo

Signed-off-by: Georg Kunz <georg.kunz@est.tech>
Change-Id: I87faf75ee5801259fb2bdb1534934d84fc2b3a5d

Adding Victor Morales as committer to Info file

Change-Id: I101159dcf90247ecdc75153a0826eea2d975e5d2
Signed-off-by: Georg Kunz <georg.kunz@est.tech>

Merge "Automation adds INFO.yaml"

Initial structure for e2e deployment scripting

This patch includes the initial skeleton of the e2e deployment
tooling. This is expected to evolve as further development progresses.

Change-Id: Ie1e334e672acb2213e8f6c2174506b685f826f98
Signed-off-by: Rihab Banday <rihab.banday@ericsson.com>