fuel.git
7 years agoCleanup outdated salt keys 05/39805/1
Michael Polenchuk [Mon, 21 Aug 2017 16:36:14 +0000 (20:36 +0400)]
Cleanup outdated salt keys

Remove keys that are left over from the previous deployment
to avoid interfere with the new ones.

Change-Id: I0dfa9782cbce9a8e8b7c1efe5954c8ffe85996f9
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoSwap vcp nodes interfaces 03/39803/1
Michael Polenchuk [Mon, 21 Aug 2017 15:38:38 +0000 (19:38 +0400)]
Swap vcp nodes interfaces

In order to connect to right underlay
bridge, swap interfaces.

Change-Id: I0ae1f50e8d1f3485404bd7e6eea772cab555b313
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoMerge "virtual: odl-router: Stop overriding Ubuntu repos"
Alexandru Avadanii [Mon, 21 Aug 2017 15:09:35 +0000 (15:09 +0000)]
Merge "virtual: odl-router: Stop overriding Ubuntu repos"

7 years agoMerge "maas: Break infinite loops into finite retries"
Alexandru Avadanii [Mon, 21 Aug 2017 15:04:35 +0000 (15:04 +0000)]
Merge "maas: Break infinite loops into finite retries"

7 years agoCheck out all vcp nodes are available 67/39767/1
Michael Polenchuk [Mon, 21 Aug 2017 13:12:29 +0000 (17:12 +0400)]
Check out all vcp nodes are available

Change-Id: I86bb27b323152440e8a885dbf867da433a288dae
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agomaas: Break infinite loops into finite retries 85/39685/1
Alexandru Avadanii [Sun, 20 Aug 2017 15:52:56 +0000 (17:52 +0200)]
maas: Break infinite loops into finite retries

While at it, move the bash commands to a separate script file.

Change-Id: Ib78b5b7f7083ed866e5d42e8340df7b27198f276
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agopatches: Add missing patch metadata line 63/39663/1
Alexandru Avadanii [Sat, 19 Aug 2017 21:56:46 +0000 (23:56 +0200)]
patches: Add missing patch metadata line

Change-Id: I35735c0d35c6004c546a704cee3d6d94ce077225
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoMaaS: Add support for dynamic fabric numbering 61/39661/1
Alexandru Avadanii [Sat, 19 Aug 2017 21:33:42 +0000 (23:33 +0200)]
MaaS: Add support for dynamic fabric numbering

Previously, we hardcoded the fabric name for our 3rd interface
(which serves PXE/DHCP for the target nodes) to "fabric-2",
relying on predictable index numbers to be provided by MaaS based
on the interfaces defined in /etc/network/interfaces.

However, the fabric IDs/names generated by MaaS are not predictable,
and therefore cannot be hardcoded in our reclass model / scripts.

Work around this by:
- adding support for fabric ID deduction based on CIDR matching
  during subnet create/update operation in MaaS py module;
- adding support for VLAN DHCP enablement to MaaS py module,
  which was previously handled via shell MaaS API operations
  from maas/region.sls;

While at it, revert previous commit that disabled network discovery
("MaaS: Disable network discovery"), since it turns out that network
discovery was not the culprit for subnet creation failure, but wrong
fabric numbering.

This reverts commit 8cdf22d1a1bae4694a373873cab4feb6251069b7.

Change-Id: I15fa059004356cb4aaabb38999ea378dd3c0e0bb
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoMerge "MaaS: Disable network discovery"
Alexandru Avadanii [Sat, 19 Aug 2017 01:03:24 +0000 (01:03 +0000)]
Merge "MaaS: Disable network discovery"

7 years agomaas state: Add debug output to grep query loops 51/39651/1
Alexandru Avadanii [Sat, 19 Aug 2017 00:33:34 +0000 (02:33 +0200)]
maas state: Add debug output to grep query loops

Change-Id: Ic47a9dd2d5a4cccc9c4330509d81aba82f777084
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoMaaS: Disable network discovery 47/39647/1
Alexandru Avadanii [Fri, 18 Aug 2017 23:18:02 +0000 (01:18 +0200)]
MaaS: Disable network discovery

In case nodes are already powered on and have an IP in the same
range as the new MaaS DHCP one (e.g. from a previous deploy),
MaaS API will reject the subnet creation due to overlapping
addresses. Try to work around this by disabling network discovery.

Change-Id: I70a33c552bf38a7ccbc1bb7e90c21f424f082bc5
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoMerge "MaaS: DHCP iprange fix: use dynamic, not reserved"
Alexandru Avadanii [Fri, 18 Aug 2017 21:14:14 +0000 (21:14 +0000)]
Merge "MaaS: DHCP iprange fix: use dynamic, not reserved"

7 years agoMaaS: DHCP iprange fix: use dynamic, not reserved 33/39633/1
Alexandru Avadanii [Fri, 18 Aug 2017 21:09:06 +0000 (23:09 +0200)]
MaaS: DHCP iprange fix: use dynamic, not reserved

Without the 'type' parameter set to 'dynamic', MaaS was configured
to reserve the IP range instead of allocating it dynamically.

This led to IP exhaustion warnings in MaaS dashboard, as well as
wrongful IP allocation.

Change-Id: I1f2b90bf4cd2393cfab6d4bc17771cef009701c0
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agomaas.region: Add port to all MaaS API URLs 19/39619/1
Alexandru Avadanii [Fri, 18 Aug 2017 18:42:00 +0000 (20:42 +0200)]
maas.region: Add port to all MaaS API URLs

Change-Id: I6ecc81cc6faf45f33882666b9f537a3e42ad379e
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agomaas.region: Add missing port to maas_url 07/39607/1
Alexandru Avadanii [Fri, 18 Aug 2017 17:02:46 +0000 (19:02 +0200)]
maas.region: Add missing port to maas_url

Change-Id: Iae9991f9148ac518696f9f8b57b5a8ca9dded730
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agolinux.network: Fix noifupdown in linux/map.jinja 05/39605/1
Alexandru Avadanii [Fri, 18 Aug 2017 15:43:05 +0000 (17:43 +0200)]
linux.network: Fix noifupdown in linux/map.jinja

Previous changes attempted to add 'noifupdown' support, but failed
to spell it correctly. Fix the typo and also edit the 'maas' state
to use simple `salt state.apply` instead of `cmd.run 'salt-call'`.

Change-Id: If9889dee896fa100febe0372fe2c4173fc223ee3
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoMaaS node: Fix dhcp_interface config 91/39591/1
Alexandru Avadanii [Fri, 18 Aug 2017 14:08:23 +0000 (16:08 +0200)]
MaaS node: Fix dhcp_interface config

Explicitly configure dhcp_interface for mas01, in order to allow
the interface name to be parametrized via "dhcp_interface" _param.

Change-Id: I6a2750adc1941c0aa1f94ac9b39133b5bd2388c6
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoApply network config on kvm nodes 81/39581/2
Michael Polenchuk [Fri, 18 Aug 2017 10:03:16 +0000 (14:03 +0400)]
Apply network config on kvm nodes

* re-assign ip from interface to bridge
  - install bridge utils
  - make a reboot straight away after network config
* change image source for vcp

Change-Id: I34506ee161337b5d3a4088cfdf3c082d99ccb695
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoMerge "patches: linux.system.single fixed upstream"
Michael Polenchuk [Fri, 18 Aug 2017 06:52:45 +0000 (06:52 +0000)]
Merge "patches: linux.system.single fixed upstream"

7 years agoci/deploy.sh: yum install --skip-broken 59/39559/1
Alexandru Avadanii [Thu, 17 Aug 2017 23:44:17 +0000 (01:44 +0200)]
ci/deploy.sh: yum install --skip-broken

Change-Id: I8098eff73ab15fe58cb357db99df76e1bd160652
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agopatches: linux.system.single fixed upstream 41/39541/3
Alexandru Avadanii [Thu, 17 Aug 2017 18:44:28 +0000 (20:44 +0200)]
patches: linux.system.single fixed upstream

Fixed upstream in [1], drop our patch.

[1] https://github.com/Mirantis/reclass-system-salt-model/commit/573be77

Change-Id: Ieeb9b87cac0418d860bbf04e5e8ffd48898a213e
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoMerge "Bring in baremetal support"
Alexandru Avadanii [Thu, 17 Aug 2017 16:40:38 +0000 (16:40 +0000)]
Merge "Bring in baremetal support"

7 years agolib.sh: Fix mcp key owner for OPNFV Jenkins jobs 13/39513/2
Alexandru Avadanii [Thu, 17 Aug 2017 14:48:12 +0000 (16:48 +0200)]
lib.sh: Fix mcp key owner for OPNFV Jenkins jobs

In case of non-root deploys (i.e. running `ci/deploy.sh` without
sudo), the OPNFV Jenkins slave executes it under a user shell,
under a root shell, e.g.:
$ sudo sudo -u jenkins bash
$ echo $USER
jenkins
$ echo $SUDO_USER
root

Adjust lib.sh to only use SUDO_USER when it is not "root".

Change-Id: I6dd1c8a5dd3a3b02cfb760818d66e99f49709a5b
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoBring in baremetal support 55/38855/25
Alexandru Avadanii [Tue, 1 Aug 2017 20:18:41 +0000 (22:18 +0200)]
Bring in baremetal support

- ci/deploy.sh: fail if default scenario file is missing;
- start by copying reclass/classes/cluster/virtual-mcp-ocata-ovs as
  classes/cluster/baremetal-mcp-ocata-ovs;
- add new state (maas) that will handle MaaS configuration;
- Split PXE network in two for baremetal:
  * rename old "pxe" virtual network to "mcpcontrol", make it
    non-configurable and identical for baremetal/virtual deploys;
  * new "pxebr" bridge is dedicated for MaaS fabric network, which
    comes with its own DHCP, TFTP etc.;
- Drop hardcoded PXE gateway & static IP for MaaS node, since
  "mcpcontrol" remains a NAT-ed virtual network, with its own DHCP;
- Keep internet access available on first interfaces for cfg01/mas01;
- Align MaaS IP addrs (all x.y.z.3), add public IP for easy debug
  via MaaS dashboard;
- Add static IP in new network segment (192.168.11.3/24) on MaaS
  node's PXE interface;
- Set MaaS PXE interface MTU 1500 (weird network errors with jumbo);
- MaaS node: Add NAT iptables traffic forward from "mcpcontrol" to
  "pxebr" interfaces;
- MaaS: Add harcoded lf-pod2 machine info (fixed identation in v6);
- Switch our targeted scenario to HA;
  * scenario: s/os-nosdn-nofeature-noha/os-nosdn-nofeature-ha/
- maas region: Use mcp.rsa.pub from ~ubuntu/.ssh/authorized_keys;
- add route for 192.168.11.0/24 via mas01 on cfg01;
- fix race condition on kvm nodes network setup:
  * add "noifupdown" support in salt formula for linux.network;
  * keep primary eth/br-mgmt unconfigured till reboot;

TODO:
- Read all this info from PDF (Pod Descriptor File) later;
- investigate leftover references to eno2, eth3;
- add public network interfaces config, IPs;
- improve wait conditions for MaaS commision/deploy;
- report upstream breakage in system.single;

Change-Id: Ie8dd584b140991d2bd992acdfe47f5644bf51409
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
Signed-off-by: Guillermo Herrero <Guillermo.Herrero@enea.com>
Signed-off-by: Charalampos Kominos <Charalampos.Kominos@enea.com>
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agovirtual: odl-router: Stop overriding Ubuntu repos 05/39205/1
Alexandru Avadanii [Sun, 13 Aug 2017 16:35:24 +0000 (18:35 +0200)]
virtual: odl-router: Stop overriding Ubuntu repos

Keep UCA default apt sources, instead of overriding them with arch
specific values from:
- system.linux.system.repo.ubuntu

Change-Id: I1edc725a97ae6290d316a7916c27fd904f59db04
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoMerge "maas: region: credentials workaround, force sync"
Alexandru Avadanii [Fri, 11 Aug 2017 13:35:24 +0000 (13:35 +0000)]
Merge "maas: region: credentials workaround, force sync"

7 years agoMerge "lib.sh: AArch64: Use VGA video mode for guests"
Alexandru Avadanii [Fri, 11 Aug 2017 13:24:18 +0000 (13:24 +0000)]
Merge "lib.sh: AArch64: Use VGA video mode for guests"

7 years agolib.sh: AArch64: Use VGA video mode for guests 79/39079/2
Alexandru Avadanii [Tue, 11 Jul 2017 16:35:40 +0000 (18:35 +0200)]
lib.sh: AArch64: Use VGA video mode for guests

On AArch64, there is no Cirrus video, so use VGA mode instead.

On Debian systems, also fix a missing link for vgabios-stdvga.bin.
Based on previous Armband work from [1].

[1] https://github.com/opnfv/armband/blob/danube.2.0/patches/fuel-library/
    arm64-bug-fixes/0002-Install-vgabios-and-link-for-aarch64.patch

Change-Id: Ia84ea5536b68e14993b719488375b0041183a767
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoRevert "Switch distrib revision to testing" 25/39125/3
Michael Polenchuk [Fri, 11 Aug 2017 10:30:45 +0000 (10:30 +0000)]
Revert "Switch distrib revision to testing"

There is no much difference between nightly vs testing repos.
This reverts commit 052a1626da71d232431b3a9faf576a76db61f10e.

Change-Id: I40f60ddc2c9e1e59c7c4eb0be59ae19b00b7fb9b
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agomaas: region: credentials workaround, force sync 53/38853/2
Alexandru Avadanii [Sat, 5 Aug 2017 00:25:38 +0000 (02:25 +0200)]
maas: region: credentials workaround, force sync

Workaround the issues described in [1], stating that salt-formula-maas
package cannot set an autogenerated PostgreSQL password, respectively
the known error thrown during initial setup.

FIXME: These should be reverted later, after fixing the MaaS password
update and initial artifact sync in the salt formula / scripts.

[1] https://docs.mirantis.com/mcp/1.0/mcp-deployment-guide/\
    install-base-infra/set-up-bare-metal-provisioner/configure-maas-vm.html

Change-Id: I8b37f55d3caa4119c64f9549578850dd4eb9e3ad
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoSynchronize down all of the dynamic modules 71/38971/1
Michael Polenchuk [Wed, 9 Aug 2017 11:15:36 +0000 (15:15 +0400)]
Synchronize down all of the dynamic modules

Sync all of the salt dynamic modules to make sure custom
modules, states, grains & etc. are on the target nodes.

Change-Id: I04f2ac0465d5381c4c07623e9383619d9b9731de
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoSwitch distrib revision to testing 85/38885/2
Michael Polenchuk [Tue, 8 Aug 2017 07:38:39 +0000 (11:38 +0400)]
Switch distrib revision to testing

In order to avoid bleeding edge issues with nightly version of
salt formulas, switch to "safe" testing repo source.

Change-Id: I9d12f337c3952711cb8843943c23315795064016
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoMerge "ci/deploy.sh: Allow non-root deploys"
Alexandru Avadanii [Sun, 6 Aug 2017 16:56:43 +0000 (16:56 +0000)]
Merge "ci/deploy.sh: Allow non-root deploys"

7 years agoMerge "Set ntp servers list"
Michael Polenchuk [Thu, 3 Aug 2017 08:56:26 +0000 (08:56 +0000)]
Merge "Set ntp servers list"

7 years agoMerge "reclass: opendaylight: Use UCA default repos"
Alexandru Avadanii [Wed, 2 Aug 2017 13:40:07 +0000 (13:40 +0000)]
Merge "reclass: opendaylight: Use UCA default repos"

7 years agoMerge "mcp/config: Move scenario defs to separate dir"
Alexandru Avadanii [Wed, 2 Aug 2017 13:39:48 +0000 (13:39 +0000)]
Merge "mcp/config: Move scenario defs to separate dir"

7 years agoSet ntp servers list 17/38617/1
Michael Polenchuk [Wed, 2 Aug 2017 11:43:10 +0000 (15:43 +0400)]
Set ntp servers list

* set ntp sweden servers list for virtuals
* wrap common cluster init options

Change-Id: I044802998d5498fed969e62bf1ea8c814652f34f
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years ago[odl-router] Bring up public network on computes 97/38597/1
Michael Polenchuk [Wed, 2 Aug 2017 09:10:26 +0000 (13:10 +0400)]
[odl-router] Bring up public network on computes

* apply provider mappings on compute nodes as well
* set default route of computes to gateway node

Change-Id: I5715e34fd8ecbed87bd7f1b1ed488766af711bae
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agomcp/config: Move scenario defs to separate dir 53/38553/1
Alexandru Avadanii [Tue, 1 Aug 2017 20:06:11 +0000 (22:06 +0200)]
mcp/config: Move scenario defs to separate dir

Prepare for adding baremetal scenarios by moving existing scenario
definitions (intended for deploys on virtual PODs) to their own
subdirectory.

Change-Id: Iaa75e0b0a9876e4f263fc6bbae796d97848ef99b
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoci/deploy.sh: Allow non-root deploys 47/38547/1
Alexandru Avadanii [Mon, 17 Jul 2017 23:10:25 +0000 (23:10 +0000)]
ci/deploy.sh: Allow non-root deploys

Currently, deploying Fuel@OPNFV requires the `ci/deploy.sh` to be ran
as root user, for:
- hypervisor access (virsh);
- installing prerequisite packages;

We can support non-root deploys if we relax above restriction into:
- current user should have hypervisor access beforehand
  (new check added);
- current user has passwordless sudo rights, for installing packages;

Later, we should move the package installation out of the deploy
script (`ci/deploy.sh`), making the whole deploy possible without
sudo, only hypervisor access.

After this change, the old way (sudo ci/deploy.sh) should work just
like it used to before, so no regression/behavior change should be
introduced with this.

Change-Id: Ib2ea96aa7b6d67ba0606318407a8adeb51e6969d
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoreclass: opendaylight: Use UCA default repos 45/38545/1
Alexandru Avadanii [Thu, 27 Jul 2017 18:09:46 +0000 (20:09 +0200)]
reclass: opendaylight: Use UCA default repos

Current opendaylight pillar enforces a full apt repository cleanup,
removing Ubuntu Cloud Archive (UCA) repos in favor of adding
pre-hardcoded Ubuntu archive repos.

Unlike UCA, main Ubuntu archive is split based on target arch, the
main archive.ubuntu.com holding only x86 packages, while the other
archs are hosted on ports.ubuntu.com.

This leads to adding (only) x86-specific repositories to our AArch64
UCA image.

Mitigate this by ommiting "system.linux.system.repo.ubuntu" from the
opendaylight pillar, leaving the default UCA repos in place.

Change-Id: Ia7033bcb544d8752d5557bbabc92c92c5008b00c
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoci/deploy.sh: Fix "notify" on dumb terminals 39/38539/1
Alexandru Avadanii [Tue, 1 Aug 2017 17:48:33 +0000 (19:48 +0200)]
ci/deploy.sh: Fix "notify" on dumb terminals

Dumb terminals (which do not support colors), like "vt220",
make `tput setaf` return with an error code, hence bypassing the
actual print.

Change-Id: Id838583beb30a810aec478ed80d452c6f3203e0f
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agosalt.sh: Drop upstream clone in favor of local git 87/38487/1
Alexandru Avadanii [Sat, 29 Jul 2017 20:49:26 +0000 (22:49 +0200)]
salt.sh: Drop upstream clone in favor of local git

salt.sh currently clones the full Fuel@OPNFV git repo from upstream
public mirror, preventing us from testing locally edited or new
patches.

Instead, bring back git submodule handling from old f_repos, clone
and patch each submodule locally, then copy the whole parent repo
over to cfg01.

This is also a first step towards implementing offline deploy support.

NOTE: This adds new deploy prerequisite packages:
- git (for submodule clone/update);
- make (for submodule patching);
- rsync (for parent repo replication to cfg01);

NOTE: Parent repository is expected to be a git repo, in order to
work with git submodules.

While at it, perform some minor related changes:
- add deploy artifacts (ISOs, qcow2 files) to .gitignore, also used
  to filter-out such files during rsync to cfg01;
- remove obsolete Fuel patches (old f_repos mechanism);
- rename "reclass-system-salt-model" submodule;

Change-Id: I6210d80d41010b2802e4f1b31acf249a18db7963
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agomcp/scripts: shellcheck cleanup 59/38459/2
Alexandru Avadanii [Fri, 28 Jul 2017 22:34:31 +0000 (00:34 +0200)]
mcp/scripts: shellcheck cleanup

Change-Id: I280d540b461341e14de654186016248eba4d3521
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoci/deploy.sh: MCP cleanup, sanity checks 57/38457/2
Alexandru Avadanii [Fri, 28 Jul 2017 01:50:09 +0000 (03:50 +0200)]
ci/deploy.sh: MCP cleanup, sanity checks

- disable false-positive shellcheck errors;
- fix obsolete backtick usage;
- move obsolete arguments to separate section;
- add color-enabled "notify" macro for warn/err messages;
- remove obsolete code intended for old Fuel;
- fix quoting and double-quoting shellcheck warnings;
- minor code changes for better readability;
- remove "no healthcheck" flag (obsolete);
- add mandantory arguments validation;

Change-Id: I991836adc8d76466f2b83b1e472bb9ef6989fff3
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoci/deploy.sh: Rework bridge arguments for MCP 43/38443/3
Alexandru Avadanii [Tue, 25 Jul 2017 17:11:56 +0000 (19:11 +0200)]
ci/deploy.sh: Rework bridge arguments for MCP

Change-Id: I20d6dedeaa31f7986eaa35be49c5388c3fdb4b83
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agolib.sh: Use host-passthrough when spawning VMs 85/38385/2
Alexandru Avadanii [Fri, 21 Jul 2017 17:59:33 +0000 (19:59 +0200)]
lib.sh: Use host-passthrough when spawning VMs

virsh defaults to using "host-model" instead of "host-passthrough",
which not only might lead to a small performance hit on x86, it is
also causing compatibility issues with libvirt 3.x.

Address this by explicitly requesting "host-passthrough" as the
CPU model for virt-install.

Change-Id: Ia7c5e8ff906c02fed2193c268cbb3594c5607bc6
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years ago[odl-router] Add missing nodes config 21/38421/1
Michael Polenchuk [Mon, 31 Jul 2017 08:32:09 +0000 (12:32 +0400)]
[odl-router] Add missing nodes config

Change-Id: Id7603aa581e4ccdddad1cf93f9434fe95c047800
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoSet key owner to original user in case of sudo 15/38415/1
Michael Polenchuk [Mon, 31 Jul 2017 07:45:30 +0000 (11:45 +0400)]
Set key owner to original user in case of sudo

Change-Id: If964d36ad4f0cb6f1b2caf8544d4e35487f59c6c
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoBring in opendaylight L3/router scenario 79/37479/3
Michael Polenchuk [Fri, 14 Jul 2017 07:11:32 +0000 (11:11 +0400)]
Bring in opendaylight L3/router scenario

Change-Id: I8a3be1764de136e2ecf81f964233483be5d6655a
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agomcp/user-data: Pin saltstack repo to 2016.11 03/38303/1
Alexandru Avadanii [Thu, 27 Jul 2017 22:52:36 +0000 (00:52 +0200)]
mcp/user-data: Pin saltstack repo to 2016.11

Latest saltstack repository recently pushed a new version of
"salt-api" which breaks compatibility with current Fuel@OPNFV code.

For now, let's pin saltstack repo to the most recent stable version.

Change-Id: I2a7e11d4fb50a8c62220f3f29ded5955fa69aef0
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agolib.sh: cleanup_vms: Also remove VMs that use UEFI 13/38213/1
Alexandru Avadanii [Wed, 26 Jul 2017 17:06:31 +0000 (19:06 +0200)]
lib.sh: cleanup_vms: Also remove VMs that use UEFI

Pass `--nvram` to `virsh undefine`, so guest VMs booted using
UEFI (OVMF on x86 or AAVMF on AArch64) can be destroyed.
This does not affect VMs without UEFI.

While at it, fix logical error in previous commit adding support
for cleaning up stopped VMs.

Change-Id: I44c20566469f29a8683d81e3641c69da572ccd4e
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agolib.sh: cleanup_vms: Also remove stopped MCP VMs 11/38211/1
Alexandru Avadanii [Wed, 26 Jul 2017 16:53:04 +0000 (18:53 +0200)]
lib.sh: cleanup_vms: Also remove stopped MCP VMs

In case the cfg01 & co. VMs are in "shut off" state, `virsh --name`
will ommit them, which leads to `cleanup_vms` leaving behind stale
VMs. Add `--all` arg to list all VMs, including stopped ones.

Change-Id: Ia550a10eb0b40138f87ade709336c2871a8b1cd8
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years ago[bugfix]invalid user ‘jenkins’ 87/37787/2
zhihui wu [Wed, 19 Jul 2017 14:26:28 +0000 (22:26 +0800)]
[bugfix]invalid user â€˜jenkins’

See https://build.opnfv.org/ci/job/fuel-deploy-zte-pod1-daily-master/456/console
In lib.sh, generate_ssh_key() assumes that "jenkins" is
the current user name. But on zte-pod1, the ci user name
isn't jenkins. It is better to use $USER replaced "jenkins".

JIRA:FUEL-273

Change-Id: I6ec6847eccd055b8b4062dd202f8f0a24ba6dd73
Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
7 years agoMerge "mcp: openstack: Install & configure horizon"
Alexandru Avadanii [Tue, 18 Jul 2017 15:34:07 +0000 (15:34 +0000)]
Merge "mcp: openstack: Install & configure horizon"

7 years agomcp: openstack: Install & configure horizon 71/37571/1
Alexandru Avadanii [Sat, 15 Jul 2017 17:58:48 +0000 (19:58 +0200)]
mcp: openstack: Install & configure horizon

Change-Id: I2f6b136efebfee95a9a192c40afb88d20bbacef0
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agomcp: lib.sh: virt-install --noautoconsole 69/37569/1
Alexandru Avadanii [Sat, 15 Jul 2017 16:18:55 +0000 (18:18 +0200)]
mcp: lib.sh: virt-install --noautoconsole

When X server is available, virt-install tries opening virt-viewer
automatically (for each newly created VM), which blocks the
deployment until the user closes the virt-viewer window.

Without X, virt-install just throws a warning and moves on.

Fix both of the above by passing the "--noautoconsole" argument to
virt-install.

Change-Id: I7df839aa902f7629dec11d24905fc05d1070f9db
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoTune network sysctl options 75/37375/1
Michael Polenchuk [Thu, 13 Jul 2017 12:35:25 +0000 (16:35 +0400)]
Tune network sysctl options

* tune net/tcp opts
* handle vcpus setting for vms
* fix tempest issue with public subnets visible
* set reclass data source to local to avoid git clone

Change-Id: Ibac9eba8234ebb20854c03b399405968cb2069e8
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoApply reclass patches before salt master init 51/37251/2
Michael Polenchuk [Wed, 12 Jul 2017 08:29:30 +0000 (12:29 +0400)]
Apply reclass patches before salt master init

Change-Id: I7bb984880e98b7bdec9aa0b3895a3be9fd75cac0
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoApply upstream patches 59/37159/2
Michael Polenchuk [Tue, 11 Jul 2017 07:41:08 +0000 (11:41 +0400)]
Apply upstream patches

For opendaylight support:
  * neutron formula
  * reclass system model

Plus missing apply of haproxy state.

Change-Id: Ic9e3672b51d5331656d636c44c3f891e49437e23
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoSet public endpoints to external interface 75/37175/1
Michael Polenchuk [Tue, 11 Jul 2017 11:27:41 +0000 (15:27 +0400)]
Set public endpoints to external interface

In order to pass functest/api_check, configure public endpoints of
openstack core services with external ip address.

Change-Id: I519865df5700acbcf542ea71efd87780e9f1d9d5
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoAlign reclass cluster model of dpdk scenario 69/37069/3
Michael Polenchuk [Fri, 7 Jul 2017 11:42:36 +0000 (15:42 +0400)]
Align reclass cluster model of dpdk scenario

Change-Id: I4fc0c0e040c97e91c79aae2f0142fb6f025081f2
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoEnable cinder volume service 05/37005/2
Michael Polenchuk [Thu, 6 Jul 2017 08:27:56 +0000 (12:27 +0400)]
Enable cinder volume service

Change-Id: I29ad8fc0e504779184fdf3795dc82ce1b031dbf8
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoTurn on opendaylight scenario 27/36927/2
Michael Polenchuk [Tue, 4 Jul 2017 11:54:11 +0000 (15:54 +0400)]
Turn on opendaylight scenario

* fix formula & reclass cluster model
* bring in running states

Change-Id: I8e66e69045f5c745f9aa6f59f7ce6d66b5bf1c95
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoRewrite infra deployment scripts 19/36719/3
Michael Polenchuk [Thu, 29 Jun 2017 11:52:28 +0000 (15:52 +0400)]
Rewrite infra deployment scripts

* bring in scenario files
* shift infra code into functions

Change-Id: I650a26d03d842c3afcc7fcb97b84ef4826827a38
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoBring in opendaylight support 63/36563/4
Michael Polenchuk [Tue, 27 Jun 2017 08:52:39 +0000 (12:52 +0400)]
Bring in opendaylight support

Change-Id: I2eed0cf19907f257be1cb4aee96528cc41f4843a
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoSet salt bootstrap distrib revision 51/36651/1
Michael Polenchuk [Wed, 28 Jun 2017 12:33:27 +0000 (16:33 +0400)]
Set salt bootstrap distrib revision

Change-Id: Id278afd05fd8793f573fce0d4ca1ff7420fc9127
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoGet latest salt-formulas code 45/36645/2
Michael Polenchuk [Wed, 28 Jun 2017 10:47:29 +0000 (14:47 +0400)]
Get latest salt-formulas code

Change-Id: I6284589343bfcdc4f35734d5c291ad0a2bf02d74
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoRemove redundant services from noha scenario 21/36421/1
Michael Polenchuk [Fri, 23 Jun 2017 13:44:33 +0000 (17:44 +0400)]
Remove redundant services from noha scenario

Change-Id: I445f6ac802fbf1b382b18bcb4306eb5538cb1867
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoMake virtual cluster as noha w/ one controller 93/36293/2
Michael Polenchuk [Wed, 21 Jun 2017 10:43:40 +0000 (14:43 +0400)]
Make virtual cluster as noha w/ one controller

* remove glusterfs from cluster
* increase amount of ram on controller
* bring in one more compute node

Change-Id: I04ccd4cdaf65bb860d6d3b9c012e035f598e44d5
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoCorrect ssh key copy options 45/36245/1
Vladimir Blokhin [Tue, 20 Jun 2017 14:36:39 +0000 (17:36 +0300)]
Correct ssh key copy options

Change-Id: Iea7a28fcd2ae59bc3ba76bffb42675dfc4bc917d
Signed-off-by: Volodymyr Blokhin <vladrulez@gmail.com>
7 years ago[mcp] Mend networks config 33/36233/1
Michael Polenchuk [Tue, 20 Jun 2017 10:21:23 +0000 (14:21 +0400)]
[mcp] Mend networks config

* create openstack/neutron external network
* set default gateway for mgmt network

Change-Id: I71c22ab6d1b8c589c1cf147aa37874600ab1cbd7
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years ago[mcp] Set default address for salt master 95/36195/3
Michael Polenchuk [Mon, 19 Jun 2017 14:42:39 +0000 (18:42 +0400)]
[mcp] Set default address for salt master

Change-Id: Iaa9cd3d5734fbf81a224d00ee006b63a66a915f0
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years ago[mcp] Copy ssh key to tmp dir 43/35943/1
Andrii Ostapenko [Fri, 9 Jun 2017 11:39:18 +0000 (14:39 +0300)]
[mcp] Copy ssh key to tmp dir

Copy ssh key to tmp dir to be able to retrieve
OS credentials by releng/utils/fetch_os_creds.sh

Also adds 'set -x' to ci/deploy.sh

Change-Id: I056c626288862f84f47c947461894730ce0483ac
Signed-off-by: Andrii Ostapenko <aostapenko@mirantis.com>
7 years ago[mcp] Mend dpdk scenario 33/35733/3
Michael Polenchuk [Fri, 2 Jun 2017 12:39:58 +0000 (16:39 +0400)]
[mcp] Mend dpdk scenario

Make a reboot of the compute nodes to activate hugepages support
and re-apply required states then. Also align ovs lcore & pmd
masks with two cpu nodes.

Change-Id: I4a5defe6f08e912aba2d939ba5ba057af768a40c
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years ago[mcp] Bring in dpdk scenario support 67/35567/1
Michael Polenchuk [Wed, 31 May 2017 12:12:43 +0000 (16:12 +0400)]
[mcp] Bring in dpdk scenario support

Change-Id: Ifd6d61026a0e98e8faf59c7d218333122d70ffe9
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years ago[mcp] Mend installation scripts 79/35479/1
Michael Polenchuk [Mon, 29 May 2017 09:36:25 +0000 (13:36 +0400)]
[mcp] Mend installation scripts

* add/unify ssh options
* get base image to temporary directory
* specify os type for virt install
* fix symbolic link to reclass
* remove outdated fuel submodules

Change-Id: I6833ce78c8fff97e1b89f4e92e6e6b470e9ce99f
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years ago[mcp] Replace reclass system models with submodule 93/35393/3
Michael Polenchuk [Fri, 26 May 2017 08:12:15 +0000 (12:12 +0400)]
[mcp] Replace reclass system models with submodule

Change-Id: Id693f7b0f3542d605b0f71601f3bd21eb882c7ba
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years ago[mcp] Bring in deployment scripts 67/35267/3
Michael Polenchuk [Wed, 24 May 2017 09:52:02 +0000 (13:52 +0400)]
[mcp] Bring in deployment scripts

Change-Id: I7d2af958e447a5892f7cd1f6c6fb8616951e2ff3
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years ago[mcp] Bring in reclass system salt models 61/35261/1
Michael Polenchuk [Wed, 24 May 2017 08:44:05 +0000 (12:44 +0400)]
[mcp] Bring in reclass system salt models

Change-Id: I1a865b7524f3a5242544e60e6b36b1092721c58b
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoAdding mpolenchuk@mirantis.com to committers list 93/34993/3
agardner [Thu, 18 May 2017 16:53:39 +0000 (12:53 -0400)]
Adding mpolenchuk@mirantis.com to committers list

Change-Id: I973810e55ea24ba879fd91ac47388d52d43867e2
Signed-off-by: agardner <agardner@linuxfoundation.org>
7 years agof_kvmpluginbuild: Allow overrides in config.mk 35/34435/1
Alexandru Avadanii [Mon, 8 May 2017 14:19:27 +0000 (16:19 +0200)]
f_kvmpluginbuild: Allow overrides in config.mk

Change-Id: I2e124e09b884a06ab84864fbf3f2173224a99fc6
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agodocs: Refresh reference for Danube 2.0 91/34291/2
Alexandru Avadanii [Thu, 4 May 2017 16:43:22 +0000 (18:43 +0200)]
docs: Refresh reference for Danube 2.0

Change-Id: If786099581cf8bf685cc2076c21d4c3041610bf7
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoMerge "Revert "Revert "Select the fastest mirror of repos"""
Alexandru Avadanii [Wed, 3 May 2017 16:45:38 +0000 (16:45 +0000)]
Merge "Revert "Revert "Select the fastest mirror of repos"""

7 years agoRevert "Revert "Select the fastest mirror of repos"" 33/34133/2
Michael Polenchuk [Wed, 3 May 2017 12:44:34 +0000 (12:44 +0000)]
Revert "Revert "Select the fastest mirror of repos""

This reverts commit 7785a18f592ecd6eeb307b7bc2f5b134e8e07221.
https://bugs.launchpad.net/fuel/+bug/1669751 has been resolved.

Change-Id: I009cf6cba8aaa7ff2ae625c5067aa4d1570e4793
JIRA: FUEL-261
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoUpdate kvm4nfv commit id 61/34061/2
Yunhong Jiang [Tue, 2 May 2017 19:25:43 +0000 (12:25 -0700)]
Update kvm4nfv commit id

This kvm4nfv commit includes changes for the config file which disable
vt-d by default and has the x2apic enabled.

Change-Id: I2e8085792fb8222dfc59d4ece0ac58ec9a16c1bd
Signed-off-by: Yunhong Jiang <yunhong.jiang@linux.intel.com>
7 years agoMerge "Update the kvm4nfv git commit"
Alexandru Avadanii [Wed, 26 Apr 2017 12:56:21 +0000 (12:56 +0000)]
Merge "Update the kvm4nfv git commit"

7 years agoFix for reap.py giving negative id's for nodes 95/33795/1
Catalina Focsa [Tue, 25 Apr 2017 15:13:12 +0000 (17:13 +0200)]
Fix for reap.py giving negative id's for nodes

Sort node id's as integer values instead of strings
in order to return the actual minimum value
by which the new list of nodes is generated

JIRA: https://jira.opnfv.org/browse/FUEL-208

Change-Id: If59d0d0ff9823076b337b042bceb4a736f1f9153
Signed-off-by: Catalina Focsa <catalina.focsa@enea.com>
7 years agoUpdate the kvm4nfv git commit 69/33769/2
Yunhong Jiang [Tue, 25 Apr 2017 09:03:43 +0000 (02:03 -0700)]
Update the kvm4nfv git commit

Update the kvm4nfv git commit_id to latest kernel, so that it includes
the patch for the bxn driver changes.

Change-Id: I63e58de24d5f993868b6046eb1b93c9e61c9668f
Signed-off-by: Yunhong Jiang <yunhong.jiang@linux.intel.com>
7 years agoMerge "[tacker] Adjust tackerc to v3 of identity api"
Alexandru Avadanii [Mon, 24 Apr 2017 15:30:30 +0000 (15:30 +0000)]
Merge "[tacker] Adjust tackerc to v3 of identity api"

7 years ago[tacker] Adjust tackerc to v3 of identity api 29/33629/1
Michael Polenchuk [Fri, 21 Apr 2017 10:36:41 +0000 (14:36 +0400)]
[tacker] Adjust tackerc to v3 of identity api

JIRA: FUEL-267
Change-Id: Ia0e9ed3298681319c870132628d930175e084bc0
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agof_repobuild: Add remaining packages explicitly 43/33543/1
Alexandru Avadanii [Fri, 7 Apr 2017 18:01:04 +0000 (20:01 +0200)]
f_repobuild: Add remaining packages explicitly

Packetary automatically solves for Fuel@OPNFV:
- base pkgs and their deps;
- bootstrap/target image additional pkgs;
- explicit reqs;

However, corner cases like "pcs", which is not in any of the
above categories - being installed via puppet only, need to be
added to the explicit list.

NOTE: This enables full offline deploys for simple scenarios
(i.e. without any plugins). Each plugin might need additional
packages, which will be handled in further patches.
See the bug report for more information.

JIRA: FUEL-250

Change-Id: Id1d31c98308cdee6cb935627984188561b560ff4
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoMerge "fuel-menu: Align defaults w/ OPNFV bootstrap cfg"
Alexandru Avadanii [Wed, 19 Apr 2017 15:21:32 +0000 (15:21 +0000)]
Merge "fuel-menu: Align defaults w/ OPNFV bootstrap cfg"

7 years ago[kvm-plugin]Modifying kernel modules 17/33117/3
Navya [Fri, 7 Apr 2017 10:07:59 +0000 (15:37 +0530)]
[kvm-plugin]Modifying kernel modules

Omitted the ovs kernel modules from kvmfornfv kernel modules for
the plugin.

Change-Id: Id907b829c843587c7fbd7914e19a243b77e7d5aa
Signed-off-by: Navya Bathula <navyax.bathula@intel.com>
7 years agofuel-menu: Align defaults w/ OPNFV bootstrap cfg 63/33163/1
Alexandru Avadanii [Sun, 9 Apr 2017 12:10:21 +0000 (14:10 +0200)]
fuel-menu: Align defaults w/ OPNFV bootstrap cfg

Instead of overwriting fuel_bootstrap_cli.yaml during post-install,
with a static config which we need to manually sync in OPNFV after
each upstream change, make the whole thing dynamic by syncing (via
patch) fuel-menu's default settings with OPNFV bootstrap.

This allows us to drop the static fuel_bootstrap_cli.yaml.

JIRA: FUEL-266

Change-Id: I132f2a272c764ad0fc84b3e0e0e1222b1fab1cd2
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
7 years agoMerge "build/install: Add USB boot option"
Alexandru Avadanii [Thu, 6 Apr 2017 15:49:42 +0000 (15:49 +0000)]
Merge "build/install: Add USB boot option"

7 years agoMerge "Double allocated memory of fuel master node"
Alexandru Avadanii [Thu, 6 Apr 2017 14:17:40 +0000 (14:17 +0000)]
Merge "Double allocated memory of fuel master node"

7 years agobuild/install: Add USB boot option 67/33067/3
Matei Valeanu [Thu, 6 Apr 2017 10:34:05 +0000 (12:34 +0200)]
build/install: Add USB boot option

Use isohybrid to add MBR for booting via BIOS
from USB flash drives

Also, Makefile "$(wildcard ubuntu-builder/*)" does not expand
to what is expected (does not include ubuntu-builder/Dockerfile),
as it uses a previous cached value.
Check this link for an explanation:
http://stackoverflow.com/questions/41470676/makefile-variable-expansion-with-wildcard-when-rule-creates-new-file

JIRA: FUEL-236

Change-Id: I9c6521a382917822ce930ddf76391c5f3c3a9cb7
Signed-off-by: Matei Valeanu <Matei.Valeanu@enea.com>
7 years agoDouble allocated memory of fuel master node 99/32999/1
Michael Polenchuk [Wed, 5 Apr 2017 09:50:44 +0000 (13:50 +0400)]
Double allocated memory of fuel master node

Rise up allocated memory of fuel master node for virtual envs in order
to avoid swapping and improve performance of overall deployment process.

Change-Id: I04b020b628a9c84f934a9d17e8be98d34fe2a085
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agoUpdate Host OS NTP Servers to pool.ntp.org 79/32779/1
Catalina Focsa [Fri, 31 Mar 2017 12:02:45 +0000 (14:02 +0200)]
Update Host OS NTP Servers to pool.ntp.org

Old *.fuel.pool.ntp.org values are no longer accessible

Change-Id: I0879dbd6a262491b4dc9f24d77fb87a007cbaec8
Signed-off-by: Catalina Focsa <catalina.focsa@enea.com>