apex.git
5 years agoAllow common patches file 09/60909/7
Tim Rozet [Mon, 13 Aug 2018 18:51:09 +0000 (14:51 -0400)]
Allow common patches file

This patch adds allowing for common patches that should be applied to
every scenario to be included. It by default pulls in a file in the
deploy directory 'common-patches.yaml', but can optionally be
overridden.

This patch also includes a patch upstream to fix OSCLI not working
anymore due to breakage with the Cinder version in the overcloudrc.

Change-Id: I97b9efb937deff07e085b9ef75b9799fb65bfc57
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoAllow all in one deployments 51/60751/5
Tim Rozet [Wed, 8 Aug 2018 21:43:55 +0000 (17:43 -0400)]
Allow all in one deployments

This patch adds the ability to deploy all in one single nodes (Control
+ Compute). To enable this functionality do the following for each
deployment type:
 - Baremetal: do not tag any nodes as compute in the inventory file
 - Virtual: use argument '--virtual-computes 0'

JIRA: APEX-548

Change-Id: I22525c9eb21d331129c819449316c26a6fcf522d
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoFix broken clean due to virtualbmc change 07/60807/1
Tim Rozet [Thu, 9 Aug 2018 20:38:08 +0000 (16:38 -0400)]
Fix broken clean due to virtualbmc change

Apex clean is failing when trying to clean vbmcs because the function
was changed in new virtualbmc version. Adding the working version to our
constraints.

JIRA: APEX-631

Change-Id: I62971183669e4a51e841d79892e78b10ea380a1e
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoBump deploy timeout 11/60711/4
Tim Rozet [Tue, 7 Aug 2018 15:50:37 +0000 (11:50 -0400)]
Bump deploy timeout

We are seeing queens baremetal deployments are all failing in step 5 due
to timeout. Not sure why the sudden increase in deployment time, but we
can try increasing the deploy timeout to see if it fixes it.

Also includes a revert for a commit that broke OOO master:
https://bugs.launchpad.net/tripleo/+bug/1785872

Change-Id: I0bcfd5b3ca49b176f901c13b8b432fa29c899188
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoRevert "Fix BGPVPN Queens scenario files to be consistent" 15/60615/1
Ricardo Noriega [Mon, 6 Aug 2018 13:45:32 +0000 (13:45 +0000)]
Revert "Fix BGPVPN Queens scenario files to be consistent"

This reverts commit b88eb3c7a1578cb251282c358fad6d87e7439868.

Change-Id: If5a2548e647de099229824761c6c575ca4f2e815
Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
5 years agoFix BGPVPN Queens scenario files to be consistent 67/60567/1
Ricardo Noriega [Fri, 3 Aug 2018 13:18:06 +0000 (15:18 +0200)]
Fix BGPVPN Queens scenario files to be consistent

Change-Id: Id5b932246020676e1e53438db689e32bc124939e
Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
5 years agoEnable BGPVPN for master deployments 69/60269/18
Ricardo Noriega [Fri, 27 Jul 2018 09:29:41 +0000 (11:29 +0200)]
Enable BGPVPN for master deployments

  - Injection of Quagga tarball via overcloud builder.
  - Extraction and installation of all related packages.
  - It uses SDNVPN artifact repository to download Quagga
    tarball, so there is only one source to test.
  - Modifies bgpvpn scenario files to use OS master branch,
    ODL master branch and containers.

JIRA: APEX-627

Change-Id: Icdbc2853d9531048e23fd6d5e444bd68208d18fc
Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
5 years agoFixes missing NovaPlacement for csit 79/60479/1
Tim Rozet [Wed, 1 Aug 2018 13:10:36 +0000 (09:10 -0400)]
Fixes missing NovaPlacement for csit

Nova Placement should have been on controller.

Change-Id: I9279e56b5cf786c1153af4b09b29e2b215c2f248
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoUse metadata IP instead of FQDN 47/60447/1
Tim Rozet [Tue, 31 Jul 2018 20:14:25 +0000 (16:14 -0400)]
Use metadata IP instead of FQDN

There is an issue with loss of external network connectivity that
prevents cloud init to instances working. This becomes a big problem
with snapshots where there is no external network connectivity. Cloud
init fails because each request takes over 30 seconds to get a response.
This is because in the background neutron metadata agent is proxying the
request to nova metadata agent with an HTTP GET using the FQDN. For
whatever reason, a DNS lookup happens even though the entry exists for
the FQDN in /etc/hosts and waits 30 seconds until timing out. After this
timeout, a 200 OK is sent and metadata works.

This patch modifies the config file for metadata to use nova metadata
server's internal IP rather than FQDN as there is no option in OOO to
use IPs instead of FQDN.

Change-Id: I6960181a227d0002c99aeae5112f59807dc41d7a
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoUpdates CSIT env files 91/60291/1
Tim Rozet [Fri, 27 Jul 2018 16:38:47 +0000 (12:38 -0400)]
Updates CSIT env files

NovaPlacementApi is not needed on compute nodes and is not default on
compute nodes upstream, so removing it. Also adds clustercheck and sql
clients to the both roles.

Change-Id: Ia9d9fb4f115bc9850be46043a03688b55149f5df
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoMerge "Increasing loop device size for baremetal deployments"
Tim Rozet [Fri, 27 Jul 2018 02:01:50 +0000 (02:01 +0000)]
Merge "Increasing loop device size for baremetal deployments"

5 years agoIncreasing loop device size for baremetal deployments 07/60207/6
Ricardo Noriega [Thu, 26 Jul 2018 09:17:37 +0000 (11:17 +0200)]
Increasing loop device size for baremetal deployments

Change-Id: Ib3779733ac27183def6a59f3404cfbe9a3e9a211
Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
5 years agoUpdate OVS in overcloud 17/60217/3
Tim Rozet [Thu, 26 Jul 2018 18:46:24 +0000 (14:46 -0400)]
Update OVS in overcloud

This bug fix is not present in the RDO versions of OVS:
https://bugzilla.redhat.com/show_bug.cgi?id=1544892

The impact of this is that traffic sent through a patch port (like from
br-int to br-ex) will not be sent correctly with OF groups (which ODL
uses). This would cause tenant vlan traffic not to work in our case.

Change-Id: Ia477b174118dcd2d7fb24189c2d093218eb97053
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoDisable undercloud as containers for now 19/60219/2
Tim Rozet [Thu, 26 Jul 2018 19:31:20 +0000 (15:31 -0400)]
Disable undercloud as containers for now

Upstream has moved to install undercloud as containers which breaks our
post undercloud configuration for some services. Disable it for now and
then move to it gracefully in a future patch.

Change-Id: I0cd1a8ddac4ba92734750265d2a16d3ef008f236
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoMerge "Remove obsolete Ceph tags"
Tim Rozet [Thu, 26 Jul 2018 19:01:30 +0000 (19:01 +0000)]
Merge "Remove obsolete Ceph tags"

5 years agoRemove obsolete Ceph tags 09/60109/9
Ricardo Noriega [Mon, 23 Jul 2018 10:14:59 +0000 (12:14 +0200)]
Remove obsolete Ceph tags

  This patch removes the logic to use an specific tag for
  Ceph containers. We will use whatever docker image TripleO
  upstream uses. For aarch64, an ansible task will replace
  the tag to pull the proper container image.

  This patch also refactors the preparation of the local
  registry. In Queens, there is no need to execute twice
  the overcloud container image prepare command.

JIRA: APEX-622

Change-Id: I947d931609e58505675bb460a59d08c1d10d1d0b
Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
5 years agoOpen port 8101 on controllers for karaf 63/60163/3
Tim Rozet [Tue, 24 Jul 2018 15:21:06 +0000 (11:21 -0400)]
Open port 8101 on controllers for karaf

By default 8101 (karaf shell) is blocked on controllers. In Apex we
advertise in our user guide (and tools scripts) the ability to connect
to karaf shell. It is also required to run CSIT. This patch opens the
port when ODL is deployed.

Change-Id: Ib3ece41f19607bafc329d9de390cf774766a26cd
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoMerge "Fixes for snapshots"
Tim Rozet [Sat, 21 Jul 2018 03:34:09 +0000 (03:34 +0000)]
Merge "Fixes for snapshots"

5 years agoFixes for snapshots 53/60053/3
Tim Rozet [Fri, 20 Jul 2018 14:34:39 +0000 (10:34 -0400)]
Fixes for snapshots

With deploying snapshots with a new ODL, we currently bring down the
docker container and bring up the tar.gz distro of ODL on the Overcloud
host itself (not rebuilding/using container). Therefore we need java
installed so that ODL can run on the host. In the future this may
change, but it works well and keeps things simple for now.

Additionally, there was a change upstream to make the opendaylight
container docker restart policy "unless-stopped" which means it will
no longer restart automatically when docker is stopped/started.
Therefore on first snapshot bring up (without the previously mentioned
ODL reinstallation) the container does not start, and snapshot
deployment fails. This patch includes a change to the restart policy to
always restart it.

Change-Id: Icc712ba147e578a28e371313154ae3190676f0dc
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoFixes missing csit queens file in setup.cfg 51/60051/1
Tim Rozet [Fri, 20 Jul 2018 13:24:23 +0000 (09:24 -0400)]
Fixes missing csit queens file in setup.cfg

Change-Id: I6d57c88efc88dba311e79a36024683d5a9ade679
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoMerge "Add tenant vlan support"
Tim Rozet [Fri, 20 Jul 2018 00:24:47 +0000 (00:24 +0000)]
Merge "Add tenant vlan support"

5 years agoAdd tenant vlan support 87/59287/6
Feng Pan [Fri, 29 Jun 2018 03:48:05 +0000 (23:48 -0400)]
Add tenant vlan support

Introduces tenant vlan support through configuration of network settings file.

JIRA: APEX-272

Change-Id: Ie8e20a92ca4ebb9e0de4c53b5e03856d19ff660c
Signed-off-by: Feng Pan <fpan@redhat.com>
5 years agoAdd pacemaker for HA snapshot deployments 59/59959/1
Tim Rozet [Wed, 18 Jul 2018 18:39:08 +0000 (14:39 -0400)]
Add pacemaker for HA snapshot deployments

Change-Id: Ic7b631af3968de8868177efa719f7c6e01628ce9
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoAdd param for ODL password into overcloudrc 11/59811/3
Tim Rozet [Fri, 13 Jul 2018 20:22:30 +0000 (16:22 -0400)]
Add param for ODL password into overcloudrc

Recent changes upstream have removed the default 'admin' ODL password
and now password is randomly generated:

https://review.openstack.org/#/c/578505/

So in OPNFV we now store the password in overcloudrc as
SDN_CONTROLLER_PASSWORD variable.

Also includes minor fixes to unittests.

Change-Id: Iabe7e4f902442c80af99ba1603a3927cf13d0393
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoUpdate queens ODL to include OF table fix 69/59869/3
Tim Rozet [Mon, 16 Jul 2018 17:49:21 +0000 (13:49 -0400)]
Update queens ODL to include OF table fix

Also includes minor fix to patching where stable was not being removed
from the short hand branch name correctly.

Includes fix where path was changed in queens for env files:
https://review.openstack.org/#/c/567810/

Change-Id: Ia3a6769be70ea97c9bec9d5539c9ab0373fed30a
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoMerge "Add support for kubernetes deployment"
Tim Rozet [Mon, 16 Jul 2018 14:14:26 +0000 (14:14 +0000)]
Merge "Add support for kubernetes deployment"

5 years agoFix OpenDaylight Oxygen deployment failures (master) 97/59797/1
Tim Rozet [Fri, 13 Jul 2018 15:25:20 +0000 (11:25 -0400)]
Fix OpenDaylight Oxygen deployment failures (master)

ODL scenarios are failing deployment with oxygen because table 17 from
the OpenFlow pipeline is missing. This pulls in an upstream patch to no
longer check for table 17. The default table 17 flow has been removed
upstream which is why it no longer appears during deployment.

This patch fixes master OS branch scenarios only. Once the patch is
cherry-picked to queens we can submit a new patch updating the DS
settings.

Change-Id: If60cf25c75440e3a1998b412ac8b903849507dab
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoMerge "Removes OC condition in dhcp-all-interfaces"
Tim Rozet [Thu, 12 Jul 2018 16:37:35 +0000 (16:37 +0000)]
Merge "Removes OC condition in dhcp-all-interfaces"

5 years agoAdds IP to external network NIC on computes 51/59651/1
Tim Rozet [Tue, 10 Jul 2018 14:10:56 +0000 (10:10 -0400)]
Adds IP to external network NIC on computes

Deployments now fail in baremetal because the external NTP server cannot
be reached because there is no IP on the extenal interfaces for
computes.

Change-Id: Ic1e67072b81bb7ca4e15930840dc77d27913737f
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoAdd support for kubernetes deployment 77/53077/27
Zenghui Shi [Wed, 4 Apr 2018 03:24:40 +0000 (11:24 +0800)]
Add support for kubernetes deployment

This patch adds capability to deploy kubernetes cluster instead of openstack.
Kubernetes will be deployed using kubespray and is run after TripleO bookstraps
overcloud nodes.

JIRA: APEX-574

Change-Id: If9c171620c933a052b719e7112a50e22bbab667f
Signed-off-by: Feng Pan <fpan@redhat.com>
Signed-off-by: Zenghui Shi <zshi@redhat.com>
5 years agoPhysical interface type note 57/59557/2
Tomi Juvonen [Thu, 5 Jul 2018 06:07:41 +0000 (09:07 +0300)]
Physical interface type note

add ovs_bridge as needed compared to earlier version

Change-Id: I1d0c6df9d1f47b0c98a3c1a8bf3a04eb5f53aff2
Signed-off-by: Tomi Juvonen <tomi.juvonen@nokia.com>
5 years agoFix neutron-opendaylight-sriov.yaml path 83/59583/1
Feng Pan [Fri, 6 Jul 2018 14:07:14 +0000 (10:07 -0400)]
Fix neutron-opendaylight-sriov.yaml path

In latest THT upstream, environment file neutron-opendaylight-sriov.yaml was
moved to services folder. Updating references in Apex to avoid deploy failure.

Change-Id: I7065e0d8e13c9add9ead282db2244a27c177e5a4
Signed-off-by: Feng Pan <fpan@redhat.com>
5 years agoDeprecates the use of '--upstream' argument 11/59011/2
Tim Rozet [Mon, 25 Jun 2018 19:21:07 +0000 (15:21 -0400)]
Deprecates the use of '--upstream' argument

We only support the use of upstream deployments from Gambia onwards.
Therefore deprecating the parameter and forcing upstream to always be
used.

Change-Id: I7926a65a2c32bca2272855ba45fdb6005f67616f
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoIgnore error if network already undefined 13/59013/1
Tim Rozet [Mon, 25 Jun 2018 20:05:33 +0000 (16:05 -0400)]
Ignore error if network already undefined

In clean we destroy a network, then undefine it. When running snapshot
deploy it uses manual virsh bash commands to create the networks and
other virsh resources. This leaves an admin network which our clean
eventually tries to delete. However when the libvirt api network destroy
command is used it is somehow undefining the newtork at the same time.
Therefore just catch that possible scenario and ignore the failure as
the network has already been removed.

Change-Id: Id1d861fbe2a338f0828e78721c09f110030d3a4a
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoAuto Generated INFO.yaml file 21/51521/5
agardner [Fri, 2 Feb 2018 22:12:24 +0000 (17:12 -0500)]
Auto Generated INFO.yaml file

INFO.yaml meant to be machine readable.
This file was auto generated from an ldap lookup
and your projects INFO file

Meeting times are not currently filled out.
please ammend this patchset to complete

Going forward comitter promotions should be done
against this file.

PTLs:
Must be merged for you to gain delete access on
testresults.opnfv.org

Change-Id: Ia3749f55a407fa1dd173021b509123029bcde297
Signed-off-by: agardner <agardner@linuxfoundation.org>
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoMerge "Fixes Ceph PG calculation"
Feng Pan [Tue, 19 Jun 2018 14:47:26 +0000 (14:47 +0000)]
Merge "Fixes Ceph PG calculation"

5 years agoFixes Ceph PG calculation 83/58683/3
Tim Rozet [Mon, 18 Jun 2018 18:00:38 +0000 (14:00 -0400)]
Fixes Ceph PG calculation

Baremetal deployments were failing because the ceph PG size was
exceeding the max allowed. Virtual was still working because we lower
the number of pools and pg/osd. This patch changes the values to a
number which should work for both virtual and baremetal. Also includes a
fix which adds the controllers back as OSDs and a few other cleanup
issues.

JIRA: APEX-614
JIRA: APEX-569

Change-Id: I2ad65727ecdcaa0454eb53d25e32b7f1a53cd3a4
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoFetch mistral logs from undercloud 71/58671/2
Tim Rozet [Mon, 18 Jun 2018 15:28:35 +0000 (11:28 -0400)]
Fetch mistral logs from undercloud

/var/lib/mistral path contains logs for when ansible is invoked by
TripleO for Ceph configuration as well as config download. This patch
now archives and fetches that directory. Logs in previous releases
like Queens store the Ceph logs in /var/log/mistral.

Change-Id: I50c43e55efaa5dbcf8b7fb00b0e11cd3288fdd05
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoAdds missing queens deploy settings files 03/58603/1
Tim Rozet [Sat, 16 Jun 2018 02:54:52 +0000 (22:54 -0400)]
Adds missing queens deploy settings files

Change-Id: I87508e6d486ade6e4acd8dec69a4c867b0d81252
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoFixes deployment failure with allNodesConfig 17/58217/2
Tim Rozet [Tue, 5 Jun 2018 01:19:22 +0000 (21:19 -0400)]
Fixes deployment failure with allNodesConfig

This pulls in upstream patch to revert a bad commit that causes the
"Unknown Property controller_ips". Also includes a fix for being able to
detect if patches that are merged upstream are also promoted into
TripleO images or container images. This happens by comparing the time
the patch was submitted to the time when the TripleO Image or Docker
Image was last updated.

JIRA: APEX-610
JIRA: APEX-612

Change-Id: I1c2ab7fb4425b407acd7b6d9ebab914ed3a24478
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoMerge "Configure NAT with baremetal when necessary"
Feng Pan [Thu, 31 May 2018 17:32:27 +0000 (17:32 +0000)]
Merge "Configure NAT with baremetal when necessary"

5 years agoMerge "Updates configs for ODL CSIT deployments"
Feng Pan [Wed, 30 May 2018 19:56:33 +0000 (19:56 +0000)]
Merge "Updates configs for ODL CSIT deployments"

5 years agoConfigure NAT with baremetal when necessary 91/57791/3
Tim Rozet [Wed, 23 May 2018 20:51:48 +0000 (16:51 -0400)]
Configure NAT with baremetal when necessary

We currently only enable NAT on undercloud for virtual deployments.
However, there could be a case where a baremetal deployment also needs
NAT as it is not using an interface on the overcloud nodes with external
access. Therefore this patch changes the behavior to configure NAT when
the gateway of either the external or admin (when external is disabled)
network matches an IP assigned to the undercloud.

JIRA: APEX-605

Change-Id: I9c79af371913e6e5f0d39b433f68205bc7e106c5
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoUpdates configs for ODL CSIT deployments 75/54575/6
Tim Rozet [Wed, 28 Mar 2018 20:58:15 +0000 (13:58 -0700)]
Updates configs for ODL CSIT deployments

For ODL CSIT we want to deploy with:
 - Minimum services per role
 - 2 Compute nodes, 1 controller
 - Single network enabled

Change-Id: If611c4c1ff68629670ef15904930124b5786a569
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoMerge "Default ctlplane to native VLAN"
Feng Pan [Tue, 29 May 2018 17:13:01 +0000 (17:13 +0000)]
Merge "Default ctlplane to native VLAN"

5 years agoMerge "Remove pacmeaker workaround"
Feng Pan [Tue, 29 May 2018 13:10:59 +0000 (13:10 +0000)]
Merge "Remove pacmeaker workaround"

5 years agoMerge "Promote Ricky to committer"
Tim Rozet [Tue, 29 May 2018 13:09:24 +0000 (13:09 +0000)]
Merge "Promote Ricky to committer"

5 years agoRemove pacmeaker workaround 39/57939/1
Tim Rozet [Fri, 25 May 2018 19:54:08 +0000 (15:54 -0400)]
Remove pacmeaker workaround

There was a compatibility issue with the centos 7.4/7.5 between the host
pacemaker version and container.  Now that containers have moved to 7.5
we should not need this workaround anymore.

Change-Id: I9632c65e87687d4f36130719c6df9af2e913eed8
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoAdding git as required dependency for Apex RPMs 63/57463/2
Ricardo Noriega [Wed, 16 May 2018 10:54:40 +0000 (12:54 +0200)]
Adding git as required dependency for Apex RPMs

  If it's not installed, opnfv-deploy will output an
  error message.

JIRA: APEX-599

Change-Id: Ib826204120f53abce1f4f1e3e4ec3119a71ab650
Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
5 years agoDefault ctlplane to native VLAN 87/57787/1
Tim Rozet [Wed, 23 May 2018 20:09:47 +0000 (16:09 -0400)]
Default ctlplane to native VLAN

We were not setting any vlan type value for the admin network.  This
caused an issue when deploying and trying to use a single collapsed
network (no net isolation).  The issue occurred when trying to create an
external neutron network.  We happen to check if the phys type is flat
or vlan using this attribute to decide what kind of phys type to use for
the neutron network.

JIRA: APEX-606

Change-Id: I4e24dd5e8b99cef920b8203b820a77d0021631cc
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoPromote Ricky to committer 83/57783/1
Tim Rozet [Wed, 23 May 2018 19:42:22 +0000 (15:42 -0400)]
Promote Ricky to committer

Ricky has been a very active Apex user and contributor over the past few
release cycles.  He has helped find and fix numerous bugs, along with
being responsible for L2GW and SRIOV features for Fraser release.  He
has shown a willingness to jump in and help whenever there are issues
with Apex, and also a willingness to work upstream in TripleO/OpenStack
to implement new features.

Change-Id: Ifd032fd349a46b0e34b2d77ba56e3c564e70226c
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoFix RPM build 85/57685/2
Tim Rozet [Tue, 22 May 2018 13:56:50 +0000 (09:56 -0400)]
Fix RPM build

networking-vpp was referencing variables from the old variables.sh.
Moving those values into the Makefile as the variables.sh file was
removed.

Change-Id: I8ef5e6988299e7e3855d442657db2ed20086689f
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoFixes ctlplane default route 15/57415/2
Tim Rozet [Tue, 15 May 2018 20:38:44 +0000 (16:38 -0400)]
Fixes ctlplane default route

Default route was using the undercloud IP, and instead should be using
the gateway set for the network in network settings.

JIRA: APEX-597

Change-Id: Iff6b18a6553af98cf9da72c278f358922d489958
Signed-off-by: Tim Rozet <trozet@redhat.com>
5 years agoMigrates master to use direct upstream 81/56981/34
Tim Rozet [Wed, 2 May 2018 16:34:38 +0000 (12:34 -0400)]
Migrates master to use direct upstream

We now move master to deploy from upstream.  That means we do not need
to build undercloud/overcloud images anymore.

Changes-Include:
 - Remove bash build scripts as we do not need to build anything
   other than the python package anymore
 - Remove building images or iso from build.py
 - Remove building of images and iso from Makefile
 - Rename/refactor deploy settings files for nosdn and odl.  The new
   convention is that the typical scenario names we use will deploy
   master.  We also support n-1 OS, so in that case we use the branch
   name for the "feature" in the scenario name: os-odl-queens-noha.
 - Tacker/Congress are disabled in settings files until we fix that with
   upstream.  Containers are now enabled by default.
 - Disable TLS for undercloud (was changed upstream to default enabled)
 - Fix environments docker directory for master THT (was changed upstream)
 - Includes fix for LP#1768901
 - Includes workaround for LP#1770692
 - Moves to docker.io for container images as it is more stable and
   should contain the same images
 - Removes the term 'common' from apex packaging for referencing the
   Python Apex package

Change-Id: If6b433860b3ff882686c78d0f24a2f0c52b9b57a
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoRemoves OC condition in dhcp-all-interfaces 37/56937/1
Tim Rozet [Tue, 1 May 2018 20:46:58 +0000 (16:46 -0400)]
Removes OC condition in dhcp-all-interfaces

Due to this condition, a non-first ctlplane NIC may fail to come up in
deployments, causing deployment to fail.  This is a temporary workaround
until the proper fix can be merged:

https://review.openstack.org/#/c/561003/1

JIRA: APEX-588

Change-Id: I3f19afba2618161843ce3b76a03e2dcf1fcb4b99
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoUpdates documentation for Fraser release 23/56523/4
Tim Rozet [Wed, 25 Apr 2018 17:45:31 +0000 (13:45 -0400)]
Updates documentation for Fraser release

Change-Id: I19bfaa5b2778baf458df60a4a53d135e57859e04
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoMerge "Fix nosdn fdio scenario"
Tim Rozet [Thu, 19 Apr 2018 04:12:15 +0000 (04:12 +0000)]
Merge "Fix nosdn fdio scenario"

6 years agoMerge "Fixes OVN scenario"
Feng Pan [Thu, 19 Apr 2018 02:12:50 +0000 (02:12 +0000)]
Merge "Fixes OVN scenario"

6 years agoAdding NovaMigrationTarget service 89/55989/1
Ricardo Noriega [Wed, 18 Apr 2018 15:10:00 +0000 (17:10 +0200)]
Adding NovaMigrationTarget service

  Live migration fails due to this missing service
  in the compute role

JIRA: APEX-564

Change-Id: I13d69673204f6157dcbce31507aaa132f8c4ecce
Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
6 years agoFix nosdn fdio scenario 75/55775/5
Feng Pan [Sat, 14 Apr 2018 02:22:40 +0000 (22:22 -0400)]
Fix nosdn fdio scenario

- Update networking-vpp to use master branch
- Update THT vpp ml2 environment file with correct parameters
- Update external network creation command to use 'externa' as
  provider network name.
- Remove vpp network settings file as it's not used

apex-tripleo-heat-templates: Ia25db8456f1ad6beb96c7b9b5f318b166ef4576a
apex-puppet-tripleo: I231054a433eb7e598a6e24f6eaea02d476e776de

Change-Id: I4a1f68c75ae3b7d2a5b347d05abf0d025e8b116b
Signed-off-by: Feng Pan <fpan@redhat.com>
6 years agoFixes OVN scenario 19/55919/1
Tim Rozet [Tue, 17 Apr 2018 17:54:27 +0000 (13:54 -0400)]
Fixes OVN scenario

The OVN scenario would not deploy due to failures in trying to upgrades
to OVS 2.8 from OVS 2.7

JIRA: APEX-594.

Change-Id: Id84e488da8d2335f2240930c68119d0e2f6faf9c
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoFix barometer install failure 45/55745/1
Feng Pan [Sat, 14 Apr 2018 22:34:38 +0000 (18:34 -0400)]
Fix barometer install failure

We are seeing pip3 not found and collectd-write_sensu package conflicts
with latest pike overcloud images. This patch changes pip3 install to
python34-pip3 and updates collectd-write_sensu package version when
removing.

Change-Id: I7dfe1f2f39c3f21bffde8cfc6066f5bae66677d6
Signed-off-by: Feng Pan <fpan@redhat.com>
6 years agoEnable nosdn-fdio scenarios for Fraser release 53/54053/8
Feng Pan [Thu, 15 Mar 2018 23:44:39 +0000 (19:44 -0400)]
Enable nosdn-fdio scenarios for Fraser release

- Update neutron NSDriver patch
- Update os-net-config to fix config errors for vpp uio-driver
- Update puppet-tripleo to add configuration of physnets and type_driver
  in vpp agent
- Update THT to change VPP environment file for vpp-agent, and add common.yaml
  for vpp interface mapping
- Update VPP and networking-vpp version to 18.01
- Fix networking-vpp rpm build to enable proper uninstall.
- Update networking settings file to use ovs_bridge as default external interface type

JIRA: APEX-578
JIRA: APEX-568
JIRA: APEX-576
JIRA: APEX-577

apex-os-net-config: I915d5455acb8d496438b9c9e851639d3a43e6fa9
apex-puppet-tripleo: I472879b8f67e64b571638a0385943597a9120e6c
apex-tripleo-heat-templates: I5dfaf85d67fb038109edaf5c5d8a3e901b9148f4

Change-Id: I369bee232bfafef260d2ef19ac32614fdc487271
Signed-off-by: Feng Pan <fpan@redhat.com>
6 years agoMerge "Fix functional issues after nosdn deployment"
Feng Pan [Mon, 9 Apr 2018 21:33:49 +0000 (21:33 +0000)]
Merge "Fix functional issues after nosdn deployment"

6 years agoFix functional issues after nosdn deployment 71/55071/3
Tim Rozet [Fri, 6 Apr 2018 17:44:27 +0000 (13:44 -0400)]
Fix functional issues after nosdn deployment

After deploying with nosdn, it looks like there is some out of state
issue between the services.  First guess looks like something is going
on with the services and timing of registering to each other through
rabbit.  Simply restarting the services seems to sync them back up
correctly.

Change-Id: I417911067c841725ee12eb9354e5759054724e01
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoFixes delorean repo update on undercloud 73/55073/1
Tim Rozet [Fri, 6 Apr 2018 18:55:00 +0000 (14:55 -0400)]
Fixes delorean repo update on undercloud

Previous fix to update delorean repo on undercloud was always failing
because the operations passed to virt-customize were not in a list type.

JIRA: APEX-565

Change-Id: Ic883309ac1c3aa6027dc252635e404e5355c269d
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoFixes relative import for utils 29/55029/1
Tim Rozet [Thu, 5 Apr 2018 21:46:24 +0000 (17:46 -0400)]
Fixes relative import for utils

opnfv-pyutil was not working due to this relative import.  The script
would only work out of the pwd.

Change-Id: I1ed5db779dd031d019012a814b2dfe27944a2e2f
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoFixes log location for pyutils 89/54989/1
Tim Rozet [Thu, 5 Apr 2018 13:23:32 +0000 (09:23 -0400)]
Fixes log location for pyutils

Change-Id: I03cda65f58753fc5d55ea4ede78f7d5bd8b7bdce
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoAdds the ability to fetch logs from deployment 75/47875/5
Tim Rozet [Mon, 27 Nov 2017 20:22:25 +0000 (15:22 -0500)]
Adds the ability to fetch logs from deployment

Usage:
opnfv-pyutil --fetch-logs
python3 utils.py --fetch-logs --lib-dir ../lib

Eventually all utils.sh functions will be migrated here.
Note there is no support here for containers.  Will be
added later.

Change-Id: I223b8592ad09e0370e287ee2801072db31f9aa12
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoGeneralization of recursive function 67/54567/2
Ricardo Noriega [Wed, 28 Mar 2018 17:35:11 +0000 (10:35 -0700)]
Generalization of recursive function

  Now, SDN_MAP is not needed to have a boolean true
  value, but it will check internally posible value formats
  such dicts and tuples.

Change-Id: Idaf492952a7dd9e48e16f42dcbf5c59d981dd535
Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
6 years agoEnables containerized overcloud deployments 31/48331/27
Tim Rozet [Mon, 4 Dec 2017 16:20:23 +0000 (11:20 -0500)]
Enables containerized overcloud deployments

Changes Include:
  - For upstream deployments, Docker local registry will be updated with
    latest current RDO containers, regular deployments will use latest
    stable
  - Upstream container images will then be patched/modified and then
    re-uploaded into local docker registry with 'apex' tag
  - Deployment command modified to deploy with containers
  - Adds a --no-fetch deployment argument to disable pulling latest
    from upstream, and instead using what already exists in cache
  - Moves Undercloud NAT setup to just after undercloud is installed.
    This provides internet during overcloud install which is now
    required for upstream container deployments.
  - Creates loop device for Ceph deployment when no device is
    provided in deploy settings (for container deployment only)
  - Updates NIC J2 template to use the new format in OOO since
    the os-apply-config method is now deprecated in > Queens

JIRA: APEX-566
JIRA: APEX-549

Change-Id: I0652c194c059b915a942ac7401936e8f5c69d1fa
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoMerge "Adding SRIOV scenario"
Tim Rozet [Fri, 16 Mar 2018 14:22:52 +0000 (14:22 +0000)]
Merge "Adding SRIOV scenario"

6 years agoAdding SRIOV scenario 39/52039/28
Ricardo Noriega [Mon, 12 Feb 2018 11:58:14 +0000 (12:58 +0100)]
Adding SRIOV scenario

  This scenario should enable SRIOV interfaces to be used
  by Neutron. Only will be supported in baremetal deployments
  with SRIOV capable NICs. The name of the interface must
  be known in advance and the physnet of the SRIOV network
  is set as nfv_sriov.

Change-Id: Ie4295413e0be2197bd9ada4f887f6b47cd486765
Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
6 years agoMerge "Enabling extra bridge for native external network"
Feng Pan [Tue, 13 Mar 2018 14:07:23 +0000 (14:07 +0000)]
Merge "Enabling extra bridge for native external network"

6 years agoMerge "Adds OS_REGION_NAME into overcloudrc files"
Feng Pan [Tue, 13 Mar 2018 14:05:39 +0000 (14:05 +0000)]
Merge "Adds OS_REGION_NAME into overcloudrc files"

6 years agoMerge "Cherry-pick of L2GW environment file"
Tim Rozet [Mon, 12 Mar 2018 21:33:42 +0000 (21:33 +0000)]
Merge "Cherry-pick of L2GW environment file"

6 years agoAdds OS_REGION_NAME into overcloudrc files 81/53581/1
Tim Rozet [Mon, 12 Mar 2018 15:56:11 +0000 (11:56 -0400)]
Adds OS_REGION_NAME into overcloudrc files

Although this is not required to be able to access overcloud, it is
required by some tests in Functest.

JIRA: APEX-570

Change-Id: I45deaa8061f1be44ce80eed4810537eaf6841803
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoEnabling extra bridge for native external network 49/52649/3
Ricardo Noriega [Mon, 26 Feb 2018 11:34:39 +0000 (06:34 -0500)]
Enabling extra bridge for native external network

  If you have a non-vlan external network in a
  separate interface, you will need to create an
  extra bridge to hook up the interface. This patch
  will allow the user to create:

    - br-isolated: for all the vlan networks
    - br-ex: for the native external network

JIRA: APEX-572

Change-Id: Ie76e2345ce75c77f2925c47451427ae41b6957d1
Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
6 years agoMerge "Fixes ceph key import failures"
Feng Pan [Sat, 10 Mar 2018 16:02:36 +0000 (16:02 +0000)]
Merge "Fixes ceph key import failures"

6 years agoFixes ceph key import failures 25/53125/4
Tim Rozet [Mon, 5 Mar 2018 22:08:03 +0000 (17:08 -0500)]
Fixes ceph key import failures

There is an issue with HA deployments where sometimes key imports fail
for Ceph which seem to occur around 50% of the time.  When logging in
after a failure, the key import seems to work which indicates it may be
a race condition.  In addition, sometimes the keyring that is created
is missing the "caps" section of the file, which will also fail import.

This patch adds a retries for a minute to try to import the key.  It
also moves creating/importing to the same Exec because there is
evidence that the file is being modified by some other process right
after the file content is created in the previous exec.

JIRA: APEX-563

Change-Id: Ie8cfeb4803f6bed95f9e612eeb37c5cdf2d76617
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoMerge "Fix URL anchor in apex document."
Feng Pan [Thu, 8 Mar 2018 16:18:14 +0000 (16:18 +0000)]
Merge "Fix URL anchor in apex document."

6 years agoMerge "Adding libguestfs-tools as dependency"
Feng Pan [Wed, 7 Mar 2018 20:24:36 +0000 (20:24 +0000)]
Merge "Adding libguestfs-tools as dependency"

6 years agoCherry-pick of L2GW environment file 09/52109/5
Ricardo Noriega [Tue, 13 Feb 2018 16:20:28 +0000 (17:20 +0100)]
Cherry-pick of L2GW environment file

  It includes ODL L3 service plugin and trunk ports

apex-tripleo-heat-templates: I37039207bc7cf9965d26e6dfa034e84bf9b7224d
Change-Id: I29c398aabf9a2d1b98f76895ed73c01dcc008c19
Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
6 years agoMerge "barometer: fix barometer apex build"
Tim Rozet [Fri, 23 Feb 2018 00:58:54 +0000 (00:58 +0000)]
Merge "barometer: fix barometer apex build"

6 years agoTypo fix for disabling ipxe 99/52399/2
Dan Radez [Wed, 21 Feb 2018 12:53:47 +0000 (07:53 -0500)]
Typo fix for disabling ipxe

JIRA: APEX-535

Change-Id: If1d074d01246407b322d5a4bc27dfde35349e9db
Signed-off-by: Dan Radez <dradez@redhat.com>
6 years agoMerge "Fixes ensuring VBMCs are actually running"
Feng Pan [Fri, 16 Feb 2018 22:21:01 +0000 (22:21 +0000)]
Merge "Fixes ensuring VBMCs are actually running"

6 years agoMerge "Fixes stale undercloud delorean repos"
Feng Pan [Fri, 16 Feb 2018 21:27:59 +0000 (21:27 +0000)]
Merge "Fixes stale undercloud delorean repos"

6 years agoFixes ensuring VBMCs are actually running 57/52257/2
Tim Rozet [Fri, 16 Feb 2018 19:16:59 +0000 (14:16 -0500)]
Fixes ensuring VBMCs are actually running

We currently start VBMCs using CLI due to issues with the VBMC python
lib.  However when we start them, there is no check to make sure they
are actually changed to 'running' status.  This patch adds logic to
check (up to 5 times) to ensure each VBMC is running or raises an error.
Note this is for virtual deployments only.

JIRA: APEX-527

Change-Id: Iab7ee3b76292d6fc547f18c83f23c04205e9bb2e
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoAdd http(s)_proxy handling to apex 17/48417/9
Dan Radez [Tue, 5 Dec 2017 21:33:13 +0000 (16:33 -0500)]
Add http(s)_proxy handling to apex

JIRA: APEX-512

Change-Id: I875bd99203b425e448e7a3f64eb9a8f99d03ddaf
Signed-off-by: Dan Radez <dradez@redhat.com>
6 years agoFixes stale undercloud delorean repos 49/52249/2
Tim Rozet [Fri, 16 Feb 2018 15:45:55 +0000 (10:45 -0500)]
Fixes stale undercloud delorean repos

When we build artifacts for release, we try to freeze the disk images
and artifacts we use for deployment.  This includes the delorean repo
which provides OpenStack packages.  This repo however expires after a
couple months and then if any packages were missing in the Undercloud
released artifact, they will attempt to be downloaded during install
and fail.

This patch adds some logic to detect if there is internet connectivity,
and if so then download and update the delorean repo on the undercloud.

JIRA: APEX-565

Change-Id: I58c28437fb5c5b179033c939377fd97aefbf427c
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoEnsures v4/v6 iptables filters are loaded 15/52215/1
Tim Rozet [Thu, 15 Feb 2018 20:56:18 +0000 (15:56 -0500)]
Ensures v4/v6 iptables filters are loaded

We configure host iptables to open different ports for VBMC.  This may
fail if the iptables filters are not loaded.

JIRA: APEX-521

Change-Id: Ia33032c29aba3555551e39b4f819087aeafe05d9
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoAdding libguestfs-tools as dependency 01/52201/1
Ricardo Noriega [Thu, 15 Feb 2018 17:02:27 +0000 (18:02 +0100)]
Adding libguestfs-tools as dependency

  Needed for virt-customize the images

Change-Id: Ide3fff2c6b850047add6eeed4082c518c36e6e74
Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
6 years agoFixes python2 docutils req and also installs ansible 63/52163/3
Tim Rozet [Wed, 14 Feb 2018 18:12:39 +0000 (13:12 -0500)]
Fixes python2 docutils req and also installs ansible

For some reason we were requiring python2-docutils in to build our rpm
instead of python34-docutils.  Patch also includes some logic to install
ansible.

JIRA: APEX-515

Change-Id: I1b85e5b4b29f74f5ff5399296f24831c334c289c
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoMerge "Adds barbican service to deployment"
Feng Pan [Tue, 13 Feb 2018 19:43:33 +0000 (19:43 +0000)]
Merge "Adds barbican service to deployment"

6 years agoAdds openstack-utils to overcloud 57/52057/4
Tim Rozet [Mon, 12 Feb 2018 22:27:16 +0000 (17:27 -0500)]
Adds openstack-utils to overcloud

Package allows user to do openstack-status to see state of services.

JIRA: APEX-352

Change-Id: Ie68cad5745786c8764ae20c2d3ad26dd05e5480b
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoAdds barbican service to deployment 55/52055/2
Tim Rozet [Mon, 12 Feb 2018 22:16:21 +0000 (17:16 -0500)]
Adds barbican service to deployment

This service is required for creating encrypted volumes for storage.

JIRA: APEX-531

Change-Id: Ied5ea1d6921ef96c1a352dba523d6f37245608e2
Signed-off-by: Tim Rozet <trozet@redhat.com>
6 years agoMerge "Adding L2GW Scenario"
Tim Rozet [Fri, 9 Feb 2018 22:10:54 +0000 (22:10 +0000)]
Merge "Adding L2GW Scenario"

6 years agoAllow disabling ipxe for provisioning 69/46069/17
Dan Radez [Fri, 20 Oct 2017 19:30:20 +0000 (15:30 -0400)]
Allow disabling ipxe for provisioning

JIRA: APEX-535

Change-Id: I52d17e962fc4a504db1ddbc20df0ac56a208f34b
Signed-off-by: Dan Radez <dradez@redhat.com>
6 years agoAdding L2GW Scenario 87/50787/7
Ricardo Noriega [Thu, 18 Jan 2018 17:25:27 +0000 (18:25 +0100)]
Adding L2GW Scenario

  This scenario allows you to install L2GW Neutron driver
  and point to OpenDaylight as service provider.

apex-tripleo-heat-templates: I37039207bc7cf9965d26e6dfa034e84bf9b7224d
Change-Id: I0dfd37bcc5060f0ad8caa95e1f87a7411bd6e723
Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
6 years agobarometer: fix barometer apex build 83/51183/7
Maryam Tahhan [Fri, 26 Jan 2018 10:13:45 +0000 (10:13 +0000)]
barometer: fix barometer apex build

apex-tripleo-heat-templates: I3250b57316b4ec85e0558f1b512f6f3ed7c349fb

apex-puppet-tripleo: I95698d69c58e0c36ae88cc2687073a05b514592c

Change-Id: I5f33cd2a2842051a77c89cb11f97e8e37d1d0185
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>