Tom Barron [Tue, 27 Sep 2016 03:02:23 +0000 (23:02 -0400)]
Set manila::keystone::auth::tenant
Without setting this parameter, overcloud deploy fails and
'openstack stack failures list overcloud' reveals the
following error:
Error: Puppet::Type::Keystone_user_role::ProviderOpenstack: Could
not find project with name [services] and domain [Default]
Error:
/Stage[main]/Manila::Keystone::Auth/Keystone::Resource::Service_identity[manilav2]/Keystone_user_role[manilav2@services]:
Could not evaluate: undefined method `[]' for nil:NilClass
When we set manila::keystone::auth::tenant to 'service', analogous
to cinder, nova, etc., the overcloud deploy completes successfully.
Change-Id: I996ac2ff602c632a9f9ea9c293472a6f2f92fd72
Jenkins [Tue, 27 Sep 2016 02:24:00 +0000 (02:24 +0000)]
Merge "Add FixedIPs parameter to from_service.yaml"
Jenkins [Tue, 27 Sep 2016 02:04:27 +0000 (02:04 +0000)]
Merge "Fix ignore warning on ceph major upgrade."
Jenkins [Tue, 27 Sep 2016 01:11:53 +0000 (01:11 +0000)]
Merge "Add integration with Manila CephFS Native driver"
Jenkins [Tue, 27 Sep 2016 01:11:46 +0000 (01:11 +0000)]
Merge "A few major-upgrade issues"
Jenkins [Tue, 27 Sep 2016 01:11:39 +0000 (01:11 +0000)]
Merge "Start mongod before calling ceilometer-dbsync"
Jenkins [Tue, 27 Sep 2016 01:11:32 +0000 (01:11 +0000)]
Merge "Reinstantiate parts of code that were accidentally removed"
Jenkins [Tue, 27 Sep 2016 00:13:37 +0000 (00:13 +0000)]
Merge "Neutron metadata agent worker count fix"
Jenkins [Tue, 27 Sep 2016 00:11:07 +0000 (00:11 +0000)]
Merge "Remove double definition of config_settings key in keystone"
Sofer Athlan-Guyot [Mon, 26 Sep 2016 13:36:29 +0000 (15:36 +0200)]
Fix ignore warning on ceph major upgrade.
The paramater IgnoreCephUpgradeWarnings is type cast into a boolean
which is rendered as 'True' or 'False' as a string not 'true' or
'false'. This fix the check.
Change-Id: I8840c384d07f9d185a72bde5f91a3872a321f623
Closes-Bug:
1627736
Jenkins [Mon, 26 Sep 2016 13:53:42 +0000 (13:53 +0000)]
Merge "Bind MySQL address to hostname appropriate to its network"
Juan Antonio Osorio Robles [Mon, 26 Sep 2016 11:10:39 +0000 (14:10 +0300)]
Remove double definition of config_settings key in keystone
Change-Id: I291bfb1e5736864ea504cd82eea1d4001fcdd931
Juan Antonio Osorio Robles [Fri, 23 Sep 2016 14:28:06 +0000 (17:28 +0300)]
Bind MySQL address to hostname appropriate to its network
This now takes into use the mysql_bind_host key, to set an
appropriate fqdn for mysql to bind to.
Closes-Bug: #
1627060
Change-Id: I50f4082ea968d93b240b6b5541d84f27afd6e2a3
Depends-On: I316acfd514aac63b84890e20283c4ca611ccde8b
Michele Baldessari [Fri, 23 Sep 2016 15:31:19 +0000 (17:31 +0200)]
get_param calls with multiple arguments need brackets around them
This issue was spotted during major upgrade where we had calls like
this:
servers: {get_param: servers, Controller}
These get_param calls are hanging indefinitely and make the whole
upgrade end in a timeout. We need to put brackets around the get_param
function when there are multiple arguments:
http://docs.openstack.org/developer/heat/template_guide/hot_spec.html#get-param
This is already done in most of the tree, and the few places where this
was not happening were parts not under CI. After this change the
following grep returns only one false positive:
grep -ir get_param: |grep -v -- '\[' |grep ','
Change-Id: I65b23bb44f37b93e017dd15a5212939ffac76614
Closes-Bug: #
1626628
Michele Baldessari [Sun, 25 Sep 2016 12:10:31 +0000 (14:10 +0200)]
A few major-upgrade issues
This commit does the following:
1. We now explicitly disable/stop and then remove the resources that are
moving to systemd. We do this because we want to make sure they are all
stopped before doing a yum upgrade, which otherwise would take ages due
to rabbitmq and galera being down. It is best if we do this via pcs
while we do the HA Full -> HA NG migration because it is simpler to make
sure all the services are stopped at that stage. For extra safety we can
still do a check by hand. By doing it via pacemaker we have the
guarantee that all the migrated services are down already when we stop
the cluster (which happens to be a syncronization point between all
controller nodes). That way we can be certain that they are all down on
all nodes before starting the yum upgrade process.
2. We actually need to start the systemd services in
major_upgrade_controller_pacemaker_2.sh and not stop them.
3. We need to use the proper bash variable name
4. Use is_bootstrap_node everywhere to make the code more consistent
Change-Id: Ic565c781b80357bed9483df45a4a94ec0423487c
Closes-Bug: #
1627490
Michele Baldessari [Sun, 25 Sep 2016 08:49:15 +0000 (10:49 +0200)]
Start mongod before calling ceilometer-dbsync
Currently we in major_upgrade_controller_pacemaker_2.sh we are calling
ceilometer-dbsync before mongod is actually started (only galera is
started at this point). This will make the dbsync hang indefinitely
until the heat stack times out.
Now this approach should be okay, but do note that when we start mongod
via systemctl we are not guaranteed that it will be up on all nodes
before we call ceilometer-dbsync. This *should* be okay because
ceilometer-dbsync keeps retrying and eventually one of the nodes will
be available. A completely clean fix here would be to add another
step in heat to have the guarantee that all mongo servers are up and
running before the dbsync call.
Change-Id: I10c960b1e0efdeb1e55d77c25aebf1e3e67f17ca
Closes-Bug: #
1627453
Michele Baldessari [Sun, 25 Sep 2016 08:15:41 +0000 (10:15 +0200)]
Reinstantiate parts of code that were accidentally removed
With commit
fb25385d34e604d2f670cebe3e03fd57c14fa6be
"Rework the pacemaker_common_functions for M..N upgrades" we
accidentally removed some lines that fixed M/N upgrade issues.
Namely:
extraconfig/tasks/major_upgrade_controller_pacemaker_1.sh
-# https://bugzilla.redhat.com/show_bug.cgi?id=
1284047
-# Change-Id: Ib3f6c12ff5471e1f017f28b16b1e6496a4a4b435
-crudini --set /etc/ceilometer/ceilometer.conf DEFAULT rpc_backend rabbit
-# https://bugzilla.redhat.com/show_bug.cgi?id=
1284058
-# Ifd1861e3df46fad0e44ff9b5cbd58711bbc87c97 Swift Ceilometer middleware no longer exists
-crudini --set /etc/swift/proxy-server.conf pipeline:main pipeline "catch_errors healthcheck cache ratelimit tempurl formpost authtoken keystone staticweb proxy-logging proxy-server"
-# LP:
1615035, required only for M/N upgrade.
-crudini --set /etc/nova/nova.conf DEFAULT scheduler_host_manager host_manager
extraconfig/tasks/major_upgrade_controller_pacemaker_2.sh
nova-manage db sync
- nova-manage api_db sync
This patch simply puts that code back without reverting the
whole commit that broke things, because that is needed.
Closes-Bug: #
1627448
Change-Id: I89124ead8928ff33e6b6907a7c2178169e91f4e6
Ben Nemec [Fri, 23 Sep 2016 20:50:53 +0000 (15:50 -0500)]
Add FixedIPs parameter to from_service.yaml
Without this, deployments using the from_service.yaml port for
service VIPs will fail with:
"Property error: : resources.RedisVirtualIP.properties: : Unknown
Property FixedIPs"
Change-Id: Ie0d3b940a87741c56fe022c9e50da0d3ae9b583b
Closes-Bug:
1627189
Jenkins [Fri, 23 Sep 2016 17:45:24 +0000 (17:45 +0000)]
Merge "Remove hard-coded roles in EnabledServices output"
Erno Kuvaja [Mon, 22 Aug 2016 09:52:02 +0000 (10:52 +0100)]
Add integration with Manila CephFS Native driver
Enables configuring CephFS Native backend for Manila.
This change is based on the usage of environments like in
review https://review.openstack.org/#/c/354019 for Netapp
driver.
Co-Authored-By: Marios Andreou <marios@redhat.com>
Change-Id: If013d796bcdfe48b2c995bcab462c89c360b7367
Depends-On: I918f6f23ae0bd3542bcfe1bf0c797d4e6aa8f4d9
Depends-On: I2b537f735b8d1be8f39e8c274be3872b193c1014
Dan Prince [Thu, 15 Sep 2016 07:19:15 +0000 (09:19 +0200)]
Move keystone::auth into service_config_settings
This patch moves the keystone::auth settings for all
services into the new service_config_settings section. This
is important because we execute the keystone commands via
puppet only on the role containing the keystone service
and without these settings it will fail.
Note that yaql merging/filtering is used here to ensure that
service_config_settings is optional in service templates,
and also that we'll only deploy hieradata for a given
service on a node running the service (the key in
the service_config_settings map must match the service_name
in the service template for this to work).
e.g the following will result in only deploying keystone: 123
in hiera on the role running the "keystone" service,
regardless of which service template defines it.
service_config_settings:
keystone:
keystone: 123
Co-Authored-By: Steven Hardy <shardy@redhat.com>
Change-Id: I0c2fce037a1a38772f998d582a816b4b703f8265
Closes-bug:
1620829
Jenkins [Fri, 23 Sep 2016 11:35:10 +0000 (11:35 +0000)]
Merge "Tolerate missing keys from role_data in service templates"
Jenkins [Fri, 23 Sep 2016 10:23:15 +0000 (10:23 +0000)]
Merge "explicitly set fluentd service_provider"
Jenkins [Fri, 23 Sep 2016 09:58:20 +0000 (09:58 +0000)]
Merge "No-op Puppet for upgrades/migrations according to composable roles"
Steven Hardy [Wed, 21 Sep 2016 10:16:03 +0000 (11:16 +0100)]
Remove hard-coded roles in EnabledServices output
This was missed during custom-roles work, and will mean deployments
break if any of the existing roles are removed from roles_data.yaml
Change-Id: Ia737b48a0dd272f8d706b7458764201fa47cb0bb
Closes-Bug: #
1625755
Jenkins [Fri, 23 Sep 2016 08:39:09 +0000 (08:39 +0000)]
Merge "Make apache-based services use network-dependent servername"
Brent Eagles [Thu, 22 Sep 2016 15:16:37 +0000 (12:46 -0230)]
Neutron metadata agent worker count fix
This patch changes the default value and type of the NeutronWorkers
parameter, allowing it to be unset and let a system-dependent value to
be used (e.g. processorcount or some derivate value).
Change-Id: Ia385b3503fe405c4b981c451f131ac91e1af5602
Closes-Bug: #
1626126
Lars Kellogg-Stedman [Thu, 22 Sep 2016 14:20:17 +0000 (10:20 -0400)]
explicitly set fluentd service_provider
the konstantin-fluentd package assumes sysv init scripts, while the
fluentd package in rhel(/centos/fedora) uses systemd. this can cause
errors starting the service.
This review explicitly sets the service_provider to "systemd".
This requires https://github.com/soylent/konstantin-fluentd/pull/15, which exposes the service_provider parameter in konstantin-fluentd.
Change-Id: I24332203de33f56a0e49fcc15f7fb7bb576e8752
Steven Hardy [Wed, 21 Sep 2016 13:42:52 +0000 (14:42 +0100)]
Tolerate missing keys from role_data in service templates
Currently we have a few keys which may be considered optional,
such as monitoring_subscription, logging* and global_config_settings.
Currently we dereference these directly via get_attr, but this will
break when heat output validation is fixed, ref bug #
1599114 is fixed
(patches are up for this, so it may be soon).
Change-Id: If4eed1ca39c10ace9b1cb5ce2dc4b9c70a3dd2f4
Partial-Bug: #
1620829
Jiri Stransky [Thu, 22 Sep 2016 12:56:50 +0000 (14:56 +0200)]
No-op Puppet for upgrades/migrations according to composable roles
Our previous no-ops stopped working because the Puppet run resources
moved under a different entry in resource registry. This is now fixed
to follow the latest way.
Change-Id: Ia5598385ddca185bfbf10e2d3babb53f6f77d1ac
Closes-Bug: #
1626452
Jenkins [Thu, 22 Sep 2016 09:52:37 +0000 (09:52 +0000)]
Merge "Make sure major upgrade script fails."
Jenkins [Wed, 21 Sep 2016 23:10:12 +0000 (23:10 +0000)]
Merge "Provide for RAM-constrained environments"
Jenkins [Wed, 21 Sep 2016 21:21:11 +0000 (21:21 +0000)]
Merge "Glance worker count fix"
Jenkins [Wed, 21 Sep 2016 21:20:48 +0000 (21:20 +0000)]
Merge "Define step input as a Number type"
Jenkins [Wed, 21 Sep 2016 21:00:21 +0000 (21:00 +0000)]
Merge "Update capabilities-map.yaml"
Jenkins [Wed, 21 Sep 2016 16:00:39 +0000 (16:00 +0000)]
Merge "Set Neutron's metadata_ip to the nova metadata VIP"
Steven Hardy [Wed, 21 Sep 2016 13:53:27 +0000 (14:53 +0100)]
Define step input as a Number type
Currently we pass numbers in (hard-coded in post.j2.yaml) but the
SoftwareConfig schema defaults to String. If puppet requires an
integer number, setting this type may help preserve the type for
the hook.
Change-Id: Ie9227d7adb58ea3c791aa459a1ab5b17ad935919
Joe Talerico [Tue, 2 Aug 2016 18:28:55 +0000 (14:28 -0400)]
Glance worker count fix
This patch changes the default value and type of the Glance worker
configuration to allow it to be unset and allow a system dependent
default to be used (e.g. processorcount or some derivative value). The
previous default of 0 would result in a single self contained process,
which while suitable for debugging and testing is not appropriate for
production deployments.
Partial-Bug: #
1626126
Change-Id: I58a6a72a581e7083e1dc4e5ca568fdd3fdd6cdf1
Jiri Stransky [Wed, 21 Sep 2016 11:53:19 +0000 (13:53 +0200)]
Provide for RAM-constrained environments
We hit problems in environments which don't have a lot of RAM (e.g. dev
envs, could be also CI) that Apache ate too much memory due to
too many worker processes being spawned.
This commit allows customizing the Apache MaxRequestWorkers and
ServerLimit directives via Heat parameters. The default stays 256 as
that's the default in the Puppet module, to be suited for production
environments with powerful machines. Also low-memory-usage.yaml
environment file is added, which can be used to make dev/test/CI
overclouds less memory hungry, where the limits are now set to 32.
Change-Id: Ibcf1d9c3326df8bb5b380066166c4ae3c4bf8d96
Co-Authored-By: Carlos Camacho <ccamacho@redhat.com>
Closes-Bug: #
1619205
Steven Hardy [Wed, 21 Sep 2016 10:10:47 +0000 (11:10 +0100)]
Make defaults from roles_data.yaml more robust
The previous logic left out the default Count completely when it was
zero, which breaks nested validation and it's likely similar problems
would exist with the other optional defaults, so rework it so the
defaulting happens in the jinja2 logic, and document the interfaces
better in roles_data.yaml
Change-Id: I7f2eb4a3a0b43c5d2cd0d001ed3c73f783c95c74
Closes-Bug: #
1625760
Jenkins [Wed, 21 Sep 2016 10:00:42 +0000 (10:00 +0000)]
Merge "Enable L3 HA when multiple controllers and no DVR"
Juan Antonio Osorio Robles [Mon, 5 Sep 2016 11:39:04 +0000 (14:39 +0300)]
Make apache-based services use network-dependent servername
Currently the servername is incorrectly set for the services running
over apache. It currently takes the default value which is just the
regular FQDN, when the services actually might be running on
different IPs that require alternative FQDNs.
This fixes that by filling that value from a fact in hiera that's
dependant on the service's network.
Closes-Bug: #
1625677
Change-Id: Ib7ea5fd2d18a376eaa2f5a3fa5687cb9b719a8e2
Sofer Athlan-Guyot [Wed, 7 Sep 2016 09:25:41 +0000 (11:25 +0200)]
Make sure major upgrade script fails.
Running upgrade-non-controller.sh against compute and object storage did
not fail if the /root/tripleo_upgrade_node.sh failed.
This make it harder to detect error in CI system for instance.
Change-Id: I12b7d640547d3b8ec1f70104d159d6052b7638ff
Closes-Bug:
1620973
Jenkins [Tue, 20 Sep 2016 22:40:58 +0000 (22:40 +0000)]
Merge "RabbitMQ threads should be configured dynamically"
Brent Eagles [Tue, 20 Sep 2016 20:51:40 +0000 (18:21 -0230)]
Set Neutron's metadata_ip to the nova metadata VIP
The neutron metadata agent's metadata_ip field is meant to refer to the
nova metadata service, not the local address on the NeutronApiNetwork.
Change-Id: Ibb25a80ea3e66ab3f5cf63c197460d495939778d
Closes-Bug: #
1625504
Juan Antonio Osorio Robles [Tue, 20 Sep 2016 10:25:53 +0000 (13:25 +0300)]
Add nova-metadata template
This is needed because currently we're not generating
nova_metadata_vip or nova_metadata_nodes_ip, and a service profile is
required for that. Unfortunately, currently puppet-nova only deploys
osapi and metadata through the same manifest, so this profile doesn't
really inject any puppet code. We can make this more elegant later.
Change-Id: Id7112111f16d0c749a6203b90e29e6d9f1e4d57e
Closes-Bug: #
1625543
Michele Baldessari [Tue, 20 Sep 2016 08:11:54 +0000 (10:11 +0200)]
RabbitMQ threads should be configured dynamically
Currently in puppet/services/rabbitmq.yaml we hardcode the thread pool
size to 30 (via the +A30 snippet):
rabbitmq_environment:
RABBITMQ_SERVER_ERL_ARGS: '"+K true +A30 +P
1048576 -kernel inet_default_connect_options [{nodelay,true},{raw,6,18,<<5000:64/native>>}] -kernel inet_default_listen_options [{raw,6,18,<<5000:64/native>>}]"'
Upstream rabbit has gained the ability to dynamically configure the
number of threads since 3.6.2 via the following commit:
https://github.com/rabbitmq/rabbitmq-server/commit/
41ce5ad808863944cd6d62ce7f7e2271f1010582
Given that the default was hardcoded in rabbit from at least 3.4.0 up
until 3.6.2 (see LP bug associated to this commit), we can actually
remove this hardcoded value as it overrides a sane default.
Before the change:
/usr/lib64/erlang/erts-7.3.1/bin/beam.smp -W w -A 64 -K true -A30 -P
1048576 ...
After the change:
/usr/lib64/erlang/erts-7.3.1/bin/beam.smp -W w -A 64 -K true -P
1048576 ...
So effectively with this change we will have the following:
- With older rabbitmq versions we keep the +A30 default
- With rabbitmq versions >= 3.6.2 the thread number is dynamically
computed to nr_cpus * 16
Change-Id: I8d30c7d141c29fcc439d40fc767498520be7966e
Closes-Bug: #
1625486
Brent Eagles [Fri, 16 Sep 2016 20:31:00 +0000 (18:01 -0230)]
Enable L3 HA when multiple controllers and no DVR
This patch conditionally enables Neutron L3 HA if there are multiple
controllers but DVR has not been enabled. If the conditions are false,
the value of NeutronL3HA is used.
Change-Id: If1ebeaf417c0da99d833450e394b71cabff2c800
Closes-Bug: #
1623155
Jenkins [Mon, 19 Sep 2016 17:23:08 +0000 (17:23 +0000)]
Merge "Add a function to upgrade from full HA to NG HA"
Jenkins [Mon, 19 Sep 2016 15:57:19 +0000 (15:57 +0000)]
Merge "Set VNC URL parameters for nova-compute"
Michele Baldessari [Fri, 26 Aug 2016 14:46:44 +0000 (16:46 +0200)]
Add a function to upgrade from full HA to NG HA
This is the initial work to have a function that migrates a full HA
architecture as deployed in Mitaka to the HA architecture as deployed in
Newton where only a few resources are managed by pacemaker.
The sequence is the following:
1) We remove the desired services from pacemaker's control. The services
at this point are still running normally via the systemd service as
invoked by pacemaker
2) We do a "systemctl stop <service>" on all controllers for all the
services that were removed from pacemaker's control. We do this to make
sure that during the yum upgrade, the %post sections that call
"systemctl try-restart" do not take ages, because at this point during
the upgrade rabbit is down. The only exceptions are "openstack-core"
and "delay" which are dummy pacemaker resources that do not exist on
the system
3) We do a "systemctl start <service>" on all nodes for all the services
mentioned above.
We should probably merge this patch only when newton has branched as it
is very specific to the M/N upgrade.
Closes-Bug:
1617520
Change-Id: I4c409ce58c1a57b6e0decc3cf168b62698b32e39
Giulio Fidente [Wed, 14 Sep 2016 16:15:55 +0000 (18:15 +0200)]
Use osd_pool_default_* puppet parameters when creating the pools
While it is possible to override the pg_num, pgp_num and size for
each pool, the defaults are hardcoded. This patch uses as default
the values given via ceph::profile::params::osd_pool_default_*
parameters, if any.
Closes-Bug:
1623590
Change-Id: Iecde772e7f72fd9abedb54cff4b8f2605df8fedd
Jenkins [Sat, 17 Sep 2016 19:57:02 +0000 (19:57 +0000)]
Merge "M/N upgrade sahara-api fails to restart."
Jenkins [Sat, 17 Sep 2016 18:50:51 +0000 (18:50 +0000)]
Merge "Add fluentd client service"
Jenkins [Sat, 17 Sep 2016 17:38:36 +0000 (17:38 +0000)]
Merge "Move rabbit's clustering port away from the ephemeral port range"
Sofer Athlan-Guyot [Fri, 19 Aug 2016 17:16:33 +0000 (19:16 +0200)]
M/N upgrade sahara-api fails to restart.
Change-Id: I7a041dab8b1b1edc9c80248e1eef3ce7ab272292
Closes-Bug:
1615056
Jenkins [Sat, 17 Sep 2016 17:28:53 +0000 (17:28 +0000)]
Merge "Rework the pacemaker_common_functions for M..N upgrades"
Juan Antonio Osorio Robles [Sat, 17 Sep 2016 07:34:48 +0000 (10:34 +0300)]
Set VNC URL parameters for nova-compute
These are needed so the computes can advertize the VNC URL correctly.
Change-Id: Ic3eba9fe929ce396b584249eb84415de09ab1b62
Closes-Bug: #
1623607
Jenkins [Sat, 17 Sep 2016 09:33:38 +0000 (09:33 +0000)]
Merge "Add mongo config settings in collector service templates"
marios [Wed, 25 May 2016 08:56:02 +0000 (11:56 +0300)]
Rework the pacemaker_common_functions for M..N upgrades
For N we cannot assume services are managed by pacemaker.
This adds functions to check if a service is systemd or
pcmk managed and start/stops it accordingly. For pcmk,
only stop/disable on bootstrap node for example, whereas
systemd should stop/start on all controllers.
There is also an equivalent change to the check_resource
which has been reworked to allow both pcmk and systemd.
Implements: blueprint overcloud-upgrades-workflow-mitaka-to-newton
Change-Id: Ic8252736781dc906b3aef8fc756eb8b2f3bb1f02
Jenkins [Sat, 17 Sep 2016 02:53:34 +0000 (02:53 +0000)]
Merge "Add NetApp Manila driver integration and tidy up generic"
Jenkins [Sat, 17 Sep 2016 02:53:28 +0000 (02:53 +0000)]
Merge "Convert AllNodesExtraConfig to support composable roles"
Lars Kellogg-Stedman [Tue, 9 Aug 2016 20:20:18 +0000 (16:20 -0400)]
Add fluentd client service
This implements support for installing fluentd agents as a composable
service on the overcloud.
Depends-On: I2e1abe4d8c8359e56ff626255ee50c9cacca1940
Implements: tripleo-opstools-centralized-logging
Change-Id: I23b0e23881b742158fcfb6b8c145a3211d45086e
Jenkins [Fri, 16 Sep 2016 21:09:15 +0000 (21:09 +0000)]
Merge "Expose parameter to enable combination alarms"
Jenkins [Fri, 16 Sep 2016 20:11:47 +0000 (20:11 +0000)]
Merge "Refactor upgrade checks."
Jenkins [Fri, 16 Sep 2016 19:48:23 +0000 (19:48 +0000)]
Merge "Add CephRgw to roles_data.yaml"
Jenkins [Fri, 16 Sep 2016 19:31:08 +0000 (19:31 +0000)]
Merge "Convert UpdateWorkflow to support composable roles"
Jenkins [Fri, 16 Sep 2016 19:08:37 +0000 (19:08 +0000)]
Merge "Fix use of batch_create in CephMon major upgrade template"
Jenkins [Fri, 16 Sep 2016 19:08:30 +0000 (19:08 +0000)]
Merge "Add hyperconverged-ceph environment to include CephOSD on computes"
Jenkins [Fri, 16 Sep 2016 18:29:32 +0000 (18:29 +0000)]
Merge "Fix _from_pool_v6.yaml str_split"
Michele Baldessari [Fri, 22 Jul 2016 06:40:25 +0000 (08:40 +0200)]
Move rabbit's clustering port away from the ephemeral port range
Currently RabbitMQ cluster uses a predefined port 35672 for clustering.
This port belongs to so-called ephemeral ports range.
Ephemeral ports are the ports kernel assings to application if it
doesn't specify which port to open. So there is a small chance that this
application being started before RabbitMQ itself could grab this port.
While rather unlikely we did see this happen.
Selinux change should already be in place. On my Centos 7 we have:
rabbitmq_port_t tcp 25672
corenet_tcp_bind_rabbitmq_port(rabbitmq_t)
corenet_tcp_connect_rabbitmq_port(rabbitmq_t)
First noted via:
https://bugzilla.redhat.com/show_bug.cgi?id=
1357522
Closes-Bug: #
1623818
Depends-On: I0bcd0d063a7a766483426fdd5ea81cbe1dfaa348
Change-Id: I995bd96c2a17614e954ea5bbae4d58998ef420dc
Pradeep Kilambi [Wed, 14 Sep 2016 20:48:01 +0000 (16:48 -0400)]
Add mongo config settings in collector service templates
In scenario where mongo and collector are on separate nodes like as
indicated in the bug, collector should be able to access mongo replset
and other hiera data.
Closes-bug: #
1620468
Depends-On: I0bcd0d063a7a766483426fdd5ea81cbe1dfaa348
Change-Id: Iadf4c78fb03da183d19e93c30f78817a3cfed425
Jenkins [Fri, 16 Sep 2016 15:40:49 +0000 (15:40 +0000)]
Merge "Convert deploy steps to jinja2 loop"
Giulio Fidente [Fri, 16 Sep 2016 14:17:22 +0000 (16:17 +0200)]
Fix _from_pool_v6.yaml str_split
Previously [1] we updated from_pool_v6 to use str_split but mistakenly
copy/pasting lines referencing an attribute which isn't created in
these templates.
1. I282dbc025500b1628d4f08a49b54a2adefd38b5f
Closes-Bug:
1624412
Change-Id: I409ff5b36eab2a791db4d352dea5b68096c2dc21
Jenkins [Fri, 16 Sep 2016 14:07:28 +0000 (14:07 +0000)]
Merge "Fixes the Ceph upgrade scripts"
Jenkins [Fri, 16 Sep 2016 13:23:00 +0000 (13:23 +0000)]
Merge "Set client protocol for glance registry client"
Mathieu Bultel [Wed, 14 Sep 2016 13:41:18 +0000 (15:41 +0200)]
Fix use of batch_create in CephMon major upgrade template
The batch_create and rolling_update keys were incorrectly defined
as properties of the resource instead of update policies.
Change-Id: I19261adc78e4cdc3616f16221e85490a6b48d47b
Closes-Bug:
1623506
Giulio Fidente [Thu, 15 Sep 2016 10:46:48 +0000 (12:46 +0200)]
Add CephRgw to roles_data.yaml
CephRgw defaults to None in the registry, seems like we missed it
in roles_data after a rebase.
Change-Id: I4ce8b160edfb193f5f6226f8295861e6625ef37b
Giulio Fidente [Thu, 15 Sep 2016 13:31:39 +0000 (15:31 +0200)]
Fixes the Ceph upgrade scripts
The Ceph upgrade scripts was failing on the following:
1. a syntax error in an if condition
2. an attempt to read a possibly unbound variable
3. an attempt to chown a directory which might not exist
this change aims at fixing all of the above.
Closes-Bug:
1623942
Change-Id: I9e9d63d4ab7626893aaf2a25dccfcafbb97ccbdf
Jenkins [Fri, 16 Sep 2016 09:48:47 +0000 (09:48 +0000)]
Merge "Unset Keystone public_endpoint"
Jenkins [Fri, 16 Sep 2016 08:58:05 +0000 (08:58 +0000)]
Merge "Populate vnc_api_lib.ini on compute nodes with OpenContrail"
Steven Hardy [Thu, 8 Sep 2016 11:14:09 +0000 (12:14 +0100)]
Convert AllNodesExtraConfig to support composable roles
This adjusts the interface to OS::TripleO::AllNodesExtraConfig so
it supports custom/composable/optional roles.
Note this does break backwards compatibility, and I can't see any way
to avoid that. I've converted the in-tree templates, and we'll have
to document carefully and or provide a script (or automated conversion
via mistral perhaps?) to allow folks to easily adjust any out of tree
templates to the new format.
Basically you just have to:
1. Remove all the *_servers parameters, replace with one "servers"
json parameter
2. Replace references to e.g "controller_servers" with "servers, Controller"
which does a path-based lookup into the json map provided by overcloud.yaml
Change-Id: I5eebf853646b2f6300d6b542fcd4f43e82d3b413
Partially-Implements: blueprint custom-roles
Steven Hardy [Thu, 8 Sep 2016 10:51:20 +0000 (11:51 +0100)]
Convert UpdateWorkflow to support composable roles
We need to remove the hard-coded roles from overcloud.j2.yaml
as now it's valid to e.g remove BlockStorage completely.
The previous behavior for the per-role upgrade scripts is maintained
but we'll need to rework this for newton->ocata upgrades where we
can no longer be sure the servers mapping will contain all roles.
Change-Id: I25e6c84757e3c00fba2aae834cd8206c62e44acf
Partially-Implements: blueprint custom-roles
Steven Hardy [Wed, 7 Sep 2016 16:05:56 +0000 (17:05 +0100)]
Convert deploy steps to jinja2 loop
Refactor so the post-deploy steps recently moved into
puppet/post.yaml are generated by jinja2 instead of hard-coded
Change-Id: I488e46aaa449c95571bd3d1de9513c3d0730baf3
Partially-Implements: blueprint custom-roles
Juan Antonio Osorio Robles [Wed, 14 Sep 2016 10:50:08 +0000 (13:50 +0300)]
Set client protocol for glance registry client
To communicate to glance registry, glance API has several parameters
that it uses to form the URI. Right now we are defaulting to http,
when we enable TLS everywhere, this will break. So setting the value
from the endpoint map should fix it.
Closes-Bug: #
1623477
Change-Id: Id86787cbaa6f87fdcf9c26111c228fd59fbba012
Pradeep Kilambi [Wed, 31 Aug 2016 15:26:50 +0000 (11:26 -0400)]
Expose parameter to enable combination alarms
The puppet-tripleo change for the same is merged
I9220b7d020dc8ed45dd6ca83ea9647efd67ea648
Change-Id: Ic5309ada98c78a15aa3a47dd94acb9e68eb25295
Jenkins [Wed, 14 Sep 2016 11:32:58 +0000 (11:32 +0000)]
Merge "Convert allNodesConfig properties to composable jinja2"
Jenkins [Wed, 14 Sep 2016 09:09:36 +0000 (09:09 +0000)]
Merge "Add support for deploying Ceph RGW role"
Steven Hardy [Mon, 5 Sep 2016 22:02:44 +0000 (23:02 +0100)]
Convert allNodesConfig properties to composable jinja2
To support custom roles we need to generate these lists of role
specific data.
Change-Id: Ide97cd57d1c07f7f7ff260ff7a6bbe2b71753bd0
Partially-Implements: blueprint custom-roles
Steven Hardy [Mon, 5 Sep 2016 21:57:43 +0000 (22:57 +0100)]
Move role ResourceGroups inside the jinja2 loop
This moves the now nearly identical group resources inside the loop
there's a FIXME related to some deprecated compute parameters we'll
need to work around.
Change-Id: Iddd63c42754867125e65e7721ab9d9f46f4d6afb
Partially-Implements: blueprint custom-roles
Jenkins [Tue, 13 Sep 2016 13:40:39 +0000 (13:40 +0000)]
Merge "Enable proxy header parsing for Manila"
marios [Thu, 11 Aug 2016 11:30:04 +0000 (14:30 +0300)]
Add NetApp Manila driver integration and tidy up generic
Enables configuring a NetApp backend for the Manila service
This was created based on the review at
https://review.openstack.org/#/c/188138/
This makes the netapp and generic backends disabled by default
in the services/manila-backend-*.yaml. A backend is then
enabled via backend-specific environment files, which will set
any config parameters and enable that backend.
It is expected that multiple manila backend specific environment
files might be specified simultaneously.
Finally generic and manila config is split into separate
service files rather than using manila-base for all the things.
Co-Authored-By: Ryan Hefner <rhefner@redhat.com>
Co-Authored-By: Ben Swartzlander <ben@swartzlander.org>
Closes-Bug:
1618479
Depends-On: Ic6f8e8d27ca20b9badddea5d16550aa18bff8418
Change-Id: I35fce32d0f6a5cc1c3382c2d0e0d6028928fd943
Jenkins [Mon, 12 Sep 2016 22:13:19 +0000 (22:13 +0000)]
Merge "De-bracket vncproxy_host in compute profile"
Jenkins [Mon, 12 Sep 2016 21:52:55 +0000 (21:52 +0000)]
Merge "Configure Keystone credentials"
Jenkins [Mon, 12 Sep 2016 21:05:24 +0000 (21:05 +0000)]
Merge "Add trunking plugin to list of default ML2 service plugins"
Adam Young [Mon, 12 Sep 2016 16:43:39 +0000 (12:43 -0400)]
Unset Keystone public_endpoint
The keystone public_endpoint value should be deduced from the calling
request and not hardcoded, or it makes network isolation impossible.
Change-Id: Ide6a65aa9393cb84591b0015ec5966cc01ffbcf8
Closes-Bug:
1381961
Ben Nemec [Tue, 30 Aug 2016 20:58:43 +0000 (15:58 -0500)]
De-bracket vncproxy_host in compute profile
This is done in the vncproxy profile, but for some reason is not in
the compute one. It causes hiera to explode when the brackets are
left, so we need to do the bracket stripping here too.
Also switches both places to just use the host_nobrackets version
of the endpoint instead of stripping them with str_replace.
Change-Id: I7ccd84b575fd652f6412fdb1869c31c79a7bf53b
Closes-Bug:
1618623
Emilien Macchi [Tue, 6 Sep 2016 22:24:28 +0000 (18:24 -0400)]
Configure Keystone credentials
Configure Keystone credentials by installing 2 keys with dynamic content
generated by python-tripleoclient.
Note: this is a first iteration of managing Keystone credentials. It has
a few limitations:
- keys are not exported to external storage.
- keys are not rotated automatically.
Change-Id: I45cf8821eadf528dfcdc8d74e6e0484597b0d2c0
Juan Antonio Osorio Robles [Mon, 12 Sep 2016 11:02:07 +0000 (14:02 +0300)]
Add explicit entry for ctlplane IP in /etc/hosts
There was currently no way of getting it and we can't asure that the
primary IP will use it. So it's explicitly needed there.
Change-Id: Idb3ca22ac136691b0bff6f94524d133a4fa10617
Sofer Athlan-Guyot [Thu, 25 Aug 2016 09:58:56 +0000 (11:58 +0200)]
Refactor upgrade checks.
We make it clear that recoverable checks happen before starting the
upgrade to be able to run the upgrade after the offending error has been
manually corrected.
Add new check for the pcsd cluster status.
Add new check for galera password file: BZ
1357112
Closes-Bug:
1614907
Change-Id: If736c79121e1ffe0eaeb814bdb73ccbc0b64edcd