fuel.git
8 years agoci, build/f_repos: Minor UX improvements 83/22883/6
Alexandru Avadanii [Sun, 9 Oct 2016 15:38:30 +0000 (17:38 +0200)]
ci, build/f_repos: Minor UX improvements

After Armband rework landed of top of `build/f_repos` mechanism [1],
the following minor UX improvements can also be applied to Fuel's
f_repos:
- set SHELL to "/bin/sh" (we don't use any bash-isms);
- improve "From SHA..." removal for exported patches;
- force checkout of root tag commit during clean;
- silence progress during git clone (cleaner logs);
- support git older than 1.8.4 in `make clean` (fix Armband deploy);

FIXME:
 Pass TERM as Docker env var until [2] is fixed in Docker 1.13.

v4 -> v5:
 * Moved `export TERM` to Releng, where it actually belongs [3];
 * Fixed Armband deploys fail [4] by adjusting `make clean`;

[1] https://gerrit.opnfv.org/gerrit/#/c/22791/
[2] https://github.com/docker/docker/issues/9299
[3] https://gerrit.opnfv.org/gerrit/#/c/22933/
[4] https://build.opnfv.org/ci/view/armband/job/\
    fuel-deploy-armband-baremetal-daily-master/57/consoleText

Fixes: FUEL-200

Change-Id: I80e3074f8659769e21f5b56f07c34c7a5de727bc
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
8 years agoImproving robustness of repo mirror selection 95/22195/3
Stefan K. Berg [Wed, 21 Sep 2016 12:34:15 +0000 (14:34 +0200)]
Improving robustness of repo mirror selection

Change-Id: If0f5b268848439aa9d2abee099bbd985abd53d5c
Signed-off-by: Stefan K. Berg <stefan.k.berg@ericsson.com>
8 years agoMerge "build: Use git submodules for Fuel git repos"
Alexandru Avadanii [Thu, 6 Oct 2016 13:15:32 +0000 (13:15 +0000)]
Merge "build: Use git submodules for Fuel git repos"

8 years agobuild: Use git submodules for Fuel git repos 73/22573/13
Alexandru Avadanii [Sat, 24 Sep 2016 15:27:16 +0000 (17:27 +0200)]
build: Use git submodules for Fuel git repos

This change reworks support for cloning (fetching) and patching all
Fuel components (fuel-library ... fuel-ui, see [1] for full list),
both outside the ISO build process (for development purposes, like
testing OPNFV patches apply cleanly to each component), and during
the ISO build.

The implementation relies heavily on git submodules and patches,
so backporting pending upstream gerrit changes, as well as adding new
out-of-upstream-tree patches, should be trivial.

Also, since without tracking remotes the repos rarely change, leverage
the in-place OPNFV build caching mechanism to drastically reduce the
number of git clones during each build.

The mechanism is detailed more in-depth in the JIRA ticket [3], and
it's merely a rehash of the submodule handling in Armband, implemented
initially by Stanislaw Kardach <stanislaw.kardach@cavium.com>.

Pros (+ new features):
 - OPNFV patches for Fuel components can be applied (imported) or
   developed (exported) outside of the ISO build process;
 - git repo caching reduces the number of external pulls;
 - reuse the same fuel-* componets in ALL targets
   e.g. fuel-mirror used to employ 2 slightly different git trees;
 - one step closer to Fuel/Armband merge (lots of steps left though);

Cons:
 - adds a lot complexity to solve a non-problem (handling the repos
   is fine in the current form, for the current goals);
   However, patching <fuel-astute> or <fuel-agent> seems to be
   quite complicated with the current mechanism, as env vars
   override our locally patched repos for these components).
   The proposed change should eliminate this issue completely.

CHANGE:
 Aligned divergent fuel-mirror in ISO vs local repo build by
 applying the 302 redirect fix ("Fixed handling http redirects") [2]
 on top of 9.0.1 tag in fuel-mirror repo, and using that for both.
 This obsoleted the followking mk file:
 - build/f_isoroot/f_repobuild/config.mk

CHANGE:
 Removed unused make target `get-fuel-repo` from build/config.mk.

FIXME:
 Remote tracking is currently deactivated for all branches.
 Change this when remote HEAD should be tracked instead,
 e.g. during Newton rebase.

[1] https://github.com/openstack/fuel-main/blob/stable/mitaka/repos.mk#L32
[2] https://review.openstack.org/#/c/334882/
[3] https://jira.opnfv.org/browse/FUEL-200

TODO: Extend build/f_repos/README.md with info about:
 - branch changes;
 - tag bumps;
 - patching now supports subdirs;

v5 -> v6:
 * Added support for nesting patches in subdirs, to be used for feature
   groups and related changes across submodules.
   E.g. Upcoming multiarch EFI support could go in:
    - .../f_repos/patch/fuel-agent/multiarch-efi/...;
    - .../f_repos/patch/fuel-astute/multiarch-efi/...;
   While Armband patches could go in:
    - .../f_repos/patch/fuel-agent/armband/...;
    - .../f_repos/patch/fuel-astute/armband/...;
   etc.
v6 -> v13:
 * fix wrong tag used for VERSION dump;
 * fix wrong tag used for patches-export;
 * move OPNFV_TAG to main config.mk and use it in FUEL_*_COMMIT;
 * only run `patches-import` when patches changed / not yet applied;
 * only run `clean` for stale `.cacheid` (avoid re-applying patches);
 * allow git submodule path/name to be different (FIXED);
 * put-cache should only run when artifact is not already cached;
 * `git am`: use 3-way merge so already applied patches are gently
   skipped (useful for upstreaming patches from Armband);
 * Properly support nested patch dirs;
 * Colorize the output a little;

JIRA: FUEL-200

Change-Id: I9dbdd9b3022896d4497d21be8dacc859730db489
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
8 years agobuild/docker: CI: no tag reuse on env var change 93/22693/2
Alexandru Avadanii [Tue, 4 Oct 2016 15:26:57 +0000 (17:26 +0200)]
build/docker: CI: no tag reuse on env var change

The previous change adding support for OPNFV build tag reuse
added the get/put-cache functionality to `build/docker` just
for detecting env var changes between tag creation and current build.

Obviously, when building outside CI, it is up to the end user to
force a docker rebuild when env vars change (this was the behavior
before the tag reuse support too).

An alternative approach would be removing get/put-cache completely,
if we consider the env vars (http proxy related) never change for
CI cached builds (seems to be true, worst case we wait 1 day for
the tag to expire when it happens).

This change just fixes the original intended behavior in tag reuse.

JIRA: FUEL-204

Change-Id: I14666994bc334012a5198a64a4a24cd4962e4bd6
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
8 years agoMerge "Use tacker plugin in SFC scenario"
Michal Skalski [Tue, 4 Oct 2016 13:56:24 +0000 (13:56 +0000)]
Merge "Use tacker plugin in SFC scenario"

8 years agoMerge "build/docker: Reuse tagged image for OPNFV build"
Alexandru Avadanii [Tue, 4 Oct 2016 09:59:30 +0000 (09:59 +0000)]
Merge "build/docker: Reuse tagged image for OPNFV build"

8 years agoUse tacker plugin in SFC scenario 43/22643/3
Michal Skalski [Mon, 3 Oct 2016 12:05:22 +0000 (14:05 +0200)]
Use tacker plugin in SFC scenario

JIRA: FUEL-205

verify: no-cache

Change-Id: I37746bf3e490f6b707de8fe56af10f1df932908c
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
8 years agoMerge "Integration of fuel-plugin-tacker"
Michal Skalski [Mon, 3 Oct 2016 12:15:02 +0000 (12:15 +0000)]
Merge "Integration of fuel-plugin-tacker"

8 years agoMerge "Simplify decrement"
Michal Skalski [Mon, 3 Oct 2016 08:55:03 +0000 (08:55 +0000)]
Merge "Simplify decrement"

8 years agoIntegration of fuel-plugin-tacker 97/22597/5
George Paraskevopoulos [Fri, 30 Sep 2016 12:21:26 +0000 (15:21 +0300)]
Integration of fuel-plugin-tacker

JIRA: FUEL-205

This change integrates https://github.com/openstack/fuel-plugin-tacker
to the Fuel project.

Change-Id: I51b1bdeeb678e55b85393f6a9f8180fc79322e8f
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
8 years agobuild/docker: Reuse tagged image for OPNFV build 27/22627/1
Alexandru Avadanii [Sat, 1 Oct 2016 17:14:51 +0000 (19:14 +0200)]
build/docker: Reuse tagged image for OPNFV build

During CI build loops, the workspace is freshly fetched,
so '.docker' make target is built each time.

Reuse existing 'opnfv.org/ubuntu-builder:14.04' tag if present, but
enforce a configurable lifespan for this tag (currently 1 day), so
it does not get stale.

JIRA: FUEL-204

Change-Id: I8d1bd81f3e5e81068e9586c9bea9f43b3327eb38
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
8 years agoMerge "use pgrep instead of ps"
Jonas Bjurel [Thu, 29 Sep 2016 19:47:28 +0000 (19:47 +0000)]
Merge "use pgrep instead of ps"

8 years agoMerge "check read access instead of isfile() for Fuel ISO"
Jonas Bjurel [Thu, 29 Sep 2016 19:44:26 +0000 (19:44 +0000)]
Merge "check read access instead of isfile() for Fuel ISO"

8 years agocheck read access instead of isfile() for Fuel ISO 79/17579/2
Ross Brattain [Wed, 8 Jun 2016 15:56:34 +0000 (08:56 -0700)]
check read access instead of isfile() for Fuel ISO

When testing with nested virtualzation I attached
the Fuel ISO to VM (/dev/sr0) running deploy.sh

This failed because we expect the ISO to be a file, when
it could be a device, e.g. /dev/sr0.  Instead of checking isfile()
check for read access.

This tested with bsdtar. It can extract an ISO from a file or device.

Change-Id: Ic09373cd618b33382303d9134cce4e005040de95
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
8 years agouse pgrep instead of ps 77/17577/4
Ross Brattain [Tue, 28 Jun 2016 00:35:57 +0000 (17:35 -0700)]
use pgrep instead of ps

pgrep was added to procps-ng, it is more exact

also replace ps -ef in wait_until_fuel_menu_up
removed get_fuel_menu_pid

Change-Id: I57ad9d2fabbfe5f570e0be3bfb40ef842f95902d
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
8 years agoRefactor deploy-config.py into object style 45/22445/3
Peter Barabas [Mon, 26 Sep 2016 11:10:56 +0000 (13:10 +0200)]
Refactor deploy-config.py into object style

Change-Id: I706563e6ed1bbfd98adc5a4124ff63789f9e32fa
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>
8 years agoMerge "[odl-l3] Get OVS plugin into the action"
Michal Skalski [Thu, 29 Sep 2016 07:25:43 +0000 (07:25 +0000)]
Merge "[odl-l3] Get OVS plugin into the action"

8 years agoMerge "Support different format of fuel task info"
Michal Skalski [Wed, 28 Sep 2016 14:47:22 +0000 (14:47 +0000)]
Merge "Support different format of fuel task info"

8 years agoSimplify decrement 25/22525/1
Peter Barabas [Wed, 28 Sep 2016 14:07:01 +0000 (16:07 +0200)]
Simplify decrement

Change-Id: I5ad9ee013cc3ac07e75b4c94d71af3c9fd46d281
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>
8 years agoMerge "Add DHA adapter dependencies"
Michal Skalski [Wed, 28 Sep 2016 07:24:36 +0000 (07:24 +0000)]
Merge "Add DHA adapter dependencies"

8 years agoSupport different format of fuel task info 11/22511/1
Michal Skalski [Tue, 27 Sep 2016 21:31:52 +0000 (23:31 +0200)]
Support different format of fuel task info

As described in this bug: https://bugs.launchpad.net/fuel/+bug/1625518
json output of the task can be in different format: single dict or list
of dicts. During tests of https://gerrit.opnfv.org/gerrit/21807 only the
later one was visible, try to support both types of output.

Change-Id: I7d3e12270c8246b03bdc6c73d3be77a039df469f
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
8 years agoMerge "Change the way how we track deployment"
Michal Skalski [Tue, 27 Sep 2016 15:17:18 +0000 (15:17 +0000)]
Merge "Change the way how we track deployment"

8 years agoMerge "deploy: fix: remove storage files during cleanup"
Jonas Bjurel [Tue, 27 Sep 2016 14:35:54 +0000 (14:35 +0000)]
Merge "deploy: fix: remove storage files during cleanup"

8 years agoAdd DHA adapter dependencies 93/22493/1
Peter Barabas [Tue, 27 Sep 2016 10:39:42 +0000 (12:39 +0200)]
Add DHA adapter dependencies

Change-Id: Ia83782ac6baed0f9d753b69b18202abaafb972e5
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>
8 years agoAdded Alexandru Avadanii as committer to Fuel@OPNFV 59/22459/1
Jonas Bjurel [Mon, 26 Sep 2016 17:23:32 +0000 (19:23 +0200)]
Added Alexandru Avadanii as committer to Fuel@OPNFV

A Majority of the Fuel@OPNFV committers have voted for Alexandru as committer:
Those include:
Michal Skalski
Jonas Bjurel
Greg Elkinbard
Stefan Berg
Daniel Smith

No one voted 0 or -1

Change-Id: Ib477ba126be438a11b409a85805a71734bf1a679
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
8 years agoMerge "Updated committer list"
Gregory Elkinbard [Mon, 26 Sep 2016 16:56:56 +0000 (16:56 +0000)]
Merge "Updated committer list"

8 years agodeploy: fix: remove storage files during cleanup 47/22447/1
Stefan Sicleru [Mon, 26 Sep 2016 12:09:09 +0000 (14:09 +0200)]
deploy: fix: remove storage files during cleanup

Remove old disks through virsh instead of calling os.delete()
methods so that the cleanup phase would succeed within a non-root
setup. [1]

Related-bug: ARMBAND-128

[1] https://gerrit.opnfv.org/gerrit/#/c/19491/

Change-Id: I90007edf014c7e15a68b9a334fcaffaa127ee4ab
Signed-off-by: Stefan Sicleru <stefan.sicleru@enea.com>
8 years ago[odl-l3] Get OVS plugin into the action 39/22439/2
Michael Polenchuk [Mon, 26 Sep 2016 09:16:30 +0000 (12:16 +0300)]
[odl-l3] Get OVS plugin into the action

Update ovs version to 2.5+ in order to get inserted security group
connection tracking flows in ovsdb, which allows to pass
tempest scenario of test_network_basic_ops.

JIRA: FUEL-199
Change-Id: Id3e6c8ed2b79c4b6b4a7623f0d262c63f1d1d89f
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
8 years agoChange the way how we track deployment 07/21807/3
Michal Skalski [Tue, 20 Sep 2016 07:38:32 +0000 (09:38 +0200)]
Change the way how we track deployment

Use fuel2 for start deployment. Since it does not return progress
use deployment task to provide this information. Currently used
'deploy-changes' will behave the same:
https://bugs.launchpad.net/fuel/+bug/1565026

Try to handle situation when nodes temporary go offline. With
deploy-changes environment still was in 'new' state in this situtation
which causes timeouts from jenkins.

JIRA: FUEL-196

Change-Id: I6548a5ec807551388e845044c282b7af32eb9100
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
8 years ago[odl] Get latest changes 39/22339/1
Michael Polenchuk [Thu, 22 Sep 2016 10:18:06 +0000 (13:18 +0300)]
[odl] Get latest changes

* Fix setting bgpd password with puppet
* Enable G1 garbage collector
* Adding caching possiblity
* Add firewall resource that opens BGP ports

Change-Id: I8f779ba7356acf52967e594a1a213edf192962fc
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
8 years agoMerge "Templater can now read files from URLs"
Michal Skalski [Thu, 22 Sep 2016 09:03:21 +0000 (09:03 +0000)]
Merge "Templater can now read files from URLs"

8 years agoMerge "Refactoring"
Michal Skalski [Thu, 22 Sep 2016 08:36:29 +0000 (08:36 +0000)]
Merge "Refactoring"

8 years agoMerge "Change prints from statements to function calls"
Michal Skalski [Thu, 22 Sep 2016 08:03:52 +0000 (08:03 +0000)]
Merge "Change prints from statements to function calls"

8 years agoEmergency patch - fixed broken links 23/22223/2
Jonas Bjurel [Wed, 21 Sep 2016 15:22:45 +0000 (17:22 +0200)]
Emergency patch - fixed broken links

Change-Id: I7aea7c06775cac3efeb22d2256c7acf6fbb137d5
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
8 years agoMerge "Fix: ISO build omits long path files"
Jonas Bjurel [Wed, 21 Sep 2016 11:46:37 +0000 (11:46 +0000)]
Merge "Fix: ISO build omits long path files"

8 years agoMerge "[performance] Disable keystone token revoke"
Jonas Bjurel [Wed, 21 Sep 2016 11:44:47 +0000 (11:44 +0000)]
Merge "[performance] Disable keystone token revoke"

8 years agoChange prints from statements to function calls 89/20989/3
Peter Barabas [Tue, 13 Sep 2016 08:28:57 +0000 (10:28 +0200)]
Change prints from statements to function calls

Change-Id: I378baa85bd9e1b9b535a2d4e9c8dcb34a267a6e5
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>
8 years agoTemporary Hardcoded Ubuntu repo 85/21885/1
Jonas Bjurel [Tue, 20 Sep 2016 15:30:37 +0000 (17:30 +0200)]
Temporary Hardcoded Ubuntu repo

Meanwhile we're investigating the issues with Ubuntu repo mirror selection,
we will hardcode the Ubuntu repo mirror

Change-Id: I776bd3a8a72dc87e00052e8ff965de1134293c7a
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
8 years ago[performance] Disable keystone token revoke 53/21453/2
Michael Polenchuk [Mon, 19 Sep 2016 14:17:39 +0000 (17:17 +0300)]
[performance] Disable keystone token revoke

Change-Id: I6db0bfaab5462a9a8f8de64bc1b088607d407bab
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
8 years agoRefactoring 87/21787/3
Peter Barabas [Tue, 20 Sep 2016 08:46:02 +0000 (10:46 +0200)]
Refactoring

 - Move function definition to its place
 - Add main function

Change-Id: I9dd71dd2da0579e04841c9efc80f2770d0182b10
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>
8 years ago[KVM] Install plugin in post-deployment 53/21553/1
Michal Skalski [Tue, 20 Sep 2016 07:42:12 +0000 (09:42 +0200)]
[KVM] Install plugin in post-deployment

JIRA: FUEL-171

Change-Id: Iead815ba2da76493f108ad71bc32cff265302b55
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
8 years agoMake sure to use only up-to-date mirrors 29/21429/2
Stefan K. Berg [Mon, 19 Sep 2016 12:14:23 +0000 (14:14 +0200)]
Make sure to use only up-to-date mirrors

Whitewash the geographically "close" mirrors against the list of
fully synced mirrors - we've had a few instances of getting bad
mirrors which would break the script.

All credit goes to:

https://askubuntu.com/questions/39922/how-do-you-select-the-fastest-mirror-from-the-command-line

... and we should perhaps use the netselect tool as well somewhere down
the line, but this fixes the most urgent problem.

Change-Id: Ia61a2bd78657b28019f57fc1962d410e754e6d2a
Signed-off-by: Stefan K. Berg <stefan.k.berg@ericsson.com>
8 years agoRepo tidy-up + licence scrubing 23/21323/3
Jonas Bjurel [Fri, 16 Sep 2016 22:12:33 +0000 (00:12 +0200)]
Repo tidy-up + licence scrubing

- Added licences and (c) to files not complying to Licence and (c) policies.
- Removed example templates not having correct licence claims and no longer being rellevant.
- Removed the Vagrant deployment method as it is not used, not rebased/up to date and not holding correct license claims.

Strategies used:
- Machine generated are not assigned an licence text, the licence follow from the source.
- Generated patch files are not assigned an licence text, the licence follow from the source.

Change-Id: I9763f076eae51fbb2d4e5cb8cacfa4bb6cf338cc
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
8 years agoUpdated committer list 25/21325/1
Jonas Bjurel [Fri, 16 Sep 2016 22:39:09 +0000 (00:39 +0200)]
Updated committer list

Change-Id: I5f22080edf695cef3c6fd24ff0f62b02a1dbc0af
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
8 years agoEnable ci off-line deployment 29/21229/2
Jonas Bjurel [Wed, 14 Sep 2016 13:24:39 +0000 (15:24 +0200)]
Enable ci off-line deployment

Updated dea_base to use locak repo mirrors for off-line deployment
NOT TO BE PART OF COLORADO.1

Change-Id: Ia8e2d716570267ed9a9e06e253b6a7b258ee26eb
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
8 years agoMerge "Final updates of release notes"
Jonas Bjurel [Fri, 16 Sep 2016 16:43:42 +0000 (16:43 +0000)]
Merge "Final updates of release notes"

8 years agoFinal updates of release notes 63/21263/5
Jonas Bjurel [Fri, 16 Sep 2016 11:30:00 +0000 (13:30 +0200)]
Final updates of release notes

-Added filters for fixes, issues and work-arounds

Change-Id: Id76545fd7837c83145bd8d87b309c23849da6f7e
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
8 years agoMerge "Increase number of hugepages allocated for nova"
Michal Skalski [Fri, 16 Sep 2016 14:19:05 +0000 (14:19 +0000)]
Merge "Increase number of hugepages allocated for nova"

8 years agoRemove extra empty line 71/21171/2
Peter Barabas [Thu, 15 Sep 2016 11:03:11 +0000 (13:03 +0200)]
Remove extra empty line

Change-Id: I462a99b42d05b979c4f1904e7309e87ddd94d1bb
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>
8 years agoTemplater can now read files from URLs 53/21253/1
Peter Barabas [Fri, 16 Sep 2016 10:56:30 +0000 (12:56 +0200)]
Templater can now read files from URLs

Change-Id: I34b81379f7e77743e64bbf4ae814b6cd296f2428
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>
8 years agoMerge "[OVS-DPDK] Turn off missing options"
Michal Skalski [Fri, 16 Sep 2016 09:08:05 +0000 (09:08 +0000)]
Merge "[OVS-DPDK] Turn off missing options"

8 years agoIncrease number of hugepages allocated for nova 31/21231/1
Michal Skalski [Thu, 15 Sep 2016 23:10:10 +0000 (01:10 +0200)]
Increase number of hugepages allocated for nova

Yardstick is using m1.small flavor for some tests, in case of ovs
scenario it should be possible to allocate 2GB from hugepages.

Change-Id: Ie908d94e63a5055907bb33c69a5e028739f44f2e
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
8 years agoStop using network transformation 53/21153/6
Michal Skalski [Thu, 15 Sep 2016 03:09:53 +0000 (05:09 +0200)]
Stop using network transformation

Due the bug in code we did not apply network transformation to created
environments, but still Fuel base on chosen segmentation type and
networks to NICs assigment has been generated network schema itself.
Since we don't use custom network schema we can remove transformation
defintions from dea pod overrides files. However there is a need to
configure NIC properties in case of dpdk deployment.

JIRA: FUEL-192

Change-Id: Ib7dab4d61910ac8c44b6d91e0c486c9693034823
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
8 years ago[OVS-DPDK] Turn off missing options 97/21197/1
Michael Polenchuk [Thu, 15 Sep 2016 14:36:58 +0000 (17:36 +0300)]
[OVS-DPDK] Turn off missing options

Get all gcc/compile options to conform to corei7 arch.

JIRA: FUEL-186
Change-Id: I5ce76631aac9174c69362f96f71e26285fc95842
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
8 years agoUplift fuel-plugin-ovs 77/21177/1
billyom [Thu, 15 Sep 2016 12:27:50 +0000 (13:27 +0100)]
Uplift fuel-plugin-ovs

Pull in "Update flavors mem_page_size"

Change-Id: I3e285cefee561dbbc02eb9ab7d2e9c01eef2742a
Signed-off-by: Billy O'Mahony <billy.o.mahony@intel.com>
8 years agoMerge "Use Boron RC3.5 for sfc scenarion"
Michal Skalski [Wed, 14 Sep 2016 15:03:42 +0000 (15:03 +0000)]
Merge "Use Boron RC3.5 for sfc scenarion"

8 years agoUse Boron RC3.5 for sfc scenarion 13/21113/1
Michal Skalski [Wed, 14 Sep 2016 09:55:21 +0000 (11:55 +0200)]
Use Boron RC3.5 for sfc scenarion

It should fix problems with vm communication through floating IPs.

Change-Id: Icadc71f2b99c28715c15389e59111272a21440fb
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
8 years agoUpdate local mirrors defintions 49/21049/1
Michal Skalski [Tue, 13 Sep 2016 18:49:03 +0000 (20:49 +0200)]
Update local mirrors defintions

If we only use main section, not all required packages are discovered.

Change-Id: I2eaa4a7bfc659b820901ce55a4ab799c3281df3b
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
8 years ago[ovs-dpdk] Target compiler to corei7 cpu arch 81/20981/2
Michael Polenchuk [Tue, 13 Sep 2016 08:06:14 +0000 (11:06 +0300)]
[ovs-dpdk] Target compiler to corei7 cpu arch

Change-Id: Id2405bc3b636178791428b9bab739fdaa0f094a2
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
8 years agoMerge "Don't fork a templater process, use the library"
Jonas Bjurel [Tue, 13 Sep 2016 09:48:13 +0000 (09:48 +0000)]
Merge "Don't fork a templater process, use the library"

8 years agoMerge "Properly handle quotes in argument masking"
Jonas Bjurel [Mon, 12 Sep 2016 13:29:26 +0000 (13:29 +0000)]
Merge "Properly handle quotes in argument masking"

8 years agoMerge "update node_reset() in zte_adapter.py"
Jonas Bjurel [Mon, 12 Sep 2016 13:28:58 +0000 (13:28 +0000)]
Merge "update node_reset() in zte_adapter.py"

8 years agoMerge "Add intel-sc lab devel-pipeline configuration"
Jonas Bjurel [Mon, 12 Sep 2016 11:12:24 +0000 (11:12 +0000)]
Merge "Add intel-sc lab devel-pipeline configuration"

8 years agoChange the way of hugepage allocation 69/20769/1
Michal Skalski [Fri, 9 Sep 2016 12:49:42 +0000 (14:49 +0200)]
Change the way of hugepage allocation

Try to allocate enough hugepages for all NUMA nodes.

JIRA: FUEL-186

Change-Id: Idcdf6ab616dfbd9ef1104be8d1667421221ea5f2
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
8 years agoupdate node_reset() in zte_adapter.py 45/20745/2
wu.zhihui [Fri, 9 Sep 2016 07:55:01 +0000 (15:55 +0800)]
update node_reset() in zte_adapter.py

Change-Id: I71790b8abb25936045f777a78ed903f3b8ce4303
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
8 years agoAdd intel-sc lab devel-pipeline configuration 87/20687/1
davidjchou [Thu, 8 Sep 2016 21:51:01 +0000 (14:51 -0700)]
Add intel-sc lab devel-pipeline configuration

intel-sc is the lab devel-pipeline configuration for a lab of Intel
in Santa Clara, CA, USA. This lab is behind Intel proxy sever.

Change-Id: I401b030adf82d6a19397e92aef4b30ebe971d80c
Signed-off-by: davidjchou <david.j.chou@intel.com>
8 years agoReduce ceilometer memory usage 97/20697/1
Michael Polenchuk [Thu, 8 Sep 2016 16:36:45 +0000 (19:36 +0300)]
Reduce ceilometer memory usage

JIRA: FUEL-189
Change-Id: I54854e4cc87f0c0e9e348e18131aa88b70e30054
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
8 years agoDon't fork a templater process, use the library 39/20439/2
Peter Barabas [Tue, 6 Sep 2016 11:23:35 +0000 (13:23 +0200)]
Don't fork a templater process, use the library

Change-Id: I931ba56fe65f2f5d5af483a8bfe654a0ecda1611
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>
8 years agoProperly handle quotes in argument masking 35/20535/1
Peter Barabas [Wed, 7 Sep 2016 08:04:56 +0000 (10:04 +0200)]
Properly handle quotes in argument masking

Use shlex to parse the command line, thus handling quotes and other
special characters.

Change-Id: Icc3a2cd934aac8f67e07d967f76c7679bcb34996
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>
8 years agoDisable cpu features in ovs with DPDK 15/20515/1
Guo Ruijing [Tue, 6 Sep 2016 22:14:51 +0000 (18:14 -0400)]
Disable cpu features in ovs with DPDK

Change-Id: I2cf5df2f0469f21f64e0e7d11740058639f68697
Signed-off-by: Guo Ruijing <ruijing.guo@intel.com>
8 years agoMerge "Final Colorado document review. - Please review the rendered HTML document...
Jonas Bjurel [Tue, 6 Sep 2016 13:35:07 +0000 (13:35 +0000)]
Merge "Final Colorado document review. - Please review the rendered HTML document (See Jenkins references below) - Please verify the documented procedures and instructions"

8 years agoFinal Colorado document review. 55/19555/12
Jonas Bjurel [Thu, 25 Aug 2016 09:20:55 +0000 (11:20 +0200)]
Final Colorado document review.
- Please review the rendered HTML document (See Jenkins references below)
- Please verify the documented procedures and instructions

READY TO MERGE

Change-Id: Idff52212ca68ce2b97f203043e18a18c582589a7
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
8 years agoFix: ISO build omits long path files 71/20071/2
Alexandru Avadanii [Wed, 31 Aug 2016 20:57:38 +0000 (22:57 +0200)]
Fix: ISO build omits long path files

make iso generates:
libisofs: WARNING : File "/ubuntu/pool/main/libj/\
libjs-twitter-bootstrap-datepicker/libjs-twitter-bootstrap-\
datepicker_1.3.1+dfsg1-1~u14.04+mos1_all.deb" can't be added
to Joliet tree, because its path length is larger than 240

At the end this package is missing in latest ISO.
NOTE: This issue is only triggered on certain kernels during build.

Closes-bug: FUEL-190

Change-Id: I21f7f1cbe3f64317d2feb66e371611a654cf30f8
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
8 years agoMerge "build: Move patches to <patch-repos> dir"
Jonas Bjurel [Mon, 5 Sep 2016 10:50:51 +0000 (10:50 +0000)]
Merge "build: Move patches to <patch-repos> dir"

8 years agoMerge "Do not use rsync for choosing mirror server"
Michal Skalski [Mon, 5 Sep 2016 10:05:51 +0000 (10:05 +0000)]
Merge "Do not use rsync for choosing mirror server"

8 years agoDo not use rsync for choosing mirror server 89/20189/2
Michal Skalski [Thu, 1 Sep 2016 22:39:30 +0000 (00:39 +0200)]
Do not use rsync for choosing mirror server

Rsync protocol was used for creating local mirrors, but now we only need
http connection. This requirement can be problematic for environments
which are behind proxy and can lead to build failures when rsync is not
allowed.

Change-Id: I4efcf500fd0c25de5fdb87307e7210cc4a96714d
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
8 years agoChange source of ODL Boron tarball 33/20233/2
Michal Skalski [Fri, 2 Sep 2016 10:23:20 +0000 (12:23 +0200)]
Change source of ODL Boron tarball

For SFC scenario we need to use ODL Boron. Since it is not yet released
there is no persistent location for a tarball. Use opnfv artifacts to
store Boron build which include required changes.

Change-Id: I43e35dbdf5ca0160d48a1adc817db071fd5db85d
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
8 years ago[OVS-DPDK] Set default for dpdk_socket_mem 43/20143/1
Michael Polenchuk [Thu, 1 Sep 2016 13:23:10 +0000 (16:23 +0300)]
[OVS-DPDK] Set default for dpdk_socket_mem

Change-Id: I175178cdcbab52ac024157d2c5707fd7e1236dd4
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
8 years agoMerge "Shift opendaylight role out of controller"
Michal Skalski [Thu, 1 Sep 2016 11:13:32 +0000 (11:13 +0000)]
Merge "Shift opendaylight role out of controller"

8 years agoMerge "[OVS-DPDK] Allocate dpdk socket memory"
Michal Skalski [Wed, 31 Aug 2016 15:20:25 +0000 (15:20 +0000)]
Merge "[OVS-DPDK] Allocate dpdk socket memory"

8 years agobuild: Move patches to <patch-repos> dir 43/20043/1
Alexandru Avadanii [Sat, 27 Aug 2016 15:13:32 +0000 (17:13 +0200)]
build: Move patches to <patch-repos> dir

Decouple main Makefile and repository patches by moving all Fuel
component patches to a subdir, <patch-repo>.

Proposed structure of <patch-repos> dir:
- patch-repos/*.patch are intended for <fuel-main> git repo;
- patch-repos/build/repo/<fuel-module>/*.patch are intended for
  <fuel-module>, e.g. "fuel-nailgun";

Full list of Fuel submodules supported by this mechanism at [1].

While at it, replace all occurences of </tmp/fuel-main> with
<FUEL_MAIN_DIR> in main Makefile and rewrite a few git/make calls
to use the "-C" arg.

NOTE: `git -C` is available starting with git 1.8.5.

[1] https://github.com/openstack/fuel-main/blob/stable/mitaka/repos.mk
    #L32-L44

Change-Id: I5e4adc7285054777c3898592ed48482ccd2b706f
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
8 years agoMerge "deploy/reap.py: Dump extra interfaces information."
Jonas Bjurel [Wed, 31 Aug 2016 15:01:19 +0000 (15:01 +0000)]
Merge "deploy/reap.py: Dump extra interfaces information."

8 years agoMerge "transplant: Generate extra interfaces config file"
Jonas Bjurel [Wed, 31 Aug 2016 15:00:39 +0000 (15:00 +0000)]
Merge "transplant: Generate extra interfaces config file"

8 years ago[OVS-DPDK] Allocate dpdk socket memory 37/19837/2
Michael Polenchuk [Tue, 30 Aug 2016 07:46:30 +0000 (10:46 +0300)]
[OVS-DPDK] Allocate dpdk socket memory

JIRA: FUEL-186
Change-Id: Id44a786f69d78b378fbabea2c70ab1ca78651729
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
8 years agodocs: build req: Remove p7zip-full 09/20009/1
Alexandru Avadanii [Wed, 31 Aug 2016 13:29:04 +0000 (15:29 +0200)]
docs: build req: Remove p7zip-full

p7zip-full is not required for building, as stated in the current
version of the docs. I think this bogus requirement was introduced
by Armband (by me, more precisely) because our build process was
happening outside docker.

Sorry for the useless code churn.

Change-Id: Id0a3c5b9016706535ca159e1da261e83c8d36d31
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
8 years agoMerge changes from topic 'multiarch-mirrors'
Jonas Bjurel [Wed, 31 Aug 2016 12:01:24 +0000 (12:01 +0000)]
Merge changes from topic 'multiarch-mirrors'

* changes:
  build: cache: Consider UBUNTU_ARCH in .cacheid
  repo mirror: Allow multi-arch local mirrors

8 years agoMerge "deploy: Delete old Fuel env if present"
Szilard Cserey [Tue, 30 Aug 2016 16:29:32 +0000 (16:29 +0000)]
Merge "deploy: Delete old Fuel env if present"

8 years agoMerge "deploy.sh: accept a timeout flag (-T)"
Jonas Bjurel [Mon, 29 Aug 2016 12:49:02 +0000 (12:49 +0000)]
Merge "deploy.sh: accept a timeout flag (-T)"

8 years agoMerge "build: cache: Allow LOCAL_CACHE_ARCH_NAME override"
Jonas Bjurel [Mon, 29 Aug 2016 12:48:19 +0000 (12:48 +0000)]
Merge "build: cache: Allow LOCAL_CACHE_ARCH_NAME override"

8 years agoMerge changes from topic 'var-overrides'
Jonas Bjurel [Mon, 29 Aug 2016 12:46:06 +0000 (12:46 +0000)]
Merge changes from topic 'var-overrides'

* changes:
  build: Allow MIRROR_MOS_UBUNTU override
  build: Allow PLUGINS override

8 years agoScript updates for CI job 33/19633/3
ferenc Cserepkei [Fri, 26 Aug 2016 05:29:28 +0000 (07:29 +0200)]
Script updates for CI job

Due to the redesign of the SFC feature test, the poc script became
part of CI job functest-fuel-baremetal, scenario os_odl_l2-sfc-ha,
there is a need of full uplift to colorado.
Changes:
 - GPG keyserver use (line 61)
 - patch updated fixing the debian package dependency issue
    (python-oslo.messaging-)
 - some typos are fixed
 - OpenDayLight address is read from hiera (management vip)

Change-Id: I4a19ec753a575220cf321819ab4ff2d9433ec16c
Signed-off-by: ferenc Cserepkei <ferenc.cserepkei@ericsson.com>
8 years agoMerge "[DOC] Do not create mailto link for Fuel@OPNFV name"
Michal Skalski [Thu, 25 Aug 2016 10:59:10 +0000 (10:59 +0000)]
Merge "[DOC] Do not create mailto link for Fuel@OPNFV name"

8 years agoMerge "[ODL] Fix odl deployment on separate node"
Michal Skalski [Thu, 25 Aug 2016 10:18:13 +0000 (10:18 +0000)]
Merge "[ODL] Fix odl deployment on separate node"

8 years ago[DOC] Do not create mailto link for Fuel@OPNFV name 53/19553/1
Michal Skalski [Thu, 25 Aug 2016 09:19:12 +0000 (11:19 +0200)]
[DOC] Do not create mailto link for Fuel@OPNFV name

Change-Id: Ib130e8a2440531c3b9c484c9e516c72d5b20301b
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
8 years agoFinal updates of the Installation instructions: 55/19355/10
Jonas Bjurel [Tue, 23 Aug 2016 13:39:31 +0000 (15:39 +0200)]
Final updates of the Installation instructions:
- Images updated
- Updated reference URIs

Change-Id: Ieeefbd8a3ef9bbd6c3a0e767f770097ab8a98f9d
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
8 years ago[ODL] Fix odl deployment on separate node 49/19549/1
Michal Skalski [Thu, 25 Aug 2016 08:18:21 +0000 (10:18 +0200)]
[ODL] Fix odl deployment on separate node

JIRA: FUEL-185

Change-Id: Id14d30154b63abc915a0cd55835bb72cee862dde
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
8 years agobuild: cache: Consider UBUNTU_ARCH in .cacheid 05/19505/1
Alexandru Avadanii [Wed, 17 Aug 2016 18:36:51 +0000 (20:36 +0200)]
build: cache: Consider UBUNTU_ARCH in .cacheid

Usually UBUNTU_ARCH is not changed inside the same repository,
but we should consider this case anyway for future merging
Armband and Fuel@OPNFV repositories/build systems.

This applies to all Fuel plugins and the local repo.

Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
8 years agobuild: cache: Allow LOCAL_CACHE_ARCH_NAME override 03/19503/1
Alexandru Avadanii [Thu, 18 Aug 2016 12:39:08 +0000 (14:39 +0200)]
build: cache: Allow LOCAL_CACHE_ARCH_NAME override

Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
8 years agobuild: Allow MIRROR_MOS_UBUNTU override 01/19501/1
Alexandru Avadanii [Tue, 16 Aug 2016 16:45:10 +0000 (18:45 +0200)]
build: Allow MIRROR_MOS_UBUNTU override

Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>