net-check: add support for faulty operstate

Some eth drivers, such as those for APM X-Gene Mustang Board's NICs, do
not advertise operstate properly in sysfs, ie. it is advertised as
"unknown" whereas ethtool shows the NIC as fully functional with link
detected. This further affects "ip link show" output which is parsed
within _check_iface_ready() method.

Replace "ip link show" command with "ethtool" in order to obtain proper
results when operstate is unknown.

Launchpad bug: https://bugs.launchpad.net/fuel/+bug/1618480

Closes-bug: ARMBAND-140

Change-Id: If8e28d3720161d9ffe897b875af235561cf1062d
Signed-off-by: Stefan Sicleru <stefan.sicleru@enea.com>
(cherry picked from commit 42050fe09821b29b4879f77411eb558c57c302cc)

Update git submodules

* Update upstream/fuel from branch 'stable/colorado'
  - Integration of fuel-plugin-tacker

    JIRA: FUEL-205

    This change integrates https://github.com/openstack/fuel-plugin-tacker
    to the Fuel project.

    Change-Id: I51b1bdeeb678e55b85393f6a9f8180fc79322e8f
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
    (cherry picked from commit d91a7fc7cc9d853a9e5c56f87b6cd22ca11ab9a2)

Updated armband
Project: fuel  8e501a8589db2c5f29a43b5fb2d253c431397b4f

deploy: fix: remove storage files during cleanup

Remove old disks through virsh instead of calling os.delete()
methods so that the cleanup phase would succeed within a non-root
setup. [1]

Related-bug: ARMBAND-128

[1] https://gerrit.opnfv.org/gerrit/#/c/19491/

Change-Id: I90007edf014c7e15a68b9a334fcaffaa127ee4ab
Signed-off-by: Stefan Sicleru <stefan.sicleru@enea.com>
(cherry picked from commit d4f9612475a07773af182f244bcd597d25bf4cd8)

Add grub template to cobbler for MAC-files

Closes-bug: ARMBAND-50

Change-Id: I9812066f2954cc02a49bfa19dbe9fc74b055e78d
Signed-off-by: Matei Valeanu <Matei.Valeanu@enea.com>
(cherry picked from commit cc19a840d7bd6826ffaf3a2bf8e84d492dacc4c9)

Updated armband
Project: fuel  d53f15a6dacb5e3d3fd58002692f9c08256ff1e9

Enable ci off-line deployment

Updated dea_base to use locak repo mirrors for off-line deployment
NOT TO BE PART OF COLORADO.1

Change-Id: Ia8e2d716570267ed9a9e06e253b6a7b258ee26eb
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
(cherry picked from commit caee61817eb7f4235ca33a9da12f14a285f9e012)

Updated armband
Project: fuel  0a76d88bcd02fcfe4678310e7d8a6ffdbabfd48e

Properly handle quotes in argument masking

Use shlex to parse the command line, thus handling quotes and other
special characters.

Change-Id: Icc3a2cd934aac8f67e07d967f76c7679bcb34996
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>
(cherry picked from commit bddbf2a740b46d1ad763967b8c8662b1877a4d75)

Updated armband
Project: fuel  d198db7f42da2915f506e7d679d47823eda58b2a

Don't fork a templater process, use the library

Change-Id: I931ba56fe65f2f5d5af483a8bfe654a0ecda1611
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>
(cherry picked from commit ff26503f13676b7551afc0633621786edd2811f0)

Updated armband
Project: fuel  c751ac064c2e9ae41caef6e529a3c39d733bfcf5

[OVS-DPDK] Turn off missing options

Get all gcc/compile options to conform to corei7 arch.

JIRA: FUEL-186
Change-Id: I5ce76631aac9174c69362f96f71e26285fc95842
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
(cherry picked from commit 861836e6bbd545d3dcee1bd041ff867fb4e3d357)

Updated armband
Project: fuel  0a4bad20dcca5e0f8b9ab577b0ccdd3e38a3db86

Remove extra empty line

Change-Id: I462a99b42d05b979c4f1904e7309e87ddd94d1bb
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>
(cherry picked from commit 2c7b9bb6623844eeea95373ec2752b0200cd69e8)

Updated armband
Project: fuel  60ced1854eaa8c3c8f1211c4b43f2a20b3a58e9d

[performance] Disable keystone token revoke

Change-Id: I6db0bfaab5462a9a8f8de64bc1b088607d407bab
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
(cherry picked from commit 5bcac1cf6a0d9367ac31f0ca5c6064d30433377b)

Updated armband
Project: fuel  cb51d993eb0ef2be99fbc06138dfd37e3dfe15ba

Fix: ISO build omits long path files

make iso generates:
libisofs: WARNING : File "/ubuntu/pool/main/libj/\
libjs-twitter-bootstrap-datepicker/libjs-twitter-bootstrap-\
datepicker_1.3.1+dfsg1-1~u14.04+mos1_all.deb" can't be added
to Joliet tree, because its path length is larger than 240

At the end this package is missing in latest ISO.
NOTE: This issue is only triggered on certain kernels during build.

Closes-bug: FUEL-190

Change-Id: I21f7f1cbe3f64317d2feb66e371611a654cf30f8
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 1e380388ee91ae71a7a32122d3942e53f146ccad)

Updated armband
Project: fuel  fcbbd6c796fca5471f29f771e9ea6949c263d795

[KVM] Install plugin in post-deployment

JIRA: FUEL-171

Change-Id: Iead815ba2da76493f108ad71bc32cff265302b55
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
(cherry picked from commit 53e6d97c9157f1e908d99dcca1207de23ea73132)

Emergency patch - fixed broken links

Change-Id: I4ec0cf95d714cbc476f73fbc4b90fd039dbd973e
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit f11e43f69af038f99ded659071e9152dbbddaf13)

Updated armband
Project: fuel  cc10e9261f6da77f10ac87e1ff4b86c9e0e44b35

Emergency patch - fixed broken links

Change-Id: I7aea7c06775cac3efeb22d2256c7acf6fbb137d5
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
(cherry picked from commit 61d9f66916fe7cacc1df25438b4060b9f3c9402d)

Updated armband
Project: fuel  d1dd9f9d570e4fa9cc3be53f9072f12efeb474cd

Temporary Hardcoded Ubuntu repo

Meanwhile we're investigating the issues with Ubuntu repo mirror selection,
we will hardcode the Ubuntu repo mirror

Change-Id: I776bd3a8a72dc87e00052e8ff965de1134293c7a
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
(cherry picked from commit 3e506f9248f2a64a8a30c832049df392b01fcb4e)

Merge "Rebase: updated blacklist for Ubuntu mirrors" into stable/colorado

Updated armband
Project: fuel  aae10837b3763e9d0a806dda9964abaebb6d8736

Make sure to use only up-to-date mirrors

Whitewash the geographically "close" mirrors against the list of
fully synced mirrors - we've had a few instances of getting bad
mirrors which would break the script.

All credit goes to:

https://askubuntu.com/questions/39922/how-do-you-select-the-fastest-mirror-from-the-command-line

... and we should perhaps use the netselect tool as well somewhere down
the line, but this fixes the most urgent problem.

Change-Id: Ia61a2bd78657b28019f57fc1962d410e754e6d2a
Signed-off-by: Stefan K. Berg <stefan.k.berg@ericsson.com>
(cherry picked from commit e12aec84ef1767d4ba9469dfb12d65d928bf0ed4)

Updated armband
Project: fuel  4d3783e1afadf7c23a6a96624170906c4cf90f0d

Repo tidy-up + licence scrubing

- Added licences and (c) to files not complying to Licence and (c) policies.
- Removed example templates not having correct licence claims and no longer being rellevant.
- Removed the Vagrant deployment method as it is not used, not rebased/up to date and not holding correct license claims.

Strategies used:
- Machine generated are not assigned an licence text, the licence follow from the source.
- Generated patch files are not assigned an licence text, the licence follow from the source.

Change-Id: I9763f076eae51fbb2d4e5cb8cacfa4bb6cf338cc
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
(cherry picked from commit 65b7cfcd862a75be72fb98777190c49f8b6ea0d3)

Rebase: updated blacklist for Ubuntu mirrors

Change-Id: I404791b14603b4ebdd0be1010412ec77cf75a478
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit cfd8c76d1f84874504ca019398787db76cf3c007)

Upstream: move patches to repo-patches dir

Upstream change: [1]

Slight rebase of our patches is now needed.

[1] https://gerrit.opnfv.org/gerrit/#/c/20043/

Change-Id: I955ae3c5c304d8c8da6e42680c81e9255487fb68
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 957a16139281785c2a6685428f7b037d6578f08d)

Updated armband
Project: fuel  f9326c161e2e8ed039499d30cced7c2553874e26

build: Move patches to <patch-repos> dir

Decouple main Makefile and repository patches by moving all Fuel
component patches to a subdir, <patch-repo>.

Proposed structure of <patch-repos> dir:
- patch-repos/*.patch are intended for <fuel-main> git repo;
- patch-repos/build/repo/<fuel-module>/*.patch are intended for
  <fuel-module>, e.g. "fuel-nailgun";

Full list of Fuel submodules supported by this mechanism at [1].

While at it, replace all occurences of </tmp/fuel-main> with
<FUEL_MAIN_DIR> in main Makefile and rewrite a few git/make calls
to use the "-C" arg.

NOTE: `git -C` is available starting with git 1.8.5.

[1] https://github.com/openstack/fuel-main/blob/stable/mitaka/repos.mk
    #L32-L44

Change-Id: I5e4adc7285054777c3898592ed48482ccd2b706f
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 52701ce099ac455aa393aac34d684f5d59b3d2fe)

Updated armband
Project: fuel  269773ffd3bbd267aeee21b49f83783c064c04c6

Increase number of hugepages allocated for nova

Yardstick is using m1.small flavor for some tests, in case of ovs
scenario it should be possible to allocate 2GB from hugepages.

Change-Id: Ie908d94e63a5055907bb33c69a5e028739f44f2e
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
(cherry picked from commit c64a4063f591c0140509e3edb88d9f0c3cd20928)

Merge "fuel-library: nova: AArch64: enable hugepage supp" into stable/colorado

Updated armband
Project: fuel  983af0184b9c0fbf6deecb2a851f4f89cc362c25

Stop using network transformation

Due the bug in code we did not apply network transformation to created
environments, but still Fuel base on chosen segmentation type and
networks to NICs assigment has been generated network schema itself.
Since we don't use custom network schema we can remove transformation
defintions from dea pod overrides files. However there is a need to
configure NIC properties in case of dpdk deployment.

JIRA: FUEL-192

Change-Id: Ib7dab4d61910ac8c44b6d91e0c486c9693034823
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>

fuel-library: nova: AArch64: enable hugepage supp

This patch adds AArch64 to the hardcoded lists of valid
architectures for hugepage support.

Closes-bug: ARMBAND-90

Change-Id: I3765e6bc314393a58db70590f3890fde206e3feb
Signed-off-by: Veena Lingadahalli <vlingadahalli@mvista.com>
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 2f4a34b88d18f7653934eaec25e99dba3bac5de6)

Updated armband
Project: fuel  1cead5571d504f5e0525eac22e9b4831867d7c18

Final updates of release notes

-Added filters for fixes, issues and work-arounds

Change-Id: Id76545fd7837c83145bd8d87b309c23849da6f7e
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
(cherry picked from commit 7dc64e4f8813a1cef9697074326698bc27a85937)

Update plugins in documentation

Change-Id: I0059e397d2f6e213e549092601b61a200f5b96a4
Signed-off-by: cristinapauna <cristina.pauna@enea.com>
(cherry picked from commit b886347f4a773f4d9b742920cc3a76751254f8fe)

Update documentation with AArch64 specifics

The documentationfrom Fuel was introduced to armband project by
https://gerrit.opnfv.org/gerrit/#/c/20679/

This patch updates it with aarch64 specifics

Change-Id: I05eccef015fd399e7d05a0505e85e733a8e95f1d
Signed-off-by: cristinapauna <cristina.pauna@enea.com>
(cherry picked from commit 5bd99052ed055c76efbc479f00edb09b5780cb56)

docs: Copy OPNFV docs dir as documentation base

There has been some restructuring of the documentation in fuel project.
This commit copies those files, while a subsequent commit will adapt
the documentation with aarch64 specifics.

Change-Id: I56b52d5d16975b88fd5b26099b43046c6a5d5747
Signed-off-by: cristinapauna <cristina.pauna@enea.com>
(cherry picked from commit b832a3e82070e12dff555e2a83d604de7e398acb)

fuel-plugin-ovs: Simplify debian version strings

Remove all suffixes from OVS debian packages, and simplify the
plugin code handling the fetching of said packages.

While at it, enable:
- local mirror caches, by mounting /etc/hosts in the docker
  builder
- HACK: mismatch between debian source versions and debian binaries

Related-bug: ARMBAND-89

Change-Id: Ifbf0e11c90cf7b2f76ce72af8ca3469a33bee071
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 6be5639d8ce2f6e282db6f3d19699a341b9b491c)

Updated armband
Project: fuel  b90311bf3240c0f57ee747e6cf3e57e07a6cf5fa

Uplift fuel-plugin-ovs

Pull in "Update flavors mem_page_size"

Change-Id: I3e285cefee561dbbc02eb9ab7d2e9c01eef2742a
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>

Updated armband
Project: fuel  f8337987d6feab6674ce05508c321ac30ef996a3

Use Boron RC3.5 for sfc scenarion

It should fix problems with vm communication through floating IPs.

Change-Id: Icadc71f2b99c28715c15389e59111272a21440fb
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
(cherry picked from commit ff9c24257a2c62dd981297a92eecf712f6643617)

AArch64: fuel-plugin-ovs enable

OVS-DPDK-NSH is not supported on arm64 for now, see [1]

Closes: ARMBAND-46

[1] https://jira.opnfv.org/browse/ARMBAND-86

Change-Id: I79b33bab7348e297c06ff4bb2bf7cc23f21eb7e3
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 5b49b2f7ea1485b56ebc7815b5a3803363ec29af)

Updated armband
Project: fuel  098c34d407f71df6f29cd70b0c8381c9522c71b2

Update local mirrors defintions

If we only use main section, not all required packages are discovered.

Change-Id: I2eaa4a7bfc659b820901ce55a4ab799c3281df3b
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
(cherry picked from commit 2e9ff14f8ab6ee9e4ebf84a2e8e40bd3f149c48e)

Revert "patches, docs: Remove MySQL WSREP SST provider"

This reverts commit 8a696682b3fd0cb5f32ddaca8ede5db7b001a57f.

Change-Id: Ib1698643639436243768f4a8209c4d68314a97ca
(cherry picked from commit f5e0922b9282dccb5d79c80c58801f455495c4ce)

Updated armband
Project: fuel  acdc36531e0b6ae2449ea7dfef58addb8786acb1

Add intel-sc lab devel-pipeline configuration

intel-sc is the lab devel-pipeline configuration for a lab of Intel
in Santa Clara, CA, USA. This lab is behind Intel proxy sever.

Change-Id: I401b030adf82d6a19397e92aef4b30ebe971d80c
Signed-off-by: davidjchou <david.j.chou@intel.com>
(cherry picked from commit 8079d1237ab9f2326adef163dc509c8a84e62775)

Updated armband
Project: fuel  72248b41f0f26b0daaacb5a61623f2f7f0f4a9b5

update node_reset() in zte_adapter.py

Change-Id: I71790b8abb25936045f777a78ed903f3b8ce4303
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
(cherry picked from commit 161dd445f06aa9a5dfcd273d89a00d1f02260ba3)

Updated armband
Project: fuel  5bd3673cb88408f13b7d84d4c09462cb15816476

Reduce ceilometer memory usage

JIRA: FUEL-189
Change-Id: I54854e4cc87f0c0e9e348e18131aa88b70e30054
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
(cherry picked from commit 4c47ef4b6f192482d99196c7a7070e5f396b1fd5)

Updated armband
Project: fuel  35cea158cb9fe9c8780bc9d90871b2ed64e4ccbe

Change the way of hugepage allocation

Try to allocate enough hugepages for all NUMA nodes.

JIRA: FUEL-186

Change-Id: Idcdf6ab616dfbd9ef1104be8d1667421221ea5f2
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
(cherry picked from commit 8d7559b50b265298f7800b18f840b87ad1e84b20)

fuel-library: mysql: Fix spurious install timeouts

Backport the following fuel-library fixes from Fuel 9.1:
- wrong relationship in clusters mysql manifest
- Rsyslog doesn't have write permission to /var/log/mysql/ directory

These two bugs manifested as:
- random deploy issues waiting for MySQL to sync, without the server
  being installed;
- no MySQL logs were saved due to permission issues;

Closes-bug: ARMBAND-78

Change-Id: I317e45d013229145e2ccbd8bb4f76ae03d544098
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit b5331973a5c755d1612d37d82841db5a98288489)

FIXME: deploy: EFI: Skip re-ordering boot via IPMI

On EFI systems deploys, altering the boot order via IPMI causes
issues on some specific targets. Until we agree on an uniform
solution for EFI systems + IPMI boot order handling, just skip
altering it via IPMI.

Related-bug: ARMBAND-71

Change-Id: I7790e1e8e3540d5ab10b8d7165316a04cf58faa4
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 946e599b00d0e9ebccb12eb0071eb25343ca3fac)

deploy: x2 timeout for fuel master install

Change-Id: I1281b0b6b9d631e371484795a53113032ebbc83c
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 7561f5f237a6abf84f7fd8adff94069906aded95)

Updated armband
Project: fuel  e07d06641a1bd5edc43eacc70bac75f824ea99ad

Disable cpu features in ovs with DPDK

Change-Id: I2cf5df2f0469f21f64e0e7d11740058639f68697
Signed-off-by: Guo Ruijing <ruijing.guo@intel.com>
(cherry picked from commit 9a3f6a38d708cbc3633d203e36e32bc91764ba20)

Updated armband
Project: vswitchperf  c4ba1cd1c33938ab54b217599d7ed9d9259a6caa

docs: Fix links and formatting

Documentation was updated as follows:
* links were updated to refer to documentation
  specific for Colorado release
* section decorators were fixed in LTD
* links to testcase and deployment
  descriptions were fixed
* duplicate labels removed from LTP&LTD
* fixed typos in formatting and text
* links to scalability and stress tests
  fixed after their renaming

JIRA: VSPERF-349

Change-Id: I8b1d7a0220d637a684e70a788dd88250c646124e
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>

build: ubuntu mirror: blacklist another SE mirror

SE mirrors are acting up lately, blacklist them:
- ftp.availo.se
- ftp.lysator.liu.se

Change-Id: If4cc7c207fa7ce39821cc8a8f754a48f573ff374
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 812b9c2aee17342b5ba00f53b45cbc721fc4adef)

Merge "deploy: Attempt fixing random deploy timeouts" into stable/colorado

Revert "EFI: Move patches to Fuel@OPNFV, upstream prep"

This reverts commit dff8f1a78db4a04dd30c2e0ac03a36cb0b198aa7.

Change-Id: I317e0f6aa7665c28035307149e6e7d42fdf508f3
(cherry picked from commit 441caa623edf47dcf8944ed11aa3c193897dcf72)

Merge "Revert "submodule: Kill fuel-astute"" into stable/colorado

Revert "submodule: Kill fuel-astute"

This reverts commit 41fc21bb87ee0ab245e8f6ada2ce49a45d633ede.

Change-Id: I0f60787acc445555b255a92671ccf0ffe8610f78

Updated armband
Project: fuel  1dfcb4b452230c0d66892f3a373c299d2c46021b

Script updates for CI job

Due to the redesign of the SFC feature test, the poc script became
part of CI job functest-fuel-baremetal, scenario os_odl_l2-sfc-ha,
there is a need of full uplift to colorado.
Changes:
 - GPG keyserver use (line 61)
 - patch updated fixing the debian package dependency issue
    (python-oslo.messaging-)
 - some typos are fixed
 - OpenDayLight address is read from hiera (management vip)

Change-Id: I4a19ec753a575220cf321819ab4ff2d9433ec16c
Signed-off-by: ferenc Cserepkei <ferenc.cserepkei@ericsson.com>
(cherry picked from commit ad0dd57dc045b58c46e53f281ab57e70d00947d7)

Updated armband
Project: fuel  b10ada83fcf236e1d3f0e181b3b551e45c39a0c4

Final Colorado document review.
- Please review the rendered HTML document (See Jenkins references below)
- Please verify the documented procedures and instructions

READY TO MERGE

Change-Id: Idff52212ca68ce2b97f203043e18a18c582589a7
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>

Rebase: fuel-mirror upstream changes

Slight rebase after upstream change [1].

FIXME: While looking at [1], I noticed that Armband is not
using the proper fuel-mirror version due to our divergent
patch & build system. This should be fixed later.

[1] https://gerrit.opnfv.org/gerrit/#/c/20317/

Change-Id: I55798ba1004312cd737b6613744683437e98865a
(cherry picked from commit b4d5044e751801507738dc02d116436d909d2248)
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

submodule: Kill fuel-astute

Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 376c76d05862ed38edeb217cd9480807571491a7)

Change-Id: I376c76d05862ed38edeb217cd9480807571491a7

EFI: Move patches to Fuel@OPNFV, upstream prep

Now we can kill fuel-astute submodule.

Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit dff8f1a78db4a04dd30c2e0ac03a36cb0b198aa7)

Change-Id: Ie049062bb7a41adfbb056894c0a6f411a2d8c254

Updated armband
Project: fuel  83cc51d849d44b4d337922cedab27645a25afcfb

Do not use rsync for choosing mirror server

Rsync protocol was used for creating local mirrors, but now we only need
http connection. This requirement can be problematic for environments
which are behind proxy and can lead to build failures when rsync is not
allowed.

Change-Id: I4efcf500fd0c25de5fdb87307e7210cc4a96714d
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
(cherry picked from commit a8820e25b80ee0c069e473cb54c576d98dd10aee)

Updated armband
Project: fuel  e49332ee58cb465c7aa95f967361c20c509b7619

Change source of ODL Boron tarball

For SFC scenario we need to use ODL Boron. Since it is not yet released
there is no persistent location for a tarball. Use opnfv artifacts to
store Boron build which include required changes.

Change-Id: I43e35dbdf5ca0160d48a1adc817db071fd5db85d
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
(cherry picked from commit 9d871421fbc631f875f7a8bdca590b42eb1bd3bf)

Updated armband
Project: vswitchperf  a12a717991c17abbbd298dff4f19d25f92c4f971

test_spec: Remove formatted text file verions of IETF Draft

Remove files with IETF copyrights (Internet Draft .txt files).
I assume these files have to be removed in C-stable branch...

JIRA: VSPERF-387

Change-Id: I03e09a6db71067f8872d653da6280b4d829fae51
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Antonio Fischetti <antonio.fischetti@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>

patches, docs: Remove MySQL WSREP SST provider

xtrabackup issues have been fixed with the latest version of
percona-xtrabackup DEBs we added to linux.enea.com, so remove
MySQL WSREP SST provider patches and corresponding docs.

Closes-bug: ARMBAND-52

Change-Id: I743e9b6ed242cf15e3063d7dcf7e05d0cee198f2
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 8a696682b3fd0cb5f32ddaca8ede5db7b001a57f)

Updated armband
Project: fuel  491c567c31839c0ea06b0b9e57d7bc553f92a494

[OVS-DPDK] Allocate dpdk socket memory

Change-Id: Ic84094e9842295df936d9f87d0777009e0020013
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>

Upstream: extra interfaces cfg

Change-Id: Ibd522813a40a0b1c385c47e65f77b1a13c860269
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 6be72ecc09f8465469a0a304ffbd6abc47a12915)

Fix: build: do not hardcode fuel branch

Change-Id: I97da6840878112a063e980c5d5d9240eb63693d7
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit cad43ce44f97f83222c6a13eaa0d8f60725b8b6f)

Updated armband
Project: fuel  72a123c3f938fd033601b2d113dcd9f524056b8e

transplant: Generate extra interfaces config file

Original work by Josep, only signed by Alex for upstreaming.

The DEA override may contain a IFCGF_<interface> section in its 'fuel:'
section, containing the necessary keys to produce a ifcfg-<interface>
file, like in this example:

fuel:
   IFCFG_ETH1:
     device: eth1
     ipaddress: 10.0.1.10
     netmask: 255.255.255.0
     gateway: 10.0.1.254

FIXME: In order for Network Manager to use the newly added interfaces
for outgoing traffic and honor their GATEWAY setting (e.g. if we just
added one public interface), the default route on admin iface (most of
the time called eth0) should be disabled. For now, we assume the admin
interface is always "eth0".

Change-Id: I96e3ac5046dd59ed10c43099dd76a6418806a1f3
Signed-off-by: Josep Puigdemont <josep.puigdemont@enea.com>
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 56d816920bfefe7d41d9c35cb8fb52e36295ee07)

Updated armband
Project: fuel  d6f49d16237333c1793d4296c43ad83892534db2

deploy/reap.py: Dump extra interfaces information.

Since on AArch64, Ubuntu local mirror lacks arm64 packages (see [1]),
Fuel master requires internet connectivity during deploy, and hence
a way to setup such a public (extra) interface automatically.

Previous commit "transplant: Generate extra interfaces config file"
introduced support for passing this information via DEA (override),
which may define a IFCGF_<interface> section in its 'fuel:'
section, containing the necessary keys to produce a ifcfg-<interface>
file, like in this example:

fuel:
   IFCFG_ETH1:
     device: eth1
     ipaddress: 10.0.1.10
     netmask: 255.255.255.0
     gateway: 10.0.1.254

In order for Network Manager to use the newly added interfaces
for outgoing traffic and honor their GATEWAY setting (e.g. if we just
added one public interface), the default route on admin iface (most of
the time called eth0) is disabled when extra interfaces are present.

FIXME: Only supports lowercase interface names, but so does Fuel,
see related bug report [2].

[1] https://jira.opnfv.org/browse/ARMBAND-35
[2] https://jira.opnfv.org/browse/FUEL-136

Change-Id: I14b023b2b9b4c7d9b9f390d4f86f693c176efde0
Signed-off-by: Josep Puigdemont <josep.puigdemont@enea.com>
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 888c45b1ab7f70f226e3dc2c81725f1c6397afff)

Updated armband
Project: fuel  00c404ef7066e31adfc409a15d9e0e118e0b491a

build: cache: Consider UBUNTU_ARCH in .cacheid

Usually UBUNTU_ARCH is not changed inside the same repository,
but we should consider this case anyway for future merging
Armband and Fuel@OPNFV repositories/build systems.

This applies to all Fuel plugins and the local repo.

Change-Id: I1fb86af4e4dc665e3b443ed8c6cfcb43f365ae6a
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 1fb86af4e4dc665e3b443ed8c6cfcb43f365ae6a)

Merge "Upstream: multiarch mirrors" into stable/colorado

Updated armband
Project: fuel  e2cfdabd45281bf26a45803509f1c3555f3d93d0

repo mirror: Allow multi-arch local mirrors

Original patch from Stan, signed by me for upstreaming.

This patch allows specifying multiple architectures via UBUNTU_ARCH in
form of a list of space separated architectures. The first architecture
in the list is considered primary and will be used for building all the
deb packages by fuel-main. Additional architectures are added to allow
targets of other architectures to use the mirror.

NOTE: this imposes a requirement that all packages built are arch
independent (which is true so far).

[ Alexandru Avadanii ]
Reworked for applying on top of Fuel@OPNFV.
Pass UBUNTU_ARCH to Docker containers.

Change-Id: Ibc4ae03223545383813ac58ec34d44c1f97b4694
Signed-off-by: Stanislaw Kardach <stanislaw.kardach@cavium.com>
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 655e777a5adeb633e114d98ffb02f74b227ab437)

Updated armband
Project: fuel  a18091f9f2a5b1ba34f38f7119eaf7f4cdfaff02

docs: build req: Remove p7zip-full

p7zip-full is not required for building, as stated in the current
version of the docs. I think this bogus requirement was introduced
by Armband (by me, more precisely) because our build process was
happening outside docker.

Sorry for the useless code churn.

Change-Id: Id0a3c5b9016706535ca159e1da261e83c8d36d31
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit de6d5d4b6ba6848304d620e65ad97f3aeeadccd5)

Merge "Upstream: delete old Fuel env if present" into stable/colorado

Updated armband
Project: fuel  62f4e0866d916a12066800cdaabe516d2f8388d9

Final Updates of the build instructions
- Updated references

Change-Id: I2a6cfdec0de6afa41ea8af59f415439b7ab7056d
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
(cherry picked from commit 9f00e08b54ac2be36e6315adc3bd29f7e3bd40d8)

Updated armband
Project: fuel  6f7290b7b1147b215a1891980ae20021bde49cd7

Final updates of the Installation instructions:
- Images updated
- Updated reference URIs

Change-Id: Ieeefbd8a3ef9bbd6c3a0e767f770097ab8a98f9d
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
(cherry picked from commit 087c8de9c667b28506b7621d5147be4846c06397)

Merge "Upstream: Fuel@OPNFV pulled patches" into stable/colorado

Updated armband
Project: fuel  dff4ff6fa7306a2556b87a2685b1b7dce1fa7e10

deploy.sh: accept a timeout flag (-T)

Original work by Josep, signed by me (Alex) for upstreaming only.

Change-Id: I58a7b9bc639bb03b994ea34fc317f5679140d9fd
Signed-off-by: Josep Puigdemont <josep.puigdemont@enea.com>
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit bb2a6188ff55e61390841694cac786d4e758d67b)

docker: build: Fix docker connectivity loss

Change-Id: Iaabd176f4032494c8ea40fd1264dafcac01b4a43
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 662822c6f09be5b23dc3f39f85ee2f21a6d3d405)

Merge "build: docker: Use host's network stack" into stable/colorado

Upstream: multiarch mirrors

Change-Id: Ia54bd3955a3e3b534d8c4d8380de5870a106edc5
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit e799e8f3912dac025e5be5e8c748df8b68b7d06d)

Updated armband
Project: fuel  9360af2ce5d4ccef3c58dc301384db5310a04300

[ODL] Fix odl deployment on separate node

JIRA: FUEL-185

Change-Id: Id14d30154b63abc915a0cd55835bb72cee862dde
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
(cherry picked from commit ba1cb485398d811d2f473406ae085993bfd9f68a)

Upstream: Fuel@OPNFV pulled patches

Change-Id: Ic584d9b1eb179009256de8ccacfb7669976823c6
(cherry picked from commit 7236ccc7f9fcb9163562d88455c80339fa6efd58)

Upstream: delete old Fuel env if present

Change-Id: I308eb1c2bfdf0fc568e7f351078cd7a3017aae4a
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 3483c7fbcc24adeec5fea80c47cceb460325efc0)

Updated armband
Project: fuel  63a7354191a77550f45a81ede6d6cc590ce75b3a

build: cache: Allow LOCAL_CACHE_ARCH_NAME override

Change-Id: Id6251356aac4fdb8fbcb2893d5072ea16500bd93
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit d6251356aac4fdb8fbcb2893d5072ea16500bd93)

Updated armband
Project: fuel  1fc220613a677ea5c4f003bc5596a203a8d02391

build: Allow MIRROR_MOS_UBUNTU override

Change-Id: Idc647f941fc3923f5ed1f2888318b218c23f4362
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit dc647f941fc3923f5ed1f2888318b218c23f4362)

Updated armband
Project: fuel  a5796fbbca6e446aa9b40b15990542c2f2e9116f

build: Allow PLUGINS override

Instead of using BUILD_FUEL_PLUGINS, which was intended for manual
overrides of the Fule@OPNFV plugin list, allow PLUGINS to be
preset to a custom list, which we will provide via Armband
Makefile spec.

Change-Id: Ic4204aefeaf0d781998e54ab83831fcde7527b89
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit c4204aefeaf0d781998e54ab83831fcde7527b89)

Updated armband
Project: fuel  afd2b0ce63fdf67e99d8404d54d3138ffe608217

deploy: Delete old Fuel env if present

In order to clean up old partitioning and boot entries on target
nodes, before removing the Fuel Master, try ssh-ing into it and
removing all environments/nodes.

This is especially important for EFI systems, where old boot
entries are left behind without a proper env delete, leading to
target nodes failing to PXE boot on Fuel Master re-install.

This change assumes that:
- all Fuel Master information is unchanged between old and new
  deploy (fuel IP, password etc.);
- Fuel Master is up and running, in a sane state (target nodes
  are also online), when deploy starts;

Closes: ARMBAND-51

Change-Id: I7b61124ea9182ce2d599adcdedef03e0d8d67ed6
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit f1e808677a29a157e009f33a1a5a024eaad2c021)

deploy: Attempt fixing random deploy timeouts

Most likely, when we configure an additional interface for Fuel
Master, and Network Manager is restarted, our old ssh connection
is timed out and needs to be re-established before checking
for fuel bootstrap process via ssh.exec_cmd.

Change-Id: I44589b2e8190008c8b1035d171cbb50270dfd98c
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 471627d481b5d5905d1d322f21c3285b9d729e2d)

build: docker: Use host's network stack

Armband build benefits (or should have) of a local mirror
for "linux.enea.com", which we used to inject into the build
system by host's "/etc/hosts".

After Armband switched to building inside docker, this change
was silently discarded by containerization.

The proposed solution uses hosts's network stack in all build
containers.

See [1] for full description.
This change simplifies the network abstraction during build by
NOT containerizing the containers' networking.

The original motivation was pointing to local mirrors via host's
"/etc/hosts", for which an alternative solution could be passing
"-v /etc/hosts:/etc/hosts".

[1] https://docs.docker.com/v1.8/articles/networking/

Change-Id: I31e3c787a432af49b4799f561669a0150668b222
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 6ae4e120c5f6aab6834e0ec42599e1b409a9af05)

Merge "fpb: Temporary fix for supporting multiple DEB ver" into stable/colorado

Merge "Rebase: Account for ODL plugin upstream changes" into stable/colorado

Rebase: Account for ODL plugin upstream changes

Change-Id: I854bedd7dd61cf10239f8592336a86b92d78d0bc
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 0ef09dd55010b86fd5cc709cb9520e1a9d686c12)

build: Bail on patches-import fail

Change-Id: Ib676747252ef647d9385cb0eeeca9563b7fd09d7
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 442cb2fc0da3ccc7428ca085f1c90b93fc79ebba)

Updated armband
Project: fuel  6192d48956803419f1e77e05fbd3cc31ba888f12

Fix ovs scenario configuration

Due the incorrect indentation install_dpdk option was not set to true.

JIRA: OVSNFV-37

Change-Id: Ida3b0d1e72ce8322905ff399af89b43cac878299
Signed-off-by: Michal Skalski <mskalski@mirantis.com>
(cherry picked from commit ae8196be2c5863a5ca837828eead7188d608023d)

fpb: Temporary fix for supporting multiple DEB ver

Backport fpb change submmited in [1].

[1] https://review.openstack.org/#/c/311031/

Change-Id: I02ce8c6151799e3953587fce50cbe552a5c95c50
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit c2dd0b63510e4e882021360ab5f0287b6fc3c597)

Merge "Fix: git -C not available for git 1.8" into stable/colorado

Merge "Rebase: Upstream renamed ODL to FUEL_PLUGIN_ODL" into stable/colorado

submodules: refresh remote commit refs

Colorado additions:
- switch Fuel@OPNFV to stable/colorado branch;
- switch vswitchperf to stable/colorado branch;

Change-Id: Id89153e39e9c163df77e275ed4526961d6800d3c
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 299676645b26ac5a2e1c5deef2ec3814b718dc1c)

Fix: git -C not available for git 1.8

Our deploy slaves are running CentOS, which only has git 1.8.3.
git -C option was made available in git 1.8.5, so instead of
installing out of repo versions of git on all our deploy slaves,
rework the main Armband Makefile to NOT use this option.

NOTE: --git-dir could be used instead, too.

Change-Id: I29b9c720e39cae25431cf1176dbaddce5bda2a35
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit e7683a82ee118c2a584fb441a7a422dfca826e28)

Rebase: Upstream renamed ODL to FUEL_PLUGIN_ODL

See Fuel@OPNFV change [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/19033/

Change-Id: I9c95a7aaec366c9e03620f1129b3cb8401385476
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit bde411ba1cccf4a0827df115deb97f2a9cfade13)

submodule: Kill yardstick

Since arm64 support has been proposed straight upstream [1], we
no longer have to keep the git submodule for the yarstick repo.

[1] https://gerrit.opnfv.org/gerrit/#/c/18883/

Change-Id: Ic8a02106ed1d26012a0767fc0444b8f8d35c54aa
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 629f39b6928c3cb36d25dc07347de47d601e847e)

Updated armband
Project: yardstick  27e254c2273e4be503053db882948b8abf53b269

Add grafana config for TC074_Storperf

Change-Id: If415a6e6170c52f3586a1521f6f239daad3d527c
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Updated armband
Project: yardstick  0e9572495a707215f5e43a1b1f5c850b6f159e98

add doc about scenario suite help

Change-Id: Ib8dfc56e8b84cdba04fc18f13ac780b2103c0b5d
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Updated armband
Project: yardstick  025432b9fa0bc6061ab34a71f0f28bdec4cf7641

add grafan config for ha test cases tc045~tc049

Change-Id: I1adc9ab36a71195e7c03fe4f3b7322ea40aa2a40
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Updated armband
Project: yardstick  94c16e0c5a7589951aea3fb9ff4dd01f37a327f4

Add grafana config for TC069_memory_bandwidth(RAMspeed)

Change-Id: I06ac3df77f35b14746a4b07ebc16d46dc83624c1
Signed-off-by: JingLu5 <lvjing5@huawei.com>