gerrit.opnfv Code Review - armband.git/log

build: Rework patch mechanism for Fuel submodules

While refactoring the patching mechanism, take care of:
- Sync submodule handling with Fuel@OPFNV;
- build: Investigate/prepare for moving patches to Fuel@OPNFV;
- build: Investigate divergent fuel-mirror;
- ISO build: cacheid for Fuel comps should not depend on
  Armband git commit;

CHANGE:
Rename/shuffle patches while grouping them in "features",
preparing for upstreaming them to Fuel@OPNFV and beyond.

CHANGE:
Allow linking patches for better representing the dependency
between one patch and different features.
e.g. 0001-Add-arch-to-nailgun-release-and-target-image.patch:
   - part of `multiarch-fuel`, because it extends Fuel;
   - part of `direct-kernel-boot`, as arch is required for that;
   - part of `cross-bootstrap`, target image is arch-dependent;
NOTE: Patch links are not staged to Fuel@OPNFV, they only serve
as markers that a specific patch is part of a feature.

CHANGE:
Kill all Fuel component submodules, now handled in Fuel@OPNFV:
  - fuel-agent
  - fuel-astute
  - fuel-library
  - fuel-mirror
  - fuel-nailgun-agent
  - fuel-web

CHANGE:
Move armband-fuel-config.mk to armband git root.

FIXME: m1.micro-Increase-profile-RAM-size-to-128MB.patch is NOT
part of `cross-bootstrap` feature, but patch context says so ...

FIXME: 0001-Add-arm64-deb-repositories-setup.patch is broken at
`make patches-export` by removing spaces at EOL.

v2 -> v3:
* Phony patch support (links to show a patch belongs to a feature);
* Updated README.md
v3 -> v7:
* Re-export Fuel submodules & plugins patches (update patch context);
* Update Cavium mail addresses (s/caviumnetworks.com/cavium.com/);
* Ignore submodule changes;
* Add armband git repo info to gitinfo_fuel.txt at build time;

Implements: ARMBAND-136
Closes-bug: ARMBAND-95
Closes-bug: ARMBAND-93
Closes-bug: ARMBAND-92

Change-Id: I1a236d9f43b2e6dca22055911f696b43c22b5973
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Cleanup: Remove obsolete Fuel@OPNFV patches

Since we are now building inside docker containers, it is no longer
necessary to use `python-debian` from pip repo instead of Ubuntu.

Also, since Fuel@OPNFV improved our mirror selection in [1], we
can drop our custom blacklist entries for Ubuntu SE mirrors, as
well as repeating the repo mirror build in case of failure.

[1] https://gerrit.opnfv.org/gerrit/#/c/22195

Change-Id: I62890b6ae7977cd8a39c06ce17c8964e6cb1dddb
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Rebase: docker tag reuse context adj

Change-Id: If6a3472a2f8fe64db2469536fe4d12d88e7a61f0
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Merge "Revert "deploy: Reduce Fuel Master VM resources""

Revert "deploy: Reduce Fuel Master VM resources"

This reverts commit acc93911c7d1d4be5ba5cd04e731626d01d59598.

Change-Id: I001cd72506ec99ae2c41bd30d3dd36dd3de06217

INFO: Add Cristina Pauna as committer.

Change-Id: I6a6a80bf58ae453485431ecc35eab8cb553c29e0
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Merge "INFO: remove commiters: Joe and Stan"

Updated armband
Project: fuel cf93e6ee11c96de090b04196cc96b4a6b0948928

use pgrep instead of ps

pgrep was added to procps-ng, it is more exact

also replace ps -ef in wait_until_fuel_menu_up
removed get_fuel_menu_pid

Change-Id: I57ad9d2fabbfe5f570e0be3bfb40ef842f95902d
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Updated armband
Project: fuel 2e6be7473d11f14d62ad1aa1d76f2e0c99327424

check read access instead of isfile() for Fuel ISO

When testing with nested virtualzation I attached
the Fuel ISO to VM (/dev/sr0) running deploy.sh

This failed because we expect the ISO to be a file, when
it could be a device, e.g. /dev/sr0. Instead of checking isfile()
check for read access.

This tested with bsdtar. It can extract an ISO from a file or device.

Change-Id: Ic09373cd618b33382303d9134cce4e005040de95
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Updated armband
Project: fuel d1f2969eed092f182cc746ca1d06337d71a8215d

Refactor deploy-config.py into object style

Change-Id: I706563e6ed1bbfd98adc5a4124ff63789f9e32fa
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>

Updated armband
Project: fuel c25f5af252949dc1b249f77fe8e33c5ea13c1ad1

[odl-l3] Get OVS plugin into the action

Update ovs version to 2.5+ in order to get inserted security group
connection tracking flows in ovsdb, which allows to pass
tempest scenario of test_network_basic_ops.

JIRA: FUEL-199
Change-Id: Id3e6c8ed2b79c4b6b4a7623f0d262c63f1d1d89f
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>

Updated armband
Project: vswitchperf 48ec9750583c47dadf0f3fd931dc2cf12f738b67

bugfix: Qemu shared dir failure

In case of testpmd or l2fwd loopback app, VSPERF copies
sources if these tools into qemu shared folder. Maximum
size of folder content is limited to approx. 500MB. This
limit is exceeded in case that DPDK is built for multiple
RTE_TARGETs. Unnecessary files are excluded from the
copy to spare size inside shared folder.

JIRA: VSPERF-398

Change-Id: Iab31a6ff2397f7031eae6a95d424317c3343d4d9
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Antonio Fischetti <antonio.fischetti@intel.com>

Updated armband
Project: fuel 0789fdc49305b2d8403960139beafe1064cef8ba

Support different format of fuel task info

As described in this bug: https://bugs.launchpad.net/fuel/+bug/1625518
json output of the task can be in different format: single dict or list
of dicts. During tests of https://gerrit.opnfv.org/gerrit/21807 only the
later one was visible, try to support both types of output.

Change-Id: I7d3e12270c8246b03bdc6c73d3be77a039df469f
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Updated armband
Project: fuel dd4357385318eccfa82c8e079b07e9373ec93cfa

Add DHA adapter dependencies

Change-Id: Ia83782ac6baed0f9d753b69b18202abaafb972e5
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>

Updated armband
Project: fuel f2fde8258dedfbbeae52d0c9b1d3a634fd290877

Change the way how we track deployment

Use fuel2 for start deployment. Since it does not return progress
use deployment task to provide this information. Currently used
'deploy-changes' will behave the same:
https://bugs.launchpad.net/fuel/+bug/1565026

Try to handle situation when nodes temporary go offline. With
deploy-changes environment still was in 'new' state in this situtation
which causes timeouts from jenkins.

JIRA: FUEL-196

Change-Id: I6548a5ec807551388e845044c282b7af32eb9100
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Merge "Add grub template to cobbler for MAC-files"

Add grub template to cobbler for MAC-files

Change-Id: I9812066f2954cc02a49bfa19dbe9fc74b055e78d
Signed-off-by: Matei Valeanu <Matei.Valeanu@enea.com>

Updated armband
Project: fuel 34a15524a89ed6cd350c42be07754901dfe244f8

deploy: fix: remove storage files during cleanup

Remove old disks through virsh instead of calling os.delete()
methods so that the cleanup phase would succeed within a non-root
setup. [1]

Related-bug: ARMBAND-128

[1] https://gerrit.opnfv.org/gerrit/#/c/19491/

Change-Id: I90007edf014c7e15a68b9a334fcaffaa127ee4ab
Signed-off-by: Stefan Sicleru <stefan.sicleru@enea.com>

Updated armband
Project: fuel 029b03673f5add0eae91980574382af89698b1b2

Added Alexandru Avadanii as committer to Fuel@OPNFV

A Majority of the Fuel@OPNFV committers have voted for Alexandru as committer:
Those include:
Michal Skalski
Jonas Bjurel
Greg Elkinbard
Stefan Berg
Daniel Smith

No one voted 0 or -1

Change-Id: Ib477ba126be438a11b409a85805a71734bf1a679
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>

Updated armband
Project: fuel e27619c3b2c926b7ff04d1c555db9d912983027f

Updated committer list

Change-Id: I5f22080edf695cef3c6fd24ff0f62b02a1dbc0af
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>

Updated armband
Project: fuel 1d4f96facadd5458a87a4d68b0b5298ca47cd1fd

[odl] Get latest changes

* Fix setting bgpd password with puppet
* Enable G1 garbage collector
* Adding caching possiblity
* Add firewall resource that opens BGP ports

Change-Id: I8f779ba7356acf52967e594a1a213edf192962fc
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>

Updated armband
Project: fuel e698d34beb1fd517db610d1e91f246a123b84c71

Templater can now read files from URLs

Change-Id: I34b81379f7e77743e64bbf4ae814b6cd296f2428
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>

Updated armband
Project: fuel 5264d80bb4b6e5434a27faf784503dabdf691a45

Refactoring

- Move function definition to its place
- Add main function

Change-Id: I9dd71dd2da0579e04841c9efc80f2770d0182b10
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>

Updated armband
Project: fuel 3f1fd8b9a96e2ce7bbaa53d89fe19404590e5bd4

Change prints from statements to function calls

Change-Id: I378baa85bd9e1b9b535a2d4e9c8dcb34a267a6e5
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>

deploy: Reduce Fuel Master VM resources

Fuel Master VM template has been updated to use:
- 4 GB RAM (was 8 GB RAM);
- 2 VCPUs (was 8 VPCUs);

Related-bug: ARMBAND-98

Change-Id: Ib95e87e8ed0035b2a7e69a95f67a4046d724d624
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Merge "Emergency patch - fixed broken links"

Emergency patch - fixed broken links

Change-Id: I4ec0cf95d714cbc476f73fbc4b90fd039dbd973e
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: fuel 61d9f66916fe7cacc1df25438b4060b9f3c9402d

Emergency patch - fixed broken links

Change-Id: I7aea7c06775cac3efeb22d2256c7acf6fbb137d5
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>

Updated armband
Project: fuel 9bef631e4d7189607540598b0b08f13e861b9410

Fix: ISO build omits long path files

make iso generates:
libisofs: WARNING : File "/ubuntu/pool/main/libj/\
libjs-twitter-bootstrap-datepicker/libjs-twitter-bootstrap-\
datepicker_1.3.1+dfsg1-1~u14.04+mos1_all.deb" can't be added
to Joliet tree, because its path length is larger than 240

At the end this package is missing in latest ISO.
NOTE: This issue is only triggered on certain kernels during build.

Closes-bug: FUEL-190

Change-Id: I21f7f1cbe3f64317d2feb66e371611a654cf30f8
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: fuel 27dea87b1a33872712008b4423e51f19712ce7c9

[performance] Disable keystone token revoke

Change-Id: I6db0bfaab5462a9a8f8de64bc1b088607d407bab
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>

Updated armband
Project: fuel 3e506f9248f2a64a8a30c832049df392b01fcb4e

Temporary Hardcoded Ubuntu repo

Meanwhile we're investigating the issues with Ubuntu repo mirror selection,
we will hardcode the Ubuntu repo mirror

Change-Id: I776bd3a8a72dc87e00052e8ff965de1134293c7a
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>

Updated armband
Project: vswitchperf 6dfabefd6cac3cd4b8fd29abf5a5b6ab9e6ae956

paths: Support binary packages

Currently VSPERF supports OVS, DPDK and QEMU built
from the source code only. In some cases it is required
to support installation of these tools from binary packages
available for given linux distribution. Thus VSPERF
configuration and code was modified to suport both source
and binary versions of tools. This can be configured perf
tool, so various combinations of source and binary version
are supported.
Together with new configuration also a handling of kernel
modules was modified to automatically detect and load module
dependencies.

JIRA: VSPERF-340
JIRA: VSPERF-339

Change-Id: I855cb438cbd8998bdc499613ea5e7de2526299d7
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Otto Sabart <osabart@redhat.com>

Updated armband
Project: fuel 53e6d97c9157f1e908d99dcca1207de23ea73132

[KVM] Install plugin in post-deployment

JIRA: FUEL-171

Change-Id: Iead815ba2da76493f108ad71bc32cff265302b55
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Rebase: updated blacklist for Ubuntu mirrors

Change-Id: I404791b14603b4ebdd0be1010412ec77cf75a478
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: fuel e12aec84ef1767d4ba9469dfb12d65d928bf0ed4

Make sure to use only up-to-date mirrors

Whitewash the geographically "close" mirrors against the list of
fully synced mirrors - we've had a few instances of getting bad
mirrors which would break the script.

All credit goes to:

https://askubuntu.com/questions/39922/how-do-you-select-the-fastest-mirror-from-the-command-line

... and we should perhaps use the netselect tool as well somewhere down
the line, but this fixes the most urgent problem.

Change-Id: Ia61a2bd78657b28019f57fc1962d410e754e6d2a
Signed-off-by: Stefan K. Berg <stefan.k.berg@ericsson.com>

Updated armband
Project: fuel 65b7cfcd862a75be72fb98777190c49f8b6ea0d3

Repo tidy-up + licence scrubing

- Added licences and (c) to files not complying to Licence and (c) policies.
- Removed example templates not having correct licence claims and no longer being rellevant.
- Removed the Vagrant deployment method as it is not used, not rebased/up to date and not holding correct license claims.

Strategies used:
- Machine generated are not assigned an licence text, the licence follow from the source.
- Generated patch files are not assigned an licence text, the licence follow from the source.

Change-Id: I9763f076eae51fbb2d4e5cb8cacfa4bb6cf338cc
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>

Updated armband
Project: fuel caee61817eb7f4235ca33a9da12f14a285f9e012

Enable ci off-line deployment

Updated dea_base to use locak repo mirrors for off-line deployment
NOT TO BE PART OF COLORADO.1

Change-Id: Ia8e2d716570267ed9a9e06e253b6a7b258ee26eb
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>

Merge "fuel-library: nova: AArch64: enable hugepage supp"

fuel-library: nova: AArch64: enable hugepage supp

This patch adds AArch64 to the hardcoded lists of valid
architectures for hugepage support.

Closes-bug: ARMBAND-90

Change-Id: I3765e6bc314393a58db70590f3890fde206e3feb
Signed-off-by: Veena Lingadahalli <vlingadahalli@mvista.com>
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: fuel 82ac1ad828e52ef74d86beed7d3c4f864031b5ca

Final updates of release notes

-Added filters for fixes, issues and work-arounds

Change-Id: Id76545fd7837c83145bd8d87b309c23849da6f7e
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>

Update plugins in documentation

Change-Id: I0059e397d2f6e213e549092601b61a200f5b96a4
Signed-off-by: cristinapauna <cristina.pauna@enea.com>

Update documentation with AArch64 specifics

The documentationfrom Fuel was introduced to armband project by
https://gerrit.opnfv.org/gerrit/#/c/20679/

This patch updates it with aarch64 specifics

Change-Id: I05eccef015fd399e7d05a0505e85e733a8e95f1d
Signed-off-by: cristinapauna <cristina.pauna@enea.com>

docs: Copy OPNFV docs dir as documentation base

There has been some restructuring of the documentation in fuel project.
This commit copies those files, while a subsequent commit will adapt
the documentation with aarch64 specifics.

Change-Id: I56b52d5d16975b88fd5b26099b43046c6a5d5747
Signed-off-by: cristinapauna <cristina.pauna@enea.com>

Updated armband
Project: fuel be0571cd1d14125a72642cc42d2f5b9eb0b0199c

Increase number of hugepages allocated for nova

Yardstick is using m1.small flavor for some tests, in case of ovs
scenario it should be possible to allocate 2GB from hugepages.

Change-Id: Ie908d94e63a5055907bb33c69a5e028739f44f2e
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Updated armband
Project: fuel 2c7b9bb6623844eeea95373ec2752b0200cd69e8

Remove extra empty line

Change-Id: I462a99b42d05b979c4f1904e7309e87ddd94d1bb
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>

Updated armband
Project: fuel 75614eaa811505a272d5a27c5582a08097e656b6

[OVS-DPDK] Turn off missing options

Get all gcc/compile options to conform to corei7 arch.

JIRA: FUEL-186
Change-Id: I5ce76631aac9174c69362f96f71e26285fc95842
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>

Updated armband
Project: fuel 8eeadbc08d8ae2efd5958fd639f910b77071d002

Stop using network transformation

Due the bug in code we did not apply network transformation to created
environments, but still Fuel base on chosen segmentation type and
networks to NICs assigment has been generated network schema itself.
Since we don't use custom network schema we can remove transformation
defintions from dea pod overrides files. However there is a need to
configure NIC properties in case of dpdk deployment.

JIRA: FUEL-192

Change-Id: Ib7dab4d61910ac8c44b6d91e0c486c9693034823
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

fuel-plugin-ovs: Simplify debian version strings

Remove all suffixes from OVS debian packages, and simplify the
plugin code handling the fetching of said packages.

While at it, enable:
- local mirror caches, by mounting /etc/hosts in the docker
builder
- HACK: mismatch between debian source versions and debian binaries

Related-bug: ARMBAND-89

Change-Id: Ifbf0e11c90cf7b2f76ce72af8ca3469a33bee071
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: fuel c5df35d8bac8d5091d60f2f170668de4152952a0

Uplift fuel-plugin-ovs

Pull in "Update flavors mem_page_size"

Change-Id: I3e285cefee561dbbc02eb9ab7d2e9c01eef2742a
Signed-off-by: Billy O'Mahony <billy.o.mahony@intel.com>

Updated armband
Project: fuel 85ef5ebb0506c78623cfebff922ab90cf7ddbf9a

Use Boron RC3.5 for sfc scenarion

It should fix problems with vm communication through floating IPs.

Change-Id: Icadc71f2b99c28715c15389e59111272a21440fb
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Merge "AArch64: fuel-plugin-ovs enable"

AArch64: fuel-plugin-ovs enable

OVS-DPDK-NSH is not supported on arm64 for now, see [1]

Closes: ARMBAND-46

[1] https://jira.opnfv.org/browse/ARMBAND-86

Change-Id: I79b33bab7348e297c06ff4bb2bf7cc23f21eb7e3
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: vswitchperf a325eb33fbe408243209b19f2d9cc288b2e57548

merge_buffers: Add option to disable merge buffer on qemu startup

In cases with VHost user and non-jumbo frame scenarios we can
disable merge buffers on the guest NICS to improve performance.
This patch adds this option to the 04_vnf conf file.

JIRA: VSPERF-388

Change-Id: Ic1f776e90fdccaa5d5a0c952c96811a8747fe936
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

Updated armband
Project: fuel 2e9ff14f8ab6ee9e4ebf84a2e8e40bd3f149c48e

Update local mirrors defintions

If we only use main section, not all required packages are discovered.

Change-Id: I2eaa4a7bfc659b820901ce55a4ab799c3281df3b
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Merge "Revert "patches, docs: Remove MySQL WSREP SST provider""

Revert "patches, docs: Remove MySQL WSREP SST provider"

This reverts commit 8a696682b3fd0cb5f32ddaca8ede5db7b001a57f.

Change-Id: Ib1698643639436243768f4a8209c4d68314a97ca

Updated armband
Project: fuel 243fb3cf924f22cbb3db80c53892f2baef3dd9be

[ovs-dpdk] Target compiler to corei7 cpu arch

Change-Id: Id2405bc3b636178791428b9bab739fdaa0f094a2
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>

Updated armband
Project: fuel 414973688bf8876685168434d0612fbde5f24dd6

Don't fork a templater process, use the library

Change-Id: I931ba56fe65f2f5d5af483a8bfe654a0ecda1611
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>

Updated armband
Project: fuel 0f5a1854028e33fa77127ffc65077058fa3b9469

Properly handle quotes in argument masking

Use shlex to parse the command line, thus handling quotes and other
special characters.

Change-Id: Icc3a2cd934aac8f67e07d967f76c7679bcb34996
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>

Updated armband
Project: fuel 23a23192e14895fd235e29c63e00e09bafd254de

update node_reset() in zte_adapter.py

Change-Id: I71790b8abb25936045f777a78ed903f3b8ce4303
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Updated armband
Project: fuel e9f9532045bc5765f2c96add3f971918e002e30d

Add intel-sc lab devel-pipeline configuration

intel-sc is the lab devel-pipeline configuration for a lab of Intel
in Santa Clara, CA, USA. This lab is behind Intel proxy sever.

Change-Id: I401b030adf82d6a19397e92aef4b30ebe971d80c
Signed-off-by: davidjchou <david.j.chou@intel.com>

fuel-library: mysql: Fix spurious install timeouts

Backport the following fuel-library fixes from Fuel 9.1:
- wrong relationship in clusters mysql manifest
- Rsyslog doesn't have write permission to /var/log/mysql/ directory

These two bugs manifested as:
- random deploy issues waiting for MySQL to sync, without the server
being installed;
- no MySQL logs were saved due to permission issues;

Closes-bug: ARMBAND-78

Change-Id: I317e45d013229145e2ccbd8bb4f76ae03d544098
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: fuel 8d7559b50b265298f7800b18f840b87ad1e84b20

Change the way of hugepage allocation

Try to allocate enough hugepages for all NUMA nodes.

JIRA: FUEL-186

Change-Id: Idcdf6ab616dfbd9ef1104be8d1667421221ea5f2
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

FIXME: deploy: EFI: Skip re-ordering boot via IPMI

On EFI systems deploys, altering the boot order via IPMI causes
issues on some specific targets. Until we agree on an uniform
solution for EFI systems + IPMI boot order handling, just skip
altering it via IPMI.

Related-bug: ARMBAND-71

Change-Id: I7790e1e8e3540d5ab10b8d7165316a04cf58faa4
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: fuel 4c47ef4b6f192482d99196c7a7070e5f396b1fd5

Reduce ceilometer memory usage

JIRA: FUEL-189
Change-Id: I54854e4cc87f0c0e9e348e18131aa88b70e30054
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>

deploy: x2 timeout for fuel master install

Change-Id: I1281b0b6b9d631e371484795a53113032ebbc83c
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: vswitchperf acdb444a54124834acdde45107062eaf1452c119

bugfix: SRIOV used wrong device names

QemuPciPassthrough class responsible for SRIOV testing
used wrong device names for GUEST configuration. Details
of HOST interfaces connected to the traffic generator were
used to initialize forwarding applications inside the guest.
Code was fixed to use correct device configuration.
As part of this fix, old bug in VNF type detection was fixed.

JIRA: VSPERF-389

Change-Id: I269c9232012980c600c171571e90beb11e7b72cd
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>

Updated armband
Project: vswitchperf f35ec410e0567649492ed8ef73287cf7d36f7b58

pkt_gen: MoonGen code clean up

MoonGen code optimizations and general clean up. No
functionality changes.

JIRA: VSPERF-351

Change-Id: Ida16f16eb218eb6f0a1c90594c38511bfbb2cf97
Signed-off-by: bmichalo <bmichalo@redhat.com>

Updated armband
Project: fuel 9a3f6a38d708cbc3633d203e36e32bc91764ba20

Disable cpu features in ovs with DPDK

Change-Id: I2cf5df2f0469f21f64e0e7d11740058639f68697
Signed-off-by: Guo Ruijing <ruijing.guo@intel.com>

build: ubuntu mirror: blacklist another SE mirror

SE mirrors are acting up lately, blacklist them:
- ftp.availo.se
- ftp.lysator.liu.se

Change-Id: If4cc7c207fa7ce39821cc8a8f754a48f573ff374
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Merge "Revert "EFI: Move patches to Fuel@OPNFV, upstream prep""

Revert "EFI: Move patches to Fuel@OPNFV, upstream prep"

This reverts commit dff8f1a78db4a04dd30c2e0ac03a36cb0b198aa7.

Change-Id: I317e0f6aa7665c28035307149e6e7d42fdf508f3

Merge "Revert "submodule: Kill fuel-astute""

Revert "submodule: Kill fuel-astute"

This reverts commit 376c76d05862ed38edeb217cd9480807571491a7.

Change-Id: Ice749599287221af71128ec466894fdb8106d2ec

Updated armband
Project: fuel bc437743bf7d775b78af83d651b45e6baf9ccf47

Final Colorado document review.
- Please review the rendered HTML document (See Jenkins references below)
- Please verify the documented procedures and instructions

READY TO MERGE

Change-Id: Idff52212ca68ce2b97f203043e18a18c582589a7
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Updated armband
Project: vswitchperf  5aa0dc99f1cf9bf1a0a1d86143d6a1cbcc778691

docs: Fix links and formatting

Documentation was updated as follows:
* section decorators were fixed in LTD
* links to testcase and deployment
  descriptions were fixed
* duplicate labels removed from LTP&LTD
* fixed typos in formatting and text
* links to scalability and stress tests
  fixed after their renaming

JIRA: VSPERF-349

Change-Id: I86c2b723231431388b69d3d696805de2a4e12435
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>

Rebase: fuel-mirror upstream changes

Slight rebase after upstream change [1].

FIXME: While looking at [1], I noticed that Armband is not
using the proper fuel-mirror version due to our divergent
patch & build system. This should be fixed later.

[1] https://gerrit.opnfv.org/gerrit/#/c/20317/

Change-Id: I55798ba1004312cd737b6613744683437e98865a
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Merge "Upstream: move patches to repo-patches dir"

Updated armband
Project: vswitchperf ddd9674fc7595788c58acdc564573cb228658b84

multi VM: Fix p2p deployment

Revert enforced vsperf failure in case, that VnfController
is used in scenario without VNFs. Instance of VnfController
is created for all scenarios including p2p, so it must
be prepared for it.

JIRA: VSPERF-361

Change-Id: Icf6e88e7ea62044c09bb194c260ea878d6a197c9
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Antonio Fischetti <antonio.fischetti@intel.com>

Merge "submodule: Kill fuel-astute"

Merge "EFI: Move patches to Fuel@OPNFV, upstream prep"

Upstream: move patches to repo-patches dir

Upstream change: [1]

Slight rebase of our patches is now needed.

[1] https://gerrit.opnfv.org/gerrit/#/c/20043/

Change-Id: I955ae3c5c304d8c8da6e42680c81e9255487fb68
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: fuel  b39d8493d27b7fb03932628ae07ee3d2394e0a04

build: Move patches to <patch-repos> dir

Decouple main Makefile and repository patches by moving all Fuel
component patches to a subdir, <patch-repo>.

Proposed structure of <patch-repos> dir:
- patch-repos/*.patch are intended for <fuel-main> git repo;
- patch-repos/build/repo/<fuel-module>/*.patch are intended for
  <fuel-module>, e.g. "fuel-nailgun";

Full list of Fuel submodules supported by this mechanism at [1].

While at it, replace all occurences of </tmp/fuel-main> with
<FUEL_MAIN_DIR> in main Makefile and rewrite a few git/make calls
to use the "-C" arg.

NOTE: `git -C` is available starting with git 1.8.5.

[1] https://github.com/openstack/fuel-main/blob/stable/mitaka/repos.mk
    #L32-L44

Change-Id: I5e4adc7285054777c3898592ed48482ccd2b706f
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: fuel bbd6bb0b5f4adb8e05cd25cd3830f0daa50af128

Do not use rsync for choosing mirror server

Rsync protocol was used for creating local mirrors, but now we only need
http connection. This requirement can be problematic for environments
which are behind proxy and can lead to build failures when rsync is not
allowed.

Change-Id: I4efcf500fd0c25de5fdb87307e7210cc4a96714d
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Updated armband
Project: fuel 9d871421fbc631f875f7a8bdca590b42eb1bd3bf

Change source of ODL Boron tarball

For SFC scenario we need to use ODL Boron. Since it is not yet released
there is no persistent location for a tarball. Use opnfv artifacts to
store Boron build which include required changes.

Change-Id: I43e35dbdf5ca0160d48a1adc817db071fd5db85d
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Updated armband
Project: vswitchperf 8363f8c6387449186b5656af5a5fc44bedc906b1

test_spec: Remove formatted text file verions of IETF Draft

Remove files with IETF copyrights (Internet Draft .txt files).
I assume these files have to be removed in C-stable branch...

JIRA: VSPERF-387

Change-Id: I76709ab055f845cec0bec8d07b14c29dec349f54
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Antonio Fischetti <antonio.fischetti@intel.com>

patches, docs: Remove MySQL WSREP SST provider

xtrabackup issues have been fixed with the latest version of
percona-xtrabackup DEBs we added to linux.enea.com, so remove
MySQL WSREP SST provider patches and corresponding docs.

Closes-bug: ARMBAND-52

Change-Id: I743e9b6ed242cf15e3063d7dcf7e05d0cee198f2
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: vswitchperf  6a56d40bcb2de85c22bc19af2527e9c9227f33e2

multi VM: Multi VMs in serial or parallel

Support for deployment scenarios with any number of VMs
in both serial and parallel configuration. Detailed
content of the patch:

* VswitchControllerPXP class for multi VM support
* pvvpxx and pvpvxx deployments for xx VMs in
  serial respective parallel configuration
* special GUEST_ options expansion to requested
  number of VMs;
* support of GUEST_ options specific macros
  #VMINDEX, #MAC(), #IP() and #EVAL()
* all GUEST specific options are turned to lists
  to be VM specific
* support for VM with 1 NIC
* support for VM with multiple NIC pairs; traffic
  is routed in serial or parallel between NIC paris
  based on deployment scenario
* support for PVVP and PVPV scenarios using VMs
  with different numbers of NICs

JIRA: VSPERF-361

Change-Id: I05bedbdfa9a81ea0166d9b03d83ae49d6cb8b19b
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Antonio Fischetti <antonio.fischetti@intel.com>

Updated armband
Project: vswitchperf 695f734862c884d09c24b54d8d2914b3816837f2

docs: Remove links to Brahmaputra documentation

Hyperlinks to the yardstick documentation were updated
to refer to files generated from the master branch.

JIRA: VSPERF-349

Change-Id: I248795b6a951377885492515fa9b96a694c9da5d
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>

Updated armband
Project: vswitchperf 7cc12c9748cfc758aa5ac164dfb13b900ef9dd82

vhost_affin_fixup: Change vhost thread from regex to pgrep usage

Change vhost affinity process lookup to use pgrep instead of
ugly error prone regex method as suggested.

Change-Id: I8cac00a7f2d26ba1ce1815535a198f578159222c
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

Updated armband
Project: fuel 5589b0e1659e8e0de0bc1055753685c9fd58f13a

[OVS-DPDK] Set default for dpdk_socket_mem

Change-Id: I175178cdcbab52ac024157d2c5707fd7e1236dd4
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>

Fix: build: do not hardcode fuel branch

Change-Id: I97da6840878112a063e980c5d5d9240eb63693d7
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: fuel 72613c121a3c28f43436bf26b8f65369fc46f520

Shift opendaylight role out of controller

In order to unload controller resources place
opendaylight role to a separate node.

Change-Id: I63db4074a9b50d80e8b8b29abd385b37bdb5f9d7
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>

Updated armband
Project: fuel cb7f00257d567a1da7d820cb03c15723ca5bd28c

[OVS-DPDK] Allocate dpdk socket memory

JIRA: FUEL-186
Change-Id: Id44a786f69d78b378fbabea2c70ab1ca78651729
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>

Merge "Upstream: extra interfaces cfg"

Upstream: extra interfaces cfg

Change-Id: Ibd522813a40a0b1c385c47e65f77b1a13c860269
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: fuel  5b24755186a36c79f03596d52cd4ba2627791470

deploy/reap.py: Dump extra interfaces information.

Since on AArch64, Ubuntu local mirror lacks arm64 packages (see [1]),
Fuel master requires internet connectivity during deploy, and hence
a way to setup such a public (extra) interface automatically.

Previous commit "transplant: Generate extra interfaces config file"
introduced support for passing this information via DEA (override),
which may define a IFCGF_<interface> section in its 'fuel:'
section, containing the necessary keys to produce a ifcfg-<interface>
file, like in this example:

fuel:
   IFCFG_ETH1:
     device: eth1
     ipaddress: 10.0.1.10
     netmask: 255.255.255.0
     gateway: 10.0.1.254

In order for Network Manager to use the newly added interfaces
for outgoing traffic and honor their GATEWAY setting (e.g. if we just
added one public interface), the default route on admin iface (most of
the time called eth0) is disabled when extra interfaces are present.

FIXME: Only supports lowercase interface names, but so does Fuel,
see related bug report [2].

[1] https://jira.opnfv.org/browse/ARMBAND-35
[2] https://jira.opnfv.org/browse/FUEL-136

Change-Id: I14b023b2b9b4c7d9b9f390d4f86f693c176efde0
Signed-off-by: Josep Puigdemont <josep.puigdemont@enea.com>
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: fuel  14c4e711f59917e1b299230668d8a4439f09d943

transplant: Generate extra interfaces config file

Original work by Josep, only signed by Alex for upstreaming.

The DEA override may contain a IFCGF_<interface> section in its 'fuel:'
section, containing the necessary keys to produce a ifcfg-<interface>
file, like in this example:

fuel:
   IFCFG_ETH1:
     device: eth1
     ipaddress: 10.0.1.10
     netmask: 255.255.255.0
     gateway: 10.0.1.254

FIXME: In order for Network Manager to use the newly added interfaces
for outgoing traffic and honor their GATEWAY setting (e.g. if we just
added one public interface), the default route on admin iface (most of
the time called eth0) should be disabled. For now, we assume the admin
interface is always "eth0".

Change-Id: I96e3ac5046dd59ed10c43099dd76a6418806a1f3
Signed-off-by: Josep Puigdemont <josep.puigdemont@enea.com>
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: fuel de6d5d4b6ba6848304d620e65ad97f3aeeadccd5

docs: build req: Remove p7zip-full

p7zip-full is not required for building, as stated in the current
version of the docs. I think this bogus requirement was introduced
by Armband (by me, more precisely) because our build process was
happening outside docker.

Sorry for the useless code churn.

Change-Id: Id0a3c5b9016706535ca159e1da261e83c8d36d31
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>