Updated armband
Project: fuel  3ec3fb2d1d316b656a13f9c1ca00cc8a7fcd51de

deploy-config: honor interfaces and transformations

Currently all scenarios assume interfaces and transformations are the
same for all nodes in the POD, however some PODs may contain nodes that
have different hardware, or where the interfaces are configured
differently.

In this patch we honor the original interfaces and transformations if
they are present in the dea-override.yaml file. The way to add this
information in the dea-override is by having a "nodes:" section with
this information, ie:

nodes:
- id: 1
  interfaces: interfaces_1
  transformations: transformations_1
- id: 2
  interfaces: interfaces_2
  transformations: transformations_2
- id: 3
  interfaces: interfaces_1
  transformations: transformations_1

The node IDs is used to find out this information.

Change-Id: If6ff8ca28b42e043d1bdf91142a4a56ae36e4304
Signed-off-by: Josep Puigdemont <josep.puigdemont@enea.com>

Updated armband
Project: fuel  9dc7082c230f7f22b37ae9bb04493387c466fa7b

Use virtio driver for fuel-master NIC

Using e1000 driver on fuel master may lead to temporarily loss of
communication [1]. We can use two approaches here:

  * use virtio driver
  * install e1000-kmod package

virtio driver should be sufficient for our purposes, we don't use
bonding on fuel master.

e1000-kmod package is available on fuel master and provide e1000 kernel
module which does not introduce additional problems. This package is not
installed by default but for this purpose MASTER_NODE_EXTRA_PACKAGES
cmdline option can be set during fuel master installation.

[1]
http://docs.openstack.org/developer/fuel-docs/userdocs/release-notes/fuel_known_issues.html

Change-Id: I3fc1fed5f0b9c780cd9174205a3c31dae92a180e
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Updated armband
Project: fuel  cd9e0219f33a9d35fd9826d47de62dc5a03021a5

Change log file permissions

Don't make it executable; don't make it world-writable.

Change-Id: I5d117b39e70fff2c1cb5e62d017efe0387b9b5f4
Signed-off-by: Peter Barabas <peter.barabas@ericsson.com>

Updated armband
Project: fuel  69d872c86b966ce546b7093426bb7032e9a22ab1

Prepared for Fuel release documentation

Helping project with the new structure, added a fuel/docs/installationprocedure
and relevant templates. If you dont need this feel free to abandon this patch.

Change-Id: Ia704aa0b2e66c62241ef0a5eb769ea8f538caa1f
Signed-off-by: Sofia Wallin <sofia.wallin@ericsson.com>

Updated armband
Project: yardstick  63f0e9d0f314e7cf8826604cdd2ffd0b2cb35c9b

reduce ping case time for daily ci

Change-Id: I9d62fc93bb37c58e374a93081a338b00ddd1305a
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Updated armband
Project: yardstick  c14c8535beabe3599d541cb2c17f731e42d029f8

BugFix: fix storperf deployment location error

Change-Id: Ib8329f6feeadacb312171782730ef2807eda5455
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Updated armband
Project: vswitchperf  99e50b9aa86d3bd92d23a32ff34b5f80b9b3e4da

Integration Test: Multi-VM with parallel PVP connections.

Implementation of 3 testcases with multi-VMs in parallel.
Flows are explicitly set on UDP destination ports so that
each packet is sent to a specific VM.

Topology is: Phy1-VM1-Phy2, Phy1-VM2-Phy2,..

This patch requires change #16855 "ovs/ofctl: Fix validation
method for complex flows."

JIRA: VSPERF-326

Change-Id: I59d23354bc9c6db470a59faba13bdcd6f2beb19d
Signed-off-by: Antonio Fischetti <antonio.fischetti@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>

Updated armband
Project: vswitchperf  ffc55a6bbbfafc36a2e28e2e28e737966fb9bb31

integration: Support for VxLAN TC without using overlay traffic gen.

The test case for verifying the vxlan tunneling feature without using any
ingress tunnel traffic. The virtual switch(OVS) is configured to mangle and
generate tunnel traffic in the deployment. The packet flow in the test case is
as follows

TRAFFIC-IN --> [ENCAP-PKT] --> [MOD-PKT] --> [DECAP-PKT] --> TRAFFIC-OUT

 ENCAP-PKT - Encapsulate the ingress packet to a tunnel type.
 MOD-PKT   - Modify the tunnel header to match the following decap interface.
 DECAP-PKT - Decapsulate the newly generated tunneled packet.

Change-Id: Ie24bacb3cb1c069bd60403e5a4ef8bcdf0e12e54
Signed-off-by: Sugesh Chandran <sugesh.chandran@intel.com>

Updated armband
Project: yardstick  8361073662d580803f1da030b9f9bd4203bbaecb

bug fix: ssh authentiation error when run compass scenario in fuel

JIRA: YARDSTICK-319

Change-Id: I25ee9a2582c751024b30e91eabf77aebb14a02f7
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Updated armband
Project: yardstick  57e7210178c975b3e29fb8ef5be459f9ce93e646

add new scenario opnfv_os-odl_l2-moon-ha

Change-Id: Iba714f9b069ea852133314d288740a53a232ac88
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Updated armband
Project: yardstick  1a31405923f0007e3aaaf36f174b268ed99fa368

fix bug of tc075 \t format error in yaml

Change-Id: Ieaea4ccee6d991d1e648a65abb2ecbc7f3455056
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Updated armband
Project: yardstick  81d438404f189b1936777f1ec5abc34b6d171ffc

Add testcase tc0075 and mofify testcsuite

Change-Id: Icbe2815c0fd0890c579d49a4180854ceb7487ecf
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Updated armband
Project: yardstick  5d0fb5e5ed3fc324cac995994b061b6d449fc869

[Yardstick-233]latency measurment by using pktgen-dpdk

VM A runs pktgen-dpdk as a traffic generator and is connected
back-to-back with VM B running testpmd for forwarding packets.

1. use linux expect to fetch the latency statics data.
2. fetch 10 samples of latency and calculate avg_latency.
3. use screen to keep test scripts running in the background.
4. add a function send_command() for screen in ssh.py

JIRA:YARDSTICK-233

Change-Id: I90ae64b3d198c79f159275ae35715eb284f05080
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Updated armband
Project: vswitchperf  a8ef2c308d4c385b8eb0cae0f7f1f2d039affaaf

docs: add vm2vm testing methodology

Change-Id: I8a89ee3eedd3b439f0243eaef2fafc50ee807739
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>

Updated armband
Project: vswitchperf  0ec5b4c8a7216eda19fae38529121911710deaa5

docs: add LTP to index.rst

Fix build issues and add the LTP to index.rst.

JIRA: DOCS-95
Change-Id: I2d22646af935c544645c01600b92a5f51ede39ec
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>

Updated armband
Project: fuel  0d53f22492e043b66734af4e47dcd07ee15a2d13

Filter out non-cluster nodes

In order to avoid fetching up non-cluster nodes
filter them out by option of id.

JIRA: FUEL-183
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
Change-Id: If0d0a1480d648167f1bcf726f0d6d345d2e00711

docs: Update the ref links

Update the links that were invalid for Colorado release

Signed-off-by: cristinapauna <cristina.pauna@enea.com>

Merge "docs: Add specs for colorado"

Updated armband
Project: fuel  1268d78a2564bcadb02226103aec3d4f01eb1fb0

Allign odl-sfc scenarios with new plugin version

ODL Boron use different set of sfc features.

JIRA: FUEL-169

Change-Id: I38c1e518ffbf625a68f879779c01e4abfdb1d672
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

docs: Add specs for colorado

Made the changes in documentation for Colorado release

Change-Id: Iaeeddd21d81f3e65790018475db833ed1416f4a3
Signed-off-by: cristinapauna <cristina.pauna@enea.com>

Updated armband
Project: vswitchperf  f6f05f632f85d86d397e2522bc43cb4407d9eba8

doc_fixup: Grammar and link fixes to documentation

Fixes minor grammar and link issues.

JIRA: VSPERF-349

Change-Id: Id8708aee5b099287b5c99e79ca6da9ab8778897f
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

Updated armband
Project: fuel  3d768dda2bb803adb1536a0247adc1729478879a

docs: Add code-block markup

Add bash code-block markup for:
- instalation instruction guides
- build instruction guides

Change-Id: If7a0f4cfc17e8cabe5d5ff59a7b2fe80ca0bb66b
Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
Signed-off-by: cristinapauna <cristina.pauna@enea.com>

Updated armband
Project: vswitchperf  ea6a60dec01d154196c21cfdacf6fd3f6981c71c

pkt_gen: Spirent changes to Harmonize test/trial terminology

Added changes to make use of the tests parameter.
The change is minor.
Prior to this the value was taken from configuration file.
With this change, the tests value is used as passed.

JIRA: VSPERF-367

Change-Id: I9d1553d3b53dd19a79428ddaaacadb55fc27324f
Signed-off-by: Sridhar Rao <sridhar.rao@spirent.com>

Updated armband
Project: yardstick  3f9d76ec447d917446fd4dd3dd8c0a2a3f758f33

Add some missing test suites for noha scenarios

JIRA: FUEL-166
Change-Id: I145042c35efa2e3fcb31aaa7659d61b187c0550a
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Updated armband
Project: yardstick  c84e43fa9800730206992f791c6b05c0f5f20723

Increase recovery SLA of HA test cases and fix tc019

JIRA: YARDSTICK-287

Change-Id: I676c4401406503a016f829ec3691a006d329f941
Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>

Updated armband
Project: fuel  00065ff5dce8ae26927693486ebb0a12280c9ad5

Update instructions with references to C-release

Change-Id: I7682e7cffcafdec3c42ca5a090662df9ccc431e2
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Updated armband
Project: fuel  31d774fbfbf9e06e1c8d3bbf27df95294a12c89c

Update installation guide for Colorado

Change-Id: Ie0fb45a570c59588429b167c4d83109ebf670ba7
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>

Updated armband
Project: vswitchperf  deeedbf93d972e5bd5b101115bb3537ea7a179ff

pkt_gen: Update MoonGen Documention

Updating MoonGen configuration guide

JIRA: VSPERF-370

Change-Id: I577491a6ece249a6162e1a3595a8682b826e5734
Signed-off-by: bmichalo <bmichalo@redhat.com>

Updated armband
Project: vswitchperf  cc4667ef7310b300cdf40202a2de0e19e85fa800

hugepage_fix: Fix free hugepage calcluation

Fixes hugepage free calculation when hugepage size is not
1GB. Calculation previously assumed 1GB in size. This change
allows for all sizes to be calculated properly.

Change-Id: Ib05800f51992e9757c412a66296a47ad29e88a3b
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

Updated armband
Project: fuel  242641444b6f64ef7e1ca6399a77d080f74987d7

KVM scenario updates

1. Install CEPH_OSD on 2 compute nodes
2. Delete default 'net_segment_type: tun' definition, for it
   is already defined in dea_base.yaml, and it can be updated
   by lab dea files
3. Update osd_pool_size from 1 to 2
4. Michal indicates that
https://review.openstack.org/#/c/342717/ set the limitation
: Restrict usage of controller and osd role on single host

Change-Id: I4907482391588fc21ecf60603b1c599413cbc531
Signed-off-by: Julien-zte <zhang.jun3g@zte.com.cn>

Updated armband
Project: yardstick  cfca1bad6b95c205a9d98376ca977ba5b18c36ff

BugFix: modify storagecapacity output format for result visualization in grafana dashboard

Change-Id: I255586efb0d1e25d7505838693d90a40282249b4
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Updated armband
Project: yardstick  bef0bcb1c50ea4440d251f69372480f42f7936f1

Add grafana config for TC070_Network Latency, Throughput, Packet Loss and Memory Utilization

Change-Id: I06e5c07e63e57d6568ca92478aec041f339209d6
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Updated armband
Project: yardstick  fcd6d55231ca915444b40d8d4e049e831fac50f3

Add grafana config for TC055_ComputeCapacity

Change-Id: Idb7946528a01f51dcca437c64a3b035d25b1e83d
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Updated armband
Project: yardstick  1cc91d0047e573d67f877440fb7185929220d844

BugFix: fix userguide format bugs

Change-Id: Ib8709a2f233333af7a75cbbf42e0507e0713ac72
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Updated armband
Project: yardstick  6b81ccde0937d37733da8ce5105c7832e5537c2c

Add test case description and modify task file for TC042

JIRA:YARDSTICK-233

Change-Id: I5fd879ceae7ec2bfaf75db50bdc0e8d3a1ec1f88
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Updated armband
Project: yardstick  e3a20869ff9b59a31946e8a7f676a9a047b2c1ac

Add task file and test case description file for TC063_StorageCapacity

also fix a bug about path to pod.yaml
also update test suites for TC063
also update 03-list-of-tcs.rst for TC063

Change-Id: I8fdacd109669e9998b10250a18c2c622cd72f0a1
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Updated armband
Project: fuel  935d133447feadd07dfb7905fbe47c949f79e53c

Rebase vsperf

1. discuss with vsperf PTL to rebase vspef with stable commit ID

Change-Id: Ia87d4d5394b5eb476165b06d015414c1675fccac
Signed-off-by: Guo Ruijing <ruijing.guo@intel.com>

Updated armband
Project: yardstick  d333fa23d6cdd9628acf548d19fc3f20b7e33547

BugFix: fix Storperf CI bug

Change-Id: I508762b4fc37620dc01f0e166cef92fe1864eac5
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Updated armband
Project: yardstick  07b65b575c786fa40917f23757f3f585c8c3f555

Add HA Test Cases in Test Suite

JIRA: YARDSTICK-306

Change-Id: Id396f3c9e5302052349c47c8d3063ba3e3a4fe1c
Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>

Updated armband
Project: yardstick  eca794ce3fc0dbdb6bbf0a2f7bae9803589cca1c

Support Network Capacity Testing

two metrics:Number of Connection, Number of Frame

JIRA:YARDSTICK-283

Change-Id: I71f1de25667437bbeac7c06749ff8fb38f41a791
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Updated armband
Project: fuel  91c1fe20f85a09d40e095ae7feaae872eb25b0fa

Fix merge_dicts logic for the case of two nonempty lists

JIRA: FUEL-170

Change-Id: I5abae6fc950cdabe064b5402d9555cedf81cfc23
Signed-off-by: Fedor Zhadaev <fzhadaev@mirantis.com>

Updated armband
Project: yardstick  2ccc014f0ee366a0abc78df4e7e501006f3a56cd

bug-fix: posting scenario status to mongodb

Change-Id: I56f5f82b83f19e48b0a1d2434550fb4c57af7396
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Updated armband
Project: fuel  f96b162d0b7ab0839a5961a23f5f57cf320168e4

Pass host cpu flags to compute guests

Both kvm and ovs plugins require specific cpu flags.
Host-model mode will pass most of the host cpu flags to guest.
If a hypervisor is not able to use the exact CPU model, libvirt
automatically falls back to a closest model.

JIRA: FUEL-157

Change-Id: I77ce625e118b6de51cbcdb58e4be5a6dcaecf384
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Updated armband
Project: fuel  41cdc56137ccd52f3403528dfeb7e2210457ca11

Rebase OVS with DPDK

1. Rebase OVS to commit 9f4ecd654dbcb88b15a424445184591fc887537e
2. Rebase DPDK to 16.07
3. Fix 2 vms in 2 hosts ping each other issue
4. update demo script

Change-Id: I85b56ab6e3a735bbf26df8d4df22f2d76b9fb1d3
Signed-off-by: Guo Ruijing <ruijing.guo@intel.com>

Updated armband
Project: fuel  ad783f86906639eca1b586831c39ed5f7a5c52cf

Revert "Pass host cpu flags to compute guests"

This reverts commit 34da00c2baa6abc69a812aae4c30a82ebae561bd.

Change-Id: I495fa1f71ac30e259ca63e90ca8b38dd2300d469
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Updated armband
Project: fuel  748b18088106826dd9cc9a26d26e1aa359ff67b6

Provide access to mgmt network from host level

Functest framework is trying to access internal endpoints from host
level which currently is not possible in virtual deployments. Move mgmt
network to untagged interface and setup IP address from mgmt subnet on
the linux bridge where mgmt traffic is traversing.

There will be corresponding changes in securedlab repository.

JIRA: FUEL-167

Change-Id: I29b8ebb23a64e39a4e56b27639a87ce2386b9774
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Updated armband
Project: fuel  737faf25aa743d54ae7f458f54d880d80aefcc6d

Pass host cpu flags to compute guests

Both kvm and ovs plugins require specific cpu flags.
Host-model mode will pass most of the host cpu flags to guest.

JIRA: FUEL-157

Change-Id: Iff620a4b4f5948e54f6f8db01411d6659f08ec00
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Updated armband
Project: fuel  7fb3c189aa9205996e236c085e96691483278dd0

tacker-server patch updated

The deb package control is changed in Mitaka, so the patch should
be updated as well.

Change-Id: Ifde84e19da72217a5cca73e0da366e21625cd21b
Signed-off-by: ferenc Cserepkei <ferenc.cserepkei@ericsson.com>

Updated armband
Project: vswitchperf  5a0c6772d255aeb0ab1e6246c91bbeb56bb3a239

docs: split LTD into LTP and LTD.

Change-Id: Id0b2ce7460e76ffb3d478bd255a7e5b8e75ba001
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: <bmichalo@redhat.com>
Reviewed-by: <sridhar.rao@spirent.com>

Updated armband
Project: vswitchperf  612090b0009574d02cf21a4fe41f036d0694b1b1

integration_cleanup: Force testcase cleanup to always run

During testcase development on the integration side, if
namespaces are used or veth ports and an exception is raised.
The namespaces and veth ports are not properly cleanup up
because the run_finalize does not get executed.

This patch wraps the testing block in a try block where
a finally will ALWAYS execute the run_finalize thus
preventing the possiblity of leftover testing artifacts.

JIRA: VSPERF-328

Change-Id: I4ea5f29a48b9171f330847f34b5b30ef3ab22f27
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

Updated armband
Project: vswitchperf  ec78c5c7f8a9357e404b7207e626df97dd20efa9

Xena_2544_tput_options: Add options for rfc 2544 testing

Adds options to Xena for testing options when running RFC 2544
throughput testing.

JIRA: VSPERF-369

Change-Id: I3145bd1a4d697d7b06cafda4f9d77cce859d1839
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

Updated armband
Project: vswitchperf  1dc40afad832bca427058380a629634aa3cb104c

hugepages: change default num pages + deallocate

Change the default number of allocated pages to the min 10GB. Deallocate
hugepages if we allocated them on the fly.

Change-Id: If9946cec423dd095c1ca1ab3bee3698e2f025047
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>

Updated armband
Project: yardstick  c016216e8adc432c5bf0f24b073179117cdf3284

bug fix no curl in yardstick docker

Change-Id: I9cae1ff556df1a42c9b5f51347b6452ea4d4cba8
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Updated armband
Project: yardstick  271d5a1bca3e7c8c22280bc564e2f4ab0722c860

add ping6 to nosdn-nofeature-ha scenario

Change-Id: Ic495293d37b51b95009000559b451ef7c12cfcbe
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Updated armband
Project: fuel  d19c4589554b2d82b6fcb1fe921ffeffd9377a2f

Rebase to collectd-ceilometer-plugin stable/mitaka
1. fix pbr:version_string in collectd-ceilometer-plugin
2. disable collectd build to use stock collectd
3. update README in fuel plugin

Change-Id: I773910c03d109af1fc1f86a5709105e9ffbfc350
Signed-off-by: Guo Ruijing <ruijing.guo@intel.com>

Updated armband
Project: vswitchperf  a9e754b1050b17464d9e77a942068956d872894e

test_spec: LTD: MatchAction Performance testing

One of the new tests we agreed by working on Etherpad
was MatchAction. Maryam led the development, and many
provided comments there. This is another chance for
comments before we merge.

JIRA: VSPERF-242

Change-Id: I9da74efb703d5f221280567159e4ed6d830eb92c
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>

Updated armband
Project: vswitchperf  f5ec5442151cb801ddbde4477a77f51654afe1a5

pkt_gen: MoonGen should use class object for line rate calc

Instead of hard coding line speed numbers for rate calcuation,
MoonGen should use its class object initialized at start time.

JIRA: VSPERF-368

Change-Id: I68c688f8c244df16d98cfd15efabf491a317256b
Signed-off-by: bmichalo <bmichalo@redhat.com>

Updated armband
Project: yardstick  7892704fdcb96964f6d10476198a9becd4188f89

Add test case description and task file for TC052

JIRA: YARDSTICK-300

Change-Id: Ifa1e9374dcff8d9343cb05785933b1ea4752efe7
Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>

Updated armband
Project: yardstick  69a2d149dc0aa99cd4c1e52e05a77112f3115f20

add reporting to mongodb in yardstick ci

also need to add report-show html in releng

Change-Id: Ie176d94a2f389bf1017a1e0d9f98b3a851b77214
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Updated armband
Project: yardstick  9cc0b04973636e85b1d5a618dee4264cec62084c

Add test case description and modify task file for TC004

Change-Id: Ie67985ebf28acc08cc53b312b4f90e65923b5fc4
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Updated armband
Project: yardstick  4b4b0d41040fbd66be92a4aa4d53c6e7692f0c77

Add Storperf in CI [work in progress]

Add task configration file for TC074_Storperf and update test suite file
Add test case description for TC074_Storperf
Update Dockerfile to add ubuntu image used by Storperf
Update yardstick-verify to load ubuntu image and install Storperf
Modify plugin.py to support local installation

Change-Id: I4de764c7924aac98de6e6a8664f9d5c0b58cf31b
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Updated armband
Project: yardstick  dbff89e9145a4841561da858b5de9df7609748f7

Two modifications for DPDK image

1. workaround for creating snapshot
2. modify the parameters of Hugepage in vm

JIRA:YARDSTICK-233

Change-Id: I9cea76ed30dabe4fe2cb644e58ed0acd7dd8ecde
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Updated armband
Project: vswitchperf  8fc264914ec05e572543f7d857a7ff4f437ffa9d

bugfix: Harmonize test/trial RFC2544 terminology

VSPERF framework was updated to follow RFC2544 definition
of 'test' and 'trial' terms. Test parameter 'rfc2544_trials'
was replaced by new parameter 'rfc2544_tests'.
Both code and documentation were updated to reflect
these changes.

JIRA: VSPERF-300

Change-Id: I144a28359fd06394f1f87ef324458bafd5aad45f
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: <bmichalo@redhat.com>

Updated armband
Project: fuel  f8fe6cb863118896bfc157f56ca7185d866db6c0

Use ODL Be SR3

JIRA: FUEL-165

Change-Id: I483f23c2f74313020d6a3dbb88079558d6674010
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Updated armband
Project: vswitchperf  31f0a3e0a25e147e285d14e2e262ac48aa83ce65

hugepage_detect: Change hugepage detection to check for free hugepages

Change hugepage detection to check if hugepages are configured. Also
verifies enough free hugepages are available based on test
configuration. Will result in an exception if not enough hugepages
are found. This performs the check based on the guest memory configs
as well as the dpdk socket configs.

Adds some new methods to check for free hugepages based on all
hugepages or for socket free hugepages.

Adds new logging indicitaing needed and free hugepages as well as info
level event if hugepages are not configured at recommended 1GB size.

JIRA: VSPerf-255

Change-Id: I80d5605308861070c412568d8d40339f01b9718b
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

Updated armband
Project: vswitchperf  18253fb2133ae1bd294689d297b0182481c174c2

namespace_bug: Initial creation of namespace fails

Initial creation of namespace fails because var/run/netns does not
exist.

JIRA: VSPERF-366

Change-Id: I02e5aef52e1675f303405b69c7461ca6482903af
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

Updated armband
Project: yardstick  df30d59db7bf598d1ecdb874f84d722445a15fde

Add test case description and task file for TC054

JIRA: YARDSTICK-302

Change-Id: I957e28da6b5eaee8a33abb408f02c994e435d042
Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>

Updated armband
Project: yardstick  1a962e2435e4acdd63dd9925a65907a1aca21bbe

Add test case description and task file for TC053

JIRA: YARDSTICK-301

Change-Id: I7369ef520bb33381e08168c81eeb997ebaafd0f5
Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>

Updated armband
Project: fuel  1772adc5124b3ebdb7593d6f7758e2879edb8c97

POC script updates for Colorado

Change-Id: I2afb7826a5dcc22f5d810312e1ff027a0b5fcbfa
Signed-off-by: ferenc Cserepkei <ferenc.cserepkei@ericsson.com>

Updated armband
Project: fuel  86d6be410288ff3865f929fdc64435c7cc572c8e

bootstrap_admin_node: Fix connectivity check.

After Fuel Master builds the bootstrap image at first boot,
internet connectivity is tested using the URL for the CentOS
updates repository.

bootstrap_admin_node.sh script parses the output of `yum repolist`,
looking for entries like 'Repo-baseurl: http://...'.

However, in Fuel 9.0, <updates> points to a mirrorlist file (a text
file containing a list of possible mirror URLs) instead of being
a single, direct link to the repository.

Also, note that in Fuel9, <updates> and <security> repos are disabled
by default.

For now, we only test that we can access the mirrorlist file,
while the check should be performed against the mirror(s).

Old (Fuel 8) repo entry format:
Repo-baseurl: http://mirror.fuel-infra.org/.../updates/x86_64/

New (Fuel 9) mirrorlist format:
Repo-mirrors: http://mirror.fuel-infra.org/.../mos-mirrors-updates.txt

Backported from upstream change [1], which should fix bug [2].
This change will get merged upstream in Fuel 10.

[1] https://review.openstack.org/#/c/335094/
[2] https://bugs.launchpad.net/fuel/+bug/1596981

Change-Id: Ibec397af2e1d925a011907f14e1d655741e280fb
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: fuel  c15c41b96c1922fcb2b9bbb2661b3ae562fda375

Fix OVS scenarios to use fuel-plugin-ovs

 * Use fuel-nshovs instead deprecated fuel-nfvovs
 * Modified scenario to enable DPDK via Fuel
 * Removed hard dependency from specific POD

 * Add ability to merge networks lists

JIRA: FUEL-156
JIRA: FUEL-162

Change-Id: Ie609ff140f1de96e54df37dd9b1881afec792317
Depends-On: Ic6072d938e09a40516c32cdde6223d0a21e57403
Signed-off-by: Fedor Zhadaev <fzhadaev@mirantis.com>

Updated armband
Project: vswitchperf  da059df422c839bb5d6393455a43c44e95873c73

pkt_gen:  MoonGen incorrectly calculates rx/tx % statistics

For MoonGen, the final results parameters: throughput_rx_percent,
throughput_tx_percent were incorrectly calculated when converting
MoonGen to VSPERF format.  In particular, this would occur when more
than one data stream (single channel unidirectional traffic) was used in
the test. When calculating these percentages, only aggregate throughput
values equaling unidirectional traffic were used (for example, for 64
byte frames bidirectional traffic should use 29.76 Mpps, not 14.88 Mpps)

JIRA: VSPERF-341

Change-Id: Ie62bded7aea023c287697f18c4172b58c320e050
Signed-off-by: bmichalo <bmichalo@redhat.com>

Updated armband
Project: vswitchperf  b219f67de8e314e419108d9e15667c2cd2b973d1

sriov: PCI IDs must be checked before usage

Order of NIC PCI IDs handling was changed to ensure their
check and possible expansion (by missing domain part)
before their first usage. This avoids a vsperf crash
in case that sriov is configured and short NIC PCI IDs
are used.

JIRA: VSPERF-363

Change-Id: I91f724e9558bce5a92520de72b4bf000f33d2f29
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: <bmichalo@redhat.com>

Updated armband
Project: vswitchperf  28b133e55f7bb8728c699b1e5db575c12dd01965

dpdk: Testpmd forwarding mode changes in v16.07

Testpmd forwarding mode mac_retry was obsoleted in DPDK v16.07.
Retry option is supported by multiple forwarding modes now.
Former "mac_retry" mode can be replaced by "mac retry" construct.

JIRA: VSPERF-333

Change-Id: I1563427985966264f07d10b1a8351784fe999d74
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: <bmichalo@redhat.com>

Updated armband
Project: vswitchperf  fc480dd1139f12730c68c72f738b3df8080af283

install: Missing packages for numa library

Recent versions of DPDK (16.xx) depend on numa library.
Thus installation scripts were updated to install both
binary and development packages.

JIRA: VSPERF-360

Change-Id: Idd0eac8758f30a355909bb804e99e650b67bba8b
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: <bmichalo@redhat.com>

Updated armband
Project: vswitchperf  77de48c31767556fb9f0de76285d1beed16dd828

Xena: Modify aggregate_stats one port no stats when bi-direction

Xena exception when no stats collected on receive on one port
during bi-directional traffic. Modify aggregate_stats in the
XenaDriver.py, add judge whether the two port both has stats,
if one port has no stats, the result use the port's value which
has stats.

JIRA: VSPERF-327

Change-Id: I18c349d609a2834907f0383dbfbebd5cd281f541
Signed-off-by: liting <tli@redhat.com>

Updated armband
Project: fuel  aa5d41bfa5ecdf5c53512194a9816cbec95b4da2

Don't use -f flag with docker tag

-f flag has been deprecated since v1.10.0 and is removed from v1.12.0.
If user use recent version of docker iso built will fail.

https://docs.docker.com/engine/deprecated/#/f-flag-on-docker-tag

JIRA: FUEL-163

Change-Id: If42781f342d59db7672322ec07063d09a23e1dcb
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Merge "def kernel-flavor: linux-image-generic-lts-xenial"

Updated armband
Project: vswitchperf  896f0fe61346916a560c01c0eae638894d653d7e

Hugepages: on the fly allocation.

If no hugepages are available, try to allocate HUGEPAGE_RAM_ALLOCATION
amount of RAM for hugepages.
JIRA: VSPERF-290

Change-Id: I092b3831254579eeebbe45e85884828f9d749895
Signed-off-by: Mars Toktonaliev <mars.toktonaliev@nokia.com>

Updated armband
Project: vswitchperf  236073f3963ee4dc038eea3b42d60644ebfc703f

pkt_gen: MoonGen start rates not correct

The VSPERF traffic profile for starting rate is in a
percentage of line rate.  MoonGen programs its
starting rate as Mpps.  Therefore the traffic profile
for VSPERF needs to be converted to a MoonGen format.
There was a hardcoding of 14.88 that was used for the
starting frame rate for all frame sizes.  This needs
to be corrected to take into account all frame sizes.

JIRA: VSPERF-350

Change-Id: Ied71668a560d7d2b03483f9a1192dd2fb4965996
Signed-off-by: bmichalo <bmichalo@redhat.com>

Updated armband
Project: vswitchperf  bf43287f11e85143148e5be6c81b7e9894652eac

docs: Update vloop-vnf changelog

Updated version of vloop-vnf image was added into the changelog inside
installation guide.

JIRA: VSPERF-349

Change-Id: I64a1acdf2191858dc282ea6c3b588048b3bdd742
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: <bmichalo@redhat.com>

Merge "Rebase: adapt patches after ovs/dpdk fix"

Updated armband
Project: fuel  cf58d9d488fde91a5177ae01363844da8ec8441c

Allow to use Intel NICs for DPDK on Ericsson POD2

JIRA: FUEL-161

Change-Id: I009ba7e9587f3c47d8e609c96b0666394887929e
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Updated armband
Project: yardstick  e023a2ee7023588fda3e0d7cfebc693e4903beb6

[Yardstick-233]DPDK image for TC042

These file is based on Akos's code.
(https://gerrit.opnfv.org/gerrit/#/c/16095/)

The different places:
1. create flavor and import yardstick_key.pub with heat template.
2. remove handle code about eth0 in user_data.
3. update heat cli and delete step "nova stop" which is not necessary.
4. clean the stack in final.
5. add eth2 for vm.

JIRA: YARDSTICK-233

Change-Id: I04f2051fb4bcfeed2df4868d758fd92011c62233
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

def kernel-flavor: linux-image-generic-lts-xenial

Ubuntu arm64: While keeping kernel 4.2 for Trusty
(linux-image-generic-lts-trusty), set 4.4 backported from Xenial
(linux-image-generic-lts-xenial) as default kernel for Armband ISO.

Xenial kernel 4.4 for Trusty has been tested with:
- AMD Softiron;
- APM Mustang;
- Cavium ThunderX;

While at it, remove obsoleted rtc-efi fixes.

Notes:
- keep 4.2 kernel inside the ISO;
- selecting 4.2 kernel may be done via deploy settings, by
  overriding kernel flavor when calling `fuel-bootstrap`;

Related-bug: ARMBAND-48

Change-Id: Ice1f95939f0d7d9491befd20030740850b1a0e61
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Rebase: adapt patches after ovs/dpdk fix

Upstream change [1] requires us to to adapt our Fuel@OPNFV patches.

[1] https://gerrit.opnfv.org/gerrit/#/c/17969/

Change-Id: I9823469df575cc929e399a6025aca6066a16e98d
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: yardstick  9d493a68b3df583a8875e22dbe58eaaa61511608

Add test case description for TC061

Change-Id: Ib73a7437ade77abd70df1412d94e0e9c8a8885a8
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Updated armband
Project: yardstick  86b9fc4f434c72bd276e4bf1ce7d7f5a04b150b2

Modify grafana config for TC002_Ping as ping output format has been changed

Change-Id: I758d3efd909011c0c197519d33dca7d579cc5cce
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Updated armband
Project: yardstick  545ac267f0080a456984f7975febff28ef4c61c7

Support Storage Capacity Test

It measures disk size, block size and disk utilization.

JIRA: YARDSTICK-284

Change-Id: I61b3fb8a35da41c77450c157f843fb853d77dddd
Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>

Updated armband
Project: fuel  f0463e6234cd27eaa2e0cd3ded0b035d89aa918c

Fix config for no-ha kvm scenario

JIRA: FUEL-157

Change-Id: I09e595902b2c467b5522b7b37a772f7ab35c8cea
Signed-off-by: Michal Skalski <mskalski@mirantis.com>

Updated armband
Project: fuel  5c9590de139f16bdb764b24ecc5dff76640b210e

Add collectd package for collectd ceilometer plugin

Change-Id: I8da0087d8f17f5f2e4c3275a26ad2ca164878226
Signed-off-by: Guo Ruijing <ruijing.guo@intel.com>

Updated armband
Project: vswitchperf  40460b1fd291612cca316527c4366e83ae295ce2

docs: Enhancement of IxNetwork configuration guide

Configuration guide has been updated with description of
IxNetwork specific configuration options. New section was added
with description of test results sharing between IxNetwork and
VSPERF.
Additional changes:
* wrong formatting inside installation.rst was fixed
* description of IxNetwork configuration was updated inside ixnet.py

JIRA: VSPERF-302

Change-Id: Ida0e086e69b82fd1f9821d16ea750b2dec1d5aa2
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: <bmichalo@redhat.com>

Updated armband
Project: vswitchperf  48feb686c3b6648d4bc52b155a053ec5b5883e9a

docs: Update release notes

Release notes were updated with features introduced by Colorado
release.

JIRA: VSPERF-349

Change-Id: I43179028c973cae4be6746e633c27fd3419e951a
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: <bmichalo@redhat.com>

Merge "Upstream: decouple patches, Makefile"

README: update Fuel version to 9.0.

While at it, move hwoto-dea.md file to repo root, dropping
confusing doc directory.

Change-Id: I96552493d8a9198841eb01f4e83567444fb785b9
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: vswitchperf  80414a002e0a10dcce9126786d51695fc350cb47

pkt_gen:  Remove commas from MoonGen results

Results from other traffic generators are reported as
pure numbers, i.e. 2477356.0000. These values are
consumed and processed by other scripts (e.g. CI or
OPNFV results visualization), so we should keep it
consistent among various traffic generators.

JIRA: VSPERF-342

Change-Id: I305421287eb632707038f2c8bc594fcb255ec939
Signed-off-by: bmichalo <bmichalo@redhat.com>

Upstream: decouple patches, Makefile

Change-Id: I78606b3dca803c7bf1d872cf067b2bd5f8a8aa91

Updated armband
Project: fuel  5bfea5d5b88a167b754384f07453a80d416d7337

build: fuel-main: Decouple patches, Makefile.

Tested in armband, with very small adaptions.

Use `git apply` and/or `git am` in favor of `patch`.
Change patches from old context format to unified diff.

This change allows us to decouple Makefile and patches.
This means we no longer have to manually stage touched files
before committing them to git.

Possible improvements:
- move patches to separate dir and add ordering info (prefix);
- merge patches (currently we have one per touched file);

Remove obsolete (unused?) patch:
- fuel-main_docker_version.patch

Change-Id: I5b621370993b259779c813b47105f632948e6da7
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Rebase: adapt patch after deploy-config refactor.

Change-Id: I97c9c79bb342d6c7504414134649795689b5e78b
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Updated armband
Project: vswitchperf  65034580a2759c89c418e0a47ee16bee10cc2c7c

xena_deadlock: Fix xena2544.exe deadlock

Fix Xena2544.exe execution with mono where sometimes the
Xena process says complete, but the mono process doesn't exit.

Changes call of Xena2544.exe from communicate thread lock to a
wait try/catch block and checks the log periodically to see
if a deadlock has occured and if so, the mono pid is terminated
to prevent deadlock.

* Fix one small issue with typecasting to int, changed to float

JIRA: VSPERF-319

Change-Id: Ie7a86a2b9ff9cdfacba5a912ad17df6cc0581702
Signed-off-by: Christian Trautman <ctrautma@redhat.com>