Addition of Configurable Sampling and Configurable Confirmation Retry

JIRA: YARDSTICK-1221

In order to increase accuracy of result the following are done :-
  - Improve Measurement Accuracy (YARDSTICK-1212)
  - Improve Sampling Interval (YARDSTICK-1219)
  - Allow 4 PROX ports to be read simultaneously (YARDSTICK-1220)

This change does the following :-
  - Stores LINE Rate statistics of Sample
  - Requires a confirmation retry before deciding to increase or
    decrease this is configurable.
  - Allows the user to disable Sampling or specify a sample interval
  - Added Code Coverage of ProxDurationRunner based on YARDSTICK-1199

Change-Id: I27242ac1849c9a2712866385b5fbc05977c71516
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
(cherry picked from commit 2e447af9a5a54355aa20028813660d07d1bd2e18)

Convert SLA asserts to raises

This commit converts Python assertions to a custom exception in all
places where SLA validation is checked with an assertion.

This commit also fixes all emerged pylint errors.

JIRA: YARDSTICK-966

Change-Id: If771ed03b2cbc0a43a57fcfb9293f18740b3ff80
Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
(cherry picked from 39f80e9b06395ae1515cfcf08508504ad4dd978a)

Merge "Bugfix: HA kill process recovery has a conflict" into stable/fraser

Merge "Replace glance delete image with shade client." into stable/fraser

Merge "Replace glance create image with shade client." into stable/fraser

Merge "Replace cinder detach volume with shade client." into stable/fraser

Merge "Replace cinder delete volume with shade client." into stable/fraser

Merge "Replace cinder create volume with shade client." into stable/fraser

Merge "Replace cinder get_volume_id with shade client." into stable/fraser

Merge "Replace nova get flavor with shade client." into stable/fraser

Merge "Replace nova get server with shade client." into stable/fraser

Merge "Replace nova attach volume to server with shade client." into stable/fraser

Merge "Replace nova delete keypair with shade client." into stable/fraser

Merge "Replace nova client create keypair with shade." into stable/fraser

Merge "Remove unused nova client functions." into stable/fraser

Merge "Replace nova delete instance with shade client." into stable/fraser

Merge "Replace nova create instance with shade client." into stable/fraser

Merge "Update neutron delete_neutron_net function." into stable/fraser

Merge "Replace neutron create security group full with shade." into stable/fraser

Corrected scale-up command line arguments

Change-Id: If308fde797dcb01e58f37ad81bb116fde542366a
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
(cherry picked from commit 5fa31a4e78b9421615ef81c8392e30179d49e1cb)

Merge "Change IxNextgen library load" into stable/fraser

Replace glance delete image with shade client.

Remove get_image_id function.
Function delete_image now uses shade client.

JIRA: YARDSTICK-892

Change-Id: I6e8510dfa49aa14786ed7ac3382b85c4e699fb9e
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit d6c1b8b7bfd257efd5fe2df30dd450bdb2c57c7d)

Replace glance create image with shade client.

Function create_image now uses shade client.

JIRA: YARDSTICK-892

Change-Id: Ia41d9ce702a1f24031080f8a365c1b2bd9ac9faa
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit c31edc5ab9013d93ffd32ed72adb14740e43b24a)

Replace cinder detach volume with shade client.

Function detach volume now uses shade client.

JIRA: YARDSTICK-891

Change-Id: Ie437ccf1172cb82dc869963f0d62e31a5ab23ebb
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit f6cca46f6b1aa6134a0e634a3a9e524cdbbfa729)

Replace cinder delete volume with shade client.

Function delete volume now uses shade client.

JIRA: YARDSTICK-891

Change-Id: I016e1d3bf5972879cad176b56c7282e35413945e
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit 4c672aa7012a530806a2f8ff2d45a8badb7f7b21)

Replace cinder create volume with shade client.

Adds get_volume function.
Function create volume now uses shade client.

JIRA: YARDSTICK-891

Change-Id: I0b2fae5f2cf52eaf2e4a0062c858d49bc4ce9ccd
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit 2d33d0f289f3dd3864fe57289e953b876f362c06)

Replace cinder get_volume_id with shade client.

Function get_volume_id now uses shade client.

JIRA: YARDSTICK-891

Change-Id: I45ae40982a64f677dbbdeb6c9510a0ec9ac973f1
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit be197a6197e803b6334f2ccf72f561245ef7aac7)

Replace nova get flavor with shade client.

Rename get_flavor_by_name with get_flavor.
Function get_flavor now uses shade client.

JIRA: YARDSTICK-1088

Change-Id: Ic82127e475baf39643be0a254b177f3058b85748
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit 35bbd618b1e69a5b5edbd64a333720bfa5a92400)

Replace nova get server with shade client.

Rename get_server_by_name with get_server.
Function get_server now uses shade client.

JIRA: YARDSTICK-1088

Change-Id: I69c59145cefdb565f3ece27baaaf932905e1b757
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit d75a91ebf2937e5cfe5cf2aa5a90db9121f73967)

Replace nova attach volume to server with shade client.

Function attach_volume_to_server now uses shade client
instead of nova client.

JIRA: YARDSTICK-1088

Change-Id: Id00df672c2c195b5c338cbbc30ddf2742a4e4d29
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit 8fd82cd8d0146d8cebbc32ed7cbb6fb9d1861297)

Replace nova delete keypair with shade client.

Function delete_keypair now uses shade client.

JIRA: YARDSTICK-1088

Change-Id: I46b895748c5c44b0bf7d5b035395676ebff48d7f
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry pick from commit aded0fdb30caf035e0eb94c1216f436ba597c2c7)

Replace nova client create keypair with shade.

Function create_keypair now uses shade client instead
of nova client.

JIRA: YARDSTICK-1088

Change-Id: I060580504d6969c5ba859ed4494082feb998d37d
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry pick from commit c1ab98526209a761a0565afa7ccd552ba9ac7ade)

Remove unused nova client functions.

Following funtions are not required by shade client also
not been used in any of the scenario files:
*create_aggregate
*create_aggregate_with_host
*create_instance
*add_host_to_aggregate
*create_aggregate_with_host
*get_availability_zones
*get_availability_zone_names
*remove_hosts_from_aggregate
*remove_host_from_aggregate
*delete_aggregate
*get_image_by_name
*check_status

JIRA: YARDSTICK-1088

Change-Id: I7ba0fbce6aa3e636aa55581a993c1ec1b48fbead
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit 2ca15a8c87e171cbd82b1e748dfc60903662b73b)

Replace nova delete instance with shade client.

Function delete_instance now uses shade client.

JIRA: YARDSTICK-1088

Change-Id: I5772a74c6dc2d103edd410042a8eaf721d1bcc5c
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit 05f97c4e4ce1e8c7c97cda16f12215e663a13c23)

Replace nova create instance with shade client.

Remove redundant functions:
*get_instances
*get_instance_status
*get_instance_by_name

Function create_instance_and_wait_for_active now uses shade client.

JIRA: YARDSTICK-1088

Change-Id: I766da333dabbb1b83a7b4ede4bf73567ec70eb8c
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit 069d7a13d1f8b6b465ae164e2a440c25270f7e8e)

Update neutron delete_neutron_net function.

Update the changes done in patch [1].

JIRA: YARDSTICK-890

[1] https://gerrit.opnfv.org/gerrit/#/c/52361/

Change-Id: Iccbf16d0a2e72919d5092366241ff41686f01a58
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit 14615e286e67ca74a8c0ae55ffe043170e5ecbb6)

Replace neutron create security group full with shade.

Function create_security_group_full now uses shade client.

Remove openstack util's private 'get_security_groups',
'get_security_group_id' & 'create_security_group' functions as
'create_security_group_full' now uses 'get_security_group' &
'create_security_group' function defined in shade client library.

JIRA: YARDSTICK-890

Change-Id: Ibd5b9ca9b7ce99b3e40c5dcc545f2af672ce2203
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit c00e2c606806b46111b108818235d236ba409515)

NSB setup inventory name changed

NSB setup script [1] fails when retrieving the inventory file. This script
is going to be deprecated but we still support it.

[1] https://github.com/opnfv/yardstick/blob/master/nsb_setup.sh

JIRA: YARDSTICK-1247

Change-Id: I3798531652b0e3a1a007d1d9434998fdd54645d7
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
(cherry picked from commit 370b703896656f6b6949de05b6c44c98a72eee46)

Fix nsb_setup.sh script

Ansible role install_dependencies was renamed
to install_dependencies_jumphost in previous patch.

JIRA: YARDSTICK-1146

Change-Id: Idf7c191151961c1c0e63ad2f75aa0aab8ed2b2fa
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
(cherry picked from commit bbf5e6a37922124bd729b5e6e50929c282bb7892)

Merge "Install dependencies: bare-metal, standalone" into stable/fraser

Merge "Start nginx and uwsgi servicies only in not container mode" into stable/fraser

Merge "Migrate install.sh script to ansible" into stable/fraser

Bugfix: HA kill process recovery has a conflict

It happens in Nokia SUT when running in the Plugfest. The problem happens when
the start_process start to recover the killed process (like nova-api), but the
self-cured mechanism already recovered. And somehow it lead to a conflict and
has problems.
So the recover of the HA attack-recover should be improved to only recover it
when it needs to.

JIRA: YARDSTICK-1222

Change-Id: I1acb5a7d59d6fe4e0de0b0c5942fa89e051dd1ff
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit 736f3fa5d52345d6fe5174b83de043f779fa0600)

Install dependencies: bare-metal, standalone

This will install all dependencies needed on the bare-metal and standalone
physical nodes.

JIRA: YARDSTICK-1177

Change-Id: I719ca64d4da098d6dd60597e5fc4ad6f4715f79e
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit 86be172a9427a4ecee5666e9660ce37c006abe1b)

Start nginx and uwsgi servicies only in not container mode

No need to execute nginx and uwsgi when running in container mode.

JIRA: YARDSTICK-1179

Change-Id: I253f3adab388a14886b70e6589936f6eb27ac4c0
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
(cherry picked from commit 3decdca3d0732a1df845650562e7bcb8fbfd87a7)

Migrate install.sh script to ansible

Ansible scripts to install yardstick.

These scripts will take a few options:
  INSTALLATION_MODE : Container or Baremetal
  YARDSTICK_DIR: Location of Yardstick directory
  VIRTUAL_ENVIRONMENT: Should a virtual environment be used
  NSB_DIR: Location of NSB directory

JIRA: YARDSTICK-1126

Change-Id: I4a13e07e96650ffd971dfb18472f2563cfd51aa9
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
(cherry picked from commit 0b976dd02421a181674acc837127ac741ccfccea)

Refactor "utils.parse_ini_file" testing

JIRA: YARDSTICK-1218

Change-Id: I5136b22110d215beb7af72998ad47a8dba27f63b
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit 4a186ef7fde978f89f4332990f70e396966f69e3)

Fix "os.path" mock problems during tests

This patch removes the global mocking applied on "os.path".

Change-Id: Ia18d2c90195c5408a1852792bdf05b6f0c1ad21f
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit d7f8717c3beb1854976e77d56823f482497ffff3)

Merge "Refactor RFC2455 TRex traffic profile injection" into stable/fraser

Change IxNextgen library load

Changed IxNextgen library load in IXIA RFC2544 traffic generator call.

JIRA: YARDSTICK-1116

Change-Id: Icbdc5f1255dd2676584f3a1be767287e55e71f4a
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit 9d84f5ad73e9689d3131e4ce09fe7262697c5817)

Stop time.sleep mocks in unit tests

tVpeApproxVnf and TestProxSocketHelper classes mock "time.sleep" in
the setUp method without deleting it at the end of the test execution.

JIRA: YARDSTICK-1243

Change-Id: Iff31d9c7b400ad8a47f37792aeb0d20328b9d9e1
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit 9b22f5b23050a0be67f8237e4d0b412f58b43472)

Refactor RFC2455 TRex traffic profile injection

The TRex RFC2455 traffic profile configures the duration of the traffic
injection. Once the traffic is started, the traffic profile should poll
the traffic injector client for the injection status. When the injection
is finished, the traffic execution should end.

Instead of this, the traffic profile waits a fixed time (using time.sleep
method) and then stops the traffic. This approach is not accurate and may
cause shorter injection periods.

JIRA: YARDSTICK-1197

Change-Id: I5090df81ef4ec7945ff6c1aff070656b48e0fe77
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit 340be73be5fd20067c23a7ddce9073639e355d3a)

Move tests: unit/network_services/helpers

* Fix pylint errors
* Add TODOs

Some errors are ignored locally, as they were a symptom of other problems.
These issues have been flagged with a TODO, and should be fixed later.

JIRA: YARDSTICK-837
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: If0b77a6e0b102071ecfb212362647c62a621e4f9
(cherry-picked from commit 065c00d3147d12c692d43179d9c1c9afadb97825)

Merge "Move tests: unit/network_services/vnf_generic" into stable/fraser

Merge "Standalone XML machine type is not longer valid" into stable/fraser

Move tests: unit/network_services/vnf_generic

* Fix pylint errors
* Add TODOs

Some errors are ignored locally, as they were a symptom of other problems.
These issues have been flagged with a TODO, and should be fixed later.

JIRA: YARDSTICK-837

Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: I3d95537a64bde923703421510d27bac0d6dd92bd
(cherry-picked from commit 98294f2c8153f663c3b3a4e4cb98910e9d5cb602)

Merge "Remove instantiated contexts in "test_task"" into stable/fraser

Remove instantiated contexts in "test_task"

During unit testing, all contexts instantiated must be deleted at the end
of the test to avoid clashes with other tests.

JIRA: YARDSTICK-1209

Change-Id: I1994b915001b4a518e096833a0c5d33febbd8de6
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit 5e4d95ba299ce92588701d9481657c343b8ef609)

Merge "Move tests: unit/network_services/nfvi" into stable/fraser

Merge "Add "duration" parameter to test case definition" into stable/fraser

Merge "Remove print out of logger exception in TestUtils" into stable/fraser

Merge "Cleanup TestYardstickNSCli class" into stable/fraser

Merge "Document for Fraser test case results" into stable/fraser

Move tests: unit/network_services/nfvi

* Fix pylint errors
* Add TODOs

Some errors are ignored locally, as they were a symptom of other problems.
These issues have been flagged with a TODO, and should be fixed later.

JIRA: YARDSTICK-837
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: Id330ee1c89d54ef487edb7fe160e5a31d9a3094f
(cherry-picked from commit e12f98c2bbed5191714bdc553e7b269b1437cecd)

Add "duration" parameter to test case definition

Add "duration" parameter to test case definition, in scenario:options
section. This parameter will be rendered in the traffic profile.

If the parameter is not present in the test case scenario options, the
default time written in the traffic profile options will be 30 seconds
(TrafficProfile.DEFAULT_DURATION = 30). If the traffic profile
injection time is not defined, the default injection time will be 30
seconds.

  testcase:scenario:options:duration (default = 30)
      render --> traffic_profile:duration
          parse --> TrafficProfile.duration (default = 30)

Target traffic profiles (RFC2544):
  - RFC2544Profile
  - IXIARFC2544Profile

JIRA: YARDSTICK-1194

Change-Id: I968922e6bb882d7ee15aa1c4db4037face7a3492
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit 1517319fd210d71db72c5e4bfa00fc49ae4fa877)

Improve IXIA IxNetwork library and traffic profile (4)

This patch implements an active wait for the traffic injection. Once the
traffic is started, the traffic generator class will poll periodically the
IXIA traffic generator chassis to retrieve the status of the traffic
("started", "stopped").

Now the latency statistics are retrieved and reported for each injection
period.

JIRA: YARDSTICK-1116

Change-Id: I4422e2c88b4fc97b7cac3de8a82b2d75467c4117
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit a3399d07b83ce0e50d9c0144d00a7ba83a73390f)

Improve IXIA IxNetwork library and traffic profile (3)

This patch modifies IP packet parameters.

"IxNextgen.update_ip_packet" modifies the L3 packet according to the
test case and setup the IP addresses.

JIRA: YARDSTICK-1116

Change-Id: I46ff75ab1989d0e6f5cc876418a015386717e06f
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit e5c78ae3ec1bcf0cb44646c6031fb9c04dd63e4a)

Improve IXIA IxNetwork library and traffic profile (2)

This patch modifies the way the packet frame and the flow is configured
before the injection.

"IxNextgen.update_frame" modifies the L2 frame according to the
test case and setup the frame rate, frame size, traffic injection
duration and MAC addresses.

JIRA: YARDSTICK-1116

Change-Id: Ife08f15a4eda24d7835c92c4172b450854d112ee
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit 8d10a6a8447fc2798491a6f3856e21b85fa309ba)

Improve IXIA IxNetwork library and traffic profile (1)

This patch introduces a new way to configure the TCL IxNetwork server.
All the configuration is done using the TCL API, removing the need of
using the pre-saved configuration file.

"IxNextgen.assign_ports" creates and assigns the virtual ports for each
physical port defined in the test case.

"IxNextgen.create_traffic_item" creates one traffic item and two flow
groups per pair of ports, in both directions.

"IxNextgen.gt_statistics" retrieves only the required statistics to
generate the samples blob in the traffic generator.

JIRA: YARDSTICK-1116

Change-Id: I8f1c0c55e99c274b2ed8276ed9a385c502e16d93
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit ee721fd3e8b77ccfe4252a107a9af8dc41ccc389)

Merge "Add active wait function" into stable/fraser

Merge "Add IxNetwork API Python Binding package" into stable/fraser

Merge "Use TRex release v2.41 to support both x86 and aarch64" into stable/fraser

Add active wait function

Added function "wait_until_true". This function will make an active
wait until the predicate passed as an argument returns True.

If the timeout expires, the function will raise a generic exception
or a user defined one passed as an argument.

This function will be used in YARDSTICK-1127.

JIRA: YARDSTICK-1128

Change-Id: I9854e465ac6b586bf4be39ab4b266d5625b39e30
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from 099108aab37d1fae1b27f4e2e20136c234df1a52)

Add IxNetwork API Python Binding package

Add IxNetwork python package to the requirements list.

This module is needed for the "NSPerf" scenarios using IXIA as traffic
generator, when IxNetwork is the program used to handle the IXIA
generator.

The latest version of this module is 8.40.1124.9 [1]. The license type
is MIT.

[1] https://pypi.python.org/pypi/ixnetwork

JIRA: YARDSTICK-1106

Change-Id: I279933c95994f5120930256a104c4192a0b9900d
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Merge "Configure ACL via static file" into stable/fraser

Merge "Move tests: unit/network_services/traffic_profile" into stable/fraser

Merge "Cleanup BaseMonitor unit tests" into stable/fraser

Move tests: unit/network_services/traffic_profile

* Fix pylint errors
* Add TODOs

Some errors are ignored locally, as they were a symptom of other problems.
These issues have been flagged with a TODO, and should be fixed later.

JIRA: YARDSTICK-837
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: Id983a2e415d66633331e7fea96a377e2a7589980
(cherry-picked from commit cfc40ad1bb36889e54bc99cb779cfcfa1f3b04dd)

Merge "MQ startup process refactor" into stable/fraser

Merge "Add "host_name_separator" variable to Context class" into stable/fraser

Merge "Move IncorrectConfig, IncorrectSetup and IncorrectNodeSetup to exceptions" into stable/fraser

Use TRex release v2.41 to support both x86 and aarch64

Currently Yardstick uses Cisco's TRex release v2.28 which
can only support x86, for the consideration of
multi-arch support of Yardstick, the trex release v2.41
is now available and it can support multi-arch(both x86
and aarch64) now.

For the external lib of v2.41, for x86_64, it looks like:
external_libs/pyzmq-14.5.0/python2/intel/ucs4/64bit/zmq
for arm64, it looks like:
external_libs/pyzmq-14.5.0/python2/arm/ucs4/64bit/zmq
So replace the trex release v2.28 with v2.41.

JIRA: YARDSTICK-1191

Change-Id: I22dc3499283d48a89da1145cc480fd7d2a93a1cc
Signed-off-by: trevortao <trevor.tao@arm.com>
(cherry picked from commit 13f19d35a04ffb46ca673e81385779bc46c48781)

Configure ACL via static file

This patch allows user to configure ACL/vFW SampleVNF ACL
via configuration file provided in TC definition. The
Yardstick applies the rules to SampleVNF from specified config
file + rules generated by Yardstick (default rules).

The example of SampleVNF ACL CLI commands generated/applied
by Yardstick can be found at (using default ACL config file):

ACL VNF ACL CLI commands:
  acl/tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex.yaml
  http://paste.openstack.org/show/723303/

vFW VNF ACL CLI commands:
  vfw/tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex.yaml
  http://paste.openstack.org/show/723304/

Change-Id: I76a630261a982083b628e3985fc3bec14ca495db
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
(cherry picked from commit 3fdca97ff5053770161059a34a95fd39463eaecd)

MQ startup process refactor

JIRA: YARDSTICK-1112

Change-Id: Id30236e190bae9fb0f5b5ebd4c5e04798e4fd443
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
(cherry picked from commit d38bd854fb2c3eb6c0c4dd34ace2a52af7cf892d)

Merge "Do not start collectd twice when SampleVNF is running on Baremetal" into stable/fraser

Add scale out TCs with availability zone support

Add PROX and vFW scale out TCs with availability zone
configuration. To be able to specify the availability
zone for specific VNF or TG the following example of
command line option shoud be used:

  yardstick -d task start --task-args='{
    "num_vnfs": 2, "availability_zone":
     {
      "vnf_0": "az_0", "tg_0": "az_0",
      "vnf_1": "az_1", "tg_1": "az_1",
      ... }}' <SCALE-OUT-TC-FILE>

The steps to run new scale-out TCs is documented in the
userguide.

JIRA: YARDSTICK-1203

Change-Id: Ib3878485c5483981fe9b48ab02995712bcc31ae5
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
(cherry picked from commit 0156b5c37e08f91a37dda08edb854758bbba7413)

Merge "Add --hwlb options as a command line argument for SampleVNF" into stable/fraser

Standalone XML machine type is not longer valid

Current XML machine type definition [1] is not longer valid. According to
[2], the default machine type should be "pc-i440fx-xenial".

NOTE: StandAlone physical nodes are deployed using Ubuntu OS.

[1]https://github.com/opnfv/yardstick/blob/master/yardstick/benchmark/contexts/standalone/model.py#L48
[2]https://wiki.ubuntu.com/QemuKVMMigration#Upgrade_machine_type

JIRA: YARDSTICK-1192

Change-Id: I77b1379aaf416b1225e91af2c3ac746cb101f774
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit 6414a61a988a73ee1b939e2d5de2f0afdde4319a)

Move IncorrectConfig, IncorrectSetup and IncorrectNodeSetup to exceptions

JIRA: YARDSTICK-1218

Change-Id: I804065e9bce3e728f5bf9e756a78df8fd28f74ac
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit dc0e675f47f4dbf1b54ce9c22878e2e876bc26e8)

Move ErrorClass definition to exceptions module

JIRA: YARDSTICK-1216

Change-Id: I82556e1d1b0c723221a58e188067cbce560b8338
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit 2bdda85878ed1507d1a91f69c3489bb9ba9d447d)

Merge "Convert SSH custom exceptions to Yardstick exceptions" into stable/fraser

Merge "Remove AnsibleCommon class method mock" into stable/fraser

Merge "Error when adding SR-IOV interfaces in SR-IOV context" into stable/fraser

Merge "Remove __init__ method overriding in HeatContextTestCase" into stable/fraser

Merge "Bump oslo.messaging version to 5.36.0" into stable/fraser

Merge "Set "cmd2" library to version 0.8.6" into stable/fraser

Error when adding SR-IOV interfaces in SR-IOV context

Method "add_sriov_interfaces" in Libvirt class throws an error when trying
to add SR-IOV interfaces in the XML file.

Function "setup_sriov_context" in SriovContext if passing to
"_enable_interfaces" method the XML file name instead of passing the XML
string.

JIRA: YARDSTICK-1189

Change-Id: If021c102311ecb98cb26934f78067dfc720e4291
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit 72df0eaac4a2a1f23439af7f249c2b5d18d1b819)

Remove __init__ method overriding in HeatContextTestCase

Unit test case clases should implement setUp() method instead of overriding
__init__() method.

JIRA: YARDSTICK-1210

Change-Id: I0f9a10575f9aeebf76dfa84619e59589b3ea83f6
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit 619bed631f064a94ab20ac296802d467ebe32318)

Correctly set PYTHONPATH in Dockerfile

JIRA: YARDSTICK-1144

Change-Id: I8c0fe229ed620417a85356e017b171260373c43f
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
(cherry picked from commit a114dc39f003beb1bb1ed12ed17fd3a6d0e7deaa)

Document for Fraser test case results

JIRA: YARDSTICK-1132

In B and C releases, Yardstick provides an overview of the results of test cases developed by Yardstick, executed on OPNFV community labs.

This work has not been done for the D and E releases, although result analysis for Euphrates is available at (https://wiki.opnfv.org/display/yardstick/Euphrates+release+test+results+analysis). We plan to restart to provide a basic test case results analysis for Fraser and compare performance data with Euphrates.

This JIRA ticket will be resolved into 3 commits: 1. Document for E release test case data; 2. Document for F release test case data; 3. Document for results analysis.

Change-Id: I3c59851c8878ba37145e6ad6958272a62bad3f52
Signed-off-by: JingLu5 <lvjing5@huawei.com>
(cherry picked from commit 3f0df920c71529024a69ad65c2bebabbcbde6022)