yardstick.git
5 years agoAdd "restartPolicy" parameter in Kubernetes policy 03/57403/9
John O Loughlin [Tue, 15 May 2018 15:20:33 +0000 (16:20 +0100)]
Add "restartPolicy" parameter in Kubernetes policy

This new parameter, "restartPolicy", will allow define the restart policy per pod.

Example of yaml definition in Kubernetes:
apiVersion: v1
kind: Pod
metadata:
  name: frontend
spec:
  containers:
    - name: db
      ...
  restartPolicy: Always  # Possible values: "Always", "OnFailure" and "Never"

Example of definition in a Yardstick context:
context:
  type: Kubernetes
    servers:
      host:
        containers:
          - name: ...
        restartPolicy: Always  # Default value: "Always"

Restart policy [1].
[1] https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle/#restart-policy

JIRA: YARDSTICK-1175

Change-Id: Id4317b909f98422e89d6d4553e8cfb0e1f593355
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoMerge "Add "resources" parameter in Kubernetes context"
Rodolfo Alonso Hernandez [Tue, 10 Jul 2018 09:23:29 +0000 (09:23 +0000)]
Merge "Add "resources" parameter in Kubernetes context"

5 years agoMerge "Add send socket commands function"
Rodolfo Alonso Hernandez [Tue, 10 Jul 2018 07:48:43 +0000 (07:48 +0000)]
Merge "Add send socket commands function"

5 years agoFix IXIA IxNetwork IMIX configuration 13/59613/1
Rodolfo Alonso Hernandez [Mon, 9 Jul 2018 11:06:55 +0000 (12:06 +0100)]
Fix IXIA IxNetwork IMIX configuration

IxNet library is not setting correctly the IMIX definition per traffic
item. The correct input for "weightedRangePairs" parameter is:

  [[64, 64, 10], [128, 128, 15], [512, 512, 5]]

JIRA: YARDSTICK-1296

Change-Id: Idb4034ce817250da5b9a434230b1be6dae0d3ba3
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
5 years agoMerge changes from topics 'YARDSTICK-1286', 'YARDSTICK-1127'
Rodolfo Alonso Hernandez [Mon, 9 Jul 2018 07:07:57 +0000 (07:07 +0000)]
Merge changes from topics 'YARDSTICK-1286', 'YARDSTICK-1127'

* changes:
  Make "IterationIPC" MQ producer for VNF control messages
  Enable traffic generator PID in "NSPerf" scenario setup
  Enable the MQ producer in "SampleVNFTrafficGen" class
  Add "TrafficGeneratorProducer" for "GenericTrafficGen" instances
  Add "IterationIPC" runner

5 years agoAdd "resources" parameter in Kubernetes context 93/57393/4
John O Loughlin [Tue, 15 May 2018 10:43:05 +0000 (11:43 +0100)]
Add "resources" parameter in Kubernetes context

This new parameter, "resources", will allow the user to automatically
add resources in a pod definition per container.

Example of yaml definition in Kubernetes:
apiVersion: v1
kind: Pod
metadata:
  name: frontend
spec:
  containers:
    - name: db
      image: mysql
      resources:
        requests:
          memory: "64Mi"
          cpu: "250m"
        limits:
          memory: "128Mi"
          cpu: "500m"

Example of definition in a Yardstick context:
context:
  type: Kubernetes
    servers:
        host:
            resources:    # There are two possible keys in this dict:
                          # "requests" and "limits".
              limits: <dictionary>
              requests: <dictionary>

Resources in containers [1].

[1] https://kubernetes.io/docs/concepts/configuration/manage-compute-resources-container/

JIRA:YARDSTICK-1171

Change-Id: I163d72d9d3e88b538fca73eb4dbf38613aa23ff4
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoAdd "env" parameter in Kubernetes context 47/57347/5
John O Loughlin [Fri, 11 May 2018 17:09:54 +0000 (18:09 +0100)]
Add "env" parameter in Kubernetes context

This new parameter, "env", will allow the user to
automatically to add environment variables in a pod definition

Example of definition in a context:
  context:
    type: Kubernetes
      servers:
        host:
            image: ...
            commands: ...
            env:
                - <variable name>: <variable value>
                - <variable name>: <variable value>

The volume type and the definition must be one of the supported
ones in Kubernetes [1].

[1] https://kubernetes.io/docs/concepts/storage/volumes/#types-of-volumes

JIRA: YARDSTICK-1161

Change-Id: Icf372a98c090063f10c9217755519ab92ba9b0ba
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoMerge "Create user defined "NodePort" services per pod"
Rodolfo Alonso Hernandez [Fri, 6 Jul 2018 09:00:54 +0000 (09:00 +0000)]
Merge "Create user defined "NodePort" services per pod"

5 years agoMerge "Change "KubernetesObject" class name to "ReplicationController""
Rodolfo Alonso Hernandez [Fri, 6 Jul 2018 09:00:42 +0000 (09:00 +0000)]
Merge "Change "KubernetesObject" class name to "ReplicationController""

5 years agoMerge "Specify the networks to be used per pod"
Rodolfo Alonso Hernandez [Fri, 6 Jul 2018 09:00:32 +0000 (09:00 +0000)]
Merge "Specify the networks to be used per pod"

5 years agoMerge "Add new Kubernetes resource kind: "Network""
Rodolfo Alonso Hernandez [Fri, 6 Jul 2018 09:00:20 +0000 (09:00 +0000)]
Merge "Add new Kubernetes resource kind: "Network""

5 years agoMerge "Add new Kubernetes resource kind: "CustomResourceDefinition""
Rodolfo Alonso Hernandez [Fri, 6 Jul 2018 09:00:09 +0000 (09:00 +0000)]
Merge "Add new Kubernetes resource kind: "CustomResourceDefinition""

5 years agoMerge "Add "securityContext" parameter in Kubernetes context"
Rodolfo Alonso Hernandez [Fri, 6 Jul 2018 09:00:03 +0000 (09:00 +0000)]
Merge "Add "securityContext" parameter in Kubernetes context"

5 years agoMerge "[Bug fix] Execute teardown if SLA is set to "assert""
Rex Lee [Fri, 6 Jul 2018 06:45:01 +0000 (06:45 +0000)]
Merge "[Bug fix] Execute teardown if SLA is set to "assert""

5 years ago[Bug fix] Execute teardown if SLA is set to "assert" 41/59541/2
Dimitrios Markou [Wed, 4 Jul 2018 08:49:54 +0000 (11:49 +0300)]
[Bug fix] Execute teardown if SLA is set to "assert"

In Duration runner if SLA is set to "assert" and a SLAValidationError
happens then a teardown is needed to avoid garbages in the environment.

JIRA: YARDSTICK-1291

Change-Id: I9056b0da3e7e496171ed42430ffc340b5c68f108
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
5 years agoMerge "Remove TRex installer from ansible directory"
Rodolfo Alonso Hernandez [Thu, 5 Jul 2018 12:55:16 +0000 (12:55 +0000)]
Merge "Remove TRex installer from ansible directory"

5 years agoMerge "Fix vCGNAPT name in ansible constants"
Rodolfo Alonso Hernandez [Thu, 5 Jul 2018 08:00:29 +0000 (08:00 +0000)]
Merge "Fix vCGNAPT name in ansible constants"

5 years agoMerge "vPE Sample VNF is missing in the installation scripts"
Rodolfo Alonso Hernandez [Thu, 5 Jul 2018 08:00:24 +0000 (08:00 +0000)]
Merge "vPE Sample VNF is missing in the installation scripts"

5 years agoMerge "Move "read_yaml_file" to common.yaml_loader"
Rodolfo Alonso Hernandez [Thu, 5 Jul 2018 08:00:09 +0000 (08:00 +0000)]
Merge "Move "read_yaml_file" to common.yaml_loader"

5 years agoMake "IterationIPC" MQ producer for VNF control messages 89/59489/6
Rodolfo Alonso Hernandez [Tue, 3 Jul 2018 08:14:35 +0000 (09:14 +0100)]
Make "IterationIPC" MQ producer for VNF control messages

"IterationIPC" runner class is a consumer for MQ aware VNFs. A MQ aware
traffic generator can send "started", "finished" and "iteration"
messages.

This feature implements a MQ producer in the runner in order to send
messages to the VNFs. The messages implemented are:
  - "start_iteration"
  - "stop_iteration"

JIRA: YARDSTICK-1286

Change-Id: I706f9a9dda5e5beed52231be7d71452945a7dbed
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
5 years agoMerge "Cleanup TestProxSocketHelper unit tests"
Rodolfo Alonso Hernandez [Thu, 5 Jul 2018 07:54:25 +0000 (07:54 +0000)]
Merge "Cleanup TestProxSocketHelper unit tests"

5 years agoMerge "Cleanup OvsDpdkContextTestCase unit tests"
Rodolfo Alonso Hernandez [Thu, 5 Jul 2018 07:54:12 +0000 (07:54 +0000)]
Merge "Cleanup OvsDpdkContextTestCase unit tests"

5 years agoRemove TRex installer from ansible directory 71/58871/2
Rodolfo Alonso Hernandez [Thu, 21 Jun 2018 14:36:16 +0000 (15:36 +0100)]
Remove TRex installer from ansible directory

Standalone TRex installer script is not updated or maintained.
TRex is installed in Jumphost and the physical nodes using the
installer script. There is no need to keep this script anymore.

JIRA: YARDSTICK-1251

Change-Id: I3af62e70e244d2277a980a1ca6b8079597621a62
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
5 years agoMerge "Cleanup ScenarioGeneral unit tests"
Rodolfo Alonso Hernandez [Thu, 5 Jul 2018 07:52:53 +0000 (07:52 +0000)]
Merge "Cleanup ScenarioGeneral unit tests"

5 years agoEnable traffic generator PID in "NSPerf" scenario setup 35/56335/32
Rodolfo Alonso Hernandez [Tue, 24 Apr 2018 09:35:50 +0000 (10:35 +0100)]
Enable traffic generator PID in "NSPerf" scenario setup

Now "NSPerf" scenario will inform about the traffic generator PIDs after
setup process. With this information, IterationIPC runner will be able
to receive the messages sent by those traffic generators and control
the main iteration loop.

The following example, using vFW as VNF and OpenStack as context, makes
use of this new runner implementation:
  /samples/vnf_samples/nsut/vfw/
    tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex_iterationipc.yaml

JIRA: YARDSTICK-1127

Change-Id: I46b1368bc209680b88ff9fb5c3b9beadf6271ac9
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
5 years agoEnable the MQ producer in "SampleVNFTrafficGen" class 81/56281/23
Rodolfo Alonso Hernandez [Mon, 23 Apr 2018 16:06:25 +0000 (17:06 +0100)]
Enable the MQ producer in "SampleVNFTrafficGen" class

Now all traffic generators using the default implementation of
"ClientResourceHelper.run_traffic" will update the status of
the traffic injection using the MQ.

The available methods are listed in common.messsaging (VNF_METHOD_*):
- tg_method_started: VNF app started
- tg_method_finished: VNF app finished
- tg_method_iteration: VNF app execution loop started

JIRA: YARDSTICK-1127

Change-Id: I12829e1762fc20cc95da3b50767a66f031e25ee8
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
5 years agoAdd "TrafficGeneratorProducer" for "GenericTrafficGen" instances 21/56221/25
Rodolfo Alonso Hernandez [Sun, 22 Apr 2018 18:52:49 +0000 (19:52 +0100)]
Add "TrafficGeneratorProducer" for "GenericTrafficGen" instances

Added "TrafficGeneratorProducer" class, a message producer specific for
"GenericTrafficGen" derived classes.

JIRA: YARDSTICK-1127

Change-Id: Icc87a6920155612e759a1d4d2f29028940c2e040
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
5 years agoAdd "IterationIPC" runner 19/56219/28
Rodolfo Alonso Hernandez [Fri, 20 Apr 2018 10:34:41 +0000 (11:34 +0100)]
Add "IterationIPC" runner

"IterationIPC" is a runner that runs a configurable number of times before
it returns. Each iteration has a configurable timeout. The loop control
depends on the feedback received from the running VNFs. The context PIDs
from the VNFs to listen the messages from are given in the scenario
"setup" method.

The MQ consumer, "RunnerIterationIPCConsumer", is subscribed to messages
sent to topic "messaging.TOPIC_TG". The endpoints are defined in the
class "RunnerIterationIPCEndpoint". Three are implemented:
"messaging.TG_METHOD_STARTED", "messaging.TG_METHOD_FINISHED" and
"messaging.TG_METHOD_ITERATION".

JIRA: YARDSTICK-1127

Change-Id: I4b2f11a15ef41e6f3c70bd64188d5c7fbcdb7eed
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
5 years agoMerge "Bump requirements to match OpenStack Queens release upper requirements"
Rex Lee [Thu, 5 Jul 2018 07:37:43 +0000 (07:37 +0000)]
Merge "Bump requirements to match OpenStack Queens release upper requirements"

5 years agoCleanup ActionTestCase unit tests 99/59499/5
Rodolfo Alonso Hernandez [Tue, 3 Jul 2018 16:05:38 +0000 (17:05 +0100)]
Cleanup ActionTestCase unit tests

Removed unneeded output and applied the correct mocks.

JIRA: YARDSTICK-1290

Change-Id: Ib8dbf582d81f7de0fadce7ddb215360abb2d16a4
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
5 years agoMerge "DPDK site change"
Abhijit Sinha [Wed, 4 Jul 2018 15:05:27 +0000 (15:05 +0000)]
Merge "DPDK site change"

5 years agoMerge "Fix up formatting on devguide"
Rodolfo Alonso Hernandez [Wed, 4 Jul 2018 10:24:38 +0000 (10:24 +0000)]
Merge "Fix up formatting on devguide"

5 years agoBump requirements to match OpenStack Queens release upper requirements 79/59479/3
rexlee8776 [Tue, 3 Jul 2018 02:16:21 +0000 (02:16 +0000)]
Bump requirements to match OpenStack Queens release upper requirements

tox -e os-requiremnts results:
Validating requirements file "requirements.txt"
Package "oslo.config" version 4.11.1 outdated, minimum version 5.1.0
Package "keystoneauth1" version 3.1.0 outdated, minimum version 3.3.0
Package "python-cinderclient" version 3.1.0 outdated, minimum version 3.3.0
Package "requests" version 2.11.1 outdated, minimum version 2.14.2
Package "osc-lib" version 1.7.0 outdated, minimum version 1.8.0
Package "oslo.utils" version 3.28.0 outdated, minimum version 3.33.0
Package "oslo.privsep" version 1.22.1 outdated, minimum version 1.23.0
Incompatible requirement found!

JIRA: YARDSTICK-1283

Change-Id: I362c1e2b5c61abf09810ce2a2fe6bab39097d017
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
5 years agoMerge "IXIA IxNetwork TP first rate is not populated"
Rodolfo Alonso Hernandez [Wed, 4 Jul 2018 09:13:31 +0000 (09:13 +0000)]
Merge "IXIA IxNetwork TP first rate is not populated"

5 years agoMerge "Sample VNF version need to be updated to Fraser"
Rodolfo Alonso Hernandez [Wed, 4 Jul 2018 06:58:58 +0000 (06:58 +0000)]
Merge "Sample VNF version need to be updated to Fraser"

5 years agoMerge changes from topics 'YARDSTICK-1250', 'YARDSTICK-1249'
Rodolfo Alonso Hernandez [Tue, 3 Jul 2018 16:33:17 +0000 (16:33 +0000)]
Merge changes from topics 'YARDSTICK-1250', 'YARDSTICK-1249'

* changes:
  Fix pip install issues in install.yaml script
  Bump ansible version to 2.5.5

5 years agoIXIA IxNetwork TP first rate is not populated 95/59495/2
Rodolfo Alonso Hernandez [Tue, 3 Jul 2018 14:47:42 +0000 (15:47 +0100)]
IXIA IxNetwork TP first rate is not populated

IXIA IxNetwork traffic profile defines an initial injection frame rate
for RFC2544 test cases:
  schema: "isb:traffic_profile:0.1"
  traffic_profile:
    frame_rate : 20000

This value should be assigned to IXIARFC2544Profile.rate before the
initial injection period.

JIRA: YARDSTICK-1288

Change-Id: I29a334c7dbb863f680e45a1d3ab880aaf1fe166d
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
5 years agoMerge "Cleanup Iperf3 unit tests"
Rodolfo Alonso Hernandez [Tue, 3 Jul 2018 16:32:19 +0000 (16:32 +0000)]
Merge "Cleanup Iperf3 unit tests"

5 years agoMerge "Cleanup Plugin unit tests"
Rodolfo Alonso Hernandez [Tue, 3 Jul 2018 16:32:14 +0000 (16:32 +0000)]
Merge "Cleanup Plugin unit tests"

5 years agoMerge "Cleanup NodeContextTestCase unit tests"
Rodolfo Alonso Hernandez [Tue, 3 Jul 2018 16:32:09 +0000 (16:32 +0000)]
Merge "Cleanup NodeContextTestCase unit tests"

5 years agoMerge "Cleanup vPE VNF unit tests"
Rodolfo Alonso Hernandez [Tue, 3 Jul 2018 16:24:36 +0000 (16:24 +0000)]
Merge "Cleanup vPE VNF unit tests"

5 years agoMerge "Cleanup TestIxLoadTrafficGen unit tests"
Rodolfo Alonso Hernandez [Tue, 3 Jul 2018 16:24:29 +0000 (16:24 +0000)]
Merge "Cleanup TestIxLoadTrafficGen unit tests"

5 years agoMerge "Cleanup GetDataDbClientTestCase unit tests"
Rodolfo Alonso Hernandez [Tue, 3 Jul 2018 16:24:24 +0000 (16:24 +0000)]
Merge "Cleanup GetDataDbClientTestCase unit tests"

5 years agoMerge "Cleanup VsperfDPDKTestCase unit tests"
Rodolfo Alonso Hernandez [Tue, 3 Jul 2018 16:24:20 +0000 (16:24 +0000)]
Merge "Cleanup VsperfDPDKTestCase unit tests"

5 years agoSample VNF version need to be updated to Fraser 97/59497/1
Rodolfo Alonso Hernandez [Tue, 3 Jul 2018 14:54:25 +0000 (15:54 +0100)]
Sample VNF version need to be updated to Fraser

JIRA: YARDSTICK-1289

Change-Id: Ib150fafdfcc7a7aa09e4ed9c683fc3013676dac4
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
5 years agoCleanup TestProxSocketHelper unit tests 33/59433/1
Rodolfo Alonso Hernandez [Mon, 2 Jul 2018 12:55:25 +0000 (13:55 +0100)]
Cleanup TestProxSocketHelper unit tests

Removed unneeded output.

JIRA: YARDSTICK-1284

Change-Id: I41d9b8d2df417fa19b0a6f8c13bc9837dc3dde95
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
5 years agoMerge "Cleanup TestProxBinSearchProfile unit tests"
Rodolfo Alonso Hernandez [Mon, 2 Jul 2018 10:01:25 +0000 (10:01 +0000)]
Merge "Cleanup TestProxBinSearchProfile unit tests"

5 years agoMerge "Cleanup ProxDuration unit tests"
Rodolfo Alonso Hernandez [Mon, 2 Jul 2018 10:00:51 +0000 (10:00 +0000)]
Merge "Cleanup ProxDuration unit tests"

5 years agoMerge "Yardstick Fraser Release notes - 6.2.1"
Rex Lee [Sun, 1 Jul 2018 19:13:57 +0000 (19:13 +0000)]
Merge "Yardstick Fraser Release notes - 6.2.1"

5 years agoYardstick Fraser Release notes - 6.2.1 11/59411/2
rexlee8776 [Sat, 30 Jun 2018 07:37:08 +0000 (07:37 +0000)]
Yardstick Fraser Release notes - 6.2.1

JIRA: YARDSTICK-1278

Change-Id: I96d54b06f0ef794c9c0ec26d78eb54ebcc6462ed
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
5 years agoMerge "Bugfix: ansible install.yaml missing configure_gui step"
Rex Lee [Sun, 1 Jul 2018 04:33:46 +0000 (04:33 +0000)]
Merge "Bugfix: ansible install.yaml missing configure_gui step"

5 years agoBugfix: ansible install.yaml missing configure_gui step 99/59399/1
rexlee8776 [Sun, 1 Jul 2018 04:07:35 +0000 (04:07 +0000)]
Bugfix: ansible install.yaml missing configure_gui step

JIRA: YARDSTICK-1279

Change-Id: I7df97479e2e17495668ef4982de4aec13d04c25c
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
5 years agoBugfix: uwsgi config file yardstick.ini output error 97/59397/1
rexlee8776 [Sun, 1 Jul 2018 04:02:52 +0000 (04:02 +0000)]
Bugfix: uwsgi config file yardstick.ini output error

JIRA: YARDSTICK-1280

Change-Id: I45b4b781cee21035897ba0c34dc740af6365e918
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
5 years agoBugfix: docker build failed 85/59385/1
rexlee8776 [Sat, 30 Jun 2018 04:23:27 +0000 (04:23 +0000)]
Bugfix: docker build failed

Due to no inventory.ini specified in Dockerfile, which
resulsts in ansible-playbook run fail

JIRA: YARDSTICK-1277

Change-Id: Iaf689b71b8c86b54b2451d8a8c480f7d94d53561
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
6 years agoCleanup Iperf3 unit tests 71/59371/1
Rodolfo Alonso Hernandez [Fri, 29 Jun 2018 16:58:54 +0000 (17:58 +0100)]
Cleanup Iperf3 unit tests

Removed unneeded output.

JIRA: YARDSTICK-1275

Change-Id: I75fe1f7f048714ba5d2fdfa586ad69ebb7b56c88
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoCleanup Plugin unit tests 69/59369/1
Rodolfo Alonso Hernandez [Fri, 29 Jun 2018 16:45:47 +0000 (17:45 +0100)]
Cleanup Plugin unit tests

Removed unneeded output (LOG.info and print functions).

JIRA: YARDSTICK-1274

Change-Id: Ida3b62ce28e27058a8b4a3a9e6fa16f041a1f99c
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoCleanup NodeContextTestCase unit tests 67/59367/1
Rodolfo Alonso Hernandez [Fri, 29 Jun 2018 16:35:48 +0000 (17:35 +0100)]
Cleanup NodeContextTestCase unit tests

Removed deprecated functions.

JIRA: YARDSTICK-1273

Change-Id: I055b8393e6b25eb08f718cd8a915c6ea684786d8
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoMerge "Update PROX_NSB_DEVGUIDE for F Release"
Rodolfo Alonso Hernandez [Fri, 29 Jun 2018 16:18:34 +0000 (16:18 +0000)]
Merge "Update PROX_NSB_DEVGUIDE for F Release"

6 years agoMerge "Yardstick Fraser Release notes - 6.2.0"
Rex Lee [Fri, 29 Jun 2018 15:33:02 +0000 (15:33 +0000)]
Merge "Yardstick Fraser Release notes - 6.2.0"

6 years agoCleanup vPE VNF unit tests 37/59337/2
Rodolfo Alonso Hernandez [Fri, 29 Jun 2018 13:36:22 +0000 (14:36 +0100)]
Cleanup vPE VNF unit tests

Removed unneeded output and stopped access to file system.

JIRA: YARDSTICK-1271

Change-Id: I15a58eb7bb81b69fe156433055f59a54372fa0a8
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoCleanup TestIxLoadTrafficGen unit tests 25/59325/2
Rodolfo Alonso Hernandez [Fri, 29 Jun 2018 11:37:00 +0000 (12:37 +0100)]
Cleanup TestIxLoadTrafficGen unit tests

Removed unneeded output and mock system calls.

JIRA: YARDSTICK-1270

Change-Id: I0e04a67cab592216280481c7145188c4f9045466
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoCleanup GetDataDbClientTestCase unit tests 21/59321/2
Rodolfo Alonso Hernandez [Fri, 29 Jun 2018 11:01:31 +0000 (12:01 +0100)]
Cleanup GetDataDbClientTestCase unit tests

Removed unneeded output.

JIRA: YARDSTICK-1268

Change-Id: I2e9130e863ba915feeb52f54fc901898b1c8f792
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoCleanup VsperfDPDKTestCase unit tests 19/59319/2
Rodolfo Alonso Hernandez [Fri, 29 Jun 2018 10:37:42 +0000 (11:37 +0100)]
Cleanup VsperfDPDKTestCase unit tests

Removed unneeded output.

JIRA: YARDSTICK-1267

Change-Id: I0a3f25db2c5ef8ed71fd087b6b35641075c121e7
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoCleanup TestProxBinSearchProfile unit tests 15/59315/2
Rodolfo Alonso Hernandez [Fri, 29 Jun 2018 10:29:34 +0000 (11:29 +0100)]
Cleanup TestProxBinSearchProfile unit tests

Removed unneeded output and mocks.

JIRA: YARDSTICK-1266

Change-Id: I04fd1ba32ea46c7896548faebc5af1a43b0f750e
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoNFVI support for standalone, baremetal and heat contexts 35/58035/18
Chornyi, TarasX [Tue, 29 May 2018 14:59:49 +0000 (17:59 +0300)]
NFVI support for standalone, baremetal and heat contexts

JIRA: YARDSTICK-1257

Change-Id: I6733bd49ac91985e8f3d7722e6990e8733bb430e
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
6 years agoUpdate PROX_NSB_DEVGUIDE for F Release 27/59327/8
DanielMartinBuckley [Fri, 29 Jun 2018 12:19:57 +0000 (13:19 +0100)]
Update PROX_NSB_DEVGUIDE for F Release

Contains Updates :-
   New Description of Grafana output
   New Description of ProxDuration Runner
   Update Description of Openstack Network

Change-Id: I861bb7eab4aeed207c0151be6766c48c5f10c6ef
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
6 years agoMove "read_yaml_file" to common.yaml_loader 13/59313/3
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 16:17:08 +0000 (17:17 +0100)]
Move "read_yaml_file" to common.yaml_loader

JIRA: YARDSTICK-1265

Change-Id: Ic2813dca7fc9a3230632f6e8bd75aeacc7e951b0
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoFix up formatting on devguide 11/58911/2
Emma Foley [Fri, 22 Jun 2018 10:36:11 +0000 (10:36 +0000)]
Fix up formatting on devguide

* Change the notation used for heading levels and
  add a key at the top of the file.
* Wrap lines at 80 characters.
* Highlight keywords

Change-Id: Ic6e7194270bbffb3ddaf688c774b632287b0c201
JIRA: YARDSTICK-1253
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
6 years agoMerge "Removed unused ACL config file."
Rodolfo Alonso Hernandez [Fri, 29 Jun 2018 08:21:57 +0000 (08:21 +0000)]
Merge "Removed unused ACL config file."

6 years agoYardstick Fraser Release notes - 6.2.0 69/59169/6
rexlee8776 [Thu, 28 Jun 2018 03:31:03 +0000 (03:31 +0000)]
Yardstick Fraser Release notes - 6.2.0

JIRA: YARDSTICK-1261

Change-Id: I61adeaea8a727605481ffce9dae9646f160bf401
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
6 years agoMerge "Add testsuite "os-odl-ovs-noha""
Rex Lee [Fri, 29 Jun 2018 01:47:01 +0000 (01:47 +0000)]
Merge "Add testsuite "os-odl-ovs-noha""

6 years agoCleanup OvsDpdkContextTestCase unit tests 13/59213/1
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 16:06:12 +0000 (17:06 +0100)]
Cleanup OvsDpdkContextTestCase unit tests

Removed unneeded output.

JIRA: YARDSTICK-1264

Change-Id: Ic804d5ebd5bc1c0fc8c98c058e8dd76a9ea565fa
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoCleanup ScenarioGeneral unit tests 11/59211/1
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 16:00:25 +0000 (17:00 +0100)]
Cleanup ScenarioGeneral unit tests

Removed unneeded output.

JIRA: YARDSTICK-1263

Change-Id: I2ca738a7234cfffb3fd3d3e9566ad043b2d132dc
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoMerge "Cleanup process test cases"
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 15:56:08 +0000 (15:56 +0000)]
Merge "Cleanup process test cases"

6 years agoMerge "Cleanup OpenStack utils test cases"
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 15:55:59 +0000 (15:55 +0000)]
Merge "Cleanup OpenStack utils test cases"

6 years agoDecrease Sampling interval - Invalid Port results 01/59201/1
DanielMartinBuckley [Thu, 28 Jun 2018 13:51:09 +0000 (14:51 +0100)]
Decrease Sampling interval - Invalid Port results

JIRA: YARDSTICK-1219

The computed in/fwd throughputs displayed on the L2FWD,
L3FWD and VPE dashboards. The computed value is likely
4x the expected value.

It is required to return sampling information form Generator AND VNF at
least every  1 second.

Change-Id: I4435fd05ba3116ead836843a4c2fce133b767a28
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
6 years agoCleanup ProxDuration unit tests 89/59189/3
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 08:18:23 +0000 (09:18 +0100)]
Cleanup ProxDuration unit tests

Removed unneeded output, removed access to files, fixed indentation,
bumped deprecated asserts, reduced time execution and fixed file header.

JIRA: YARDSTICK-1262

Change-Id: I4803980748d4731cc27608e386707a858e1a8630
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoRemoved unused ACL config file. 59/59159/1
Mytnyk, Volodymyr [Wed, 27 Jun 2018 19:13:19 +0000 (20:13 +0100)]
Removed unused ACL config file.

Change-Id: Ibdb1dd12587df0182b5e8d3b7bc6901be0aac3ec
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
6 years agoMerge "Update to Grafana Dashboard for NSB PROX NFVI"
Abhijit Sinha [Wed, 27 Jun 2018 18:47:40 +0000 (18:47 +0000)]
Merge "Update to Grafana Dashboard for NSB PROX NFVI"

6 years agoMerge "NSB NFVi PROX BNG losing many packets"
Abhijit Sinha [Wed, 27 Jun 2018 18:47:35 +0000 (18:47 +0000)]
Merge "NSB NFVi PROX BNG losing many packets"

6 years agoNSB NFVi PROX BNG losing many packets 31/58731/9
DanielMartinBuckley [Tue, 19 Jun 2018 15:43:41 +0000 (16:43 +0100)]
NSB NFVi PROX BNG losing many packets

JIRA: YARDSTICK-1101

Problem was incorrect generator and changed the traffic profile to allow
a tolerated loss of 5%.

ARP packets are not managed (just passed thru the system) therefor the
tolerated loss must be higehr than normal.

Change-Id: I03bd62b397a66b50961e810d033c6894d0b3e9a6
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
6 years agoUpdate to Grafana Dashboard for NSB PROX NFVI 47/59147/1
DanielMartinBuckley [Wed, 27 Jun 2018 16:47:33 +0000 (17:47 +0100)]
Update to Grafana Dashboard for NSB PROX NFVI

JIRA: YARDSTICK-1252

CPU grouping in grafana for better representation
Throughput table is difficult to read as the tests
  run longer the values can overlap
Default time in dashboard should be always last 1hour in
  dashboard (auto refresh can be also checked)
Add one column in table with Gbps throughput (Rx
  Throughput) plus code change in yardstick
Boxes are not aligned and big and small, need to be fixed
  boxes are now aligned,
Added Seperate graphe for LINE Rate

Change-Id: Ief31777c2e7a18aab4bf21fb6ccc0e93a3bb9178
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
6 years agoMerge "Fix NSB NfVi support for 25 and 40Gbps"
Abhijit Sinha [Wed, 27 Jun 2018 16:06:17 +0000 (16:06 +0000)]
Merge "Fix NSB NfVi support for 25 and 40Gbps"

6 years agoCorrected scale-up command line arguments 35/59035/4
Chornyi, TarasX [Tue, 26 Jun 2018 11:39:56 +0000 (14:39 +0300)]
Corrected scale-up command line arguments

Change-Id: If308fde797dcb01e58f37ad81bb116fde542366a
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
6 years agoFix NSB NfVi support for 25 and 40Gbps 39/58239/8
Xavier Simonart [Tue, 5 Jun 2018 12:06:29 +0000 (14:06 +0200)]
Fix NSB NfVi support for 25 and 40Gbps

When setting interface_speed option in the test case, NSB/PROX
was still considering 100% as 10 Gbps.
With this fix, when interface_speed is set to for instance 25 Gbps
then NSB/PROX will start generate at 25 Gbps.
Yardstick logging info printed on the screen will show performance result
as percentage of interface_speed (e.g. 100% will be 25 Gbps).
This is done by sending the command "speed 250" to PROX (PROX cannot
know the underlying interface speed in all cases e.g. in virtio, and
hence considers 100% as 10Gbps).

JIRA: YARDSTICK-1217

Change-Id: I4989161b04a7afa5e347935ee7ccef7dfe5a504d
Signed-off-by: Xavier Simonart <xavier.simonart@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
6 years agoMerge "Resolve NameError in test_utils.py"
Rodolfo Alonso Hernandez [Wed, 27 Jun 2018 12:29:24 +0000 (12:29 +0000)]
Merge "Resolve NameError in test_utils.py"

6 years agoNSB NFVi PROX VPE losing many packets 85/58685/8
DanielMartinBuckley [Mon, 18 Jun 2018 18:27:41 +0000 (19:27 +0100)]
NSB NFVi PROX VPE losing many packets

JIRA: YARDSTICK-1105

Running a vPE test ends up with up to 25% drooped packets.
This is due to tolerated loss being incorrectly configured,
test duration was too short and test interval was too
short.

Note This is due to the fact that vPE use case have by
default a tolerated loss of 100%, Now changed to 0.001,
same as L2FWD

Also: Grafan dashboard has been updated to show all SUT
CPUS Utilization in 1 panel. And LINE rate MIN, MAX & TEST
Rate have been added

Change-Id: I7adae2199b3f656fe460705b6aeb3aa69c767d50
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
6 years agoAdd testsuite "os-odl-ovs-noha" 87/58187/2
ting wu [Mon, 4 Jun 2018 12:18:15 +0000 (14:18 +0200)]
Add testsuite "os-odl-ovs-noha"

Add testsuite yaml file for scenario
"os-odl-ovs-noha"

JIRA: YARDSTICK-1208

Change-Id: I2671df847332379afed8c6481e54eb25dcba5e48
Signed-off-by: ting wu <ting.wu@enea.com>
6 years agoMerge "Define several containers per pod in a replication controller"
Rodolfo Alonso Hernandez [Wed, 27 Jun 2018 10:32:45 +0000 (10:32 +0000)]
Merge "Define several containers per pod in a replication controller"

6 years agoMerge "Decrease Sampling interval"
Abhijit Sinha [Wed, 27 Jun 2018 01:53:19 +0000 (01:53 +0000)]
Merge "Decrease Sampling interval"

6 years agoNSB NFVi BNG test fails to run - stops after one step 43/58543/7
DanielMartinBuckley [Thu, 14 Jun 2018 15:15:26 +0000 (16:15 +0100)]
NSB NFVi BNG test fails to run - stops after one step

JIRA: YARDSTICK-1244

When sending the start or stop command to PROX. We sould not send the same core.
We should not send "start 1,1" instead we should send "start 1"

Change-Id: Ie600dc3ed808fd00341e92f13bd52199e68dc51f
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
6 years agoDecrease Sampling interval 61/58261/21
DanielMartinBuckley [Tue, 5 Jun 2018 18:06:38 +0000 (19:06 +0100)]
Decrease Sampling interval

JIRA: YARDSTICK-1219

Currently NSB for NFVI using PROX returns sampling information every 13
seconds.

This is too slow.

It is required to return sampling information form Generator AND VNF at
least every  1 second.

This change is depandant on JIRA: YARDSTICK-1212 and YARDSTICK-1220

Change-Id: Ica7ab795a2919d191d8cd846d028e15739e33fb7
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
6 years agoMerge "Addition of Configurable Sampling and Configurable Confirmation Retry"
Abhijit Sinha [Tue, 26 Jun 2018 17:39:32 +0000 (17:39 +0000)]
Merge "Addition of Configurable Sampling and Configurable Confirmation Retry"

6 years agoMerge "Bugfix: heat conext of test case yamls jinja2 bypass sriov type"
Abhijit Sinha [Tue, 26 Jun 2018 17:39:18 +0000 (17:39 +0000)]
Merge "Bugfix: heat conext of test case yamls jinja2 bypass sriov type"

6 years agoResolve NameError in test_utils.py 57/59057/1
Emma Foley [Tue, 26 Jun 2018 17:13:35 +0000 (18:13 +0100)]
Resolve NameError in test_utils.py

The import of the yardstick module was removed from test_util.py, which relied
on this module location for a file name in
test_import_modules_from_package_no_mod and test_import_modules_from_package.

JIRA: YARDSTICK-1258
Change-Id: I754dbadfb8d788236f354e9a0c1a61ad6c4abf70
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
6 years agoMerge "Extended Context class with get_physical_nodes functionality"
Rodolfo Alonso Hernandez [Tue, 26 Jun 2018 16:11:38 +0000 (16:11 +0000)]
Merge "Extended Context class with get_physical_nodes functionality"

6 years agoAddition of Configurable Sampling and Configurable Confirmation Retry 97/58297/31
DanielMartinBuckley [Wed, 6 Jun 2018 14:06:01 +0000 (15:06 +0100)]
Addition of Configurable Sampling and Configurable Confirmation Retry

JIRA: YARDSTICK-1221

In order to increase accuracy of result the following are done :-
  - Improve Measurement Accuracy (YARDSTICK-1212)
  - Improve Sampling Interval (YARDSTICK-1219)
  - Allow 4 PROX ports to be read simultaneously (YARDSTICK-1220)

This change does the following :-
  - Stores LINE Rate statistics of Sample
  - Requires a confirmation retry before deciding to increase or
    decrease this is configurable.
  - Allows the user to disable Sampling or specify a sample interval
  - Added Code Coverage of ProxDurationRunner based on YARDSTICK-1199

Change-Id: I27242ac1849c9a2712866385b5fbc05977c71516
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
6 years agoMerge "Bugfix: HA kill process recovery has a conflict"
Abhijit Sinha [Tue, 26 Jun 2018 15:15:02 +0000 (15:15 +0000)]
Merge "Bugfix: HA kill process recovery has a conflict"

6 years agoMerge "NSB Topology fix for Prox 4 port test case"
Emma Foley [Tue, 26 Jun 2018 14:30:20 +0000 (14:30 +0000)]
Merge "NSB Topology fix for Prox 4 port test case"

6 years agoMerge "Refactor "utils.parse_ini_file" testing"
Rodolfo Alonso Hernandez [Tue, 26 Jun 2018 09:53:14 +0000 (09:53 +0000)]
Merge "Refactor "utils.parse_ini_file" testing"