yardstick.git
6 years ago[docs] Add info on gerrit groups to the devguide. 29/57329/2
Emma Foley [Fri, 11 May 2018 15:00:03 +0000 (15:00 +0000)]
[docs] Add info on gerrit groups to the devguide.

Added the yardstick-reviewers and yardstick-committers groups
as an alternative to adding individual developers to a code review.

Change-Id: I1ebba56ba27dac00f7e7af7858b3c599a0f1eae8
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
6 years agoMerge "nsb_setup: parametrize docker image"
Emma Foley [Thu, 10 May 2018 09:18:23 +0000 (09:18 +0000)]
Merge "nsb_setup: parametrize docker image"

6 years agoMerge "Update samples/test_suite.yaml"
Abhijit Sinha [Thu, 10 May 2018 09:01:02 +0000 (09:01 +0000)]
Merge "Update samples/test_suite.yaml"

6 years agoMerge "Re enable pip package unit tests"
Rodolfo Alonso Hernandez [Wed, 9 May 2018 16:57:19 +0000 (16:57 +0000)]
Merge "Re enable pip package unit tests"

6 years agoUpdate samples/test_suite.yaml 21/55821/3
Emma Foley [Mon, 16 Apr 2018 13:08:25 +0000 (13:08 +0000)]
Update samples/test_suite.yaml

The sample test suite at sample/test_suite.yaml contained incorrect
syntax. It has been updated to add the "default" parameter to
"task_args" when running a testcase.

JIRA: YARDSTICK-1125
Change-Id: I53409168e47d969317145623df1e2c789396cc32
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
6 years agoMerge "Bug Fix: correct the file path to build docker file"
Emma Foley [Wed, 9 May 2018 10:34:56 +0000 (10:34 +0000)]
Merge "Bug Fix: correct the file path to build docker file"

6 years agoBug Fix: correct the file path to build docker file 73/57173/4
ting wu [Tue, 8 May 2018 11:51:47 +0000 (13:51 +0200)]
Bug Fix: correct the file path to build docker file

To be able to build a docker file, the path to file
"exec_tests.sh" should be modifed from .docker/exec_tests.sh
to ./exec_tests.sh.

JIRA: YARDSTICK-1157

Change-Id: I0f707ba579039d0efc8f2185b596e23b901c09df
Signed-off-by: ting wu <ting.wu@enea.com>
6 years agoMerge "Fix log typos in benchmark/scenarios/availability"
Emma Foley [Wed, 9 May 2018 09:11:40 +0000 (09:11 +0000)]
Merge "Fix log typos in benchmark/scenarios/availability"

6 years agoMerge "Replace cinder get_volume_id with shade client."
Rodolfo Alonso Hernandez [Wed, 9 May 2018 07:43:37 +0000 (07:43 +0000)]
Merge "Replace cinder get_volume_id with shade client."

6 years agoMerge "Implement Virtual Switch resilience test case"
Ross Brattain [Tue, 8 May 2018 08:57:56 +0000 (08:57 +0000)]
Merge "Implement Virtual Switch resilience test case"

6 years agoMerge "Bug Fix: Start openvswitch service in Centos distro"
Ross Brattain [Tue, 8 May 2018 08:57:44 +0000 (08:57 +0000)]
Merge "Bug Fix: Start openvswitch service in Centos distro"

6 years agoMerge "Add support for restarting a service"
Ross Brattain [Tue, 8 May 2018 08:57:30 +0000 (08:57 +0000)]
Merge "Add support for restarting a service"

6 years agoMerge "Add ODL HA testcase"
Ross Brattain [Tue, 8 May 2018 08:57:19 +0000 (08:57 +0000)]
Merge "Add ODL HA testcase"

6 years agoMerge "Add pod.yaml files for Apex"
Ross Brattain [Tue, 8 May 2018 08:57:04 +0000 (08:57 +0000)]
Merge "Add pod.yaml files for Apex"

6 years agoFix log typos in benchmark/scenarios/availability 57/56757/5
Miikka Koistinen [Mon, 7 May 2018 09:12:33 +0000 (12:12 +0300)]
Fix log typos in benchmark/scenarios/availability

This commit fixes multiple log message typos and all the emerged pylint
errors.

MonitorProcess/MonitorOpenstackCmd.verify_SLA() repeat already logged
information, so these prints are removed.

JIRA: YARDSTICK-1145

Change-Id: Ifef26e4b4ff7766089caec24785511969c2d663e
Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
6 years agoReplace cinder get_volume_id with shade client. 35/55335/13
Shobhi Jain [Fri, 6 Apr 2018 10:41:54 +0000 (11:41 +0100)]
Replace cinder get_volume_id with shade client.

Function get_volume_id now uses shade client.

JIRA: YARDSTICK-891

Change-Id: I45ae40982a64f677dbbdeb6c9510a0ec9ac973f1
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoRe enable pip package unit tests 07/54207/11
Rodolfo Alonso Hernandez [Tue, 20 Mar 2018 14:45:47 +0000 (14:45 +0000)]
Re enable pip package unit tests

In [1] the pip unit test cases were removed, because of a problem in pip3
library. Currently there is a reported error in pip 9.0.2 version, in
_vendor.urllib3 library [2].

This error is solved in [3].

[1]I43b1edc23cebe0db97b6b56a551acd376986dfea
[2]https://github.com/pypa/pip/issues/5079
[3]I2ee28749f146cd3b0e1bf4ed92b51cbe6db8b2f3

JIRA: YARDSTICK-1087

Change-Id: Id4f0e1accf3240b5f27d3698323e679a27f63f87
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoMerge "Add IxNetwork API Python Binding package"
Rodolfo Alonso Hernandez [Tue, 8 May 2018 07:02:00 +0000 (07:02 +0000)]
Merge "Add IxNetwork API Python Binding package"

6 years agoJörgen Karlsson standing down as Yardstick committer 33/57133/2
Ross Brattain [Mon, 7 May 2018 17:53:22 +0000 (10:53 -0700)]
Jörgen Karlsson standing down as Yardstick committer

https://lists.opnfv.org/pipermail/opnfv-tsc/2018-May/004333.html

Change-Id: Ida2692c9f5f8e41580a653c8e9b5a05b5d99df00
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoMerge "Add "os_cloud_config" as a new context flag parameter"
Emma Foley [Fri, 4 May 2018 14:54:16 +0000 (14:54 +0000)]
Merge "Add "os_cloud_config" as a new context flag parameter"

6 years agoMerge "Update the dummy-scenario-heat-context testcase"
Rodolfo Alonso Hernandez [Fri, 4 May 2018 13:16:52 +0000 (13:16 +0000)]
Merge "Update the dummy-scenario-heat-context testcase"

6 years agoMerge changes from topics 'YARDSTICK-1147', 'YARDSTICK-1144'
Rodolfo Alonso Hernandez [Fri, 4 May 2018 09:36:32 +0000 (09:36 +0000)]
Merge changes from topics 'YARDSTICK-1147', 'YARDSTICK-1144'

* changes:
  Fix ansible scripts for running in container
  Correctly set PYTHONPATH in Dockerfile

6 years agoAdd IxNetwork API Python Binding package 15/54615/14
Rodolfo Alonso Hernandez [Thu, 29 Mar 2018 14:39:49 +0000 (15:39 +0100)]
Add IxNetwork API Python Binding package

Add IxNetwork python package to the requirements list.

This module is needed for the "NSPerf" scenarios using IXIA as traffic
generator, when IxNetwork is the program used to handle the IXIA
generator.

The latest version of this module is 8.40.1124.9 [1]. The license type
is MIT.

[1] https://pypi.python.org/pypi/ixnetwork

JIRA: YARDSTICK-1106

Change-Id: I279933c95994f5120930256a104c4192a0b9900d
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoFix ansible scripts for running in container 27/57027/2
John O Loughlin [Thu, 3 May 2018 13:19:29 +0000 (14:19 +0100)]
Fix ansible scripts for running in container

JIRA: YARDSTICK-1147

Change-Id: I52dae85a2d97192bc8a48c5aeea3173b3d4de003
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
6 years agoMQ startup process refactor 87/54887/13
Chornyi, TarasX [Wed, 4 Apr 2018 08:26:09 +0000 (11:26 +0300)]
MQ startup process refactor

YARDSTICK-1112

Change-Id: Id30236e190bae9fb0f5b5ebd4c5e04798e4fd443
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
6 years agoMerge "Remove unused methods in SampleVNF"
Abhijit Sinha [Thu, 3 May 2018 10:59:45 +0000 (10:59 +0000)]
Merge "Remove unused methods in SampleVNF"

6 years agoImplement Virtual Switch resilience test case 87/56487/14
Dimitrios Markou [Wed, 25 Apr 2018 14:32:18 +0000 (17:32 +0300)]
Implement Virtual Switch resilience test case

This testcase tests the resilience of the Virtual
Switch in an OpenStack environment. It can only run in a
non Ubuntu distro because it is limited by this bug [0]

[0]: JIRA: YARDSTICK-1140

Change-Id: Ia1480fba9f3549d1144c80699056b501d3b07a0f
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
6 years agoBug Fix: Start openvswitch service in Centos distro 67/56767/7
Dimitrios Markou [Fri, 27 Apr 2018 08:51:17 +0000 (11:51 +0300)]
Bug Fix: Start openvswitch service in Centos distro

JIRA: YARDSTICK-1142

Change-Id: I82c479c95e10de37416081eacf2d8bee396e50dc
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
6 years agoAdd support for restarting a service 91/56491/8
Dimitrios Markou [Wed, 25 Apr 2018 14:37:03 +0000 (17:37 +0300)]
Add support for restarting a service

JIRA: YARDSTICK-1138

Change-Id: Id57defb574eb7e0f5be81b52803cdb05f46796ab
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
6 years agoReplace nova get flavor with shade client. 01/55001/16
Shobhi Jain [Thu, 5 Apr 2018 15:04:08 +0000 (16:04 +0100)]
Replace nova get flavor with shade client.

Rename get_flavor_by_name with get_flavor.
Function get_flavor now uses shade client.

JIRA: YARDSTICK-1088

Change-Id: Ic82127e475baf39643be0a254b177f3058b85748
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoReplace nova get server with shade client. 11/54911/20
Shobhi Jain [Fri, 30 Mar 2018 09:45:54 +0000 (10:45 +0100)]
Replace nova get server with shade client.

Rename get_server_by_name with get_server.
Function get_server now uses shade client.

JIRA: YARDSTICK-1088

Change-Id: I69c59145cefdb565f3ece27baaaf932905e1b757
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoAdd "os_cloud_config" as a new context flag parameter 77/56677/6
Rodolfo Alonso Hernandez [Thu, 26 Apr 2018 14:24:44 +0000 (15:24 +0100)]
Add "os_cloud_config" as a new context flag parameter

This new parameter will contain the OpenStack cloud specific configuration
used by Shade client. This new flag is used only in Heat context.

By default, this new parameter (dict) will contain this content:
  'os_cloud_config': {'verify': False}

This field will be used by HeatStack [1] to create a Shade cloud. Shade
retrieves, if not defined, the OpenStack configuration from
"os_client_config". This configuration is used to generate the cloud
configuration, which is the description of the OpenStackCloud returned.

The default parameter defined, "verify", refers to the related bug. By
default, in case of using SSL certificate it will not be verified.

[1] https://github.com/opnfv/yardstick/blob/b338d3091bb0beb89d4ad9f7c144f43a31a19a74/yardstick/orchestrator/heat.py#L47

JIRA: YARDSTICK-1139

Change-Id: I875a7018401b84e51dab775b8194174645d27e06
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoMerge "Fix nsb_setup.sh script"
Abhijit Sinha [Wed, 2 May 2018 16:49:19 +0000 (16:49 +0000)]
Merge "Fix nsb_setup.sh script"

6 years agoMerge "Move tests: unit/network_services/{lib/,collector/,*.py}"
Abhijit Sinha [Wed, 2 May 2018 16:46:29 +0000 (16:46 +0000)]
Merge "Move tests: unit/network_services/{lib/,collector/,*.py}"

6 years agoFix nsb_setup.sh script 61/56961/2
John O Loughlin [Wed, 2 May 2018 09:03:20 +0000 (10:03 +0100)]
Fix nsb_setup.sh script

Ansible role install_dependencies was renamed
to install_dependencies_jumphost in previous patch.

JIRA: YARDSTICK-1146

Change-Id: Idf7c191151961c1c0e63ad2f75aa0aab8ed2b2fa
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
6 years agoCorrectly set PYTHONPATH in Dockerfile 57/56957/2
John O Loughlin [Wed, 2 May 2018 07:50:53 +0000 (08:50 +0100)]
Correctly set PYTHONPATH in Dockerfile

JIRA: YARDSTICK-1144

Change-Id: I8c0fe229ed620417a85356e017b171260373c43f
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
6 years agoMerge "Replace nova attach volume to server with shade client."
Rodolfo Alonso Hernandez [Wed, 2 May 2018 07:24:29 +0000 (07:24 +0000)]
Merge "Replace nova attach volume to server with shade client."

6 years agoMove tests: unit/network_services/{lib/,collector/,*.py} 67/48267/17
Emma Foley [Fri, 27 Apr 2018 10:29:27 +0000 (10:29 +0000)]
Move tests: unit/network_services/{lib/,collector/,*.py}

* Fix pylint errors
* Add TODOs

Some errors are ignored locally, as they were a symptom of other problems.
These issues have been flagged with a TODO, and should be fixed later.

JIRA: YARDSTICK-837
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: Idc2e70291b6d9b4cf7e7249a10c4a290b999206c

6 years agoUpdate Dockerfile.aarch64.patch 93/56893/1
Cristina Pauna [Mon, 30 Apr 2018 11:12:49 +0000 (14:12 +0300)]
Update Dockerfile.aarch64.patch

The patch doesn't apply anymore for the latest docker builds.
Updated the patch to accomodate the latest changes to the Dockerfile

Change-Id: Ia8a35337a421b3628c90be3060f049c655446758
Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
6 years agoMerge "Add active wait function"
Rodolfo Alonso Hernandez [Mon, 30 Apr 2018 10:26:03 +0000 (10:26 +0000)]
Merge "Add active wait function"

6 years agoReplace nova attach volume to server with shade client. 61/54561/21
Shobhi Jain [Wed, 28 Mar 2018 11:19:35 +0000 (12:19 +0100)]
Replace nova attach volume to server with shade client.

Function attach_volume_to_server now uses shade client
instead of nova client.

JIRA: YARDSTICK-1088

Change-Id: Id00df672c2c195b5c338cbbc30ddf2742a4e4d29
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoMerge "Migrate install.sh script to ansible"
Rodolfo Alonso Hernandez [Fri, 27 Apr 2018 08:55:37 +0000 (08:55 +0000)]
Merge "Migrate install.sh script to ansible"

6 years agoAdd active wait function 63/56063/10
Rodolfo Alonso Hernandez [Thu, 19 Apr 2018 13:58:38 +0000 (14:58 +0100)]
Add active wait function

Added function "wait_until_true". This function will make an active
wait until the predicate passed as an argument returns True.

If the timeout expires, the function will raise a generic exception
or a user defined one passed as an argument.

This function will be used in YARDSTICK-1127.

JIRA: YARDSTICK-1128

Change-Id: I9854e465ac6b586bf4be39ab4b266d5625b39e30
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoMerge "Get HA test case results on failure"
Ross Brattain [Thu, 26 Apr 2018 14:11:27 +0000 (14:11 +0000)]
Merge "Get HA test case results on failure"

6 years agoMigrate install.sh script to ansible 35/52935/17
John O Loughlin [Fri, 16 Feb 2018 15:29:58 +0000 (15:29 +0000)]
Migrate install.sh script to ansible

Ansible scripts to install yardstick.

These scripts will take a few options:
  INSTALLATION_MODE : Container or Baremetal
  YARDSTICK_DIR: Location of Yardstick directory
  VIRTUAL_ENVIRONMENT: Should a virtual environment be used
  NSB_DIR: Location of NSB directory

JIRA: YARDSTICK-1126

Change-Id: I4a13e07e96650ffd971dfb18472f2563cfd51aa9
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
6 years agoMerge "OpenStack deployment using kolla"
Rodolfo Alonso Hernandez [Thu, 26 Apr 2018 09:23:10 +0000 (09:23 +0000)]
Merge "OpenStack deployment using kolla"

6 years agoMerge "Replace nova delete keypair with shade client."
Rodolfo Alonso Hernandez [Thu, 26 Apr 2018 09:04:41 +0000 (09:04 +0000)]
Merge "Replace nova delete keypair with shade client."

6 years agoMerge "Replace nova client create keypair with shade."
Rodolfo Alonso Hernandez [Thu, 26 Apr 2018 09:04:38 +0000 (09:04 +0000)]
Merge "Replace nova client create keypair with shade."

6 years agoMerge "Remove unused nova client functions."
Rodolfo Alonso Hernandez [Thu, 26 Apr 2018 09:04:32 +0000 (09:04 +0000)]
Merge "Remove unused nova client functions."

6 years agoMerge "Replace nova delete instance with shade client."
Rodolfo Alonso Hernandez [Thu, 26 Apr 2018 09:04:28 +0000 (09:04 +0000)]
Merge "Replace nova delete instance with shade client."

6 years agoMerge "Replace nova create instance with shade client."
Rodolfo Alonso Hernandez [Thu, 26 Apr 2018 09:04:25 +0000 (09:04 +0000)]
Merge "Replace nova create instance with shade client."

6 years agoOpenStack deployment using kolla 15/54015/12
Stepan Andrushko [Fri, 16 Mar 2018 18:53:06 +0000 (20:53 +0200)]
OpenStack deployment using kolla

OpenStack deployment using Kolla installer for all-in-one mode and
multinode inside VMs which are already created. Two types of OpenStack
nodes are supported as input in sample files, like
infra_deploy_two.yaml.sample: controller and compute.

JIRA: YARDSTICK-1078

Change-Id: I51616a7a17ac565a01ec6da57b589290237d18ee
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
6 years agoMerge "Add dashboard for TC058"
Ross Brattain [Thu, 26 Apr 2018 06:37:53 +0000 (06:37 +0000)]
Merge "Add dashboard for TC058"

6 years ago[release] Yardstick Fraser 6.0.0 Release notes 69/56169/15
rexlee8776 [Sat, 21 Apr 2018 01:51:04 +0000 (01:51 +0000)]
[release] Yardstick Fraser 6.0.0 Release notes

JIRA: YARDSTICK-1129

Change-Id: I5adb2e9547c58b90d3eafb0e2b90015ce5472cfa
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agonsb_setup: parametrize docker image 93/56493/3
Ross Brattain [Wed, 25 Apr 2018 14:47:35 +0000 (07:47 -0700)]
nsb_setup: parametrize docker image

The user may need to pull a different image stable or a
tagged release version.

Since we can't pull a tagged image before it is tagged
just give up and make it an argument

JIRA: YARDSTICK-1137

Change-Id: I0caf0f8915c191786c7db6d929be2fa350a545af
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoMerge "Fix "os.path" mock problems during tests"
Ross Brattain [Thu, 26 Apr 2018 04:57:44 +0000 (04:57 +0000)]
Merge "Fix "os.path" mock problems during tests"

6 years agoMerge "Bugfix: ansible can't not run without config"
Rex Lee [Thu, 26 Apr 2018 02:04:54 +0000 (02:04 +0000)]
Merge "Bugfix: ansible can't not run without config"

6 years agoFix "os.path" mock problems during tests 19/56119/10
Ross Brattain [Thu, 19 Apr 2018 05:16:32 +0000 (22:16 -0700)]
Fix "os.path" mock problems during tests

This patch removes the global mocking applied on "os.path".

Change-Id: Ia18d2c90195c5408a1852792bdf05b6f0c1ad21f
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoMerge "OpenStack deployment: delete RS or all VMs"
Rodolfo Alonso Hernandez [Wed, 25 Apr 2018 17:14:02 +0000 (17:14 +0000)]
Merge "OpenStack deployment: delete RS or all VMs"

6 years agoMerge "Add docker support for Ubuntu 17.10 with Yardstick"
Rodolfo Alonso Hernandez [Wed, 25 Apr 2018 16:50:25 +0000 (16:50 +0000)]
Merge "Add docker support for Ubuntu 17.10 with Yardstick"

6 years agoBugfix: ansible can't not run without config 09/56309/1
chenjiankun [Tue, 24 Apr 2018 01:58:10 +0000 (01:58 +0000)]
Bugfix: ansible can't not run without config

JIRA: YARDSTICK-1135

Ansible need ansible.cfg when run in the remote node.
However the file name is wrong. Need:
setup.cfg -> ansible.cfg

Change-Id: Ifa674fb624ca83d90c3ac9ad3bfe148013bf8bfd
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
6 years agoremove more old apexlake testcases 99/56299/2
Ross Brattain [Mon, 23 Apr 2018 21:42:35 +0000 (14:42 -0700)]
remove more old apexlake testcases

fix fraser failures

Change-Id: I8bb12a762054a4c3274cc6e0297e948b92700e7e
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoMerge "[docs] Updated baremetal instalation instructions"
Rodolfo Alonso Hernandez [Mon, 23 Apr 2018 16:32:45 +0000 (16:32 +0000)]
Merge "[docs] Updated baremetal instalation instructions"

6 years agoReplace nova delete keypair with shade client. 57/54557/9
Shobhi Jain [Tue, 27 Mar 2018 15:47:04 +0000 (16:47 +0100)]
Replace nova delete keypair with shade client.

Function delete_keypair now uses shade client.

JIRA: YARDSTICK-1088

Change-Id: I46b895748c5c44b0bf7d5b035395676ebff48d7f
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoReplace nova client create keypair with shade. 15/54515/12
Shobhi Jain [Tue, 27 Mar 2018 13:28:08 +0000 (14:28 +0100)]
Replace nova client create keypair with shade.

Function create_keypair now uses shade client instead
of nova client.

JIRA: YARDSTICK-1088

Change-Id: I060580504d6969c5ba859ed4494082feb998d37d
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoRemove unused nova client functions. 13/54513/12
Shobhi Jain [Mon, 26 Mar 2018 15:04:49 +0000 (16:04 +0100)]
Remove unused nova client functions.

Following funtions are not required by shade client also
not been used in any of the scenario files:
*create_aggregate
*create_aggregate_with_host
*create_instance
*add_host_to_aggregate
*create_aggregate_with_host
*get_availability_zones
*get_availability_zone_names
*remove_hosts_from_aggregate
*remove_host_from_aggregate
*delete_aggregate
*get_image_by_name
*check_status

JIRA: YARDSTICK-1088

Change-Id: I7ba0fbce6aa3e636aa55581a993c1ec1b48fbead
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoReplace nova delete instance with shade client. 79/54479/13
Shobhi Jain [Mon, 26 Mar 2018 13:56:59 +0000 (14:56 +0100)]
Replace nova delete instance with shade client.

Function delete_instance now uses shade client.

JIRA: YARDSTICK-1088

Change-Id: I5772a74c6dc2d103edd410042a8eaf721d1bcc5c
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoReplace nova create instance with shade client. 69/54469/14
Shobhi Jain [Thu, 22 Mar 2018 16:45:13 +0000 (16:45 +0000)]
Replace nova create instance with shade client.

Remove redundant functions:
*get_instances
*get_instance_status
*get_instance_by_name

Function create_instance_and_wait_for_active now uses shade client.

JIRA: YARDSTICK-1088

Change-Id: I766da333dabbb1b83a7b4ede4bf73567ec70eb8c
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoMerge "MessagingConsumer accepts messages from multiple producers"
Rodolfo Alonso Hernandez [Sun, 22 Apr 2018 19:05:00 +0000 (19:05 +0000)]
Merge "MessagingConsumer accepts messages from multiple producers"

6 years agoMerge "Improve "Libvirt.create_snapshot_qemu" function"
Rodolfo Alonso Hernandez [Sat, 21 Apr 2018 08:24:55 +0000 (08:24 +0000)]
Merge "Improve "Libvirt.create_snapshot_qemu" function"

6 years agoMerge "extra loopback cleanup"
Ross Brattain [Fri, 20 Apr 2018 17:13:32 +0000 (17:13 +0000)]
Merge "extra loopback cleanup"

6 years agodisable NSB (DPDK) image load for ARM 61/56161/1
Ross Brattain [Fri, 20 Apr 2018 16:57:35 +0000 (09:57 -0700)]
disable NSB (DPDK) image load for ARM

we skip the building now but we also need to skip the image loading

JIRA: YARDSTICK-1124

Change-Id: I27c40d6319e74374282203132cfc2c7ebff9b094
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoAdd ODL HA testcase 95/53995/5
Dimitrios Markou [Fri, 16 Mar 2018 13:51:49 +0000 (15:51 +0200)]
Add ODL HA testcase

This testcase confirms the resiliency of Opendaylight
in a HA deployment

SPEC: https://gerrit.opnfv.org/gerrit/#/c/50991

JIRA: HA-33
JIRA: YARSTICK-955

Change-Id: I4cb39d1970ed0333a43fbb58f8c7138908379dcb
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
6 years agoAdd pod.yaml files for Apex 59/54259/9
Dimitrios Markou [Wed, 21 Mar 2018 14:09:58 +0000 (16:09 +0200)]
Add pod.yaml files for Apex

JIRA: YARDSTICK-1097

Change-Id: If116174c562bc08c0b7602324599bc85d8c60be0
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
6 years agoMerge "DPDK: detect dpdk_make_arch based on image arch"
Abhijit Sinha [Fri, 20 Apr 2018 08:52:49 +0000 (08:52 +0000)]
Merge "DPDK: detect dpdk_make_arch based on image arch"

6 years agoextra loopback cleanup 81/56081/2
Ross Brattain [Thu, 19 Apr 2018 20:58:26 +0000 (13:58 -0700)]
extra loopback cleanup

try to cleanup in the shell script in case ansible errors

maybe it is hopeless because of docker

JIRA: YARDSTICK-1096
JIRA: YARDSTICK-1054

Change-Id: I759ded4731a7710a194a81530cfb35376eb7800d
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agodisable DPDK images for ARM 41/56041/3
Ross Brattain [Thu, 19 Apr 2018 05:00:53 +0000 (22:00 -0700)]
disable DPDK images for ARM

We are trying to compile DPDK for the os-nosdn-ovs-ha scenario because we added TC042  "Measure network latency using testpmd and pktgen-dpdk".

However it looks like TC042 is only enabled for compass in opnfv_os-nosdn-kvm_ovs_dpdk-ha

https://gerrit.opnfv.org/gerrit/#/c/54659/1/tests/opnfv/test_suites/opnfv_os-nosdn-kvm_ovs_dpdk-ha_daily.yaml

-
  file_name: opnfv_yardstick_tc042.yaml
  constraint:
      installer: compass
      pod: huawei-pod1

We don't actually need TC042 and DPDK or os-nosdn-ovs-ha.

But in order to run TC042 we have to know beforehand that we are going to use DPDK, so we have a conditional in the load_images.sh script that tries to guess when we will need a DPDK image.

The conditional only checks for *[_-]ovs[_-]*
if [[ $DEPLOY_SCENARIO == *[_-]ovs[_-]* ]]; then
    ansible-playbook \
             -e img_property="nsb" \
             -e YARD_IMG_ARCH=${YARD_IMG_ARCH} \
             -vvv -i inventory.ini build_yardstick_image.yml
    if [ ! -f "${QCOW_NSB_IMAGE}" ]; then
        echo "Failed building QCOW NSB image"
        exit 1
    fi
fi

For this release we won't be able to get DPDK images to compile on ARM, we should fix this conditional and not try to compile.

Also change the shell glob to match *[_-]ovs_dpdk[_-]* to only enable DPDK
images for ovs_dpdk scenarios

JIRA: YARDSTICK-1124

Change-Id: I03142e6b8aa00dc9cdf9b446868fb723cd10198b
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoMerge "Update neutron delete_neutron_net function."
Emma Foley [Thu, 19 Apr 2018 10:23:09 +0000 (10:23 +0000)]
Merge "Update neutron delete_neutron_net function."

6 years agoMessagingConsumer accepts messages from multiple producers 01/55701/4
Rodolfo Alonso Hernandez [Fri, 13 Apr 2018 17:40:38 +0000 (18:40 +0100)]
MessagingConsumer accepts messages from multiple producers

The messaging consumer now can store a list of PID of several producers.
The notification handler can compare the procedence of a message from
a list of PID.

JIRA: YARDSTICK-1074

Change-Id: I193f83c2b471e5bf1298ac728be52533aded0c1a
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoMerge "add verbose to debug losetup delete"
Ross Brattain [Wed, 18 Apr 2018 20:50:05 +0000 (20:50 +0000)]
Merge "add verbose to debug losetup delete"

6 years agoDPDK: detect dpdk_make_arch based on image arch 17/56017/1
Ross Brattain [Wed, 18 Apr 2018 20:41:37 +0000 (13:41 -0700)]
DPDK: detect dpdk_make_arch based on image arch

JIRA: YARDSTICK-1124

Change-Id: I26e5854f5117a3b45ac7fa4d4b06f325dcd4d97a
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoMerge "remove apex lake tc007 from test suites"
Ross Brattain [Wed, 18 Apr 2018 17:19:40 +0000 (17:19 +0000)]
Merge "remove apex lake tc007 from test suites"

6 years agoMerge "Replace neutron create security group full with shade."
Rodolfo Alonso Hernandez [Wed, 18 Apr 2018 15:45:16 +0000 (15:45 +0000)]
Merge "Replace neutron create security group full with shade."

6 years agoUpdate the dummy-scenario-heat-context testcase 85/55985/1
Emma Foley [Wed, 18 Apr 2018 14:17:00 +0000 (14:17 +0000)]
Update the dummy-scenario-heat-context testcase

The testcase is included in the docs to demonstrate definining a heat context.
It previously used cirros, but this is not included by default.
Set-up instructions/scripts add yardstick-image and yardstick-flavor, so these
have been added to the testcase instead.

A default value for context_name was also added.

Change-Id: I5f642086971487b334ae48a5cf5c9b71e9b99e2e
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
6 years agoremove apex lake tc007 from test suites 65/55865/3
Ross Brattain [Tue, 17 Apr 2018 07:45:17 +0000 (00:45 -0700)]
remove apex lake tc007 from test suites

fixes opnfv_os-nosdn-fdio-noha_daily.yaml failures due
to missing testcase

Change-Id: I5f050d72334da46b94de5fa3662047bf694f7e3e
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agofix unittest test_deploy_try_retrieve_context_does_not_exist 41/55941/1
Ross Brattain [Wed, 18 Apr 2018 00:07:43 +0000 (17:07 -0700)]
fix unittest test_deploy_try_retrieve_context_does_not_exist

unittest is failing due to mock being called multiple times.

I assume this is due to parallelization of tests in Jenkins somehow

======================================================================
FAIL: test_deploy_try_retrieve_context_does_not_exist (benchmark.contexts.test_heat.HeatContextTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/mock/mock.py", line 1305, in patched
    return func(*args, **keywargs)
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/yardstick/tests/unit/benchmark/contexts/test_heat.py", line 309, in test_deploy_try_retrieve_context_does_not_exist
    mock_path_exists.assert_called_once_with(key_filename)
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/mock/mock.py", line 947, in assert_called_once_with
    raise AssertionError(msg)
AssertionError: Expected 'exists' to be called once. Called 3 times.

----------------------------------------------------------------------

Change-Id: I696c63ef9f7943b841e2d3d533c92f18aa7044da
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoOpenStack deployment: delete RS or all VMs 13/55813/4
Stepan Andrushko [Mon, 16 Apr 2018 11:17:54 +0000 (14:17 +0300)]
OpenStack deployment: delete RS or all VMs

New parameter is added to shell script to delete data for VMs either from
input file or all.
Added disk images removal as per new input parameter.

JIRA: YARDSTICK-1123

Change-Id: I8d2cee4a3a7ad7147f4d59303bab656d80370221
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
6 years agoRemove unused methods in SampleVNF 97/55597/2
Emma Foley [Thu, 12 Apr 2018 14:45:42 +0000 (14:45 +0000)]
Remove unused methods in SampleVNF

The following private methods are unused in
yardstick/network_services/vnf_generic/vnf/sample_vnf.py:SampleVNF

* _build_ports(self)
* _get_route_data(self, route_index, route_type)
* _get_port0localip6(self)
* _get_port1localip6(self)
* _get_port0prefixlen6(self)
* _get_port1prefixlen6(self)
* _get_port0gateway6(self)
* _get_port1gateway6(self)

They are being removed as:
* _get_port* functions are already implemented and used in MultiPortConfig
* _get_route_data is an auxillary functions used by the previous ones
* _build_ports is implemented in the helpers

JIRA: YARDSTICK-1122
Change-Id: Ie7a706cd87b610ea56f89214118a02e612a70dc0
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
6 years agoImprove "Libvirt.create_snapshot_qemu" function 11/50711/24
Rodolfo Alonso Hernandez [Tue, 16 Jan 2018 15:55:02 +0000 (15:55 +0000)]
Improve "Libvirt.create_snapshot_qemu" function

Improved "Libvirt.create_snapshot_qemu" function:
- Check if the base image is present in the remote host.
  If not, try to copy from the execution host.
- Check the execution status. In case the command fails, raise an
  exception.

JIRA: YARDSTICK-944

Change-Id: I78bd0d3ed6a1f35ed772c0d192bb240009a580ed
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoUpdate neutron delete_neutron_net function. 01/54001/15
Shobhi Jain [Fri, 16 Mar 2018 13:07:55 +0000 (13:07 +0000)]
Update neutron delete_neutron_net function.

Update the changes done in patch [1].

JIRA: YARDSTICK-890

[1] https://gerrit.opnfv.org/gerrit/#/c/52361/

Change-Id: Iccbf16d0a2e72919d5092366241ff41686f01a58
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoReplace neutron create security group full with shade. 87/53987/13
Shobhi Jain [Fri, 16 Mar 2018 11:56:09 +0000 (11:56 +0000)]
Replace neutron create security group full with shade.

Function create_security_group_full now uses shade client.

Remove openstack util's private 'get_security_groups',
'get_security_group_id' & 'create_security_group' functions as
'create_security_group_full' now uses 'get_security_group' &
'create_security_group' function defined in shade client library.

JIRA: YARDSTICK-890

Change-Id: Ibd5b9ca9b7ce99b3e40c5dcc545f2af672ce2203
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoMerge "Remove tool provisioning in Standalone contexts"
Emma Foley [Mon, 16 Apr 2018 10:01:28 +0000 (10:01 +0000)]
Merge "Remove tool provisioning in Standalone contexts"

6 years agoGet HA test case results on failure 47/55247/5
Miikka Koistinen [Mon, 9 Apr 2018 14:40:39 +0000 (17:40 +0300)]
Get HA test case results on failure

Now, yardstick HA test cases (which have 'sla action: monitor') do
not output results if the test case SLA validation fails.
This patch modifies the task runner and the serviceHA scenario so
that during an SLA validation failure the test result data is
captured correctly.

Do similar changes in the general scenario.

JIRA: YARDSTICK-1115

Change-Id: I648a8b229600c0ad089320ac3f803698f73aa800
Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
6 years agoMerge "Bugfix: interface down HA tc050 attack and monitor logistic wrong"
Rex Lee [Mon, 16 Apr 2018 01:48:22 +0000 (01:48 +0000)]
Merge "Bugfix: interface down HA tc050 attack and monitor logistic wrong"

6 years agoAdd MQ consumer, producer and payload base classes 01/53901/10
Rodolfo Alonso Hernandez [Wed, 14 Mar 2018 11:27:25 +0000 (11:27 +0000)]
Add MQ consumer, producer and payload base classes

Added MessagingProducer base class. A class implementing this base class
can send a cast message using the MQ service installed in the Yardstick
jumphost (RabbitMQ by default, other MQ could be implemented). The producer
will send messages to an specific topic.

Added MessagingConsumer base class. A class implementing this base class
will be able to receive any message sent by a MessagingPorducer class
publishing messages in the topic subscribed.

By default both Producer and Consumer "fanout" is True. That means every
Consumer will create a fanout Queue attached to the MQ Exchange topic. All
Consumers attached to this topic will receive the message sent by the
Producer [1].

Added Payload base class. To send data through the message queue service,
a Payload derived object should be created. This base class allows to
define the attributes container in the class, convert the object to a dict
and retrieve the object from a dict.

Added a new library, "oslo.messaging", to implement the RPC client and
server.

[1]http://blog.thedigitalcatonline.com/blog/2013/08/21/some-tips-about-amqp-direct-exchanges/

JIRA: YARDSTICK-1074

Change-Id: I63932b5fb3de2bdc1270fc83295630a2a349e2a6
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoBugfix: interface down HA tc050 attack and monitor logistic wrong 19/55519/6
rexlee8776 [Thu, 12 Apr 2018 06:53:17 +0000 (06:53 +0000)]
Bugfix: interface down HA tc050 attack and monitor logistic wrong

1. simplify the attack to be one interface
2. move monitor step before attack
3. update rst doc to match

JIRA: YARDSTICK-1120

Change-Id: Icfa21d58e7ccdbeaca8a9a1a3098cceb21c981c3
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
6 years agoMerge "Bugfix: to list all used loop device"
Rodolfo Alonso Hernandez [Fri, 13 Apr 2018 07:36:45 +0000 (07:36 +0000)]
Merge "Bugfix: to list all used loop device"

6 years agoMerge "Bugfix: Can't get image list in API"
Jing Lu [Fri, 13 Apr 2018 02:46:38 +0000 (02:46 +0000)]
Merge "Bugfix: Can't get image list in API"

6 years agoBugfix: to list all used loop device 63/55563/3
ting wu [Thu, 12 Apr 2018 10:31:37 +0000 (12:31 +0200)]
Bugfix: to list all used loop device

Bug fix in script "build_yardstick_image.yml", to

- Use option "-a" to list all used loop devices, to be more compatible.
- Ignore the error and continue, if the debug command failed.

JIRA: YARDSTICK-1121

Change-Id: I24aaebb2ffe3107ca5c619401725aa8c8e1af295
Signed-off-by: ting wu <ting.wu@enea.com>
6 years agoBugfix: Can't get image list in API 69/54769/7
chenjiankun [Tue, 3 Apr 2018 06:23:42 +0000 (06:23 +0000)]
Bugfix: Can't get image list in API

JIRA: YARDSTICK-1110

To match OpenStack Pike release, we upgrade novaclient from 7.1.1 to 9.1.1.
And the client interface has changed, it no longer has nova_client.images attribute.
So I use shade instead. Later will change all same issue.

Change-Id: Ie4f54069d4346e44e2ad925439930504b945cbad
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>