yardstick.git
6 years agoInstall RabitMQ for RPC messaging between processes 97/53597/7
Rodolfo Alonso Hernandez [Mon, 12 Mar 2018 17:03:30 +0000 (17:03 +0000)]
Install RabitMQ for RPC messaging between processes

In NetworkServices Tescases, the TGs (traffic generators) run the traffic in
a separate process. In order to synchronize the traffic injection and the
runner interval loops, an RPC server is needed to publish/subscribe events.

RabbitMQ is a well supported MQ in Linux (used in OpenStack or collectd)
and supported by Python implemented projects like oslo.messaging [1].

RabbitMQ default configuration:
- Port: 5672
- User/password: yardstick/yardstick

[1]https://github.com/openstack/oslo.messaging

JIRA: YARDSTICK-1068

Change-Id: I15db294ee430fb38e574a59b9ce1bf0f8b651a67
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoAdd "Scenario" class wait methods for runners 71/53571/8
Rodolfo Alonso Hernandez [Mon, 12 Mar 2018 14:14:57 +0000 (14:14 +0000)]
Add "Scenario" class wait methods for runners

"Duration" and "Iteration" runners execute a passive wait during the
execution of the work process. This wait time is done at the end of
the scenario "run" method execution.

This patch adds a pre-run and post-run wait period, which will
depends on the Scenario executed. The wait time will be always the
same, but the execution order (pre-wait time, run method, post-wait
time) will depends on the Scenario.

By default, any Scenario will execute the "run" method and them will
wait the specified time.

NetworkServicesTestCase Scenario will wait the specified time and them
will execute the "run" method to retrieve the KPIs.

JIRA: YARDSTICK-1067

Change-Id: I6ad6bfc6978815b6b2d4df63f2ac2f8815fb5b8a
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoMake "Scenario" class abstract 35/53535/6
Rodolfo Alonso Hernandez [Mon, 12 Mar 2018 12:44:52 +0000 (12:44 +0000)]
Make "Scenario" class abstract

All scenario child classes must implement "run" method.

JIRA: YARDSTICK-1065

Change-Id: I35b78e380620967b49cd8cd23777a1aee6dfd140
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoImprove "Libvirt.virsh_destroy_vm" function 95/50695/17
Rodolfo Alonso Hernandez [Tue, 16 Jan 2018 11:19:05 +0000 (11:19 +0000)]
Improve "Libvirt.virsh_destroy_vm" function

Read the command exit code and log a warning in case the VM destroy
process went wrong.

JIRA: YARDSTICK-943

Change-Id: I2750b8d4a8f67af081c1988510cf5aca848a2cf1
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoImprove NSB Standalone XML generation 53/50653/19
Rodolfo Alonso Hernandez [Mon, 15 Jan 2018 14:25:46 +0000 (14:25 +0000)]
Improve NSB Standalone XML generation

Delayed the generation of the XML file until the last step. The
following functions will return a XML string insted:
- Libvirt.build_vm_xml
- SriovContext._enable_interfaces
- OvsDpdkContext._enable_interfaces

The XML file will be written just before copying the file to the
compute hosting the VMs.

JIRA: YARDSTICK-939

Change-Id: Icc80f4741903bbe335db4ebccab395b72fa87e82
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoImprove OVS-DPDK setup process 51/50551/20
Rodolfo Alonso Hernandez [Sat, 13 Jan 2018 11:16:34 +0000 (11:16 +0000)]
Improve OVS-DPDK setup process

Improved OVS-DPDK setup process:
- Added log string for each command executed.
- Removed unnecessary 'kill' command.
- Check if commands are executed correctly.

JIRA: YARDSTICK-922

Change-Id: I09fba96ffa39cde1e000a3c4382d474219c99985
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoImprove "Libvirt.virsh_create_vm" function 91/50691/15
Rodolfo Alonso Hernandez [Tue, 16 Jan 2018 11:03:17 +0000 (11:03 +0000)]
Improve "Libvirt.virsh_create_vm" function

Read the command exit code and raise an exception in case the VM boot
process went wrong.

JIRA: YARDSTICK-941

Change-Id: Ibabaae8983213a33799ad00fa4d9541bbabea857
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoImprove OVS-DPDK boot process 49/50449/18
Rodolfo Alonso Hernandez [Wed, 10 Jan 2018 19:42:57 +0000 (19:42 +0000)]
Improve OVS-DPDK boot process

Check if hugepages are present in the system.
Check if every command executed during the boot up process
exits correctly.

JIRA: YARDSTICK-917

Change-Id: Ic0c8a72199ad80e3a65488cc88d0692863751284
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoMerge "Offline support for bottlenecks project"
Rex Lee [Wed, 21 Mar 2018 08:51:37 +0000 (08:51 +0000)]
Merge "Offline support for bottlenecks project"

6 years agoMerge "Enforce pip version during installation"
Rex Lee [Wed, 21 Mar 2018 08:18:24 +0000 (08:18 +0000)]
Merge "Enforce pip version during installation"

6 years agoMerge "Replace neutron router creation with shade."
Rex Lee [Wed, 21 Mar 2018 08:13:02 +0000 (08:13 +0000)]
Merge "Replace neutron router creation with shade."

6 years agoTC042 bug fix 65/54065/7
liyin [Sun, 18 Mar 2018 14:51:19 +0000 (14:51 +0000)]
TC042 bug fix

JIRA:YARDSTICK-786

yardstick DPDK image have problems to build.
We will fix this by using nsb image
the pktgen DPDK testcase will use sampleVNF image

Change-Id: I24b7b6a9acfe21ec956fa9c4ee7ebe7ae1787dbb
Signed-off-by: liyin <liyin11@huawei.com>
6 years agoOffline support for bottlenecks project 91/53291/4
liyin [Thu, 8 Mar 2018 17:54:07 +0000 (17:54 +0000)]
Offline support for bottlenecks project

JIRA: YARDSTICK-1053

Those three yaml files are for bottlenecks support offiline flavor
The ssh time out problem will fix in changing the duration time

Change-Id: Ifd317404a820d0446ffab5070211e48def1a0d2f
Signed-off-by: liyin <liyin11@huawei.com>
6 years agoAdd k8-nosdn-stor4nfv-ha/noha scenario 31/54231/1
chenjiankun [Wed, 21 Mar 2018 02:30:02 +0000 (02:30 +0000)]
Add k8-nosdn-stor4nfv-ha/noha scenario

JIRA: YARDSTICK-1090

We have k8-nosdn-stor4nfv-ha/noha scenario in compass,
so we need to add this files to trigger it.

Change-Id: Iefa3a83407bff7d3c1de1959f35b6d8e5eecd145
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
6 years agoBugfix: update test case base on node parameters in ci 79/54179/4
rexlee8776 [Tue, 20 Mar 2018 09:14:16 +0000 (09:14 +0000)]
Bugfix: update test case base on node parameters in ci

JIRA: YARDSTICK-1082

Change-Id: I00080d0317a54b73a6cd571198e9446962c11b5a
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
6 years agoMerge "Fix for datasource field value"
Rex Lee [Wed, 21 Mar 2018 01:45:10 +0000 (01:45 +0000)]
Merge "Fix for datasource field value"

6 years agoMerge "Fix retrieving "options" section in "scenario""
Ross Brattain [Tue, 20 Mar 2018 23:04:07 +0000 (23:04 +0000)]
Merge "Fix retrieving "options" section in "scenario""

6 years agoMerge "Add "YARDSTICK_REPO_DIR" into tests path"
Ross Brattain [Tue, 20 Mar 2018 23:01:36 +0000 (23:01 +0000)]
Merge "Add "YARDSTICK_REPO_DIR" into tests path"

6 years agoMerge "Modify the Docker diff file for ARM64"
Ross Brattain [Tue, 20 Mar 2018 23:00:03 +0000 (23:00 +0000)]
Merge "Modify the Docker diff file for ARM64"

6 years agoenv: validate installer_ip from environment 59/53359/2
Ross Brattain [Thu, 8 Mar 2018 22:45:06 +0000 (14:45 -0800)]
env: validate installer_ip from environment

validate installer_ip is proper IPv4 address in case of user error

Change-Id: Ib01916bc85ec411c159af1564f5142177f464047
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoFix for datasource field value 13/54213/1
Mika Rautakumpu [Tue, 20 Mar 2018 17:33:15 +0000 (19:33 +0200)]
Fix for datasource field value

This is fix for grafana dashboard templates
where variable "${DS_YARDSTICK}" is replaced
by "yardstick".

JIRA: YARDSTICK-1089

Change-Id: I0647d5bfd772a2d9ffa18bac59cdbbb39c8ec0ab
Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
6 years agoReplace neutron floating ip creation with shade. 63/52663/18
Shobhi Jain [Fri, 23 Feb 2018 14:59:09 +0000 (14:59 +0000)]
Replace neutron floating ip creation with shade.

Function create_floating_ip now uses shade client instead of neutron
client.

JIRA: YARDSTICK-890

Change-Id: I3defd691dad998cebf98442b52f0555b176f1af4
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoReplace neutron router interface deletion with shade. 55/52455/14
Shobhi Jain [Wed, 21 Feb 2018 16:13:16 +0000 (16:13 +0000)]
Replace neutron router interface deletion with shade.

Function remove_interface_router now uses shade client instead of neutron
client.

JIRA: YARDSTICK-890

Change-Id: I6bd36e35a339cce64dfa8b69c1e7b56cd70af956
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoReplace neutron router creation with shade. 09/52409/25
Shobhi Jain [Wed, 21 Feb 2018 14:45:21 +0000 (14:45 +0000)]
Replace neutron router creation with shade.

Function create_neutron_router now uses shade client instead of neutron
client.

JIRA: YARDSTICK-890

Change-Id: I819d26f4edb3af5e50f777e8ddbadf4d24820b7f
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoEnforce pip version during installation 03/54203/3
Rodolfo Alonso Hernandez [Tue, 20 Mar 2018 14:26:09 +0000 (14:26 +0000)]
Enforce pip version during installation

Currently there is a reported problem in pip library [1]. To avoid this
problem, the pip version should be enforced during the installation.

[1]https://github.com/pypa/pip/issues/5079

JIRA: YARDSTICK-1087

Change-Id: I2ee28749f146cd3b0e1bf4ed92b51cbe6db8b2f3
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoAdd "YARDSTICK_REPO_DIR" into tests path 99/54199/2
ting wu [Tue, 20 Mar 2018 13:17:28 +0000 (14:17 +0100)]
Add "YARDSTICK_REPO_DIR" into tests path

In the CI flow, script "load_images.sh",
variable ${YARDSTICK_REPO_DIR} needs to be added
in front of tests path to avoid the error:

sed: can't read tests/opnfv/test_cases/*:
No such file or directory

This fix is specific to arm64

JIRA: YARDSTICK-1086

Change-Id: If19b295233bb7313226dae70df016ad236bed2ac
Signed-off-by: ting wu <ting.wu@enea.com>
6 years agoMerge "update scenario test cases according to gating release"
Emma Foley [Tue, 20 Mar 2018 13:24:11 +0000 (13:24 +0000)]
Merge "update scenario test cases according to gating release"

6 years agoMerge "Bugfix: sutie -> suite in documentation"
Emma Foley [Tue, 20 Mar 2018 13:18:39 +0000 (13:18 +0000)]
Merge "Bugfix: sutie -> suite in documentation"

6 years agoDashboard for TC056 81/54181/2
Mika Rautakumpu [Tue, 20 Mar 2018 09:22:55 +0000 (11:22 +0200)]
Dashboard for TC056

This is dashboard for Yardstick test case TC056.

JIRA: YARDSTICK-1085

Change-Id: I8bf2149f8dd9081022deb280101815cb1dd417ec
Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
6 years agoRunning Test Case in Latest Yardstick Docker Image shows Error 71/54171/1
chenjiankun [Tue, 20 Mar 2018 08:11:39 +0000 (08:11 +0000)]
Running Test Case in Latest Yardstick Docker Image shows Error

JIRA: YARDSTICK-1080

This bug will only occur in kubernetes test case.
In openstack, we use 'stack_name.context', but some kubernetes
resources(pod, etc) do not support this format. So we use
'name-context'.

Change-Id: I87d61c027d55449914bc283672eb98be3d3fe22f
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
6 years agoupdate scenario test cases according to gating release 57/54157/1
rexlee8776 [Tue, 20 Mar 2018 06:30:30 +0000 (06:30 +0000)]
update scenario test cases according to gating release

JIRA: YARDSTICK-1046

Change-Id: I12223876d1cf1f3e45152f6b7996b75a66b16fe6
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
6 years agoyardstick image: use growpart instead of parted 27/53727/7
Ross Brattain [Tue, 13 Mar 2018 22:10:42 +0000 (15:10 -0700)]
yardstick image: use growpart instead of parted

parted doesn't handle growing GPT partition correctly, so switch to
growpart

see https://github.com/opnfv/fuel/blob/master/mcp/scripts/lib.sh#L133

for example

If the yardstick image uses GPT then parted complains about the GPT
table

The warning is "Warning: Not all of the space available to
DEVICE appears to be used, you can fix the GPT to use all
of the space (an extra 500 blocks) or continue with the
current setting?"

The backup GPT table is not at the end of the
disk, as it should be. This might mean that
another operating system believes the disk is
smaller. Fix, by moving the backup to the end
(and removing the old backup)?

echo 'f' to fix the GPT table

Instead use growpart

JIRA: YARDSTICK-1058

Change-Id: Ib0e90feef1e3766408b4f742036f2a48af942f32
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoBugfix: sutie -> suite in documentation 77/54077/2
chenjiankun [Mon, 19 Mar 2018 07:24:02 +0000 (07:24 +0000)]
Bugfix: sutie -> suite in documentation

Change-Id: Ia898a7a6d95e74b16cfc754b615cccfd9c5380ad
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
6 years agoBugfix: storperf fails on ci when install plugin 71/54071/3
rexlee8776 [Mon, 19 Mar 2018 03:57:09 +0000 (03:57 +0000)]
Bugfix: storperf fails on ci when install plugin

JIRA: YARDSTICK-1060

Change-Id: I6356bf16c547a1bd15f83f3ff6390822b7980f28
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
6 years agotemp unblock unittests 83/54083/2
Ross Brattain [Mon, 19 Mar 2018 08:22:57 +0000 (01:22 -0700)]
temp unblock unittests

======================================================================
ERROR: common.test_packages (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: common.test_packages
Traceback (most recent call last):
  File "/usr/lib/python3.5/unittest/loader.py", line 428, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib/python3.5/unittest/loader.py", line 369, in _get_module_from_name
    __import__(name)
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/yardstick/tests/unit/common/test_packages.py", line 17, in <module>
    from pip.operations import freeze
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/__init__.py", line 45, in <module>
    from pip.vcs import git, mercurial, subversion, bazaar  # noqa
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/vcs/mercurial.py", line 9, in <module>
    from pip.download import path_to_url
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/download.py", line 40, in <module>
    from pip._vendor import requests, six
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/_vendor/requests/__init__.py", line 98, in <module>
    from . import packages
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/_vendor/requests/packages.py", line 12, in <module>
    sys.modules['pip._vendor.requests.packages.' + mod] = sys.modules["pip._vendor." + mod]
KeyError: 'pip._vendor.urllib3.contrib'

 File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/yardstick/tests/unit/common/test_packages.py", line 16, in <module>
    from pip import exceptions as pip_exceptions

======================================================================
ERROR: common.test_packages (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: common.test_packages
Traceback (most recent call last):
  File "/usr/lib/python3.5/unittest/loader.py", line 428, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib/python3.5/unittest/loader.py", line 369, in _get_module_from_name
    __import__(name)
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/yardstick/tests/unit/common/test_packages.py", line 16, in <module>
    from pip import exceptions as pip_exceptions
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/__init__.py", line 45, in <module>
    from pip.vcs import git, mercurial, subversion, bazaar  # noqa
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/vcs/mercurial.py", line 9, in <module>
    from pip.download import path_to_url
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/download.py", line 40, in <module>
    from pip._vendor import requests, six
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/_vendor/requests/__init__.py", line 98, in <module>
    from . import packages
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/_vendor/requests/packages.py", line 12, in <module>
    sys.modules['pip._vendor.requests.packages.' + mod] = sys.modules["pip._vendor." + mod]
KeyError: 'pip._vendor.urllib3.packages.backports.makefile'

Change-Id: I43b1edc23cebe0db97b6b56a551acd376986dfea
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoMerge "Add ODL noHA testcase"
Ross Brattain [Fri, 16 Mar 2018 20:39:55 +0000 (20:39 +0000)]
Merge "Add ODL noHA testcase"

6 years agoMerge "Improve ansible code for network xml creation"
Rodolfo Alonso Hernandez [Fri, 16 Mar 2018 17:21:03 +0000 (17:21 +0000)]
Merge "Improve ansible code for network xml creation"

6 years agoMerge "NSB userguide: run TC in heat context & sriov ports"
Rodolfo Alonso Hernandez [Fri, 16 Mar 2018 17:20:43 +0000 (17:20 +0000)]
Merge "NSB userguide: run TC in heat context & sriov ports"

6 years agoMerge "NSB PROX L3FWD Dropping packets"
Abhijit Sinha [Fri, 16 Mar 2018 17:19:20 +0000 (17:19 +0000)]
Merge "NSB PROX L3FWD Dropping packets"

6 years agoMerge "Replace assert statements in tests"
Abhijit Sinha [Fri, 16 Mar 2018 17:17:47 +0000 (17:17 +0000)]
Merge "Replace assert statements in tests"

6 years agoNSB userguide: run TC in heat context & sriov ports 05/52405/4
Mytnyk, Volodymyr [Wed, 21 Feb 2018 14:08:16 +0000 (14:08 +0000)]
NSB userguide: run TC in heat context & sriov ports

Add section that describeds steps to be able to run
sample vFW TC in heat context with sriov ports
confiured in the OpenStack.

JIRA: YARDSTICK-1022

Change-Id: I764933e26ca7cb10aa1094901ec3304156054333
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
6 years agoMerge "Supporting user config task parameters in GUI"
Jack Chan [Fri, 16 Mar 2018 09:01:07 +0000 (09:01 +0000)]
Merge "Supporting user config task parameters in GUI"

6 years agoMerge "Update API documentation"
Jack Chan [Fri, 16 Mar 2018 09:00:55 +0000 (09:00 +0000)]
Merge "Update API documentation"

6 years agoMerge "Add SUT page in GUI"
Jack Chan [Fri, 16 Mar 2018 09:00:21 +0000 (09:00 +0000)]
Merge "Add SUT page in GUI"

6 years agoMerge "Create API to get SUT information"
Jack Chan [Fri, 16 Mar 2018 09:00:05 +0000 (09:00 +0000)]
Merge "Create API to get SUT information"

6 years agoMerge "testcase start service script fail on centos env"
Jing Lu [Fri, 16 Mar 2018 08:45:29 +0000 (08:45 +0000)]
Merge "testcase start service script fail on centos env"

6 years agoAdd SUT page in GUI 23/53923/1
chenjiankun [Fri, 16 Mar 2018 02:44:42 +0000 (02:44 +0000)]
Add SUT page in GUI

JIRA: YARDSTICK-1076

We need to show SUT information in GUI.

Change-Id: I885773894fc9f6aa5975b39383af1fdf1b88b8bb
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
6 years agoTest case description and configuration file for yardstick_tc090:Control 59/53159/2
tjuyinkanglin [Tue, 6 Mar 2018 12:07:05 +0000 (20:07 +0800)]
Test case description and configuration file for yardstick_tc090:Control
Node Openstack Service High Availability - Database Instances

JIRA: YARDSTICK-960

Change-Id: Ibe47a9b4d1f095971857fcbaee57a3c7f64f9911
Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
6 years agoTest case description and configuration file for yardstick_tc091:Control 47/53147/3
tjuyinkanglin [Tue, 6 Mar 2018 07:30:40 +0000 (15:30 +0800)]
Test case description and configuration file for yardstick_tc091:Control
Node Openstack Service High Availability - Heat Api

JIRA: YARDSTICK-961

Change-Id: I49fc2b2d8fc4fa090a74f1838f5ac386e39eaf49
Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
6 years agoNSB PROX L3FWD Dropping packets 27/52827/5
DanielMartinBuckley [Wed, 28 Feb 2018 13:56:53 +0000 (13:56 +0000)]
NSB PROX L3FWD Dropping packets

JIRA: YARDSTICK-1037

NSB PROX L3FWD was incorrect. The routing table (ipv4.lua) was incorrect.
Also a specific ipv4 for 2 port configuration is required.

Change-Id: I3a5fd1ea1d1ddf74cbdd6a5d9e7ced42d3c1d6e9
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
6 years agoMerge "support for Bottlenecks soak throughputs"
Jing Lu [Thu, 15 Mar 2018 08:40:19 +0000 (08:40 +0000)]
Merge "support for Bottlenecks soak throughputs"

6 years agoCreate API to get SUT information 69/53769/6
chenjiankun [Wed, 14 Mar 2018 09:41:01 +0000 (09:41 +0000)]
Create API to get SUT information

JIRA: YARDSTICK-1072

We need to show SUT information in GUI.

Change-Id: I40bcd513f3c6a443c82764687637ac5258b99584
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
6 years agoUpdate API documentation 49/53649/2
chenjiankun [Tue, 13 Mar 2018 08:24:56 +0000 (08:24 +0000)]
Update API documentation

JIRA: YARDSTICK-1070

Our current API documentation is out-of-date.
We need to update it.

Change-Id: If5133c0350a91affb8d3f856d23b23a9903c8620
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
6 years agosupport for Bottlenecks soak throughputs 49/53149/4
Yang Yu [Tue, 6 Mar 2018 08:50:33 +0000 (16:50 +0800)]
support for Bottlenecks soak throughputs

JIRA: YARDSTICK-1049

Changes:
1. NetperfNode -> Netperf, it seems that yardstick-image has not
correctly complied Netperf since cpuutil is not available,
resulting that LOCAL_CPU_UTIL=-1 for the output. Will create
another JIRA ticket for this.

Change-Id: I26a85f4aafcc5d5e1eda3e04272ecf3b059238fc
Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com>
6 years agoMerge "Add "YARD_IMG_ARCH" input variable to "build_yardstick_image.yml""
Rex Lee [Wed, 14 Mar 2018 21:44:13 +0000 (21:44 +0000)]
Merge "Add "YARD_IMG_ARCH" input variable to "build_yardstick_image.yml""

6 years agoFix retrieving "options" section in "scenario" 85/53785/2
Rodolfo Alonso Hernandez [Wed, 14 Mar 2018 11:46:53 +0000 (11:46 +0000)]
Fix retrieving "options" section in "scenario"

In [1] a new method to rename the "scenario" host names was implemented.
This method parses all sections with host names and applies the
"qualified" name.

Some malformed test cases define the "options" section without content.
This causes that [2] retrieves "None" value instead of an empty
dictionary. This possibility must be handled in the new method.

[1]I44da30dac562c1a4166e084645ae91c17798651d
[2]https://github.com/opnfv/yardstick/blob/4b8b674b65830a24230faed71e8d9a1048139c89/yardstick/benchmark/core/task.py#L630

JIRA: YARDSTICK-1073

Change-Id: I8864b428734ead8c5aa39de5091d3a2a691be060
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoImprove ansible code for network xml creation 25/52225/2
John O Loughlin [Fri, 16 Feb 2018 10:29:44 +0000 (10:29 +0000)]
Improve ansible code for network xml creation

JIRA: YARDSTICK-1018

Change-Id: Ia94fb1ceb9cb55bd54e512f356f85a263c32d1cf
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
6 years agoAdd "YARD_IMG_ARCH" input variable to "build_yardstick_image.yml" 63/53663/3
Rodolfo Alonso Hernandez [Tue, 13 Mar 2018 10:44:50 +0000 (10:44 +0000)]
Add "YARD_IMG_ARCH" input variable to "build_yardstick_image.yml"

"YARD_IMG_ARCH" variable is added as input parameter to
"build_yardstick_image.yml" ansible script, in order to generate
the correct image for the running architecture.

JIRA: YARDSTICK-1058

Change-Id: I33954c236695478eaae34fcfca2e9d5b40791bbf
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoMerge "Get SUT information"
Jack Chan [Wed, 14 Mar 2018 06:33:38 +0000 (06:33 +0000)]
Merge "Get SUT information"

6 years agoTest case spec for SDN controller resilience in non-HA config 45/49245/11
Georg Kunz [Mon, 18 Dec 2017 19:05:14 +0000 (11:05 -0800)]
Test case spec for SDN controller resilience in non-HA config

This is the test case specification for verifying the HA capabilities of
a SDN controller running in a non-HA configuration.

JIRA: HA-31
JIRA: YARDSTICK-955

Change-Id: I10f9ce4a2888092c033d2c02bf9a5a950b8b12dc
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
6 years agoMerge "Add support for VNC to VMs created by ansible"
Ross Brattain [Tue, 13 Mar 2018 00:09:22 +0000 (00:09 +0000)]
Merge "Add support for VNC to VMs created by ansible"

6 years agoMerge "[Bug Fix] Support nova create instance operation"
Ross Brattain [Tue, 13 Mar 2018 00:00:11 +0000 (00:00 +0000)]
Merge "[Bug Fix] Support nova create instance operation"

6 years agoModify the Docker diff file for ARM64 13/53313/3
Rodolfo Alonso Hernandez [Thu, 8 Mar 2018 15:07:08 +0000 (15:07 +0000)]
Modify the Docker diff file for ARM64

In I5d9e135449b2d35f051ecf5fa63a1ce11030de4a the Dockerfile was modified.
Until we can handle the Dockerfile generation for each architecture in a
better way, we need to keep updated the Docker diff file for ARM64.

JIRA: YARDSTICK-1030

Change-Id: Ibd9224dcb9a7a897b0da8aab126f62983b5e70bd
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoMerge changes from topics 'delete_router', 'neutron_subnet_create', 'neutron_create'
Emma Foley [Mon, 12 Mar 2018 13:26:12 +0000 (13:26 +0000)]
Merge changes from topics 'delete_router', 'neutron_subnet_create', 'neutron_create'

* changes:
  Replace neutron router deletion with shade.
  Replace neutron subnet creation with shade.
  Replace neutron network creation with shade.

6 years agoMerge "Add context name to Dummy test"
Abhijit Sinha [Mon, 12 Mar 2018 12:01:49 +0000 (12:01 +0000)]
Merge "Add context name to Dummy test"

6 years agoMerge "Reduce the log level if TRex client is no connected"
Emma Foley [Mon, 12 Mar 2018 11:55:18 +0000 (11:55 +0000)]
Merge "Reduce the log level if TRex client is no connected"

6 years agoReplace neutron router deletion with shade. 61/52361/22
Shobhi Jain [Mon, 19 Feb 2018 16:50:51 +0000 (16:50 +0000)]
Replace neutron router deletion with shade.

Function delete_neutron_router now uses shade client instead of neutron
client.

JIRA: YARDSTICK-890

Change-Id: I5b557b640396f343b85b5f5eff415384decc083c
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoReplace neutron subnet creation with shade. 39/51839/22
Shobhi Jain [Wed, 7 Feb 2018 11:08:05 +0000 (11:08 +0000)]
Replace neutron subnet creation with shade.

Function 'create_neutron_subnet' now uses shade client
instead of neutron client.

JIRA: YARDSTICK-890

Change-Id: I8eb5295cecd73742bfb5a7d0764af6f45ef0685e
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoReplace neutron network creation with shade. 69/51769/27
Shobhi Jain [Mon, 5 Feb 2018 15:18:43 +0000 (15:18 +0000)]
Replace neutron network creation with shade.

Function create_neutron_net now uses shade client instead of neutron
client.

JIRA: YARDSTICK-890

Change-Id: I456078e98550901c1f736640c9f9bd0d5f9c3df6
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
6 years agoAdd support for VNC to VMs created by ansible 23/52223/5
John O Loughlin [Fri, 16 Feb 2018 09:24:49 +0000 (09:24 +0000)]
Add support for VNC to VMs created by ansible

JIRA: YARDSTICK-1017

Change-Id: I76ca53c12a6791ecbf7f546f9074b16c5f6d215a
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
6 years agoMerge "assertTrue(mock.called) -> mock.assert_called"
Rodolfo Alonso Hernandez [Mon, 12 Mar 2018 09:53:40 +0000 (09:53 +0000)]
Merge "assertTrue(mock.called) -> mock.assert_called"

6 years agoMerge "Update the fuel pod.yaml"
Ross Brattain [Mon, 12 Mar 2018 09:06:04 +0000 (09:06 +0000)]
Merge "Update the fuel pod.yaml"

6 years agoMerge changes from topic 'YARDSTICK-1040'
Ross Brattain [Mon, 12 Mar 2018 09:05:24 +0000 (09:05 +0000)]
Merge changes from topic 'YARDSTICK-1040'

* changes:
  Fetch Nova instance's private IP
  Assign nova instance to security group

6 years agoGet SUT information 85/53485/3
chenjiankun [Mon, 12 Mar 2018 02:27:26 +0000 (02:27 +0000)]
Get SUT information

JIRA: YARDSTICK-1063

We have the demand to get SUT information.
In this patch, we use ansible to get the SUT information.

Change-Id: I983675d6d367fa528f00c1b50bc6fa2a9cee03f7
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
6 years agoDo NOT hardcode interface speed for PROX tests 47/53247/19
DanielMartinBuckley [Wed, 7 Mar 2018 18:09:12 +0000 (18:09 +0000)]
Do NOT hardcode interface speed for PROX tests

JIRA: YARDSTICK-1035

Do not hardcode NIC/interface speed in PROX test. Test assumes
NIC used is 10Gbps. This is incorrect. It could support 1Gbps,
10Gbps, 25Gbps, 40Gbps or something else.

This is used to calculate pps (Packets Per Second)
In Baremetal the NIC speed could be extracted. however when
run on a virtual machine this is not possible.

Solution:
Add in options section of test file.

eg.
Options:
  interface_speed_gbps: 10

Where 10 refers to a 10Gbps. In a setup where multiple interfaces
are used. This will refer to the speed of the slowest connection.

Change-Id: I89ab16479a2cdd1d79e52cbcc5a972762c60d057
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
6 years agoMake Sample VNF hugepages size configurable 09/53409/1
Rodolfo Alonso Hernandez [Fri, 9 Mar 2018 13:19:22 +0000 (13:19 +0000)]
Make Sample VNF hugepages size configurable

The amount of hugepages claimed for a Sample VNF is always 16GB. This
value is excesive for most of the Sample VNF applications (except for vPE).

Making this parameter configurable we allow to spawn smaller VMs by using
less hugepages (in case of StandAlone and OpenStack deployments).

Because this parameter depends on the Scenario and the type of VNF executed,
the parameter is located in:

  scenarios: {options: hugepages_gb} # number of GB of hugepages claimed

PENDING: document this new parameter. A new userguide section should be
         created to document all "scenario" sections and parameters.

JIRA: YARDSTICK-1061

Change-Id: I6f082e105289bd01781be18f2fecbe0ba2fdfdee
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoAdd context name to Dummy test 07/53407/1
Rodolfo Alonso Hernandez [Fri, 9 Mar 2018 13:41:57 +0000 (13:41 +0000)]
Add context name to Dummy test

Since I1447fb5ed447691eaeb0a97f928c0b3333799d07, the context name is
a mandatory parameter for every context.

JIRA: YARDSTICK-886

Change-Id: I0ccb7e9fabdf6bc2890d2e4763f53baee06c87b2
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years ago[Bug Fix] Support nova create instance operation 27/53027/4
Dimitrios Markou [Sat, 3 Mar 2018 01:26:41 +0000 (03:26 +0200)]
[Bug Fix] Support nova create instance operation

Add the ability to create a nova instance through the
operation perspective

JIRA: YARDSTICK-1038

Change-Id: Idac141958d65cc6c53b6bd27df83ac74ae8804ec
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
6 years agoReduce the log level if TRex client is no connected 23/53323/1
Rodolfo Alonso Hernandez [Thu, 8 Mar 2018 16:42:59 +0000 (16:42 +0000)]
Reduce the log level if TRex client is no connected

If the TRex client is no connected, the testcase will write an exception
log that will be thrown to the CLI. There is no need to show the
traceback in the CLI in this case.

The log level is reduced to "error".

JIRA: YARDSTICK-1059

Change-Id: I22a52cedd6479f4cf692ba16a8415f7b8f574ab1
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoMerge "Fix numbering and html (generated) alignment"
Emma Foley [Thu, 8 Mar 2018 16:10:49 +0000 (16:10 +0000)]
Merge "Fix numbering and html (generated) alignment"

6 years agoMerge "[bugfix] report generate command print error"
Rodolfo Alonso Hernandez [Thu, 8 Mar 2018 12:34:33 +0000 (12:34 +0000)]
Merge "[bugfix] report generate command print error"

6 years agoSupporting user config task parameters in GUI 99/53299/1
chenjiankun [Thu, 8 Mar 2018 12:18:27 +0000 (12:18 +0000)]
Supporting user config task parameters in GUI

JIRA: YARDSTICK-981

We need to add function to enable user to config task parameters in GUI.
The way to config must be more friendly.

Change-Id: I8746149084f1d554b48ed392f2fef4748e279dfb
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
6 years agoFetch Nova instance's private IP 33/52933/8
Dimitrios Markou [Thu, 1 Mar 2018 12:17:50 +0000 (14:17 +0200)]
Fetch Nova instance's private IP

Add the capability to fetch the private IP of a Nova
instance through the operation perspective.

JIRA: YARDSTICK-1040

Change-Id: Idc3d62bcd3f477a03a89f7dcc8d8616f3cfa2742
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
6 years agoAssign nova instance to security group 29/53029/9
Dimitrios Markou [Sat, 3 Mar 2018 01:38:31 +0000 (03:38 +0200)]
Assign nova instance to security group

Support the assigning of a nova instance to an
existing security group through the operation
perspective

Change-Id: Ic1c26031c25d400fede2ecb298a66aec42dcfbc5
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
6 years ago[bugfix] report generate command print error 95/53295/1
rexlee8776 [Thu, 8 Mar 2018 11:01:37 +0000 (11:01 +0000)]
[bugfix] report generate command print error

JIRA: YARDSTICK-1056

Change-Id: I32ab9ae7482f6b81e00d6d3e7e858d980a2dd95f
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
6 years agoAdd ODL noHA testcase 59/52159/25
Dimitrios Markou [Wed, 14 Feb 2018 16:54:12 +0000 (18:54 +0200)]
Add ODL noHA testcase

This testcase confirms the resiliency of Opendaylight
in a noHA deployment

SPEC: https://gerrit.opnfv.org/gerrit/#/c/49245/

Change-Id: I810011c35c7bb6377f9295330cf7122d10cf74c3
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
6 years agoMerge "Allow VMs to access internet"
Rodolfo Alonso Hernandez [Thu, 8 Mar 2018 09:54:35 +0000 (09:54 +0000)]
Merge "Allow VMs to access internet"

6 years agoUpdate the fuel pod.yaml 99/53099/7
Dimitrios Markou [Mon, 5 Mar 2018 14:52:12 +0000 (16:52 +0200)]
Update the fuel pod.yaml

Fuel except Controller and Compute nodes
it deploys an ODL node in noHA and HA deployment
and also a Gateway node in a noHA deployment.
So it is essential to describe them in Fuel's pod.

JIRA: YARDSTICK-1050

Change-Id: Iee6c25c5b2e2e4e661ceb0591bf2437f7f7fa7f8
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
6 years agoFix numbering and html (generated) alignment 05/53205/2
Dino Madarang [Wed, 7 Mar 2018 05:47:55 +0000 (21:47 -0800)]
Fix numbering and html (generated) alignment

Fix numbering from 3,5,6 to 3,4,5 and alignment
of the numbered list in HTML output.

Trim lines to 79 chars or less.

Change-Id: Icf233ef6bbf99ac0dcd8a9fc2599aee9dc1a46fd
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Reviewed-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Reviewed-by: Emma Foley <emma.l.foley@intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoMerge "NFVi Test stops after one hour even if configured context duration is longer"
Ross Brattain [Wed, 7 Mar 2018 19:05:14 +0000 (19:05 +0000)]
Merge "NFVi Test stops after one hour even if configured context duration is longer"

6 years agobugfix: fix prepare_env.sh shell quote 45/53245/2
Ross Brattain [Wed, 7 Mar 2018 16:09:03 +0000 (08:09 -0800)]
bugfix: fix prepare_env.sh shell quote

JIRA: YARDSTICK-1051

Change-Id: If28bc0f2fe2e3cdec95882bb2abedf839e6ac2e0
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoNFVi Test stops after one hour even if configured context duration is longer 21/52821/5
DanielMartinBuckley [Wed, 28 Feb 2018 11:55:44 +0000 (11:55 +0000)]
NFVi Test stops after one hour even if configured context duration is longer

JIRA: YARDSTICK-1021

If the Test is to take longer than the Default Duration timer use
defined test time.
If not use Default Duration time

Change-Id: Idacc188e199ff031310b9826238b63ed3f2ea409
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
6 years agoMerge "ansible: fix urlsplit('hostname') in convert_openrc"
Emma Foley [Wed, 7 Mar 2018 10:51:53 +0000 (10:51 +0000)]
Merge "ansible: fix urlsplit('hostname') in convert_openrc"

6 years agoMerge "Add l2fwd module in Tgen mode"
Jack Chan [Wed, 7 Mar 2018 01:55:05 +0000 (01:55 +0000)]
Merge "Add l2fwd module in Tgen mode"

6 years agoMerge "Add test case sample to enable mixed network"
Jack Chan [Wed, 7 Mar 2018 01:54:20 +0000 (01:54 +0000)]
Merge "Add test case sample to enable mixed network"

6 years agoMerge "add opnfv_k8-nosdn-lb_ceph-noha_daily.yaml"
Ross Brattain [Wed, 7 Mar 2018 01:52:55 +0000 (01:52 +0000)]
Merge "add opnfv_k8-nosdn-lb_ceph-noha_daily.yaml"

6 years agoMerge "[bugfix]tc006 failed due to volume attached to different location "/dev/vdc""
Rex Lee [Wed, 7 Mar 2018 01:14:36 +0000 (01:14 +0000)]
Merge "[bugfix]tc006 failed due to volume attached to different location "/dev/vdc""

6 years agoMerge "Add start service operation"
Ross Brattain [Tue, 6 Mar 2018 23:28:57 +0000 (23:28 +0000)]
Merge "Add start service operation"

6 years agoadd opnfv_k8-nosdn-lb_ceph-noha_daily.yaml 81/53181/1
Ross Brattain [Tue, 6 Mar 2018 18:32:00 +0000 (10:32 -0800)]
add opnfv_k8-nosdn-lb_ceph-noha_daily.yaml

https://build.opnfv.org/ci/job/yardstick-joid-baremetal-daily-master/2206/console

Change-Id: Ib5fc186caa285ef8f6a879fd1fd2f786b07a257a
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoMerge "Move SSH key generation from "init" to "deploy""
Emma Foley [Tue, 6 Mar 2018 17:21:43 +0000 (17:21 +0000)]
Merge "Move SSH key generation from "init" to "deploy""