Ross Brattain [Tue, 15 Aug 2017 03:21:06 +0000 (20:21 -0700)]
ACL: remove failing testing
test_instantiate_panic fails randomly sometimes
in Jenkins, the test doesn't really do anything
useful, so remove it
Change-Id: Ia44ebbe778b812ae1b4660d64e88bf029fed3701
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Rex Lee [Tue, 15 Aug 2017 01:13:40 +0000 (01:13 +0000)]
Merge "KVMFORNFV: Update Grafana config for Packet Forwarding test cases."
Jing Zhang [Thu, 25 May 2017 22:41:00 +0000 (18:41 -0400)]
Integrate vsperf in Tgen mode
Problem:
Running Vsperf in Tgen mode is supported but the integration is not complete at the code level
i.e. not ready-to-use, and dpdk loopback is not supported inside the VM.
Solution:
(1) Completely automates VM image generation and supports 1G huge pages.
(2) Adds a new test scenario VsperfDPDK for testpmd based loopback inside the VM.
Update 1-2: Fixed "line too long" issues not reported by local run_tests.sh (why?)
Update 3: Per comment change to use SSH.from_node() and add unit test cases
Update 4: Add more unit test cases for coverage and ready the code for merge
JIRA: YARDSTICK-661
Change-Id: Iea3014d4c83e1b0c079019a4ed27771d40a7eed8
Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
Ross Brattain [Tue, 15 Aug 2017 00:56:55 +0000 (00:56 +0000)]
Merge "Add yardstick report for each task"
Ross Brattain [Wed, 15 Mar 2017 18:50:29 +0000 (11:50 -0700)]
Ansible typo fix, whitespace
Change-Id: I3639ab84ab5b9e802e1bbd23674b0fbda46fdc66
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Mon, 24 Apr 2017 21:25:48 +0000 (23:25 +0200)]
PROX VNF and TG
PROX was added to samplevnf project
https://git.opnfv.org/samplevnf/tree/VNFs/DPPD-PROX
JIRA: YARDSTICK-638
Change-Id: If9875b1130c6bed87deb8720b0d8b28ede9289d9
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Mon, 14 Aug 2017 15:41:10 +0000 (15:41 +0000)]
Merge "cli: typo, s/dispath/dispatch/g"
chenjiankun [Mon, 14 Aug 2017 02:47:29 +0000 (02:47 +0000)]
Add yardstick report for each task
JIRA: YARDSTICK-784
Currently we have yardstick report in GUI.
But if users do not use GUI, they can't see this report.
So we need generate a report each task.
After run each test case, we can see report:
http://ip:port/report/report.html
Change-Id: Ic76cf57f55aa6680b91272e210135136f0225373
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
Ross Brattain [Sun, 13 Aug 2017 19:09:53 +0000 (12:09 -0700)]
cli: typo, s/dispath/dispatch/g
Change-Id: I3df6bc606f2ac78baf611aee22b9247f6f9d5136
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Deepak S [Sat, 12 Aug 2017 23:57:06 +0000 (16:57 -0700)]
Move the comment above the config parameter line to avoid the expection
Traceback (most recent call last):
File "/opt/nsb_bin/yardstick_venv/lib/python2.7/site-packages/yardstick-0.1.dev0-py2.7.egg/yardstick/cmd/commands/task.py", line 54, in do_start
result = Task().start(param, **kwargs)
File "/opt/nsb_bin/yardstick_venv/lib/python2.7/site-packages/yardstick-0.1.dev0-py2.7.egg/yardstick/benchmark/core/task.py", line 148, in start
self._do_output(output_config, result)
File "/opt/nsb_bin/yardstick_venv/lib/python2.7/site-packages/yardstick-0.1.dev0-py2.7.egg/yardstick/benchmark/core/task.py", line 227, in _do_output
dispatchers = DispatcherBase.get(output_config)
File "/opt/nsb_bin/yardstick_venv/lib/python2.7/site-packages/yardstick-0.1.dev0-py2.7.egg/yardstick/dispatcher/base.py", line 46, in get
for out_type in config['DEFAULT']['dispatcher']]
File "/opt/nsb_bin/yardstick_venv/lib/python2.7/site-packages/yardstick-0.1.dev0-py2.7.egg/yardstick/dispatcher/base.py", line 38, in get_cls
raise RuntimeError("No such dispatcher_type %s" % dispatcher_type)
RuntimeError: No such dispatcher_type Http # setup multiple dipatcher with comma deperted e.g. file
Change-Id: I497d0d9ce7fdb7ea2913af6ebeb4bb9008344fed
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Ross Brattain [Tue, 14 Mar 2017 05:08:06 +0000 (22:08 -0700)]
Add Ansible executor class for node context
import the AnsibleCommon class to execute Ansible playbooks
Update node context support to use AnsibleCommon
needs unittests
We must call ansible-playbook as an executable, so we must create temp
files for inventory, and for the playbooks.
AnsibleCommon has evolved to be quite flexible, it auto-generates the
inventory from the context['nodes'] and generates groups from the node
Role.
We also support either a single playbook filename, or a list of
filenames.
If given a list we dynamically generate a playbook that includes the
other playbooks.
We support adding any number of extra_vars using a temp JSON file.
Also designed to be extended by subclassing.
Change-Id: I5bd0a2b4547feaadd70b7e2b8801f19371b99df0
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Fri, 11 Aug 2017 21:38:28 +0000 (14:38 -0700)]
ixia: VNF id must match class name
The class name is IxiaTrafficGen
Change-Id: Ie18be44c7b58d50f13e9a5df50afa3e02fc0cce3
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Fri, 11 Aug 2017 17:47:29 +0000 (17:47 +0000)]
Merge "yardstick setup ansible, including load_images"
kalyanreddy [Fri, 11 Aug 2017 10:45:24 +0000 (03:45 -0700)]
KVMFORNFV: Update Grafana config for Packet Forwarding test cases.
JIRA: YARDSTICK-783
This patch is used for updating the configuration file of opnfv grafana
dashboard for kvmfornfv packet forwarding to publish the results of new
test cases added as part of kvmfornfv daily job.
Also used for updating the config file of opnfv grafana dashboard for
kvmfornfv cyclictest test cases to correct the alias colours.
Change-Id: I34aa155e2782e58147e55f974134673a892eb93b
Signed-off-by: Gundarapu Kalyan Reddy <reddyx.gundarapu@intel.com>
chenjiankun [Wed, 9 Aug 2017 03:23:58 +0000 (03:23 +0000)]
Add real time log view in GUI
JIRA: YARDSTICK-775
We have GUI now, but we can't see real time log in GUI view.
So I add real time log view in GUI.
Change-Id: Ie83f327ef0a94302afa6b3def764fec6ef5818d1
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
Jing Lu [Fri, 11 Aug 2017 09:16:42 +0000 (09:16 +0000)]
Merge "Add common openstack opertation scenarios: image & volume"
Kubi [Fri, 11 Aug 2017 07:55:43 +0000 (07:55 +0000)]
Merge "bugfix: tc038 ssh default wait 3600s"
Kubi [Fri, 11 Aug 2017 07:54:37 +0000 (07:54 +0000)]
Merge "Add common openstack opertation scenarios: flavor & server"
rexlee8776 [Fri, 11 Aug 2017 07:04:35 +0000 (07:04 +0000)]
bugfix: tc038 ssh default wait 3600s
JIRA: YARDSTICK-771
Change-Id: Ibcd2228505d341feb09b0d477e5f4ed6062c1e89
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Ross Brattain [Fri, 11 Aug 2017 04:26:07 +0000 (04:26 +0000)]
Merge "UDP relay"
Jing Lu [Fri, 11 Aug 2017 03:47:23 +0000 (03:47 +0000)]
Merge "New storage test case: Bonnie++"
JingLu5 [Fri, 11 Aug 2017 02:58:20 +0000 (02:58 +0000)]
Add common openstack opertation scenarios: image & volume
JIRA: YARDSTICK-781
This patch adds some common openstack opertation scenarios
Change-Id: I3de7dbb30eaebac4feebcf07dd6a0d2bdcf428d9
Signed-off-by: JingLu5 <lvjing5@huawei.com>
Deepak S [Tue, 20 Jun 2017 21:21:24 +0000 (14:21 -0700)]
UDP relay
Change-Id: I598f6f98f94f70334139966cc170832c90ea9aa6
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Fri, 11 Aug 2017 02:52:24 +0000 (02:52 +0000)]
Merge "Sample CGNAPT VNF"
Deepak S [Tue, 20 Jun 2017 21:15:50 +0000 (14:15 -0700)]
Sample VFW VNF
Change-Id: I32ca166cd6d818b57bbcfaf7c7e5a65b7147ba8d
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Deepak S [Tue, 20 Jun 2017 21:15:18 +0000 (14:15 -0700)]
Sample CGNAPT VNF
Change-Id: I0f5555a1674a5ecb7e2afb508d495b7872c90757
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
JingLu5 [Thu, 10 Aug 2017 06:00:58 +0000 (06:00 +0000)]
Add common openstack opertation scenarios: flavor & server
JIRA: YARDSTICK-781
This patch adds some common openstack opertation scenarios
Change-Id: I9e84a8894fe9b9c1754a45a0ddfdf93739164b9a
Signed-off-by: JingLu5 <lvjing5@huawei.com>
Ross Brattain [Thu, 10 Aug 2017 19:53:49 +0000 (19:53 +0000)]
Merge "NSB fixes: docstring, whitespace, etc."
Kubi [Thu, 10 Aug 2017 06:18:58 +0000 (06:18 +0000)]
Merge "bugfix: tc037/38 multiprocessing failed sometimes"
Ross Brattain [Thu, 10 Aug 2017 06:14:50 +0000 (06:14 +0000)]
Merge "pip_license: quick hack script to add license info to requirements.txt"
Ross Brattain [Thu, 10 Aug 2017 06:14:29 +0000 (06:14 +0000)]
Merge "requirements.txt: add license info"
Ross Brattain [Thu, 10 Aug 2017 05:30:25 +0000 (22:30 -0700)]
NSB fixes: docstring, whitespace, etc.
remove unused docstring params
remove whitespace
fix sudo vnf_build command
ignore stdout
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Change-Id: I6fcdbb0ed4bc6b7fc2f557529f5ff9fd960c05e9
Ross Brattain [Thu, 10 Aug 2017 03:57:47 +0000 (03:57 +0000)]
Merge "Collectd"
Ross Brattain [Thu, 10 Aug 2017 03:56:50 +0000 (03:56 +0000)]
Merge "constants: cache YAML config values"
Ross Brattain [Thu, 10 Aug 2017 03:56:37 +0000 (03:56 +0000)]
Merge "IXIA traffic generator"
Ross Brattain [Thu, 10 Aug 2017 03:56:29 +0000 (03:56 +0000)]
Merge "Sample ACL VNF"
rexlee8776 [Thu, 10 Aug 2017 01:35:58 +0000 (01:35 +0000)]
bugfix: tc037/38 multiprocessing failed sometimes
set runner.join timeout
JIRA: YARDSTICK-771
Change-Id: Iec7d04549a45c0fbd0eb48dcaad7770fd5ca1f4e
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Kubi [Thu, 10 Aug 2017 01:18:55 +0000 (01:18 +0000)]
Merge "bugfix: tc025 and tc054 fail"
Kubi [Thu, 10 Aug 2017 01:18:33 +0000 (01:18 +0000)]
Merge "bugfix: hosts should be clean if update_hosts twice"
Ross Brattain [Tue, 8 Aug 2017 01:38:53 +0000 (18:38 -0700)]
requirements.txt: add license info
Change-Id: I9de6a51e7efb9e49da5bbd541c466f106c3a52e3
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
chenjiankun [Wed, 9 Aug 2017 07:37:22 +0000 (07:37 +0000)]
Bugfix: remove ping package for it is GPL license
JIRA: YARDSTICK-777
In migrate test case, we use ping to count downtime.
But ping package is GPL license, so we need remove it.
Since ping command tool can not set timeout less then 1 second, and the
downtime is less then 1 second, so we need find another package to replace.
For now, I find most ping tool is GPL license, so maybe later we need to
implement ping ourselves.
And the migrate case can not calculate downtime unless user install ping
themselves.
Change-Id: I78cba5e4af9de2e3c0bb16b27570bed951caf440
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
Ross Brattain [Thu, 22 Jun 2017 02:25:22 +0000 (19:25 -0700)]
constants: cache YAML config values
don't reparse the yardstick.yaml file each
time we lookup an option.
Since it is global data, just cache it in a global
var
Use pkg_resources.resource_filename
to lookup the path of yardstick tests, intsead of using __file__
pkg_resources is slightly more proper than __file__
at least for packages
Change-Id: I05d9748390a37bd45c53013fc084d23069ab7c51
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
rexlee8776 [Thu, 3 Aug 2017 12:39:44 +0000 (12:39 +0000)]
bugfix: tc025 and tc054 fail
also modify tc025 an tc054 to be able to pass paras
JIRA: YARDSTICK-772
Change-Id: Ibeba931804cccfd74fc70fcf4fdb6af9d5c8ab77
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
rexlee8776 [Tue, 8 Aug 2017 08:09:41 +0000 (08:09 +0000)]
bugfix: hosts should be clean if update_hosts twice
JIRA: YARDSTICK-774
Change-Id: Id610d43d236ab3a7d1aa4b8cfd230a40958fac38
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Malanik Jan [Tue, 18 Jul 2017 16:54:10 +0000 (12:54 -0400)]
yardstick setup ansible, including load_images
also update to cirros 0.3.5
added PROX compilation
add create_node_pod_yaml role
JIRA: YARDSTICK-639
Change-Id: If5999841287a54c7e5c64a7cc487c6394df90424
Signed-off-by: Malanik Jan <janx.malanik@intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Deepak S [Tue, 20 Jun 2017 21:24:26 +0000 (14:24 -0700)]
Collectd
Change-Id: I15e4ac38b347a08350b71c68469e2793eeed92ab
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Deepak S [Tue, 20 Jun 2017 21:14:06 +0000 (14:14 -0700)]
Sample ACL VNF
Change-Id: I33de47ac6ca353d6c69f0d166809b4c95d3fd90f
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Deepak S [Tue, 20 Jun 2017 21:18:57 +0000 (14:18 -0700)]
IXIA traffic generator
Change-Id: I09bcb3f2c4b945283070d442589d3bf00468abbc
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Deepak S [Tue, 20 Jun 2017 21:31:19 +0000 (14:31 -0700)]
NSB update
Refactored main NSB VNF classes accroding to class diagram
https://wiki.opnfv.org/display/yardstick/NSB+class+diagram
All the SampleVNFs have been separated and placed under
the SampleVNF class.
Added AutoConnectSSH to automatically create SSH conneciton on demand.
Added VnfdHelper class to wrap the VNFD dictionary in prepartion for
class-based modeling.
Extracted DpdkVnfSetupEnvHelper for DPDK based VNF setup.
Extracted Stats and other client config to ResourceHelper
Had to replace dict_key_flatten with deepgetitem due to Python 2.7
Jinja2 infinite recursion.
Change-Id: Ia8840e9c44cdbdf39aab6b02e6d2176b31937dc9
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Tue, 8 Aug 2017 01:39:28 +0000 (18:39 -0700)]
pip_license: quick hack script to add license info to requirements.txt
Change-Id: Ic41772cb32cd53d405b16880bd43cf89307b4716
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Thu, 3 Aug 2017 20:18:00 +0000 (13:18 -0700)]
fix heatclient import
for some reason, maybe apexlake, we didn't do the correct import
we need to import heatclient.client directly
Change-Id: I682c88ae780845adb0b5aa898390697197e3af5d
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Thu, 3 Aug 2017 15:09:29 +0000 (15:09 +0000)]
Merge "DRAFT: remove apexlake"
JingLu5 [Wed, 2 Aug 2017 07:16:27 +0000 (07:16 +0000)]
New storage test case: Bonnie++
JIRA: YARDSTICK-770
Bonnie++ is a disk and file system benchmarking tool for measuring I/O performance.
With Bonnie++ you can quickly and easily produce a meaningful value to represent
your current file system performance.
This work is add new storage test case using Bonnie++.
Change-Id: I752fee156707cda730962c68d17fda4d4e9cd472
Signed-off-by: JingLu5 <lvjing5@huawei.com>
Ross Brattain [Thu, 3 Aug 2017 01:54:40 +0000 (01:54 +0000)]
Merge "replace yaml.load with yaml.safe_load"
Ross Brattain [Wed, 2 Aug 2017 19:38:33 +0000 (19:38 +0000)]
Merge "Fix adding right deb repo based on the distro we are running on"
Jing Lu [Wed, 2 Aug 2017 01:20:22 +0000 (01:20 +0000)]
Merge "Add task-args(from yaml file) candidates in /api/v2/yardstick/testcases API"
chenjiankun [Mon, 31 Jul 2017 02:49:12 +0000 (02:49 +0000)]
Add task-args(from yaml file) candidates in /api/v2/yardstick/testcases API
JIRA: YARDSTICK-766
We have the demand to get all task-args candidates in test case yaml
file,
so that user get easily change it.
The response will like:
{
'status': 1,
'result': {
'testcase': case content,
'args': {
'image': {'description': '', 'type': 'String'}
}
}
}
In this patch, I add jinja2schema 0.1.4 in requirements.txt.
Change-Id: I450082402370add5ab29090286f026fe3cc8c36e
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
Jing Lu [Wed, 2 Aug 2017 00:46:00 +0000 (00:46 +0000)]
Merge "Add spec cpu2006 test case"
Ross Brattain [Thu, 13 Jul 2017 18:21:46 +0000 (11:21 -0700)]
test_env_action: speedup unittest, don't sleep
Change-Id: Ib662032e5133b8fead1c6858905bd13ca40f4dd6
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Sat, 22 Jul 2017 22:15:13 +0000 (15:15 -0700)]
replace yaml.load with yaml.safe_load
yaml.safe_load is safer, obviously.
anteater will check for this
template_format use specialized constructor based on yaml.SafeLoader
JIRA: YARDSTICK-760
Change-Id: Ia3b0b3aa0765385a0ee472a4d83f49d424b5a77f
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
JingLu5 [Tue, 1 Aug 2017 08:24:01 +0000 (08:24 +0000)]
Bugfix: port_security_enabled issue
JIRA: YARDSTICK-765
When port_security_enabled is not set, VMs are assigned with security group 'default'.
When using 'default' security group, all egress traffic and intercommunication in the
default group are allowed and all ingress from outside of the default group is dropped
by default (in the default security group). This causes yardstick cannot ssh into VMs.
If port_security_enabled is not set, we should still add the security group that created
by yardstick to the VMs.
Change-Id: Ifd22fb452e0077581b6900f8f51c4e3c342a30aa
Signed-off-by: JingLu5 <lvjing5@huawei.com>
Ross Brattain [Tue, 1 Aug 2017 03:10:20 +0000 (20:10 -0700)]
DRAFT: remove apexlake
apexlake is unmaintained, so remove it
From some reason orchestrator/heat.py started failing
so fixup those unittests
Change-Id: Ie06508b5ab7c9dcf9fdfca83e173a188a894d564
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Jing Lu [Tue, 1 Aug 2017 03:36:34 +0000 (03:36 +0000)]
Merge "bugfix: enable vlan and physical netwok able to set"
Jing Lu [Tue, 1 Aug 2017 03:34:07 +0000 (03:34 +0000)]
Merge "Add more parameters in iperf3 taml"
Ross Brattain [Tue, 1 Aug 2017 02:34:16 +0000 (19:34 -0700)]
cover.sh: delete .testrepository before running coverage
When running py27 and py3 test ran into problems
with .testrepository already exists, but testr
thinking it was corrupt
running testr
No repository found in /home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master. Create one by running "testr init".
error: testr failed (3)
The fix seems to be to delete .testrepository before
running testr coverage
Change-Id: Ib8cd3ab9d3384935380ac29ce365439c6464adc3
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Rex Lee [Tue, 1 Aug 2017 02:18:33 +0000 (02:18 +0000)]
Merge "Bugfix: yardstick always report 'PASS' to DB"
Rex Lee [Tue, 1 Aug 2017 02:17:22 +0000 (02:17 +0000)]
Merge "Add yardstick logo in GUI"
Jing Lu [Tue, 1 Aug 2017 02:02:57 +0000 (02:02 +0000)]
Merge "Add container ping VM test case"
chenjiankun [Mon, 31 Jul 2017 03:05:36 +0000 (03:05 +0000)]
Add yardstick logo in GUI
JIRA: YARDSTICK-767
We have yardstick logo in opnfv community.
We have the demand to display it in yardstick GUI.
Change-Id: Ief5807c918754e679e95ae1d1f3a769ab2d6d4b2
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
Jing Lu [Tue, 1 Aug 2017 01:09:31 +0000 (01:09 +0000)]
Merge "add opnfv_os-odl-sfc-ha_daily.yaml test suite"
Ross Brattain [Mon, 31 Jul 2017 21:26:15 +0000 (21:26 +0000)]
Merge "run_tests: don't write python bytecode"
Ross Brattain [Mon, 31 Jul 2017 21:13:58 +0000 (14:13 -0700)]
cover: another 'db type could not be determined' workaround
Change-Id: Ib94ff2dfc86725e5367908296b5160f9565442b8
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Mon, 31 Jul 2017 20:36:28 +0000 (13:36 -0700)]
run_tests: don't write python bytecode
we usually disable .pyc generate during unittests
Change-Id: I7d7af7c6d188f5a592d24aa90322edb217ffd8ba
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Mon, 31 Jul 2017 18:50:53 +0000 (18:50 +0000)]
Merge "NSBperf: don't exit during import time"
Ross Brattain [Mon, 31 Jul 2017 18:37:04 +0000 (11:37 -0700)]
cover.sh: workaround 'db type could not be determined' bug
https://bugs.launchpad.net/testrepository/+bug/
1229445
rm -f .testrepository/times.dbm
remove that file before running testr
Change-Id: I178efefebe600a65d1a28beb9b01f7dfecaa4d00
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Mon, 31 Jul 2017 18:38:08 +0000 (11:38 -0700)]
NSBperf: don't exit during import time
This was breaking testr unittests.
Don't do this like this during import time,
only do them in if __name__ sections, otherwise
when anything else tries to import this module
it exists.
Change-Id: Ia17f5e1a5cbe07ab287d3b95e96489b8a6248170
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
JingLu5 [Mon, 31 Jul 2017 10:11:03 +0000 (10:11 +0000)]
add opnfv_os-odl-sfc-ha_daily.yaml test suite
Change-Id: I56961d143bdd723f4e957a4c02ba4127ccddadb3
Signed-off-by: JingLu5 <lvjing5@huawei.com>
Rex Lee [Mon, 31 Jul 2017 06:10:06 +0000 (06:10 +0000)]
Merge "Testing live migration using qemu"
chenjiankun [Mon, 31 Jul 2017 04:53:17 +0000 (04:53 +0000)]
Add container ping VM test case
JIRA: YARDSTICK-769
This is demand from openretriever project(https://jira.opnfv.org/browse/CONTAINER-19).
Since we have the kubernetes context now and we have first container test case.
We can have a new test case that make container(k8s) ping VM(openstack).
Change-Id: Ia1724130d92d447836529b370510fe1bf1738723
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
chenjiankun [Mon, 31 Jul 2017 03:33:00 +0000 (03:33 +0000)]
Bugfix: yardstick always report 'PASS' to DB
JIRA: YARDSTICK-768
Now yardstick will not stop if test case failed,
so that we can run the rest test case in the suite.
CI judge task status by the cmd return code. In this way,
the 'yardstick task start' cmd will always return 0.
So we will always report 'PASS' to DB.
In this patch I add a judgement in cmd, if the status is not 'PASS', we
will raise a RuntimeError.
Change-Id: I655424dd9cd3782869986963a17b24acfb340345
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
Ace Lee [Mon, 31 Jul 2017 02:50:01 +0000 (02:50 +0000)]
Add more parameters in iperf3 taml
JIRA: YARDSTICK-755
The parameters that iperf3 testcase support now maybe insufficient in some usecase.
The test case should support parameters such as: windows size and length of buffer.
This work is about adding more parameters in testcase yaml file
Change-Id: I8c900a4a8909d97543cf837a02c76a6aee19f439
Signed-off-by: Ace Lee <liyin11@huawei.com>
JingLu5 [Thu, 27 Jul 2017 07:56:02 +0000 (07:56 +0000)]
Add spec cpu2006 test case
JIRA: YARDSTICK-764
This work is about support run SPEC CPU2006 benchmark.
users must get a "cpu2006-1.2.iso" from the SPEC website,
save it under the /home/opnfv/yardstick/yardstick/resources folder
(e.g. /home/opnfv/yardstick/yardstick/resources/cpu2006-1.2.iso),
user may also supply a runspec cfg file
(e.g. /home/opnfv/yardstick/yardstick/resources/files/yardstick_spec_cpu2006.cfg).
Change-Id: If4aecc1c14635a07589555196d2edc8bd37d7bdb
Signed-off-by: JingLu5 <lvjing5@huawei.com>
JingLu5 [Mon, 24 Jul 2017 02:44:26 +0000 (02:44 +0000)]
Heat: support vnic_type in heat type context
JIRA: YARDSTICK-757
Some test scenarios require VM with specific vnic type.
This work is about supporting using different vnic types in heat type context.
context:
name: demo
image: cirros-0.3.5
flavor: yardstick-flavor
user: cirros
placement_groups:
pgrp1:
policy: "availability"
servers:
athena:
floating_ip: true
placement: "pgrp1"
ares:
placement: "pgrp1"
networks:
test:
cidr: '10.0.1.0/24'
vnic_type: "normal"
Change-Id: Ia229fda72f47b04288ea107e2d58fd3e8ac91dd9
Signed-off-by: JingLu5 <lvjing5@huawei.com>
JingLu5 [Mon, 24 Jul 2017 01:39:57 +0000 (01:39 +0000)]
Heat: support create and attach volume in heat type context
JIRA: YARDSTICK-756
Some test scenarios require VM with volume attached.
This work is about supporting create and attach volume in heat type context.
context:
name: demo
image: cirros-0.3.5
flavor: yardstick-flavor
user: cirros
placement_groups:
pgrp1:
policy: "availability"
servers:
athena:
floating_ip: true
# per-vm inline volume definition. if no volume size specified, then this
# volume should be an existing volume in the openstack environment
volume: yardstick-volume
placement: "pgrp1"
ares:
# per-vm inline volume definition. if volume size is specified, then this
# volume will be crated and attach to the vm
volume:
name: test-volume
size: 10
# volume mountpoint is also configurable
volume_mountpoint: /dev/vdb
placement: "pgrp1"
networks:
test:
cidr: '10.0.1.0/24'
Change-Id: Ief87b313980a59eac229eb4780d93ffc929ceb66
Signed-off-by: JingLu5 <lvjing5@huawei.com>
rexlee8776 [Sat, 29 Jul 2017 03:46:02 +0000 (03:46 +0000)]
bugfix: enable vlan and physical netwok able to set
Enable vlan and physical netwok able to set by
parameters for heat context. It won't affect the
original test case, but enable vlan to be set
directly by pass task-args to command:
yardstick -d task start samples/ping.yaml --task-args '{"provider": "vlan"}'
JIRA: YARDSTICK-763
Change-Id: I96f96a61991cceb1506d055867a006d56689a008
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Kubi [Sat, 29 Jul 2017 02:59:44 +0000 (02:59 +0000)]
Merge "bugfix: enable vlan and physical netwok able to set"
Rex Lee [Sat, 29 Jul 2017 02:49:28 +0000 (02:49 +0000)]
Merge "Update NSBPerf CLI to adapt to new output format"
Rex Lee [Fri, 28 Jul 2017 08:29:29 +0000 (08:29 +0000)]
Merge "Test Case: OPNFV_YARDSTICK_TC023: VM availability during live migration"
rexlee8776 [Fri, 28 Jul 2017 07:46:38 +0000 (07:46 +0000)]
bugfix: enable vlan and physical netwok able to set
enable vlan and physical netwok able to set by
parameters for heat context
this is a sample, if it's ok, i'll copy it to other yaml.
it won't affect the original test case, but enable vlan
to be set directly by pass task-args to command.
yardstick -d task start samples/ping.yaml --task-args '{"provider": "vlan"}'
JIRA: YARDSTICK-763
Change-Id: Ie35dac4b5e80404558a1eb45d49fa0bb6ab45a98
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Rex Lee [Fri, 28 Jul 2017 01:12:14 +0000 (01:12 +0000)]
Merge "leave port_security_enabled undefined by default"
Deepak S [Mon, 19 Jun 2017 12:19:41 +0000 (12:19 +0000)]
Adding support for multi-dispatcher
JIRA: YARDSTICK-684
This patch adds the support to enable multi-dispatcher of result.
e.g.
[DEFAULT]
debug = False
dispatcher = file, http
Change-Id: Id0e1a1bba14edd899fcf5b275be1f0a091b6db77
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Thu, 27 Jul 2017 07:36:52 +0000 (00:36 -0700)]
leave port_security_enabled undefined by default
some deployments don't have port security ML2 plugin enabled,
so we have to leave port security undefined by default
RuntimeError: Resource CREATE failed:
BadRequest: resources.yardstick-TC072-
19be2f60-test: Unrecognized attribute(s) 'port_security_enabled'
https://build.opnfv.org/ci/user/narindergupta/my-views/view/joid/job/yardstick-joid-baremetal-daily-master/1276/console
Change-Id: I69178f869f6215f42d90ea4cfb297dad3d799f83
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Jing Lu [Thu, 27 Jul 2017 05:04:36 +0000 (05:04 +0000)]
Merge "Yardstick GUI & GUI deployment"
chenjiankun [Mon, 24 Jul 2017 04:13:56 +0000 (04:13 +0000)]
Yardstick GUI & GUI deployment
JIRA: YARDSTICK-758
As E release plan, we have the need of yardstick GUI.
This patch is GUI front end code and deployment.
The backend code is yardstick API.
Change-Id: Ib15f78bcc50168c7828beff97256e9939c6da809
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
chenjiankun [Mon, 17 Apr 2017 15:49:17 +0000 (15:49 +0000)]
Test Case: OPNFV_YARDSTICK_TC023: VM availability during live migration
JIRA: YARDSTICK-174
This live migration test case is based on share storage, default share
storage is enabled.
This test case will do some config work. And do live migration and
calculate the migration time and downtime.
Change-Id: I6601601edebdd0ac6434ba632b1eba9e9bd4fda0
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
Ross Brattain [Wed, 26 Jul 2017 07:58:29 +0000 (00:58 -0700)]
fix sriov/ovs-dpdk unittests on systems with fewer than 10 cores
we need to wrap vcpupin modulo number of cores.
also mock time.sleep
Change-Id: I6433418a99505b469c61c81a9a023d84434fa0ee
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
JingLu5 [Wed, 26 Jul 2017 01:50:49 +0000 (01:50 +0000)]
Bugfix: plugin remove command use "JUMP_HOST_IP" if ip is set to local
JIRA: YARDSTICK-762
Change-Id: Id4a94ef8bbe578944e3664e5e7c24fdf7478805b
Signed-off-by: JingLu5 <lvjing5@huawei.com>
Jing Lu [Wed, 26 Jul 2017 01:39:44 +0000 (01:39 +0000)]
Merge "Bugfix: supoort insecure mode in checking openstack environment"
JingLu5 [Tue, 25 Jul 2017 03:21:30 +0000 (03:21 +0000)]
Bugfix: supoort insecure mode in checking openstack environment
Change-Id: I18346aa177689bc995eb7d4883f4a66383e827ba
Signed-off-by: JingLu5 <lvjing5@huawei.com>
Rex Lee [Wed, 26 Jul 2017 00:42:51 +0000 (00:42 +0000)]
Merge changes from topic '35521'
* changes:
Setup OVS-DPDK Standalone Context
Adding new SRIOV Standalone Context