Ross Brattain [Thu, 21 Sep 2017 22:00:30 +0000 (15:00 -0700)]
tg_rfc2544_ixia: log exceptions and fix list iter
Change-Id: Ia9722604b7c8ae23e784e780f113d012de544d4b
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
chenjiankun [Wed, 30 Aug 2017 02:31:40 +0000 (02:31 +0000)]
Add service in kubernetes context
JIRA: YARDSTICK-803
Currently kubernetes test case can only run in master node.
We need to support it run in jump server.
So I add service and use nodePort type.
Then we can login the pod using nodePort.
Change-Id: Ia7900d263f1c5323f132435addec27ad10547ef9
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
root [Thu, 21 Sep 2017 03:40:59 +0000 (03:40 +0000)]
bugfix: tc025 should use ipmi to poweroff
if it use shutdown, it'll take several minutes to shutdown,
leads to the ipmi power on command fails
Change-Id: I74b61325cbcc3a6ec070d2fa103accf84f29b0fa
Signed-off-by: root <limingjiang@huawei.com>
Maciej Skrocki [Tue, 19 Sep 2017 21:00:53 +0000 (14:00 -0700)]
Introduced timeout to post method of HttpClient
We seen cases where grafana container bring-up code would fail,
because of too quick access to the http api. Added 10sec timeout
for the first query of the API.
Change-Id: Ifc95a626d0ab5552a1f26fb167fc3f65791392d7
Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
Ross Brattain [Thu, 21 Sep 2017 00:33:34 +0000 (17:33 -0700)]
tg_rfc2544_ixia: use traffic id from JSON to update mac
we were using raw sort index of the interfaces to
set the MAC address, but we should be using the
traffic id from the static JSON instead.
Change-Id: I13284db04abb3eaf8c9826974a9e5aa1c37b3891
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Maciej Skrocki [Thu, 21 Sep 2017 00:00:45 +0000 (17:00 -0700)]
Bumped samplevnfs flavor disk size to 6G.
Since we increased the images size the 4G is not sufficient anymore.
Change-Id: Iae25cf4cfb7a6cc69c8d28771c183a2342ac38d0
Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
Ross Brattain [Wed, 20 Sep 2017 21:08:57 +0000 (14:08 -0700)]
ixia: renamed execute to execute_traffic
ixia: pass ports to generate_samples
Change-Id: I90d12fa2ce8cd4d1c2a18bdcf70027f6d9e3f77f
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Wed, 20 Sep 2017 20:48:42 +0000 (13:48 -0700)]
nsb_setup.sh: update to Ansible 2.3.2
Change-Id: I2f700fbb169d02d126fe7ea22721bebf127c1206
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Wed, 20 Sep 2017 21:42:00 +0000 (14:42 -0700)]
cgnapt: mock time.sleep in unitests
Change-Id: I26957977e6dcd0392078a543a6907a550711c702
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Tue, 5 Sep 2017 22:39:45 +0000 (15:39 -0700)]
requirements: bump Ansible version to 2.3
Change-Id: Ib429ba24d2b7287b6ec4e749386da0e1242d6a20
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Maciej Skrocki [Wed, 20 Sep 2017 16:40:00 +0000 (09:40 -0700)]
Tweaked nsb_setup to always re-download latest container
and re-create the container.
Change-Id: I21204ddf97e2cccc2d5a762f5d910068bda1a948
Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
Ross Brattain [Wed, 20 Sep 2017 09:09:40 +0000 (02:09 -0700)]
prox: fix TG KPIs
The problem is that we share the same ProxResourceHelper
for both VNF and TG.
For VNF we want to talk to resource.py and get collectd KPIs.
For TG we need to read from the queue the TG calculated KPIs and
we also want collectd KPIs.
workaround is to use a different method name collect_collectd_kpi
for VNFs
Change-Id: Icc2132758e37ce210f5600a0cd433077930208e5
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
DanielMartinBuckley [Tue, 5 Sep 2017 18:39:23 +0000 (19:39 +0100)]
Addition of PROX NSB tests to yardstick
JIRA: YARDSTICK-802
Addition of PROX L2FWD_Multiflow, ACL, Load Balancing plus
grafana dashboards
Supports 2 and 4 port Baremetal & Heat
Change-Id: I1f3990d5451de265ee3901302569c355ece3b146
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
Ross Brattain [Wed, 20 Sep 2017 08:14:46 +0000 (01:14 -0700)]
prox: use find_relative_file when uploading
the prox files were being found correctly.
if we use find_relative_file they will lookup
relative to the task_path
Change-Id: Ifde5d07df5ccfbfeba015b2f43bd8b53e89a00b7
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Tue, 19 Sep 2017 22:52:16 +0000 (15:52 -0700)]
add opnfv_os-odl-fdio-dvr-ha_daily.yaml scenario
Change-Id: I723477edf810a220816a2e67aa80f7f144efb3a6
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Tue, 19 Sep 2017 08:07:15 +0000 (01:07 -0700)]
prox: pass prox_config_dict between Processes using queue
we generate the prox_config_dict in the _run Process,
but we also need it in the _traffic_runner Process to
get core info.
use a queue to pass the config list between the processes
enable collect_kpi
Change-Id: Ibaf41d606e559a87addf43d6ddaed206dbd2d20c
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
Maciej Skrocki [Tue, 19 Sep 2017 17:37:29 +0000 (10:37 -0700)]
Fixed few gaps when running on a minimal version of system
- we need to make sure we have lsof installed
- we need to update cache inside the image, because we are unable to install some of them
Change-Id: Ic555489779e9096540001cb9c62ea2ab25c1ae90
Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
Ross Brattain [Tue, 19 Sep 2017 08:10:07 +0000 (01:10 -0700)]
prox testcases: private -> uplink,public -> downlink, vnf_0, tg_0
Change-Id: I85afff4582bf538fcd0be5b4db1405a4da2573f9
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Tue, 19 Sep 2017 08:26:45 +0000 (01:26 -0700)]
UDP_Replay: enable collectd KPIs
Change-Id: I92146411707a9ec29864d164dbd63b96d05bffe0
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Fri, 8 Sep 2017 18:32:01 +0000 (11:32 -0700)]
Heat: use pkey from string instead of key_filename
Instead of using a key_filename for Heat, we can
read the key as a string directly using pkg_resources.resource_string()
This will enable us to save Heat stacks as pod.yaml, because
we can embedded the key into the pod.yaml directly.
Change-Id: I16baaba17dab845ee0846f97678733bae33cb463
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
Ross Brattain [Tue, 12 Sep 2017 16:41:45 +0000 (09:41 -0700)]
Generate pod.yaml from current context
We want to generate pod.yaml from Heat contexts so we can
re-use the context without destroying it.
But we don't have node role information and it doesn't
make sense in this case, so make the role optional.
Since we changed Heat to use pkey instead of key_filename,
we can embed the pkey into the pod.yaml, but we have
to make sure to convert the pkey to string, in case
it is a RSAKey object
Change-Id: Ibefcfbd8236e68013a704c39964cb870da825da8
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
chenjiankun [Mon, 11 Sep 2017 03:41:53 +0000 (03:41 +0000)]
Add host&targer in scenario['options']['server_name'] support
JIRA: YARDSTICK-810
Currently host, target is in scenario, but as a input, we prefer it in
scenario['options'].
So I add support for under scenario['options']['server_name']
If we write host in scenario['options']['server_name'], the host ip info
will be written in context.
Change-Id: I90df20467ef5da772d22e9f272a2cac250f822e0
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
chenjiankun [Mon, 14 Aug 2017 03:09:36 +0000 (03:09 +0000)]
Log each test case status in a task
JIRA: YARDSTICK-785
Currently if one test case failed, we will log error.
But if one case success, we do not have any tips.
We need log success when one case success.
Change-Id: I0f41ac55f2569f44b787133e3f2594a5c5547f4a
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
Ross Brattain [Fri, 1 Sep 2017 09:17:54 +0000 (02:17 -0700)]
ansible: resize VNF image
When compiling Trex, DPDK, collectd and all the SampleVNFs
we use more than the 2.2GB size of the original Ubuntu cloud image.
Accordingly we need to resize the image.
If we were not inside a docker container we would use virt-resize
to automatically handle all the cases, but virt-resize launches qemu.
Instead we can use qemu-img to add extra space, then
luckily we can use parted to resize the partition and finally
resize2fs to resize the filesystem.
This limits us to only ext3/4 images, but if we need to
we could add support for other filesystems by checking
file system type.
Change-Id: Iac84b8e6967af5be64c280a7b1eaaf09f5d6b3aa
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Mon, 18 Sep 2017 20:53:23 +0000 (13:53 -0700)]
add scenario opnfv_os-nosdn-bar-ha_daily.yaml for Barometer
For now just copied and renamed opnfv_os-nosdn-nofeature-ha_daily.yaml
Change-Id: Idbd37a3e21220aa407d053157da71b449bad15ee
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Tue, 12 Sep 2017 16:57:38 +0000 (09:57 -0700)]
NSB: count from 0, vnf_0, tg_9, private->uplink, public->downlink
Also rename private to uplink, public to downlink
for scale-out template we need to count from 0
so we can use range() without +1/-1 errors
vnf_0, vnf_1
tg_0, tg_1
also fix Ixia defaults
Change-Id: I6aecfbb95f99af20f012a9df19c19be77d1b5b77
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
Ross Brattain [Mon, 4 Sep 2017 03:32:55 +0000 (20:32 -0700)]
apiserver: mock socket.gethostbyname
we don't want use external DNS requests during unittest
Change-Id: I5ed67b700ef1dab4b650ae5071a3cf641a17ae4c
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Sun, 27 Aug 2017 20:39:25 +0000 (13:39 -0700)]
NSB test: remove vld_id it is not needed
we get vld_id from the topology, we
don't need it in Heat context
Change-Id: I42c2309dda919e5b2026065dda851555df76ba57
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Deepak S [Tue, 22 Aug 2017 08:41:03 +0000 (01:41 -0700)]
Fixing vPE config creation anf bring up issues.
Change-Id: Icf7a01a053495e6d96bd664d6ceda8964fa437eb
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Deepak S [Mon, 28 Aug 2017 02:11:59 +0000 (19:11 -0700)]
Fix all the exception while genereating the latency traffic
Change-Id: I0b25e704b29fc68678eaa29d9e1d1eb04ee94e3e
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Deepak S [Fri, 1 Sep 2017 05:55:33 +0000 (22:55 -0700)]
Terminate the ixia traffic generator at the end of the test run
Change-Id: I80501ab3662a58930939d849f0bde0e810154a39
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Deepak S [Wed, 23 Aug 2017 07:08:23 +0000 (00:08 -0700)]
Added multi-port testcases for vFW
Change-Id: I6cf8675c83fc081dd22ae7896e63ff7725ed3c13
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Mon, 18 Sep 2017 00:31:01 +0000 (17:31 -0700)]
rename odl_l3 tests to just odl
Change-Id: I664437d598db9f9dcc7036e306b8a4edc40287cf
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Martin Banszel [Wed, 13 Sep 2017 15:12:28 +0000 (17:12 +0200)]
Fix the offset bug for UDP dst port in the traffic profile
Also sends a new line to the VNF when waiting for prompt.
Change-Id: Ib8641093974cd6713594aac9b418595ad5268e87
Signed-off-by: Martin Banszel <martinx.banszel@intel.com>
Ross Brattain [Mon, 11 Sep 2017 15:22:50 +0000 (08:22 -0700)]
vnf_generic: adjust ssh timeout for number of VNFs
we assume the time it takes to start multiple
instances is proportional to the number of instances
so we scale the timeout based on the number of instances.
Change-Id: I6901890d3f184ac4e38e1d6823b96c291579e04a
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Martin Banszel [Wed, 19 Jul 2017 19:35:02 +0000 (19:35 +0000)]
NSB: fix port topology
Add a new PortPair class to resolve the
topology into list of public and private ports.
Before we were calculating public/private in multiple
locations and using different conventions.
In addition for all the DPDK test we need to use the DPDK
port number and no rely on interface ordering or interface naming
conventions.
We used to use xe0 -> 0, xe1 -> 1, etc. This is not the DPDK port
number.
Use the new dpdknicbind_helper class to parse the output of
dpdk-devbind.py to find the actual DPDK port number at runtime.
We then use this DPDK port number to correctly calculate the
port_mask_hex.
The port mask maps the DPDK port num (PMD ID) to the LINK ID
used in the pipeline config
We also need to make sure we only use the interfaces matched to the
topology and not use all the interfaces, because in some cases we will
have unused interfaces. In particular TRex always requires an even
number of interfaces, so for single port TRex tests we have to create
the second port and not use it.
Thus we had to modify the traffic generator stats code to only dump
stats for used ports and no unused ports.
Ixia was using interface ordering to map to Ixia ports, instead we use
the dpdk_port_num which must be hardcoded for Ixia.
Renamed traffic_profile.execute to traffic_profile.execute_traffic so
we can trace the code easier.
We pass the port used by the traffic profile to generate_samples so we
don't get stats for unused ports.
Fixed up vPE config creation and bring up issues.
Fixed up CGNAPT and UDP_Replay to work correctly.
Tested with 4-port scale-out
Change-Id: I2e4f328bff2904108081e92a4bf712333fa73869
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
Rex Lee [Fri, 15 Sep 2017 09:01:59 +0000 (09:01 +0000)]
Merge "add tc083 rst and tc073/tc083 netperf local dashboard"
Rex Lee [Fri, 15 Sep 2017 09:01:25 +0000 (09:01 +0000)]
Merge "bugfix: show testcase api return type error"
Rex Lee [Fri, 15 Sep 2017 09:01:06 +0000 (09:01 +0000)]
Merge "tc006: fio job_file.ini the volume should be configed"
Rex Lee [Fri, 15 Sep 2017 08:59:39 +0000 (08:59 +0000)]
Merge "KVMFORNFV: Update Grafana config for Packet Forwarding test cases."
Rex Lee [Fri, 15 Sep 2017 08:59:04 +0000 (08:59 +0000)]
Merge "improve logging, clear using print"
Rex Lee [Fri, 15 Sep 2017 08:58:55 +0000 (08:58 +0000)]
Merge "[DRAFT] add yardstick cli info in userguide"
Rex Lee [Fri, 15 Sep 2017 08:58:44 +0000 (08:58 +0000)]
Merge "tc063: make node parameter can be pass"
rexlee8776 [Fri, 15 Sep 2017 03:38:52 +0000 (03:38 +0000)]
add tc083 rst and tc073/tc083 netperf local dashboard
Change-Id: I382b2a711d6659f94982c4386c2f25c144705831
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Jing Lu [Fri, 15 Sep 2017 03:11:26 +0000 (03:11 +0000)]
Merge "Create opnfv_k8-ovn-lb-noha_daily.yaml test suite file"
Rex Lee [Fri, 15 Sep 2017 03:07:28 +0000 (03:07 +0000)]
Merge "tc011: make parameters to be able to config"
Ross Brattain [Thu, 14 Sep 2017 20:40:48 +0000 (20:40 +0000)]
Merge "ssh fix, always wait"
kalyanreddy [Wed, 13 Sep 2017 14:50:50 +0000 (07:50 -0700)]
KVMFORNFV: Update Grafana config for Packet Forwarding test cases.
JIRA: YARDSTICK-783
This patch is used for updating the configuration file of opnfv grafana
dashboard for kvmfornfv packet forwarding to publish the throughput
results of test cases added as part of kvmfornfv daily job.
Change-Id: I913bbc5172eefbbfeee86f7ca74b2b99c521c248
Signed-off-by: Gundarapu Kalyan Reddy <reddyx.gundarapu@intel.com>
rexlee8776 [Thu, 14 Sep 2017 09:25:53 +0000 (09:25 +0000)]
bugfix: show testcase api return type error
segmentation_id should be number, provider should be string
Change-Id: Iabdc08cb0989f4d585013b5a8ef3662442eeda45
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
rexlee8776 [Thu, 14 Sep 2017 08:51:28 +0000 (08:51 +0000)]
tc011: make parameters to be able to config
Change-Id: Ic8a85b762f5204a9b759bf57c3189df97aa52d0c
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
rexlee8776 [Thu, 14 Sep 2017 07:31:19 +0000 (07:31 +0000)]
tc006: fio job_file.ini the volume should be configed
Change-Id: Ie03dfe7d1227578bb50e5e4460e50b9dc59dd202
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
chenjiankun [Thu, 14 Sep 2017 03:10:32 +0000 (03:10 +0000)]
Create opnfv_k8-ovn-lb-noha_daily.yaml test suite file
JIRA: RDSTICK-811
We need to create opnfv_k8-ovn-lb-noha_daily.yaml so that we
can run kubernetes test in k8-ovn-lb-noha scenario.
Change-Id: I9c18b6d68c96ef917f3b65e494e3c2d9e1beefdd
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
Ross Brattain [Fri, 8 Sep 2017 18:34:48 +0000 (11:34 -0700)]
Heat: support non-mesh network toplogy
Previsouly we added all servers to every network
in Heat in a full mesh.
To more closely replicate test topology and to limit
then number of ports we need to all each server
to specify which ports should be connected to each network.
This should also allow for some kind of multiport setup.
Add optional network_ports dict to each server with network to port_list
mapping
match inteface based on port name or vld_id
replace vld_id matching with network name matching, since network_name == vld_id
Change-Id: I5de46b8f673949e3c17d8df6fa96f055c43886ce
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
rexlee8776 [Wed, 13 Sep 2017 08:29:08 +0000 (08:29 +0000)]
improve logging, clear using print
Change-Id: I744353f631cf1771d75f750543e8612f81be71ee
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Ross Brattain [Wed, 13 Sep 2017 20:59:40 +0000 (13:59 -0700)]
ssh fix, always wait
Change-Id: I1c529eeb0ef47752ed15e3e7941f57f7793ebfd4
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Maciej Skrocki [Wed, 13 Sep 2017 22:40:22 +0000 (15:40 -0700)]
Removed special networking from yardstick container when started by nsb_setup.
Change-Id: Ief1cfd7c018948a9125549400bb5bf0e5c20d730
Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
rexlee8776 [Wed, 13 Sep 2017 03:49:09 +0000 (03:49 +0000)]
tc063: make node parameter can be pass
Change-Id: I7af9706085508f2391957dc5633db4152f828bfc
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Ross Brattain [Tue, 12 Sep 2017 18:22:30 +0000 (18:22 +0000)]
Merge "Added line parser to INI parser"
Jing Lu [Tue, 12 Sep 2017 11:09:29 +0000 (11:09 +0000)]
Merge "Bugfix: cleanup command not found"
rexlee8776 [Tue, 12 Sep 2017 09:53:48 +0000 (09:53 +0000)]
[DRAFT] add yardstick cli info in userguide
Change-Id: Ib52f0f0629c27b35774804be81276427ac29bac2
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Rex Lee [Tue, 12 Sep 2017 09:23:16 +0000 (09:23 +0000)]
Merge "KVMFORNFV:Livemigration testcase changes in Yardstick"
Edward MacGillivray [Tue, 5 Sep 2017 20:20:20 +0000 (13:20 -0700)]
Added line parser to INI parser
Line parser handles comments, keys and values
and makes exceptions.
Change-Id: I5cd3612ffd8cb08b14051bd0ef4b757c310f77bd
Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
Kubi [Mon, 11 Sep 2017 02:42:34 +0000 (02:42 +0000)]
Merge "change outage_time from 20 to 30s"
Rex Lee [Mon, 11 Sep 2017 02:41:50 +0000 (02:41 +0000)]
Merge "Add API(v1) to get real time log"
chenjiankun [Mon, 11 Sep 2017 01:26:25 +0000 (01:26 +0000)]
Bugfix: cleanup command not found
JIRA: YARDSTICK-808
This bug is from CI, see log:
https://build.opnfv.org/ci/view/yardstick/job/yardstick-joid-baremetal-daily-master/1560/consoleFull
The reason is we don not have cleanup function in the script.
It is in another script clean_image.sh.
so I remove it, and call clean_image.sh when in openstack scenario.
Change-Id: I844cd9e8f0b6e1e8ff7a6094be37789d35a2c345
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
Jing Lu [Fri, 8 Sep 2017 07:38:45 +0000 (07:38 +0000)]
Merge "testcase: add rate parameter for spec cpu 2006"
Ross Brattain [Fri, 8 Sep 2017 07:27:01 +0000 (07:27 +0000)]
Merge "Adding nfvi flag to enable data collection"
Ross Brattain [Fri, 8 Sep 2017 07:26:22 +0000 (07:26 +0000)]
Merge "Adding latency test for vfw"
Ross Brattain [Fri, 8 Sep 2017 07:19:51 +0000 (07:19 +0000)]
Merge "Yardstick TC083: Move sample test case netperf"
Ross Brattain [Fri, 8 Sep 2017 07:19:41 +0000 (07:19 +0000)]
Merge "Yardstick TC082: move sample test case perf.yaml"
rexlee8776 [Fri, 8 Sep 2017 02:49:25 +0000 (02:49 +0000)]
change outage_time from 20 to 30s
Change-Id: I255c71a75d748f8e7401815a2a5890111a1ee2f5
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Ross Brattain [Thu, 7 Sep 2017 15:24:46 +0000 (15:24 +0000)]
Merge "Adding ixia latency support for dynamic cgnapt"
Deepak S [Fri, 1 Sep 2017 03:35:32 +0000 (20:35 -0700)]
Adding ixia latency support for dynamic cgnapt
Change-Id: I346f6064c39cb5662c2b17ca0f520addbe5eae4c
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Ross Brattain [Thu, 7 Sep 2017 15:14:11 +0000 (15:14 +0000)]
Merge "updating the traffic profile to enable static cgnapt for ixnet"
Kubi [Thu, 7 Sep 2017 02:05:33 +0000 (02:05 +0000)]
Merge "update yardstick ha test cases dashboard"
Kubi [Thu, 7 Sep 2017 02:05:17 +0000 (02:05 +0000)]
Merge "Bugfix: ha test case criteria pass when sla not pass"
Ross Brattain [Wed, 6 Sep 2017 22:55:00 +0000 (22:55 +0000)]
Merge "decrease default hugepages, depends on VNF of course"
Ross Brattain [Wed, 6 Sep 2017 22:50:09 +0000 (22:50 +0000)]
Merge "test_kubernetes: mock file operations in test_ssh_key"
Ross Brattain [Wed, 6 Sep 2017 22:49:47 +0000 (22:49 +0000)]
Merge "test_vsperf_dpdk: mock time to speedup unitests"
Abhijit Sinha [Wed, 6 Sep 2017 11:04:10 +0000 (12:04 +0100)]
Addition of Prox NSB tests in yardstick
JIRA: YARDSTICK-802
Added Prox L3FWD and Packet buffering tests
- The tests supports BM and Openstack Heat
- L3FWD tests suports 2 and 4 ports
- Packet flow buffering test is a 1 port test
- Grafana Dashboards are added
TODO: Latency stats are missing in KPI collection
Need to invetigate that
Coverage if needed!
Change-Id: I216a170488d5578622cf8c3748a6277b380f016a
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
Ross Brattain [Wed, 6 Sep 2017 09:55:16 +0000 (02:55 -0700)]
ansible: update package proxy code
re-enable retries
Change-Id: I77738250e8aa8de3c8a8a1019093af04ce785ae0
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Wed, 6 Sep 2017 00:53:03 +0000 (00:53 +0000)]
Merge "Adding NSB documentation for SV and Baremetal"
Martin Banszel [Wed, 19 Jul 2017 19:35:02 +0000 (19:35 +0000)]
Add fixes for heat deployed UDP_Replay and TRex
- Added a PROTOCOL_MAP to map the protocol names to codes -- the scapy
requires the code, it fails if the proto is set e.g. to 'udp'
- ip addresses must be str, not unicode -- explicit conversion to str
added
- removed unittest for setup_vnf_environment in test_tg_trex.py as
it is the same function as already tested in test_sample_vnf.py
- traffic_profile refactored -- code repetition decreased, unittest
adapted
Known issues:
- there is a an attempt to stop already stopped trex. It fires an
exception that stop command is issued on the disconnected client.
Change-Id: I87e9029630f48b30e8f5b4f9d88ab3b25fd65f03
Signed-off-by: Martin Banszel <martinx.banszel@intel.com>
Ross Brattain [Wed, 6 Sep 2017 00:18:44 +0000 (17:18 -0700)]
nsb_setup: fixup typo
Change-Id: I7fcbf0a3c3f21065d82ffb23b5ea8c1e774a1d67
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Wed, 6 Sep 2017 00:16:46 +0000 (00:16 +0000)]
Merge "ansible: remove default openrc_file"
Ross Brattain [Tue, 5 Sep 2017 22:47:10 +0000 (15:47 -0700)]
ansible: remove default openrc_file
when clause is re-evaluated after default
Change-Id: I2f9b093a4cb0e2d024f8d6beb935f336ac1df637
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Tue, 5 Sep 2017 22:05:09 +0000 (15:05 -0700)]
nsb_setup: pin pip versions for ansible, shade, docker
Change-Id: Ia1f1c26becdc776ce664b4ab2fb0254049087318
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Sat, 2 Sep 2017 01:21:11 +0000 (18:21 -0700)]
PROX: catch ports stats parse error
for some reason port status returned
fewer fields, catch this for debug
and return empty result dict so test continues
and hopefully we get a valid stat
read on next call.
Change-Id: I54f1a86707d2a00efcb82a7e0239d12f90a6542c
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Deepak S [Mon, 4 Sep 2017 08:54:56 +0000 (01:54 -0700)]
Adding NSB documentation for SV and Baremetal
Change-Id: I6db301b88af67256b52f5d197dfffe3c0719e132
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Ross Brattain [Tue, 5 Sep 2017 13:02:33 +0000 (13:02 +0000)]
Merge "Addition of Prox NSB changes in yardstick"
Ross Brattain [Tue, 5 Sep 2017 07:28:48 +0000 (00:28 -0700)]
ansible: fix corrupt /etc/fstab boot error
Change-Id: I71fdef5deff75cad434bf19f0a7e507c1dcc4ed3
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Maciej Skrocki [Fri, 1 Sep 2017 22:33:53 +0000 (15:33 -0700)]
Introduced ansible playbook to setup NSB.
Change-Id: I5865cd50d5fde26e9e9fc265d4385372d668413f
Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Tue, 5 Sep 2017 03:43:55 +0000 (03:43 +0000)]
Merge "Adding intel_pmu tools plugin for collectd"
Deepak S [Sun, 3 Sep 2017 02:28:08 +0000 (19:28 -0700)]
Adding intel_pmu tools plugin for collectd
Change-Id: I81ff3d43d209e98188855c8b2eb302835bb5d417
Signed-off-by: Neha Vadnere <neha.r.vadnere@intel.com>
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Deepak S [Sun, 3 Sep 2017 19:47:45 +0000 (12:47 -0700)]
Fix Ixload KPIs collection & hang issues.
Change-Id: If679333dc1cb9e041a332fb374c55f72eaab1b28
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
abhijitsinha [Mon, 28 Aug 2017 19:35:46 +0000 (20:35 +0100)]
Addition of Prox NSB changes in yardstick
JIRA: YARDSTICK-802
Addition of Prox L2Fwd, MPLS test cases for BM and Heat.
updates:
Most of tg_prox and prox_vnf were absorbed into the base classes.
delete most of ProxDpdkVnfSetupEnvHelper, it is handled by DpdkVnfSetupEnvHelper baseclass
use standard _build_pipeline_kwargs methods
don't use terminate() use baseclass version
add new method kill_vnf that runs pkill -x
replace resource_helper.execute() with vnf_execture for dumping stats
In order to share code between tg_prox and vnf_prox
refactor to have tg_prox hold and wrap a ProxApproxVnf instance and call
methods on that class. Do this instead of multiple-inheritance.
Implement ProxApproxVnf.terminate() using prox socket command
based exit, (stop_all, quit, force_quit).
vnf_execute calls resource_helper.execute() which calls
socket methods on the sut object.
Since tg_prox wraps the VNF object, we can call
terminate on the VNF object and it should work correctly.
move prox config generation to parent process
we need to get core number info from config file
inside the TG processes, so we need to generate
the config in the parent process so the data is
copied to the child during the fork.
moved more config file methods to the setup_helper class.
we run force_quit after quit, so the socket should already be closed
this will trigger socket error, so add _ignore_errors option for
vnf_execute to ignore socket errors
Fixed the terminate issue. Added MPLS tests.
Added TG Stats in_packet/out_packet
Fixed compile (pep8) issues
Fixed MPLS TG port stats, in/out packets
Added Grafana dashboards for L2FWD and MPLS
Traffic profiles modified for tolerated loss and
precision as per DATS tests.
Added unit test case for Mpls
Single port test stats collection support.
Change-Id: Idd9493f597c668a3bb7d90e167e6a418546106e8
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Mon, 4 Sep 2017 03:30:40 +0000 (20:30 -0700)]
test_create_keypair: fix op_utils mock and mock paramiko
Change-Id: I5c039c0d4f4ba651209c7d5ca4e748f9151b5630
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Mon, 4 Sep 2017 03:18:31 +0000 (20:18 -0700)]
test_kubernetes: mock file operations in test_ssh_key
tests take too long and we should not be createing/deleting
files during unittests, filesystems operations introduce
too many external issues
Change-Id: I989c9d0a84187becdf63497c0c1ac6e10c5eac70
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Mon, 4 Sep 2017 00:20:41 +0000 (17:20 -0700)]
test_vsperf_dpdk: mock time to speedup unitests
If you put time.sleep(1) all over your code you need
to mock time.sleep() in your unittests lest the unittests
take forever.
Change-Id: I9ebbf9e21c98e8c46bab727bbb22f33045db4361
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Deepak S [Sun, 3 Sep 2017 20:52:13 +0000 (13:52 -0700)]
Adding nfvi flag to enable data collection
Change-Id: Ieafefb5501dc3a20fee41726a7daa9e4bb28599f
Signed-off-by: Deepak S <deepak.s@linux.intel.com>