Serhiy Pshyk [Fri, 5 Oct 2018 15:51:43 +0000 (16:51 +0100)]
Add 4 port topology for agnostic vnf and Ixia tg
JIRA: YARDSTICK-1466
Change-Id: I2e4b7f54591489a90c44535a09207de8a46d0e24
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
Serhiy Pshyk [Fri, 5 Oct 2018 11:15:43 +0000 (12:15 +0100)]
Update Ixia tg to use new API for traffic model creation
JIRA: YARDSTICK-1464
Change-Id: Ibbced9e0e04e077ec5c23fc15e97308dd11b7004
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
Emma Foley [Wed, 3 Oct 2018 10:37:06 +0000 (10:37 +0000)]
Merge "Fix influxdb "field type conflict" error"
Abhijit Sinha [Wed, 3 Oct 2018 09:03:54 +0000 (09:03 +0000)]
Merge "Fix NSB PROX L3FWD dropping packets"
Abhijit Sinha [Wed, 3 Oct 2018 09:00:07 +0000 (09:00 +0000)]
Merge "NSB PROX NFVi Test does not stop after reaching expected precision"
Patrice Buriez [Mon, 24 Sep 2018 14:59:02 +0000 (16:59 +0200)]
Fix NSB PROX L3FWD dropping packets
JIRA: YARDSTICK-1037
Adjusted number of RX/TX descriptors to 2048, instead of default 256,
in order to cope with interrupts during which no packets are received
by the core, which results in the NIC dropping packets when it gets out
of available descriptors to buffer them.
Also adjusted mempool size, because more descriptors need more mbufs.
This change aligns L3FWD test case with other test cases, for which
number of RX/TX descriptors is already set to 2048.
Change-Id: I11378c078398aca799295b619bb3d14dbee04ca3
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
Patrice Buriez [Mon, 1 Oct 2018 11:36:33 +0000 (13:36 +0200)]
Fix influxdb "field type conflict" error
JIRA: YARDSTICK-1457
Field types must be consistent across points in a measurement, otherwise
influxdb rejects newer points with "field type conflict" error.
This error was faced when "theor_max_throughput" field, meant to be
assigned as a float from "TxThroughput" sample, was instead assigned as
an int from initial value of theor_max_thruput variable. This especially
occured for subsequent packet sizes, when theor_max_thruput variable was
reset to its default int value.
This fix changes the default value of theor_max_thruput variable to 0.0,
and also makes sure that the default value for "Actual_throughput" field
is consistently a float.
Change-Id: If8d4f1297094709fe9657ab3e2b8adaad09815b2
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
Serhiy Pshyk [Tue, 25 Sep 2018 16:37:05 +0000 (17:37 +0100)]
Modify IxNextgen API for traffic model configuration
Changes to IxNextgen API:
- modify API for traffic model configuration so that it can be used
to create/configure different models
- add methods to start and stop protocols on IxNetwork
- add method for getting assigned ports
JIRA: YARDSTICK-1455
Change-Id: I43c10fea9ba83994caf373ceff8b0252a45439b3
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
DanielMartinBuckley [Mon, 10 Sep 2018 18:02:10 +0000 (19:02 +0100)]
NSB PROX NFVi Test does not stop after reaching expected precision
JIRA: YARDSTICK-1419
When using prox_binsearch algorithm, a binary search is
performed, increasing lower bound when step was successful
and decreasing upper bound when the step was a failure.
This runs until the test_precision (as specified in the
traffic profile) is reached. When the test precision
is reached, the test is not completed until the
runner duration is reached.
As runner duration is usually high (e.g. 1800sec), the
tests take much too long to execute.
This makes it difficult to create test suites.
Change-Id: I6cc503a09fb534a556c61c805e6df4786bb8cc4b
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
Patrice Buriez [Tue, 18 Sep 2018 09:52:48 +0000 (11:52 +0200)]
Update the pinned sampleVNF version
JIRA: YARDSTICK-1414
Updated the sampleVNF version to the most recent validated commit.
Provided comments on accepted version types and values, and on where
users can find alternative values, in case they want to try something
different than the version recommended and validated for Yardstick/NSB.
Change-Id: I336f96237fcfa8b580c91c787d722d368cc6c015
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
Abhijit Sinha [Fri, 21 Sep 2018 16:48:02 +0000 (16:48 +0000)]
Merge "SA: Fix private key file name generation issue"
Abhijit Sinha [Fri, 21 Sep 2018 16:36:23 +0000 (16:36 +0000)]
Merge "[NSB] Adds support for running "black box" test cases for VNFs"
Chornyi, TarasX [Fri, 7 Sep 2018 09:11:04 +0000 (12:11 +0300)]
[NSB] Adds support for running "black box" test cases for VNFs
Using AgnosticVNF is now possible to create a "black box"
testcase for any VNF.
Example rfc2544 test with TRex as trafficgen
samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_ipv4_64B_trex.yaml
and Ixia
samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_latency_ipv4_64B_ixia.yaml
NOTE:
Yardstick will not interact with VNF.
No KPIs from VNF will be collected
JIRA: YARDSTICK-1438
Change-Id: I408b3dcb90f29c7b41fcf8f883b5abfc4e9c3dbc
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
Abhijit Sinha [Thu, 20 Sep 2018 16:40:11 +0000 (16:40 +0000)]
Merge changes from topics 'YARDSTICK-1354', 'YARDSTICK-1348', 'YARDSTICK-1359', 'YARDSTICK-1356'
* changes:
Add vEPC service request test cases
Add network initiated dedicated bearers creation
Add UE initiated dedicated bearer creation test
Add vEPC infrastructure for Landslide TG
Add vEPC default bearers relocation test case
Add vEPC default bearers create/delete test case
Add Spirent Landslide traffic profile templates
Update LSResourceHelper unittests
Add Spirent Landslide TG API
Added Landslide Resource Helper implementation
Add TclClients for Spirent Landslide TG
Mytnyk, Volodymyr [Thu, 20 Sep 2018 09:13:03 +0000 (10:13 +0100)]
SA: Fix private key file name generation issue
In current implementation of Yardstick, SA context uses the
same SSH key file name for each VM created. E.g. the Yardstick
overrides the key file context each time the new VM is created.
As a result, the key file is valid only for last VM created
by Yardstick causing the connection problem for other VMs.
Solution is to generate different key file name for each VM
name separately.
JIRA: YARDSTICK-1436
Change-Id: I22ae2874695736255aa3314654a2cced9338b53d
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
Serhiy Pshyk [Tue, 11 Sep 2018 15:44:00 +0000 (16:44 +0100)]
Add IxNextgen API for creating Vlans configurations
New IxNextgen API allows to configure Vlans(vlan id, priority, tp id)
to Ethernet layer of device group.
JIRA: YARDSTICK-1420
Change-Id: I1c5fe37b5beb11daf1c539933fcad60832553bb9
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
Orest Voznyy [Fri, 14 Sep 2018 19:21:46 +0000 (22:21 +0300)]
Add vEPC service request test cases
Add UE and network initiated testcase and related session profiles.
JIRA: YARDSTICK-1429
Change-Id: I16d6c065cf346db31e235ac5add57509cfbc8009
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
Orest Voznyy [Fri, 14 Sep 2018 18:27:41 +0000 (21:27 +0300)]
Add network initiated dedicated bearers creation
Adding related pod file, session profile and testcase file.
JIRA: YARDSTICK-1355
Change-Id: Ic97d59ef3a36ac05c6c369c36f917ae95d18d863
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
Orest Voznyy [Fri, 14 Sep 2018 18:49:47 +0000 (21:49 +0300)]
Add UE initiated dedicated bearer creation test
Adding session profile and test case file.
JIRA: YARDSTICK-1353
Change-Id: Iaa98fd8cb3ed243f9ac157089de32fa23ec0e6b4
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
Orest Voznyy [Thu, 13 Sep 2018 10:30:08 +0000 (13:30 +0300)]
Add vEPC infrastructure for Landslide TG
1. Add yardstick topology and model for fully emulated environment.
2. Add support for black-box testing of real vEPC VNF vs Spirent Landslide
traffic generator:
- vEPC VNF pod file
- topology and model files aware of vEPC VNF connection to Spirent
Landslide TG
- stub class for vEPC VNF, and related unit tests
JIRA: YARDSTICK-1424
Change-Id: If7b6d19919679347c4360f4a0f2e420716e7fd2d
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
Orest Voznyy [Sat, 28 Jul 2018 19:25:05 +0000 (22:25 +0300)]
Add vEPC default bearers relocation test case
This test case runs on Spirent Landslide TG. All vEPC entities are
emulated on Landslide test servers.
Test case actions sequence:
- create default bearers
- start sending traffic
- partial/full bearers relocation between two ENodeB's, Intra-MME
- disconnect all bearers
JIRA: YARDSTICK-1354
Change-Id: I95c7b0001ddb363402013d83ae8617b88b2a4bd9
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
Orest Voznyy [Sat, 28 Jul 2018 13:25:02 +0000 (16:25 +0300)]
Add vEPC default bearers create/delete test case
This test case runs on Spirent Landslide TG. All vEPC entities are
emulated on Landslide test server.
Test run configuration is performed in following files:
1. test case file
2. pod file
3. session profile file (landslide_session_default_bearer*.yaml)
The structure of these files represents configuration of different
parts of test cases in this test session. The order of test cases should
always match.
Spirent Landslide test types involved: "SGW_Node", "SGW_Nodal".
Test case actions sequence:
- create default bearers (as per value of "Sessions" key) with
specified rate (session profile key "StartRate")
- send traffic flow(s) (pre-configured in traffic profile) for a number
of seconds (specified in session profile key "duration")
- remove N default bearers with specified rate (session profile key
"DisconnectRate")
Parameters with ALL_CAPS values are placeholders.
User should replace them with their own condifuration.
Session profile file placeholders do not need to be replaced as long as
these parameters are overriden in other files (e.g. pod, test case).
Test results are dispatched according to runner configuration options.
For fully emulated test runs like this one, best suited runner is "Search"
type. In case of testing against real EPC VNFs, user could prefer
different runner type.
JIRA: YARDSTICK-1348
Change-Id: I5caf4878fb212b38d4148a297c5dba03b8ab98a8
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
Orest Voznyy [Sat, 28 Jul 2018 17:39:56 +0000 (20:39 +0300)]
Add Spirent Landslide traffic profile templates
These files are templates of Spirent Landslide data message flow (DMF)
representing traffic profile of one or multiple traffic flows.
Template files should not be edited directly. Instead, their parameters
could be overriden in test case YAML file, in section "dmf".
JIRA: YARDSTICK-1359
Change-Id: I4980a784a78ca870c18457227248e6e2ac0b8eda
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
Patrice Buriez [Thu, 13 Sep 2018 13:01:32 +0000 (15:01 +0200)]
Fix Yardstick Docker image ARM build
Soften sed pattern, in order to cope with new contents of
ansible/install.yaml, recently modified by change 61173.
Previous sed pattern does not work anymore against this changed line:
https://gerrit.opnfv.org/gerrit/#/c/61173/4/ansible/install.yaml@39
JIRA: YARDSTICK-1411
Change-Id: I1e1ebd454900252c29263e746470e18e3139e016
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
Abhijit Sinha [Thu, 13 Sep 2018 16:23:25 +0000 (16:23 +0000)]
Merge "Cleanup unittests for test_lmbench"
Mytnyk, Volodymyr [Thu, 13 Sep 2018 13:36:24 +0000 (14:36 +0100)]
Assign IXIA ports in one call instead of one by one
Assigning IXIA ports one by one takes more time than
assign all ports by once. Also, assigning ports in
one call resolves the assign port issues caused on
some IXIA chassis versions.
JIRA: YARDSTICK-1425
Change-Id: Ibb08e40ee1a8762573f6752bdd1f583c5a1d9d2a
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Emma Foley [Thu, 6 Sep 2018 17:26:55 +0000 (18:26 +0100)]
Update LSResourceHelper unittests
New unit tests have been added to make sure the right
commands are sent to Spirent LS.
This helps to ensure that the correct commands are sent
to Spirent, so that potentially breaking changes can be
flagged.
JIRA: YARDSTICK-1356
Change-Id: I23f452355afcec2705da7d4665a34b178e2ba729
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Emma Foley [Thu, 13 Sep 2018 10:49:41 +0000 (10:49 +0000)]
Merge "Add UT: ArithmeticRunner exception handling"
Mytnyk, Volodymyr [Thu, 13 Sep 2018 08:46:09 +0000 (09:46 +0100)]
IXIA traffic mac address is set incorrectly
IXIA API sets the src/dst mac of the traffic always into
default value. The `srcmac`/`dstmac` is never set in `traffic_param`
map [1]. Instead the src/dst mac is stored in traffic_param[`outer_l2`].
[1] https://gerrit.opnfv.org/gerrit/gitweb?p=yardstick.git;a=blob;f=yardstick/network_services/traffic_profile/ixia_rfc2544.py;h=
44bf2eafc7f8cf03ebd2c8520d316358fe1e5fc2;hb=HEAD#l92
JIRA: YARDSTICK-1423
Change-Id: Iabab7a54404b284d3b95bbea6c8624233c138351
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
Rex Lee [Thu, 13 Sep 2018 08:26:52 +0000 (08:26 +0000)]
Merge "Update configure_uwsgi run in baremetal/container"
Rex Lee [Thu, 13 Sep 2018 01:30:23 +0000 (01:30 +0000)]
Merge "Revert "Bugfix: ansible version should be the same both in Dockerfile and requirements.txt""
Rex Lee [Thu, 13 Sep 2018 01:30:08 +0000 (01:30 +0000)]
Merge "Create a sample fio test case base on kubernetes"
Rex Lee [Thu, 13 Sep 2018 01:29:18 +0000 (01:29 +0000)]
Merge "Create a sample lmbench test case base on kubernetes"
Rex Lee [Thu, 13 Sep 2018 01:27:36 +0000 (01:27 +0000)]
Merge "tc046 kill keystone process condition incorrect - dovetail"
Emma Foley [Thu, 30 Aug 2018 12:54:57 +0000 (13:54 +0100)]
Add Spirent Landslide TG API
New TG class "LandslideTrafficGen" represents an interface to use Spirent
Landslide API to configure and execute vEPC test cases on
hardware/software Spirent environment. For that purpose this class and its
helper classes use Spirent Landslide REST API calls and Landslide TCL API
calls via library module lsapi.py.
Change-Id: Ib6560d5cd2483c6c9f5c95568345ac39bfebbd4d
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
Stepan Andrushko [Wed, 22 Aug 2018 16:01:28 +0000 (19:01 +0300)]
Update configure_uwsgi run in baremetal/container
Now "daemonize" prevents from installing Yardstick on baremetal.
Configuring:
"daemonize" in case "container" installation mode;
"logto" in case "baremetal" installation mode;
JIRA: YARDSTICK-1395
Change-Id: Ie390464db9c0816583edc711ed6526629d091bd3
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
Abhijit Sinha [Tue, 11 Sep 2018 11:54:34 +0000 (11:54 +0000)]
Merge "Add IxNextgen API for creating PPPoX configurations"
rexlee8776 [Thu, 12 Jul 2018 12:18:03 +0000 (12:18 +0000)]
Create a sample fio test case base on kubernetes
make samples/fio.yaml to support both Openstack and K8s
with context_type specified. It defaultly use Heat context, if
for k8s,
yardstick -d task start samples/fio.yaml --task-args
'{"context_type": "Kubernetes"}'
JIRA: YARDSTICK-1309
Change-Id: I2b0d61cf2f197ec8c60bda0ab4ff51594709f482
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Rodolfo Alonso Hernandez [Tue, 11 Sep 2018 07:10:24 +0000 (07:10 +0000)]
Merge "Add container pull option to install.yaml"
rexlee8776 [Thu, 12 Jul 2018 12:37:38 +0000 (12:37 +0000)]
Create a sample lmbench test case base on kubernetes
make samples/lmbench.yaml to support both Openstack and K8s
with context_type specified. It defaultly use Heat context, if
for k8s,
yardstick -d task start samples/lmbench.yaml --task-args
'{"context_type": "Kubernetes"}'
JIRA: YARDSTICK-1310
Change-Id: Ifa542e830fb5ab7823bd4f994ab5d7a8e8a5b415
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Rex Lee [Tue, 11 Sep 2018 01:12:22 +0000 (01:12 +0000)]
Merge "Add k8s scenario test suite in Gambia"
Rex Lee [Mon, 10 Sep 2018 08:39:15 +0000 (08:39 +0000)]
Revert "Bugfix: ansible version should be the same both in Dockerfile and requirements.txt"
This reverts commit
662de49b9f6c116d15882aed9e678cd3cf67494b.
JIRA: YARDSTICK-1411
Change-Id: Id277aa8711c9ff77e085d26c90546eecc3490535
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
rexlee8776 [Fri, 31 Aug 2018 07:08:45 +0000 (07:08 +0000)]
tc046 kill keystone process condition incorrect - dovetail
Change-Id: If01abfd5a99b4cea74f835e258f3a982af9446cd
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Emma Foley [Thu, 30 Aug 2018 12:19:36 +0000 (13:19 +0100)]
Added Landslide Resource Helper implementation
Class "LandslideResourceHelper" provides API for operations needed
- to configure Landslide test session
- manage test session execution (start/stop/abort)
- collect measurements during test run
This helper class API is responsible to for configure Landslide test runs:
- create test user
- create test servers (for emulation of specific vEPC blocks)
- create SUTs (actual tested VNFs performing specific vEPC roles)
- create test session (contains actual test cases)
- create DMFs (pre-defined traffic flows in traffic profile)
- operate traffic run execution (start, stop, abort)
- monitor test run status
- collect KPIs on TG side
Some of these features use Landslide REST API.
Other ones use Landslide TCL API.
JIRA: YARDSTICK-1356
Change-Id: I8fc8a7d85301121da465d054b8d38ae09a541c36
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
Serhiy Pshyk [Mon, 3 Sep 2018 16:10:33 +0000 (17:10 +0100)]
Add IxNextgen API for creating PPPoX configurations
New IxNextgen API allows to perform the following configurations on IxNetwork:
- add topology
- add device group to topology
- add ethernet protocol layer to device group
- add ipv4 protocol layer to device group
- add pppox protocol layer to device group
JIRA: YARDSTICK-1408
Change-Id: Icf5bb5f24784cf2c167c515b04c81471ac425e38
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
rexlee8776 [Fri, 7 Sep 2018 03:34:09 +0000 (03:34 +0000)]
Add k8s scenario test suite in Gambia
JIRA: YARDSTICK-1410
Change-Id: I23b4c0bcfa9aa431e259930a41d4171ff5b4e8a1
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Orest Voznyy [Sat, 28 Jul 2018 16:05:06 +0000 (19:05 +0300)]
Add TclClients for Spirent Landslide TG
Add class "LandslideTclClient" which holds TCL calls wrappers for
operations on the LandSlide TG.
It also introduces several new parameters in
- test case YAML file structure:
* session_profile: YAML file holding a template of Landslide test
session for specific vEPC test scenario
* dmf: test case options member holding traffic flow specific parameters
for designated test scenario, that override ones in traffic_profile
YAML file
* test_cases: test case options member holding parameters specific to
designated vEPC test case, overriding those in session_profile
template file
- pod YAML file structure:
* tas_manager: holds parameters used to connect to Spirent Landslide TAS
* config: list of entries describing Landslide test servers access,
their network interfaces configuration, information of vEPC elements
emulated by specific test server
Class "LandslideProfile" implements access to traffic profile template
from "LandslideResourceHelper" class.
JIRA: YARDSTICK-1356
Change-Id: Ia6428072b1e72025be17c94e5141bd23f7993247
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
Patrice Buriez [Tue, 28 Aug 2018 15:45:03 +0000 (17:45 +0200)]
Fix CLI argument handling in nsb_setup.sh
CLI argument $1 was used for both admin-openrc file with OpenStack
credentials and Yardstick Docker image, so obviously one of them would
be wrong, and NSB setup would fail at some point.
Historically, admin-openrc could be supplied as CLI argument $1, but
change https://gerrit.opnfv.org/gerrit/56493 broke it, which means
specifying Yardstick Docker image as CLI argument never worked.
This fix implements support for the following CLI options:
-o openrc Specify admin-openrc file with OpenStack credentials
-i image Specify Yardstick Docker image
-h Provide usage information
For backward compatibility reasons, admin-openrc file can be supplied
either with the -o option, or as a CLI argument.
JIRA: YARDSTICK-1137
Change-Id: I3e9904970560468c24b21738203bc67b7591f9e4
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
Abhijit Sinha [Tue, 4 Sep 2018 16:57:39 +0000 (16:57 +0000)]
Merge "Merge latest changes to Dashboard from L2FWD to L3FWD dashboard"
Abhijit Sinha [Tue, 4 Sep 2018 16:26:13 +0000 (16:26 +0000)]
Merge "NSB NFVi PROX Missing VNF Statistics for CPU Utilization"
DanielMartinBuckley [Mon, 3 Sep 2018 13:14:06 +0000 (14:14 +0100)]
Merge latest changes to Dashboard from L2FWD to L3FWD dashboard
Come changes re: Status == "Result" and Status == "Success" and
L3FWD changes onto latest L3FWD Dashboard
Change-Id: I62d0cfc30167085ad5efe348ab118f1defbc4901
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
DanielMartinBuckley [Thu, 30 Aug 2018 13:07:31 +0000 (14:07 +0100)]
NSB NFVi PROX Missing VNF Statistics for CPU Utilization
JIRA: YARDSTICK-1404
The test scripts require an extra argument to support collectd.
Also the CPU utilization is a different variable name structure
in the JSON file.
Change-Id: I127b7e86c0f93f7743331a2d71eb81d690e42471
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
Miikka Koistinen [Tue, 19 Jun 2018 11:42:57 +0000 (14:42 +0300)]
Add UT: ArithmeticRunner exception handling
* Use time.sleep to avoid multiprocessing.Queue broken pipe error.
JIRA: YARDSTICK-1245
Change-Id: I1ef1f8e68a553278996b38c226314c13dd974faa
Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
Rodolfo Alonso Hernandez [Fri, 31 Aug 2018 09:43:26 +0000 (10:43 +0100)]
TRex IMIX data must return percentage value
Function "_create_imix_data" must return the weight in percentage, not in
absolute value.
JIRA: YARDSTICK-1406
Change-Id: I3bc409bab17ae5778a6783f4319699009a5437fa
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Stepan Andrushko [Tue, 21 Aug 2018 11:04:59 +0000 (14:04 +0300)]
Add container pull option to install.yaml
Supported Yardstick installation modes in yardstick.yaml: baremetal
and container. First is used to install Yardstick on baremetal,
another is used during docker build to install Yardstick in container.
Added third option: 'container pull': to pull docker image
(opnfv/yardstick) from Docker hub and start container.
JIRA: YARDSTICK-1392
Change-Id: I4158de3eb6fcbe0018a15fdda89a3e3ab29c26bb
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
Rodolfo Alonso Hernandez [Thu, 30 Aug 2018 16:19:23 +0000 (16:19 +0000)]
Merge "Adopt infra_deploy to spawn VM on LTS Ubuntu 18"
Rodolfo Alonso Hernandez [Thu, 30 Aug 2018 16:13:07 +0000 (16:13 +0000)]
Merge "Add source and destination seed value in IXIA RFC2544"
Stepan Andrushko [Thu, 23 Aug 2018 13:13:47 +0000 (16:13 +0300)]
Adopt infra_deploy to spawn VM on LTS Ubuntu 18
Add possibility ro reuse infra_deploy.yaml to spawn VMs on jump host,
depending on jump host Ubuntu version: either 16 or 18.
JIRA: YARDSTICK-1396
Change-Id: Id0682c03098e611fe3a51cbd24d8ff2dda7c552a
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
Rodolfo Alonso Hernandez [Thu, 30 Aug 2018 09:08:21 +0000 (09:08 +0000)]
Merge "Assign static IP to VM for standalone context"
Stepan Andrushko [Wed, 29 Aug 2018 18:19:33 +0000 (21:19 +0300)]
Updated documentation for stanalone context
Added details about hosts configurations in order to run tests for
standalone context.
Changes made to '13-nsb-installation.rst'.
JIRA: YARDSTICK-1402
Change-Id: I4e3304065343014a80b85fc712cdde3ca62d8b2e
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
Stepan Andrushko [Tue, 28 Aug 2018 10:30:19 +0000 (13:30 +0300)]
Assign static IP to VM for standalone context
During VM spawning IP address should be assigned by DHCP server in
the local network. Sometimes DHCP server is not capable to assign IP
address. So, need to add static IP address.
JIRA: YARDSTICK-1402
Change-Id: Ie59c340eb88eddcaff043496fc20aa48b49205ec
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
rexlee8776 [Wed, 29 Aug 2018 06:13:58 +0000 (06:13 +0000)]
Bugfix: ansible version should be the same both in Dockerfile and requirements.txt
Because Dockerfile is using ansible script to install yardstick requirements.
Or it may lead to exception when installing Yardstick.
Change-Id: Ia83cf76675a7f3f1d0aa5c311e7b72be5c7ca5c3
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Rex Lee [Tue, 28 Aug 2018 11:15:50 +0000 (11:15 +0000)]
Merge "Bugfix: openstack router list broken in Yardstick container - dovetail"
Rodolfo Alonso Hernandez [Mon, 27 Aug 2018 16:00:31 +0000 (16:00 +0000)]
Merge "Change tc_trex files to execute standalone tests"
Rodolfo Alonso Hernandez [Mon, 27 Aug 2018 08:05:57 +0000 (09:05 +0100)]
Add source and destination seed value in IXIA RFC2544
Add source and destination seed value in IXIA RFC2544 traffic profile.
The default value for both parameters is 1.
JIRA: YARDSTICK-1401
Change-Id: I3351194c8be9ac42cbf5655996d50b9b69884c72
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Rodolfo Alonso Hernandez [Mon, 27 Aug 2018 08:01:32 +0000 (08:01 +0000)]
Merge "Make TRex IMIX traffic mode configurable"
rexlee8776 [Tue, 14 Aug 2018 04:15:49 +0000 (04:15 +0000)]
ping bottlenecks failed when security group rule do not support ipv6 - dovetail
JIRA: YARDSTICK-1380
Change-Id: I2163eeb9ab17e4f0216ddaed688e78acdf51a1ff
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Jing Lu [Mon, 27 Aug 2018 01:49:38 +0000 (01:49 +0000)]
Merge "Make security group configurable - dovetail"
rexlee8776 [Fri, 24 Aug 2018 07:04:59 +0000 (07:04 +0000)]
Bugfix: openstack router list broken in Yardstick container - dovetail
Dependancy of python-openstackclient is not constrained.
This patch specify openstacksdk and openstackclient's version according to [1].
This patch apply for bugfix and need to backported to fraser stable branch.
Continual work need to be done in Gambia according to YARDSTICK-1398.
[1]
https://github.com/openstack/requirements/blob/stable/pike/upper-constraints.txt
JIRA: DOVETAIL-728
Change-Id: I57c718e192699ac322150458d18508b06c93d22b
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Rodolfo Alonso Hernandez [Thu, 23 Aug 2018 14:09:08 +0000 (15:09 +0100)]
Make TRex IMIX traffic mode configurable
Enable TRex IMIX generation using two modes:
- Distribution in packages.
- Distribution in byes.
The default one will be distribution in packages, like the default
one in IxNetwork.
JIRA: YARDSTICK-1397
Change-Id: I86b2527968496218b0515349fc0a2680a84261e5
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Rodolfo Alonso Hernandez [Thu, 23 Aug 2018 16:13:48 +0000 (16:13 +0000)]
Merge "Fix setting `flow` configuration in TC yaml"
Abhijit Sinha [Thu, 23 Aug 2018 13:39:34 +0000 (13:39 +0000)]
Merge "Fix issues with 'Success_' stats reported by ProxBinSearchProfile"
Abhijit Sinha [Thu, 23 Aug 2018 13:38:54 +0000 (13:38 +0000)]
Merge "Runners crash on test startup."
Rodolfo Alonso Hernandez [Thu, 23 Aug 2018 13:26:22 +0000 (13:26 +0000)]
Merge "Provide access to VM in Standalone context"
Rodolfo Alonso Hernandez [Thu, 23 Aug 2018 09:46:02 +0000 (09:46 +0000)]
Merge "Provide average latency results in IXIA KPIs"
DanielMartinBuckley [Tue, 21 Aug 2018 13:17:25 +0000 (14:17 +0100)]
Runners crash on test startup.
JIRA: YARDSTICK-1393
The problem resides in this traffic generator class: this class
is inheriting from SampleVNFTrafficGen and overriding the
__init__ method but is NOT calling the parent class __init__
one.
Change-Id: I206a66e361a3e2eb50bb5fa01ddadae25b4a9f54
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
Stepan Andrushko [Wed, 27 Jun 2018 18:43:18 +0000 (21:43 +0300)]
Provide access to VM in Standalone context
Add possibility to access VM with SampleVNF image, which is spawned on
baremetal server using password or key pairs (provided or generated).
Changes provided for OVS-DPDK and SRIOV cases.
JIRA: YARDSTICK-1260
Change-Id: I89cf17dc83f02abe23d206b24b9d0ec1298d3231
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
Serhiy Pshyk [Fri, 17 Aug 2018 15:35:41 +0000 (16:35 +0100)]
Fix issues with 'Success_' stats reported by ProxBinSearchProfile
List of changes:
- Added 'Status' field to indicate status of each search iteration.
Possible values are 'Success', 'Failure', 'Result'.
- Removed reporting of duplicated stats with 'Success_' prefix.
Instead 'Status' field is set to 'Success'
- Removed reporting of duplicated stats with 'Result_' prefix.
Instead 'Status' field is set to 'Result'
- Updated Prox_BM_L2FWD-4Port_MultiSize-
1518452496550.json dashboard
to query success and result status by 'Status' field value.
JIRA: YARDSTICK-1386
Change-Id: I9a21a102af6cb4db137e805011b5d81c4943d77b
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
Rodolfo Alonso Hernandez [Wed, 22 Aug 2018 14:43:55 +0000 (15:43 +0100)]
Provide average latency results in IXIA KPIs
IXIA KPIs will provide an average value of all port latency values:
max, min and avg.
JIRA: YARDSTICK-1394
Change-Id: Ib7c7b5300e8343a1af0a20cb4e49c0bd669c1143
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Rodolfo Alonso Hernandez [Tue, 21 Aug 2018 17:08:30 +0000 (17:08 +0000)]
Merge "Add virtual image generation to install script"
Rodolfo Alonso Hernandez [Tue, 21 Aug 2018 14:45:20 +0000 (14:45 +0000)]
Merge "Improvie TRex RFC2544 throughput calculation"
Rodolfo Alonso Hernandez [Tue, 21 Aug 2018 12:54:39 +0000 (12:54 +0000)]
Merge "Convert IXIA latency statistics to integer"
Rodolfo Alonso Hernandez [Mon, 20 Aug 2018 14:27:50 +0000 (15:27 +0100)]
Convert IXIA latency statistics to integer
JIRA: YARDSTICK-1385
Change-Id: Id50c393da7ded4b3c8e127f7d7a6501832a68446
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Rodolfo Alonso Hernandez [Tue, 21 Aug 2018 09:33:21 +0000 (09:33 +0000)]
Merge "Make TRex latency statistics optional"
Abhijit Sinha [Tue, 21 Aug 2018 08:55:56 +0000 (08:55 +0000)]
Merge "NSB NFVi PROX BNG and vPE losing many packets"
Rex Lee [Tue, 21 Aug 2018 01:29:57 +0000 (01:29 +0000)]
Merge "the recovery action of "baremetal down" should be triggered mandatory"
Rodolfo Alonso Hernandez [Mon, 20 Aug 2018 11:39:27 +0000 (12:39 +0100)]
Make TRex latency statistics optional
Because of performance issues in TRex due to the extra power needed to
retrieve the latency statistics, this parameter will be optional and disabled
by default.
JIRA: YARDSTICK-1388
Change-Id: I07c0ec7bef86fd438d078cbd6748b98bc8cc0b37
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Rodolfo Alonso Hernandez [Thu, 16 Aug 2018 11:20:10 +0000 (12:20 +0100)]
Improvie TRex RFC2544 throughput calculation
Improve TRex RFC2544 throughput calculation by using the in/out packets
instead of using the throughput samples.
JIRA: YARDSTICK-1387
Change-Id: I877e901c3226d31c6435a877a2924bb95deb1cf0
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Rodolfo Alonso Hernandez [Mon, 20 Aug 2018 09:33:30 +0000 (10:33 +0100)]
Fix RFC2544 IXIA latency information
Do not overwrite the samples information with the latency parameters.
JIRA: YARDSTICK-1385
Change-Id: I2f144800ad19d7736eedf5c7b6783731031c4bf4
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
rexlee8776 [Wed, 8 Aug 2018 08:54:59 +0000 (08:54 +0000)]
Make security group configurable - dovetail
Make sercurity group can be configured via the context.
The format would be:
context:
name: demo
image: yardstick-image
flavor: yardstick-flavor
user: ubuntu
security_group:
rules:
- remote_ip_prefix: "0.0.0.0/0"
protocol: "tcp"
port_range_min: 1
port_range_max: 65535
- remote_ip_prefix: "0.0.0.0/0"
protocol: "udp"
port_range_min: 1
port_range_max: 65535
- remote_ip_prefix: "0.0.0.0/0"
protocol: "icmp"
JIRA: YARDSTICK-1360
Change-Id: I00c45767ee2d70b790590e824599d5a4c274bced
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Rodolfo Alonso Hernandez [Fri, 17 Aug 2018 08:48:22 +0000 (08:48 +0000)]
Merge "Improve IXIA TG Rx/TX throughput calculation"
Rodolfo Alonso Hernandez [Fri, 17 Aug 2018 07:36:53 +0000 (08:36 +0100)]
Add RFC2544 IXIA latency information
JIRA: YARDSTICK-1385
Change-Id: Icecceaabc0389279a3a7154884c50259f794eb76
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Emma Foley [Thu, 16 Aug 2018 15:24:16 +0000 (16:24 +0100)]
Cleanup unittests for test_lmbench
unused-arg check was re-enabled after being disabled at a file level.
Changes were made so that the file conforms to our testing conventions.
Change-Id: Ie34a0088258c1aaff6cb0fdf0b86b37920d35bd6
JIRA: YARDSTICK-1384
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Emma Foley [Thu, 16 Aug 2018 15:27:23 +0000 (15:27 +0000)]
Merge "IXIA traffic stops running after first iteration"
Rex Lee [Thu, 16 Aug 2018 13:32:43 +0000 (13:32 +0000)]
Merge "Disk Initialization and Custom Workload"
Mytnyk, Volodymyr [Mon, 13 Aug 2018 10:00:00 +0000 (11:00 +0100)]
Improve IXIA TG Rx/TX throughput calculation
Use float instead of integer to convert TG throughtput
IXIA statistic.
JIRA: YARDSTICK-1378
Change-Id: I39bd143adc4b10035c6f0986a06d407a18aa0887
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
Mytnyk, Volodymyr [Thu, 16 Aug 2018 07:40:04 +0000 (08:40 +0100)]
Fix setting `flow` configuration in TC yaml
The `flow` configuration is not applied to the traffic
profile if `seed` or `count` option is missing in the
TC definition.
- Fix `seed` backward compatibility.
JIRA: YARDSTICK-1383
Change-Id: Ic874fb2be1c13009f94eb3a80194bfe81d7a923b
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
Stepan Andrushko [Thu, 24 May 2018 10:13:40 +0000 (13:13 +0300)]
Add virtual image generation to install script
Update install.yaml with image generation: nsb and normal.
JIRA: YARDSTICK-1198
Change-Id: I3b8773e9b3b9890ae8623bb6536d05f1151d84a8
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
Abhijit Sinha [Wed, 15 Aug 2018 13:07:51 +0000 (13:07 +0000)]
Merge "[docs] Remove the VTC chapter in the userguide"
Abhijit Sinha [Wed, 15 Aug 2018 12:48:39 +0000 (12:48 +0000)]
Merge "Fix KPI data reported by ProxBinSearchProfile"