DanielMartinBuckley [Tue, 5 Jun 2018 18:06:38 +0000 (19:06 +0100)]
Decrease Sampling interval
JIRA: YARDSTICK-1219
Currently NSB for NFVI using PROX returns sampling information every 13
seconds.
This is too slow.
It is required to return sampling information form Generator AND VNF at
least every 1 second.
This change is depandant on JIRA: YARDSTICK-1212 and YARDSTICK-1220
Change-Id: Ica7ab795a2919d191d8cd846d028e15739e33fb7
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
(cherry picked from commit
f8b45aca386ed5852d9568c531ba4595c68cc0e2)
DanielMartinBuckley [Wed, 6 Jun 2018 14:06:01 +0000 (15:06 +0100)]
Addition of Configurable Sampling and Configurable Confirmation Retry
JIRA: YARDSTICK-1221
In order to increase accuracy of result the following are done :-
- Improve Measurement Accuracy (YARDSTICK-1212)
- Improve Sampling Interval (YARDSTICK-1219)
- Allow 4 PROX ports to be read simultaneously (YARDSTICK-1220)
This change does the following :-
- Stores LINE Rate statistics of Sample
- Requires a confirmation retry before deciding to increase or
decrease this is configurable.
- Allows the user to disable Sampling or specify a sample interval
- Added Code Coverage of ProxDurationRunner based on YARDSTICK-1199
Change-Id: I27242ac1849c9a2712866385b5fbc05977c71516
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
(cherry picked from commit
2e447af9a5a54355aa20028813660d07d1bd2e18)
Miikka Koistinen [Fri, 8 Jun 2018 10:54:48 +0000 (13:54 +0300)]
Convert SLA asserts to raises
This commit converts Python assertions to a custom exception in all
places where SLA validation is checked with an assertion.
This commit also fixes all emerged pylint errors.
JIRA: YARDSTICK-966
Change-Id: If771ed03b2cbc0a43a57fcfb9293f18740b3ff80
Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
(cherry picked from
39f80e9b06395ae1515cfcf08508504ad4dd978a)
Jing Lu [Thu, 28 Jun 2018 07:36:33 +0000 (07:36 +0000)]
Merge "Bugfix: HA kill process recovery has a conflict" into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:24:14 +0000 (07:24 +0000)]
Merge "Replace glance delete image with shade client." into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:24:10 +0000 (07:24 +0000)]
Merge "Replace glance create image with shade client." into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:24:08 +0000 (07:24 +0000)]
Merge "Replace cinder detach volume with shade client." into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:24:04 +0000 (07:24 +0000)]
Merge "Replace cinder delete volume with shade client." into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:24:01 +0000 (07:24 +0000)]
Merge "Replace cinder create volume with shade client." into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:23:59 +0000 (07:23 +0000)]
Merge "Replace cinder get_volume_id with shade client." into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:23:56 +0000 (07:23 +0000)]
Merge "Replace nova get flavor with shade client." into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:23:53 +0000 (07:23 +0000)]
Merge "Replace nova get server with shade client." into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:23:50 +0000 (07:23 +0000)]
Merge "Replace nova attach volume to server with shade client." into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:23:47 +0000 (07:23 +0000)]
Merge "Replace nova delete keypair with shade client." into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:23:44 +0000 (07:23 +0000)]
Merge "Replace nova client create keypair with shade." into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:23:41 +0000 (07:23 +0000)]
Merge "Remove unused nova client functions." into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:23:35 +0000 (07:23 +0000)]
Merge "Replace nova delete instance with shade client." into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:23:33 +0000 (07:23 +0000)]
Merge "Replace nova create instance with shade client." into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:23:30 +0000 (07:23 +0000)]
Merge "Update neutron delete_neutron_net function." into stable/fraser
Rodolfo Alonso Hernandez [Thu, 28 Jun 2018 07:23:26 +0000 (07:23 +0000)]
Merge "Replace neutron create security group full with shade." into stable/fraser
Chornyi, TarasX [Tue, 26 Jun 2018 11:39:56 +0000 (14:39 +0300)]
Corrected scale-up command line arguments
Change-Id: If308fde797dcb01e58f37ad81bb116fde542366a
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
(cherry picked from commit
5fa31a4e78b9421615ef81c8392e30179d49e1cb)
Rodolfo Alonso Hernandez [Wed, 27 Jun 2018 16:48:33 +0000 (16:48 +0000)]
Merge "Change IxNextgen library load" into stable/fraser
Shobhi Jain [Thu, 12 Apr 2018 12:38:21 +0000 (13:38 +0100)]
Replace glance delete image with shade client.
Remove get_image_id function.
Function delete_image now uses shade client.
JIRA: YARDSTICK-892
Change-Id: I6e8510dfa49aa14786ed7ac3382b85c4e699fb9e
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit
d6c1b8b7bfd257efd5fe2df30dd450bdb2c57c7d)
Shobhi Jain [Wed, 11 Apr 2018 08:34:22 +0000 (09:34 +0100)]
Replace glance create image with shade client.
Function create_image now uses shade client.
JIRA: YARDSTICK-892
Change-Id: Ia41d9ce702a1f24031080f8a365c1b2bd9ac9faa
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit
c31edc5ab9013d93ffd32ed72adb14740e43b24a)
Shobhi Jain [Tue, 10 Apr 2018 14:17:35 +0000 (15:17 +0100)]
Replace cinder detach volume with shade client.
Function detach volume now uses shade client.
JIRA: YARDSTICK-891
Change-Id: Ie437ccf1172cb82dc869963f0d62e31a5ab23ebb
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit
f6cca46f6b1aa6134a0e634a3a9e524cdbbfa729)
Shobhi Jain [Tue, 10 Apr 2018 13:13:50 +0000 (14:13 +0100)]
Replace cinder delete volume with shade client.
Function delete volume now uses shade client.
JIRA: YARDSTICK-891
Change-Id: I016e1d3bf5972879cad176b56c7282e35413945e
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit
4c672aa7012a530806a2f8ff2d45a8badb7f7b21)
Shobhi Jain [Fri, 6 Apr 2018 13:44:33 +0000 (14:44 +0100)]
Replace cinder create volume with shade client.
Adds get_volume function.
Function create volume now uses shade client.
JIRA: YARDSTICK-891
Change-Id: I0b2fae5f2cf52eaf2e4a0062c858d49bc4ce9ccd
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit
2d33d0f289f3dd3864fe57289e953b876f362c06)
Shobhi Jain [Fri, 6 Apr 2018 10:41:54 +0000 (11:41 +0100)]
Replace cinder get_volume_id with shade client.
Function get_volume_id now uses shade client.
JIRA: YARDSTICK-891
Change-Id: I45ae40982a64f677dbbdeb6c9510a0ec9ac973f1
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit
be197a6197e803b6334f2ccf72f561245ef7aac7)
Shobhi Jain [Thu, 5 Apr 2018 15:04:08 +0000 (16:04 +0100)]
Replace nova get flavor with shade client.
Rename get_flavor_by_name with get_flavor.
Function get_flavor now uses shade client.
JIRA: YARDSTICK-1088
Change-Id: Ic82127e475baf39643be0a254b177f3058b85748
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit
35bbd618b1e69a5b5edbd64a333720bfa5a92400)
Shobhi Jain [Fri, 30 Mar 2018 09:45:54 +0000 (10:45 +0100)]
Replace nova get server with shade client.
Rename get_server_by_name with get_server.
Function get_server now uses shade client.
JIRA: YARDSTICK-1088
Change-Id: I69c59145cefdb565f3ece27baaaf932905e1b757
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit
d75a91ebf2937e5cfe5cf2aa5a90db9121f73967)
Shobhi Jain [Wed, 28 Mar 2018 11:19:35 +0000 (12:19 +0100)]
Replace nova attach volume to server with shade client.
Function attach_volume_to_server now uses shade client
instead of nova client.
JIRA: YARDSTICK-1088
Change-Id: Id00df672c2c195b5c338cbbc30ddf2742a4e4d29
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit
8fd82cd8d0146d8cebbc32ed7cbb6fb9d1861297)
Shobhi Jain [Tue, 27 Mar 2018 15:47:04 +0000 (16:47 +0100)]
Replace nova delete keypair with shade client.
Function delete_keypair now uses shade client.
JIRA: YARDSTICK-1088
Change-Id: I46b895748c5c44b0bf7d5b035395676ebff48d7f
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry pick from commit
aded0fdb30caf035e0eb94c1216f436ba597c2c7)
Shobhi Jain [Tue, 27 Mar 2018 13:28:08 +0000 (14:28 +0100)]
Replace nova client create keypair with shade.
Function create_keypair now uses shade client instead
of nova client.
JIRA: YARDSTICK-1088
Change-Id: I060580504d6969c5ba859ed4494082feb998d37d
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry pick from commit
c1ab98526209a761a0565afa7ccd552ba9ac7ade)
Shobhi Jain [Mon, 26 Mar 2018 15:04:49 +0000 (16:04 +0100)]
Remove unused nova client functions.
Following funtions are not required by shade client also
not been used in any of the scenario files:
*create_aggregate
*create_aggregate_with_host
*create_instance
*add_host_to_aggregate
*create_aggregate_with_host
*get_availability_zones
*get_availability_zone_names
*remove_hosts_from_aggregate
*remove_host_from_aggregate
*delete_aggregate
*get_image_by_name
*check_status
JIRA: YARDSTICK-1088
Change-Id: I7ba0fbce6aa3e636aa55581a993c1ec1b48fbead
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit
2ca15a8c87e171cbd82b1e748dfc60903662b73b)
Shobhi Jain [Mon, 26 Mar 2018 13:56:59 +0000 (14:56 +0100)]
Replace nova delete instance with shade client.
Function delete_instance now uses shade client.
JIRA: YARDSTICK-1088
Change-Id: I5772a74c6dc2d103edd410042a8eaf721d1bcc5c
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit
05f97c4e4ce1e8c7c97cda16f12215e663a13c23)
Shobhi Jain [Thu, 22 Mar 2018 16:45:13 +0000 (16:45 +0000)]
Replace nova create instance with shade client.
Remove redundant functions:
*get_instances
*get_instance_status
*get_instance_by_name
Function create_instance_and_wait_for_active now uses shade client.
JIRA: YARDSTICK-1088
Change-Id: I766da333dabbb1b83a7b4ede4bf73567ec70eb8c
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit
069d7a13d1f8b6b465ae164e2a440c25270f7e8e)
Shobhi Jain [Fri, 16 Mar 2018 13:07:55 +0000 (13:07 +0000)]
Update neutron delete_neutron_net function.
Update the changes done in patch [1].
JIRA: YARDSTICK-890
[1] https://gerrit.opnfv.org/gerrit/#/c/52361/
Change-Id: Iccbf16d0a2e72919d5092366241ff41686f01a58
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit
14615e286e67ca74a8c0ae55ffe043170e5ecbb6)
Shobhi Jain [Fri, 16 Mar 2018 11:56:09 +0000 (11:56 +0000)]
Replace neutron create security group full with shade.
Function create_security_group_full now uses shade client.
Remove openstack util's private 'get_security_groups',
'get_security_group_id' & 'create_security_group' functions as
'create_security_group_full' now uses 'get_security_group' &
'create_security_group' function defined in shade client library.
JIRA: YARDSTICK-890
Change-Id: Ibd5b9ca9b7ce99b3e40c5dcc545f2af672ce2203
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
(cherry picked from commit
c00e2c606806b46111b108818235d236ba409515)
Mytnyk, Volodymyr [Wed, 27 Jun 2018 13:27:15 +0000 (14:27 +0100)]
NSB setup inventory name changed
NSB setup script [1] fails when retrieving the inventory file. This script
is going to be deprecated but we still support it.
[1] https://github.com/opnfv/yardstick/blob/master/nsb_setup.sh
JIRA: YARDSTICK-1247
Change-Id: I3798531652b0e3a1a007d1d9434998fdd54645d7
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
(cherry picked from commit
370b703896656f6b6949de05b6c44c98a72eee46)
John O Loughlin [Wed, 2 May 2018 09:03:20 +0000 (10:03 +0100)]
Fix nsb_setup.sh script
Ansible role install_dependencies was renamed
to install_dependencies_jumphost in previous patch.
JIRA: YARDSTICK-1146
Change-Id: Idf7c191151961c1c0e63ad2f75aa0aab8ed2b2fa
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
(cherry picked from commit
bbf5e6a37922124bd729b5e6e50929c282bb7892)
Rodolfo Alonso Hernandez [Wed, 27 Jun 2018 09:18:56 +0000 (09:18 +0000)]
Merge "Install dependencies: bare-metal, standalone" into stable/fraser
Rodolfo Alonso Hernandez [Wed, 27 Jun 2018 09:18:51 +0000 (09:18 +0000)]
Merge "Start nginx and uwsgi servicies only in not container mode" into stable/fraser
Rodolfo Alonso Hernandez [Wed, 27 Jun 2018 09:18:47 +0000 (09:18 +0000)]
Merge "Migrate install.sh script to ansible" into stable/fraser
rexlee8776 [Tue, 19 Jun 2018 10:40:20 +0000 (10:40 +0000)]
Bugfix: HA kill process recovery has a conflict
It happens in Nokia SUT when running in the Plugfest. The problem happens when
the start_process start to recover the killed process (like nova-api), but the
self-cured mechanism already recovered. And somehow it lead to a conflict and
has problems.
So the recover of the HA attack-recover should be improved to only recover it
when it needs to.
JIRA: YARDSTICK-1222
Change-Id: I1acb5a7d59d6fe4e0de0b0c5942fa89e051dd1ff
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit
736f3fa5d52345d6fe5174b83de043f779fa0600)
Stepan Andrushko [Tue, 15 May 2018 09:46:42 +0000 (12:46 +0300)]
Install dependencies: bare-metal, standalone
This will install all dependencies needed on the bare-metal and standalone
physical nodes.
JIRA: YARDSTICK-1177
Change-Id: I719ca64d4da098d6dd60597e5fc4ad6f4715f79e
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit
86be172a9427a4ecee5666e9660ce37c006abe1b)
Stepan Andrushko [Tue, 15 May 2018 15:42:55 +0000 (18:42 +0300)]
Start nginx and uwsgi servicies only in not container mode
No need to execute nginx and uwsgi when running in container mode.
JIRA: YARDSTICK-1179
Change-Id: I253f3adab388a14886b70e6589936f6eb27ac4c0
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
(cherry picked from commit
3decdca3d0732a1df845650562e7bcb8fbfd87a7)
John O Loughlin [Fri, 16 Feb 2018 15:29:58 +0000 (15:29 +0000)]
Migrate install.sh script to ansible
Ansible scripts to install yardstick.
These scripts will take a few options:
INSTALLATION_MODE : Container or Baremetal
YARDSTICK_DIR: Location of Yardstick directory
VIRTUAL_ENVIRONMENT: Should a virtual environment be used
NSB_DIR: Location of NSB directory
JIRA: YARDSTICK-1126
Change-Id: I4a13e07e96650ffd971dfb18472f2563cfd51aa9
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
(cherry picked from commit
0b976dd02421a181674acc837127ac741ccfccea)
Rodolfo Alonso Hernandez [Tue, 5 Jun 2018 14:44:30 +0000 (15:44 +0100)]
Refactor "utils.parse_ini_file" testing
JIRA: YARDSTICK-1218
Change-Id: I5136b22110d215beb7af72998ad47a8dba27f63b
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit
4a186ef7fde978f89f4332990f70e396966f69e3)
Emma Foley [Tue, 26 Jun 2018 14:37:52 +0000 (15:37 +0100)]
Fix "os.path" mock problems during tests
This patch removes the global mocking applied on "os.path".
Change-Id: Ia18d2c90195c5408a1852792bdf05b6f0c1ad21f
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit
d7f8717c3beb1854976e77d56823f482497ffff3)
Emma Foley [Tue, 26 Jun 2018 13:56:01 +0000 (13:56 +0000)]
Merge "Refactor RFC2455 TRex traffic profile injection" into stable/fraser
Rodolfo Alonso Hernandez [Mon, 25 Jun 2018 07:47:00 +0000 (08:47 +0100)]
Change IxNextgen library load
Changed IxNextgen library load in IXIA RFC2544 traffic generator call.
JIRA: YARDSTICK-1116
Change-Id: Icbdc5f1255dd2676584f3a1be767287e55e71f4a
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit
9d84f5ad73e9689d3131e4ce09fe7262697c5817)
Rodolfo Alonso Hernandez [Thu, 14 Jun 2018 13:14:27 +0000 (14:14 +0100)]
Stop time.sleep mocks in unit tests
tVpeApproxVnf and TestProxSocketHelper classes mock "time.sleep" in
the setUp method without deleting it at the end of the test execution.
JIRA: YARDSTICK-1243
Change-Id: Iff31d9c7b400ad8a47f37792aeb0d20328b9d9e1
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit
9b22f5b23050a0be67f8237e4d0b412f58b43472)
Rodolfo Alonso Hernandez [Thu, 24 May 2018 13:02:03 +0000 (14:02 +0100)]
Refactor RFC2455 TRex traffic profile injection
The TRex RFC2455 traffic profile configures the duration of the traffic
injection. Once the traffic is started, the traffic profile should poll
the traffic injector client for the injection status. When the injection
is finished, the traffic execution should end.
Instead of this, the traffic profile waits a fixed time (using time.sleep
method) and then stops the traffic. This approach is not accurate and may
cause shorter injection periods.
JIRA: YARDSTICK-1197
Change-Id: I5090df81ef4ec7945ff6c1aff070656b48e0fe77
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit
340be73be5fd20067c23a7ddce9073639e355d3a)
Emma Foley [Fri, 27 Apr 2018 10:33:17 +0000 (10:33 +0000)]
Move tests: unit/network_services/helpers
* Fix pylint errors
* Add TODOs
Some errors are ignored locally, as they were a symptom of other problems.
These issues have been flagged with a TODO, and should be fixed later.
JIRA: YARDSTICK-837
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: If0b77a6e0b102071ecfb212362647c62a621e4f9
(cherry-picked from commit
065c00d3147d12c692d43179d9c1c9afadb97825)
Emma Foley [Tue, 26 Jun 2018 11:02:43 +0000 (11:02 +0000)]
Merge "Move tests: unit/network_services/vnf_generic" into stable/fraser
Emma Foley [Tue, 26 Jun 2018 10:17:47 +0000 (10:17 +0000)]
Merge "Standalone XML machine type is not longer valid" into stable/fraser
Emma Foley [Fri, 27 Apr 2018 10:30:20 +0000 (10:30 +0000)]
Move tests: unit/network_services/vnf_generic
* Fix pylint errors
* Add TODOs
Some errors are ignored locally, as they were a symptom of other problems.
These issues have been flagged with a TODO, and should be fixed later.
JIRA: YARDSTICK-837
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: I3d95537a64bde923703421510d27bac0d6dd92bd
(cherry-picked from commit
98294f2c8153f663c3b3a4e4cb98910e9d5cb602)
Emma Foley [Tue, 26 Jun 2018 09:30:47 +0000 (09:30 +0000)]
Merge "Remove instantiated contexts in "test_task"" into stable/fraser
Rodolfo Alonso Hernandez [Thu, 31 May 2018 17:54:31 +0000 (18:54 +0100)]
Remove instantiated contexts in "test_task"
During unit testing, all contexts instantiated must be deleted at the end
of the test to avoid clashes with other tests.
JIRA: YARDSTICK-1209
Change-Id: I1994b915001b4a518e096833a0c5d33febbd8de6
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit
5e4d95ba299ce92588701d9481657c343b8ef609)
Emma Foley [Mon, 25 Jun 2018 15:08:31 +0000 (15:08 +0000)]
Merge "Move tests: unit/network_services/nfvi" into stable/fraser
Rodolfo Alonso Hernandez [Mon, 25 Jun 2018 14:41:59 +0000 (14:41 +0000)]
Merge "Add "duration" parameter to test case definition" into stable/fraser
Rodolfo Alonso Hernandez [Mon, 25 Jun 2018 14:40:34 +0000 (14:40 +0000)]
Merge "Remove print out of logger exception in TestUtils" into stable/fraser
Rodolfo Alonso Hernandez [Mon, 25 Jun 2018 14:40:13 +0000 (14:40 +0000)]
Merge "Cleanup TestYardstickNSCli class" into stable/fraser
Emma Foley [Mon, 25 Jun 2018 14:38:17 +0000 (14:38 +0000)]
Merge "Document for Fraser test case results" into stable/fraser
Emma Foley [Fri, 27 Apr 2018 10:41:10 +0000 (10:41 +0000)]
Move tests: unit/network_services/nfvi
* Fix pylint errors
* Add TODOs
Some errors are ignored locally, as they were a symptom of other problems.
These issues have been flagged with a TODO, and should be fixed later.
JIRA: YARDSTICK-837
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: Id330ee1c89d54ef487edb7fe160e5a31d9a3094f
(cherry-picked from commit
e12f98c2bbed5191714bdc553e7b269b1437cecd)
Rodolfo Alonso Hernandez [Wed, 23 May 2018 08:16:39 +0000 (09:16 +0100)]
Add "duration" parameter to test case definition
Add "duration" parameter to test case definition, in scenario:options
section. This parameter will be rendered in the traffic profile.
If the parameter is not present in the test case scenario options, the
default time written in the traffic profile options will be 30 seconds
(TrafficProfile.DEFAULT_DURATION = 30). If the traffic profile
injection time is not defined, the default injection time will be 30
seconds.
testcase:scenario:options:duration (default = 30)
render --> traffic_profile:duration
parse --> TrafficProfile.duration (default = 30)
Target traffic profiles (RFC2544):
- RFC2544Profile
- IXIARFC2544Profile
JIRA: YARDSTICK-1194
Change-Id: I968922e6bb882d7ee15aa1c4db4037face7a3492
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit
1517319fd210d71db72c5e4bfa00fc49ae4fa877)
Rodolfo Alonso Hernandez [Thu, 12 Apr 2018 14:08:58 +0000 (15:08 +0100)]
Improve IXIA IxNetwork library and traffic profile (4)
This patch implements an active wait for the traffic injection. Once the
traffic is started, the traffic generator class will poll periodically the
IXIA traffic generator chassis to retrieve the status of the traffic
("started", "stopped").
Now the latency statistics are retrieved and reported for each injection
period.
JIRA: YARDSTICK-1116
Change-Id: I4422e2c88b4fc97b7cac3de8a82b2d75467c4117
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit
a3399d07b83ce0e50d9c0144d00a7ba83a73390f)
Rodolfo Alonso Hernandez [Wed, 11 Apr 2018 17:32:52 +0000 (18:32 +0100)]
Improve IXIA IxNetwork library and traffic profile (3)
This patch modifies IP packet parameters.
"IxNextgen.update_ip_packet" modifies the L3 packet according to the
test case and setup the IP addresses.
JIRA: YARDSTICK-1116
Change-Id: I46ff75ab1989d0e6f5cc876418a015386717e06f
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit
e5c78ae3ec1bcf0cb44646c6031fb9c04dd63e4a)
Rodolfo Alonso Hernandez [Tue, 10 Apr 2018 08:15:55 +0000 (09:15 +0100)]
Improve IXIA IxNetwork library and traffic profile (2)
This patch modifies the way the packet frame and the flow is configured
before the injection.
"IxNextgen.update_frame" modifies the L2 frame according to the
test case and setup the frame rate, frame size, traffic injection
duration and MAC addresses.
JIRA: YARDSTICK-1116
Change-Id: Ife08f15a4eda24d7835c92c4172b450854d112ee
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit
8d10a6a8447fc2798491a6f3856e21b85fa309ba)
Rodolfo Alonso Hernandez [Tue, 10 Apr 2018 07:39:16 +0000 (08:39 +0100)]
Improve IXIA IxNetwork library and traffic profile (1)
This patch introduces a new way to configure the TCL IxNetwork server.
All the configuration is done using the TCL API, removing the need of
using the pre-saved configuration file.
"IxNextgen.assign_ports" creates and assigns the virtual ports for each
physical port defined in the test case.
"IxNextgen.create_traffic_item" creates one traffic item and two flow
groups per pair of ports, in both directions.
"IxNextgen.gt_statistics" retrieves only the required statistics to
generate the samples blob in the traffic generator.
JIRA: YARDSTICK-1116
Change-Id: I8f1c0c55e99c274b2ed8276ed9a385c502e16d93
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit
ee721fd3e8b77ccfe4252a107a9af8dc41ccc389)
Rodolfo Alonso Hernandez [Mon, 25 Jun 2018 09:20:44 +0000 (09:20 +0000)]
Merge "Add active wait function" into stable/fraser
Rodolfo Alonso Hernandez [Mon, 25 Jun 2018 09:20:39 +0000 (09:20 +0000)]
Merge "Add IxNetwork API Python Binding package" into stable/fraser
Rodolfo Alonso Hernandez [Mon, 25 Jun 2018 07:48:11 +0000 (07:48 +0000)]
Merge "Use TRex release v2.41 to support both x86 and aarch64" into stable/fraser
Rodolfo Alonso Hernandez [Thu, 19 Apr 2018 13:58:38 +0000 (14:58 +0100)]
Add active wait function
Added function "wait_until_true". This function will make an active
wait until the predicate passed as an argument returns True.
If the timeout expires, the function will raise a generic exception
or a user defined one passed as an argument.
This function will be used in YARDSTICK-1127.
JIRA: YARDSTICK-1128
Change-Id: I9854e465ac6b586bf4be39ab4b266d5625b39e30
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from
099108aab37d1fae1b27f4e2e20136c234df1a52)
Rodolfo Alonso Hernandez [Thu, 29 Mar 2018 14:39:49 +0000 (15:39 +0100)]
Add IxNetwork API Python Binding package
Add IxNetwork python package to the requirements list.
This module is needed for the "NSPerf" scenarios using IXIA as traffic
generator, when IxNetwork is the program used to handle the IXIA
generator.
The latest version of this module is 8.40.1124.9 [1]. The license type
is MIT.
[1] https://pypi.python.org/pypi/ixnetwork
JIRA: YARDSTICK-1106
Change-Id: I279933c95994f5120930256a104c4192a0b9900d
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Emma Foley [Fri, 22 Jun 2018 16:45:56 +0000 (16:45 +0000)]
Merge "Configure ACL via static file" into stable/fraser
Emma Foley [Fri, 22 Jun 2018 16:39:35 +0000 (16:39 +0000)]
Merge "Move tests: unit/network_services/traffic_profile" into stable/fraser
Emma Foley [Fri, 22 Jun 2018 16:37:53 +0000 (16:37 +0000)]
Merge "Cleanup BaseMonitor unit tests" into stable/fraser
Emma Foley [Fri, 27 Apr 2018 10:37:37 +0000 (10:37 +0000)]
Move tests: unit/network_services/traffic_profile
* Fix pylint errors
* Add TODOs
Some errors are ignored locally, as they were a symptom of other problems.
These issues have been flagged with a TODO, and should be fixed later.
JIRA: YARDSTICK-837
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: Id983a2e415d66633331e7fea96a377e2a7589980
(cherry-picked from commit
cfc40ad1bb36889e54bc99cb779cfcfa1f3b04dd)
Abhijit Sinha [Fri, 22 Jun 2018 15:46:31 +0000 (15:46 +0000)]
Merge "MQ startup process refactor" into stable/fraser
Emma Foley [Fri, 22 Jun 2018 15:21:59 +0000 (15:21 +0000)]
Merge "Add "host_name_separator" variable to Context class" into stable/fraser
Emma Foley [Fri, 22 Jun 2018 15:13:32 +0000 (15:13 +0000)]
Merge "Move IncorrectConfig, IncorrectSetup and IncorrectNodeSetup to exceptions" into stable/fraser
trevortao [Wed, 23 May 2018 04:42:28 +0000 (12:42 +0800)]
Use TRex release v2.41 to support both x86 and aarch64
Currently Yardstick uses Cisco's TRex release v2.28 which
can only support x86, for the consideration of
multi-arch support of Yardstick, the trex release v2.41
is now available and it can support multi-arch(both x86
and aarch64) now.
For the external lib of v2.41, for x86_64, it looks like:
external_libs/pyzmq-14.5.0/python2/intel/ucs4/64bit/zmq
for arm64, it looks like:
external_libs/pyzmq-14.5.0/python2/arm/ucs4/64bit/zmq
So replace the trex release v2.28 with v2.41.
JIRA: YARDSTICK-1191
Change-Id: I22dc3499283d48a89da1145cc480fd7d2a93a1cc
Signed-off-by: trevortao <trevor.tao@arm.com>
(cherry picked from commit
13f19d35a04ffb46ca673e81385779bc46c48781)
Mytnyk, Volodymyr [Thu, 31 May 2018 09:03:10 +0000 (10:03 +0100)]
Configure ACL via static file
This patch allows user to configure ACL/vFW SampleVNF ACL
via configuration file provided in TC definition. The
Yardstick applies the rules to SampleVNF from specified config
file + rules generated by Yardstick (default rules).
The example of SampleVNF ACL CLI commands generated/applied
by Yardstick can be found at (using default ACL config file):
ACL VNF ACL CLI commands:
acl/tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex.yaml
http://paste.openstack.org/show/723303/
vFW VNF ACL CLI commands:
vfw/tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex.yaml
http://paste.openstack.org/show/723304/
Change-Id: I76a630261a982083b628e3985fc3bec14ca495db
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
(cherry picked from commit
3fdca97ff5053770161059a34a95fd39463eaecd)
Chornyi, TarasX [Wed, 4 Apr 2018 08:26:09 +0000 (11:26 +0300)]
MQ startup process refactor
JIRA: YARDSTICK-1112
Change-Id: Id30236e190bae9fb0f5b5ebd4c5e04798e4fd443
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
(cherry picked from commit
d38bd854fb2c3eb6c0c4dd34ace2a52af7cf892d)
Rodolfo Alonso Hernandez [Fri, 22 Jun 2018 11:43:07 +0000 (11:43 +0000)]
Merge "Do not start collectd twice when SampleVNF is running on Baremetal" into stable/fraser
Mytnyk, Volodymyr [Wed, 4 Apr 2018 15:30:08 +0000 (16:30 +0100)]
Add scale out TCs with availability zone support
Add PROX and vFW scale out TCs with availability zone
configuration. To be able to specify the availability
zone for specific VNF or TG the following example of
command line option shoud be used:
yardstick -d task start --task-args='{
"num_vnfs": 2, "availability_zone":
{
"vnf_0": "az_0", "tg_0": "az_0",
"vnf_1": "az_1", "tg_1": "az_1",
... }}' <SCALE-OUT-TC-FILE>
The steps to run new scale-out TCs is documented in the
userguide.
JIRA: YARDSTICK-1203
Change-Id: Ib3878485c5483981fe9b48ab02995712bcc31ae5
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
(cherry picked from commit
0156b5c37e08f91a37dda08edb854758bbba7413)
Rodolfo Alonso Hernandez [Fri, 22 Jun 2018 07:23:19 +0000 (07:23 +0000)]
Merge "Add --hwlb options as a command line argument for SampleVNF" into stable/fraser
Rodolfo Alonso Hernandez [Tue, 22 May 2018 10:47:52 +0000 (11:47 +0100)]
Standalone XML machine type is not longer valid
Current XML machine type definition [1] is not longer valid. According to
[2], the default machine type should be "pc-i440fx-xenial".
NOTE: StandAlone physical nodes are deployed using Ubuntu OS.
[1]https://github.com/opnfv/yardstick/blob/master/yardstick/benchmark/contexts/standalone/model.py#L48
[2]https://wiki.ubuntu.com/QemuKVMMigration#Upgrade_machine_type
JIRA: YARDSTICK-1192
Change-Id: I77b1379aaf416b1225e91af2c3ac746cb101f774
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit
6414a61a988a73ee1b939e2d5de2f0afdde4319a)
Rodolfo Alonso Hernandez [Fri, 1 Jun 2018 15:54:11 +0000 (16:54 +0100)]
Move IncorrectConfig, IncorrectSetup and IncorrectNodeSetup to exceptions
JIRA: YARDSTICK-1218
Change-Id: I804065e9bce3e728f5bf9e756a78df8fd28f74ac
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit
dc0e675f47f4dbf1b54ce9c22878e2e876bc26e8)
Rodolfo Alonso Hernandez [Fri, 1 Jun 2018 12:49:38 +0000 (13:49 +0100)]
Move ErrorClass definition to exceptions module
JIRA: YARDSTICK-1216
Change-Id: I82556e1d1b0c723221a58e188067cbce560b8338
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit
2bdda85878ed1507d1a91f69c3489bb9ba9d447d)
Rodolfo Alonso Hernandez [Thu, 21 Jun 2018 13:28:03 +0000 (13:28 +0000)]
Merge "Convert SSH custom exceptions to Yardstick exceptions" into stable/fraser
Rodolfo Alonso Hernandez [Thu, 21 Jun 2018 13:08:42 +0000 (13:08 +0000)]
Merge "Remove AnsibleCommon class method mock" into stable/fraser
Rodolfo Alonso Hernandez [Thu, 21 Jun 2018 13:04:55 +0000 (13:04 +0000)]
Merge "Error when adding SR-IOV interfaces in SR-IOV context" into stable/fraser
Rodolfo Alonso Hernandez [Thu, 21 Jun 2018 13:04:50 +0000 (13:04 +0000)]
Merge "Remove __init__ method overriding in HeatContextTestCase" into stable/fraser
Rodolfo Alonso Hernandez [Thu, 21 Jun 2018 13:04:21 +0000 (13:04 +0000)]
Merge "Bump oslo.messaging version to 5.36.0" into stable/fraser
Rodolfo Alonso Hernandez [Thu, 21 Jun 2018 13:04:08 +0000 (13:04 +0000)]
Merge "Set "cmd2" library to version 0.8.6" into stable/fraser
Rodolfo Alonso Hernandez [Mon, 21 May 2018 16:38:50 +0000 (17:38 +0100)]
Error when adding SR-IOV interfaces in SR-IOV context
Method "add_sriov_interfaces" in Libvirt class throws an error when trying
to add SR-IOV interfaces in the XML file.
Function "setup_sriov_context" in SriovContext if passing to
"_enable_interfaces" method the XML file name instead of passing the XML
string.
JIRA: YARDSTICK-1189
Change-Id: If021c102311ecb98cb26934f78067dfc720e4291
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit
72df0eaac4a2a1f23439af7f249c2b5d18d1b819)
Rodolfo Alonso Hernandez [Fri, 1 Jun 2018 08:38:28 +0000 (09:38 +0100)]
Remove __init__ method overriding in HeatContextTestCase
Unit test case clases should implement setUp() method instead of overriding
__init__() method.
JIRA: YARDSTICK-1210
Change-Id: I0f9a10575f9aeebf76dfa84619e59589b3ea83f6
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit
619bed631f064a94ab20ac296802d467ebe32318)
John O Loughlin [Wed, 2 May 2018 07:50:53 +0000 (08:50 +0100)]
Correctly set PYTHONPATH in Dockerfile
JIRA: YARDSTICK-1144
Change-Id: I8c0fe229ed620417a85356e017b171260373c43f
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
(cherry picked from commit
a114dc39f003beb1bb1ed12ed17fd3a6d0e7deaa)