chenjiankun [Fri, 16 Mar 2018 02:44:42 +0000 (02:44 +0000)]
Add SUT page in GUI
JIRA: YARDSTICK-1076
We need to show SUT information in GUI.
Change-Id: I885773894fc9f6aa5975b39383af1fdf1b88b8bb
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
chenjiankun [Wed, 14 Mar 2018 09:41:01 +0000 (09:41 +0000)]
Create API to get SUT information
JIRA: YARDSTICK-1072
We need to show SUT information in GUI.
Change-Id: I40bcd513f3c6a443c82764687637ac5258b99584
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
Jack Chan [Wed, 14 Mar 2018 06:33:38 +0000 (06:33 +0000)]
Merge "Get SUT information"
Ross Brattain [Tue, 13 Mar 2018 00:09:22 +0000 (00:09 +0000)]
Merge "Add support for VNC to VMs created by ansible"
Ross Brattain [Tue, 13 Mar 2018 00:00:11 +0000 (00:00 +0000)]
Merge "[Bug Fix] Support nova create instance operation"
Emma Foley [Mon, 12 Mar 2018 13:26:12 +0000 (13:26 +0000)]
Merge changes from topics 'delete_router', 'neutron_subnet_create', 'neutron_create'
* changes:
Replace neutron router deletion with shade.
Replace neutron subnet creation with shade.
Replace neutron network creation with shade.
Abhijit Sinha [Mon, 12 Mar 2018 12:01:49 +0000 (12:01 +0000)]
Merge "Add context name to Dummy test"
Emma Foley [Mon, 12 Mar 2018 11:55:18 +0000 (11:55 +0000)]
Merge "Reduce the log level if TRex client is no connected"
Shobhi Jain [Mon, 19 Feb 2018 16:50:51 +0000 (16:50 +0000)]
Replace neutron router deletion with shade.
Function delete_neutron_router now uses shade client instead of neutron
client.
JIRA: YARDSTICK-890
Change-Id: I5b557b640396f343b85b5f5eff415384decc083c
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
Shobhi Jain [Wed, 7 Feb 2018 11:08:05 +0000 (11:08 +0000)]
Replace neutron subnet creation with shade.
Function 'create_neutron_subnet' now uses shade client
instead of neutron client.
JIRA: YARDSTICK-890
Change-Id: I8eb5295cecd73742bfb5a7d0764af6f45ef0685e
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
Shobhi Jain [Mon, 5 Feb 2018 15:18:43 +0000 (15:18 +0000)]
Replace neutron network creation with shade.
Function create_neutron_net now uses shade client instead of neutron
client.
JIRA: YARDSTICK-890
Change-Id: I456078e98550901c1f736640c9f9bd0d5f9c3df6
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
John O Loughlin [Fri, 16 Feb 2018 09:24:49 +0000 (09:24 +0000)]
Add support for VNC to VMs created by ansible
JIRA: YARDSTICK-1017
Change-Id: I76ca53c12a6791ecbf7f546f9074b16c5f6d215a
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
Rodolfo Alonso Hernandez [Mon, 12 Mar 2018 09:53:40 +0000 (09:53 +0000)]
Merge "assertTrue(mock.called) -> mock.assert_called"
Ross Brattain [Mon, 12 Mar 2018 09:06:04 +0000 (09:06 +0000)]
Merge "Update the fuel pod.yaml"
Ross Brattain [Mon, 12 Mar 2018 09:05:24 +0000 (09:05 +0000)]
Merge changes from topic 'YARDSTICK-1040'
* changes:
Fetch Nova instance's private IP
Assign nova instance to security group
chenjiankun [Mon, 12 Mar 2018 02:27:26 +0000 (02:27 +0000)]
Get SUT information
JIRA: YARDSTICK-1063
We have the demand to get SUT information.
In this patch, we use ansible to get the SUT information.
Change-Id: I983675d6d367fa528f00c1b50bc6fa2a9cee03f7
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
DanielMartinBuckley [Wed, 7 Mar 2018 18:09:12 +0000 (18:09 +0000)]
Do NOT hardcode interface speed for PROX tests
JIRA: YARDSTICK-1035
Do not hardcode NIC/interface speed in PROX test. Test assumes
NIC used is 10Gbps. This is incorrect. It could support 1Gbps,
10Gbps, 25Gbps, 40Gbps or something else.
This is used to calculate pps (Packets Per Second)
In Baremetal the NIC speed could be extracted. however when
run on a virtual machine this is not possible.
Solution:
Add in options section of test file.
eg.
Options:
interface_speed_gbps: 10
Where 10 refers to a 10Gbps. In a setup where multiple interfaces
are used. This will refer to the speed of the slowest connection.
Change-Id: I89ab16479a2cdd1d79e52cbcc5a972762c60d057
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
Rodolfo Alonso Hernandez [Fri, 9 Mar 2018 13:41:57 +0000 (13:41 +0000)]
Add context name to Dummy test
Since I1447fb5ed447691eaeb0a97f928c0b3333799d07, the context name is
a mandatory parameter for every context.
JIRA: YARDSTICK-886
Change-Id: I0ccb7e9fabdf6bc2890d2e4763f53baee06c87b2
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Dimitrios Markou [Sat, 3 Mar 2018 01:26:41 +0000 (03:26 +0200)]
[Bug Fix] Support nova create instance operation
Add the ability to create a nova instance through the
operation perspective
JIRA: YARDSTICK-1038
Change-Id: Idac141958d65cc6c53b6bd27df83ac74ae8804ec
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
Rodolfo Alonso Hernandez [Thu, 8 Mar 2018 16:42:59 +0000 (16:42 +0000)]
Reduce the log level if TRex client is no connected
If the TRex client is no connected, the testcase will write an exception
log that will be thrown to the CLI. There is no need to show the
traceback in the CLI in this case.
The log level is reduced to "error".
JIRA: YARDSTICK-1059
Change-Id: I22a52cedd6479f4cf692ba16a8415f7b8f574ab1
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Emma Foley [Thu, 8 Mar 2018 16:10:49 +0000 (16:10 +0000)]
Merge "Fix numbering and html (generated) alignment"
Rodolfo Alonso Hernandez [Thu, 8 Mar 2018 12:34:33 +0000 (12:34 +0000)]
Merge "[bugfix] report generate command print error"
Dimitrios Markou [Thu, 1 Mar 2018 12:17:50 +0000 (14:17 +0200)]
Fetch Nova instance's private IP
Add the capability to fetch the private IP of a Nova
instance through the operation perspective.
JIRA: YARDSTICK-1040
Change-Id: Idc3d62bcd3f477a03a89f7dcc8d8616f3cfa2742
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
Dimitrios Markou [Sat, 3 Mar 2018 01:38:31 +0000 (03:38 +0200)]
Assign nova instance to security group
Support the assigning of a nova instance to an
existing security group through the operation
perspective
Change-Id: Ic1c26031c25d400fede2ecb298a66aec42dcfbc5
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
rexlee8776 [Thu, 8 Mar 2018 11:01:37 +0000 (11:01 +0000)]
[bugfix] report generate command print error
JIRA: YARDSTICK-1056
Change-Id: I32ab9ae7482f6b81e00d6d3e7e858d980a2dd95f
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Rodolfo Alonso Hernandez [Thu, 8 Mar 2018 09:54:35 +0000 (09:54 +0000)]
Merge "Allow VMs to access internet"
Dimitrios Markou [Mon, 5 Mar 2018 14:52:12 +0000 (16:52 +0200)]
Update the fuel pod.yaml
Fuel except Controller and Compute nodes
it deploys an ODL node in noHA and HA deployment
and also a Gateway node in a noHA deployment.
So it is essential to describe them in Fuel's pod.
JIRA: YARDSTICK-1050
Change-Id: Iee6c25c5b2e2e4e661ceb0591bf2437f7f7fa7f8
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
Dino Madarang [Wed, 7 Mar 2018 05:47:55 +0000 (21:47 -0800)]
Fix numbering and html (generated) alignment
Fix numbering from 3,5,6 to 3,4,5 and alignment
of the numbered list in HTML output.
Trim lines to 79 chars or less.
Change-Id: Icf233ef6bbf99ac0dcd8a9fc2599aee9dc1a46fd
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Reviewed-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Reviewed-by: Emma Foley <emma.l.foley@intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Wed, 7 Mar 2018 19:05:14 +0000 (19:05 +0000)]
Merge "NFVi Test stops after one hour even if configured context duration is longer"
Ross Brattain [Wed, 7 Mar 2018 16:09:03 +0000 (08:09 -0800)]
bugfix: fix prepare_env.sh shell quote
JIRA: YARDSTICK-1051
Change-Id: If28bc0f2fe2e3cdec95882bb2abedf839e6ac2e0
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
DanielMartinBuckley [Wed, 28 Feb 2018 11:55:44 +0000 (11:55 +0000)]
NFVi Test stops after one hour even if configured context duration is longer
JIRA: YARDSTICK-1021
If the Test is to take longer than the Default Duration timer use
defined test time.
If not use Default Duration time
Change-Id: Idacc188e199ff031310b9826238b63ed3f2ea409
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
Emma Foley [Wed, 7 Mar 2018 10:51:53 +0000 (10:51 +0000)]
Merge "ansible: fix urlsplit('hostname') in convert_openrc"
Jack Chan [Wed, 7 Mar 2018 01:55:05 +0000 (01:55 +0000)]
Merge "Add l2fwd module in Tgen mode"
Jack Chan [Wed, 7 Mar 2018 01:54:20 +0000 (01:54 +0000)]
Merge "Add test case sample to enable mixed network"
Ross Brattain [Wed, 7 Mar 2018 01:52:55 +0000 (01:52 +0000)]
Merge "add opnfv_k8-nosdn-lb_ceph-noha_daily.yaml"
Rex Lee [Wed, 7 Mar 2018 01:14:36 +0000 (01:14 +0000)]
Merge "[bugfix]tc006 failed due to volume attached to different location "/dev/vdc""
Ross Brattain [Tue, 6 Mar 2018 23:28:57 +0000 (23:28 +0000)]
Merge "Add start service operation"
Ross Brattain [Tue, 6 Mar 2018 18:32:00 +0000 (10:32 -0800)]
add opnfv_k8-nosdn-lb_ceph-noha_daily.yaml
https://build.opnfv.org/ci/job/yardstick-joid-baremetal-daily-master/2206/console
Change-Id: Ib5fc186caa285ef8f6a879fd1fd2f786b07a257a
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Emma Foley [Tue, 6 Mar 2018 17:21:43 +0000 (17:21 +0000)]
Merge "Move SSH key generation from "init" to "deploy""
Rodolfo Alonso Hernandez [Tue, 6 Mar 2018 09:32:15 +0000 (09:32 +0000)]
Move SSH key generation from "init" to "deploy"
In [1], the Context SSH key generation was modified; the SSH now has a
name matching the name context (which depends on the given name and
the task ID).
In a test suite, the task ID is the same for all test cases executed
in the same batch. If the context name of different test cases is the
same (there is no impediment, e.g.: "demo", "yardstick"), the SSH key
filename will be the same.
Currently the SSH key generation is done during the initialization
process, at the begining of the test suite executing. If, by
coincidence, two test cases have the same context name, the first
one will remove the SSH key file during the "undeploy" process; then
the second one will rise an exception because the SSH key file is
deleted.
This patch moves the SSH key file generation from the initialization
process to the context deploy process:
TEST SUITE:
- init: parse all test cases
- test case 1:
- deploy (generate SSH keys)
- run
- undeploy (delete SSH keys)
- test case 2: ...
[1] Id175061d6cfe23a068bb3d12ce176c1f176e8236
JIRA: YARDSTICK-1045
Change-Id: I05dc46db20d2a0cba3092c415ce9b248513406fb
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Dimitrios Markou [Thu, 1 Mar 2018 12:04:43 +0000 (14:04 +0200)]
Add start service operation
Support the capability to start a service through the operation
perspective.
JIRA: YARDSTICK-1041
Change-Id: If817f4a522546de2e4a826c1e85b3545e6f3efed
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
John O Loughlin [Thu, 15 Feb 2018 18:24:52 +0000 (18:24 +0000)]
Allow VMs to access internet
Add option to the config file for default network.
Check to see if 1 default network is defined.
Enable nat on all defined networks.
Add default gateway to VM
JIRA: YARDSTICK-1016
Change-Id: Ie943a7c7b4f1a9673774cf8fedaba0af352cd7f4
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
Jack Chan [Tue, 6 Mar 2018 01:30:13 +0000 (01:30 +0000)]
Merge "Enable heat context to support existing network"
Ross Brattain [Mon, 5 Mar 2018 20:52:46 +0000 (20:52 +0000)]
Merge "Bug fix ansible scripts"
Ross Brattain [Mon, 5 Mar 2018 20:52:26 +0000 (20:52 +0000)]
Merge "Error in string format in HeatTemplateError message"
Rodolfo Alonso Hernandez [Mon, 5 Mar 2018 17:49:53 +0000 (17:49 +0000)]
Error in string format in HeatTemplateError message
There is a missing "s" in HeatTemplateError message [1].
[1]https://github.com/opnfv/yardstick/blob/
8400c1895c49cb0c7802692f75d820fb5b8b7dc4/yardstick/common/exceptions.py#L70
JIRA: YARDSTICK-1047
Change-Id: Ieb6fbf0af35d624015dbf34f34de7c7cc9145dd5
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Ross Brattain [Mon, 5 Mar 2018 17:49:32 +0000 (17:49 +0000)]
Merge "Fix report generation"
Emma Foley [Mon, 5 Mar 2018 17:41:33 +0000 (17:41 +0000)]
assertTrue(mock.called) -> mock.assert_called
When checking whether a mocked method has been called,
mock.assert_called or mock.assert_called_once should be
used, and not unittest.assertTrue(mock.called)
This change does this update.
It can be verified with:
grep -irn "self.assertTrue(.*called)" --exclude-dir=.tox
And the replacement was done with:
sed -i 's/self.assertTrue(\(.*\).called)/\1.assert_called_once()/g' <list_of_files>
Change-Id: I4f26e0c736bf33e0b2413c8e8c33dbdb91f090e2
JIRA: YARDSTICK-865
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
John O Loughlin [Fri, 16 Feb 2018 11:38:18 +0000 (11:38 +0000)]
Bug fix ansible scripts
For 'qemu-img version 2.10.1' unit 'MB' is not acceptable
Changing to 'M'
JIRA: YARDSTICK-1019
Change-Id: Ic9153e9e9c85d949d15b1d15cc8cddfad986b4a3
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
Xavier Simonart [Thu, 22 Feb 2018 15:19:38 +0000 (16:19 +0100)]
Fix report generation
The command "yardstick report generate task_id yaml_name" was returning
some errors and failing to generate a html report.
With this fix an html report will be generated with all data from influx.
JIRA: YARDSTICK-1023
Change-Id: If9aab4b85cfb2b5809f608568e1adb2ddeec8b78
Signed-off-by: Xavier Simonart <xavier.simonart@intel.com>
Ross Brattain [Mon, 5 Mar 2018 08:06:43 +0000 (08:06 +0000)]
Merge "prepare_env.sh: fix some shellcheck warnings"
Ross Brattain [Thu, 1 Mar 2018 15:58:55 +0000 (07:58 -0800)]
prepare_env.sh: fix some shellcheck warnings
prepare_env.sh:13:3: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:14:3: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:15:3: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:16:3: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:17:3: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:18:3: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:22:8: warning: Declare and assign separately to avoid masking return values. [SC2155]
prepare_env.sh:28:1: warning: INSTALLERS appears unused. Verify it or export it. [SC2034]
prepare_env.sh:36:5: warning: Can't follow non-constant source. Use a directive to specify location. [SC1090]
prepare_env.sh:42:1: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:46:5: warning: Can't follow non-constant source. Use a directive to specify location. [SC1090]
prepare_env.sh:46:12: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:53:5: warning: i appears unused. Verify it or export it. [SC2034]
prepare_env.sh:54:27: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:68:25: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:73:19: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:73:49: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:76:27: note: Useless cat. Consider 'cmd < file | ..' or 'cmd file | ..' instead. [SC2002]
prepare_env.sh:77:24: note: Useless cat. Consider 'cmd < file | ..' or 'cmd file | ..' instead. [SC2002]
prepare_env.sh:80:46: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:83:46: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:86:46: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:89:43: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:92:43: note: Double quote to prevent globbing and word splitting. [SC2086]
prepare_env.sh:96:71: note: Double quote to prevent globbing and word splitting. [SC2086]
Change-Id: I96a1f591b825d21e3ba202f1d681449347d940a6
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Thu, 1 Mar 2018 02:17:04 +0000 (18:17 -0800)]
heat: replace neutronclient with shade
neutronclient is deprecated and also has bunches of issues with SSL and
such.
JIRA: YARDSTICK-890
JIRA: YARDSTICK-1032
Change-Id: I41c9aac0ea69e1307560a001f7dc34178fcd7e71
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Fri, 2 Mar 2018 21:44:13 +0000 (21:44 +0000)]
Merge "VNF interfaces are sorted by "vpci" address before being populated"
Ross Brattain [Fri, 2 Mar 2018 19:29:11 +0000 (19:29 +0000)]
Merge "Prohibit the importation of a list of libraries"
Ross Brattain [Fri, 2 Mar 2018 19:27:20 +0000 (19:27 +0000)]
Merge "Layout fixes to test case descriptions"
Ross Brattain [Fri, 2 Mar 2018 19:26:45 +0000 (19:26 +0000)]
Merge "Remove main() and __main__ from tests."
Emma Foley [Mon, 19 Feb 2018 16:06:50 +0000 (16:06 +0000)]
Add yardstick.benchmark.contexts.heat.HeatContext._delete_key_file()
* Move logic for removing key file into its own method
* Update the log message to be more useful
JIRA: YARDSTICK-1026
Change-Id: I8c131720ed91c939698c41ad63d586396fcce1fe
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Rodolfo Alonso Hernandez [Fri, 2 Mar 2018 17:44:03 +0000 (17:44 +0000)]
VNF interfaces are sorted by "vpci" address before being populated
In [1], VNF interfaces in TG PROX are sorted by "vpci" address, before
this value is populated in "vnfd_helper". "vpci_if_name_ascending" is
only used in TP ProxPofile [2] to generate the stats.
This patch delays this sorting process until the stats generation.
[1]https://github.com/opnfv/yardstick/blob/
a74ad5a1ec1a73389c5983440b2031b0bc72cea1/yardstick/network_services/vnf_generic/vnf/tg_prox.py#L62-L64
[2]https://github.com/opnfv/yardstick/blob/
a74ad5a1ec1a73389c5983440b2031b0bc72cea1/yardstick/network_services/traffic_profile/prox_profile.py#L33
JIRA: YARDSTICK-1044
Change-Id: I988dc48f9a82baa1c64f728d9e6d54f2f4bae010
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Emma Foley [Thu, 23 Nov 2017 00:00:47 +0000 (00:00 +0000)]
Remove main() and __main__ from tests.
Removes the unnecessary main() functions from tests.
Also removes shebang (#!) where it appears at the top of files.
JIRA: YARDSTICK-861
Change-Id: I79180d1eb9c5bce640142dd62ce28c7437c1b210
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Abhijit Sinha [Fri, 2 Mar 2018 15:39:36 +0000 (15:39 +0000)]
Merge "Replace assertEqual(None, xx) with assertIsNone(xx)"
Abhijit Sinha [Fri, 2 Mar 2018 15:35:28 +0000 (15:35 +0000)]
Merge "Make files pep8 compliant before replacing assertEqual(None, xx)"
Emma Foley [Fri, 2 Mar 2018 14:06:26 +0000 (14:06 +0000)]
Merge "remove releng from Dockerfile and elsewhere"
Mika Rautakumpu [Fri, 2 Mar 2018 13:11:43 +0000 (15:11 +0200)]
Layout fixes to test case descriptions
Change-Id: I9658b023e4f3db7e22d67c71dfbba61511d981c6
Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
Emma Foley [Thu, 25 Jan 2018 23:10:31 +0000 (23:10 +0000)]
Replace assertEqual(None, xx) with assertIsNone(xx)
Change-Id: Ie956d8064a8fbcbd3d56c5a79c4c613d35184af4
JIRA: YARDSTICK-942
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Emma Foley [Tue, 20 Feb 2018 15:38:34 +0000 (15:38 +0000)]
Make files pep8 compliant before replacing assertEqual(None, xx)
* tests/unit/network_services/helpers/test_samplevnf_helper.py
* tests/unit/network_services/traffic_profile/test_rfc2544.py
* yardstick/tests/unit/common/test_ansible_common.py
JIRA: YARDSTICK-942
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: Ib3c71db5f5774d2bfb3a9cbd260b838eb5501448
Rodolfo Alonso Hernandez [Fri, 2 Mar 2018 09:42:34 +0000 (09:42 +0000)]
Merge "Add "render-only" option to "task" command"
Ross Brattain [Thu, 1 Mar 2018 21:17:05 +0000 (21:17 +0000)]
Merge "Add ability to reuse existing OpenStack set-up"
Rodolfo Alonso Hernandez [Sun, 18 Feb 2018 16:11:02 +0000 (16:11 +0000)]
Add "render-only" option to "task" command
This new option provides to the user the ability to output the rendered
input files. This option could be useful in case the input files are
Jinja2 templates, depending on input arguments. The user can preview
the rendered input tasks files without executing them.
JIRA: YARDSTICK-1020
Change-Id: Ib15ade7e1adcb29beae5e635fb5d02045c4432bb
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Emma Foley [Mon, 19 Feb 2018 23:15:11 +0000 (23:15 +0000)]
Add ability to reuse existing OpenStack set-up
This change adds two optional flags to the context configuration for heat:
* no_setup -- to re-use an existing OpenStack deployment
* no_teardown -- to skip undeploying the context, so it is available in other testcases
In order to achieve this, resource naming had to be made more predictable.
When no_setup or no_teardown are set:
* Do not add a suffix to context name
* When searching, try with and without a suffix to find a server by name
All behaviors remain the same unless these values are set.
NOTE:
This feature doesn't work with the NSPerf scenario, because the
interfaces in the VNFs are bound to DPDK after the first test, so the
look-up for missing topology information fails in subsequent test
runs, as the interfaces are not visable to the kernel.
This can be addressed either by either unbinding the interfaces from
DPDK at the end of each test, or modifying the look-up for the missing
topology information to query DPDK as well.
The change will be made in a future patch.
JIRA: YARDSTICK-886
Change-Id: I6df5e86e419c283a2bee41917e4f62179aa9c31a
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Ross Brattain [Wed, 4 Oct 2017 20:38:43 +0000 (13:38 -0700)]
NSB: move interface probe to VNF, and attempt driver-only probe first
If no devices are present we can't detect MAC address so
we can't match Heat ports to interfaces.
If only the driver is missing we can try to probe the driver using
lspci. We can use lspci to ask the kernel what driver it should use
for the PCI device.
If we can't probe at all because the device is already bound, we can
use dpkd-devind to find all the PCI address we care about and create a
map with PCI device and real kernel driver.
Then we can dpdk force rebind to the kernel driver.
Once we have rebound to the kernel driver we can detect
MAC address and all the other attributes that are required.
Fix VnfSshHelper to allow override of wait timeout
And a bunch of other refactors that got swept up in this
JIRA: YARDSTICK-835
Change-Id: I14cb657ed289a77941d048345d06ced5b5d5da52
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Thu, 1 Mar 2018 16:17:51 +0000 (16:17 +0000)]
Merge "Add methods to get an existing stack"
Ross Brattain [Thu, 1 Mar 2018 16:16:12 +0000 (16:16 +0000)]
Merge "Use context name instead of key_uuid"
Ross Brattain [Thu, 1 Mar 2018 16:15:11 +0000 (16:15 +0000)]
Merge changes from topics 'feat/keep_vnf', 'YARDSTICK-886'
* changes:
Add _create_new_stack method
Update TaskParser to deal with qualified name in Context
Add qualified name to Context
Ross Brattain [Wed, 28 Feb 2018 15:38:05 +0000 (07:38 -0800)]
remove releng from Dockerfile and elsewhere
Current CI does openrc fetching before starting
the Docker container and then passes openrc
via Docker mount
JIRA: YARDSTICK-691
Change-Id: Id0649130f48db5a5586149b237c5252b953e57be
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Thu, 1 Mar 2018 15:11:31 +0000 (15:11 +0000)]
Merge "vFW scale-up template."
Ross Brattain [Thu, 1 Mar 2018 15:11:20 +0000 (15:11 +0000)]
Merge "Add arguments to the traffic profile render"
Ross Brattain [Thu, 1 Mar 2018 15:11:03 +0000 (15:11 +0000)]
Merge "Import "traffic_profile" modules only once"
Emma Foley [Mon, 19 Feb 2018 23:15:11 +0000 (23:15 +0000)]
Add methods to get an existing stack
* Add yardstick/orchestrator/heat.py:HeatStack.get
* Add yardstick/benchmark/contexts/heay.py:HeatContext.retrieve_existing_stack
JIRA: YARDSTICK-886
Change-Id: I6974b79a25f98066a49b1bc8ccd11383e7962091
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Emma Foley [Fri, 16 Feb 2018 15:22:12 +0000 (15:22 +0000)]
Use context name instead of key_uuid
context.key_uuid is only used as a suffix for the key files.
There is already a unique ID associated with a the context;
the context name includes a task ID, which is a UUID.
This patch sets context.key_uuid to to context.name instead of
generating a separate UUID
As a result, get_short_key_uuid() is not needed.
JIRA: YARDSTICK-1028
Change-Id: Id175061d6cfe23a068bb3d12ce176c1f176e8236
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Emma Foley [Wed, 21 Feb 2018 12:36:15 +0000 (12:36 +0000)]
Add _create_new_stack method
The logic for creating a new stack in contexts/heat.py:HeatContext
can added to a method to make the code eassier to read and test.
This is in preparation for an update to deploy() that would allow
an existing stack to be reused, or a new stack created.
By having the create_new_stack logic in a new method, deploy()
becomes easier to read and test.
JIRA: YARDSTICK-886
Change-Id: I7af01e2209a3460658f8db0249b7c620743cced0
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Emma Foley [Thu, 22 Feb 2018 19:11:12 +0000 (19:11 +0000)]
Update TaskParser to deal with qualified name in Context
The context name depends on the defined name in the testcase input
file, the task ID and the flags of the context.
If the context is going to be undeployed at the end of the test, the
task ID is suffixed to the name to avoid interferences with previous
deployments. If the context needs to be deployed at the end of the
test, the name assigned is kept.
This patch makes this process transparent to the developer.
This patch modifies how TaskParser determines the correct context name,
taking into account that the name might change based on context flags.
JIRA: YARDSTICK-886
Change-Id: I44da30dac562c1a4166e084645ae91c17798651d
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Mytnyk, Volodymyr [Sat, 10 Feb 2018 18:30:06 +0000 (20:30 +0200)]
vFW scale-up template.
Added topology and traffic profile templates
Added support for using JinJa2 templates in topology definition
Added support for static pipeline configs for SampleVNFs
JIRA: YARDSTICK-1043
Change-Id: Iab99fd5b5ad69ca32ee70b9fe47779387ad27e7f
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
Rodolfo Alonso Hernandez [Thu, 1 Mar 2018 13:23:54 +0000 (13:23 +0000)]
Merge "Module to manage pip packages"
Emma Foley [Mon, 26 Feb 2018 11:43:51 +0000 (11:43 +0000)]
Add qualified name to Context
The context name depends on the defined name in the testcase input
file, the task ID and the flags of the context.
If the context is going to be undeployed at the end of the test, the
task ID is suffixed to the name to avoid interferences with previous
deployments. If the context needs to be deployed at the end of the
test, the name assigned is kept.
This patch makes base.Context use Flags when initialising contexts,
this sets the name property based on the no_setup and no_teardown
flags.
Since base.Context is an abstract class, it cannot be instantiated.
However, there are some non-abstract methods that need testing.
Since DummyContext does not override any of these methods, it can be used for
testing.
JIRA: YARDSTICK-886
Change-Id: I1447fb5ed447691eaeb0a97f928c0b3333799d07
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Rodolfo Alonso Hernandez [Wed, 17 Jan 2018 18:04:53 +0000 (18:04 +0000)]
Add arguments to the traffic profile render
In order to render configurable traffic profiles in NSB test cases,
a new variable is introduced: "extra_arg". The content of
this variable is added to the VNFD render data, under a key called
"extra_args".
This will allow the user to define Jinja templates for traffic profiles.
E.g.:
$ cat test_case_definition.yml
scenarios:
- type: NSPerf
traffic_profile: traffic_profile.yml
extra_args:
vports: 10
$ cat traffic_profile.yml
{% set vports = get(extra_args, 'vports', '0') or 4 %}
{% for vport in range(vports|int) %}
uplink_{{vport}}:
data...
{% endfor %}
JIRA: YARDSTICK-946
Change-Id: Ib3c1f2d89efa012772edf2156e97d5f4742a6b80
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Rodolfo Alonso Hernandez [Fri, 19 Jan 2018 15:46:11 +0000 (15:46 +0000)]
Import "traffic_profile" modules only once
"traffic_profile" modules should be imported only once. Every time
TrafficProfile.get is called, the modules under
"yardstick.network_services.traffic_profiles" are loaded [1]. Instead
of this, the modules should be registered only once the first time
"yardstick.network_services.traffic_profiles.base" is loaded. This
will reduce the execution time and will avoid unnecessary calls.
[1] https://github.com/opnfv/yardstick/blob/
d2c7cc4e9768ed003257a95c92cdb278d516761b/yardstick/network_services/traffic_profile/base.py#L36-L37
JIRA: YARDSTICK-951
Change-Id: Ia3565378ba3a1377fcb0aea8bda50ef8189414fd
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Ross Brattain [Thu, 1 Mar 2018 02:30:48 +0000 (18:30 -0800)]
scenario: add opnfv_os-odl-bgpvpn-noha_daily.yaml
adding missing scenario for Apex.
https://gerrit.opnfv.org/gerrit/#/c/50045/
JIRA: YARDSTICK-998
Change-Id: I211f567587a4864b403ce321fea007a3c0963136
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
rexlee8776 [Sat, 27 Jan 2018 06:15:51 +0000 (06:15 +0000)]
Bugfix: yardstick env grafana fails when access the server
current timeout is 10 seconds, it would fail if grafana
server start slow in some cases.
JIRA: YARDSTICK-972
Change-Id: I783206fdd1352e94ba7e498283f70b5a6834b6fa
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Jack Chan [Thu, 1 Mar 2018 02:20:38 +0000 (02:20 +0000)]
Merge "fix pep8 problem in env.py"
Ross Brattain [Tue, 13 Feb 2018 01:34:40 +0000 (17:34 -0800)]
NSB: Rename traffic_profile to trex_traffic_profile
Make it more clear that traffic_profile is not a generic class.
Eventually we can refactor a more generic traffic profile.
Change-Id: I1bf44a8cafcdeb8d74efb9e85a34f6d7b526d036
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Emma Foley [Wed, 28 Feb 2018 18:01:24 +0000 (18:01 +0000)]
Merge "Add Flags class to base.Context"
Abhijit Sinha [Wed, 28 Feb 2018 17:49:00 +0000 (17:49 +0000)]
Merge "Mock TRex STL libraries globally"
Ross Brattain [Wed, 28 Feb 2018 15:39:43 +0000 (07:39 -0800)]
ansible: fix urlsplit('hostname') in convert_openrc
can't use urlsplit|attr('hostname') since urlsplit is a dict
should instead use urlsplit('hostname')
Change-Id: I272cac785c2336891b43b81ecf10370af8be228b
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Ross Brattain [Wed, 28 Feb 2018 15:52:57 +0000 (15:52 +0000)]
Merge "Deprecate authentication variable OS_TENANT_NAME"
Rodolfo Alonso Hernandez [Tue, 13 Feb 2018 17:17:22 +0000 (17:17 +0000)]
Mock TRex STL libraries globally
TRex Python libraries are not going to be available during
unit testing execution. Those modules calling TRex libraries
should be mocked individually. This patch will remove the need
of mocking those libraries per module.
JIRA: YARDSTICK-1010
Change-Id: I4aa11d43ecf32a3dad78f869541b4afea4ec1d28
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Abhijit Sinha [Wed, 28 Feb 2018 13:22:40 +0000 (13:22 +0000)]
Merge "Improve SampleVNF hugepages setup"
Abhijit Sinha [Wed, 28 Feb 2018 13:05:45 +0000 (13:05 +0000)]
Merge "Addition of storage of extra counters for Grafana"
DanielMartinBuckley [Fri, 16 Feb 2018 15:39:41 +0000 (15:39 +0000)]
Addition of storage of extra counters for Grafana
JIRA: YARDSTICK-1036
This stores a number of extra counters in influxdb for Prox test cases.
It also stores existing counters with a "succcess_" tag.
Previously throughput where stored without success or failure indication.
Also "Result_" counters are also stored.
These can now be used by Grafana to graph output.
Change-Id: Ie5636c14ecbab1b53a988bdfbd47ddd1fcdbd695
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
Rodolfo Alonso Hernandez [Tue, 19 Dec 2017 09:08:05 +0000 (09:08 +0000)]
Deprecate authentication variable OS_TENANT_NAME
OS_TENANT_NAME was deprecated as authentication variable in Keystone
when moved from v2 to v3, in Icehouse (2014). Because this project doesn't
support oldest versions, by default the only identification API version
supported is v3.
JIRA: YARDSTICK-902
Change-Id: I273fb0151ba583f7c8a5a809e5e8864e92c27d31
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>