yardstick.git
7 years agoAdd API(v2) to get all test case info 21/37821/1
chenjiankun [Thu, 20 Jul 2017 03:36:38 +0000 (03:36 +0000)]
Add API(v2) to get all test case info

JIRA: YARDSTICK-743

API: /api/v2/yardstick/testcases
METHOD: GET

Change-Id: Iced97206cb4c5f68ee8a5729af937e8d45ca6e87
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoAdd API(v2) to upload test case 19/37819/1
chenjiankun [Thu, 20 Jul 2017 03:30:58 +0000 (03:30 +0000)]
Add API(v2) to upload test case

JIRA: YARDSTICK-742

API: /api/v2/yardstick/testcases/action
METHOD: POST
PARAMS:
{
   'action': 'upload_case',
    'args': {
        'file': file
    }
}

Change-Id: Id305e72a24ec28295ac4bae5e5b9ad83eb2c1e34
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoMerge "Add API(v2) to delete container"
Jing Lu [Wed, 19 Jul 2017 08:18:22 +0000 (08:18 +0000)]
Merge "Add API(v2) to delete container"

7 years agoMerge "Add API(v2) to get container info"
Jing Lu [Wed, 19 Jul 2017 08:18:06 +0000 (08:18 +0000)]
Merge "Add API(v2) to get container info"

7 years agoMerge "Add API(v2) to create grafana"
Jing Lu [Wed, 19 Jul 2017 08:17:49 +0000 (08:17 +0000)]
Merge "Add API(v2) to create grafana"

7 years agoMerge "Add API(v2) to create influxdb"
Jing Lu [Wed, 19 Jul 2017 08:17:38 +0000 (08:17 +0000)]
Merge "Add API(v2) to create influxdb"

7 years agoMerge "Add API(v2) to delete pod"
Jing Lu [Wed, 19 Jul 2017 08:17:25 +0000 (08:17 +0000)]
Merge "Add API(v2) to delete pod"

7 years agoMerge "test_base: speedup unittest, wait for queue not empty"
Ross Brattain [Mon, 17 Jul 2017 16:46:04 +0000 (16:46 +0000)]
Merge "test_base: speedup unittest, wait for queue not empty"

7 years agoAdd API(v2) to delete container 05/37605/1
chenjiankun [Mon, 17 Jul 2017 08:15:57 +0000 (08:15 +0000)]
Add API(v2) to delete container

JIRA: YARDSTICK-729

API: /api/v2/yardstick/containers/<container_id>
METHOD: DELETE

Change-Id: I4cda76329edd7b988a357f1fcb2b5041bf48be64
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoAdd API(v2) to get container info 03/37603/1
chenjiankun [Mon, 17 Jul 2017 07:54:46 +0000 (07:54 +0000)]
Add API(v2) to get container info

JIRA: YARDSTICK-728

API: /api/v2/yardstick/containers/<container_id>
METHOD: GET

Change-Id: Iba34e6c6dd84573dc9d5914a584d920678c0de36
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoAdd API(v2) to create grafana 01/37601/1
chenjiankun [Mon, 17 Jul 2017 07:40:09 +0000 (07:40 +0000)]
Add API(v2) to create grafana

JIRA: YARDSTICK-727

API: /api/v2/yardstick/containers/action
METHOD: POST
PARAMS:
{
    'action': 'create_influxdb',
    'args': {
        'environment_id': environment_id
    }
}

Change-Id: I12fc23261ba62df6f923a4d34455ad8b46c4aa8f
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoMerge "attacker_process: fix typo s/envrioment/environment/"
Rex Lee [Mon, 17 Jul 2017 06:18:54 +0000 (06:18 +0000)]
Merge "attacker_process: fix typo s/envrioment/environment/"

7 years agoMerge "test_nstat: speedup unittests, sleep for 0 seconds"
Ross Brattain [Mon, 17 Jul 2017 06:14:57 +0000 (06:14 +0000)]
Merge "test_nstat: speedup unittests, sleep for 0 seconds"

7 years agoAdd API(v2) to create influxdb 85/37585/5
chenjiankun [Mon, 17 Jul 2017 02:10:34 +0000 (02:10 +0000)]
Add API(v2) to create influxdb

JIRA: YARDSTICK-726

API: /api/v2/yardstick/containers/action
METHOD: POST
PARAMS:
{
    'action': 'create_influxdb',
    'args': {
        'environment_id': environment_id
    }
}

Change-Id: I20961fc6ae9918c894de7fabd3f81ca966bd24cd
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoMerge "pktgen: speedup unittest, mock time.sleep"
Ross Brattain [Mon, 17 Jul 2017 04:40:11 +0000 (04:40 +0000)]
Merge "pktgen: speedup unittest, mock time.sleep"

7 years agoMerge "tg: speedup unittests, mock time.sleep"
Ross Brattain [Mon, 17 Jul 2017 04:21:49 +0000 (04:21 +0000)]
Merge "tg: speedup unittests, mock time.sleep"

7 years agoMerge "test_pktgen_dpdk_throughput: speedup unittest, mock time.sleep()"
Ross Brattain [Mon, 17 Jul 2017 04:20:39 +0000 (04:20 +0000)]
Merge "test_pktgen_dpdk_throughput: speedup unittest, mock time.sleep()"

7 years agotest_nstat: speedup unittests, sleep for 0 seconds 63/37463/3
Ross Brattain [Fri, 14 Jul 2017 05:03:35 +0000 (22:03 -0700)]
test_nstat: speedup unittests, sleep for 0 seconds

Change-Id: I3f961e26fb045ea7501dc3a5b630b3ef94fec3ee
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agotest_heat: ipaddress expects unicode inputs 99/37599/2
Ross Brattain [Mon, 17 Jul 2017 03:46:27 +0000 (20:46 -0700)]
test_heat: ipaddress expects unicode inputs

weird error

E           AddressValueError: '10.20.0.0/15' does not appear to be an IPv4 or IPv6 network. Did you pass in a bytes (str in Python 2) instead of a unicode object?

I guess we need to convert the stack.outputs mock to unicode

FAILED
tests/unit/benchmark/contexts/test_heat.py:137 (HeatContextTestCase.test_add_server_port)
self = <tests.unit.benchmark.contexts.test_heat.HeatContextTestCase testMethod=test_add_server_port>

    def test_add_server_port(self):
        network1 = mock.MagicMock()
        network1.vld_id = 'vld111'
        network2 = mock.MagicMock()
        network2.vld_id = 'vld777'
        self.test_context.name = 'foo'
        self.test_context.stack = mock.MagicMock()
        self.test_context.networks = {
            'a': network1,
            'c': network2,
        }
        self.test_context.stack.outputs = {
            'b': '10.20.30.45',
            'b-subnet_id': 1,
            'foo-a-subnet-cidr': '10.20.0.0/15',
            'foo-a-subnet-gateway_ip': '10.20.30.1',
            'b-mac_address': '00:01',
            'b-device_id': 'dev21',
            'b-network_id': 'net789',
            'd': '40.30.20.15',
            'd-subnet_id': 2,
            'foo-c-subnet-cidr': '40.30.0.0/18',
            'foo-c-subnet-gateway_ip': '40.30.20.254',
            'd-mac_address': '00:10',
            'd-device_id': 'dev43',
            'd-network_id': 'net987',
        }
        server = mock.MagicMock()
        server.ports = OrderedDict([
            ('a', {'stack_name': 'b'}),
            ('c', {'stack_name': 'd'}),
        ])

        expected = {
            "private_ip": '10.20.30.45',
            "subnet_id": 1,
            "subnet_cidr": '10.20.0.0/15',
            "network": '10.20.0.0',
            "netmask": '255.254.0.0',
            "gateway_ip": '10.20.30.1',
            "mac_address": '00:01',
            "device_id": 'dev21',
            "network_id": 'net789',
            "network_name": 'a',
            "local_mac": '00:01',
            "local_ip": '10.20.30.45',
            "vld_id": 'vld111',
        }
>       self.test_context.add_server_port(server)

tests/unit/benchmark/contexts/test_heat.py:186:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
yardstick/benchmark/contexts/heat.py:307: in add_server_port
    network_name, port['stack_name'], self.stack.outputs)
yardstick/benchmark/contexts/heat.py:315: in make_interface_dict
    subnet_ip = ipaddress.ip_network(subnet_cidr)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

address = '10.20.0.0/15', strict = True

    def ip_network(address, strict=True):
        """Take an IP string/int and return an object of the correct type.

        Args:
            address: A string or integer, the IP network.  Either IPv4 or
              IPv6 networks may be supplied; integers less than 2**32 will
              be considered to be IPv4 by default.

        Returns:
            An IPv4Network or IPv6Network object.

        Raises:
            ValueError: if the string passed isn't either a v4 or a v6
              address. Or if the network has host bits set.

        """
        try:
            return IPv4Network(address, strict)
        except (AddressValueError, NetmaskValueError):
            pass

        try:
            return IPv6Network(address, strict)
        except (AddressValueError, NetmaskValueError):
            pass

        if isinstance(address, bytes):
            raise AddressValueError(
                '%r does not appear to be an IPv4 or IPv6 network. '
                'Did you pass in a bytes (str in Python 2) instead of'
>               ' a unicode object?' % address)
E           AddressValueError: '10.20.0.0/15' does not appear to be an IPv4 or IPv6 network. Did you pass in a bytes (str in Python 2) instead of a unicode object?

../../yardstick/yardstick_venv/lib/python2.7/site-packages/ipaddress.py:199: AddressValueError

Change-Id: Ie3b087a26a054203573eaa9b13c3e90152bba6a9
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoMerge "test_tg_rfc2544_trex: speedup unittest, set time.sleep(0)"
Ross Brattain [Mon, 17 Jul 2017 03:56:09 +0000 (03:56 +0000)]
Merge "test_tg_rfc2544_trex: speedup unittest, set time.sleep(0)"

7 years agotest_tg_rfc2544_trex: speedup unittest, set time.sleep(0) 31/37331/4
Ross Brattain [Thu, 13 Jul 2017 04:05:22 +0000 (21:05 -0700)]
test_tg_rfc2544_trex: speedup unittest, set time.sleep(0)

Change-Id: I6fdae629bdbd45cba715a838c41613b914a3abcb
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agotest_delete_all_calls_delete: fix delete mock 93/37593/2
Ross Brattain [Mon, 17 Jul 2017 03:31:38 +0000 (20:31 -0700)]
test_delete_all_calls_delete: fix delete mock

we need to mock HeatStack.delete() before
we instantiate otherwise we can't
reach the instantiated objects delete() method

we need to patch the class so we patch all instances

Change-Id: I36f9476dcfb83e2d583c5a9f72dc27fce57258eb
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agotest_heat: don't waste 2 seconds in unittest 95/37595/1
Ross Brattain [Fri, 14 Jul 2017 06:05:45 +0000 (23:05 -0700)]
test_heat: don't waste 2 seconds in unittest

remove duration checks and test with sleep 0

Change-Id: I22516cde56ac3a02358ca9c3e652cead10580d76
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoMerge "Bugfix: kubernetes context do not implement _get_network"
Jing Lu [Mon, 17 Jul 2017 03:15:13 +0000 (03:15 +0000)]
Merge "Bugfix: kubernetes context do not implement _get_network"

7 years agoBugfix: kubernetes context do not implement _get_network 87/37587/2
chenjiankun [Mon, 17 Jul 2017 02:32:47 +0000 (02:32 +0000)]
Bugfix: kubernetes context do not implement _get_network

Since kubernetes context do not implement _get_network,
so when run unit test case, we will get a error:

    TypeError: Can't instantiate abstract class KubernetesContext with
    abstract methods _get_network

Change-Id: Ib56abe7c580ef8a6fc9f52f3fcd566d0fa70e1cc
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoMerge "apexlake: speed unittest, mock time.sleep"
Ross Brattain [Mon, 17 Jul 2017 03:09:35 +0000 (03:09 +0000)]
Merge "apexlake: speed unittest, mock time.sleep"

7 years agoMerge "test_attacker_baremetal: don't run local commands"
Ross Brattain [Mon, 17 Jul 2017 03:08:47 +0000 (03:08 +0000)]
Merge "test_attacker_baremetal: don't run local commands"

7 years agoMerge "Kubernetes (k8s) support"
Jing Lu [Mon, 17 Jul 2017 01:58:00 +0000 (01:58 +0000)]
Merge "Kubernetes (k8s) support"

7 years agoMerge "add network info to topology"
Rex Lee [Mon, 17 Jul 2017 01:15:07 +0000 (01:15 +0000)]
Merge "add network info to topology"

7 years agoKubernetes (k8s) support 37/36537/16
chenjiankun [Tue, 27 Jun 2017 03:20:08 +0000 (03:20 +0000)]
Kubernetes (k8s) support

JIRA: YARDSTICK-682

We decide to support k8s in E release.
We need to discuss with openretriver team and then rewrite the ping
test case under k8s as the first step.

Change-Id: I3f81ebca8de5c1f3a8b7d42581cd7342dc320239
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoadd release date 57/37557/1
Ross Brattain [Sat, 15 Jul 2017 04:59:21 +0000 (21:59 -0700)]
add release date

Change-Id: Icf12b7a59144754f65f67ed54a5c455a64c5042f
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoDanube 3.1 release notes 51/36451/4
Ross Brattain [Sun, 25 Jun 2017 22:36:21 +0000 (15:36 -0700)]
Danube 3.1 release notes

Change-Id: I7032dd2348dd7212484a4a3cbd40e1d7698c8668
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoAdd API(v2) to delete pod 85/37485/1
chenjiankun [Fri, 14 Jul 2017 03:54:06 +0000 (03:54 +0000)]
Add API(v2) to delete pod

JIRA: YARDSTICK-725

API: /api/v2/yardstick/pods/<pod_id>
METHOD: DELETE

Change-Id: Ib9e9f9ced455c4ee3b6e1f63d773ea2e3ee906a6
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoMerge "Initial all url of api v2"
Jing Lu [Fri, 14 Jul 2017 08:38:41 +0000 (08:38 +0000)]
Merge "Initial all url of api v2"

7 years agoattacker_process: fix typo s/envrioment/environment/ 81/37481/1
Ross Brattain [Fri, 14 Jul 2017 08:24:25 +0000 (01:24 -0700)]
attacker_process: fix typo s/envrioment/environment/

Change-Id: I1e5db657eb88c73b5d9223c47e2d97dc79eec1f1
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoMerge "test_monitor_command: mock LOG so we don't output error"
Ross Brattain [Fri, 14 Jul 2017 08:09:50 +0000 (08:09 +0000)]
Merge "test_monitor_command: mock LOG so we don't output error"

7 years agoInitial all url of api v2 77/37477/1
chenjiankun [Fri, 14 Jul 2017 07:12:03 +0000 (07:12 +0000)]
Initial all url of api v2

JIRA: YARDSTICK-648

Change-Id: I915889a974da9c49188c25fe2443ece481987ecb
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoAdd API(v2) to get pod info 57/37457/2
chenjiankun [Fri, 14 Jul 2017 03:39:06 +0000 (03:39 +0000)]
Add API(v2) to get pod info

JIRA: YARDSTICK-724

API: /api/v2/yardstick/pods/<pod_id>
METHOD: GET

Change-Id: I49608eab1f1625cd4358732da052ce3745e28c24
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agotest_attacker_baremetal: don't run local commands 69/37469/4
Ross Brattain [Fri, 14 Jul 2017 06:03:46 +0000 (23:03 -0700)]
test_attacker_baremetal: don't run local commands

these tests were failing to mock subprocess.check_output
and thus were trying to run sudo commands on the local
system.

This is dangerous.  Add the subprocess mock.

Also mock the LOG object so we don't print
bogus Runtime error tracebacks in the unittest logs
when we test assertRaises()

Change-Id: I01535f9952fbd95ce2f5972b641c51ff836e7e8c
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agotest_monitor_command: mock LOG so we don't output error 71/37471/2
Ross Brattain [Fri, 14 Jul 2017 06:14:07 +0000 (23:14 -0700)]
test_monitor_command: mock LOG so we don't output error

Don't print fake tracebacks to the unittest logs

Change-Id: I8a468b8c6566f02be88a9dd222567c14c66b0956
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoMerge "Add API(v2) to delete openrc"
Rex Lee [Fri, 14 Jul 2017 06:15:25 +0000 (06:15 +0000)]
Merge "Add API(v2) to delete openrc"

7 years agoAdd API(v2) to upload pod file 55/37455/2
chenjiankun [Fri, 14 Jul 2017 03:27:43 +0000 (03:27 +0000)]
Add API(v2) to upload pod file

JIRA: YARDSTICK-723

API: /api/v2/yardstick/pods/action
METHOD: POST
PARAMS:
{
    'action': 'upload_pod_file',
    'args': {
        'file': file,
        'environment_id': environment_id
    }
}

Change-Id: I5eb065d8b46080a94c989ec9b8217dc54900bd06
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoAdd API(v2) to delete openrc 47/37447/2
chenjiankun [Fri, 14 Jul 2017 01:49:52 +0000 (01:49 +0000)]
Add API(v2) to delete openrc

JIRA: YARDSTICK-722

API: /api/v2/yardstick/environments/openrcs/<openrc_id>
METHOD: DELETE

Change-Id: Ia0989fe74681654750af80ddb935bb3e63485f43
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoAdd API(v2) to get openrc info 45/37445/2
chenjiankun [Fri, 14 Jul 2017 01:38:47 +0000 (01:38 +0000)]
Add API(v2) to get openrc info

JIRA: YARDSTICK-721

API: /api/v2/yardstick/environments/openrcs/<openrc_id>
METHOD: GET

Change-Id: I57241381cf50fef0dc4eec3281c01ba106262a5a
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoAdd API(v2) to update openrc 43/37443/2
chenjiankun [Fri, 14 Jul 2017 01:01:19 +0000 (01:01 +0000)]
Add API(v2)  to update openrc

JIRA: YARDSTICK-720

API: /api/v2/yardstick/environments/openrcs/action
METHOD: POST
PARAMS:
{
    'action': 'update_openrc',
        'args': {
            'openrc': {
                "EXTERNAL_NETWORK": "ext-net",
                "OS_AUTH_URL": "http://192.168.23.51:5000/v3",
                "OS_IDENTITY_API_VERSION": "3",
                "OS_IMAGE_API_VERSION": "2",
                "OS_PASSWORD": "console",
                "OS_PROJECT_DOMAIN_NAME": "default",
                "OS_PROJECT_NAME": "admin",
                "OS_TENANT_NAME": "admin",
                "OS_USERNAME": "admin",
                "OS_USER_DOMAIN_NAME": "default"
            },
            'environment_id': environment_id
        }
}

Change-Id: Ie9a1614190a01456fd0896f0bdfd05f9d0724fc6
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoAdd API(v2) to upload openrc 55/37355/3
chenjiankun [Thu, 13 Jul 2017 09:39:20 +0000 (09:39 +0000)]
Add API(v2) to upload openrc

JIRA: YARDSTICK-719

API: /api/v2/yardstick/environments/openrcs/action
METHOD: POST
PARAMS:
{
    'action': 'upload_openrc',
    'args': {
        'file': file,
        'environment_id': environment_id
    }
}

Change-Id: If367904a2d0c2d4a192fdc87a8da21ac6549269e
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoMerge "Add API to delete single environment"
Rex Lee [Fri, 14 Jul 2017 04:01:24 +0000 (04:01 +0000)]
Merge "Add API to delete single environment"

7 years agoMerge "Add API to get single environment info"
Rex Lee [Fri, 14 Jul 2017 03:59:18 +0000 (03:59 +0000)]
Merge "Add API to get single environment info"

7 years agoMerge "Add API to get environments"
Rex Lee [Fri, 14 Jul 2017 03:56:16 +0000 (03:56 +0000)]
Merge "Add API to get environments"

7 years agoMerge "test_monitor_multi: speedup unittests, sleep less"
Ross Brattain [Fri, 14 Jul 2017 03:55:31 +0000 (03:55 +0000)]
Merge "test_monitor_multi: speedup unittests, sleep less"

7 years agoMerge "test_storperf: speedup unittest, use time.sleep(0)"
Ross Brattain [Fri, 14 Jul 2017 03:55:27 +0000 (03:55 +0000)]
Merge "test_storperf: speedup unittest, use time.sleep(0)"

7 years agoMerge "Add API to create environment"
Rex Lee [Fri, 14 Jul 2017 03:53:12 +0000 (03:53 +0000)]
Merge "Add API to create environment"

7 years agoadd network info to topology 45/36745/17
Ross Brattain [Mon, 22 May 2017 04:07:50 +0000 (21:07 -0700)]
add network info to topology

we need to know which network each port is connected to
so we can find VLAN or VXLAN ID.

To do this we implement a new method for Contexts,
Context.get_network().  This method is similar to
Context.get_server(), it searches for a given
network name in all the contexts.

From this we generate a context_cfg["networks"]
dict that stores all the network info for the nodes
in the scenario.

Then when we generate the topology for VNFD, we can
lookup a given network by the vld_id and get the
network_type, segmentation_id, etc.

Then if we need to for example generated
traffic on a given VLAN or VXLAN, we have this
info available.

Define default nd_route_tbl for ACL VNF
we need default empty nd_route_tbl for IPv6 route.

Change-Id: I9f9cfbd6acabeb4ae4675ca7354390efa57b29e7
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
7 years agotest_monitor_multi: speedup unittests, sleep less 41/37441/1
Ross Brattain [Thu, 13 Jul 2017 21:38:23 +0000 (14:38 -0700)]
test_monitor_multi: speedup unittests, sleep less

Change-Id: I306e8e5525c3722179a5321988cad76190b93951
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agotest_storperf: speedup unittest, use time.sleep(0) 35/37435/1
Ross Brattain [Thu, 13 Jul 2017 04:04:29 +0000 (21:04 -0700)]
test_storperf: speedup unittest, use time.sleep(0)

Change-Id: I3923d75c1ae7974c7803b0ad6997a5ad0fece11d
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agotest_pktgen_dpdk_throughput: speedup unittest, mock time.sleep() 29/37329/2
Ross Brattain [Thu, 13 Jul 2017 04:05:56 +0000 (21:05 -0700)]
test_pktgen_dpdk_throughput: speedup unittest, mock time.sleep()

Change-Id: I74bbdee1a503ef9bad32db7d4444921f6730f465
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agotest_vpe_vnf: speedup unittest, mock time 27/37327/2
Ross Brattain [Thu, 13 Jul 2017 04:09:55 +0000 (21:09 -0700)]
test_vpe_vnf: speedup unittest, mock time

Change-Id: I046fae81c23555573df7d9e2e80995499062cf38
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoapexlake: speed unittest, mock time.sleep 33/37433/1
Ross Brattain [Thu, 13 Jul 2017 18:20:08 +0000 (11:20 -0700)]
apexlake: speed unittest, mock time.sleep

Change-Id: I40cbcd1963bbb2481282c34b2360c77a5bef109b
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agotg: speedup unittests, mock time.sleep 31/37431/1
Ross Brattain [Thu, 13 Jul 2017 18:20:42 +0000 (11:20 -0700)]
tg: speedup unittests, mock time.sleep

Change-Id: Ia6207c898653c3ba21b22e9c309e7abb25d5cd32
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agopktgen: speedup unittest, mock time.sleep 29/37429/1
Ross Brattain [Thu, 13 Jul 2017 18:21:01 +0000 (11:21 -0700)]
pktgen: speedup unittest, mock time.sleep

Change-Id: I0c6f6b68b30ae72887666a3b9e994dabf7c6a71d
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agotest_base: speedup unittest, wait for queue not empty 27/37427/1
Ross Brattain [Thu, 13 Jul 2017 18:21:27 +0000 (11:21 -0700)]
test_base: speedup unittest, wait for queue not empty

Change-Id: I41a72b1fd7099e404a1cf832de39f15bbc7b46e0
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoAdd API to delete single environment 49/37349/1
chenjiankun [Thu, 13 Jul 2017 08:20:10 +0000 (08:20 +0000)]
Add API to delete single environment

JIRA: YARDSTICK-718

API: /api/v2/yardstick/environments/<environment_id>
METHOD: DELETE

Change-Id: I2e96b0f786440dea46f6b851d3f10f6cc5a0ab40
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoAdd API to get single environment info 43/37343/1
chenjiankun [Thu, 13 Jul 2017 07:24:35 +0000 (07:24 +0000)]
Add API to get single environment info

JIRA: YARDSTICK-717

API: /api/v2/yardstick/environments/<environment_id>
METHOD: GET

Change-Id: I9fe42a48520cc17d0f5416080b3595bd6c269761
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoAdd API to get environments 33/37333/2
chenjiankun [Thu, 13 Jul 2017 06:14:43 +0000 (06:14 +0000)]
Add API to get environments

JIRA: YARDSTICK-716

API: /api/v2/yardstick/environments
METHOD: GET

Change-Id: I46b7fb2b143fe76b6a0edbf1ecc8281187b85918
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoupdate gitignore to exclude *.DS_Store *.log 21/37321/1
rexlee8776 [Thu, 13 Jul 2017 04:02:54 +0000 (12:02 +0800)]
update gitignore to exclude *.DS_Store *.log

Change-Id: Ibd05768eb08336ecfa3f2454ec5548b48944126f
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
7 years agoAdd API to create environment 13/37313/3
chenjiankun [Thu, 13 Jul 2017 02:26:19 +0000 (02:26 +0000)]
Add API to create environment

JIRA: YARDSTICK-715

API: /api/v2/yardstick/environments/action
METHOD: POST
PARAM:
{
    'action': 'create_environment'
}

Change-Id: I58086be3c70cdc3c4c93516bcfd53ba725486600
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoMerge "NSBperf: fix bad sigint handler"
Ross Brattain [Thu, 13 Jul 2017 03:19:54 +0000 (03:19 +0000)]
Merge "NSBperf: fix bad sigint handler"

7 years agoMerge "test_nstat: decrease sleep time for unittest"
Ross Brattain [Thu, 13 Jul 2017 01:20:03 +0000 (01:20 +0000)]
Merge "test_nstat: decrease sleep time for unittest"

7 years agoNSBperf: fix bad sigint handler 03/37303/2
Ross Brattain [Thu, 13 Jul 2017 01:04:03 +0000 (18:04 -0700)]
NSBperf: fix bad sigint handler

This is why we don't do things at module
import time.

when we import this module it makes a bad
sigint handler.  Only load signal handlers
at runtime.

Also fix handler to take *args, **kwargs.

Unittest failures:

>     time.sleep(0.01)
E     TypeError: handler() takes 0 positional arguments but 2 were given

Change-Id: I4296a4bdef0e5f4d58b0503dcbc834f3bef0feeb
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agotest_nstat: decrease sleep time for unittest 01/37301/1
Ross Brattain [Thu, 13 Jul 2017 00:53:17 +0000 (17:53 -0700)]
test_nstat: decrease sleep time for unittest

there is no reason to sleep for a whole
minute during unittest

Change-Id: I206229bcaa7a50af1859f7b04e521955bb6217d4
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoChange endpoint to url in API 55/37255/4
chenjiankun [Wed, 12 Jul 2017 10:45:17 +0000 (10:45 +0000)]
Change endpoint to url in API

There are come conflict with new architecture.
Also it is more proper to use url as endpoint.

Change-Id: Idce331e36d85d0720bbf3255dca29ba6022e18b2
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoconstants: default SERVER_IP to 127.0.0.1 87/33287/7
Ross Brattain [Wed, 12 Apr 2017 04:56:15 +0000 (21:56 -0700)]
constants: default SERVER_IP to 127.0.0.1

When running unittest while connected to P2P VPN,
their is no default route, so we get None.

Instead of using None, default to 127.0.0.1

Not sure why this was renamed to SERVER_IP either,
what do we use this value for?

Still getting py.test unittest failures all the time.

The problem is we lookup influxdb.ip but SERVER_IP is None,
so the lookup fails.

  INFLUXDB_IP = get_param('influxdb.ip', SERVER_IP)

SERVER_IP can't ever be None

Change-Id: Iedb09dc541137f7cdc6ef8d26dd312807985bfa8
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoMerge "Yardstick api database v2 model"
Jing Lu [Wed, 12 Jul 2017 02:54:02 +0000 (02:54 +0000)]
Merge "Yardstick api database v2 model"

7 years agoYardstick api database v2 model 67/37167/2
chenjiankun [Tue, 11 Jul 2017 09:44:48 +0000 (09:44 +0000)]
Yardstick api database v2 model

JIRA: YARDSTICK-713

We have api v2 for gui, and they are all based on the database model.

Change-Id: I51b127588b0b84316acff8acf4a7886339646060
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoMerge "Yardstick API architecture improvement"
Rex Lee [Wed, 12 Jul 2017 01:35:03 +0000 (01:35 +0000)]
Merge "Yardstick API architecture improvement"

7 years agoYardstick API architecture improvement 45/37045/4
chenjiankun [Fri, 7 Jul 2017 03:13:36 +0000 (03:13 +0000)]
Yardstick API architecture improvement

JIRA: YARDSTICK-710

Since we have the plan to upload api v2 and gui.
We need to add put and delete method.
So the architecture need to be improved.

Change-Id: Ie20a79c26ef6c581897ce4e63980fa2895b162d2
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoipaddress: don't use backport on python 3 74/36474/2
Ross Brattain [Mon, 26 Jun 2017 04:39:00 +0000 (21:39 -0700)]
ipaddress: don't use backport on python 3

JIRA: YARDSTICK-645

Change-Id: I7b6d4222d58c29a0f5d1817fa84351c0f09404f7
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoChange storperf target IP 13/37113/1
JingLu5 [Mon, 10 Jul 2017 04:19:08 +0000 (04:19 +0000)]
Change storperf target IP

As compass in master use OpenStack Ansible, the former IP "192.168.200.1" for
Huawei pod-1 has been deprecated.

Change-Id: Ia60885b36abec3455db2aa2939afbe2ef8bd79f5
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoMerge "Yardstick install storperf update"
Jing Lu [Mon, 10 Jul 2017 02:20:39 +0000 (02:20 +0000)]
Merge "Yardstick install storperf update"

7 years agoYardstick install storperf update 43/36943/4
JingLu5 [Wed, 5 Jul 2017 03:49:32 +0000 (03:49 +0000)]
Yardstick install storperf update

JIRA: YARDSTICK-702

Sicnce StorPerf has switched to use docker-compose to start container suite.
The way Yardstick install storperf should also be updated.

Change-Id: Idee05703b8ae5cd03bc214f598f56c8ac05ca755
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoMerge "Improvement: delete stack if create stack failed"
Rex Lee [Thu, 6 Jul 2017 12:21:22 +0000 (12:21 +0000)]
Merge "Improvement: delete stack if create stack failed"

7 years agoMerge "Bugfix: Abnormally stopped background scenario causes test data lost"
Rex Lee [Thu, 6 Jul 2017 12:20:58 +0000 (12:20 +0000)]
Merge "Bugfix: Abnormally stopped background scenario causes test data lost"

7 years agoMerge "move flatten dict key to common utils"
Kubi [Thu, 6 Jul 2017 12:14:34 +0000 (12:14 +0000)]
Merge "move flatten dict key to common utils"

7 years agoImprovement: delete stack if create stack failed 07/37007/4
JingLu5 [Thu, 6 Jul 2017 08:33:17 +0000 (08:33 +0000)]
Improvement: delete stack if create stack failed

JIRA: YARDSTICK-709

If the stack is CREATE_FAILED during the context deployment, the failed
stack should be deleted.

Change-Id: I35b28ffae0f4d1f3ea9809d21add5d718dae5c9d
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoMerge "Add API to update hosts info about SUT"
Jing Lu [Thu, 6 Jul 2017 08:19:36 +0000 (08:19 +0000)]
Merge "Add API to update hosts info about SUT"

7 years agomove flatten dict key to common utils 35/36935/6
rexlee8776 [Wed, 5 Jul 2017 02:50:06 +0000 (02:50 +0000)]
move flatten dict key to common utils

So it can easily be used by other testcase to unify result

JIRA: YARDSTICK-702

Change-Id: Id4fde38a9a0c2a87a6c870bdb7b0c8f3a3b371ac
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
7 years agoAdd API to update hosts info about SUT 57/36557/6
rexlee8776 [Tue, 27 Jun 2017 07:27:03 +0000 (07:27 +0000)]
Add API to update hosts info about SUT

JIRA: YARDSTICK-674

For some SUT which use domain name as endpoint and AUTH_URL, yardstick
restAPI should support to add "ip domain_name" info into /etc/hosts so
that it can use the ip_address to access the SUT.

api: /yardstick/env/action
description: update hosts info for domain name
method: POST

parameters:
{
    "action": "update_hosts",
    "args": {"opnfv.org": "1.1.1.1",
             "openstack.org": "2.2.2.2"
            }
}

Change-Id: Iee1defaf069ebcb0328a37a659024eabac297482
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
7 years agoMerge "Blacklist TC011 from suites with ODL"
Jing Lu [Thu, 6 Jul 2017 03:59:15 +0000 (03:59 +0000)]
Merge "Blacklist TC011 from suites with ODL"

7 years agoMerge "Bugfix: test case constraint not work if "INSTALLER_TYPE" and "NODE_NAME"...
Kubi [Thu, 6 Jul 2017 03:58:40 +0000 (03:58 +0000)]
Merge "Bugfix: test case constraint not work if "INSTALLER_TYPE" and "NODE_NAME" absent"

7 years agoMerge "show actual exceptions in task.py"
Kubi [Thu, 6 Jul 2017 03:58:19 +0000 (03:58 +0000)]
Merge "show actual exceptions in task.py"

7 years agoMerge "unify pod keywork so api can easily used"
Kubi [Wed, 5 Jul 2017 02:59:40 +0000 (02:59 +0000)]
Merge "unify pod keywork so api can easily used"

7 years agoMerge "Use "OS_INSECURE" variable as the insecure mode indicator"
Kubi [Wed, 5 Jul 2017 02:58:30 +0000 (02:58 +0000)]
Merge "Use "OS_INSECURE" variable as the insecure mode indicator"

7 years agoBugfix: test case constraint not work if "INSTALLER_TYPE" and "NODE_NAME" absent 97/36897/3
JingLu5 [Tue, 4 Jul 2017 07:44:52 +0000 (07:44 +0000)]
Bugfix: test case constraint not work if "INSTALLER_TYPE" and "NODE_NAME" absent

Change-Id: Idffc07c28fabda590b58c9501f388099f84f06b2
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agosupport segmentation_id for vlan provider network 61/36861/6
JingLu5 [Mon, 3 Jul 2017 10:34:53 +0000 (10:34 +0000)]
support segmentation_id for vlan provider network

If a network specified in the test case is a vlan provider network, new attribute "segmentation_id" can be used to specify the desired vlan tag in the test case network section:

networks:
  test-net:
    cidr: '192.168.1.0/24'
    provider: "vlan"
    physical_network: 'physnet1'
    segmentation_id: "1000"

If the "segmentation_id" attribute is absent, a random vlan tag will be allocated to the network.

Change-Id: Ic53852447a3c1bd8feb9ebd42d35f1ade3684be1
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoBugfix: Abnormally stopped background scenario causes test data lost 85/36885/2
JingLu5 [Tue, 4 Jul 2017 05:59:52 +0000 (05:59 +0000)]
Bugfix: Abnormally stopped background scenario causes test data lost

Change-Id: I19b8d1c1c6becf4335537d585046cbd59cab5935
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoBugfix: background scenario can't not update result 81/36881/1
chenjiankun [Tue, 4 Jul 2017 03:16:55 +0000 (03:16 +0000)]
Bugfix: background scenario can't not update result

JIRA: YARDSTICK-700

In this patch:
https://gerrit.opnfv.org/gerrit/#/c/35257/
In yardstick/benchmark/core/task.py

We update background result only when it be stopped abnormally.
We need move it out of 'if' statement.

Change-Id: I25b76e160273a87da66098565a16e4a143cec11f
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoYardstick: Aarch64 jenkins slave support 41/34841/17
Alexandru Nemes [Tue, 16 May 2017 12:50:27 +0000 (15:50 +0300)]
Yardstick: Aarch64 jenkins slave support

Change-Id: I2d58c38d75fc1fe036769340e9fb02932f543510
Signed-off-by: Alexandru Nemes <alexandru.nemes@enea.com>
7 years agoBlacklist TC011 from suites with ODL 67/36567/5
Alexandru Nemes [Tue, 27 Jun 2017 11:05:07 +0000 (14:05 +0300)]
Blacklist TC011 from suites with ODL

In deployments with ODL, security groups behave badly because of an
IPv6 rule that causes IPv4 packets to be incorrectly routed.
This is described in:
https://jira.opnfv.org/browse/ARMBAND-61
As a consequence, Yardstick TC011 fails because iperf cannot
create a connection.
The proposed solution is to temporarily comment out TC011
from test suites with ODL.
As mentioned here, security groups support for IPv6 is partial:
artifacts.opnfv.org/ipv6/docs/gapanalysis/gap-analysis-odl-boron.html
On nosdn deployments this issue is not reproducing and the test runs ok.

JIRA: ARMBAND-269

Change-Id: Id5fede27262c21d777ec8e9988941643d16f9417
Signed-off-by: Alexandru Nemes <alexandru.nemes@enea.com>
7 years agoBugfix: amend the CLI to build yardstick-image manually 43/36843/2
JingLu5 [Mon, 3 Jul 2017 04:16:14 +0000 (04:16 +0000)]
Bugfix: amend the CLI to build yardstick-image manually

Change-Id: I8fbf0d6383375660c05e55d36fb0d2f91e1d8de8
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoMerge "Set TEST_DB_URL for storperf"
Jing Lu [Mon, 3 Jul 2017 01:58:44 +0000 (01:58 +0000)]
Merge "Set TEST_DB_URL for storperf"