Fix ansible scripts for running in container

JIRA: YARDSTICK-1147

Change-Id: I52dae85a2d97192bc8a48c5aeea3173b3d4de003
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>

Correctly set PYTHONPATH in Dockerfile

JIRA: YARDSTICK-1144

Change-Id: I8c0fe229ed620417a85356e017b171260373c43f
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>

Merge "Replace nova attach volume to server with shade client."

Update Dockerfile.aarch64.patch

The patch doesn't apply anymore for the latest docker builds.
Updated the patch to accomodate the latest changes to the Dockerfile

Change-Id: Ia8a35337a421b3628c90be3060f049c655446758
Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>

Merge "Add active wait function"

Replace nova attach volume to server with shade client.

Function attach_volume_to_server now uses shade client
instead of nova client.

JIRA: YARDSTICK-1088

Change-Id: Id00df672c2c195b5c338cbbc30ddf2742a4e4d29
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>

Merge "Migrate install.sh script to ansible"

Add active wait function

Added function "wait_until_true". This function will make an active
wait until the predicate passed as an argument returns True.

If the timeout expires, the function will raise a generic exception
or a user defined one passed as an argument.

This function will be used in YARDSTICK-1127.

JIRA: YARDSTICK-1128

Change-Id: I9854e465ac6b586bf4be39ab4b266d5625b39e30
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Merge "Get HA test case results on failure"

Migrate install.sh script to ansible

Ansible scripts to install yardstick.

These scripts will take a few options:
  INSTALLATION_MODE : Container or Baremetal
  YARDSTICK_DIR: Location of Yardstick directory
  VIRTUAL_ENVIRONMENT: Should a virtual environment be used
  NSB_DIR: Location of NSB directory

JIRA: YARDSTICK-1126

Change-Id: I4a13e07e96650ffd971dfb18472f2563cfd51aa9
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>

Merge "OpenStack deployment using kolla"

Merge "Replace nova delete keypair with shade client."

Merge "Replace nova client create keypair with shade."

Merge "Remove unused nova client functions."

Merge "Replace nova delete instance with shade client."

Merge "Replace nova create instance with shade client."

OpenStack deployment using kolla

OpenStack deployment using Kolla installer for all-in-one mode and
multinode inside VMs which are already created. Two types of OpenStack
nodes are supported as input in sample files, like
infra_deploy_two.yaml.sample: controller and compute.

JIRA: YARDSTICK-1078

Change-Id: I51616a7a17ac565a01ec6da57b589290237d18ee
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>

Merge "Add dashboard for TC058"

[release] Yardstick Fraser 6.0.0 Release notes

JIRA: YARDSTICK-1129

Change-Id: I5adb2e9547c58b90d3eafb0e2b90015ce5472cfa
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "Fix "os.path" mock problems during tests"

Merge "Bugfix: ansible can't not run without config"

Fix "os.path" mock problems during tests

This patch removes the global mocking applied on "os.path".

Change-Id: Ia18d2c90195c5408a1852792bdf05b6f0c1ad21f
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Merge "OpenStack deployment: delete RS or all VMs"

Merge "Add docker support for Ubuntu 17.10 with Yardstick"

Bugfix: ansible can't not run without config

JIRA: YARDSTICK-1135

Ansible need ansible.cfg when run in the remote node.
However the file name is wrong. Need:
setup.cfg -> ansible.cfg

Change-Id: Ifa674fb624ca83d90c3ac9ad3bfe148013bf8bfd
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>

remove more old apexlake testcases

fix fraser failures

Change-Id: I8bb12a762054a4c3274cc6e0297e948b92700e7e
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "[docs] Updated baremetal instalation instructions"

Replace nova delete keypair with shade client.

Function delete_keypair now uses shade client.

JIRA: YARDSTICK-1088

Change-Id: I46b895748c5c44b0bf7d5b035395676ebff48d7f
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>

Replace nova client create keypair with shade.

Function create_keypair now uses shade client instead
of nova client.

JIRA: YARDSTICK-1088

Change-Id: I060580504d6969c5ba859ed4494082feb998d37d
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>

Remove unused nova client functions.

Following funtions are not required by shade client also
not been used in any of the scenario files:
*create_aggregate
*create_aggregate_with_host
*create_instance
*add_host_to_aggregate
*create_aggregate_with_host
*get_availability_zones
*get_availability_zone_names
*remove_hosts_from_aggregate
*remove_host_from_aggregate
*delete_aggregate
*get_image_by_name
*check_status

JIRA: YARDSTICK-1088

Change-Id: I7ba0fbce6aa3e636aa55581a993c1ec1b48fbead
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>

Replace nova delete instance with shade client.

Function delete_instance now uses shade client.

JIRA: YARDSTICK-1088

Change-Id: I5772a74c6dc2d103edd410042a8eaf721d1bcc5c
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>

Replace nova create instance with shade client.

Remove redundant functions:
*get_instances
*get_instance_status
*get_instance_by_name

Function create_instance_and_wait_for_active now uses shade client.

JIRA: YARDSTICK-1088

Change-Id: I766da333dabbb1b83a7b4ede4bf73567ec70eb8c
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>

Merge "MessagingConsumer accepts messages from multiple producers"

Merge "Improve "Libvirt.create_snapshot_qemu" function"

Merge "extra loopback cleanup"

disable NSB (DPDK) image load for ARM

we skip the building now but we also need to skip the image loading

JIRA: YARDSTICK-1124

Change-Id: I27c40d6319e74374282203132cfc2c7ebff9b094
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "DPDK: detect dpdk_make_arch based on image arch"

extra loopback cleanup

try to cleanup in the shell script in case ansible errors

maybe it is hopeless because of docker

JIRA: YARDSTICK-1096
JIRA: YARDSTICK-1054

Change-Id: I759ded4731a7710a194a81530cfb35376eb7800d
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

disable DPDK images for ARM

We are trying to compile DPDK for the os-nosdn-ovs-ha scenario because we added TC042  "Measure network latency using testpmd and pktgen-dpdk".

However it looks like TC042 is only enabled for compass in opnfv_os-nosdn-kvm_ovs_dpdk-ha

https://gerrit.opnfv.org/gerrit/#/c/54659/1/tests/opnfv/test_suites/opnfv_os-nosdn-kvm_ovs_dpdk-ha_daily.yaml

-
  file_name: opnfv_yardstick_tc042.yaml
  constraint:
      installer: compass
      pod: huawei-pod1

We don't actually need TC042 and DPDK or os-nosdn-ovs-ha.

But in order to run TC042 we have to know beforehand that we are going to use DPDK, so we have a conditional in the load_images.sh script that tries to guess when we will need a DPDK image.

The conditional only checks for *[_-]ovs[_-]*
if [[ $DEPLOY_SCENARIO == *[_-]ovs[_-]* ]]; then
    ansible-playbook \
             -e img_property="nsb" \
             -e YARD_IMG_ARCH=${YARD_IMG_ARCH} \
             -vvv -i inventory.ini build_yardstick_image.yml
    if [ ! -f "${QCOW_NSB_IMAGE}" ]; then
        echo "Failed building QCOW NSB image"
        exit 1
    fi
fi

For this release we won't be able to get DPDK images to compile on ARM, we should fix this conditional and not try to compile.

Also change the shell glob to match *[_-]ovs_dpdk[_-]* to only enable DPDK
images for ovs_dpdk scenarios

JIRA: YARDSTICK-1124

Change-Id: I03142e6b8aa00dc9cdf9b446868fb723cd10198b
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "Update neutron delete_neutron_net function."

MessagingConsumer accepts messages from multiple producers

The messaging consumer now can store a list of PID of several producers.
The notification handler can compare the procedence of a message from
a list of PID.

JIRA: YARDSTICK-1074

Change-Id: I193f83c2b471e5bf1298ac728be52533aded0c1a
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Merge "add verbose to debug losetup delete"

DPDK: detect dpdk_make_arch based on image arch

JIRA: YARDSTICK-1124

Change-Id: I26e5854f5117a3b45ac7fa4d4b06f325dcd4d97a
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "remove apex lake tc007 from test suites"

Merge "Replace neutron create security group full with shade."

remove apex lake tc007 from test suites

fixes opnfv_os-nosdn-fdio-noha_daily.yaml failures due
to missing testcase

Change-Id: I5f050d72334da46b94de5fa3662047bf694f7e3e
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

fix unittest test_deploy_try_retrieve_context_does_not_exist

unittest is failing due to mock being called multiple times.

I assume this is due to parallelization of tests in Jenkins somehow

======================================================================
FAIL: test_deploy_try_retrieve_context_does_not_exist (benchmark.contexts.test_heat.HeatContextTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/mock/mock.py", line 1305, in patched
    return func(*args, **keywargs)
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/yardstick/tests/unit/benchmark/contexts/test_heat.py", line 309, in test_deploy_try_retrieve_context_does_not_exist
    mock_path_exists.assert_called_once_with(key_filename)
  File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/mock/mock.py", line 947, in assert_called_once_with
    raise AssertionError(msg)
AssertionError: Expected 'exists' to be called once. Called 3 times.

----------------------------------------------------------------------

Change-Id: I696c63ef9f7943b841e2d3d533c92f18aa7044da
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

OpenStack deployment: delete RS or all VMs

New parameter is added to shell script to delete data for VMs either from
input file or all.
Added disk images removal as per new input parameter.

JIRA: YARDSTICK-1123

Change-Id: I8d2cee4a3a7ad7147f4d59303bab656d80370221
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>

Improve "Libvirt.create_snapshot_qemu" function

Improved "Libvirt.create_snapshot_qemu" function:
- Check if the base image is present in the remote host.
  If not, try to copy from the execution host.
- Check the execution status. In case the command fails, raise an
  exception.

JIRA: YARDSTICK-944

Change-Id: I78bd0d3ed6a1f35ed772c0d192bb240009a580ed
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Update neutron delete_neutron_net function.

Update the changes done in patch [1].

JIRA: YARDSTICK-890

[1] https://gerrit.opnfv.org/gerrit/#/c/52361/

Change-Id: Iccbf16d0a2e72919d5092366241ff41686f01a58
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>

Replace neutron create security group full with shade.

Function create_security_group_full now uses shade client.

Remove openstack util's private 'get_security_groups',
'get_security_group_id' & 'create_security_group' functions as
'create_security_group_full' now uses 'get_security_group' &
'create_security_group' function defined in shade client library.

JIRA: YARDSTICK-890

Change-Id: Ibd5b9ca9b7ce99b3e40c5dcc545f2af672ce2203
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>

Merge "Remove tool provisioning in Standalone contexts"

Get HA test case results on failure

Now, yardstick HA test cases (which have 'sla action: monitor') do
not output results if the test case SLA validation fails.
This patch modifies the task runner and the serviceHA scenario so
that during an SLA validation failure the test result data is
captured correctly.

Do similar changes in the general scenario.

JIRA: YARDSTICK-1115

Change-Id: I648a8b229600c0ad089320ac3f803698f73aa800
Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>

Merge "Bugfix: interface down HA tc050 attack and monitor logistic wrong"

Add MQ consumer, producer and payload base classes

Added MessagingProducer base class. A class implementing this base class
can send a cast message using the MQ service installed in the Yardstick
jumphost (RabbitMQ by default, other MQ could be implemented). The producer
will send messages to an specific topic.

Added MessagingConsumer base class. A class implementing this base class
will be able to receive any message sent by a MessagingPorducer class
publishing messages in the topic subscribed.

By default both Producer and Consumer "fanout" is True. That means every
Consumer will create a fanout Queue attached to the MQ Exchange topic. All
Consumers attached to this topic will receive the message sent by the
Producer [1].

Added Payload base class. To send data through the message queue service,
a Payload derived object should be created. This base class allows to
define the attributes container in the class, convert the object to a dict
and retrieve the object from a dict.

Added a new library, "oslo.messaging", to implement the RPC client and
server.

[1]http://blog.thedigitalcatonline.com/blog/2013/08/21/some-tips-about-amqp-direct-exchanges/

JIRA: YARDSTICK-1074

Change-Id: I63932b5fb3de2bdc1270fc83295630a2a349e2a6
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Bugfix: interface down HA tc050 attack and monitor logistic wrong

1. simplify the attack to be one interface
2. move monitor step before attack
3. update rst doc to match

JIRA: YARDSTICK-1120

Change-Id: Icfa21d58e7ccdbeaca8a9a1a3098cceb21c981c3
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Merge "Bugfix: to list all used loop device"

Merge "Bugfix: Can't get image list in API"

Bugfix: to list all used loop device

Bug fix in script "build_yardstick_image.yml", to

- Use option "-a" to list all used loop devices, to be more compatible.
- Ignore the error and continue, if the debug command failed.

JIRA: YARDSTICK-1121

Change-Id: I24aaebb2ffe3107ca5c619401725aa8c8e1af295
Signed-off-by: ting wu <ting.wu@enea.com>

Bugfix: Can't get image list in API

JIRA: YARDSTICK-1110

To match OpenStack Pike release, we upgrade novaclient from 7.1.1 to 9.1.1.
And the client interface has changed, it no longer has nova_client.images attribute.
So I use shade instead. Later will change all same issue.

Change-Id: Ie4f54069d4346e44e2ad925439930504b945cbad
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>

Merge "Bug fix in using Unixbench"

Add docker support for Ubuntu 17.10 with Yardstick

JIRA: YARDSTICK-1119

Change-Id: I6d9b21667605f1c0a157c2a72e708c36b90e8c3a
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>

Upgrade collectd to version 5.8

Update collectd version to 5.8 as it's the latest stable
and supports GCC 7

JIRA: YARDSTICK-1114

Change-Id: I9147b7277d87047eda729664d5ee3e8ab2c145af
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>

Merge "Add support for dpdk 17.05"

Add support for dpdk 17.05

Add support for dpdk 17.05. Add option to dpdk scripts
to download dpdk 17.08 17.11 and 18.02. These are currently
unsupported due to prox build issues.

JIRA: YARDSTICK-1113

Change-Id: I585566364a4d1f04a696439af96c50c0e9d38033
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>

Bug fix in using Unixbench

JIRA: YARDSTICK-1117

This bug will cause the error in running unixbench.
"no such file named ./run"
So we have to fix it.

Change-Id: I141fcb5567fbb0e3df97aee677cb946a25a9788e
Signed-off-by: liyin <liyin11@huawei.com>

Bugfix: k8 scenario fix

JIRA: YARDSTICK-1109

Change-Id: Ic61a63099c3d2d4af5fa5634299e4b2946d53eaf
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit 3b1316647b50bc3bbb1eb6216aa07fd4dff34edf)

docker/supervisor.sh: Fix condition block end

Fixes: 18546b4f

Change-Id: I51fcb48e790ff7c57273a3f6712ccb2b9bc4aa32
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit ead90064d12be552bd334828d41ffffa75fad01b)

docker/supervisor.sh: Fix condition block end

Fixes: 18546b4f

Change-Id: I51fcb48e790ff7c57273a3f6712ccb2b9bc4aa32
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

[AArch64] Dockerfile: Fix malformed patch

Change-Id: Ia2dfc6c4def8e71e36747b8f27cbf22700f676b1
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
(cherry picked from commit 161f7d676b4404a5445681a7871e086b751fdafc)

[AArch64] Dockerfile: Fix malformed patch

Change-Id: Ia2dfc6c4def8e71e36747b8f27cbf22700f676b1
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>

Merge "Bugfix: k8 scenario fix"

[docs] Updated baremetal instalation instructions

JIRA: YARDSTICK-1111

Change-Id: Iefab24f74c87a0855c2d70090ac34256ffa9200c
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>

[userguide] Use literalinclude directive in 05-operation

Uses literalinclude directive instead of having a copy of the file content in documentation.
This means that any update to this file is detected, and the most up-to-date content is used.

If a testcase is updated, the updates wil be picked up.
The examples used are ones that are tested reqularly.

JIRA: YARDSTICK-1066

Change-Id: I15d967eb04d1e6f4348683d8746fa9989dceda94
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

[docs] update the user guide for "yardstick-operation"

* Add a new chapter: operation which shows how to use Yardstick and
  how to create test cases
* Include details on how to reuse and keep VNFs between testcases

JIRA: YARDSTICK-885
JIRA: YARDSTICK-886
Change-Id: I365152e8812427a3c54259adbc18d5ddb216d775
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

[docs] Move user guide chapters to make room for new chapter.

* Increment the numbering on chapters
* Fix some of the changes flagged by doc8

Change-Id: Ie03d165297671dfd50b9de339612cdc8bf00b988
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

Bugfix: k8 scenario fix

JIRA: YARDSTICK-1109

Change-Id: Ic61a63099c3d2d4af5fa5634299e4b2946d53eaf
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

ADD tc042 into CI

JIRA: YARDSTICK-1108

We add this test case in ovs_dpdk-ha and ovs_dpdk-noha testsuites
also add image build into load_images script

Change-Id: I2b0c6b106dd98c3693df18dba46259ff8ef0a76e
Signed-off-by: liyin <liyin11@huawei.com>

add verbose to debug losetup delete

JIRA: YARDSTICK-1096
JIRA: YARDSTICK-1054

Change-Id: I5a11dbd2638782c5e499cb94dd5882b8bf696e8d
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "Fix RabbitMQ service installation and initialization"

Merge "don't print exceptions in atexit handler"

Merge "task: don't hide exceptions in Task"

don't print exceptions in atexit handler

atexit handler calls terminate_all after the regular python execution
path, and it looks like the traceback stack is None somehow.

In this context log.debug("", exc_info=True) doesn't work
it prints out NoneType on Python3 and
causes other problems on Python2.7

remove the exc_info=True from the logging call

JIRA: YARDSTICK-1107

Change-Id: Ida0a0ced7ff5e017e2f8608880e3bb531724af95
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

add new Fraser scenarios

New scenarios from wiki: https://wiki.opnfv.org/display/SWREL/Fraser+Scenario+Statu

Change-Id: Ifd6e45e73be2bbb99743aa3f4981d22899aab92a
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "restore Heat stack failure logs for CI"

Add dashboard for TC058

This dashboard is for Yardstick test case TC058.

JIRA: YARDSTICK-1091

Change-Id: Ib76d917f52cd0fc7d968ac300f8e7e01de3dfd0f
Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>

Remove tool provisioning in Standalone contexts

In both Standalone contexts, SR-IOV and DPDK, the tool provisioning must
be removed. If the tool, "dpdk-devbind.py", is not in the VNF, the test
should fail because this tool should be provided during the provisioning,
not during the test execution.

JIRA: YARDSTICK-1092

Change-Id: I212c1303fd655f151e9c0efc29aad97fe6d71d1c
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Fix RabbitMQ service installation and initialization

RabbitMQ service added in [1] is not correctly installed and initialized:
- There is an error during the installation process ("\" character
  missing).
- In the installation script, the service needs to be started first.
- In the container installation, the service needs to be started via
  supervisor.

[1]https://gerrit.opnfv.org/gerrit/#/c/53597/

JIRA: YARDSTICK-1103

Change-Id: Iade3d6ce4b522e6f576af71b7afe5559081f7929
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Merge "Replace neutron create security group rule with shade."

Merge "Dashboard for TC056"

task: don't hide exceptions in Task

If the Task raised an exception we currently hide it
and replace it with RuntimeError.  This is bad.

If an exception occured, then we don't have a result so
re-raise the original exception.

Or we could log the traceback and raise RuntimeError, but
that doesn't seem to be a good idea.

Sample traceback after re-raising original.  Without this patch the ValueError is only written
to _write_error_data

2018-03-25 22:57:56,511 yardstick.benchmark.contexts.node node.py:85 DEBUG BareMetals: []
2018-03-25 22:57:56,511 yardstick.benchmark.contexts.node node.py:89 DEBUG Env: {}
2018-03-25 22:57:56,511 yardstick.cmd.commands.task task.py:57 INFO Task FAILED
Traceback (most recent call last):
  File "/home/rbbratta/yardstick-upstream/yardstick/yardstick/cmd/commands/task.py", line 54, in do_start
    result = Task().start(param, **kwargs)
  File "/home/rbbratta/yardstick-upstream/yardstick/yardstick/benchmark/core/task.py", line 103, in start
    task_args_fnames)
  File "/home/rbbratta/yardstick-upstream/yardstick/yardstick/benchmark/core/task.py", line 321, in _parse_tasks
    task_args_fnames[i]
  File "/home/rbbratta/yardstick-upstream/yardstick/yardstick/benchmark/core/task.py", line 558, in parse_task
    context.init(cfg_attrs)
  File "/home/rbbratta/yardstick-upstream/yardstick/yardstick/benchmark/contexts/heat.py", line 131, in init
    server = Server(name, self, server_attrs)
  File "/home/rbbratta/yardstick-upstream/yardstick/yardstick/benchmark/contexts/model.py", line 210, in __init__
    (name, p))
ValueError: server 'trafficgen_1', placement 'pgrp2' is invalid
2018-03-25 22:57:56,512 yardstick.cmd.commands.task task.py:62 INFO Task FAILED
2018-03-25 22:57:56,662 yardstick.benchmark.runners.base base.py:124 DEBUG Terminating all runners
NoneType

JIRA: YARDSTICK-1102

Change-Id: I7e6fa41fc1d36f6d438a1602ab60cb41ffbee1e9
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

restore Heat stack failure logs for CI

We need to see what Heat failures occured
so that we can debug CI failures.

The only way to do this seems to be to use the
private event_utils.get_events function to
query for all failures

Also since we had a failure go ahead and dump the
Heat template that failed.

Sample output:

2018-03-25 23:50:08,765 [INFO] yardstick.orchestrator.heat heat.py:629 Creating stack 'yardstick-460ed969' START
2018-03-25 23:50:21,932 [ERROR] yardstick.orchestrator.heat heat.py:644 Resource CREATE failed: BadRequest: resources.yardstick-460ed969-xe1: Invalid input for operation: physical_network 'nosuch' unknown for flat provider network.
Neutron server returns request_ids: ['req-6f981f1e-a9e2-4114-af84-1ee528aed51b']
2018-03-25 23:50:21,933 [ERROR] yardstick.orchestrator.heat heat.py:644 BadRequest: resources.yardstick-460ed969-xe1: Invalid input for operation: physical_network 'nosuch' unknown for flat provider network.
Neutron server returns request_ids: ['req-6f981f1e-a9e2-4114-af84-1ee528aed51b']
2018-03-25 23:50:21,972 [ERROR] yardstick.orchestrator.heat heat.py:645 {'description': '\n'
                'All referred generated resources are prefixed with the '
                'template\n'
                'name (i.e. yardstick-460ed969).\n',
 'heat_template_version': '2013-05-23',
 'outputs': {'trafficgen_1.yardstick-460ed969': {'description': 'VM UUID',
                                                 'value': {'get_resource': 'trafficgen_1.yardstick-460ed969'}},
             'trafficgen_1.yardstick-460ed969-fip': {'description': 'floating '
                                                                    'ip '
JIRA: YARDSTICK-998

Change-Id: Ia8f4e5ba7e280fb9086519680d5ee90a2b442e6b
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "Improve "Libvirt.virsh_destroy_vm" function"

Merge "Improve "Libvirt.virsh_create_vm" function"

Merge "Improve NSB Standalone XML generation"

Merge "Improve OVS-DPDK setup process"

Merge "Improve OVS-DPDK boot process"

Replace neutron create security group rule with shade.

Rename create_secgroup_rule with create_security_group_rule.
Function create_security_group_rule now uses shade client.

JIRA: YARDSTICK-890

Change-Id: Ie0ebac67a281e55dc95c0e3e33ba43de80aba9ec
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>

Merge "Replace neutron floating ip deletion with shade."

Merge "Replace neutron floating ip creation with shade."