Fix tables in the troubleshooting guide

Change-Id: I1e1f741cc17961d5ff4542884b51b6fb81530560
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit ad50b6b1284bd0e799c1f12e3d779f6970ff646f)

Add rally troubleshooting guide

Change-Id: If964d6270d5574d9e249bf42ecfb00669c224df6
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit fd7cee7f8629c46bd2d2f7671ed9f98f55932a26)

Add vPing troubleshooting guides

Change-Id: I47ff023d720b4348ecb465ca6c3fa4653d3ab2f8
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit d2775f8d819b357d8b64de48f97ad58871d9ea22)

Adjusting the heading level for composite doc rendering.

Change-Id: Ib73ffdff9c08a5e34b85c9a73f7878f3ae15974b
Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
(cherry picked from commit c2ad2cc5eead2f8a4047871572a2490ec434fa73)

Fix Doc errors detected in opnfv-docs-verify and add license

Some changes taken from https://gerrit.opnfv.org/gerrit/#/c/10595/1

Change-Id: I39f295841c3a89b24e74b7ee613c9da4b223ccab
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 9f02fb0b914b52336d04a5e8e25102a828fe6191)

Change table format

Change-Id: I051208e31ba58ffe241725302cdcb5f662c1899e
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 331f246f2b8be355ecf07e3e207b66e124af3799)

Fix formatting for compass and joid scenarios

Change-Id: I74309a19ff33462ee549cfd8d43e8046907044dc
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit fa2cbbcd065997bfd0712f01b432864ffa06e2e2)

Correct rst formatting for fuel scenarios and set proper order

Change-Id: If9f59e36eb39db97a206f5e3e715b144aeef7fe8
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 9de85e7fcd1fa33982fd494d2f7b6e169eef8b91)

Add doctor results to apex-odl-l2 scenario

Change-Id: I56661f953fab0275b089f718ac22c7403f9cfc71
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit a6fab7def0699971dbb7396ca7f18d2cccbc54bb)

Add the missing scenario results to the doc html page

Removed those who won't be part of SR0. We can add them when
they get the green light

Change-Id: I463e22a32b77f3b12994f72a71f5441b76b7fbcd
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 58356df02d77f3ed53237ff0d1a210d3d836f69a)

Add result docs for apex, compass, joid

Change-Id: I3124c6128c4222410514b08e32d6815cb7f60ace
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 2232cdeef8c076455a81068fe8ab5aa66f2f517a)

Add fuel scenarios test report

Removed those which won't be part of the  release

Change-Id: I99c837d367de8d2bc4ac6f32d2d20fa8bb731759
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit a71539a6ff0f9691a8f14c44b3bd8edb5997c904)

Fix differences in stable/brahmaputra

Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>

Moving testusage.rst to introduction.rst to avoid being pulled into the userguide.

Change-Id: I96bc3bd578ccb19b0aac2af2f2134619e476605f
Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>

Add compass onos and odl_l2 scenario

Signed-off-by: mrichomme <morgan.richomme@orange.com>
(cherry picked from commit 2515014f340542d0f39e1ea516314ddb5fb86c0a)

Change-Id: I9331aec4fb2548e15a37f63da6190ad490d5b8e6

remove "print" in tempest to avoid having a message "None" in the output

Change-Id: If2008fa7ed1bce1b5acc40cad82c21afa55ec4e5
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit f937af8864c6fe6d392c9b9766df98d164c64459)

Create troubleshooting guide as a separate .rst

Change-Id: I2d5a1544e7c07dbc164b5d7403318ccafe75e5c1
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit a931c6fe03313fac0cb1374acad2d753670328bf)

Add git support for Doctor repo in config_functest.yaml

Change-Id: I10ad0dc6cd6697a2a93f5e11edcdd69f70f86c5f
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit e0e52cec1e43491714f0ce078a7722e2cc3d9fca)

Fix message outputs taken from the console log in vPing_ssh

Change-Id: Id169167d90d60b8266913a8451699969abb4ef7c
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 8960264f843abd8c261b0effe9014d1be5cd4dae)

Corrected using of echo command

Full path of echo is needed when using -e option in Docker file.
Otherwise -e will be output as part of the string.

Change-Id: Ic226209a3ef5dac991ccae996f6e7afa0061fccf
Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
(cherry picked from commit 78fd590723f24a723fe8ab32bf992b80f0956f25)

Remove network failed message check form vping_ssh

Change-Id: I72d97af3ddd76f698ce54918cf92f98c8f5a7fd4
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 4789710123718723adbc84ab6445ac141e074a9b)

Add VI and alias support in the docker container

When editing a file with VI in the container, the
keyboard is not properly setup. This options will
help to do things more smoothly..

Change-Id: I4c9004a4df067d7bbb558461dd98d76e32e64591
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 80ddf6005f1e1afbcbc3183f2a0ced1a66fdfe8b)

Release floating ip after vPing_ssh test

Also, check the console to see if the instance fails
when sending the discover to the dhcp agent

Change-Id: I314051886b9580a42bb88f2d88a9bdbf2a9e198a
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 62131c3f53e66b6305bdd163037d452483821cfd)

Create vPing_userdata instances with dynamic ports created by nova/neutron

Change-Id: I1808763f6ccf1ac90b8a696c48ecdfba03d782fb
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 81892929f7fc0949b08eb79c93583658a2b87c50)

Create vPing instances with dynamic ports created by nova/neutron

Also,
- check if the used network is already created to not create it again
- check if the image already exists to not create it again
- check if the sec group already exists to not create it again

Change-Id: I243619a1538444d836fdda84a86b834668aaf456
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 12c1b110e91b2c062b378561f3fb271fe0626aec)

Rally live migration case selection

Execute live migration cases only if the feature is enabled in Tempest configuration file.

Change-Id: Ie88da2a8f6a4e22cbc96d6aa1f749d555ac58d84
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit 1d62586d396d948c523fb0b0e351ae162e7fdc6b)

Add result overview and onos-nosdn-ha scenario reults

Change-Id: I5978d06dc2f991630a6fd3ebfb8c20c5f8978b1b
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 6e424590b9e3129ffc2801df9b23b7313126389e)

docs: add userguide file for the central doc

See https://wiki.opnfv.org/documentation/userguide .

Change-Id: Id3786ca6d69b517e9dc8ddc96c9cf3a8cf3438ea
Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
(cherry picked from commit 3bdc2171d87e61da1589fe238c6fa6ed5981ffe5)

Adding a structure for the reporting of test cases for functest

The structure builds on an index.rst in the results folder.
The results are seperated inot specific files for each scenario.
All scenarios are commented out at this time and we can add them when ready.
Not all scenario files have template text at this time.  (have to run, wanted to push this)

Change-Id: Iaff140a5e8106f19d15d23f937f6dd27453a5680
Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
(cherry picked from commit 75bfd472302483a201a48eb18c69447343f83b75)

bug fiw syntax when calling push to db from vIMS

Change-Id: I79ce10993c5a21fcb840681efd364ad2dc366e50
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit b577ceda844c7fae4b2991b12a335f34fcf9cd73)

Add project in push_to_db function of functests utils to allow external project onboarded in Functest to push their results

Change-Id: I3a065e6ce82b1a87bbd07810f13df7d146655933
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 9812bf270c6ef1a5f0582bd8be3c5a3776e73960)

Push results without extra formating

Change-Id: I70713a30cec556ca7cd32122b9c10cf4c1732c3f
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 4c2674593f1bf6f093bbdc5de41241e46bfcbe14)

Enadled --serial option for run_tests.sh

It could be useful to execute e.g. Tempest test cases in a single
thread in order to troubleshoot possible concurrency problems.

Change-Id: I5e5fc190fb4483ff075a8f837a8d4116ece90c80
Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
(cherry picked from commit 66df82a76334015e3e2d25ddcc22b343b110320c)

Bugfix add "fi" at the end of the if-else statement in run_tests.sh

Change-Id: I14945cf335803936043ab71dff93250577bc6601
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 188aef4912beee7a8eb87272de1500a1bded99f0)

Add -n|--no-clean flag to vPing,Tempest,Rally,vIMS scripts

Use --no-clean flag in run_tests.sh to tell the test scripts to cleanup
or not the resources

Change-Id: I597eca5199e1eaf16b1f03a223222d33e4adf170
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit abc81e24d33b9bf8d2f8fb05dc5f5f57443abe93)

Rename the vPing scripts proplery and adapt documentation

Change-Id: Idb498eb7cefd938006661f42f1bf1772395d9d47
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>

Doc updates

- Some clarifications, rephrasing
- Remove more statements related to the DB
- Add more info for vPing
- Add more info about clean defaults

Change-Id: I12e97443852dc38a23bda589945ca0333a37e410
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit e637e75435587014cb99edbc57e79970095d0464)

Create Rally summary report also for verbose mode

Also:
- Fix percentage format of summary
- Get the percentage from the row 'total'

JIRA: FUNCTEST-134

Change-Id: Ifb45523921b4096c3242578cf4ddc6b084e8bbb2
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 945aff5ef35837170fc09953b83cfb6081a1edad)

Push rally summary results into DB

json produced by Rally are pushed to rally_details

Change-Id: I2f057093307cb395f5c5ffd42c3d228b05133a09
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 96f4bbb9aef2b4d3a8bda16b82a06157c110d2e9)

Remove obsolete public network definitions

Use functest_utils.py routines in run_rally-cert.py to retrive external
network name instead of static definition in config_functest.yaml. Also
change the network name and id setting in task arguments.

Change-Id: Iced9e9a28e79d6ac6ddd2f9f593481949f5fc8a0
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit 41eaec87fe939a8511dc6c0ec63976b53cbf5578)

Create Rally output summary at the end of the tests

Added template to start pushing results to DB

JIRA: FUNCTEST-134

Change-Id: Ibc04eae8478827146947df2bcf3460b8c7ef0bc7
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 76ee625343b28868ca7c6c6108ee974bb57dbea8)

doctor: adds logger

Change-Id: Idc9c0f17049b9e6d2d7a0b8dc2bf35778d3c29dd
Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
(cherry picked from commit fc19da3f029594b4e0a72bfe11b66d0ed76f0ff4)

update doc
- update external test cases
- add chapter on push to DB

Change-Id: I10cd5c9583233604c8b8595f173c690f45124789
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 6ab2ccb7071f1d4925f25344d4b4a29d0525d935)

Used sed instead of crudini for updating regex

It seems that crudini has limitations regarding quotation marks
so sed tool is used instead in order to replace ssh_user_regex
parameter into tempest.conf file.

Change-Id: I8587b3e6b0c15930407ab90bf05f00086348edf6
Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
(cherry picked from commit 8d7f1158885ca2d880811747b07f34ab50d2031d)

Merge "enable doctor test scenario" into stable/brahmaputra

enable doctor test scenario

Change-Id: If0e050e979d886fff436daa384a97a651a56aaa5
Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
(cherry picked from commit f91f448317ea36ce5c790bcac345dfdcefbe1fb7)

Added configuration of ssh_user_regex parameter

Some Rally versions don't set correctly SSH user name into
tempest.conf file so that e.g. test_server_basicops test case
of Tempest suite fails with "Please login as 'cirros' user,
not as root" error. This change ensures that correct SSH user
info will be used for Cirros images created by Rally.

Change-Id: I90dcad0024f2034ef3ed20d2c6981e675213558d
Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
(cherry picked from commit 04cf934e24b0f7e0c53125711b4e98c14d54f049)

Reduce the number of iterations to ten in rally scenarios

Change-Id: Ibefc3f5eeb57ff6a1daa0be26f482ed0376a0d40
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit 01608c214878c19c9f01c60e1b08e106a5d684cf)

update user guide
- change vIMS logs
- add Promise logs
- modify section on OpenStack audit (now dynamic)
- minor reformating of tables
- typos
- add troubleshooting section on vPing and vPing_userdata

JIRA: FUNCTEST-113

Change-Id: Ib29c4d5e2c4f10f64de764491fc536495b39ea3d
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit c348fa9a9dcd8fd4fb4d83b36d441e3c949af390)

Import request python module for promise test case

Change-Id: I437766fe1c595a60a82af3c49a5eb29974e0da33
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit b0e19118c80d694820dd75c53001e0b9563061a9)

Fix success status parsing of rally results

Change-Id: I6053bce6cc919af7ac34a16843b2583e45f01ac2
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit 5cf9b7fe8f380f6315e656527b90778c2d91a95c)

Use python json parser to get the results form the Promise json report

JIRA: FUNCTEST-68

Also, add sleep to let the promise instances terminate,
otherwise, clean_openstack will detect them while they
are still being removed and will fail.

Change-Id: I7a5543143758483eb1d7e06dbe4922e9f1e05cfb
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 75149a9d278b5a969606ad182fff580c08e37d6c)

bug fix: get installer using functest_utils

JIRA: FUNCTEST-68

Change-Id: I0b4847f28ca77e171ca525b301b7bfa6cf366e94
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit a6a3af39986e61f5f7c9094befec41fd753610d5)

FIX:use 'info' after sourcing the common.sh

Change-Id: I0572375d79983791970ece0d31ed2e3d7df8cfc3
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
(cherry picked from commit 778325ba0b725ab524ffb1944140e3e555dcfd5d)

FIX: sleep 3 second to release create_venv.sh from chmod command

sometimes vIMS failed to create venv for "Text file busy",it should
be a side effect of last command "chmod +x ..."

Change-Id: I6a94b644e89988efa92afc46e9fbdeb8564db89e
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>

Show Promise results output and push results to DB

JIRA: FUNCTEST-68

Change-Id: Iecb1becee1fc788a7c854227a8c3ea2252898eba
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 17baf4a83e8b9962281ed230e75c362047c34487)

Consider volumes and floatingips as defaults in clean_openstack

Change-Id: I3ffc864768a7c474ee1063eecee1e2085de807b5
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 16038f444c1e80006e13b72cb0597976a0b2f92e)

Create security groups with ICMP and SSH rules for vPing tests

JIRA: FUNCTEST-133

Some installers don't allow icmp and TCP port 22 (SSH)
in the default security group. To avoid any dependency
with the installer, vPing will create its own security
group with those rules and delete it afterwards.

Change-Id: I6f31f21c240d80eed8bead638af51aa7e1e92aad
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit ab3413a15aeb3b3669da94fa383ec07212eeb915)

bug fix to run tempest and minor display error in run_test.sh

Change-Id: Ic30bdd1c514aa8dcab37ba91de2f8879729a80a2
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 86c95df05ef125218f392748a177d2f9aa79848f)

Report vPing timeouts to the DB with duration = 0 and test status=NOK

JIRA: FUNCTEST-132

Change-Id: Ida0c485504fd07db29b0c33ac59da6944da303a9
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 5bb53025a593bbda834ef6ad325faba5aa073f7f)

Remove error message if instance is not found

Reason: vping calls this function until the VMs are deleted,
when that happens, it throws an exception and returns None,
which is fine, but the message error on the output is a
bit confusing if you don't know the context.

Change-Id: I8a4c408197d3c83151fb15a12387575d9fe1d553
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 7dd58acc208727aaed83807f065dedcc899b0137)

Small improvements with output messages

Change-Id: I4c274df30bc3123bef23d5423a1762a07dd93e68
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit ac0d556e54a09b5a3470b20384ac58f7ed383202)

Use openstack client to avoid keystone deprecation warnings

Change-Id: Ib82b3f20d0c23fc67201c7159e3b3a6de5c201cf
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 906b3b2f7e85f1269d009684b1a557a6c19e96bc)

Use generate_defaults instead of os_defaults fixed parameters

JIRA: FUNCTEST-131

Running generate_defaults.py in prepare_env.sh (before running any test)
will create a file with the CURRENT OpenStack objects in
the deployment. After each test, the cleanup script will take into
consideration those parameters instead of the specified in
os_defaults.yaml

Keep os_defaults.yaml for the moment

Change-Id: I5f38fef47f0a6d79407d1d582b1e7d3713503e07
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 47635924e6def36be3c44a047d91018e47a439eb)

Use promise-flavor if exists and don't try to create it again

Change-Id: I02ba76acb02f9785d13ca9bcd61ebe1290fa1cd7
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 81d7877b7f124f393c929e3a862e64125218e945)

Add script to generate the OpenStack defaults

JIRA: FUNCTEST-131

It checks the existing Openstack objects in the current
deployment (i.e. when the script is executed) and it will
create a yaml file to be used afterwards by clean_openstack.

This way, a user can generate the defaults when needed if there
are things that are not meant to be deleted without fear of
using clean_openstack.

Change-Id: Iacf204bdd14f591df21b3f243d27199ead2404b0
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 954907ac2995cfc158d5e363829af7c776be5f90)

Enable all rally outputs in verbose mode

In verbose mode the complete output of rally tests is shown.

Change-Id: I315c89b270312b13b3630b97cc24e5f529952645
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit e75f34706a8d72ee440d7f94363d4909a02f5293)

Adding structure to pull content into central docs.

Including minor fixes and corrections.

Change-Id: I7c4bd9ca4f5fb35aeb2350096520c66b11aecbe8
Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
(cherry picked from commit 63c77f27ec173fc3684ed980e82a4a7ed97beb6b)

use scenario instead of git info in version field of the test results

Change-Id: Ie80cc39e64d0fe70981623229560aa145df95c50
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 86728ad2ccfbea4a733b664aaafff0fcc22c4b0e)

Merge "Add aodh default user for apex" into stable/brahmaputra

Add testcases results to DB

Change-Id: Iada89aa690f6b3f1d041328b641620ceb0279912
(cherry picked from commit 817f19d6c668176d9e62ab4a3523585fcdd92b01)

Replace openstack single clients by python-openstackcclient

Some projects like Promise need to use the openstack cli directly.
This requirement will also install automatically the following dependent clients:
python-cinderclient (1.5.0)
python-glanceclient (1.2.0)
python-keystoneclient (2.1.1)
python-neutronclient (4.0.0)
python-novaclient (3.2.0)
python-openstackclient (2.0.0)

Change-Id: I6836b8765364b30ae877ec4d1e8d88c8927b030d
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit ff89aea46827ac2fc81429354ad28dfbb4c57fe3)

Export private net OS_TEST_NETWORK for Promise tests

Change-Id: Ie2e83a049a98f8e63245c3b992ff379fd353a0be
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit cc8dd9e8092cc68484d8ad3422c97762658271e8)

Add aodh default user for apex

Noticed here:
https://build.opnfv.org/ci/view/functest/job/functest-apex-opnfv-jump-1-daily-master/lastBuild/consoleFull

Change-Id: I508f8c2d6e19ba2ee5e633a3ed323693b06a6692
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 2eeb7cb050bf1a52358eb526eaad48870efcb46c)

fix the bug of onos test report

Change-Id: I34a068f991b89af6c65c895c7e9e604eac5dadf6
(cherry picked from commit 38cb5f334a2acc034b9757eba68561d134da79fa)

Copy tempest.conf to results dir to be uploaded to artifacts

Change-Id: I9cfe566c085dc45410a03650a9cf2a84de004d19
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit aa02e0de645a6af39baed4abed3667a112b09c42)

Create stdout and stderr files for Tempest results

Change-Id: Ibd45dd628dc64db16af28102276f5523f55fcaf4
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit c04286e7e407ebfc383f1e69ae1b7c3e015b9971)

Add promise section from patch 8361 of Gerald

Change-Id: I106239377020cedafa64ba58cbc765fd9dab7d61
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 1b268ef0cbf5324dffcd5c23ca2c36549ee2833a)

Editorials

Addressing the doc8 warnings.
Fixes also the wrong image file path.
Some more bug fixing on indentation.
Addressing severe title level inconsistencies.

Change-Id: I9ca235205056bf78c8f370055d05b6c6b3b7367d
Signed-off-by: Gerald Kunzmann <kunzmann@docomolab-euro.com>
(cherry picked from commit 1f5d8a36ce871b32aaf4a44102d4e11a67f074cf)

bugfix: self.logger

Change-Id: I6e9b3a833f590831cddac83e00a6b8809410d2cb
Signed-off-by: boucherv <valentin.boucher@orange.com>
(cherry picked from commit feecd6ccf9231ffdb82ac6bb2b1dcbb8389e457c)

Merge "Add some error result in result db api" into stable/brahmaputra

Change scenario start/result messages in run_rally-cert.py

Change-Id: I2f5d4f327ab88b6855569d920a275ec801eb0311
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit 358ea20ea921db3d2f4ed0d0d22c92a2b534ce3a)

Add some error result in result db api

Change-Id: I1c5f9bc51c04e321ace8c0ee0312be28d321910f
Signed-off-by: boucherv <valentin.boucher@orange.com>
(cherry picked from commit 9ec86196a8e96fea966beef08c01b9c9822a9bc4)

Add scenario name to Rally result message

Change-Id: I1eb6604c9ad658b65cc47c8d7d0f47717078a9fe
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit c269353e4027a2f8d690fc4a03315ebc93301ba7)

Changed to use $(repos_dir) and removed #

Change-Id: I6e4004aad2d55309b520647eee59608ee7fa66d7
Signed-off-by: Stuart Mackie <wsmackie@juniper.net>
(cherry picked from commit abfd2e7b94e4028e8ac032a5282f648b9dac08ec)

Update doc

Change-Id: I415f090e38fa382e0c768758b4b82dd3a7c9294f
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 7c5cfcf8085174066c35cfc39c4b6745a5819ecd)

Small typos fixes in functest_utils.py

Change-Id: I9fdb1efe11ce62c460f380ba1087ed9fc83611ef
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 87880013c9030fdacf477c0b977a8e06f9afbbdf)

Change to logger.error when there is an error in clean_openstack

Change-Id: I753ded0cbbd9982dfa81ff734ae1f1fdeea6f268
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 899f54d9123f6cdc349807dc7fc17fdbc58d2394)

Refactor functest_utils.py

The order of volume type related functions and the error handling changed
to conform general approach used in functest_utils.py.

Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit 09f1b2201aaee2c3deee5936c819089bcc86692b)

Change-Id: I1461380ae0c579e5557bf4bfec4ec68f2766ee40

change for get joid onos ip
(cherry picked from commit 03ec0a88e72ed6c2fdc2995d0c93d2c61f847ae3)

Change-Id: Ic6d420d855615ddf53de707c19771fffaba47bbf

Follow change in joid use SDN_CONTROLLER_IP env var instead of ODL_CONTROLLER_IP

Change-Id: I298cfdfe880c52a18580eb607294cf4c7f353e71
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 73f040dd4998cadfbaa7b0706a441ae6ce6f6ffc)

Merge "Fix promise test output" into stable/brahmaputra

Reduce Rally output

This patch intends to reduce the output of Rally test,
showing only the important information of the tests,
which is the scenario name and the table with results.
Showing the scenario json/yaml is unnecessary since it is
already in the repo.

Change-Id: Iff0ba3fed17212bb4a695c4155747c8aaf683da3
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit b0365d10fda5018721d012602077dddda948a6d9)

Volume type management moved from run_tests.sh to run_rally-cert.py

Change-Id: I80c8b27e041ec5089b816b8515cbc8fa1e8b9eea
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit 9922669c3dd92d43c6e387c8077255153c35b71e)

Fix promise test output

Change-Id: I12bda2e9953228bd0db1810a8a06bfe2e1644ac8
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 9c6eeae44d8e82fb7af2111784474628ec839a46)

Bugfix print arguments in functest_utils.py

Change-Id: I54c94ad43a88732840c0cf915bae42a0cf476e90
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit fd0e23740a75ef749a75431defba50520d79215a)

Print json result file of Promise testcase

JIRA: FUNCTEST-68

Change-Id: Ib89e84b7f4d6f3cfe990655c941705af1da24bfb
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 5c705a0c56af8d622edafa1e99e9806ba627754e)

Remove possible message "No handlers could be found for logger paramiko"

Change-Id: Ib6324b96489551cd88eb1639cb61d38bff898638
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 438a29faf556a9dcc2a304180ce77a32cc748e35)

Option to redirect stderr output to a file for Tempest test

The output when we run Tempest from CI is too long
if there are many tests failing. This patch intends to
show only the test cases that passed/failed within a table.
If troubleshooting is needed, it will be a log file with all
the stderr in it.

Change-Id: If5b0f35463a3dae06a0c177de4dc473bfc4687c5
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 9be6519eca39111295b89e9b3b0d853f95126a72)

Refactor functest_utils.py script

JIRA: FUNCTEST-129

Change-Id: Id5202b1830f7efa77fdb8023d4eeb93775168d29
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit b3b50bef3d0ee76decca7810fbccdbac13ab892c)