Release notes for 3.0

This patch updates the release notes for brahmaputra.3.0.
The results document is also updated with the list of verified scenarios
and limitations.

Change-Id: Ie16ff71e9c3acdb136f57a5e30e5c3d64479b417
Signed-off-by: Ana C <ana.cunha@ericsson.com>
(cherry picked from commit a4a0eeb84629ecc2a0114a99974701e14c3d3af9)

Update links in user guide

Updates to the links for the presentations referred in the text and to ETSI
TST document.
No other changes were done.

Change-Id: I147c359929e3e53ff8039611f96a7409613de798
Signed-off-by: Ana C <ana.cunha@ericsson.com>
(cherry picked from commit 8d376bfbe5802beb6ea3847df94828bb89d55428)

yardstick-verify: Mod yardstick-flavor for ovs scenarios

VMs used with DPDK-enabled OVS must have their memory backed by large pages.

Change-Id: Id685554183a76e8a6024d58920a9a9e187b90e24
Signed-off-by: Billy O'Mahony <billy.o.mahony@intel.com>
Reviewed-by: Ana Cunha <ana.cunha@ericsson.com>
Reviewed-by: Jorgen Karlsson <jorgen.w.karlsson@ericsson.com>
Reviewed-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
Reviewed-by: Daniel Smith <daniel.smith@ericsson.com>
Reviewed-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
Reviewed-by: Mark D. Gray <mark.d.gray@intel.com>
(cherry picked from commit 11a452a34c345abb7d882b151dd99c536f477650)

Update info file

This patch adds two new committers after voting in community and removes
three inactive committers who stepped down.

Change-Id: Id92e834df1343438d39db4acf0b5866b0fc2c28b
Signed-off-by: Ana C <ana.cunha@ericsson.com>
(cherry picked from commit 7e6ed769e0d1e483c4a1906023128758626ab827)

Release notes for Brahmaputra2.0

This change updates the release notes for Brahmaputra2.0.
It also includes minor updates on reuslts report.

Change-Id: Id0b5def1fc2b9b6cd03821bb3d248ecc28c0e06d
Signed-off-by: Ana C <ana.cunha@ericsson.com>
(cherry picked from commit 65e8a633ad5c8ec1f3f3bcfd172a82f2a99ff8cd)

Documentation and results explanation for vTC generic test case

Change-Id: Idff2bc3e857414469a7d9ce42ad8bf1e82f423bf
(cherry picked from commit 45e2326fbdf602734063e60caaab393465ce33b0)

Documentation: Installation and Results for vTC test cases

Change-Id: I6b0d11255b4edfe9fe5070f880ad75ca597e1960
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>

Add Logical view part of SWA

JIRA: -

Change-Id: I64ada7e2ea1b7e668b93ae10c22c7c1c9facf6f7
Signed-off-by: QiLiang <liangqi1@huawei.com>
(cherry picked from commit 2375ac7a7a3f55fd92a7d4307688967107cb1038)

Merge "Deployment View part of SWA" into stable/brahmaputra

Merge "Process Case View Part Of SWA" into stable/brahmaputra

Deployment View part of SWA

this part will shows how yardstick can be deployed into the underlying platform.

Change-Id: Ia24f52fd85056e1ab5718cdf560a4ede7c7aaa69
Signed-off-by: Patrick <shamrock.pang@huawei.com>
(cherry picked from commit 90994a67f2899e0fc046992d07671f1890e530ff)

Process Case View Part Of SWA

this part will show a sequence graph of test execution flow to help users to use yardstick

Change-Id: Ie72ee6da93eb2fbe89f3a121190b6a87d232dfb0
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit a17470a28b597749bbcd8f360eca31bf9e0e822f)

Use Case View Part Of SWA

this part will show some use case to help users to use yardstick

Change-Id: If521bebaff066185ba59ffa5ab35347915818926
Signed-off-by: kubi <jean.gaoliang@huawei.com>
(cherry picked from commit e2876079f91b617bbcfc63b1e75e808319b8cd75)

add software Architecture chapter for user guide

this is a part of SWA, referenced with Per Holmgren's patch(9815).
Because Brahmaputra 2.0 is coming, Qiliang,Patrick,Mingjiang Lin
will work with me together to finish this chapter before doc freeze.

Change-Id: I1e6abe55658671fb1fcc66f2d81b5c2d0b364822
Signed-off-by: kubi <jean.gaoliang@huawei.com>
(cherry picked from commit bf1746e6432e18f17b6d8e890c72c93cd9ac928c)

Set environment variables when running VTC daily

Change-Id: I791434ac5ac263cb12f256414cbc7e07a9a20765
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit 329b808434a04ab1c6e8707f951d754582151acc)

Fix configuration files according to the last working configuration in Montreal testbed

Change-Id: Icd4d56de8bd60b2b4333459ce8669363ba54a33b
Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local>
(cherry picked from commit cd5baa32609687c3ae8acd4b19dbb10cd0bd47ff)

Added a Yardstick test scenario for the OPNFV-Playground development CI pipeline

Change-Id: I6d2e825c1080bb91c8b0f91ab0f37ce66462bcb9
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
(cherry picked from commit 3780f6898ddb91928d4a7c15b8bd032da17822f3)

Change copyright for cover.sh.

Change-Id: Ib342ac40adf5a48aca0269eee1baaf7db2a95135
Signed-off-by: kubi <jean.gaoliang@huawei.com>
(cherry picked from commit 01da7a3f419c342b7cc6c4d5d25bb32eae4ac66b)

Improvement of debug messages to the user

Change-Id: I09fa9cd865021701f53e0df2a2cd79d60ea04d6c
Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local>
(cherry picked from commit 6a4bd2c4bdce07b945ab61e1151e67da99be7489)

Support for port_security extension

Change-Id: I5c513eb4024a3cd35c27e3ba6b9ace92af278432
Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local>
(cherry picked from commit 224c6b9e8e21c1d445cf7f0e506d1e5ace1f9042)

Bug Fix - Fixes the heat template for noisy neighbours and its deployment

Change-Id: I4c45b204a06a728db276a2e4a5f905f3a34f2de5
Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local>
(cherry picked from commit 6b3a3a061aed097fcbc7f0c4dceeabf0f7312122)

Bug Fix - select specific commit for smcroute within the vTC VM

Change-Id: I515c6355546758365346fab5babc3a0810de1f4a
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
(cherry picked from commit 67a0722e9d6de8e9c772ddb4778ab53af9f9c9fd)

Change copyright for dispatchers.

Changed to ceilometer/influxdb-python copyright as lots of concepts
and code have been reused.

JIRA: -

Change-Id: I5fb0a8f9dac2e7b816240f5cf4d43f31f8e1a2f3
Signed-off-by: QiLiang <liangqi1@huawei.com>
(cherry picked from commit 9369e4f06e308735868af960e13e737091bb0bea)

Change copyright for base scenario

Changed to rally copyright as lots of concepts and code have
been reused.

Change-Id: I00d3665fc37634b1ad5f8b2aaca31fffb8fa8942
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit b4ac4870416bbb589e48bf63bddcce4d1307bda9)

Change copyright for runners.

Changed to rally copyright as lots of concepts and code have
been reused.

Change-Id: Id850b94c9ad05a075614870b293456f2d5fb6e5f
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit 3be4620ca48858e8a0cb38b61b6c5bbb45f96472)

Add missing dependencies to docker file

Change-Id: I51e198e5992cc52070b9ddddad59a123d1c476fd
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit 7243bac5aa0069140055aebcfbeaa271abf1ea6a)

Update setup.py and dependencies

Fixes dependency problem with python-openstackclient
Freezes requirements to use latest/current upstream versions

Yardstick can be installed with:

$ python setup.py install

or with:

$ easy_install -U pip
$ pip install -r ci/requirements.txt
$ pip install .      (or for develop mode: pip install -e .)

if fixed package versions are required

Change-Id: I9cb44d29011509c9c388dc2e7dc8bb60ee25e790
JIRA:-
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit bce1f77ef610e3e7997a547704c96cfbdc544cc1)

support os+odl for ipv6

As we known, the network of os+odl scenario is still not available.
so this patch still need to do more debug work.
however, Jan 19th is code freeze day, i think a good way is to merge it at first
when os+odl become available, i will do rest debug work and fix it

Change-Id: I518f759069e74d2e57e40b52dfecaef4b4d26a02
Signed-off-by: kubi <jean.gaoliang@huawei.com>
(cherry picked from commit 3717375b27980ec55fe54f23077d01e51f130b6f)

update ipv6 test case user guide

add more introduce into ipv6 test case of user guide
JIRA:-
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Change-Id: I96e78d6bf5553bb53ba1837d45126726981c9d42
Signed-off-by: kubi <jean.gaoliang@huawei.com>
(cherry picked from commit 8c3fa589cb56c461fd8f9f475b804f96dae7e72b)

Adds test results for scenario: fuel_os_nosdn_nofeature_ha

All scenario TCs included, except TC011 which has had
an InfluxDB population problem. This is now solved but too
late to run with scenario in R2 release time frame.

Change-Id: I0eefa9b3599e7813ec8b21df863d885766cae4d0
Signed-off-by: Per Holmgren <per.q.holmgren@ericsson.com>
(cherry picked from commit f3213f3a7590559c8a88e248768a120ebd309180)

Adds test scenario result report: fuel-os-odl_l2-nofeature-ha

Change-Id: I2574411fe5ac670851ea9d1be5ba5f2da5defb17
Signed-off-by: Per Holmgren <per.q.holmgren@ericsson.com>
(cherry picked from commit d2aeb85b86a4814aefc8c05ebfee41d5f2416e67)

Adds test results for scenario: fuel_os_onos_nofeature_ha

All scenario TCs included, except TC011 which has had an
InfluxDB population problem. This is now solved but too
late to run with scenario in R2 release time frame.

Change-Id: I341bd4109baf14069b6241f37da4c62da4cad394
Signed-off-by: Per Holmgren <per.q.holmgren@ericsson.com>
(cherry picked from commit 401b2497ec380fdfcb3f6a494775a6e5005050f4)

Test results for apex and joid

Adds test results for apex-odl-l2 and joid-odl-l2 scenarios.

Change-Id: I76869112a8225ff33d19cde179b2e6ca7e988fd4
Signed-off-by: Ana C <ana.cunha@ericsson.com>
(cherry picked from commit 19e624d300a77f4176aa465bda34f63012bb199d)

Test results for compass onos and odl l2

Add short summary for tests using compass, scenarios onos and odl l2.

Change-Id: I1f1f0ba4f2aeae4e656ae9a6d06fbd948da41424
Signed-off-by: Ana C <ana.cunha@ericsson.com>
(cherry picked from commit 4f0587c254767a38c96e25f1f53bc2d64684df96)

add test result: compass_os_nosdn_nofeature_ha

Reference to PerH's patch, modify the real value of
every test case, and add two more test cases about ipv6 and parser.
All scenario TCs included, except TC011 which has had an InfluxDB
population problem. this is now solved but too late to run with scenario
in R2 release time frame

JIRA:-
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Change-Id: Ic58613b6bdf45de449ca3f0c381d716f0c03a736
Signed-off-by: kubi <jean.gaoliang@huawei.com>
(cherry picked from commit 19155bef2e194d93efb0fb30929335afbedbaa8d)

Test Result of TC019 and TC025

JIRA: None

Change-Id: I425f957dade4bdb3bffe2f6c172fa6c3b68ce382
Signed-off-by: wym_libra <yimin.wang@huawei.com>
(cherry picked from commit 6640a2ca7cc319e4b9957f074fd2f93eba649856)

Add Yardstick release note

This change adds Brahmaputra release note for Yardstick, listing
deliverables.

Test results for the release and scenarios will be documented separately.

Test cases for vTC have been removed, will be delivered in SR1.

Change-Id: Ia9575249c8155d5a417722a8a1e89102e942784f
Signed-off-by: Ana C <ana.cunha@ericsson.com>
(cherry picked from commit bc9a7228aa3f880393eabca2b906cd9b3798536a)

Release results overview

This change includes the list of scenarios tested for the release.

Change-Id: Id1e6a07378560e7b88cabde16caca0fcc26544dc
Signed-off-by: Ana C <ana.cunha@ericsson.com>
(cherry picked from commit 80c3834806e1a34b364e46f50230fb296709f48a)

Merge "iperf3: fix for influxDb schema errors" into stable/brahmaputra

iperf3: fix for influxDb schema errors

Convert integers to float before dumping to influxDb.

Iperf3 is not always consistent about data types in its
JSON output. This may cause schema errors when values with
different types (integer and float) are written to the same
field in InfluxDb.

This is a quick fix. A Future improvement would be to write a
format func for the data.

Change-Id: I7011adc19693f91db5889554fd6bec0d46dc6679
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>

ipv6-bug-fix: update physical pod yaml configure

due to the configure of huawei sc physical pod has been changed, ipv6 testing failed,
so i update the pod.yaml in yardstick to make it run successfully again

JIRA: YARDSTICK-186

Signed-off-by: kubi <jean.gaoliang@huawei.com>
(cherry picked from commit 790e54ca0806f4b826fbe77f260f1b3127324507)

Change-Id: I883608e49aec5805a41ce20085504aebb0999eb9

Altering the name to ensure it is included in the configuration guide and not drawn into the user guide.

Change-Id: I51f91b4ac94a869bd00bc7ded18ec1df78a4c073
Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
(cherry picked from commit 8c64f4d1ff0dcead041be066fce22ce90b7f7d91)

Add missing license files

This change adds missing license information.

Change-Id: I2ddc85e3fb7b92a86b8a0f054d4ee177af198c8f
Signed-off-by: Ana C <ana.cunha@ericsson.com>
(cherry picked from commit 555e5730514a36ec91eb7e1f944f7c427dec3b93)

influxdb: log error when result posting fails

Change-Id: I628e3919af56586a481708cb97ac4e38b7ccc5fa
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit eaf476bd9a780de256c4cab37cc3632b14bafec3)

Results for Yardstick test cases

This change adds folder Results and templates for all scenarios as well as
tests not included in scenarios.

Change-Id: I2e93cd12e9af9ac8c3717515339e2c7687ef1943
Signed-off-by: Ana C <ana.cunha@ericsson.com>
(cherry picked from commit a3fc6bb48c4a77fcd495f99b7bf4d3bc0e11dcf3)

Yardstick input for Release central doc

This change adds a file, userguide.rst, that will be used by the release
central document as a summary of the Yardstick Project.

This file shall not be included in the index of the userguide.

The file has been renamed to testusage.rst, as per request.

Change-Id: Id8099349a7e626be3d800499bf98171d23239ded
Signed-off-by: Ana C <ana.cunha@ericsson.com>
(cherry picked from commit 3bcd8816da2d38f5c0d3c4358a47aac2ac19f873)

Add heat template workaround for odl-l3

Change-Id: I476fdd4d0e0e97cb1457ae15f92442c42aa77b4e
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit c3949144ecd32e7152ba89a45795d7ca401d5d50)

ci: Freeze pip requirements + cleanups

Freeze pip requirements for brahmaputra release to make sure we
keep track of dependencies.

Fixes internalURL problem with ericsson-virtual1

Add check to verify that nova, glance and heat services are functional

Change-Id: I15c3d215596eaad31f8e260d129b8e07a7d63976
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit 3b7c8d522d1ef0950d5c79232e161de05689fe53)

Add test suite for ericsson-virtual1 blade

Change-Id: I6c22a32fd3197a5475ee4f41db946bd78b08dfa0
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
(cherry picked from commit 2fb2e9e9dc63707fa714af5bea6dce8e829cad9b)

Add more debug to image build

Change-Id: Icfbed0433cb9cfb6f8f479fc69699d08ad49602b
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit 9de7358215ca6e3f0b394bacdd97f1e2b119b4b4)

Add license info and update structure

This change adds license to all .rst files under userguide.
It also combines all configguide files into user guide.
New reference.rst with list of links.
Updated glossary, removed separate directories for apexlake and yardstick
framework.

Change-Id: I6532ed073905b0fa85a17e759ea7dc3c24acb91f
Signed-off-by: Ana C <ana.cunha@ericsson.com>
(cherry picked from commit 702eebbf78b29fb9046436dd71575b4f210f4731)

Updated install requirements

Change-Id: I594eb3fc976bc65a9fa01e48a805c3564ad3a5f3
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit fd3dd37a734a741a823962dbc646480ece70b3bb)

Revert "Test: Workaround for ODL Lithium"

This reverts commit 4be7c4c3960e941ce6fad82acd4572a5b96fb5c4.

Change-Id: I4f949f2773703bb045662fd5b0be209e39d1e0a4

Add influxdb credentials.

This is temporary!!!!!

Credentials should be moved to a more secure place.

Change-Id: Ifc0985aa58bb9fc861e0974e54d7ec34eb445a43
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit 21e49fe80a862c8f6c11348a648ec69f6d9b1859)

Add deploy scenario tag to influxdb measurements

Change-Id: I7e303f8445e4910074fcae6e48f142fa7b61923c
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit 97edfb00e78ddae222bc1024eb908b3751bebbc9)

yardstick image build cleanups

 - reduce progress verbosity when downloading with wget
 - added some debug printouts for trouble shooting
   mount issues

Change-Id: Ic608f847b0fe74df231ce3d7d419dcf6c19807ed
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit 9639677d22a1434387dca1242ec9afbfcff81a0a)

bug fix: wrong POD name used in result dispatchers

Change-Id: I04a300b3478dd075208f9c904dcb281d74089344
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit 84a5fd5cea31dd957fb1d0283144306e20d8e97b)

bug fix: huawei sc lab  virtual pod task fail

opnfv_yardstick_tc027.yaml 's configure file is written for physical pod

it shouldn't be added into virtual pod task, so remove it. otherwise, task will failed

Change-Id: Ic2f03c6522cace32426a7aade1da56ed2c1766d1
Signed-off-by: kubi <jean.gaoliang@huawei.com>
(cherry picked from commit ab99b83b03f3583c51c03fc821d48b77e2bd2273)

add precondition check

as we discussed yersterday, for daily jenkins task,
i have a new idea, i add a precondition check and a key parameter in test case,
if environment info(eg. "DEPLOY_SCENARIO") meet the preconditon which was defined in test case ,
this test case will run, if not meet, this test case will skip.

and default is allow all test case to run, so this patch will not influence existing test case.
any comments are welcomed

Change-Id: I4300ac58994d51c0ddb4dd6d58b7191f796ddcee
Signed-off-by: kubi <jean.gaoliang@huawei.com>
(cherry picked from commit ff5cb9501b155e07fe75f03062217270b9745131)

Test: Workaround for ODL Lithium

Change-Id: I9db7f95beb618e2a3125b5252a79bf1a400b6af1
(cherry picked from commit 912fe3bb9877456cb8ef363f9304bfab733eaffd)

bug fix : git clone yardstick repo failed

line45: git clone YARDSTICK_REPO $YARDSTICK_REPO_DIR fail

Change-Id: I7f2973b320a30a02264b3f65fb3e1397218a5d9a
Signed-off-by: kubi <jean.gaoliang@huawei.com>
(cherry picked from commit 115bd363930d3c3c254369b1f5307abaf95cec28)

Add test suites for huawei lab virtual deploy

JIRA: -

Change-Id: Ibc44bf11fb8bef4878ec57187877624a557f9937
Signed-off-by: QiLiang <liangqi1@huawei.com>
(cherry picked from commit 556a2f2226391043eee47acb5163adfc8342e157)

Service Function Chaining test cases

Change-Id: Id4c8b1bc05e768bdb2b8f17798f13f4d83dcd9d6
Signed-off-by: Ricardo Noriega <ricardo.noriega.de.soto@ericsson.com>
(cherry picked from commit 805aaa50d226e8c91b69af0252aef68eda1551c3)

Add directory for code documentation

This change adds a folder for yardstick code documentation under docs,
apidocs. An index.rst  file is added, and a modules.rst to list the
modules.
The documentation will be automatically generated from code docstrings,
using sphinx autodoc directive.

JIRA:YARDSTICK-161

Change-Id: I56ff1904c319a00352842be5ba7bb0cb52bbc3d6
Signed-off-by: Ana C <ana.cunha@ericsson.com>
(cherry picked from commit f879c91a15dfd0de24367dd098c8c796851f9769)

Add debug info to solve image build errors

Add more debug output and clear devmap table in order to
solve build problems in YARDSTICK-226.

Change-Id: Idfdbb925501c8debb67406f2dd316e1d4bfbaaa8
JIRA: YARDSTICK-226
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit 8f6ecefac63f58bc988bc82ecc5247ec98a13d6e)

License for PCAP files

Change-Id: Id2fdedf56099200b59392b5b337fcdde502d5f3a
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
(cherry picked from commit df0a57d1ca51d67b929f5b7b31b3f3e164914093)

Add test suite for huawei lab virtual deploy

JIRA: -

Change-Id: I0cd58a2acb0a2a55431eebd6b4adcde95d50d7bc
Signed-off-by: QiLiang <liangqi1@huawei.com>
(cherry picked from commit 22e55a637eb9fe70fbb378494242f5f6f196f3c0)

Revert "Test: Workaround for ODL scenarios"

This reverts commit e1d2d085b04dd3e6bbed0aede1cc5487b2916193.

Change-Id: If2dd6586e34956b43f87da82e79231f62c441a73

Test: Workaround for ODL scenarios

Temporarily removing security group from generated heat template.

This patch is pushed through for testing purposes and should be
reverted when a proper solution is found.

Change-Id: I64c86f41664499d46d8317bb1ebbe304083554ab
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit 8236c94ecef8aa25af073c50f7a0eaafae9b4bc6)

InfluxDB add authentication support

JIRA: YARDSTICK-212

Change-Id: I6b669800160268db70b5c9e43cbbc053576ec4b5
Signed-off-by: QiLiang <liangqi1@huawei.com>
(cherry picked from commit 20b3b5fa5e1ecd8a6b68980d365f82034f69df6d)

fix some  missing license file

fix .coveragerc, etc/yardstick/nodes/pod.yaml.sample
etc/yardstick/yardstick.conf.sample

Change-Id: Iece74c80316202fb000dda0ea2b3f8fdb6fe5eb8
Signed-off-by: kubi <jean.gaoliang@huawei.com>

Add license to files for Apex Lake directory

Change-Id: I25978755d4ec705d01eeb78c2d8e91e45e556011
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
(cherry picked from commit 7cefb860a55a4c3c72247cc80eb512f348debf82)

Add apexlake CI script

Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
Change-Id: I5dcd45692938afddadbf17650c96fddf1f99dce7
(cherry picked from commit 9a3fa8bde1e8a82796fd05c8a40b1fbb8eca60c6)

Influxdb change tc as measurement

Add host and taget tags (initially for cpuload scenario to
                         identify  where the test run)

JIRA: YARDSTICK-212

Change-Id: I895bd435ec4a5e036e5ae2dc965df23ccfa6bf24
Signed-off-by: QiLiang <liangqi1@huawei.com>
(cherry picked from commit 2c62f3d7fd73e64bf2a3be2d1741a57bedefb726)

Move the test case of TC025 to the test cases folder

Change-Id: Ia3760a4fcc17f810940240d1778939333e8ffdc6
Signed-off-by: wym_libra <yimin.wang@huawei.com>
(cherry picked from commit c8ea364de2f2d7bb4703f4beb86897c23dc88c39)

Fix EXTERNAL_NETWORK for joid

Change-Id: I31c932a9098933fe139c28a65c3989a0014d0f8d
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit 31419c67b8737dcea4768627b3ebf11f68e5e2bc)

Fix Apexlake Documentation

Change-Id: If9519d1660fe21bc13307ce35711424c6e2b8176
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
(cherry picked from commit 19caefaa3505a67bea77cf082168f29cbcf41ba9)

Create weekly Jenkins Job for Yardstick run in Huawei lab in Santa Clara

Test Case 040 :parser is added into weekly yaml
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Change-Id: I0cb4a9e273b5cac55b9a7a278ea17b1ad78d1ac6

HttpDispatcher case_name value update

See details on https://etherpad.opnfv.org/p/yardstick_release_b_troubleshooting
section Questions 6.1

Change-Id: I72268c827a2321859c405f45b7e1e475c0ffb4a0
Signed-off-by: QiLiang <liangqi1@huawei.com>
(cherry picked from commit 625a6dac381a35a0c12cab0cfd21146844778aaa)

Fixed documentation for ApexLake

Integration of ApexLake documentation into the main docs directory

Change-Id: I3398acc16cc2ff4bb039783fc5bcb6a10afda4e1
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
(cherry picked from commit 58f3b57faedfda7033383b5807fb6553acaa6a2f)

modify sc lab pod yaml as real configure

Change-Id: I6587794b7206cb3d5f13b6c448670d1c97ecd596
Signed-off-by: kubi <jean.gaoliang@huawei.com>
(cherry picked from commit cfbefd9ad48e07a1890e022e94cbae117e04f87a)

enable ipv6 test case in sc lab

Change-Id: I4609fcb4427413fd6cde435f7bd062c9dde61949
Signed-off-by: kubi <jean.gaoliang@huawei.com>

Update test suite files.

Added TC 10, 11 and 14.
Removed TC 1 as it is already included in TC 37

Change-Id: Iea483c4a26c657984769400f2949ca300c2504bd
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit 2a2ebe6b1ea2ff317f4a3ca6a8e8fab811350eae)

Dump test result when test finished

JIRA: -

Change-Id: I8712f1c4a0a063bdf7ba6a425015dea894c34d16
Signed-off-by: QiLiang <liangqi1@huawei.com>
(cherry picked from commit 261e3fe02d803fd6476a4af56dea32a29094923b)

fix some bug in ipv6 to make it run in ci

JIRA:YARDSTICK-187

Change-Id: Ia15d17afdef145f7b230a8a4d25a61eed5cdfd76
Signed-off-by: kubi <jean.gaoliang@huawei.com>

Adds desription for TC024, the CPU load/mpstat test case

Change-Id: Ifbc571e3e216349d065ac21df1a3f10fe94d4e9a
JIRA: -
(cherry picked from commit bb82fb8c9198d6e792b8558bf6eaf4f53710c7fe)

Correct some typos

Change-Id: Ia9fd31580ff75663514aebbb46a8b87021cb01de
Signed-off-by: wym_libra <yimin.wang@huawei.com>
(cherry picked from commit 9028f681b95ca213f6702536cf740f07490e4b45)

Add test case description and task file for TC011

Add test case description for Packet delay variation between VMs (TC011)
and test case .yaml task file.

** Please note that the SLA value has not yet been determined. **

Change-Id: I68a374224946d46c173ad477c14cb79d573b1eee
Signed-off-by: wym_libra <yimin.wang@huawei.com>
(cherry picked from commit 09c6f91228759e22a08bd9344962d65c1818e6b3)

HeatContext model update to match heat code update

In Heat Liberty release OS::Nova::Server will always use the user
pre-configured in the image (e.g. "fedora" for stock Fedora cloud
images, "ubuntu" for stock Ubuntu cloud images, "cloud-user" for
stock CentOS cloud images etc)

Change all ec2-user -> ubuntu

Add admin-user in Heat model for backwards compatibility.

Refer below links for detalis:
https://etherpad.opnfv.org/p/yardstick_release_b_troubleshooting
https://github.com/openstack/heat/commit/e423bec7f10b0f5d07f05d195b3b7860f6bceb00
http://blog.scottlowe.org/2015/04/23/ubuntu-openstack-heat-cloud-init/

JIRA: -

Change-Id: I6b8b2b21daf113a3a86aee1126b0c3e74737ef4f
Signed-off-by: QiLiang <liangqi1@huawei.com>
(cherry picked from commit 9d36842e3966185e97cc5732aa7a0edd2050bfe2)

Update results for Test Cases 6, 7, 20, 21

JIRA: YARDSTICK-219

Change-Id: I06143f074592e05cd17b740eb9751414a56c9fde
Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com>
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
(cherry picked from commit 9b8b765373abbb10289415312a24574ff122541a)

Add test suite for Orange POD2

Change-Id: I667a54793be39c74a9f787b055b07fda9b2ba06c
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit a6415b5199936de2eb247a26f18e47a368b82afa)

Add template for test results report

This change is a proposal for a report for yardstick test case reesults.
One report for all the executed tests, summarizing the results and the
labs where the tests were executed.

JIRA: -

Change-Id: I7cdfdc82d6ee07d2b9da426f33ce34b86362b5b4
Signed-off-by: Ana C <ana.cunha@ericsson.com>
(cherry picked from commit 3871a2c4f61b1da9a8512135bf0cf6e9e35d7e8d)

Fix small bugs for running Apexlake on Montreal testbed

JIRA: YARDSTICK-219

Change-Id: I5f403e6c922f5e6ea790dc9cdb589cbc98e66ded
Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local>
(cherry picked from commit 174560a6b7d4a23763564fcfc87c2dd7e60aa241)

ci: add influxdb target options

Change-Id: I50cbbf4d2fe59d688a4951cc8bec3362b098adcb
JIRA:-
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit 55f7c41c927320a3dac5a0907ebf66647aafd8a8)

Fix flake8 errors

Change-Id: I14f21092f5e97abf0629a92a27062846a6d3130b
JIRA:-
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
(cherry picked from commit 791323df72d8bf4f4f4c32a1e7273721f2adc349)

Fix minor format details in tc descriptions

This change fixes minor formating in TC025, remove one extra line in TC028
and update 03-list-of-tcs.

The formating caused the pdf to fail.

Change-Id: I304335277b1fbc33b10d9a07245ebeef0612fc80
Signed-off-by: Ana C <ana.cunha@ericsson.com>
(cherry picked from commit 5c4c8667e0c0a8e039d7682f235b022f39149d56)

Rename tc019/tc025 & fix description for tc005

Added tc019 and tc025 to index of test cases in 03-list-of-tcs.

JIRA: -

Change-Id: I02696dc408d2d5c20becba29c49b3cff2a7049a9
Signed-off-by: QiLiang <liangqi1@huawei.com>
(cherry picked from commit 25095fb4e6d6a0e71581eee18f50c7d61f6a270d)

Add test case description for TC028-kvm

JIRA: YARDSTICK-188

Change-Id: I16f8c5ac3a3997640ce96a77984c4dbe9ccb2804
Signed-off-by: QiLiang <liangqi1@huawei.com>
(cherry picked from commit ef353b91b2527580a642da561a387d67b71e753d)

Add test case description and task file for TC025

Add test case description for HA of OpenStack Controll Node abnormally
shutdown (TC025) and the sample  .yaml task file.

** Please note that the SLA value has not yet been determined. **

JIRA: YARDSTICK-135

Change-Id: I70f1afb0c9cfa5446aac08b7b13e543a9ec20898
Signed-off-by: wym_libra <yimin.wang@huawei.com>
(cherry picked from commit 83d895e535b700790497429ac6cbd46fb0fef9e5)

Add test case description and task file for TC019

Add test case description for Control node-OpenStack service down (TC019)
and test case .yaml task file.

** Please note that the SLA value has not yet been determined. **

JIRA: YARDSTICK-135

Change-Id: Id512159034929dc197d2c7fdf6cc672ecddfb996
Signed-off-by: wym_libra <yimin.wang@huawei.com>
(cherry picked from commit 32b39d0f576dc5c71678fd0b6b8feab6f2173939)