functest.git
7 years agoAdd Danube 2.0 reporting status 57/34357/1 danube.2.0 danube.2.RC1
Morgan Richomme [Fri, 5 May 2017 09:19:15 +0000 (11:19 +0200)]
Add Danube 2.0 reporting status

Change-Id: Icc09b824a4e7906dfab031b679ba3d0aa86ab0cd
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 94807a8c352cf49df156f7f50f2a21df7ba34115)

7 years agoMerge "Release notes for Danube 2.0" into stable/danube
Jose Lausuch [Fri, 5 May 2017 09:21:07 +0000 (09:21 +0000)]
Merge "Release notes for Danube 2.0" into stable/danube

7 years agoRelease notes for Danube 2.0 71/34171/3
jose.lausuch [Wed, 3 May 2017 20:11:17 +0000 (22:11 +0200)]
Release notes for Danube 2.0

Change-Id: Ibe121dad771f0df36ffa15ec13d637b835cf09a8
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
7 years agorefstack-client userguide 09/34209/1
MatthewLi [Thu, 6 Apr 2017 08:26:37 +0000 (04:26 -0400)]
refstack-client userguide

JIRA: FUNCTEST-758

container setup steps are skipped, since they already
included in the functest userguide documents.

Change-Id: I729d4c3174b03706624a7235da24cb3043b28c2c
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
(cherry picked from commit 11826f38829dd5952830d6d2e50ac4918be528f1)

7 years agoBugfixing the testcases execusion 59/33859/2
Nikolas Hermanns [Fri, 7 Apr 2017 08:55:26 +0000 (10:55 +0200)]
Bugfixing the testcases execusion

tempest.api.compute.servers.test_server_actions\
.ServerActionsTestJSON.test_reboot_server_hard
is working in fuel so do test it.

The "-" was missing on
tempest.scenario.test_server_basic_ops
.TestServerBasicOps.test_server_basic_ops

Change-Id: I6808ce9283271e2d2f8acf7c2587aed006d1cbc2
Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
(cherry picked from commit f85b54b8fc8843897f9c1a7b4711b489ab29f297)

7 years agoFix the irc channel 21/33421/1
Cédric Ollivier [Mon, 17 Apr 2017 08:58:25 +0000 (10:58 +0200)]
Fix the irc channel

Change-Id: Idb446213274b7dfb03b0ee072717a35e03428609
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoFix .gitreview in stable/danube 19/33419/1
Cédric Ollivier [Mon, 17 Apr 2017 09:04:14 +0000 (11:04 +0200)]
Fix .gitreview in stable/danube

Change-Id: Ice94ed01903458296b6777fe6145a9fa871211bf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoIncrease ram for tempest tests (aarch64) 03/33103/1
Cristina Pauna [Wed, 5 Apr 2017 14:13:49 +0000 (17:13 +0300)]
Increase ram for tempest tests (aarch64)

The following tests fail on armband because the VM cannot boot.
tempest.api.compute.servers.test_server_actions.
ServerActionsTestJSON.test_reboot_server_hard

tempest.scenario.test_network_basic_ops.
TestNetworkBasicOps.test_network_basic_ops

tempest.scenario.test_volume_boot_pattern.
TestVolumeBootPattern.test_volume_boot_pattern

tempest.scenario.test_volume_boot_pattern.
TestVolumeBootPatternV2.test_volume_boot_pattern

The reason for the failure is that the 128 ram is insufficient for the
image to boot. The fix consists in increasing the ram to 256

JIRA: ARMBAND-61

Change-Id: I5be1a44a8038b4952cca100511e8d08b7a37681c
Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
(cherry picked from commit 5a417f076549941e0dae176849045aab32bf0be5)

7 years agoBackup of reporting status for Danube 1.0 91/32791/1 danube.1.0 danube.1.RC1
Morgan Richomme [Fri, 31 Mar 2017 13:13:32 +0000 (15:13 +0200)]
Backup of reporting status for Danube 1.0

- reporting html pages for apex, compass, fuel and joid
- text file with history of Danube scenarios
- text file of validated Danube scenarios (100% in functest)

Change-Id: If5585acc5bf56406c0c92e8b132157ed742244f1
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 3a625a5f4b176147e288dbee01734a666a25e34f)

7 years agoMerge "Adding label for userguide" into stable/danube
Jose Lausuch [Fri, 31 Mar 2017 07:58:07 +0000 (07:58 +0000)]
Merge "Adding label for userguide" into stable/danube

7 years agoAdding label for userguide 21/32721/1
ShubhamRathi [Fri, 31 Mar 2017 07:04:55 +0000 (12:34 +0530)]
Adding label for userguide

Change-Id: Iaab305c913173594ee2d857255b6492d15f15916
Signed-off-by: ShubhamRathi <shubhamiiitbackup@gmail.com>
(cherry picked from commit 9e1dba02a3e545fb6c3d28fa6478b01ece36647c)

7 years agoMake tempest cleanup resources after running 17/32717/1
Linda Wang [Thu, 30 Mar 2017 08:14:16 +0000 (08:14 +0000)]
Make tempest cleanup resources after running

JIRA: FUNCTEST-773

1. When running refstack_defcore, create tenant and user failed due to conflict
   with those created when runnning tempest_smoke_serial.
2. Clean all resources created for tempest_smoke_serial.

Change-Id: Icf8ec95f6db0b2f93bf6c56ec10a6e8ea1a91ab1
Signed-off-by: Linda Wang <wangwulin@huawei.com>
(cherry picked from commit f94a1744e7a4d3a48466b6171a205e1ed84026d7)

7 years agoMerge "Check a rule existence for a specific security group" into stable/danube
Jose Lausuch [Thu, 30 Mar 2017 14:58:15 +0000 (14:58 +0000)]
Merge "Check a rule existence for a specific security group" into stable/danube

7 years agoMerge "Re-enable rally and tempest full for weekly" into stable/danube
Jose Lausuch [Thu, 30 Mar 2017 14:58:06 +0000 (14:58 +0000)]
Merge "Re-enable rally and tempest full for weekly" into stable/danube

7 years agoCheck a rule existence for a specific security group 27/32527/1
tomsou [Mon, 27 Mar 2017 15:56:02 +0000 (15:56 +0000)]
Check a rule existence for a specific security group

    Implement a functionality to check if a rule concerning
    a specific security group exists
    - function get_security_group_rules(neutron_client, sg_id)
      returns the list of the security rules for a specific security group
    - function check_security_group_rules(neutron_client,
                                          sg_id, direction,
                                          protocol,
                                          port_min=None,
                                          port_max=None)
      checks if a specific rule for a specific security group exists
      and returns True or False
    - implement unit tests for the two new functions

     This new functionality is needed for sdnvpn project

Change-Id: Ib930bc9a76141932f4164d88e2640b49f3df4d77
Signed-off-by: tomsou <soth@intracom-telecom.com>
(cherry picked from commit 41b103d9a6804a97ca85e2b09b628cea06219faf)

7 years agoMerge "Release notes for Danube 1.0" into stable/danube
Jose Lausuch [Thu, 30 Mar 2017 14:50:32 +0000 (14:50 +0000)]
Merge "Release notes for Danube 1.0" into stable/danube

7 years agoRe-enable rally and tempest full for weekly 25/32525/1
jose.lausuch [Thu, 30 Mar 2017 09:47:54 +0000 (11:47 +0200)]
Re-enable rally and tempest full for weekly

Change-Id: I640531ebcc471adebe780c75627d822cf8fd956d
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 6c9981cf03127c847481235e2b26377ecd108c2d)

7 years agoUpgrade to the latest kingbird version 93/32493/1
Dimitri Mazmanov [Thu, 30 Mar 2017 10:56:25 +0000 (12:56 +0200)]
Upgrade to the latest kingbird version

Change-Id: I80015fa05811f11c2c62e4c87f6008bea279fbf7
Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
(cherry picked from commit 251b25f7dc3a42d3717e696a164a92510e21cb38)

7 years agoRelease notes for Danube 1.0 35/32435/1
jose.lausuch [Wed, 29 Mar 2017 15:57:42 +0000 (17:57 +0200)]
Release notes for Danube 1.0

JIRA: FUNCTEST-562

Change-Id: I1e2c827bad7c924561bbe433dac97c096282024d
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit b59f2b7f4d2f9aac185ff043c8b9cdad410ef966)

7 years agoMerge "Clean up Tempest blacklist" into stable/danube
Jose Lausuch [Thu, 30 Mar 2017 07:51:16 +0000 (07:51 +0000)]
Merge "Clean up Tempest blacklist" into stable/danube

7 years agoClean up Tempest blacklist 97/32397/1
jose.lausuch [Wed, 29 Mar 2017 22:30:21 +0000 (00:30 +0200)]
Clean up Tempest blacklist

This list has been generated in Colorado and there are
some scenarios that are deprecated and there is no
need to list them here.

Change-Id: I62a30b5026ed1df65ebdb7a68a6acf3364469865
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 69de5300f0a5b75aed99a24a809f852498dc0695)

7 years agoDisable tempest server reboot test for SDNVPN and Gluon 93/32393/1
Georg Kunz [Wed, 29 Mar 2017 09:00:50 +0000 (11:00 +0200)]
Disable tempest server reboot test for SDNVPN and Gluon

Bug report: https://bugs.opendaylight.org/show_bug.cgi?id=5586
As a result, floating IPs are not working in Apex at the moment.

Change-Id: I437c10b53dc01810ed757f040d3378c92320274b
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
(cherry picked from commit 9fba4aed6b8f2ef1c939498d866f2cae57b89246)

7 years agoRevert "Make SFC test a python call to main()" 37/32037/1
George Paraskevopoulos [Tue, 28 Mar 2017 09:27:22 +0000 (12:27 +0300)]
Revert "Make SFC test a python call to main()"

This reverts commit d5820bef80ea4bdb871380dbfe41db12290fc5f8.

Robot test runs before SFC test and it imports
https://github.com/robotframework/SSHLibrary
which does a monkey patching in
the python runtime / paramiko.
Untill now sfc run in a new python process (clean)
because it run using the bash command.
But when importing it as a module and call main()
from python, it will run in the patched runtime
and it will error out.
https://hastebin.com/iyobuxutib.py

Change-Id: I54237c32c957718b363d302efe84e01bc78e4f47
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
(cherry picked from commit e59055e29b5cc6a027d3a24803cc05fd709cca90)

7 years agoRemove vping_ssh from bgpvpn and gluon scenario 03/32003/1
Nikolas Hermanns [Mon, 27 Mar 2017 16:15:01 +0000 (18:15 +0200)]
Remove vping_ssh from bgpvpn and gluon scenario

Cause of the bug:
https://bugs.opendaylight.org/show_bug.cgi?id=5586
Floating ip is not working at the moment for us.

We don't want to remove the vping_ssh test from
fuel. the scenarios are called different in fuel and
in apex. odl-bgpvpn in apex. odl_l2-bgpvpn in fuel.

Change-Id: Iaa2e6cea8a4fdb8635f018427aaf30634fd8d2d5
Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
(cherry picked from commit 5af67bcca589c275b73fe5e4bca9bea5871948aa)

7 years agoMerge "Fix pylint warnings in test_testcase_base" into stable/danube
Cedric Ollivier [Mon, 27 Mar 2017 12:00:55 +0000 (12:00 +0000)]
Merge "Fix pylint warnings in test_testcase_base" into stable/danube

7 years agoChanging project name of vRouter 93/31893/1
ShuyaNakama [Mon, 27 Mar 2017 09:15:43 +0000 (18:15 +0900)]
Changing project name of vRouter

JIRA: FUNCTEST-769

 When pushing result to DB in vRouter module an error occurred.
 couse is wrong project name.
 We changed project name from "vRouter" to "functest".

Change-Id: I8b8289b48330b17b6d6620524024dea4f488e38a
Signed-off-by: Shuya Nakama <shuya.nakama@okinawaopenlabs.org>
(cherry picked from commit 9439d684449825f8d580c26b1b9475ccbdde698a)

7 years agoFix pylint warnings in test_testcase_base 63/31863/1
Cédric Ollivier [Sun, 26 Mar 2017 10:08:32 +0000 (12:08 +0200)]
Fix pylint warnings in test_testcase_base

It takes into account the following warnings:
  - wrong-import-order
  - no-value-for-parameter

The 'no-value-for-parameter' warnings are false positive. The added
default values are useless but avoid them.

Change-Id: I50d0af178d9da668a3c72e75f5af467d36ca0e6a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e7440f39c66121cf915f156897c0a7d0e2af2951)

7 years agoFix pylint warnings in testcase_base 53/31853/1
Cédric Ollivier [Sun, 26 Mar 2017 09:55:10 +0000 (11:55 +0200)]
Fix pylint warnings in testcase_base

It takes into account the following warnings:
  - bare-except
  - unused-argument
  - broad-except

Change-Id: I3a50bf6d07823edc80a7f0f78f46681ace7f4a39
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e4d7506a5a21550a89f897dfaea3f0dcae352e5b)

7 years agoUpdate documentation for Danube 51/31851/1
Morgan Richomme [Fri, 17 Mar 2017 16:40:12 +0000 (17:40 +0100)]
Update documentation for Danube

JIRA: FUNCTEST-559
JIRA: FUNCTEST-560

Change-Id: I2104a9b68bb3985c9f5900ebc30bab89b09b7835
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 19f9f2a99641cca98b896aa975a2182c43ba7f97)

7 years agoMerge "Change api version" into stable/danube
Jose Lausuch [Sat, 25 Mar 2017 15:39:32 +0000 (15:39 +0000)]
Merge "Change api version" into stable/danube

7 years agoPrinting the flavor_metadata for SnapsTestRunner 73/31773/1
randyl [Fri, 24 Mar 2017 14:51:35 +0000 (08:51 -0600)]
Printing the flavor_metadata for SnapsTestRunner

Need to print what is being tested to debug and
verify results.

JIRA : FUNCTEST-768

This is needed by the Apex team for the danube release.

Change-Id: Ie7400af14f7e54d1deb5b2b5d2fc91eb5b14ca91
Signed-off-by: randyl <r.levensalor@cablelabs.com>
(cherry picked from commit 16cda37220675370bb18ab06079d829fcd9f6050)

7 years agoChange api version 71/31771/1
Dimitri Mazmanov [Fri, 24 Mar 2017 10:59:41 +0000 (11:59 +0100)]
Change api version

The api_version had full API url instead of just the version.

Change-Id: I78b39ea5d39e1ffab54d2bca41df96aadd47ac86
Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
(cherry picked from commit 3fb0175dab6d60af2fe40274fab19abf3ea6162f)

7 years agoClean redundant error logs of refstack_defcore in the console 63/31663/1
Linda Wang [Wed, 22 Mar 2017 01:35:42 +0000 (01:35 +0000)]
Clean redundant error logs of refstack_defcore in the console

1. Remove the file "refstack-error.log", and all the stderr and stdout
will be stored in refstack.log
2. Clean redundant error logs in the console and all the detailed error
logs will be found in refstack.log.

Change-Id: I7e71567c98dc89c529421eccbf1b497962b07405
Signed-off-by: Linda Wang <wangwulin@huawei.com>
(cherry picked from commit 0a07e0f686d9aaaa12b6445e99a67e0a7f7dbbd0)

7 years agoFix VIM onboarding 11/31611/1
Michael Pauls [Thu, 23 Mar 2017 10:28:25 +0000 (11:28 +0100)]
Fix VIM onboarding

Usage openstack client in order to get project id directly

Change-Id: Id75dcd594430501152c3ba02a969ac1a2aaaadc5
Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
(cherry picked from commit 84a87e788b47d5a8fa3565195672fdddd35f4cf0)

7 years agoMerge "Replace domain name from Default to default" into stable/danube
Morgan Richomme [Thu, 23 Mar 2017 18:04:02 +0000 (18:04 +0000)]
Merge "Replace domain name from Default to default" into stable/danube

7 years agoMerge "Support running on openstack which enabled https" into stable/danube
Morgan Richomme [Thu, 23 Mar 2017 17:58:38 +0000 (17:58 +0000)]
Merge "Support running on openstack which enabled https" into stable/danube

7 years agoSupport running on openstack which enabled https 25/31525/2
helenyao [Fri, 10 Mar 2017 12:23:42 +0000 (20:23 +0800)]
Support running on openstack which enabled https

JIRA: FUNCTEST-757

Change-Id: Ic87bee3020b9714bcd83105127440a9c1a7ff2ad
Signed-off-by: helenyao <yaohelan@huawei.com>
(cherry picked from commit 4a989722feca53e1baa6f64985841bd6a244d627)

7 years agoReplace domain name from Default to default 87/31587/1
Dimitri Mazmanov [Thu, 23 Mar 2017 09:05:11 +0000 (10:05 +0100)]
Replace domain name from Default to default

The tests don't pass if the domain name is Default.
Instead the domain id 'default' should be used.

Change-Id: Ife919f79f007ab3fea3d53744634a92ddb172c23
Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
(cherry picked from commit d832b215a844cc2e0008eb0a86b689830e0277bb)

7 years ago[fuel] Skip test_server_basic_ops tempest test 79/31579/1
Michael Polenchuk [Mon, 13 Mar 2017 13:05:42 +0000 (17:05 +0400)]
[fuel] Skip test_server_basic_ops tempest test

Tempest ssh client is hanging on opendaylight enabled envs
(getting deadlock in paramiko recv_exit_status method) while
trying to execute a command on a vm.

Change-Id: I6660cebc6bc44a5f02e6a1e83ee9a61bae141746
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
(cherry picked from commit 1b2db725757ef1c444e094db45287b291ad9f3a6)

7 years agoIgnore certain modules for logging 71/31571/1
jose.lausuch [Tue, 21 Mar 2017 16:50:25 +0000 (17:50 +0100)]
Ignore certain modules for logging

Some modules are logged to functest.log or the console
and are not relevant for us since they are already
in the openstack logs.
This causes a huge log which makes it unreadable.

Change-Id: I3f0fb83e2080e41cd5bf815f8448f5bc25e3464a
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit d6f4f25e6269a23120b37f58178164740f1cf0e9)

7 years agoEnable functest offline by installing tempest system wide 55/31555/1
Linda Wang [Thu, 16 Mar 2017 08:51:55 +0000 (08:51 +0000)]
Enable functest offline by installing tempest system wide

JIRA: FUNCTEST-764

1. When creating verifier via rally in functest env prepare, without the
parameter "--system-wide", rally will install tempest and its dependent
packages into the virtual env of rally. Thus, it needs to connect internet
when installing tempest, which will not enable functest offline.
2. Some packages are needed for multisite testcase, and they are installed
in virtual env of rally before. But if "--system-wide" is set, there packages
should be installed addtionally.

Change-Id: I340701e9ed4a0f8f278ff952f0dd61470c6deed1
Signed-off-by: Linda Wang <wangwulin@huawei.com>
(cherry picked from commit 264896f475e3f0975754c9fa78980051661698c0)

7 years agoSwitch test_db_url to a directory 49/31549/1
xudan [Thu, 16 Mar 2017 07:09:53 +0000 (07:09 +0000)]
Switch test_db_url to a directory

We must now set a dir (e.g. /home/opnfv/db) to dump results. It avoids
replacing "results" and prevent from limiting the use of this decorator.
All data will be dumped into url/dump.txt

As also proposed in FUNCTEST-729, missing directories are created too.
The decorator will raise exceptions if dir exists or if target is not a
directory.

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
JIRA: FUNCTEST-729
Change-Id: I9650c72493043539f17725f5c328c12639ecc059
Signed-off-by: xudan <xudan16@huawei.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 18bdde48e866f198b5d08b62fc9e26e3dfe4e818)

7 years agoMake SFC test a python call to main() 45/31545/1
jose.lausuch [Tue, 21 Mar 2017 14:17:46 +0000 (15:17 +0100)]
Make SFC test a python call to main()

Instead of python -> bash -> python, call
the SFC test using the execute() method that
is inherited from FeatureBase and it's a bash
call by default.
With this change, we call the SFC test using main()
of run_tests.py of SFC repo and will have
real time output.

Change-Id: I6d59821e603c88697a82b95c5626c5b703c11026
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
(cherry picked from commit d5820bef80ea4bdb871380dbfe41db12290fc5f8)

7 years agorefstack: bugfix of testcase failure 67/31467/1
MatthewLi [Fri, 17 Mar 2017 03:42:55 +0000 (23:42 -0400)]
refstack: bugfix of testcase failure

JIRA: DOVETAIL-366
JIRA: DOVETAIL-758

1)for compass, joid, failure log
  https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/1062/consoleFull
  https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/936/consoleFull
  volume_device_name should be set vdb.
  for fuel, "vdb" is used for config, drive when force_config_drive=True is in action, so set to vdc
  testcase test_attach_detach_volume is not dynamic enough, to skip temporarily.
2)rename defcore_201608.txt to defcore.txt
  since this file is the default running file, can be changed as version changes.
  and will be easy for dovetail to consume with a general name rather than a special name.
  then dovetail can define the testcases to replace this file when running.

Change-Id: I58f89095721a7bdb15230b9af2b96234c3c7dcb9
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
(cherry picked from commit 9ae14f931da5baf42a3b62eef49c644e762405fc)

7 years agoDisable blocking status for odl_netvirt 45/31445/1
Jamo Luhrsen [Wed, 22 Mar 2017 21:30:25 +0000 (14:30 -0700)]
Disable blocking status for odl_netvirt

Change-Id: I4a3f10a82d3109a44f8db237cbd7beda06a361da
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
(cherry picked from commit 569182f4b24de6b0f020754d717129a82d19930b)

7 years agobugfix: fail to push odl-sfc test result to TestDB 73/31373/1
SerenaFeng [Wed, 22 Mar 2017 10:50:32 +0000 (18:50 +0800)]
bugfix: fail to push odl-sfc test result to TestDB

'functest-odl-sfc"' will appear as [functest-odl-sfc"],
tailing with ", it is not defined in TestDB. led to
failure pushing

Change-Id: I43966236e25578aed12952710b22ba99e244cf56
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
(cherry picked from commit 3137017fd435547abdcc2df0d73be5f1b2ef443a)

7 years agoUpdate keys of details dic for refstack_defcore 35/31335/1
Linda Wang [Tue, 21 Mar 2017 09:28:43 +0000 (09:28 +0000)]
Update keys of details dic for refstack_defcore

Update the keys of details in refstack_defcore ("num_tests", "num_failures",
and "failed") to "tests", "failures" and "errors", in order to be consistent
with those in tempest.

Change-Id: I24f8a23548ffa253621083bbf6eb988306fd6edb
Signed-off-by: Linda Wang <wangwulin@huawei.com>
(cherry picked from commit 93d5bf2ad47f431bfab173ed718bb7469b67514f)

7 years agoSet refstack_defcore criteria to 100% 33/31333/1
Linda Wang [Tue, 21 Mar 2017 09:03:33 +0000 (09:03 +0000)]
Set refstack_defcore criteria to 100%

In order to be consistent with other tests, set refstack_defcore
criteria to 100%.

Change-Id: Iab8bc0cb66b834a661b860a032192d502fde578b
Signed-off-by: Linda Wang <wangwulin@huawei.com>
(cherry picked from commit fa1dea1dbcf36e7a9d44fcb716fa9af0ef47b445)

7 years agobug fix: version not retrieved on weekly jobs 95/31195/1
Morgan Richomme [Mon, 20 Mar 2017 09:04:57 +0000 (10:04 +0100)]
bug fix: version not retrieved on weekly jobs

a first fix had been done
but the version was retrieved 2 times with the regex
this patch removes the second regex and re-use get_version
the associated unit tests has been removed because even
if the build_tag is badly formated, it will not prevent
the results to be pushed with version = unknown

JIRA: FUNCTEST-765

Change-Id: I2cbe8ba1dd7278c3f3510a47c667c433f65e00f8
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit afc59e6af25a60c68a3095365c780974721f1364)

7 years ago[cloudify_ims] Change VNF flavor value 73/31173/1
boucherv [Tue, 21 Mar 2017 08:49:09 +0000 (09:49 +0100)]
[cloudify_ims] Change VNF flavor value

Change-Id: I843f77fa5051a99be8bdbdbb76300ab965e9d8af
Signed-off-by: boucherv <valentin.boucher@orange.com>
(cherry picked from commit 442cedd8fd0453d5b662319c6d307bc0ee6437da)

7 years agoRemove functest_defcore testcases 69/31169/1
Morgan Richomme [Thu, 16 Mar 2017 16:42:52 +0000 (17:42 +0100)]
Remove functest_defcore testcases

refstack_defcore has been merged
the testcase is no more needed (duplication)

Change-Id: I287406b40cdd89ff2c4eadcde7e9d5a93e21953a
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 9f6db60565be34a886f457d92d655d364bd71f9d)

7 years agoFix usage of v3 APIs of OpenStack 87/31087/1
Michael Pauls [Mon, 20 Mar 2017 15:08:13 +0000 (16:08 +0100)]
Fix usage of v3 APIs of OpenStack

Using OS_PROJECT_ID instead of OS_TENANT_NAME as tenant
when onboarding a new VIM/PoP with Open Baton

Change-Id: I873badc73e7b33179fa487505d18ce89840d6599
Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
(cherry picked from commit 340cf9330af728dac334de7b391c3ea3971fd125)

7 years ago[vnf_base] improve exception 19/31019/1
boucherv [Mon, 20 Mar 2017 09:52:48 +0000 (10:52 +0100)]
[vnf_base] improve exception

Return on part of previous changes in commit: 30257
https://gerrit.opnfv.org/gerrit/#/c/30257/

Change-Id: I11b33ee2a6f9d4cbcf1449006b47be508fce655e
Signed-off-by: boucherv <valentin.boucher@orange.com>
(cherry picked from commit 3575dcb2a262c623dd4ded0823bc78adf3a1012e)

7 years agoRemove raise exceptions 17/31017/1
Morgan Richomme [Fri, 10 Mar 2017 15:14:29 +0000 (16:14 +0100)]
Remove raise exceptions

until exceptions are better managed in abstraction
Currently it triggers an exit from the jenkins job
and prevent other tests to be run

Change-Id: Id3b18c1d6d3b786fc78456b3ad51963d2cbb2cc1
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 6ac6937237bc03b27935f71bbb33c0abffc1e993)

7 years agoBug Fix: retrieve version from build tag in weekly jobs 45/30945/1
Morgan Richomme [Fri, 17 Mar 2017 13:41:06 +0000 (14:41 +0100)]
Bug Fix: retrieve version from build tag in weekly jobs

- fix regex issue
- add unit test to cover weekly and dummy build tags
- remove useless logs

JIRA: FUNCTEST-765

Change-Id: I7a8d40b4662f4557cd080669da46fb1c32d2ad6d
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit f15a4f277fb61b86074e949e2323b8f652969dd1)

7 years ago[cloudify_ims] fix signaling test error 43/30943/1
boucherv [Sun, 19 Mar 2017 11:44:17 +0000 (12:44 +0100)]
[cloudify_ims] fix signaling test error

Change-Id: I6d6cf36c2a82df1ff9943cc3084b38967033bb94
Signed-off-by: boucherv <valentin.boucher@orange.com>
(cherry picked from commit 5b8aa73c0ae774649998c62d9d38d4c7bd09bb84)

7 years agoFix deployment flavor of orchestra machine; Improve bootstrap 81/30881/1
Michael Pauls [Fri, 17 Mar 2017 17:59:49 +0000 (18:59 +0100)]
Fix deployment flavor of orchestra machine; Improve bootstrap

Change-Id: I3aa00be7e6e7d3e8de86a8b6a8e9564dc548a3d3
Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
(cherry picked from commit dce6afeedc21ec9e5b97d630493b9307682ccaa4)

7 years agoBugfix: fix the criteria of refstack_defcore 29/30729/1
Linda Wang [Thu, 16 Mar 2017 15:34:35 +0000 (15:34 +0000)]
Bugfix: fix the criteria of refstack_defcore

The criteria of refstack_defcore is supposed to be ">= 80%" rather
than "== 80%".

Change-Id: I9f9e38c84925c3725289e8b427e5735d131459f1
Signed-off-by: Linda Wang <wangwulin@huawei.com>
(cherry picked from commit 5f500e6a33c9b8ea904a46b2f84d734f26da4aaf)

7 years agorefstack-client: arm dockerfile support 27/30727/1
MatthewLi [Wed, 15 Mar 2017 10:02:33 +0000 (06:02 -0400)]
refstack-client: arm dockerfile support

JIRA: FUNCTEST-758
JIRA: DOVETAIL-366

Change-Id: I02784263bca26a1bfc786949b933d688c35c950f
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
(cherry picked from commit 0deaa18a03be4ba14a3d1c7c71ae404e0f6837a8)

7 years agoParse refstack_defcore results 25/30725/1
Linda Wang [Wed, 15 Mar 2017 09:53:37 +0000 (09:53 +0000)]
Parse refstack_defcore results

JIRA: DOVETAIL-366
JIRA: FUNCTEST-758

Parse refstack_defcore results, including:
1. show number of tests passed, skipped and failed
2. record the detailed info about testcases passed, skipped and failed.

Change-Id: I355a907c5c9ea2739f845447144c62613ec3bb6a
Signed-off-by: Linda Wang <wangwulin@huawei.com>
(cherry picked from commit 2223051412c8855afebb7a9d657c90e9f235f78a)

7 years agorefstack client integration 23/30723/1
MatthewLi [Fri, 10 Mar 2017 05:03:09 +0000 (00:03 -0500)]
refstack client integration

JIRA: DOVETAIL-366
JIRA: FUNCTEST-758

usage:
1,functest testcase run refstack_defcore, will run the
default testcases in defcore_201608.txt
2,cd <path>/functest/functest/opnfv_tests/openstack/refstack_client
  python refstack_client.py -c <tempest-conf-file-path> --testlist <testlist-path>

this has been worked with openstack-refstack experts, etc.
tested workedi.
result see http://paste.openstack.org/show/602173/

Change-Id: I1aaffea01dec9dc8d1c572885bdf516614a16894
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
(cherry picked from commit 99f308dc9b11e8f99d928840de576af274229331)

7 years agoAdded Unit Tests for ci/generate_report with 21/30721/1
ashishk1994 [Tue, 21 Feb 2017 17:21:30 +0000 (22:51 +0530)]
Added Unit Tests for ci/generate_report with
argument refactoring for main and init
functions in generate_reports

Change-Id: I291d04a9c0ed381f4b92e989270c0b9a37c15264
Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
(cherry picked from commit cc72b61456aeaa9752527d55541df3791ff1fbbf)

7 years agoAdded Unit Tests for ci/run_tests 19/30719/1
ashishk1994 [Tue, 21 Feb 2017 17:22:45 +0000 (22:52 +0530)]
Added Unit Tests for ci/run_tests

Change-Id: I5cd900cee809b8fd935a5c8b862a9ecd6278bdf5
Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
(cherry picked from commit 0077ad99834d51654a75a5ccf49fcfcaf828b905)

7 years agoAdded Unit Tests for ci/tier_builder 17/30717/1
ashishk1994 [Tue, 21 Feb 2017 17:23:29 +0000 (22:53 +0530)]
Added Unit Tests for ci/tier_builder

Change-Id: I66f43fb09472948bc71178cd8aeb14dc1ab5fa55
Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
(cherry picked from commit f651565ffc8979ef99a1d9bc001561bf1fba3779)

7 years agoenv variable support for test DB url 57/30657/1
Morgan Richomme [Tue, 14 Mar 2017 15:57:05 +0000 (16:57 +0100)]
env variable support for test DB url

So far DB url was retrieved from configuration file
If you want to use the CI chain (jenkins, testapi, test DB,
functest, ..) then you have a problem

calling functest will systematically point to the configuration
from the repo
Supporting env variable allow to avoid post processing in the
configuration file and as a consequence offer the possibility
to create a local DB to host local results

Change-Id: Ie64b8b265827d7f5724c7066a8c173de8cf012e2
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 0c194ede4dd9eb46b61af49e85527fcc368a8fca)

7 years agobug fix: remove reference to ovno 45/30445/1
Morgan Richomme [Tue, 14 Mar 2017 15:32:02 +0000 (16:32 +0100)]
bug fix: remove reference to ovno

ovno has no danube branch and is not used
clean the ovno from functest to avoid side effect
when producing danube functest docker file

Change-Id: I5347111fc90a04ca9018679b5578ca30ae33b2f2
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 65b26f2e9db7e0cf336c147d46d91cb1c828a67b)

7 years ago[snaps] Pass flavor metadata to smoke tests 39/30439/1
Michael Polenchuk [Tue, 14 Mar 2017 14:34:24 +0000 (18:34 +0400)]
[snaps] Pass flavor metadata to smoke tests

Change-Id: I774d3625d35e3d264d609ba9aa7538a723923bcf
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
(cherry picked from commit 1ee860c3f5391234e5424b49e5e9cba9cdebf593)

7 years ago[tempest/defcore] Configure volume device name 19/30419/1
Michael Polenchuk [Thu, 9 Mar 2017 12:43:02 +0000 (16:43 +0400)]
[tempest/defcore] Configure volume device name

Actually attach_detach_volume must be skipped because the device name
ain't reliable and that's using a hard-coded device name in config.
This test should just get the device info after the attach and use
that rather than the hard-coded config option in Tempest that ain't
likely to work - the test should have been written more dynamically.

However, set volume device name to "vdc" since "vdb" is used for config
drive when force_config_drive=True is in action.

Change-Id: Ic70de93a609df932c7749a94f71505e927df1b79
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
(cherry picked from commit 3b006a6a3742325c0fe4ccc557b7a8e140f2cab2)

7 years agoMerge "cloudify_ims: fix error on account creation"
Morgan Richomme [Fri, 10 Mar 2017 14:27:02 +0000 (14:27 +0000)]
Merge "cloudify_ims: fix error on account creation"

7 years agocloudify_ims: fix error on account creation 55/30255/1
boucherv [Fri, 10 Mar 2017 14:01:24 +0000 (15:01 +0100)]
cloudify_ims: fix error on account creation

Change-Id: I43550b2062c69d7b4eb144057a90806f92328739
Signed-off-by: boucherv <valentin.boucher@orange.com>
7 years agoMerge "Add extra check to avoid double delete of instances"
Morgan Richomme [Fri, 10 Mar 2017 13:18:53 +0000 (13:18 +0000)]
Merge "Add extra check to avoid double delete of instances"

7 years agoMerge "Exclude Doctor from Joid scnenarios"
Morgan Richomme [Fri, 10 Mar 2017 09:58:50 +0000 (09:58 +0000)]
Merge "Exclude Doctor from Joid scnenarios"

7 years agoMerge "cloudify_ims: fix sip public domain name"
Morgan Richomme [Fri, 10 Mar 2017 09:42:38 +0000 (09:42 +0000)]
Merge "cloudify_ims: fix sip public domain name"

7 years agocloudify_ims: fix sip public domain name 41/30241/1
boucherv [Fri, 10 Mar 2017 09:36:48 +0000 (10:36 +0100)]
cloudify_ims: fix sip public domain name

Change-Id: I25423cc3fbab54f81047fbebd0bc33895d826186
Signed-off-by: boucherv <valentin.boucher@orange.com>
7 years agoExclude Doctor from Joid scnenarios 39/30239/1
Morgan Richomme [Fri, 10 Mar 2017 09:35:01 +0000 (10:35 +0100)]
Exclude Doctor from Joid scnenarios

Doctor feature not available for Joid on Danube

Change-Id: I1d39ff15a1fe003689828f6923b92c7e7c7d716f
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
7 years agoMerge "Unit tests added for openstack/tempest"
Morgan Richomme [Fri, 10 Mar 2017 09:27:19 +0000 (09:27 +0000)]
Merge "Unit tests added for openstack/tempest"

7 years agoChange scenario for odl_netvirt tests to be os-odl_l3-nofeature 15/30115/2
Jamo Luhrsen [Thu, 9 Mar 2017 06:16:15 +0000 (22:16 -0800)]
Change scenario for odl_netvirt tests to be os-odl_l3-nofeature

Change-Id: Ibf04adcaa0b14c4cdda8fba2ef2826a0c7f3b7d4
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
7 years agoMerge "Show verification details in tempest log"
Morgan Richomme [Fri, 10 Mar 2017 07:12:51 +0000 (07:12 +0000)]
Merge "Show verification details in tempest log"

7 years agoMerge "Change the order of HealthCheck tests"
Morgan Richomme [Fri, 10 Mar 2017 07:12:35 +0000 (07:12 +0000)]
Merge "Change the order of HealthCheck tests"

7 years agoMerge "fix vnf deployment"
Morgan Richomme [Thu, 9 Mar 2017 20:38:40 +0000 (20:38 +0000)]
Merge "fix vnf deployment"

7 years agofix vnf deployment 15/30215/1
boucherv [Thu, 9 Mar 2017 20:30:49 +0000 (21:30 +0100)]
fix vnf deployment

Change-Id: If92c7d402b88f59367564f7279d426eb8f3b582a
Signed-off-by: boucherv <valentin.boucher@orange.com>
7 years agoChange the order of HealthCheck tests 97/30197/1
Morgan Richomme [Thu, 9 Mar 2017 16:20:17 +0000 (17:20 +0100)]
Change the order of HealthCheck tests

currently the snaps healthcheck (dhcp) is tried first
it should be connectivity, api, dhcp

the reporting looks for scenario based on connectivity

testing dhcp first => scenarios ok on connectivy but
failed with DHCP are not considered, which could be
misleading

Change-Id: I0eb34b1f5ba163540281e5ef0dcb12c8cefa88bd
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
7 years agoMerge "Update tempest to the latest 15.0.0"
Morgan Richomme [Thu, 9 Mar 2017 16:12:02 +0000 (16:12 +0000)]
Merge "Update tempest to the latest 15.0.0"

7 years agoShow verification details in tempest log 87/30187/1
Juha Kosonen [Thu, 9 Mar 2017 15:22:13 +0000 (17:22 +0200)]
Show verification details in tempest log

JIRA: FUNCTEST-747

Change-Id: I85f15188315136cc44876914325e3693f7973af8
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
7 years agoMerge "Introduce smoke tests for FDS"
Morgan Richomme [Thu, 9 Mar 2017 13:54:16 +0000 (13:54 +0000)]
Merge "Introduce smoke tests for FDS"

7 years agoIntroduce smoke tests for FDS 83/28883/12
Tomas Cechvala [Fri, 17 Feb 2017 00:39:00 +0000 (01:39 +0100)]
Introduce smoke tests for FDS

Added:
 - fds repository to docker file
 - fds test to smoke tier in testcases
 - config values for fds tests

A new robot var OS_AUTH_URL is defined as expected by FDS robot files.
Method args switch from Keystone IP to OS_AUTH_URL which is more
precised. The argument parsing is changed too.

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Ife27ab4a83f0110cbdcf7c9d47d9b3fb4c0ec705
Signed-off-by: Tomas Cechvala <tcechval@cisco.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
7 years agoMerge "Revert "Change barometer target log file""
Morgan Richomme [Thu, 9 Mar 2017 11:00:54 +0000 (11:00 +0000)]
Merge "Revert "Change barometer target log file""

7 years agoRevert "Change barometer target log file" 51/30151/3
Morgan Richomme [Thu, 9 Mar 2017 10:45:37 +0000 (10:45 +0000)]
Revert "Change barometer target log file"

This reverts commit 044de9eb0c74fb2ef9cb34b6487bf0536412058d.

Change-Id: I9179f4b5ce866456e8ec85cb8a730a5d7f2af16e
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
7 years agoMerge "Change barometer target log file"
Morgan Richomme [Thu, 9 Mar 2017 09:37:07 +0000 (09:37 +0000)]
Merge "Change barometer target log file"

7 years agoMerge "Improve error log into vnf test step"
Morgan Richomme [Thu, 9 Mar 2017 08:54:57 +0000 (08:54 +0000)]
Merge "Improve error log into vnf test step"

7 years agoMerge "Optimize releng cloning when running unit tests"
Morgan Richomme [Thu, 9 Mar 2017 08:53:53 +0000 (08:53 +0000)]
Merge "Optimize releng cloning when running unit tests"

7 years agoOptimize releng cloning when running unit tests 55/30055/4
Morgan Richomme [Wed, 8 Mar 2017 10:07:04 +0000 (11:07 +0100)]
Optimize releng cloning when running unit tests

not need to clone full releng
depth 1 is enough
do not go out of workspace anymore..never...

Change-Id: I1d2dbc30bec6c168ef7ddf3327cb00fff4056aa1
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
7 years agoChange barometer target log file 27/30127/1
Morgan Richomme [Thu, 9 Mar 2017 07:41:12 +0000 (08:41 +0100)]
Change barometer target log file

Change-Id: Id903683b12366c5a2f486c8b7d7ce6977d4448e0
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
7 years agoMerge "Exclude SNAPS smoke for lxd scenario"
Morgan Richomme [Thu, 9 Mar 2017 07:21:27 +0000 (07:21 +0000)]
Merge "Exclude SNAPS smoke for lxd scenario"

7 years agoInstall kingbird verifier extension for tempest 61/30061/3
Juha Kosonen [Wed, 8 Mar 2017 13:39:49 +0000 (15:39 +0200)]
Install kingbird verifier extension for tempest

JIRA: FUNCTEST-742

Change-Id: I5de8ed22932250c542751e38eae3185c4a263cd0
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
7 years agoImprove error log into vnf test step 79/30079/1
boucherv [Wed, 8 Mar 2017 18:40:09 +0000 (19:40 +0100)]
Improve error log into vnf test step

Change-Id: Ied92224bc80ab4e02611e7b1f4bf33f276914e89
Signed-off-by: boucherv <valentin.boucher@orange.com>
7 years agoAarch64 adaption in functest for snaps smoke 87/29987/2
Cristina Pauna [Tue, 7 Mar 2017 17:48:34 +0000 (19:48 +0200)]
Aarch64 adaption in functest for snaps smoke

This commit sends the aarch64 custom config to the snaps integration
tests. Since these are the same as the snaps healthcheck, no additional
values were added to config_aarch64_patch.yaml

Change-Id: I5f2302a3c65d47ec8fca661888268489e2c6ba35
Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
7 years agoAdding Labels 39/29939/2
ShubhamRathi [Tue, 7 Mar 2017 11:41:03 +0000 (17:11 +0530)]
Adding Labels

Labels serve as anchors/ refs when referenced from other documents
This patch adds labels to docs/*/*/index.rst

Change-Id: Iaa339f0f8b2efbde286b173ae6cf7e92cddab115
Signed-off-by: ShubhamRathi <shubhamiiitbackup@gmail.com>
7 years agoExclude SNAPS smoke for lxd scenario 63/30063/1
Morgan Richomme [Wed, 8 Mar 2017 13:43:09 +0000 (14:43 +0100)]
Exclude SNAPS smoke for lxd scenario

SNAPS healthcheck is already excluded due to the
use of QCOW2 images, not compatible with lxd
scenarios

2 JIRAs have been cretaed to adapt the SNAPS cases
to lxd in Euphrates
https://jira.opnfv.org/browse/FUNCTEST-752
https://jira.opnfv.org/browse/FUNCTEST-753

Additionnal cleaning done on testcases.yaml
- remove juju_epc case (no one from OAI available
for Danube)
- remove orchestra (as standalone test case of the
MANO stack, postponed to Euphrates)
- comment aaa (empty sample used to illustrate
the VNF abstraction but not completed for Danube)

Change-Id: Ibad6cad4c92ee9897b6665b29c09b62cb1986aae
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
7 years agoAdded support for scenario-based flavor creation. 77/29877/5
spisarski [Mon, 6 Mar 2017 19:58:34 +0000 (12:58 -0700)]
Added support for scenario-based flavor creation.

As certain scenarios such as, DPDK, FDIO, and OVS use cases
require special 'hw:' settings to flavors, SNAPS-OO has just
implemented the ability to take in these configuration values
to apply to its integration tests. This change checks the
scenario and should be configuring the flavor metadata accordingly.

Also see SNAPS-38

Used this as an opportunity to refactor the SNAPS test classes as well...

JIRA: FUNCTEST-746

Change-Id: I63535776acde088a7461f602966a324b6207592d
Signed-off-by: spisarski <s.pisarski@cablelabs.com>