docs/testing/developer/devguide/overview.rst

   1 .. This work is licensed under a Creative Commons Attribution 4.0 International License.
   2 .. http://creativecommons.org/licenses/by/4.0
   3 .. (c) Huawei Technologies Co.,Ltd and others.
   4
   5 *********************
   6 Project Testing Guide
   7 *********************
   8
   9 For each *test suite*, you can either setup *test story* or *test case* to run
  10 certain test. *test story* could include several *test cases* as a set in one
  11 configuration file. You could then call the *test story* or *test case* by using
  12 Bottlencks CLI or Python build process.
  13 Details will be shown in the following section.
  14
  15 Brief Introdcution of the Test suites in Project Releases
  16 =============================================================
  17
  18 Brahmaputra: rubbos is introduced, which is an end2end NFVI perforamnce tool.
  19 Virtual switch test framework(VSTF) is also introduced,
  20 which is an test framework used for vswitch performance test.
  21
  22 Colorado: rubbos is refactored by using puppet, which makes it quite flexible
  23 to configure with different number of load generator (Client), worker (tomcat).
  24 vstf is refactored by extracting the test case's configuration information.
  25
  26 Danube: posca testsuite is introduced to implementing stress (factor), scenario and
  27 tuning test in parametric manner. Two testcases are developed and integrated into
  28 community CI pipeline. Rubbos and VSTF are not supported any more.
  29
  30 Integration Description
  31 =======================
  32 +-------------+----------------------+----------------------+
  33 | Release     | Integrated Installer | Supported Testsuite  |
  34 +-------------+----------------------+----------------------+
  35 | Brahmaputra |    Fuel              | Rubbos, VSTF         |
  36 +-------------+----------------------+----------------------+
  37 | Colorado    |    Compass           | Rubbos, VSTF         |
  38 +-------------+----------------------+----------------------+
  39 | Danube      |    Compass           | POSCA                |
  40 +-------------+----------------------+----------------------+
  41
  42 Test suite & Test case Description
  43 ==================================
  44 +--------+-------------------------------+
  45 |POSCA   | posca_factor_ping             |
  46 |        +-------------------------------+
  47 |        | posca_factor_system_bandwidth |
  48 +--------+-------------------------------+
  49 |Rubbos  | rubbos_basic                  |
  50 |        +-------------------------------+
  51 |        | rubbos_TC1101                 |
  52 |        +-------------------------------+
  53 |        | rubbos_TC1201                 |
  54 |        +-------------------------------+
  55 |        | rubbos_TC1301                 |
  56 |        +-------------------------------+
  57 |        | rubbos_TC1401                 |
  58 |        +-------------------------------+
  59 |        | rubbos_heavy_TC1101           |
  60 +--------+-------------------------------+
  61 |vstf    | vstf_Ti1                      |
  62 |        +-------------------------------+
  63 |        | vstf_Ti2                      |
  64 |        +-------------------------------+
  65 |        | vstf_Ti3                      |
  66 |        +-------------------------------+
  67 |        | vstf_Tn1                      |
  68 |        +-------------------------------+
  69 |        | vstf_Tn2                      |
  70 |        +-------------------------------+
  71 |        | vstf_Tu1                      |
  72 |        +-------------------------------+
  73 |        | vstf_Tu2                      |
  74 |        +-------------------------------+
  75 |        | vstf_Tu3                      |
  76 +--------+-------------------------------+