docs/testing/developer/overview.rst

   1 .. This work is licensed under a Creative Commons Attribution 4.0 International License.
   2 .. http://creativecommons.org/licenses/by/4.0
   3 .. (c) Huawei Technologies Co.,Ltd and others.
   4
   5 *********************
   6 Project Testing Guide
   7 *********************
   8
   9 For each *test suite*, you can either setup *test story* or *test case* to run
  10 certain test. *test story* could include several *test cases* as a set in one
  11 configuration file. You could then call the *test story* or *test case* by using
  12 Bottlencks CLI or Python build process.
  13 Details will be shown in the following section.
  14
  15 Brief Introdcution of the Test suites in Project Releases
  16 =============================================================
  17
  18 Brahmaputra: rubbos is introduced, which is an end2end NFVI perforamnce tool.
  19 Virtual switch test framework(VSTF) is also introduced,
  20 which is an test framework used for vswitch performance test.
  21
  22 Colorado: rubbos is refactored by using puppet, which makes it quite flexible
  23 to configure with different number of load generator(Client), worker(tomcat).
  24 vstf is refactored by extracting the test case's configuration information.
  25
  26 Danube: posca testsuite is introduced to implementing stress (factor), scenario and
  27 tuning test in parametric manner. Two testcases are developed and integrated into
  28 community CI pipeline.
  29
  30 Integration Description
  31 =======================
  32 +-------------+----------------------+----------------------+
  33 | Release     | integrated installer | Supported Testsuite  |
  34 +-------------+----------------------+----------------------+
  35 | Brahmaputra |    Fuel              | Rubbos, VSTF         |
  36 +-------------+----------------------+----------------------+
  37 | Colorado    |    Compass           | Rubbos, VSTF         |
  38 +-------------+----------------------+----------------------+
  39 | Danube      |    Compass           | POSCA                |
  40 +-------------+----------------------+----------------------+
  41
  42 Test suite & Test case Description
  43 ==================================
  44 +--------+-------------------------------+
  45 |Rubbos  | rubbos_basic                  |
  46 |        +-------------------------------+
  47 |        | rubbos_TC1101                 |
  48 |        +-------------------------------+
  49 |        | rubbos_TC1201                 |
  50 |        +-------------------------------+
  51 |        | rubbos_TC1301                 |
  52 |        +-------------------------------+
  53 |        | rubbos_TC1401                 |
  54 |        +-------------------------------+
  55 |        | rubbos_heavy_TC1101           |
  56 +--------+-------------------------------+
  57 |vstf    | vstf_Ti1                      |
  58 |        +-------------------------------+
  59 |        | vstf_Ti2                      |
  60 |        +-------------------------------+
  61 |        | vstf_Ti3                      |
  62 |        +-------------------------------+
  63 |        | vstf_Tn1                      |
  64 |        +-------------------------------+
  65 |        | vstf_Tn2                      |
  66 |        +-------------------------------+
  67 |        | vstf_Tu1                      |
  68 |        +-------------------------------+
  69 |        | vstf_Tu2                      |
  70 |        +-------------------------------+
  71 |        | vstf_Tu3                      |
  72 +--------+-------------------------------+
  73 |posca   | posca_stress_ping             |
  74 |        +-------------------------------+
  75 |        | posca_stress_traffic          |
  76 |        |                               |
  77 |        | (posca_factor_sys_bandwidth)  |
  78 +--------+-------------------------------+
  79
  80 Installation of Testsuites
  81 ==========================
  82
  83 * TODO
  84
  85 Setting Up Configrations
  86 ========================
  87
  88 * TODO
  89
  90 Run Tests Brief
  91 ===============
  92
  93 * TODO
  94 * More will be shown in the platform overview