docs/release/release-notes/release-notes.rst

   1 =======
   2 License
   3 =======
   4
   5 OPNFV Danube release note for Yardstick Docs
   6 are licensed under a Creative Commons Attribution 4.0 International License.
   7 You should have received a copy of the license along with this.
   8 If not, see <http://creativecommons.org/licenses/by/4.0/>.
   9
  10 The *Yardstick framework*, the *Yardstick test cases* and the *ApexLake*
  11 experimental framework are opensource software, licensed under the terms of the
  12 Apache License, Version 2.0.
  13
  14 =========================================
  15 OPNFV Danube Release Note for Yardstick
  16 =========================================
  17
  18 .. toctree::
  19    :maxdepth: 2
  20
  21 .. _Yardstick: https://wiki.opnfv.org/yardstick
  22
  23 .. _Dashboard: http://testresults.opnfv.org/grafana/dashboard/db/yardstick-main
  24
  25 .. _NFV-TST001: http://www.etsi.org/deliver/etsi_gs/NFV-TST/001_099/001/01.01.01_60/gs_NFV-TST001v010101p.pdf
  26
  27
  28 Abstract
  29 ========
  30
  31 This document describes the release note of Yardstick project.
  32
  33
  34 Version History
  35 ===============
  36
  37 +----------------+--------------------+---------------------------------+
  38 | *Date*         | *Version*          | *Comment*                       |
  39 |                |                    |                                 |
  40 +----------------+--------------------+---------------------------------+
  41 |                |  3.0               | Yardstick for Danube release    |
  42 |                |                    |                                 |
  43 +----------------+--------------------+---------------------------------+
  44 |                |  2.0               | Yardstick for Danube release    |
  45 |                |                    |                                 |
  46 +----------------+--------------------+---------------------------------+
  47 | Mar 31st, 2017 |  1.0               | Yardstick for Danube release    |
  48 |                |                    |                                 |
  49 +----------------+--------------------+---------------------------------+
  50
  51
  52 Important Notes
  53 ===============
  54
  55 The software delivered in the OPNFV Yardstick_ Project, comprising the
  56 *Yardstick framework*, the *Yardstick test cases* and the experimental
  57 framework *Apex Lake* is a realization of the methodology in ETSI-ISG
  58 NFV-TST001_.
  59
  60 The *Yardstick* framework is *installer*, *infrastructure* and *application*
  61 independent.
  62
  63
  64 OPNFV Danube Release
  65 ======================
  66
  67 This Danube release provides *Yardstick* as a framework for NFVI testing
  68 and OPNFV feature testing, automated in the OPNFV CI pipeline, including:
  69
  70 * Documentation generated with Sphinx
  71
  72   * User Guide
  73
  74   * Developer Guide
  75
  76   * Release notes (this document)
  77
  78   * Results
  79
  80 * Automated Yardstick test suite (daily, weekly)
  81
  82   * Jenkins Jobs for OPNFV community labs
  83
  84 * Automated Yardstick test results visualization
  85
  86   * Dashboard_ using Grafana (user:opnfv/password: opnfv), influxDB is used as
  87     backend
  88
  89 * Yardstick framework source code
  90
  91 * Yardstick test cases yaml files
  92
  93 * Yardstick pliug-in configration yaml files, plug-in install/remove scripts
  94
  95 For Danube release, the *Yardstick framework* is used for the following
  96 testing:
  97
  98 * OPNFV platform testing - generic test cases to measure the categories:
  99
 100   * Compute
 101
 102   * Network
 103
 104   * Storage
 105
 106 * OPNFV platform network service benchmarking(NSB)
 107
 108   * NSB
 109
 110 * Test cases for the following OPNFV Projects:
 111
 112   * High Availability
 113
 114   * IPv6
 115
 116   * KVM
 117
 118   * Parser
 119
 120   * StorPerf
 121
 122   * VSperf
 123
 124   * virtual Traffic Classifier
 125
 126 The *Yardstick framework* is developed in the OPNFV community, by the
 127 Yardstick_ team. The *virtual Traffic Classifier* is a part of the Yardstick
 128 Project.
 129
 130 .. note:: The test case description template used for the Yardstick test cases
 131   is based on the document ETSI-ISG NFV-TST001_; the results report template
 132   used for the Yardstick results is based on the IEEE Std 829-2008.
 133
 134
 135 Release Data
 136 ============
 137
 138 +--------------------------------------+--------------------------------------+
 139 | **Project**                          | Yardstick                            |
 140 |                                      |                                      |
 141 +--------------------------------------+--------------------------------------+
 142 | **Repo/tag**                         | yardstick/Danube.1.0                 |
 143 |                                      |                                      |
 144 +--------------------------------------+--------------------------------------+
 145 | **Yardstick Docker image tag**       | Danube.1.0                           |
 146 |                                      |                                      |
 147 +--------------------------------------+--------------------------------------+
 148 | **Release designation**              | Danube                               |
 149 |                                      |                                      |
 150 +--------------------------------------+--------------------------------------+
 151 | **Release date**                     | March 31st, 2017                     |
 152 |                                      |                                      |
 153 +--------------------------------------+--------------------------------------+
 154 | **Purpose of the delivery**          | OPNFV Danube release 1.0             |
 155 |                                      |                                      |
 156 +--------------------------------------+--------------------------------------+
 157
 158
 159 Deliverables
 160 ============
 161
 162 Documents
 163 ---------
 164
 165  - User Guide: http://artifacts.opnfv.org/yardstick/Danube/docs/userguide/index.html
 166
 167  - Test Results: http://artifacts.opnfv.org/yardstick/Danube/docs/results/overview.html
 168
 169
 170 Software Deliverables
 171 ---------------------
 172
 173 **Yardstick framework source code <Danube.1.0>**
 174
 175 +--------------------------------------+--------------------------------------+
 176 | **Project**                          | Yardstick                            |
 177 |                                      |                                      |
 178 +--------------------------------------+--------------------------------------+
 179 | **Repo/tag**                         | yardstick/Danube.1.0                 |
 180 |                                      |                                      |
 181 +--------------------------------------+--------------------------------------+
 182 | **Yardstick Docker image tag**       | Danube.1.0                           |
 183 |                                      |                                      |
 184 +--------------------------------------+--------------------------------------+
 185 | **Release designation**              | Danube                               |
 186 |                                      |                                      |
 187 +--------------------------------------+--------------------------------------+
 188 | **Release date**                     | March 31st, 2017                     |
 189 |                                      |                                      |
 190 +--------------------------------------+--------------------------------------+
 191 | **Purpose of the delivery**          | OPNFV Danube release                 |
 192 |                                      |                                      |
 193 +--------------------------------------+--------------------------------------+
 194
 195
 196 **Contexts**
 197
 198 +---------------------+-------------------------------------------------------+
 199 | **Context**         | **Description**                                       |
 200 |                     |                                                       |
 201 +---------------------+-------------------------------------------------------+
 202 | *Heat*              | Models orchestration using OpenStack Heat             |
 203 |                     |                                                       |
 204 +---------------------+-------------------------------------------------------+
 205 | *Node*              | Models Baremetal, Controller, Compute                 |
 206 |                     |                                                       |
 207 +---------------------+-------------------------------------------------------+
 208 | *Standalone*        | Models to deploy/undeploy NFVi infrastructure to run  |
 209 |                     | the VNF                                               |
 210 |                     |                                                       |
 211 +---------------------+-------------------------------------------------------+
 212
 213
 214 **Runners**
 215
 216 +---------------------+-------------------------------------------------------+
 217 | **Runner**          | **Description**                                       |
 218 |                     |                                                       |
 219 +---------------------+-------------------------------------------------------+
 220 | *Arithmetic*        | Steps every run arithmetically according to specified |
 221 |                     | input value                                           |
 222 |                     |                                                       |
 223 +---------------------+-------------------------------------------------------+
 224 | *Duration*          | Runs for a specified period of time                   |
 225 |                     |                                                       |
 226 +---------------------+-------------------------------------------------------+
 227 | *Iteration*         | Runs for a specified number of iterations             |
 228 |                     |                                                       |
 229 +---------------------+-------------------------------------------------------+
 230 | *Sequence*          | Selects input value to a scenario from an input file  |
 231 |                     | and runs all entries sequentially                     |
 232 |                     |                                                       |
 233 +---------------------+-------------------------------------------------------+
 234
 235
 236 **Scenarios**
 237
 238 +---------------------+-------------------------------------------------------+
 239 | **Category**        | **Delivered**                                         |
 240 |                     |                                                       |
 241 +---------------------+-------------------------------------------------------+
 242 | *Availability*      | Attacker:                                             |
 243 |                     |                                                       |
 244 |                     | * baremetal, process                                  |
 245 |                     |                                                       |
 246 |                     | HA tools:                                             |
 247 |                     |                                                       |
 248 |                     | * check host, openstack, process, service             |
 249 |                     | * kill process                                        |
 250 |                     | * start/stop service                                  |
 251 |                     |                                                       |
 252 |                     | Monitor:                                              |
 253 |                     |                                                       |
 254 |                     | * command, process                                    |
 255 |                     |                                                       |
 256 +---------------------+-------------------------------------------------------+
 257 | *Compute*           | * cpuload                                             |
 258 |                     |                                                       |
 259 |                     | * cyclictest                                          |
 260 |                     |                                                       |
 261 |                     | * lmbench                                             |
 262 |                     |                                                       |
 263 |                     | * lmbench_cache                                       |
 264 |                     |                                                       |
 265 |                     | * perf                                                |
 266 |                     |                                                       |
 267 |                     | * unixbench                                           |
 268 |                     |                                                       |
 269 |                     | * ramspeed                                            |
 270 |                     |                                                       |
 271 |                     | * cachestat                                           |
 272 |                     |                                                       |
 273 |                     | * memeoryload                                         |
 274 |                     |                                                       |
 275 |                     | * computecapacity                                     |
 276 |                     |                                                       |
 277 +---------------------+-------------------------------------------------------+
 278 | *Networking*        | * iperf3                                              |
 279 |                     |                                                       |
 280 |                     | * netperf                                             |
 281 |                     |                                                       |
 282 |                     | * netperf_node                                        |
 283 |                     |                                                       |
 284 |                     | * ping                                                |
 285 |                     |                                                       |
 286 |                     | * ping6                                               |
 287 |                     |                                                       |
 288 |                     | * pktgen                                              |
 289 |                     |                                                       |
 290 |                     | * sfc                                                 |
 291 |                     |                                                       |
 292 |                     | * sfc with tacker                                     |
 293 |                     |                                                       |
 294 |                     | * vtc instantion validation                           |
 295 |                     |                                                       |
 296 |                     | * vtc instantion validation with noisy neighbors      |
 297 |                     |                                                       |
 298 |                     | * vtc throughput                                      |
 299 |                     |                                                       |
 300 |                     | * vtc throughput in the presence of noisy neighbors   |
 301 |                     |                                                       |
 302 |                     | * networkcapacity                                     |
 303 |                     |                                                       |
 304 |                     | * netutilization                                      |
 305 |                     |                                                       |
 306 |                     | * nstat                                               |
 307 |                     |                                                       |
 308 +---------------------+-------------------------------------------------------+
 309 | *Parser*            | Tosca2Heat                                            |
 310 |                     |                                                       |
 311 +---------------------+-------------------------------------------------------+
 312 | *Storage*           | fio                                                   |
 313 |                     |                                                       |
 314 |                     | storagecapacity                                       |
 315 |                     |                                                       |
 316 +---------------------+-------------------------------------------------------+
 317 | *StorPerf*          | storperf                                              |
 318 |                     |                                                       |
 319 +---------------------+-------------------------------------------------------+
 320 | *NSB*               | vPE thoughput test case                               |
 321 |                     |                                                       |
 322 +---------------------+-------------------------------------------------------+
 323
 324
 325 **API to Other Frameworks**
 326
 327 +---------------------+-------------------------------------------------------+
 328 | **Framework**       | **Description**                                       |
 329 |                     |                                                       |
 330 +---------------------+-------------------------------------------------------+
 331 | *ApexLake*          | Experimental framework that enables the user to       |
 332 |                     | validate NFVI from the perspective of a VNF.          |
 333 |                     | A virtual Traffic Classifier is utilized as VNF.      |
 334 |                     | Enables experiments with SR-IOV on Compute Node.      |
 335 |                     |                                                       |
 336 +---------------------+-------------------------------------------------------+
 337
 338
 339 **Test Results Output**
 340
 341 +-----------------------------+-----------------------------------------------+
 342 | **Dispatcher**              | **Description**                               |
 343 |                             |                                               |
 344 +-----------------------------+-----------------------------------------------+
 345 |  file                       | Log to a file.                                |
 346 |                             |                                               |
 347 +-----------------------------+-----------------------------------------------+
 348 |  http                       | Post data to html.                            |
 349 |                             |                                               |
 350 +-----------------------------+-----------------------------------------------+
 351 |  influxdb                   | Post data to influxDB.                        |
 352 |                             |                                               |
 353 +-----------------------------+-----------------------------------------------+
 354
 355
 356 Delivered Test cases
 357 --------------------
 358
 359 * Generic NFVI test cases
 360
 361   * OPNFV_YARDSTICK_TCOO1 - NW Performance
 362
 363   * OPNFV_YARDSTICK_TCOO2 - NW Latency
 364
 365   * OPNFV_YARDSTICK_TCOO4 - Cache Utilization
 366
 367   * OPNFV_YARDSTICK_TCOO5 - Storage Performance
 368
 369   * OPNFV_YARDSTICK_TCOO8 - Packet Loss Extended Test
 370
 371   * OPNFV_YARDSTICK_TCOO9 - Packet Loss
 372
 373   * OPNFV_YARDSTICK_TCO10 - Memory Latency
 374
 375   * OPNFV_YARDSTICK_TCO11 - Packet Delay Variation Between VMs
 376
 377   * OPNFV_YARDSTICK_TCO12 - Memory Bandwidth
 378
 379   * OPNFV_YARDSTICK_TCO14 - Processing Speed
 380
 381   * OPNFV_YARDSTICK_TCO24 - CPU Load
 382
 383   * OPNFV_YARDSTICK_TCO37 - Latency, CPU Load, Throughput, Packet Loss
 384
 385   * OPNFV_YARDSTICK_TCO38 - Latency, CPU Load, Throughput, Packet Loss Extended
 386     Test
 387
 388   * OPNFV_YARDSTICK_TCO42 - Network Performance
 389
 390   * OPNFV_YARDSTICK_TCO43 - Network Latency Between NFVI Nodes
 391
 392   * OPNFV_YARDSTICK_TCO44 - Memory Utilization
 393
 394   * OPNFV_YARDSTICK_TCO55 - Compute Capacity
 395
 396   * OPNFV_YARDSTICK_TCO61 - Network Utilization
 397
 398   * OPNFV_YARDSTICK_TCO63 - Storage Capacity
 399
 400   * OPNFV_YARDSTICK_TCO69 - Memory Bandwidth
 401
 402   * OPNFV_YARDSTICK_TCO70 - Latency, Memory Utilization, Throughput, Packet
 403     Loss
 404
 405   * OPNFV_YARDSTICK_TCO71 - Latency, Cache Utilization, Throughput, Packet Loss
 406
 407   * OPNFV_YARDSTICK_TCO72 - Latency, Network Utilization, Throughput, Packet
 408     Loss
 409
 410   * OPNFV_YARDSTICK_TC073 - Network Latency and Throughput Between Nodes
 411
 412   * OPNFV_YARDSTICK_TCO75 - Network Capacity and Scale
 413
 414   * OPNFV_YARDSTICK_TCO76 - Network frame error rate
 415
 416 * Test Cases for OPNFV HA Project:
 417
 418   * OPNFV_YARDSTICK_TCO19 - HA: Control node Openstack service down
 419
 420   * OPNFV_YARDSTICK_TC025 - HA: OpenStacK Controller Node abnormally down
 421
 422   * OPNFV_YARDSTICK_TCO45 - HA: Control node Openstack service down - neutron
 423     server
 424
 425   * OPNFV_YARDSTICK_TC046 - HA: Control node Openstack service down - keystone
 426
 427   * OPNFV_YARDSTICK_TCO47 - HA: Control node Openstack service down - glance
 428     api
 429
 430   * OPNFV_YARDSTICK_TC048 - HA: Control node Openstack service down - cinder
 431     api
 432
 433   * OPNFV_YARDSTICK_TCO49 - HA: Control node Openstack service down - swift
 434     proxy
 435
 436   * OPNFV_YARDSTICK_TC050 - HA: OpenStack Controller Node Network High
 437     Availability
 438
 439   * OPNFV_YARDSTICK_TCO51 - HA: OpenStack Controller Node CPU Overload High
 440     Availability
 441
 442   * OPNFV_YARDSTICK_TC052 - HA: OpenStack Controller Node Disk I/O Block High
 443     Availability
 444
 445   * OPNFV_YARDSTICK_TCO53 - HA: OpenStack Controller Load Balance Service High
 446     Availability
 447
 448   * OPNFV_YARDSTICK_TC054 - HA: OpenStack Virtual IP High Availability
 449
 450 * Test Case for OPNFV IPv6 Project:
 451
 452   * OPNFV_YARDSTICK_TCO27 - IPv6 connectivity
 453
 454 * Test Case for OPNFV KVM Project:
 455
 456   * OPNFV_YARDSTICK_TCO28 - KVM Latency measurements
 457
 458 * Test Case for OPNFV Parser Project:
 459
 460   * OPNFV_YARDSTICK_TCO40 - Verify Parser Yang-to-Tosca
 461
 462 * Test Case for OPNFV StorPerf Project:
 463
 464   * OPNFV_YARDSTICK_TCO74 - Storperf
 465
 466 * Test Cases for Virtual Traffic Classifier:
 467
 468   * OPNFV_YARDSTICK_TC006 - Virtual Traffic Classifier Data Plane Throughput
 469 Benchmarking Test
 470
 471   * OPNFV_YARDSTICK_TC007 - Virtual Traffic Classifier Data Plane Throughput
 472 Benchmarking in presence of noisy neighbors Test
 473
 474   * OPNFV_YARDSTICK_TC020 - Virtual Traffic Classifier Instantiation Test
 475
 476   * OPNFV_YARDSTICK_TC021 - Virtual Traffic Classifier Instantiation in
 477 presence of noisy neighbors Test
 478
 479
 480 Version Change
 481 ==============
 482
 483 Module Version Changes
 484 ----------------------
 485
 486 This is the second tracked release of Yardstick. It is based on following
 487 upstream versions:
 488
 489 - ONOS Goldeneye
 490
 491 - OpenStack Newton
 492
 493 - OpenDaylight Beryllium
 494
 495
 496 Document Version Changes
 497 ------------------------
 498
 499 This is the fouth tracked version of the Yardstick framework in OPNFV.
 500 It includes the following documentation updates:
 501
 502 - Yardstick User Guide: add "network service benchmarking(NSB)" chapter;
 503   add "Yardstick - NSB Testing -Installation" chapter;
 504   Update Yardstick installation chapter;
 505
 506 - Yardstick Developer Guide
 507
 508 - Yardstick Code Documentation: no changes
 509
 510 - Yardstick Release Notes for Yardstick: this document
 511
 512 - Test Results report for Danube testing with Yardstick: updated listed of
 513 verified scenarios and limitations
 514
 515
 516 Feature additions
 517 -----------------
 518 - Yardstick ReST API support
 519 - Network service benchmarking
 520
 521 Scenario Matrix
 522 ===============
 523
 524 For Danube 1.0, Yardstick was tested on the following scenarios:
 525
 526 +-------------------------+---------+---------+---------+---------+
 527 |         Scenario        |  Apex   | Compass |  Fuel   |   Joid  |
 528 +=========================+=========+=========+=========+=========+
 529 | os-nosdn-nofeature-noha |         |         |    X    |    X    |
 530 +-------------------------+---------+---------+---------+---------+
 531 | os-nosdn-nofeature-ha   |    X    |    X    |    X    |    X    |
 532 +-------------------------+---------+---------+---------+---------+
 533 | os-odl_l2-nofeature-ha  |         |    X    |    X    |    X    |
 534 +-------------------------+---------+---------+---------+---------+
 535 | os-odl_l2-nofeature-noha|         |         |    X    |         |
 536 +-------------------------+---------+---------+---------+---------+
 537 | os-odl_l3-nofeature-ha  |    X    |    X    |    X    |         |
 538 +-------------------------+---------+---------+---------+---------+
 539 | os-odl_l3-nofeature-noha|         |         |    X    |         |
 540 +-------------------------+---------+---------+---------+---------+
 541 | os-onos-sfc-ha          |         |         |         |         |
 542 +-------------------------+---------+---------+---------+---------+
 543 | os-onos-nofeature-ha    |         |    X    |         |    X    |
 544 +-------------------------+---------+---------+---------+---------+
 545 | os-onos-nofeature-noha  |         |         |         |         |
 546 +-------------------------+---------+---------+---------+---------+
 547 | os-odl_l2-sfc-ha        |         |         |    X    |         |
 548 +-------------------------+---------+---------+---------+---------+
 549 | os-odl_l2-sfc-noha      |         |         |    X    |         |
 550 +-------------------------+---------+---------+---------+---------+
 551 | os-odl_l2-bgpvpn-ha     |    X    |         |    X    |         |
 552 +-------------------------+---------+---------+---------+---------+
 553 | os-odl_l2-bgpvpn-noha   |         |         |    X    |         |
 554 +-------------------------+---------+---------+---------+---------+
 555 | os-nosdn-kvm-ha         |    X    |         |    X    |         |
 556 +-------------------------+---------+---------+---------+---------+
 557 | os-nosdn-kvm-noha       |         |         |    X    |         |
 558 +-------------------------+---------+---------+---------+---------+
 559 | os-nosdn-ovs-ha         |         |         |    X    |         |
 560 +-------------------------+---------+---------+---------+---------+
 561 | os-nosdn-ovs-noha       |         |         |    X    |         |
 562 +-------------------------+---------+---------+---------+---------+
 563 | os-ocl-nofeature-ha     |         |    X    |         |         |
 564 +-------------------------+---------+---------+---------+---------+
 565 | os-nosdn-lxd-ha         |         |         |         |    X    |
 566 +-------------------------+---------+---------+---------+---------+
 567 | os-nosdn-lxd-noha       |         |         |         |    X    |
 568 +-------------------------+---------+---------+---------+---------+
 569 | os-nosdn-fdio-ha        |    X    |         |         |         |
 570 +-------------------------+---------+---------+---------+---------+
 571 | os-odl_l2-fdio-noha     |    X    |         |         |         |
 572 +-------------------------+---------+---------+---------+---------+
 573 | os-odl-gluon-noha       |    X    |         |         |         |
 574 +-------------------------+---------+---------+---------+---------+
 575 | os-nosdn-openo-ha       |         |    X    |         |         |
 576 +-------------------------+---------+---------+---------+---------+
 577 | os-nosdn-kvm_ovs_dpdk   |         |         |    X    |         |
 578 | -noha                   |         |         |         |         |
 579 +-------------------------+---------+---------+---------+---------+
 580 | os-nosdn-kvm_ovs_dpdk-ha|         |         |    X    |         |
 581 +-------------------------+---------+---------+---------+---------+
 582 | os-nosdn-kvm_ovs_dpdk   |         |         |    X    |         |
 583 | _bar-ha                 |         |         |         |         |
 584 +-------------------------+---------+---------+---------+---------+
 585 | os-nosdn-kvm_ovs_dpdk   |         |         |    X    |         |
 586 | _bar-noha               |         |         |         |         |
 587 +-------------------------+---------+---------+---------+---------+
 588
 589
 590 Test results
 591 ============
 592
 593 Test results are available in:
 594
 595  - jenkins logs on CI: https://build.opnfv.org/ci/view/yardstick/
 596
 597 The reporting pages can be found at:
 598
 599  * apex: http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-apex.html
 600  * compass: http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-compass.html
 601  * fuel: http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-fuel.html
 602  * joid: http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-joid.html
 603
 604 You can get additional details through test logs on http://artifacts.opnfv.org/.
 605 As no search engine is available on the OPNFV artifact web site you must
 606 retrieve the pod identifier on which the tests have been executed (see
 607 field pod in any of the results) then click on the selected POD and look
 608 for the date of the test you are interested in.
 609
 610
 611 Known Issues/Faults
 612 ------------
 613  - Floating IP not supported in bgpvpn scenario
 614  - VM instance cannot get floating IP in compass-os-odl_l2-nofeature-ha scenario
 615
 616 .. note:: The faults not related to *Yardstick* framework, addressing scenarios
 617   which were not fully verified, are listed in the OPNFV installer's release
 618   notes.
 619
 620
 621 Corrected Faults
 622 ----------------
 623
 624
 625 Danube.1.0:
 626
 627 +----------------------------+------------------------------------------------+
 628 | **JIRA REFERENCE**         | **SLOGAN**                                     |
 629 |                            |                                                |
 630 +----------------------------+------------------------------------------------+
 631 | JIRA: YARDSTICK-593        | fix yardstick-image built without test tools   |
 632 |                            |                                                |
 633 +----------------------------+------------------------------------------------+
 634 | JIRA: YARDSTICK-599        | Could not load EntryPoint.parse when using     |
 635 |                            | 'openstack -h'                                 |
 636 +----------------------------+------------------------------------------------+
 637 | JIRA: YARDSTICK-600        | netperf_bottleneck execute failed because      |
 638 |                            | is_same_heat_context return True               |
 639 +----------------------------+------------------------------------------------+
 640 | JIRA: YARDSTICK-602        | Don't rely on staic ip addresses as they       |
 641 |                            | are dynamic                                    |
 642 +----------------------------+------------------------------------------------+
 643 | JIRA: YARDSTICK-604        | add storperf flavor for TC074                  |
 644 |                            |                                                |
 645 +----------------------------+------------------------------------------------+
 646 | JIRA: YARDSTICK-605        | pathspec 'master' did not match any file(s)    |
 647 |                            | known to git                                   |
 648 +----------------------------+------------------------------------------------+
 649 | JIRA: YARDSTICK-607        | Error validating value 'cirros-0.3.5'          |
 650 |                            |                                                |
 651 +----------------------------+------------------------------------------------+
 652 | JIRA: YARDSTICK-609        | Remove improper license header in swagger docs |
 653 |                            |                                                |
 654 +----------------------------+------------------------------------------------+
 655
 656
 657 Danube 1.0 known restrictions/issues
 658 ====================================
 659 +-----------+-----------+----------------------------------------------+
 660 | Installer | Scenario  |  Issue                                       |
 661 +===========+===========+==============================================+
 662 | any       | *-bgpvpn  | Floating ips not supported. Some Test cases  |
 663 |           |           | related to floating ips are excluded.        |
 664 +-----------+-----------+----------------------------------------------+
 665 | any       | odl_l3-*  | Some test cases related to using floating IP |
 666 |           |           | addresses fail because of a known ODL bug.   |
 667 |           |           |                                              |
 668 +-----------+-----------+----------------------------------------------+
 669 | compass   | odl_l2-*  | In some test cases, VM instance will failed  |
 670 |           |           | raising network interfaces.                  |
 671 |           |           |                                              |
 672 +-----------+-----------+----------------------------------------------+
 673
 674
 675
 676 Open JIRA tickets
 677 =================
 678
 679 +----------------------------+------------------------------------------------+
 680 | **JIRA REFERENCE**         | **SLOGAN**                                     |
 681 |                            |                                                |
 682 +----------------------------+------------------------------------------------+
 683 | JIRA: YARDSTICK-603        | Timeout waiting for floating ip                |
 684 |                            | (which actually pingable)                      |
 685 +----------------------------+------------------------------------------------+
 686 | JIRA: YARDSTICK-412        | IPv6 test case should add support for newton   |
 687 |                            |                                                |
 688 +----------------------------+------------------------------------------------+
 689
 690 Useful links
 691 ============
 692
 693  - wiki project page: https://wiki.opnfv.org/display/yardstick/Yardstick
 694
 695  - wiki Yardstick Danube release planing page: https://wiki.opnfv.org/display/yardstick/Yardstick+Danube+Release+Planning
 696
 697  - wiki Yardstick Danube release jira page: https://wiki.opnfv.org/display/yardstick/Jira+Yardstick-Danube
 698
 699  - Yardstick repo: https://git.opnfv.org/cgit/yardstick
 700
 701  - Yardstick CI dashboard: https://build.opnfv.org/ci/view/yardstick
 702
 703  - Yardstick grafana dashboard: http://testresults.opnfv.org/grafana/
 704
 705  - Yardstick IRC chanel: #opnfv-yardstick