docs/release/release-notes/release-notes.rst

   1 =======
   2 License
   3 =======
   4
   5 OPNFV Danube release note for Yardstick Docs
   6 are licensed under a Creative Commons Attribution 4.0 International License.
   7 You should have received a copy of the license along with this.
   8 If not, see <http://creativecommons.org/licenses/by/4.0/>.
   9
  10 The *Yardstick framework*, the *Yardstick test cases* and the *ApexLake*
  11 experimental framework are opensource software, licensed under the terms of the
  12 Apache License, Version 2.0.
  13
  14 =========================================
  15 OPNFV Danube Release Note for Yardstick
  16 =========================================
  17
  18 .. toctree::
  19    :maxdepth: 2
  20
  21 .. _Yardstick: https://wiki.opnfv.org/yardstick
  22
  23 .. _Dashboard: http://testresults.opnfv.org/grafana/dashboard/db/yardstick-main
  24
  25 .. _NFV-TST001: http://www.etsi.org/deliver/etsi_gs/NFV-TST/001_099/001/01.01.01_60/gs_NFV-TST001v010101p.pdf
  26
  27
  28 Abstract
  29 ========
  30
  31 This document describes the release note of Yardstick project.
  32
  33
  34 Version History
  35 ===============
  36
  37 +----------------+--------------------+---------------------------------+
  38 | *Date*         | *Version*          | *Comment*                       |
  39 |                |                    |                                 |
  40 +----------------+--------------------+---------------------------------+
  41 |                |  3.0               | Yardstick for Danube release    |
  42 |                |                    |                                 |
  43 +----------------+--------------------+---------------------------------+
  44 | May 4th, 2017  |  2.0               | Yardstick for Danube release    |
  45 |                |                    |                                 |
  46 +----------------+--------------------+---------------------------------+
  47 | Mar 31st, 2017 |  1.0               | Yardstick for Danube release    |
  48 |                |                    |                                 |
  49 +----------------+--------------------+---------------------------------+
  50
  51
  52 Important Notes
  53 ===============
  54
  55 The software delivered in the OPNFV Yardstick_ Project, comprising the
  56 *Yardstick framework*, the *Yardstick test cases* and the experimental
  57 framework *Apex Lake* is a realization of the methodology in ETSI-ISG
  58 NFV-TST001_.
  59
  60 The *Yardstick* framework is *installer*, *infrastructure* and *application*
  61 independent.
  62
  63
  64 OPNFV Danube Release
  65 ======================
  66
  67 This Danube release provides *Yardstick* as a framework for NFVI testing
  68 and OPNFV feature testing, automated in the OPNFV CI pipeline, including:
  69
  70 * Documentation generated with Sphinx
  71
  72   * User Guide
  73
  74   * Developer Guide
  75
  76   * Release notes (this document)
  77
  78   * Results
  79
  80 * Automated Yardstick test suite (daily, weekly)
  81
  82   * Jenkins Jobs for OPNFV community labs
  83
  84 * Automated Yardstick test results visualization
  85
  86   * Dashboard_ using Grafana (user:opnfv/password: opnfv), influxDB is used as
  87     backend
  88
  89 * Yardstick framework source code
  90
  91 * Yardstick test cases yaml files
  92
  93 * Yardstick plug-in configration yaml files, plug-in install/remove scripts
  94
  95 For Danube release, the *Yardstick framework* is used for the following
  96 testing:
  97
  98 * OPNFV platform testing - generic test cases to measure the categories:
  99
 100   * Compute
 101
 102   * Network
 103
 104   * Storage
 105
 106 * OPNFV platform network service benchmarking(NSB)
 107
 108   * NSB
 109
 110 * Test cases for the following OPNFV Projects:
 111
 112   * High Availability
 113
 114   * IPv6
 115
 116   * KVM
 117
 118   * Parser
 119
 120   * StorPerf
 121
 122   * VSperf
 123
 124   * virtual Traffic Classifier
 125
 126 The *Yardstick framework* is developed in the OPNFV community, by the
 127 Yardstick_ team. The *virtual Traffic Classifier* is a part of the Yardstick
 128 Project.
 129
 130 .. note:: The test case description template used for the Yardstick test cases
 131   is based on the document ETSI-ISG NFV-TST001_; the results report template
 132   used for the Yardstick results is based on the IEEE Std 829-2008.
 133
 134
 135 Release Data
 136 ============
 137
 138 +--------------------------------------+--------------------------------------+
 139 | **Project**                          | Yardstick                            |
 140 |                                      |                                      |
 141 +--------------------------------------+--------------------------------------+
 142 | **Repo/tag**                         | yardstick/Danube.2.0                 |
 143 |                                      |                                      |
 144 +--------------------------------------+--------------------------------------+
 145 | **Yardstick Docker image tag**       | Danube.2.0                           |
 146 |                                      |                                      |
 147 +--------------------------------------+--------------------------------------+
 148 | **Release designation**              | Danube                               |
 149 |                                      |                                      |
 150 +--------------------------------------+--------------------------------------+
 151 | **Release date**                     | May 4th, 2017                        |
 152 |                                      |                                      |
 153 +--------------------------------------+--------------------------------------+
 154 | **Purpose of the delivery**          | OPNFV Danube release 2.0             |
 155 |                                      |                                      |
 156 +--------------------------------------+--------------------------------------+
 157
 158
 159 Deliverables
 160 ============
 161
 162 Documents
 163 ---------
 164
 165  - User Guide: http://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/index.html
 166
 167  - Developer Guide: http://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/developer/devguide/index.html
 168
 169
 170 Software Deliverables
 171 ---------------------
 172
 173
 174  - The Yardstick Docker image: https://hub.docker.com/r/opnfv/yardstick (tag: danube.2.0)
 175
 176
 177 **Contexts**
 178
 179 +---------------------+-------------------------------------------------------+
 180 | **Context**         | **Description**                                       |
 181 |                     |                                                       |
 182 +---------------------+-------------------------------------------------------+
 183 | *Heat*              | Models orchestration using OpenStack Heat             |
 184 |                     |                                                       |
 185 +---------------------+-------------------------------------------------------+
 186 | *Node*              | Models Baremetal, Controller, Compute                 |
 187 |                     |                                                       |
 188 +---------------------+-------------------------------------------------------+
 189 | *Standalone*        | Models VM running on Non-Managed NFVi                 |
 190 |                     |                                                       |
 191 +---------------------+-------------------------------------------------------+
 192
 193
 194 **Runners**
 195
 196 +---------------------+-------------------------------------------------------+
 197 | **Runner**          | **Description**                                       |
 198 |                     |                                                       |
 199 +---------------------+-------------------------------------------------------+
 200 | *Arithmetic*        | Steps every run arithmetically according to specified |
 201 |                     | input value                                           |
 202 |                     |                                                       |
 203 +---------------------+-------------------------------------------------------+
 204 | *Duration*          | Runs for a specified period of time                   |
 205 |                     |                                                       |
 206 +---------------------+-------------------------------------------------------+
 207 | *Iteration*         | Runs for a specified number of iterations             |
 208 |                     |                                                       |
 209 +---------------------+-------------------------------------------------------+
 210 | *Sequence*          | Selects input value to a scenario from an input file  |
 211 |                     | and runs all entries sequentially                     |
 212 |                     |                                                       |
 213 +---------------------+-------------------------------------------------------+
 214
 215
 216 **Scenarios**
 217
 218 +---------------------+-------------------------------------------------------+
 219 | **Category**        | **Delivered**                                         |
 220 |                     |                                                       |
 221 +---------------------+-------------------------------------------------------+
 222 | *Availability*      | Attacker:                                             |
 223 |                     |                                                       |
 224 |                     | * baremetal, process                                  |
 225 |                     |                                                       |
 226 |                     | HA tools:                                             |
 227 |                     |                                                       |
 228 |                     | * check host, openstack, process, service             |
 229 |                     | * kill process                                        |
 230 |                     | * start/stop service                                  |
 231 |                     |                                                       |
 232 |                     | Monitor:                                              |
 233 |                     |                                                       |
 234 |                     | * command, process                                    |
 235 |                     |                                                       |
 236 +---------------------+-------------------------------------------------------+
 237 | *Compute*           | * cpuload                                             |
 238 |                     |                                                       |
 239 |                     | * cyclictest                                          |
 240 |                     |                                                       |
 241 |                     | * lmbench                                             |
 242 |                     |                                                       |
 243 |                     | * lmbench_cache                                       |
 244 |                     |                                                       |
 245 |                     | * perf                                                |
 246 |                     |                                                       |
 247 |                     | * unixbench                                           |
 248 |                     |                                                       |
 249 |                     | * ramspeed                                            |
 250 |                     |                                                       |
 251 |                     | * cachestat                                           |
 252 |                     |                                                       |
 253 |                     | * memeoryload                                         |
 254 |                     |                                                       |
 255 |                     | * computecapacity                                     |
 256 |                     |                                                       |
 257 +---------------------+-------------------------------------------------------+
 258 | *Networking*        | * iperf3                                              |
 259 |                     |                                                       |
 260 |                     | * netperf                                             |
 261 |                     |                                                       |
 262 |                     | * netperf_node                                        |
 263 |                     |                                                       |
 264 |                     | * ping                                                |
 265 |                     |                                                       |
 266 |                     | * ping6                                               |
 267 |                     |                                                       |
 268 |                     | * pktgen                                              |
 269 |                     |                                                       |
 270 |                     | * sfc                                                 |
 271 |                     |                                                       |
 272 |                     | * sfc with tacker                                     |
 273 |                     |                                                       |
 274 |                     | * vtc instantion validation                           |
 275 |                     |                                                       |
 276 |                     | * vtc instantion validation with noisy neighbors      |
 277 |                     |                                                       |
 278 |                     | * vtc throughput                                      |
 279 |                     |                                                       |
 280 |                     | * vtc throughput in the presence of noisy neighbors   |
 281 |                     |                                                       |
 282 |                     | * networkcapacity                                     |
 283 |                     |                                                       |
 284 |                     | * netutilization                                      |
 285 |                     |                                                       |
 286 |                     | * nstat                                               |
 287 |                     |                                                       |
 288 +---------------------+-------------------------------------------------------+
 289 | *Parser*            | Tosca2Heat                                            |
 290 |                     |                                                       |
 291 +---------------------+-------------------------------------------------------+
 292 | *Storage*           | fio                                                   |
 293 |                     |                                                       |
 294 |                     | storagecapacity                                       |
 295 |                     |                                                       |
 296 +---------------------+-------------------------------------------------------+
 297 | *StorPerf*          | storperf                                              |
 298 |                     |                                                       |
 299 +---------------------+-------------------------------------------------------+
 300 | *NSB*               | vPE thoughput test case                               |
 301 |                     |                                                       |
 302 +---------------------+-------------------------------------------------------+
 303
 304
 305 **API to Other Frameworks**
 306
 307 +---------------------+-------------------------------------------------------+
 308 | **Framework**       | **Description**                                       |
 309 |                     |                                                       |
 310 +---------------------+-------------------------------------------------------+
 311 | *ApexLake*          | Experimental framework that enables the user to       |
 312 |                     | validate NFVI from the perspective of a VNF.          |
 313 |                     | A virtual Traffic Classifier is utilized as VNF.      |
 314 |                     | Enables experiments with SR-IOV on Compute Node.      |
 315 |                     |                                                       |
 316 +---------------------+-------------------------------------------------------+
 317
 318
 319 **Test Results Output**
 320
 321 +-----------------------------+-----------------------------------------------+
 322 | **Dispatcher**              | **Description**                               |
 323 |                             |                                               |
 324 +-----------------------------+-----------------------------------------------+
 325 |  file                       | Log to a file.                                |
 326 |                             |                                               |
 327 +-----------------------------+-----------------------------------------------+
 328 |  http                       | Post data to html.                            |
 329 |                             |                                               |
 330 +-----------------------------+-----------------------------------------------+
 331 |  influxdb                   | Post data to influxDB.                        |
 332 |                             |                                               |
 333 +-----------------------------+-----------------------------------------------+
 334
 335
 336 Delivered Test cases
 337 --------------------
 338
 339 * Generic NFVI test cases
 340
 341   * OPNFV_YARDSTICK_TCOO1 - NW Performance
 342
 343   * OPNFV_YARDSTICK_TCOO2 - NW Latency
 344
 345   * OPNFV_YARDSTICK_TCOO4 - Cache Utilization
 346
 347   * OPNFV_YARDSTICK_TCOO5 - Storage Performance
 348
 349   * OPNFV_YARDSTICK_TCOO8 - Packet Loss Extended Test
 350
 351   * OPNFV_YARDSTICK_TCOO9 - Packet Loss
 352
 353   * OPNFV_YARDSTICK_TCO10 - Memory Latency
 354
 355   * OPNFV_YARDSTICK_TCO11 - Packet Delay Variation Between VMs
 356
 357   * OPNFV_YARDSTICK_TCO12 - Memory Bandwidth
 358
 359   * OPNFV_YARDSTICK_TCO14 - Processing Speed
 360
 361   * OPNFV_YARDSTICK_TCO24 - CPU Load
 362
 363   * OPNFV_YARDSTICK_TCO37 - Latency, CPU Load, Throughput, Packet Loss
 364
 365   * OPNFV_YARDSTICK_TCO38 - Latency, CPU Load, Throughput, Packet Loss Extended
 366     Test
 367
 368   * OPNFV_YARDSTICK_TCO42 - Network Performance
 369
 370   * OPNFV_YARDSTICK_TCO43 - Network Latency Between NFVI Nodes
 371
 372   * OPNFV_YARDSTICK_TCO44 - Memory Utilization
 373
 374   * OPNFV_YARDSTICK_TCO55 - Compute Capacity
 375
 376   * OPNFV_YARDSTICK_TCO61 - Network Utilization
 377
 378   * OPNFV_YARDSTICK_TCO63 - Storage Capacity
 379
 380   * OPNFV_YARDSTICK_TCO69 - Memory Bandwidth
 381
 382   * OPNFV_YARDSTICK_TCO70 - Latency, Memory Utilization, Throughput, Packet
 383     Loss
 384
 385   * OPNFV_YARDSTICK_TCO71 - Latency, Cache Utilization, Throughput, Packet Loss
 386
 387   * OPNFV_YARDSTICK_TCO72 - Latency, Network Utilization, Throughput, Packet
 388     Loss
 389
 390   * OPNFV_YARDSTICK_TC073 - Network Latency and Throughput Between Nodes
 391
 392   * OPNFV_YARDSTICK_TCO75 - Network Capacity and Scale
 393
 394   * OPNFV_YARDSTICK_TCO76 - Network frame error rate
 395
 396 * Test Cases for OPNFV HA Project:
 397
 398   * OPNFV_YARDSTICK_TCO19 - HA: Control node Openstack service down
 399
 400   * OPNFV_YARDSTICK_TC025 - HA: OpenStacK Controller Node abnormally down
 401
 402   * OPNFV_YARDSTICK_TCO45 - HA: Control node Openstack service down - neutron
 403     server
 404
 405   * OPNFV_YARDSTICK_TC046 - HA: Control node Openstack service down - keystone
 406
 407   * OPNFV_YARDSTICK_TCO47 - HA: Control node Openstack service down - glance
 408     api
 409
 410   * OPNFV_YARDSTICK_TC048 - HA: Control node Openstack service down - cinder
 411     api
 412
 413   * OPNFV_YARDSTICK_TCO49 - HA: Control node Openstack service down - swift
 414     proxy
 415
 416   * OPNFV_YARDSTICK_TC050 - HA: OpenStack Controller Node Network High
 417     Availability
 418
 419   * OPNFV_YARDSTICK_TCO51 - HA: OpenStack Controller Node CPU Overload High
 420     Availability
 421
 422   * OPNFV_YARDSTICK_TC052 - HA: OpenStack Controller Node Disk I/O Block High
 423     Availability
 424
 425   * OPNFV_YARDSTICK_TCO53 - HA: OpenStack Controller Load Balance Service High
 426     Availability
 427
 428   * OPNFV_YARDSTICK_TC054 - HA: OpenStack Virtual IP High Availability
 429
 430 * Test Case for OPNFV IPv6 Project:
 431
 432   * OPNFV_YARDSTICK_TCO27 - IPv6 connectivity
 433
 434 * Test Case for OPNFV KVM Project:
 435
 436   * OPNFV_YARDSTICK_TCO28 - KVM Latency measurements
 437
 438 * Test Case for OPNFV Parser Project:
 439
 440   * OPNFV_YARDSTICK_TCO40 - Verify Parser Yang-to-Tosca
 441
 442 * Test Case for OPNFV StorPerf Project:
 443
 444   * OPNFV_YARDSTICK_TCO74 - Storperf
 445
 446 * Test Cases for Virtual Traffic Classifier:
 447
 448   * OPNFV_YARDSTICK_TC006 - Virtual Traffic Classifier Data Plane Throughput
 449
 450 * Benchmarking Test:
 451
 452   * OPNFV_YARDSTICK_TC007 - Virtual Traffic Classifier Data Plane Throughput
 453
 454 * Benchmarking in presence of noisy neighbors Test:
 455
 456   * OPNFV_YARDSTICK_TC020 - Virtual Traffic Classifier Instantiation Test
 457
 458   * OPNFV_YARDSTICK_TC021 - Virtual Traffic Classifier Instantiation in
 459     presence of noisy neighbors Test
 460
 461
 462 Version Change
 463 ==============
 464
 465 Module Version Changes
 466 ----------------------
 467
 468 This is the fourth tracked release of Yardstick. It is based on following
 469 upstream versions:
 470
 471 - ONOS Ibis
 472
 473 - OpenStack Newton
 474
 475 - OpenDaylight Boron
 476
 477
 478 Document Version Changes
 479 ------------------------
 480
 481 This is the fourth tracked version of the Yardstick framework in OPNFV.
 482 It includes the following documentation updates:
 483
 484 - Yardstick User Guide: add "network service benchmarking(NSB)" chapter;
 485   add "Yardstick - NSB Testing -Installation" chapter; add "Yardstick API" chapter;
 486   add "Yardstick user interface" chapter; Update Yardstick installation chapter;
 487
 488 - Yardstick Developer Guide
 489
 490 - Yardstick Release Notes for Yardstick: this document
 491
 492
 493 Feature additions
 494 -----------------
 495
 496 - Yardstick RESTful API support
 497
 498 - Introduce Network service benchmarking
 499
 500 - Introduce stress testing with Bottlenecks team
 501
 502 - Yardstick framework improvement:
 503
 504   - Parellel test cases execution support
 505
 506   - yardstick report CLI
 507
 508   - Node context support openstack configuration via Ansible
 509
 510   - Https support
 511
 512 - Python 3 support
 513
 514
 515 Scenario Matrix
 516 ===============
 517
 518 For Danube 2.0, Yardstick was tested on the following scenarios:
 519
 520 +-------------------------+---------+---------+---------+---------+
 521 |         Scenario        |  Apex   | Compass |  Fuel   |   Joid  |
 522 +=========================+=========+=========+=========+=========+
 523 | os-nosdn-nofeature-noha |         |         |    X    |    X    |
 524 +-------------------------+---------+---------+---------+---------+
 525 | os-nosdn-nofeature-ha   |    X    |    X    |    X    |    X    |
 526 +-------------------------+---------+---------+---------+---------+
 527 | os-odl_l2-nofeature-ha  |         |    X    |    X    |    X    |
 528 +-------------------------+---------+---------+---------+---------+
 529 | os-odl_l2-nofeature-noha|         |         |    X    |         |
 530 +-------------------------+---------+---------+---------+---------+
 531 | os-odl_l3-nofeature-ha  |    X    |    X    |    X    |         |
 532 +-------------------------+---------+---------+---------+---------+
 533 | os-odl_l3-nofeature-noha|         |         |    X    |         |
 534 +-------------------------+---------+---------+---------+---------+
 535 | os-onos-sfc-ha          |         |         |         |         |
 536 +-------------------------+---------+---------+---------+---------+
 537 | os-onos-nofeature-ha    |         |    X    |         |    X    |
 538 +-------------------------+---------+---------+---------+---------+
 539 | os-onos-nofeature-noha  |         |         |         |         |
 540 +-------------------------+---------+---------+---------+---------+
 541 | os-odl_l2-sfc-ha        |         |         |    X    |         |
 542 +-------------------------+---------+---------+---------+---------+
 543 | os-odl_l2-sfc-noha      |         |         |    X    |         |
 544 +-------------------------+---------+---------+---------+---------+
 545 | os-odl_l2-bgpvpn-ha     |    X    |         |    X    |         |
 546 +-------------------------+---------+---------+---------+---------+
 547 | os-odl_l2-bgpvpn-noha   |         |         |    X    |         |
 548 +-------------------------+---------+---------+---------+---------+
 549 | os-nosdn-kvm-ha         |    X    |         |    X    |         |
 550 +-------------------------+---------+---------+---------+---------+
 551 | os-nosdn-kvm-noha       |         |         |    X    |         |
 552 +-------------------------+---------+---------+---------+---------+
 553 | os-nosdn-ovs-ha         |         |         |    X    |         |
 554 +-------------------------+---------+---------+---------+---------+
 555 | os-nosdn-ovs-noha       |         |         |    X    |         |
 556 +-------------------------+---------+---------+---------+---------+
 557 | os-ocl-nofeature-ha     |         |    X    |         |         |
 558 +-------------------------+---------+---------+---------+---------+
 559 | os-nosdn-lxd-ha         |         |         |         |    X    |
 560 +-------------------------+---------+---------+---------+---------+
 561 | os-nosdn-lxd-noha       |         |         |         |    X    |
 562 +-------------------------+---------+---------+---------+---------+
 563 | os-nosdn-fdio-ha        |    X    |         |         |         |
 564 +-------------------------+---------+---------+---------+---------+
 565 | os-odl_l2-fdio-noha     |    X    |         |         |         |
 566 +-------------------------+---------+---------+---------+---------+
 567 | os-odl-gluon-noha       |    X    |         |         |         |
 568 +-------------------------+---------+---------+---------+---------+
 569 | os-nosdn-openo-ha       |         |    X    |         |         |
 570 +-------------------------+---------+---------+---------+---------+
 571 | os-nosdn-kvm_ovs_dpdk   |         |         |    X    |         |
 572 | -noha                   |         |         |         |         |
 573 +-------------------------+---------+---------+---------+---------+
 574 | os-nosdn-kvm_ovs_dpdk-ha|         |         |    X    |         |
 575 +-------------------------+---------+---------+---------+---------+
 576 | os-nosdn-kvm_ovs_dpdk   |         |         |    X    |         |
 577 | _bar-ha                 |         |         |         |         |
 578 +-------------------------+---------+---------+---------+---------+
 579 | os-nosdn-kvm_ovs_dpdk   |         |         |    X    |         |
 580 | _bar-noha               |         |         |         |         |
 581 +-------------------------+---------+---------+---------+---------+
 582 | opnfv_os-ovn-nofeature- |    X    |         |         |         |
 583 | noha_daily              |         |         |         |         |
 584 +-------------------------+---------+---------+---------+---------+
 585
 586 Test results
 587 ============
 588
 589 Test results are available in:
 590
 591  - jenkins logs on CI: https://build.opnfv.org/ci/view/yardstick/
 592
 593 The reporting pages can be found at:
 594
 595  * apex: http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-apex.html
 596  * compass: http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-compass.html
 597  * fuel: http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-fuel.html
 598  * joid: http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-joid.html
 599
 600
 601 Known Issues/Faults
 602 ------------
 603
 604  - Floating IP not supported in bgpvpn scenario
 605
 606  - VM instance cannot get floating IP in compass-os-odl_l2-nofeature-ha scenario
 607
 608 .. note:: The faults not related to *Yardstick* framework, addressing scenarios
 609   which were not fully verified, are listed in the OPNFV installer's release
 610   notes.
 611
 612
 613 Corrected Faults
 614 ----------------
 615
 616 Danube.2.0:
 617
 618 +----------------------------+------------------------------------------------+
 619 | **JIRA REFERENCE**         | **SLOGAN**                                     |
 620 |                            |                                                |
 621 +----------------------------+------------------------------------------------+
 622 | JIRA: YARDSTICK-608        | Set work directory in Yardstick container      |
 623 |                            |                                                |
 624 +----------------------------+------------------------------------------------+
 625 | JIRA: YARDSTICK-616        | Bugfix: https support should adapt insecure    |
 626 |                            | situation                                      |
 627 +----------------------------+------------------------------------------------+
 628 | JIRA: YARDSTICK-620        | Yardstick virtualenv support                   |
 629 |                            |                                                |
 630 +----------------------------+------------------------------------------------+
 631 | JIRA: YARDSTICK-621        | Bugfix: fix query job status in TC074          |
 632 |                            |                                                |
 633 +----------------------------+------------------------------------------------+
 634 | JIRA: YARDSTICK-622        | Bugfix: take test case modification into       |
 635 |                            | effect in load_images.sh                       |
 636 +----------------------------+------------------------------------------------+
 637 | JIRA: YARDSTICK-623        | change openrc file path to                     |
 638 |                            | /etc/yardstick/openstack.creds                 |
 639 +----------------------------+------------------------------------------------+
 640 | JIRA: YARDSTICK-624        | Add opnfv_os-ovn-nofeature-noha_daily test     |
 641 |                            | suite                                          |
 642 +----------------------------+------------------------------------------------+
 643 | JIRA: YARDSTICK-628        | Bugfix: Make tc019 and tc025 accept            |
 644 |                            | --task-args options                            |
 645 +----------------------------+------------------------------------------------+
 646 | JIRA: YARDSTICK-629        | Bugfix: yardstick env prepare cmd do not       |
 647 |                            | support other installer                        |
 648 +----------------------------+------------------------------------------------+
 649 | JIRA: YARDSTICK-632        | Bugfix: KeyError when using http dispatcher    |
 650 |                            |                                                |
 651 +----------------------------+------------------------------------------------+
 652 | JIRA: YARDSTICK-633        | Bugfix: Environment Compatibility Issues in HA |
 653 |                            | Test Cases                                     |
 654 +----------------------------+------------------------------------------------+
 655 | JIRA: YARDSTICK-634        | fix ha issue when run tc050~tc054 in ci        |
 656 |                            |                                                |
 657 +----------------------------+------------------------------------------------+
 658 | JIRA: YARDSTICK-635        | Bugfix: Local Openstack Operation in HA test   |
 659 |                            | frameworks                                     |
 660 +----------------------------+------------------------------------------------+
 661
 662 Danube.1.0:
 663
 664 +----------------------------+------------------------------------------------+
 665 | **JIRA REFERENCE**         | **SLOGAN**                                     |
 666 |                            |                                                |
 667 +----------------------------+------------------------------------------------+
 668 | JIRA: YARDSTICK-599        | Could not load EntryPoint.parse when using     |
 669 |                            | 'openstack -h'                                 |
 670 +----------------------------+------------------------------------------------+
 671 | JIRA: YARDSTICK-602        | Don't rely on staic ip addresses as they       |
 672 |                            | are dynamic                                    |
 673 +----------------------------+------------------------------------------------+
 674
 675
 676 Danube 2.0 known restrictions/issues
 677 ====================================
 678 +-----------+-----------+----------------------------------------------+
 679 | Installer | Scenario  |  Issue                                       |
 680 +===========+===========+==============================================+
 681 | any       | *-bgpvpn  | Floating ips not supported. Some Test cases  |
 682 |           |           | related to floating ips are excluded.        |
 683 +-----------+-----------+----------------------------------------------+
 684 | any       | odl_l3-*  | Some test cases related to using floating IP |
 685 |           |           | addresses fail because of a known ODL bug.   |
 686 |           |           |                                              |
 687 +-----------+-----------+----------------------------------------------+
 688 | compass   | odl_l2-*  | In some test cases, VM instance will failed  |
 689 |           |           | raising network interfaces.                  |
 690 |           |           |                                              |
 691 +-----------+-----------+----------------------------------------------+
 692
 693
 694 Open JIRA tickets
 695 =================
 696
 697 +----------------------------+------------------------------------------------+
 698 | **JIRA REFERENCE**         | **SLOGAN**                                     |
 699 |                            |                                                |
 700 +----------------------------+------------------------------------------------+
 701 | JIRA: YARDSTICK-626        | Fio and Lmbench don't work in Ubuntu-arm64     |
 702 |                            | image                                          |
 703 +----------------------------+------------------------------------------------+
 704 | JIRA: YARDSTICK-603        | Timeout waiting for floating ip                |
 705 |                            | (which actually pingable)                      |
 706 +----------------------------+------------------------------------------------+
 707 | JIRA: YARDSTICK-412        | IPv6 test case should add support for newton   |
 708 |                            |                                                |
 709 +----------------------------+------------------------------------------------+
 710
 711
 712 Useful links
 713 ============
 714
 715  - wiki project page: https://wiki.opnfv.org/display/yardstick/Yardstick
 716
 717  - wiki Yardstick Danube release planing page: https://wiki.opnfv.org/display/yardstick/Yardstick+Danube+Release+Planning
 718
 719  - Yardstick repo: https://git.opnfv.org/cgit/yardstick
 720
 721  - Yardstick CI dashboard: https://build.opnfv.org/ci/view/yardstick
 722
 723  - Yardstick grafana dashboard: http://testresults.opnfv.org/grafana/
 724
 725  - Yardstick IRC chanel: #opnfv-yardstick