docs/release/release-notes/release-notes.rst

   1 =======
   2 License
   3 =======
   4
   5 OPNFV Danube release note for Yardstick Docs
   6 are licensed under a Creative Commons Attribution 4.0 International License.
   7 You should have received a copy of the license along with this.
   8 If not, see <http://creativecommons.org/licenses/by/4.0/>.
   9
  10 The *Yardstick framework*, the *Yardstick test cases* and the *ApexLake*
  11 experimental framework are opensource software, licensed under the terms of the
  12 Apache License, Version 2.0.
  13
  14 =========================================
  15 OPNFV Danube Release Note for Yardstick
  16 =========================================
  17
  18 .. toctree::
  19    :maxdepth: 2
  20
  21 .. _Yardstick: https://wiki.opnfv.org/yardstick
  22
  23 .. _Dashboard: http://testresults.opnfv.org/grafana/dashboard/db/yardstick-main
  24
  25 .. _NFV-TST001: http://www.etsi.org/deliver/etsi_gs/NFV-TST/001_099/001/01.01.01_60/gs_NFV-TST001v010101p.pdf
  26
  27
  28 Abstract
  29 ========
  30
  31 This document describes the release note of Yardstick project.
  32
  33
  34 Version History
  35 ===============
  36
  37 +----------------+--------------------+---------------------------------+
  38 | *Date*         | *Version*          | *Comment*                       |
  39 |                |                    |                                 |
  40 +----------------+--------------------+---------------------------------+
  41 |                |  3.0               | Yardstick for Danube release    |
  42 |                |                    |                                 |
  43 +----------------+--------------------+---------------------------------+
  44 |                |  2.0               | Yardstick for Danube release    |
  45 |                |                    |                                 |
  46 +----------------+--------------------+---------------------------------+
  47 | Mar 31st, 2017 |  1.0               | Yardstick for Danube release    |
  48 |                |                    |                                 |
  49 +----------------+--------------------+---------------------------------+
  50
  51
  52 Important Notes
  53 ===============
  54
  55 The software delivered in the OPNFV Yardstick_ Project, comprising the
  56 *Yardstick framework*, the *Yardstick test cases* and the experimental
  57 framework *Apex Lake* is a realization of the methodology in ETSI-ISG
  58 NFV-TST001_.
  59
  60 The *Yardstick* framework is *installer*, *infrastructure* and *application*
  61 independent.
  62
  63
  64 OPNFV Danube Release
  65 ======================
  66
  67 This Danube release provides *Yardstick* as a framework for NFVI testing
  68 and OPNFV feature testing, automated in the OPNFV CI pipeline, including:
  69
  70 * Documentation generated with Sphinx
  71
  72   * User Guide
  73
  74   * Developer Guide
  75
  76   * Release notes (this document)
  77
  78   * Results
  79
  80 * Automated Yardstick test suite (daily, weekly)
  81
  82   * Jenkins Jobs for OPNFV community labs
  83
  84 * Automated Yardstick test results visualization
  85
  86   * Dashboard_ using Grafana (user:opnfv/password: opnfv), influxDB is used as
  87     backend
  88
  89 * Yardstick framework source code
  90
  91 * Yardstick test cases yaml files
  92
  93 * Yardstick plug-in configration yaml files, plug-in install/remove scripts
  94
  95 For Danube release, the *Yardstick framework* is used for the following
  96 testing:
  97
  98 * OPNFV platform testing - generic test cases to measure the categories:
  99
 100   * Compute
 101
 102   * Network
 103
 104   * Storage
 105
 106 * OPNFV platform network service benchmarking(NSB)
 107
 108   * NSB
 109
 110 * Test cases for the following OPNFV Projects:
 111
 112   * High Availability
 113
 114   * IPv6
 115
 116   * KVM
 117
 118   * Parser
 119
 120   * StorPerf
 121
 122   * VSperf
 123
 124   * virtual Traffic Classifier
 125
 126 The *Yardstick framework* is developed in the OPNFV community, by the
 127 Yardstick_ team. The *virtual Traffic Classifier* is a part of the Yardstick
 128 Project.
 129
 130 .. note:: The test case description template used for the Yardstick test cases
 131   is based on the document ETSI-ISG NFV-TST001_; the results report template
 132   used for the Yardstick results is based on the IEEE Std 829-2008.
 133
 134
 135 Release Data
 136 ============
 137
 138 +--------------------------------------+--------------------------------------+
 139 | **Project**                          | Yardstick                            |
 140 |                                      |                                      |
 141 +--------------------------------------+--------------------------------------+
 142 | **Repo/tag**                         | yardstick/Danube.1.0                 |
 143 |                                      |                                      |
 144 +--------------------------------------+--------------------------------------+
 145 | **Yardstick Docker image tag**       | Danube.1.0                           |
 146 |                                      |                                      |
 147 +--------------------------------------+--------------------------------------+
 148 | **Release designation**              | Danube                               |
 149 |                                      |                                      |
 150 +--------------------------------------+--------------------------------------+
 151 | **Release date**                     | March 31st, 2017                     |
 152 |                                      |                                      |
 153 +--------------------------------------+--------------------------------------+
 154 | **Purpose of the delivery**          | OPNFV Danube release 1.0             |
 155 |                                      |                                      |
 156 +--------------------------------------+--------------------------------------+
 157
 158
 159 Deliverables
 160 ============
 161
 162 Documents
 163 ---------
 164
 165  - User Guide: http://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/index.html
 166
 167  - Developer Guide: http://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/developer/devguide/index.html
 168
 169
 170 Software Deliverables
 171 ---------------------
 172
 173 **Yardstick framework source code <Danube.1.0>**
 174
 175 +--------------------------------------+--------------------------------------+
 176 | **Project**                          | Yardstick                            |
 177 |                                      |                                      |
 178 +--------------------------------------+--------------------------------------+
 179 | **Repo/tag**                         | yardstick/Danube.1.0                 |
 180 |                                      |                                      |
 181 +--------------------------------------+--------------------------------------+
 182 | **Yardstick Docker image tag**       | Danube.1.0                           |
 183 |                                      |                                      |
 184 +--------------------------------------+--------------------------------------+
 185 | **Release designation**              | Danube                               |
 186 |                                      |                                      |
 187 +--------------------------------------+--------------------------------------+
 188 | **Release date**                     | March 31st, 2017                     |
 189 |                                      |                                      |
 190 +--------------------------------------+--------------------------------------+
 191 | **Purpose of the delivery**          | OPNFV Danube release                 |
 192 |                                      |                                      |
 193 +--------------------------------------+--------------------------------------+
 194
 195
 196 **Contexts**
 197
 198 +---------------------+-------------------------------------------------------+
 199 | **Context**         | **Description**                                       |
 200 |                     |                                                       |
 201 +---------------------+-------------------------------------------------------+
 202 | *Heat*              | Models orchestration using OpenStack Heat             |
 203 |                     |                                                       |
 204 +---------------------+-------------------------------------------------------+
 205 | *Node*              | Models Baremetal, Controller, Compute                 |
 206 |                     |                                                       |
 207 +---------------------+-------------------------------------------------------+
 208 | *Standalone*        | Models VM running on Non-Managed NFVi                 |
 209 |                     |                                                       |
 210 +---------------------+-------------------------------------------------------+
 211
 212
 213 **Runners**
 214
 215 +---------------------+-------------------------------------------------------+
 216 | **Runner**          | **Description**                                       |
 217 |                     |                                                       |
 218 +---------------------+-------------------------------------------------------+
 219 | *Arithmetic*        | Steps every run arithmetically according to specified |
 220 |                     | input value                                           |
 221 |                     |                                                       |
 222 +---------------------+-------------------------------------------------------+
 223 | *Duration*          | Runs for a specified period of time                   |
 224 |                     |                                                       |
 225 +---------------------+-------------------------------------------------------+
 226 | *Iteration*         | Runs for a specified number of iterations             |
 227 |                     |                                                       |
 228 +---------------------+-------------------------------------------------------+
 229 | *Sequence*          | Selects input value to a scenario from an input file  |
 230 |                     | and runs all entries sequentially                     |
 231 |                     |                                                       |
 232 +---------------------+-------------------------------------------------------+
 233
 234
 235 **Scenarios**
 236
 237 +---------------------+-------------------------------------------------------+
 238 | **Category**        | **Delivered**                                         |
 239 |                     |                                                       |
 240 +---------------------+-------------------------------------------------------+
 241 | *Availability*      | Attacker:                                             |
 242 |                     |                                                       |
 243 |                     | * baremetal, process                                  |
 244 |                     |                                                       |
 245 |                     | HA tools:                                             |
 246 |                     |                                                       |
 247 |                     | * check host, openstack, process, service             |
 248 |                     | * kill process                                        |
 249 |                     | * start/stop service                                  |
 250 |                     |                                                       |
 251 |                     | Monitor:                                              |
 252 |                     |                                                       |
 253 |                     | * command, process                                    |
 254 |                     |                                                       |
 255 +---------------------+-------------------------------------------------------+
 256 | *Compute*           | * cpuload                                             |
 257 |                     |                                                       |
 258 |                     | * cyclictest                                          |
 259 |                     |                                                       |
 260 |                     | * lmbench                                             |
 261 |                     |                                                       |
 262 |                     | * lmbench_cache                                       |
 263 |                     |                                                       |
 264 |                     | * perf                                                |
 265 |                     |                                                       |
 266 |                     | * unixbench                                           |
 267 |                     |                                                       |
 268 |                     | * ramspeed                                            |
 269 |                     |                                                       |
 270 |                     | * cachestat                                           |
 271 |                     |                                                       |
 272 |                     | * memeoryload                                         |
 273 |                     |                                                       |
 274 |                     | * computecapacity                                     |
 275 |                     |                                                       |
 276 +---------------------+-------------------------------------------------------+
 277 | *Networking*        | * iperf3                                              |
 278 |                     |                                                       |
 279 |                     | * netperf                                             |
 280 |                     |                                                       |
 281 |                     | * netperf_node                                        |
 282 |                     |                                                       |
 283 |                     | * ping                                                |
 284 |                     |                                                       |
 285 |                     | * ping6                                               |
 286 |                     |                                                       |
 287 |                     | * pktgen                                              |
 288 |                     |                                                       |
 289 |                     | * sfc                                                 |
 290 |                     |                                                       |
 291 |                     | * sfc with tacker                                     |
 292 |                     |                                                       |
 293 |                     | * vtc instantion validation                           |
 294 |                     |                                                       |
 295 |                     | * vtc instantion validation with noisy neighbors      |
 296 |                     |                                                       |
 297 |                     | * vtc throughput                                      |
 298 |                     |                                                       |
 299 |                     | * vtc throughput in the presence of noisy neighbors   |
 300 |                     |                                                       |
 301 |                     | * networkcapacity                                     |
 302 |                     |                                                       |
 303 |                     | * netutilization                                      |
 304 |                     |                                                       |
 305 |                     | * nstat                                               |
 306 |                     |                                                       |
 307 +---------------------+-------------------------------------------------------+
 308 | *Parser*            | Tosca2Heat                                            |
 309 |                     |                                                       |
 310 +---------------------+-------------------------------------------------------+
 311 | *Storage*           | fio                                                   |
 312 |                     |                                                       |
 313 |                     | storagecapacity                                       |
 314 |                     |                                                       |
 315 +---------------------+-------------------------------------------------------+
 316 | *StorPerf*          | storperf                                              |
 317 |                     |                                                       |
 318 +---------------------+-------------------------------------------------------+
 319 | *NSB*               | vPE thoughput test case                               |
 320 |                     |                                                       |
 321 +---------------------+-------------------------------------------------------+
 322
 323
 324 **API to Other Frameworks**
 325
 326 +---------------------+-------------------------------------------------------+
 327 | **Framework**       | **Description**                                       |
 328 |                     |                                                       |
 329 +---------------------+-------------------------------------------------------+
 330 | *ApexLake*          | Experimental framework that enables the user to       |
 331 |                     | validate NFVI from the perspective of a VNF.          |
 332 |                     | A virtual Traffic Classifier is utilized as VNF.      |
 333 |                     | Enables experiments with SR-IOV on Compute Node.      |
 334 |                     |                                                       |
 335 +---------------------+-------------------------------------------------------+
 336
 337
 338 **Test Results Output**
 339
 340 +-----------------------------+-----------------------------------------------+
 341 | **Dispatcher**              | **Description**                               |
 342 |                             |                                               |
 343 +-----------------------------+-----------------------------------------------+
 344 |  file                       | Log to a file.                                |
 345 |                             |                                               |
 346 +-----------------------------+-----------------------------------------------+
 347 |  http                       | Post data to html.                            |
 348 |                             |                                               |
 349 +-----------------------------+-----------------------------------------------+
 350 |  influxdb                   | Post data to influxDB.                        |
 351 |                             |                                               |
 352 +-----------------------------+-----------------------------------------------+
 353
 354
 355 Delivered Test cases
 356 --------------------
 357
 358 * Generic NFVI test cases
 359
 360   * OPNFV_YARDSTICK_TCOO1 - NW Performance
 361
 362   * OPNFV_YARDSTICK_TCOO2 - NW Latency
 363
 364   * OPNFV_YARDSTICK_TCOO4 - Cache Utilization
 365
 366   * OPNFV_YARDSTICK_TCOO5 - Storage Performance
 367
 368   * OPNFV_YARDSTICK_TCOO8 - Packet Loss Extended Test
 369
 370   * OPNFV_YARDSTICK_TCOO9 - Packet Loss
 371
 372   * OPNFV_YARDSTICK_TCO10 - Memory Latency
 373
 374   * OPNFV_YARDSTICK_TCO11 - Packet Delay Variation Between VMs
 375
 376   * OPNFV_YARDSTICK_TCO12 - Memory Bandwidth
 377
 378   * OPNFV_YARDSTICK_TCO14 - Processing Speed
 379
 380   * OPNFV_YARDSTICK_TCO24 - CPU Load
 381
 382   * OPNFV_YARDSTICK_TCO37 - Latency, CPU Load, Throughput, Packet Loss
 383
 384   * OPNFV_YARDSTICK_TCO38 - Latency, CPU Load, Throughput, Packet Loss Extended
 385     Test
 386
 387   * OPNFV_YARDSTICK_TCO42 - Network Performance
 388
 389   * OPNFV_YARDSTICK_TCO43 - Network Latency Between NFVI Nodes
 390
 391   * OPNFV_YARDSTICK_TCO44 - Memory Utilization
 392
 393   * OPNFV_YARDSTICK_TCO55 - Compute Capacity
 394
 395   * OPNFV_YARDSTICK_TCO61 - Network Utilization
 396
 397   * OPNFV_YARDSTICK_TCO63 - Storage Capacity
 398
 399   * OPNFV_YARDSTICK_TCO69 - Memory Bandwidth
 400
 401   * OPNFV_YARDSTICK_TCO70 - Latency, Memory Utilization, Throughput, Packet
 402     Loss
 403
 404   * OPNFV_YARDSTICK_TCO71 - Latency, Cache Utilization, Throughput, Packet Loss
 405
 406   * OPNFV_YARDSTICK_TCO72 - Latency, Network Utilization, Throughput, Packet
 407     Loss
 408
 409   * OPNFV_YARDSTICK_TC073 - Network Latency and Throughput Between Nodes
 410
 411   * OPNFV_YARDSTICK_TCO75 - Network Capacity and Scale
 412
 413   * OPNFV_YARDSTICK_TCO76 - Network frame error rate
 414
 415 * Test Cases for OPNFV HA Project:
 416
 417   * OPNFV_YARDSTICK_TCO19 - HA: Control node Openstack service down
 418
 419   * OPNFV_YARDSTICK_TC025 - HA: OpenStacK Controller Node abnormally down
 420
 421   * OPNFV_YARDSTICK_TCO45 - HA: Control node Openstack service down - neutron
 422     server
 423
 424   * OPNFV_YARDSTICK_TC046 - HA: Control node Openstack service down - keystone
 425
 426   * OPNFV_YARDSTICK_TCO47 - HA: Control node Openstack service down - glance
 427     api
 428
 429   * OPNFV_YARDSTICK_TC048 - HA: Control node Openstack service down - cinder
 430     api
 431
 432   * OPNFV_YARDSTICK_TCO49 - HA: Control node Openstack service down - swift
 433     proxy
 434
 435   * OPNFV_YARDSTICK_TC050 - HA: OpenStack Controller Node Network High
 436     Availability
 437
 438   * OPNFV_YARDSTICK_TCO51 - HA: OpenStack Controller Node CPU Overload High
 439     Availability
 440
 441   * OPNFV_YARDSTICK_TC052 - HA: OpenStack Controller Node Disk I/O Block High
 442     Availability
 443
 444   * OPNFV_YARDSTICK_TCO53 - HA: OpenStack Controller Load Balance Service High
 445     Availability
 446
 447   * OPNFV_YARDSTICK_TC054 - HA: OpenStack Virtual IP High Availability
 448
 449 * Test Case for OPNFV IPv6 Project:
 450
 451   * OPNFV_YARDSTICK_TCO27 - IPv6 connectivity
 452
 453 * Test Case for OPNFV KVM Project:
 454
 455   * OPNFV_YARDSTICK_TCO28 - KVM Latency measurements
 456
 457 * Test Case for OPNFV Parser Project:
 458
 459   * OPNFV_YARDSTICK_TCO40 - Verify Parser Yang-to-Tosca
 460
 461 * Test Case for OPNFV StorPerf Project:
 462
 463   * OPNFV_YARDSTICK_TCO74 - Storperf
 464
 465 * Test Cases for Virtual Traffic Classifier:
 466
 467   * OPNFV_YARDSTICK_TC006 - Virtual Traffic Classifier Data Plane Throughput
 468
 469 * Benchmarking Test:
 470
 471   * OPNFV_YARDSTICK_TC007 - Virtual Traffic Classifier Data Plane Throughput
 472
 473 * Benchmarking in presence of noisy neighbors Test:
 474
 475   * OPNFV_YARDSTICK_TC020 - Virtual Traffic Classifier Instantiation Test
 476
 477   * OPNFV_YARDSTICK_TC021 - Virtual Traffic Classifier Instantiation in
 478     presence of noisy neighbors Test
 479
 480
 481 Version Change
 482 ==============
 483
 484 Module Version Changes
 485 ----------------------
 486
 487 This is the fourth tracked release of Yardstick. It is based on following
 488 upstream versions:
 489
 490 - ONOS Ibis
 491
 492 - OpenStack Newton
 493
 494 - OpenDaylight Boron
 495
 496
 497 Document Version Changes
 498 ------------------------
 499
 500 This is the fourth tracked version of the Yardstick framework in OPNFV.
 501 It includes the following documentation updates:
 502
 503 - Yardstick User Guide: add "network service benchmarking(NSB)" chapter;
 504   add "Yardstick - NSB Testing -Installation" chapter; add "Yardstick API" chapter;
 505   add "Yardstick user interface" chapter; Update Yardstick installation chapter;
 506
 507 - Yardstick Developer Guide
 508
 509 - Yardstick Release Notes for Yardstick: this document
 510
 511
 512 Feature additions
 513 -----------------
 514
 515 - Yardstick RESTful API support
 516
 517 - Introduce Network service benchmarking
 518
 519 - Introduce stress testing with Bottlenecks team
 520
 521 - Yardstick framework improvement:
 522
 523   - Parellel test cases execution support
 524
 525   - yardstick report CLI
 526
 527   - Node context support openstack configuration via Ansible
 528
 529   - Https support
 530
 531 - Python 3 support
 532
 533
 534 Scenario Matrix
 535 ===============
 536
 537 For Danube 1.0, Yardstick was tested on the following scenarios:
 538
 539 +-------------------------+---------+---------+---------+---------+
 540 |         Scenario        |  Apex   | Compass |  Fuel   |   Joid  |
 541 +=========================+=========+=========+=========+=========+
 542 | os-nosdn-nofeature-noha |         |         |    X    |    X    |
 543 +-------------------------+---------+---------+---------+---------+
 544 | os-nosdn-nofeature-ha   |    X    |    X    |    X    |    X    |
 545 +-------------------------+---------+---------+---------+---------+
 546 | os-odl_l2-nofeature-ha  |         |    X    |    X    |    X    |
 547 +-------------------------+---------+---------+---------+---------+
 548 | os-odl_l2-nofeature-noha|         |         |    X    |         |
 549 +-------------------------+---------+---------+---------+---------+
 550 | os-odl_l3-nofeature-ha  |    X    |    X    |    X    |         |
 551 +-------------------------+---------+---------+---------+---------+
 552 | os-odl_l3-nofeature-noha|         |         |    X    |         |
 553 +-------------------------+---------+---------+---------+---------+
 554 | os-onos-sfc-ha          |         |         |         |         |
 555 +-------------------------+---------+---------+---------+---------+
 556 | os-onos-nofeature-ha    |         |    X    |         |    X    |
 557 +-------------------------+---------+---------+---------+---------+
 558 | os-onos-nofeature-noha  |         |         |         |         |
 559 +-------------------------+---------+---------+---------+---------+
 560 | os-odl_l2-sfc-ha        |         |         |    X    |         |
 561 +-------------------------+---------+---------+---------+---------+
 562 | os-odl_l2-sfc-noha      |         |         |    X    |         |
 563 +-------------------------+---------+---------+---------+---------+
 564 | os-odl_l2-bgpvpn-ha     |    X    |         |    X    |         |
 565 +-------------------------+---------+---------+---------+---------+
 566 | os-odl_l2-bgpvpn-noha   |         |         |    X    |         |
 567 +-------------------------+---------+---------+---------+---------+
 568 | os-nosdn-kvm-ha         |    X    |         |    X    |         |
 569 +-------------------------+---------+---------+---------+---------+
 570 | os-nosdn-kvm-noha       |         |         |    X    |         |
 571 +-------------------------+---------+---------+---------+---------+
 572 | os-nosdn-ovs-ha         |         |         |    X    |         |
 573 +-------------------------+---------+---------+---------+---------+
 574 | os-nosdn-ovs-noha       |         |         |    X    |         |
 575 +-------------------------+---------+---------+---------+---------+
 576 | os-ocl-nofeature-ha     |         |    X    |         |         |
 577 +-------------------------+---------+---------+---------+---------+
 578 | os-nosdn-lxd-ha         |         |         |         |    X    |
 579 +-------------------------+---------+---------+---------+---------+
 580 | os-nosdn-lxd-noha       |         |         |         |    X    |
 581 +-------------------------+---------+---------+---------+---------+
 582 | os-nosdn-fdio-ha        |    X    |         |         |         |
 583 +-------------------------+---------+---------+---------+---------+
 584 | os-odl_l2-fdio-noha     |    X    |         |         |         |
 585 +-------------------------+---------+---------+---------+---------+
 586 | os-odl-gluon-noha       |    X    |         |         |         |
 587 +-------------------------+---------+---------+---------+---------+
 588 | os-nosdn-openo-ha       |         |    X    |         |         |
 589 +-------------------------+---------+---------+---------+---------+
 590 | os-nosdn-kvm_ovs_dpdk   |         |         |    X    |         |
 591 | -noha                   |         |         |         |         |
 592 +-------------------------+---------+---------+---------+---------+
 593 | os-nosdn-kvm_ovs_dpdk-ha|         |         |    X    |         |
 594 +-------------------------+---------+---------+---------+---------+
 595 | os-nosdn-kvm_ovs_dpdk   |         |         |    X    |         |
 596 | _bar-ha                 |         |         |         |         |
 597 +-------------------------+---------+---------+---------+---------+
 598 | os-nosdn-kvm_ovs_dpdk   |         |         |    X    |         |
 599 | _bar-noha               |         |         |         |         |
 600 +-------------------------+---------+---------+---------+---------+
 601
 602
 603 Test results
 604 ============
 605
 606 Test results are available in:
 607
 608  - jenkins logs on CI: https://build.opnfv.org/ci/view/yardstick/
 609
 610 The reporting pages can be found at:
 611
 612  * apex: http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-apex.html
 613  * compass: http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-compass.html
 614  * fuel: http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-fuel.html
 615  * joid: http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-joid.html
 616
 617
 618 Known Issues/Faults
 619 ------------
 620
 621  - Floating IP not supported in bgpvpn scenario
 622
 623  - VM instance cannot get floating IP in compass-os-odl_l2-nofeature-ha scenario
 624
 625 .. note:: The faults not related to *Yardstick* framework, addressing scenarios
 626   which were not fully verified, are listed in the OPNFV installer's release
 627   notes.
 628
 629
 630 Corrected Faults
 631 ----------------
 632
 633 Danube.1.0:
 634
 635 +----------------------------+------------------------------------------------+
 636 | **JIRA REFERENCE**         | **SLOGAN**                                     |
 637 |                            |                                                |
 638 +----------------------------+------------------------------------------------+
 639 | JIRA: YARDSTICK-599        | Could not load EntryPoint.parse when using     |
 640 |                            | 'openstack -h'                                 |
 641 +----------------------------+------------------------------------------------+
 642 | JIRA: YARDSTICK-602        | Don't rely on staic ip addresses as they       |
 643 |                            | are dynamic                                    |
 644 +----------------------------+------------------------------------------------+
 645
 646
 647 Danube 1.0 known restrictions/issues
 648 ====================================
 649 +-----------+-----------+----------------------------------------------+
 650 | Installer | Scenario  |  Issue                                       |
 651 +===========+===========+==============================================+
 652 | any       | *-bgpvpn  | Floating ips not supported. Some Test cases  |
 653 |           |           | related to floating ips are excluded.        |
 654 +-----------+-----------+----------------------------------------------+
 655 | any       | odl_l3-*  | Some test cases related to using floating IP |
 656 |           |           | addresses fail because of a known ODL bug.   |
 657 |           |           |                                              |
 658 +-----------+-----------+----------------------------------------------+
 659 | compass   | odl_l2-*  | In some test cases, VM instance will failed  |
 660 |           |           | raising network interfaces.                  |
 661 |           |           |                                              |
 662 +-----------+-----------+----------------------------------------------+
 663
 664
 665
 666 Open JIRA tickets
 667 =================
 668
 669 +----------------------------+------------------------------------------------+
 670 | **JIRA REFERENCE**         | **SLOGAN**                                     |
 671 |                            |                                                |
 672 +----------------------------+------------------------------------------------+
 673 | JIRA: YARDSTICK-603        | Timeout waiting for floating ip                |
 674 |                            | (which actually pingable)                      |
 675 +----------------------------+------------------------------------------------+
 676 | JIRA: YARDSTICK-412        | IPv6 test case should add support for newton   |
 677 |                            |                                                |
 678 +----------------------------+------------------------------------------------+
 679
 680
 681 Useful links
 682 ============
 683
 684  - wiki project page: https://wiki.opnfv.org/display/yardstick/Yardstick
 685
 686  - wiki Yardstick Danube release planing page: https://wiki.opnfv.org/display/yardstick/Yardstick+Danube+Release+Planning
 687
 688  - Yardstick repo: https://git.opnfv.org/cgit/yardstick
 689
 690  - Yardstick CI dashboard: https://build.opnfv.org/ci/view/yardstick
 691
 692  - Yardstick grafana dashboard: http://testresults.opnfv.org/grafana/
 693
 694  - Yardstick IRC chanel: #opnfv-yardstick