From: dimitris.tsiolakis Date: Tue, 18 Sep 2018 13:37:01 +0000 (+0300) Subject: Reviewers Guide document for fraser release. X-Git-Tag: ovp-2.0.0~4 X-Git-Url: https://gerrit.opnfv.org/gerrit/gitweb?a=commitdiff_plain;h=refs%2Fchanges%2F19%2F62619%2F1;p=dovetail.git Reviewers Guide document for fraser release. Images have been updated to depict the latest changes in Dovetail Web portal. Change-Id: I4dc928141856fab34670272fcc465bea3f6156db Signed-off-by: dimitris.tsiolakis (cherry picked from commit cfa402bae022e7e288f9d9eaa3582f22fd39c42e) --- diff --git a/docs/testing/user/reviewerguide/images/ovp_log_files_functest_image.png b/docs/testing/user/reviewerguide/images/ovp_log_files_functest_image.png index 51a672af..66d3fd73 100644 Binary files a/docs/testing/user/reviewerguide/images/ovp_log_files_functest_image.png and b/docs/testing/user/reviewerguide/images/ovp_log_files_functest_image.png differ diff --git a/docs/testing/user/reviewerguide/images/ovp_log_setup.png b/docs/testing/user/reviewerguide/images/ovp_log_setup.png index de529a05..4a68d9b6 100644 Binary files a/docs/testing/user/reviewerguide/images/ovp_log_setup.png and b/docs/testing/user/reviewerguide/images/ovp_log_setup.png differ diff --git a/docs/testing/user/reviewerguide/images/ovp_pass_fraction.png b/docs/testing/user/reviewerguide/images/ovp_pass_fraction.png index 7c3299f4..94dcd45a 100644 Binary files a/docs/testing/user/reviewerguide/images/ovp_pass_fraction.png and b/docs/testing/user/reviewerguide/images/ovp_pass_fraction.png differ diff --git a/docs/testing/user/reviewerguide/images/ovp_pass_percentage.png b/docs/testing/user/reviewerguide/images/ovp_pass_percentage.png index adfe96e5..0d477a78 100644 Binary files a/docs/testing/user/reviewerguide/images/ovp_pass_percentage.png and b/docs/testing/user/reviewerguide/images/ovp_pass_percentage.png differ diff --git a/docs/testing/user/reviewerguide/images/ovp_result_overview.png b/docs/testing/user/reviewerguide/images/ovp_result_overview.png index 1097f0af..1f66a69c 100644 Binary files a/docs/testing/user/reviewerguide/images/ovp_result_overview.png and b/docs/testing/user/reviewerguide/images/ovp_result_overview.png differ diff --git a/docs/testing/user/reviewerguide/images/ovp_result_review.png b/docs/testing/user/reviewerguide/images/ovp_result_review.png index a8f988fc..427127e0 100644 Binary files a/docs/testing/user/reviewerguide/images/ovp_result_review.png and b/docs/testing/user/reviewerguide/images/ovp_result_review.png differ diff --git a/docs/testing/user/reviewerguide/images/ovp_wrong_num_of_tc.png b/docs/testing/user/reviewerguide/images/ovp_wrong_num_of_tc.png deleted file mode 100644 index 9e5d2b47..00000000 Binary files a/docs/testing/user/reviewerguide/images/ovp_wrong_num_of_tc.png and /dev/null differ diff --git a/docs/testing/user/reviewerguide/images/sut_endpoints.png b/docs/testing/user/reviewerguide/images/sut_endpoints.png index f11d531f..d5ad6239 100644 Binary files a/docs/testing/user/reviewerguide/images/sut_endpoints.png and b/docs/testing/user/reviewerguide/images/sut_endpoints.png differ diff --git a/docs/testing/user/reviewerguide/images/sut_info.png b/docs/testing/user/reviewerguide/images/sut_info.png index 395f5f41..53c3d51a 100644 Binary files a/docs/testing/user/reviewerguide/images/sut_info.png and b/docs/testing/user/reviewerguide/images/sut_info.png differ diff --git a/docs/testing/user/reviewerguide/index.rst b/docs/testing/user/reviewerguide/index.rst index dd9456ce..99585581 100644 --- a/docs/testing/user/reviewerguide/index.rst +++ b/docs/testing/user/reviewerguide/index.rst @@ -92,11 +92,11 @@ eight characters even though the 'Test ID' is a longer UUID in the back-end.* Figure 3 -3. Test-Case Pass Percentage +2. Test-Case Pass Percentage ============================ All mandatory test-cases have to run successfully. The below diagram of the 'Test Run Results' is one method and -shows that 94.39% of the mandatory test-cases have passed. +shows that 98.15% of the mandatory test-cases have passed. This value must not be lower than 100%. .. image:: images/ovp_pass_percentage.png @@ -117,7 +117,7 @@ Failed test cases can also be easy identified by the color of pass/total number. Figure 5 -4. Log File Verification +3. Log File Verification ======================== Each log file of the mandatory test cases have to be verified for content. @@ -190,7 +190,7 @@ An example of a FAILED and a SUCCESS test case are listed below: 2018-08-28 10:23:41,907 [INFO] yardstick.benchmark.core.task task.py:127 Testcase: "opnfv_yardstick_tc052" **SUCCESS**!!! -5. SUT Info Verification +4. SUT Info Verification ======================== SUT information must be present in the results to validate that all required endpoint services