summary |
shortlog | log |
commit |
commitdiff |
review |
tree
first ⋅ prev ⋅ next
Morgan Richomme [Thu, 19 May 2016 12:41:23 +0000 (14:41 +0200)]
Adapt reporting after Functest refactoring
Get test cases from cases declares in Tiers
Consider only Tier 0-3 to validate scenario
Display results for Tier > 3
Change-Id: I581702bd7f2cc323d38b82a2404b301fb8fd7840
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
SerenaFeng [Thu, 19 May 2016 10:13:27 +0000 (18:13 +0800)]
add unittests of project & refactor response
post body: {'href':'<http://ip:8000/pods/pod_name >'}
get body: Pod/Project
list body: list of Pod/Project
update body: Pod/Project
delete: no body
JIRA: FUNCTEST-253
Change-Id: I28c6f5b35d8909d827f2f803197d95be4abd44bb
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
Morgan Richomme [Wed, 18 May 2016 12:27:46 +0000 (12:27 +0000)]
Merge "add pod related unittests in testAPI"
SerenaFeng [Wed, 18 May 2016 05:32:50 +0000 (13:32 +0800)]
add pod related unittests in testAPI
unittest for create/get/list pod in testAPI project
JIRA: FUNCTEST-252
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
Change-Id: Ifedb4715abffda20c93284ef58cd93f584879af8
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
Morgan Richomme [Tue, 17 May 2016 14:26:17 +0000 (16:26 +0200)]
make run_test executable in repo
Change-Id: If855e03df16d4786af6274c5b9c234fbef480278
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
SerenaFeng [Tue, 17 May 2016 13:05:27 +0000 (21:05 +0800)]
add unittest framework for supporting unittest in testAPI
usage is shown in utils/test/result_collection_api/README.md
JIRA: FUNCTEST-251
Change-Id: I788417e296c153cc485f4a4064697bdafc394e5b
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
SerenaFeng [Fri, 13 May 2016 07:58:04 +0000 (15:58 +0800)]
tornado_swagger_ui support query operation in "GET" method, and support methods in model
query: GET /item?property1=1&property2=1
methods in model:
@swagger.model()
class Item:
def format_http(self):
pass
@staticmethod
def item_from_dict(item_dict):
pass
@classmethod
def test_classmethod(cls):
pass
JIRA: FUNCTEST-250
Change-Id: I12f937c4d2f64f93dc1194a8ad982e8b7ff21b7c
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
SerenaFeng [Thu, 12 May 2016 03:25:06 +0000 (11:25 +0800)]
support list property in tornado_swagger_ui
list property will be declared in format
'@ptype property4: C{list} of L{PropertySubclass}'
JIRA: FUNCTEST-248
Change-Id: I3ee31389f1eab39cc9f621cbab006f0a8764c8ca
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
SerenaFeng [Wed, 11 May 2016 03:48:06 +0000 (11:48 +0800)]
integration of tornado and swagger-ui
this code will be applied to testApi later, as regards how to use it,
please refer utils/test/result_collection_api/tornado_swagger_ui/README.md
JIRA: FUNCTEST-247
Change-Id: Ie40e125846add7ceda15f05a38232dc8813b8f29
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
Morgan Richomme [Wed, 4 May 2016 15:21:58 +0000 (17:21 +0200)]
fix config path after refactoring
Change-Id: Idb4d9d978c89ae8bc590ca9f938b756118c5e26a
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Wed, 4 May 2016 14:19:09 +0000 (16:19 +0200)]
Add global scenario reporting
Save date when a scenario is validated
Change-Id: I0895ae56812c7059972a60bf017fdb76d40de25c
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Fri, 29 Apr 2016 12:10:36 +0000 (14:10 +0200)]
Add trust indicator field
JIRA: FUNCTEST-165
Change-Id: Ic79f528f27dd28b6781ddd3300743ba691a8c085
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Tue, 26 Apr 2016 14:16:44 +0000 (16:16 +0200)]
Improve code quality (flake8)
Change-Id: Id58236ab080bc7dd5d9d7b98c4a0fce27ee1b7ad
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Tue, 26 Apr 2016 12:24:56 +0000 (14:24 +0200)]
Functest reporting refactoring
integrate the notion of version (brahmaputra, master, ..)
change dir structure
Change-Id: Ieb8aed811ed4e1ab8738fb02e4db411da3d07ca2
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Thu, 21 Apr 2016 07:12:44 +0000 (07:12 +0000)]
Merge "bug fix: Rally duration not correct due to result format change"
Morgan Richomme [Wed, 20 Apr 2016 16:04:41 +0000 (18:04 +0200)]
bug fix: Rally duration not correct due to result format change
JIRA: FUNCTEST-207
Change-Id: I04892271008a8a7130dbaf39757ab3039167602e
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Ciprian Barbu [Wed, 20 Apr 2016 14:16:19 +0000 (17:16 +0300)]
Fuel: add functest job on arm-pod1
Change-Id: I3703e0bde8b712d7c9b90621cc7ee1a44340076b
Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
Juraj Linkes [Tue, 29 Mar 2016 09:13:27 +0000 (11:13 +0200)]
added ELK scripts for porting data from mongo to elasticsearch and managing kibana dashboards
Change-Id: I9edbc1535f6f9c4ca4dc8b4871a04c2ed6d1969e
Signed-off-by: Juraj Linkes <jlinkes@cisco.com>
Morgan Richomme [Thu, 24 Mar 2016 15:51:32 +0000 (16:51 +0100)]
Complete reporting status, process the scenario and get success criteria
Change-Id: Iaf5292293aec877f94e9cdec80519a680fef6718
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Thu, 17 Mar 2016 13:54:25 +0000 (14:54 +0100)]
Add scenario and criteria field in the Test result object of the test API
scenario will be used for OPNFV scenario (currently using version field)
criteria will be passed or failed to give an immediate feedback on the test result status
JIRA: FUNCTEST-151
Change-Id: Iff5eb66bbf0cfbaafec0c3a6211031f6eb83c34f
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Wed, 16 Mar 2016 17:31:06 +0000 (18:31 +0100)]
Add automatic status reporting
Show last scenario run + sun/cloud/storm dynamically
JIRA:FUNCTEST-151
Change-Id: I86eeb64f0dea842a71b0cba9dd1058d7fa876269
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
boucherv [Sat, 12 Mar 2016 21:47:46 +0000 (22:47 +0100)]
Organization of reporting files
Change-Id: I2761528ca988f10deb112aab567bfd0ee407d072
Signed-off-by: boucherv <valentin.boucher@orange.com>
Morgan Richomme [Thu, 10 Mar 2016 08:34:38 +0000 (09:34 +0100)]
reorganization of Test folder in Releng
Change-Id: I92b507105e820198691ab8b1c44e1011b983b849
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Wed, 9 Mar 2016 16:21:05 +0000 (17:21 +0100)]
Add automated reporting for Tempest
Change-Id: I3cc411c2d0d22a96333bf0b978ad8dd833744e8c
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
boucherv [Wed, 2 Mar 2016 15:04:10 +0000 (16:04 +0100)]
Reporting dashboard for functest
Change-Id: I6a5fa0c8918c0d4a98754c38f3c33238a0132a39
Signed-off-by: boucherv <valentin.boucher@orange.com>
Morgan Richomme [Mon, 29 Feb 2016 13:59:40 +0000 (14:59 +0100)]
Add tempest success rate to calculate the % of success results
Change-Id: I38c76904648253601258e5a048ea6bc53821c313
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Mon, 29 Feb 2016 09:18:19 +0000 (09:18 +0000)]
Merge "fix last spaces & tab"
Morgan Richomme [Mon, 29 Feb 2016 08:57:24 +0000 (09:57 +0100)]
bug fix: installer field no more available in result object
Change-Id: I3562231f88ac16179d07e9a3a855f1dc114ada6d
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Fri, 26 Feb 2016 16:03:03 +0000 (17:03 +0100)]
fix last spaces & tab
Change-Id: I15503bcdb1f5b046d2fbdb6a6b35ebbdd184fbc9
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Fri, 26 Feb 2016 15:58:29 +0000 (15:58 +0000)]
Merge "Add jenkins build tag into result api"
Morgan Richomme [Fri, 26 Feb 2016 15:58:18 +0000 (15:58 +0000)]
Merge "Add POD visualisation"
boucherv [Fri, 26 Feb 2016 14:40:54 +0000 (15:40 +0100)]
Add jenkins build tag into result api
Ex: jenkins-functest-compass-intel-pod8-daily-master-19
Change-Id: I336d3908d6d67ba7f995d0fc25b5404efd9b5cf5
JIRA: FUNCTEST-140
Signed-off-by: boucherv <valentin.boucher@orange.com>
Cloud user [Thu, 25 Feb 2016 14:48:02 +0000 (14:48 +0000)]
Add POD visualisation
Change-Id: I4044c018fc3900615492a897e0c2a73348c8b0cd
Signed-off-by: Cloud user <cloud@test-cloudinit.novalocal>
Morgan Richomme [Tue, 23 Feb 2016 17:35:46 +0000 (18:35 +0100)]
fix bug on period in Test API
JIRA: RELENG-46
Change-Id: I416886e2cddf9369141d5f1f09e54e8c3dd02ed9
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Rex Lee [Mon, 22 Feb 2016 06:54:04 +0000 (06:54 +0000)]
bottlenecks: fix rewrite the rubbos graph drawing function
JIRA: BOTTLENECK-30
Change-Id: Id3e4f9f375ecb9bf454e21d8be41e884c6cc4371
Signed-off-by: Rex Lee <limingjiang@huawei.com>
MatthewLi [Fri, 19 Feb 2016 08:27:14 +0000 (03:27 -0500)]
bottlenecks: rewrite the rubbos graph drawing function
JIRA: BOTTLENECK-30
Change-Id: Iee2e177b7ddec5c0e0a765d5a7369ec76e6ad911
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
Morgan Richomme [Fri, 12 Feb 2016 13:49:01 +0000 (13:49 +0000)]
Merge "Update dashboard"
Cloud user [Fri, 12 Feb 2016 09:40:29 +0000 (09:40 +0000)]
Update dashboard
Change-Id: I679fada5f12bd660c65d3bb006742b1119735f4c
Signed-off-by: Cloud user <cloud@test-cloudinit.novalocal>
Morgan Richomme [Thu, 11 Feb 2016 15:20:49 +0000 (16:20 +0100)]
Add Rally summary and Doctor for visualization
Change-Id: I23ff748237511f89417d2c60e22fb79949ac90b7
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Fri, 5 Feb 2016 13:43:37 +0000 (14:43 +0100)]
Add promise for dashboard
Change-Id: I70345e6aa2223cea4210ca6e01defbd1ea426c7a
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Fri, 5 Feb 2016 10:52:15 +0000 (11:52 +0100)]
Adapt dashboard for ONOS new result format
Change-Id: I28373a74557769b78f8fc0ee1381172db6036eef
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Sat, 30 Jan 2016 08:48:02 +0000 (09:48 +0100)]
Add ONOS and ODL in dashboard
see http://testresults.opnfv.org/proto/index2.html
Change-Id: I38a1bcd0a16cbbc84be03f1abc29d39e32950e99
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Fatih Degirmenci [Wed, 27 Jan 2016 08:53:39 +0000 (09:53 +0100)]
Add license header
License headers are added.
- Set company name based on the author who created the file first time
- Add SPDX header for Apache 2.0
Change-Id: I8f357a2d6f75179171c681f4b53e0f4249eca5a2
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
Cloud user [Wed, 27 Jan 2016 17:15:11 +0000 (17:15 +0000)]
Add light dashboard
Change-Id: I61c2e38b91085d9d6c5f8d5f8a52863bec8aacd6
Signed-off-by: Cloud user <cloud@test-cloudinit.novalocal>
Morgan Richomme [Wed, 27 Jan 2016 10:08:58 +0000 (10:08 +0000)]
Merge "bad text for vIMS case"
Morgan Richomme [Wed, 27 Jan 2016 09:53:55 +0000 (10:53 +0100)]
bad text for vIMS case
Change-Id: Ia75882b6ebf323ac07d06148a2e24122fc79ff57
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
MofassirArif [Mon, 25 Jan 2016 11:34:51 +0000 (03:34 -0800)]
qtip: update DB address
Change-Id: Ib3a92a28102c32db34edd625486d4fff8434d609
Signed-off-by: MofassirArif <Mofassir_Arif@dellteam.com>
Morgan Richomme [Wed, 20 Jan 2016 10:38:29 +0000 (11:38 +0100)]
Adapt dashboard to a second vPing scenario
Change-Id: Ic1d3b6479b1afdbc1cd42536fba65dd3410b8614
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Tue, 19 Jan 2016 15:04:01 +0000 (16:04 +0100)]
add qtip for dashboard
Change-Id: I592d0b1349c418e39653628bb3701062ceaf2644
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
MofassirArif [Tue, 12 Jan 2016 05:41:17 +0000 (21:41 -0800)]
qtip: fix 'too many values to unpack' error
Change-Id: Ida505af3bab72e589b16d4803cd6c9ef910cb6f4
Signed-off-by: MofassirArif <Mofassir_Arif@dellteam.com>
Yiting.Li [Mon, 11 Jan 2016 13:19:02 +0000 (21:19 +0800)]
add two test cases: VSTF tu1 and tu3
JIRA: BOTTLENECK-29
Change-Id: I08b531037f28bfab41dedf9d487abb1896da130a
Signed-off-by: Yiting.Li <liyiting@huawei.com>
Morgan Richomme [Fri, 8 Jan 2016 08:15:07 +0000 (09:15 +0100)]
add bottlenecks to test dashboard
Change-Id: I476c8b65fd319528b28847d45de305f885be14c1
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
rexlee8776 [Mon, 28 Dec 2015 07:44:47 +0000 (15:44 +0800)]
add dashboard for bottlenecks project
JIRA:BOTTLENECK-30
Change-Id: I8f02d0b905a2b4b2c2de4f2e8dfc03fa32d469f2
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
Morgan Richomme [Wed, 9 Dec 2015 17:25:00 +0000 (18:25 +0100)]
Add status virtual case for Functest dashboard
use static value to start, KPI shall be processed according to real results..
JIRA: FUNCTEST-111
Change-Id: I3aa43be36815b99e3a92923e6df3154d83c09b19
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Wed, 2 Dec 2015 07:24:16 +0000 (08:24 +0100)]
remove test_cases info in project description
JIRA: RELENG-59
Change-Id: I73246d475b5607832c733026a76bd78d7e50af9e
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Fri, 27 Nov 2015 08:36:51 +0000 (09:36 +0100)]
Add tool to backup Mongo tables and postman collection as sample
JIRA: RELENG-7
Change-Id: Ib06c814fed7e808adbb913dbaf340044f27548b6
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Sun, 22 Nov 2015 17:57:20 +0000 (17:57 +0000)]
Merge "Integrate vsperf with opnfv_test_dashboard"
Morgan Richomme [Thu, 12 Nov 2015 16:36:27 +0000 (17:36 +0100)]
add vIMS for dahsboard
JIRA: FUNCTEST-64
Change-Id: I344c3a882d64acdcd310decf015f234964faeb5a
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Radek Zetik [Wed, 18 Nov 2015 14:15:01 +0000 (14:15 +0000)]
Integrate vsperf with opnfv_test_dashboard
All the test projects generate results in different format.
The goal of a testing dashboard is to provide a consistent
view of the different tests from the different projects.
We need to enable the data collection for VSPERF, in other words
VSPERF pushes data using a REST API.
JIRA: VSPERF-112
Change-Id: I5d31a0fcca9fa932ceab398fe5da073966a8809f
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Morgan Richomme [Wed, 28 Oct 2015 08:28:18 +0000 (09:28 +0100)]
fix format method (case sensitive)
JIRA: FUNCTEST-87
Change-Id: I6ba9a17401480556b19a0918119d554d8b1871ce
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
QiLiang [Tue, 27 Oct 2015 15:43:37 +0000 (15:43 +0000)]
Yardstick test results reformat for Dashboard
JIRA: YARDSTICK-132
Change-Id: Ibfb78e1341fdfe3a877765dd17445f5677a37b0f
Signed-off-by: QiLiang <liangqi1@huawei.com>
Morgan Richomme [Mon, 19 Oct 2015 15:19:44 +0000 (17:19 +0200)]
create post processing for Tempest test
JIRA: FUNCTEST-56
Change-Id: I4bfaa80ed2e93c89062a95db014a9a445c6a53de
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Sat, 17 Oct 2015 16:19:12 +0000 (18:19 +0200)]
add dashboard method to test result collection API
+ add new fields in pod section
JIRA: RELENG-45
Change-Id: I8e833207b7014d7fd07769af415a4892b9e9d924
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Wed, 14 Oct 2015 08:50:49 +0000 (10:50 +0200)]
Do not check key in json file
to avoid warning due to . in key in Rally reports
JIRA: RELENG-47
Change-Id: I204714311b9838ec09086950504046be7a29339d
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Guy Rodrigue Koffi [Thu, 1 Oct 2015 08:56:55 +0000 (10:56 +0200)]
Updates for result_collection_api
- pod identification : RELENG-33
- add filters on results : RELENG-32 / RELENG-31
- fix bugs on db connection
Change-Id: Ie720bb8028e5bfabd914c57df323b81d40c47fcd
Signed-off-by: Guy Rodrigue Koffi <koffirodrigue@gmail.com>
Morgan Richomme [Wed, 16 Sep 2015 12:58:27 +0000 (14:58 +0200)]
fix POD id type in API
the pod_id are defined as int but the APi sent a string, then the API was not working well when filtering on pod_id
we may discuss if a string description would not be more explicit than an id
JIRA: RELENG-7
Change-Id: Ib53263f379047bc4214926f966e40e797e42314e
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Guy Rodrigue Koffi [Sat, 5 Sep 2015 04:54:21 +0000 (06:54 +0200)]
Add external config support to result_collection_api
JIRA : RELENG-7
Change-Id: I2b68aac3e903b237f500bad91e3625aaf57bfdaf
Signed-off-by: Guy Rodrigue Koffi <koffirodrigue@gmail.com>
grkoffi [Mon, 31 Aug 2015 12:45:53 +0000 (14:45 +0200)]
Fix minor bugs for result_collection_api
JIRA : RELENG-7
Change-Id: Id3cda0a0a73fcf1d05de751a7f48bbae2145fbf4
Signed-off-by: Guy Rodrigue Koffi <koffirodrigue@gmail.com>
grkoffi [Tue, 25 Aug 2015 17:28:42 +0000 (19:28 +0200)]
Update result_collection_api
Fix lines length regarding pep8.
Add new handlers for cases and results and
HTTP methods to projects.
JIRA : RELENG-7
Change-Id: Idc7c0868384d29f28bccc78540edfb02ae1dfbaf
Signed-off-by: grkoffi <koffirodrigue@gmail.com>
Code Review / releng-testresults.git / log