mbeierl [Thu, 13 Jul 2017 01:41:01 +0000 (21:41 -0400)]
Creation of Local Docker for Daily Job
Moves the dockerfiles for the different submodules/containers into
their respective directories.
Adds a docker compose file that can build the containers from the
local filesystem, and mounts the local filesystem as a volume,
making it easier for developer testing as local changes are
automatically reflected in the final container.
Change-Id: I2376034258cab2a3dc3a0d1ac3f01bbf5d1f59e7
JIRA: STORPERF-189
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Tue, 11 Jul 2017 19:12:35 +0000 (15:12 -0400)]
Change all paths
Changes the paths of all source code so that it exists under the dockerfile location
for each container. This way we can use COPY instead of git clone, as well as use the
existing JJB.
Change-Id: I883b2957d89659c164fff0a1ebc4d677c534796d
JIRA: STORPERF-188
Signed-off-by: mbeierl <mark.beierl@dell.com>
saksham115 [Mon, 10 Jul 2017 18:26:50 +0000 (23:56 +0530)]
Adding /reporting/
Adding /reporting/ to the url
JIRA: STORPERF-162
Change-Id: I4042c490459738820558e7ce686ee5f2269d2bb1
Signed-off-by: saksham115 <saksham.agrawal@research.iiit.ac.in>
saksham115 [Thu, 6 Jul 2017 14:16:28 +0000 (19:46 +0530)]
Demo Code
Enter the URL of the json file available at testresults.opnfv.org.
It presents the data in the tabular and plots the chart for the series.
Data validation and some UI changes are yet to be made
Change-Id: I90ceed4e8a3240face479539f127d5c922d19d0c
JIRA: STORPERF-162
Signed-off-by: saksham115 <saksham.agrawal@research.iiit.ac.in>
Mark Beierl [Thu, 6 Jul 2017 13:55:35 +0000 (13:55 +0000)]
Merge "Dockerfile for reporting module updated"
saksham115 [Fri, 23 Jun 2017 10:05:49 +0000 (15:35 +0530)]
Dockerfile for reporting module updated
JIRA: STORPERF-162
Change-Id: If012cf4ce2c03851c2ceb3744dd3a2f366cb65d5
Signed-off-by: saksham115 <saksham.agrawal@research.iiit.ac.in>
mbeierl [Thu, 6 Jul 2017 13:45:26 +0000 (09:45 -0400)]
Corrected Typo
Change-Id: I67e47a1f56f90758a129d4d608d8c41ab4ad8d55
Signed-off-by: mbeierl <mark.beierl@dell.com>
Mark Beierl [Thu, 6 Jul 2017 13:42:49 +0000 (13:42 +0000)]
Merge "Adding Danube 3.0 Release Notes"
mbeierl [Tue, 4 Jul 2017 17:23:11 +0000 (13:23 -0400)]
Adding Danube 3.0 Release Notes
Changes the release notes to Danube 3.0 content
Change-Id: I13a03a20aa9e9f310e9b79eb878f3714ab38fa1e
Signed-off-by: mbeierl <mark.beierl@dell.com>
Mark Beierl [Tue, 4 Jul 2017 16:48:21 +0000 (16:48 +0000)]
Merge "Bugfix: Stack creation failure"
mbeierl [Sat, 1 Jul 2017 02:30:02 +0000 (22:30 -0400)]
Multi-threaded HTTP Support
Adds multithreaded HTTP request abilities to ReST Server.
Fixes docker-compose to ensure pull prior to up.
Fixes metrics typo to make jobs API query work again.
Change-Id: Ibac6188379cae0489792c5ea80f37dd3abf37082
JIRA: STORPERF-183
Signed-off-by: mbeierl <mark.beierl@dell.com>
Taseer [Sun, 2 Jul 2017 16:28:48 +0000 (21:28 +0500)]
Bugfix: Stack creation failure
JIRA: STORPERF-180
Change-Id: I07c38227b27b8e6148117a9907d43baeba4c67bb
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
mbeierl [Thu, 29 Jun 2017 18:16:39 +0000 (14:16 -0400)]
Docker Compose Updates
Adds docker-compose directory with content to start container suite using
nginx as front and and SwaggerUI in its own container.
Updates the documentation to reflect new method of starting StorPerf.
Change-Id: I469676e330dcad6c968b90133df8866b69eb5ea1
JIRA: STORPERF-181
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Wed, 21 Jun 2017 20:02:57 +0000 (16:02 -0400)]
Allow User to Specify Flavor
Adds flavor as parameter to ReST /configurations API and passes
it through to the heat template creation.
Change-Id: Id3632fb571da9da51b4d75db58c7a7c0a91e0ccf
JIRA: STORPERF-92
Signed-off-by: mbeierl <mark.beierl@dell.com>
Shrenik [Tue, 20 Jun 2017 20:10:53 +0000 (01:40 +0530)]
Remove Swagger from Storperf
Remove Swagger module from Storperf
Change-Id: Id491bb7ea1ddd55549d39ddbe4c7a7004d797a59
JIRA: STORPERF-129
Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>
mbeierl [Tue, 20 Jun 2017 16:06:22 +0000 (12:06 -0400)]
Creation of Reporting Module
Adds a new subdirector where all graphing and reporting content, including the
dockerfile, will be stored.
Change-Id: I8e9a0d975fe944faf81e97ae3792379a1375166a
JIRA: STORPERF-162
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Sat, 10 Jun 2017 12:38:00 +0000 (08:38 -0400)]
Removal of matplotlib
Removes the matplotlib modules from the main container.
Change-Id: I26a0c171b2172dbf2be66cdf10b897bb72e4bf2b
JIRA: STORPERF-161
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Thu, 8 Jun 2017 02:43:50 +0000 (22:43 -0400)]
Allow Filename Target
Changes the default filesize to 1g so that profiling a file works again
Change-Id: I060b7af75be08f4ffb411f1c612babb846172dd5
JIRA: STORPERF-153
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Thu, 8 Jun 2017 01:11:55 +0000 (21:11 -0400)]
Allow User-Specified Sample Size
Adds the ability to accept steady_state_sample_size as a parameter.
Removes deprecated nowarm and nossd.
Adds OS_PROJECT_DOMAIN_ID.
Change-Id: I00c01b05cd2cbf001bc5446faa30f36137350ccf
JIRA: STORPERF-139
Signed-off-by: mbeierl <mark.beierl@dell.com>
Mark Beierl [Mon, 5 Jun 2017 18:00:38 +0000 (18:00 +0000)]
Merge "Adding CORS Adds flask-cors module so that SwaggerUI can examine content from a different container JIRA: STORPERF-129"
Shrenik [Tue, 30 May 2017 19:08:55 +0000 (00:38 +0530)]
Adding CORS
Adds flask-cors module so that SwaggerUI can examine content from a different container
JIRA: STORPERF-129
Change-Id: I9c47a2ea464da83910c368d771dce13f5364ca23
Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>
mbeierl [Thu, 1 Jun 2017 14:30:39 +0000 (10:30 -0400)]
Fixing typo
Change-Id: I40a2367de22afe4db46c7da7d774f0e646cb8a23
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Wed, 31 May 2017 18:41:52 +0000 (14:41 -0400)]
Daily Job Parameter Support
Adds environment variables so that the daily jobs can be parameterized
from Jenkins.
Change-Id: I77518b90595460ca932f1e71f57b2b02ab3dd1f5
JIRA: STORPERF-138
Signed-off-by: mbeierl <mark.beierl@dell.com>
Mark Beierl [Mon, 29 May 2017 20:59:25 +0000 (20:59 +0000)]
Merge "Adding docker tag"
mbeierl [Mon, 29 May 2017 20:57:09 +0000 (16:57 -0400)]
Adding docker tag
Adds the tag to use when running docker from the DOCKER_TAG environment
variable.
Change-Id: Idde85510df01f8a809049dac62872db0c8a5bf25
JIRA: STORPERF-128
Signed-off-by: mbeierl <mark.beierl@dell.com>
Mark Beierl [Fri, 26 May 2017 20:30:13 +0000 (20:30 +0000)]
Merge "Removal of Edgar StPierre from Committer List"
mbeierl [Wed, 24 May 2017 17:25:07 +0000 (13:25 -0400)]
Adding domain to authentication
Adds domain if present in environment variables to user and project
Change-Id: I05fca2fbdeef4fa985bfb505f9158ce31da5ab9c
JIRA: STORPERF-127
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Wed, 24 May 2017 15:54:24 +0000 (11:54 -0400)]
numpy error in container
Removes numpy from container as it causes runtime problems.
Change-Id: Iaae384c9229e0af5057822d62fca146732d62a53
JIRA: STORPERF-126
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Tue, 23 May 2017 18:51:26 +0000 (14:51 -0400)]
Specify numpy version
Adds explicit version of numpy so it cannot conflict with any other that
may be present in the system path.
Change-Id: I23b21bca43f55805b3087646b1c31e1aea686aca
JIRA: STORPERF-126
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Thu, 4 May 2017 19:39:04 +0000 (15:39 -0400)]
Adding Release Notes
Change-Id: I904e995fa8fb8088053a556ddaf0d243a378098f
JIRA: STORPERF-111
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Tue, 2 May 2017 14:42:56 +0000 (10:42 -0400)]
Fix admin.rc generation
Explicitly filters out anything that is not an environment variable.
Change-Id: I0694649623b837d2ab4b2196abf45973d0e63168
JIRA: STORPERF-124
Signed-off-by: mbeierl <mark.beierl@dell.com>
Trevor Bramwell [Wed, 26 Apr 2017 21:30:57 +0000 (14:30 -0700)]
Removal of Edgar StPierre from Committer List
Change-Id: Ia79fd87e5ef15d2226457efb2bb1a21845a1fdd5
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
mbeierl [Wed, 26 Apr 2017 15:58:52 +0000 (11:58 -0400)]
Pinning version of Swagger UI
Changes the inclusion of Swagger UI to become a git checkout
of a fixed version rather than following the head.
Change-Id: I30def6d6c37a166cc37f15857a98064c760eb7c6
JIRA: STORPERF-123
Signed-off-by: mbeierl <mark.beierl@dell.com>
Mark Beierl [Fri, 31 Mar 2017 07:19:14 +0000 (07:19 +0000)]
Merge "Fixed paths to match standard"
mbeierl [Fri, 31 Mar 2017 07:01:17 +0000 (03:01 -0400)]
Fixed paths to match standard
Change-Id: I733d34eb8bbdf0201b06a21d0ceeda50a06dd49f
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Thu, 30 Mar 2017 14:05:27 +0000 (10:05 -0400)]
Fixed typo
Change-Id: I03b8df65a13a0c2ddeee6eb40e6071c8843ad5ca
JIRA: STORPERF-110
Signed-off-by: mbeierl <mark.beierl@dell.com>
(cherry picked from commit
6eb2c8d8a8971ee3ae0693feebe509d4ec30a7a8)
mbeierl [Thu, 30 Mar 2017 14:05:27 +0000 (10:05 -0400)]
Fixed typo
Change-Id: I03b8df65a13a0c2ddeee6eb40e6071c8843ad5ca
JIRA: STORPERF-110
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Thu, 30 Mar 2017 01:00:50 +0000 (21:00 -0400)]
Use tagged version of graphite
Changes the docker build procedure to use a pip install of a
specific version of graphite so that it doesn't break when
upstream changes occur.
Change-Id: I2316912fc04568c441212087665e384075e409a6
JIRA: STORPERF-110
Signed-off-by: mbeierl <mark.beierl@dell.com>
(cherry picked from commit
1bcbe0bac328e26341ba68341d4b809c32b8242f)
mbeierl [Thu, 30 Mar 2017 01:00:50 +0000 (21:00 -0400)]
Use tagged version of graphite
Changes the docker build procedure to use a pip install of a
specific version of graphite so that it doesn't break when
upstream changes occur.
Change-Id: I2316912fc04568c441212087665e384075e409a6
JIRA: STORPERF-110
Signed-off-by: mbeierl <mark.beierl@dell.com>
ShubhamRathi [Wed, 8 Mar 2017 09:24:33 +0000 (14:54 +0530)]
Adding Labels
Labels serve as anchors/ refs when referenced from other documents
This patch adds labels to docs/*/*/index.rst
Change-Id: I464d17d0b1e3b53daa30a5ecb1725f56aaabf39b
Signed-off-by: ShubhamRathi <shubhamiiitbackup@gmail.com>
mbeierl [Tue, 7 Mar 2017 16:14:12 +0000 (11:14 -0500)]
Changing run length to 30min to see if queue depth 2, block size 8192 stablilizes then instead
Change-Id: I360c1198f0464edb84fcfd04ef6bf3e35d1e7e4f
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Mon, 6 Mar 2017 19:53:40 +0000 (14:53 -0500)]
Remove deprecated fields
Removes the nowarm and nossd fields as it is better to be
explicit about running the '_warm_up' workload.
Change-Id: I54b67006abdc071f6fd190d6a5eefe026609c150
JIRA: STORPERF-108
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Fri, 24 Feb 2017 19:29:08 +0000 (14:29 -0500)]
Fixing final report
Makes the report readable instead of JSON escaped and dumps it
to the Jenkins daily when done.
Change-Id: Ic3788672b185461369e2c41221ae36fc4b45436b
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Tue, 21 Feb 2017 18:23:42 +0000 (13:23 -0500)]
Documentation Update
Adds documentation for Danube.
Change-Id: I2755cb00b769cd0668e5c956d0b70c33d328d882
JIRA: STORPERF-81
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Fri, 17 Feb 2017 22:43:39 +0000 (17:43 -0500)]
Steady State Metrics
Changes the overall value of all metrics to be based on the
calculated steady state values instead of the average for the
entire run.
Change-Id: I121929d5fe2dd43df7f289b82e9f5291c9ea9aab
JIRA: STORPERF-107
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Thu, 16 Feb 2017 15:40:35 +0000 (10:40 -0500)]
Prevent notifications after termination
Changes the event notification logic inside the FIO invoker
so that it no longer publishes events after termination.
Prevents false reports after steady state has been detected.
Change-Id: I694f77b6493b88820fe4f4cc7f634e3e62c45a9a
JIRA: STORPERF-105
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Wed, 15 Feb 2017 21:38:29 +0000 (16:38 -0500)]
Normalize data series
Changes the data series from using seconds to samples
so that slope is not artificially flattened.
Change-Id: Idf87926a47c2ba67e66e2254d3572adad7a81b44
JIRA: STORPERF-106
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Wed, 1 Feb 2017 19:27:19 +0000 (14:27 -0500)]
Add URL for results report
Records the URL returned from testresults db.
Changes the URL ref from localhost to external and reports in
daily job.
Change-Id: I0068ea963671fb183779ac20592ba6933647eea0
JIRA: STORPERF-104
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Tue, 31 Jan 2017 17:57:56 +0000 (12:57 -0500)]
Fixing double JSON encoding of results payload
Change-Id: I5e5a8180d5851630b1200ade84f6beb5dfa18466
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Mon, 30 Jan 2017 17:14:02 +0000 (12:14 -0500)]
Make it easier to see what's happening in Jenkins
Change-Id: I3ac727faa98c1e87dcd9522c0063ca6b251c62b4
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Fri, 27 Jan 2017 21:35:37 +0000 (16:35 -0500)]
Testresults DB Alignment
Changes the key names sent to the testresults db to align with other
projects.
Defines a clear PASS/FAIL based on the ability to find steady state for
all runs. If one run failed to achieve steady state, run gets labelled
as FAIL.
Change-Id: I73143779453689eea93829079388ed8035134aa3
JIRA: STORPERF-100
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Fri, 27 Jan 2017 18:15:53 +0000 (13:15 -0500)]
Dump env so I can see what variables are visible once the job is run under Jenkins
Change-Id: I576a75864fa0d7c6d12990c91984e12b1489258f
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Fri, 27 Jan 2017 17:44:07 +0000 (12:44 -0500)]
Fixed line to long error
Fixes the version of requests to match what docker was already
pulling in.
Truncate log message to 512 characters.
Change-Id: Idba9374c0f339c8b4cb6902c921c8b26fef573cc
JIRA: STORPERF-103
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Thu, 26 Jan 2017 18:00:16 +0000 (13:00 -0500)]
Pin version of setuptools
Forces explicit version of setuptools to be used because
of an upstream change:
https://github.com/pypa/setuptools/issues/937
Change-Id: I4124dedee38713ca1bfa445944d8d79cf1be6c15
JIRA: STORPERF-102
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Thu, 26 Jan 2017 16:30:26 +0000 (11:30 -0500)]
Hardening FIO interaction
Fixes a problem where FIO does not terminate by scheduling a
second killall if we get a specific message back from FIO
stderr.
Introduces a new flavor for StorPerf that has a little more
memory as larger memory maps for duplicate blocks sometimes
caused out of memory killer to be invoked.
Change-Id: I06856561ad73fef582a81d4136a36a1bea47654a
JIRA: STORPERF-99
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Fri, 20 Jan 2017 21:05:24 +0000 (16:05 -0500)]
Fix multiple workload runs
Change reporting so that multiple workloads in one job execution can
be reported instead of overwriting the previous value.
Change the daily job to use a single, multiple workload run.
Change-Id: I8e350350ae13d2272b584af7a60ad269de160587
JIRA: STORPERF-98
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Fri, 20 Jan 2017 17:25:19 +0000 (12:25 -0500)]
Correct duplicate event notification
Clears the listener list on start and remove listener after run
is completed.
Change-Id: I76e1f13379d60bdb72fcf2faf57d9762a62f17d3
JIRA: STORPERF-96
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Fri, 20 Jan 2017 16:40:06 +0000 (11:40 -0500)]
Change to Ubuntu 16.04
Change the base image used for the agent VM to Ubuntu 16.04 as
the 14.04 image has kernel panic when the Cinder Volume is detached
Change-Id: I37e41939826fbc7c1efcc4360b99b1a2b34b8d11
JIRA: STORPERF-97
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Wed, 18 Jan 2017 20:09:34 +0000 (15:09 -0500)]
Actually check out releng locally
Change-Id: I50358e0685be45abd9330639fcdfa9c8a39ff5ba
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Wed, 18 Jan 2017 19:22:08 +0000 (14:22 -0500)]
Fixing up paths and checking out releng locally
Change-Id: I62d877acc37a10391e59db1611c0a0af3d57fca3
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Wed, 18 Jan 2017 19:07:11 +0000 (14:07 -0500)]
Fixed typo
Change-Id: Iedc8f023636325dee664bfafab45381997d6403a
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Tue, 17 Jan 2017 19:22:18 +0000 (14:22 -0500)]
StorPerf Daily Job
Helper script that determines what installer was used.
Script to generate RC file for container.
Script to determine number of Cinder nodes.
Daily job to pull new container, create stack based on
number of Cinder nodes, issue a warm up, and then run
a series of performance tests against the stack. Deletes
stack once complete.
JIRA: STORPERF-87
Signed-off-by: mbeierl <mark.beierl@dell.com>
Change-Id: I551f21ffc85f11b0c0724205e952551022a94f5b
mbeierl [Tue, 17 Jan 2017 19:16:29 +0000 (14:16 -0500)]
Expose TENANT_ID
Change-Id: I2b07bb9724b19f8b25e35160fba3bf11621a30d7
JIRA: STORPERF-93
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Fri, 9 Dec 2016 18:34:35 +0000 (13:34 -0500)]
Use v3 Auth
Change to detect environment variable and use v3 authentication
instead if present.
Change-Id: Iada49741b3297f20b740e232b2b35bec92fda91a
JIRA: STORPERF-88
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Tue, 6 Dec 2016 15:54:10 +0000 (10:54 -0500)]
Allow 0 to match steady state and don't terminate the warmup
Change-Id: I61f8ce4e719e2c2ef7597c0e41aff8c8d79edc2d
Signed-off-by: mbeierl <mark.beierl@dell.com>
mbeierl [Tue, 6 Dec 2016 14:45:04 +0000 (09:45 -0500)]
Fixed typo
Change-Id: I82cf026017690436a1112daabfa0b084275d8fe7
Signed-off-by: mbeierl <mark.beierl@dell.com>
Mark Beierl [Sat, 3 Dec 2016 03:25:48 +0000 (22:25 -0500)]
Steady state detection
Detection of steady state after 10+ samples of data
Change-Id: I29368b06188c6370d17b3d567fece6486d171235
JIRA: STORPERF-72 STORPERF-73
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
Mark Beierl [Sat, 3 Dec 2016 03:24:07 +0000 (03:24 +0000)]
Merge "Change to Paramiko"
Mark Beierl [Fri, 2 Dec 2016 16:19:54 +0000 (11:19 -0500)]
Change to Paramiko
Use Paramiko ssh client instead of invoking ssh and scp
from the command line
Change-Id: Ibc8395b98842fd7f40b49c4dafa2688d8e64abc7
JIRA: STORPERF-91
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
MatthewLi [Thu, 1 Dec 2016 03:34:47 +0000 (22:34 -0500)]
bugfix: Add BRANCH Argument in the Dockerfile
Change-Id: If5ccbe0633ed5331b38d8231e0dd6eadd05ecbe8
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
Mark Beierl [Mon, 28 Nov 2016 21:17:05 +0000 (16:17 -0500)]
Data Handling Refactoring
Break out test db interaction into new module and
make the push event driven instead of the sleep
that was there before.
Change-Id: I9485aba1405f6c3b4ee5000168fbc037efa87c81
JIRA: STORPERF-90
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
jose.lausuch [Wed, 30 Nov 2016 14:49:47 +0000 (15:49 +0100)]
Add BRANCH Argument in the Dockerfile
This patch allows:
- clone the respective repo branch while building the image
- slightly reduce the size of the image by cloning only the latest
Change-Id: I48994d7d9cf230493fa22f39cf1ed7ef4fd72d9e
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
Mark Beierl [Fri, 25 Nov 2016 18:28:40 +0000 (13:28 -0500)]
Data Reporting Gate
Module that allows passing of a gate only once all other
peers have also reported in within a specified time period
Change-Id: If4baf1d4377026c7833a6f30bfc2e36698f675e8
JIRA: STORPERF-71
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
Mark Beierl [Wed, 23 Nov 2016 21:59:18 +0000 (16:59 -0500)]
Daily Job
Creation of a daily job script that runs under Jenkins and
kicks off a series of tests using the freshly cloned workspace.
Change-Id: Ibc63c1df954578ad78604321ea410c8fd8c63c41
JIRA: STORPERF-87
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
Mark Beierl [Tue, 22 Nov 2016 20:45:17 +0000 (15:45 -0500)]
Ability to query job status
Provide a method to query the status of a job by id
Change-Id: I4d3567995e7c7c3359596346009358276e79d65c
JIRA: STORPERF-89
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
Mark Beierl [Tue, 22 Nov 2016 15:26:06 +0000 (10:26 -0500)]
Wait for agent status
Test the agent's ssh port prior to proceeding with test
Change-Id: Iff65f2c12a50063aa9f2ee4b75638ec0666ded1b
JIRA: STORPERF-34
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
Mark Beierl [Fri, 11 Nov 2016 15:48:38 +0000 (10:48 -0500)]
Additional Coverage
Adds HTML output to coverage so we can see it in Jenkins
Change-Id: I89595921bf86b8963890051a25e45f7bd08b0636
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
Mark Beierl [Thu, 10 Nov 2016 20:47:41 +0000 (15:47 -0500)]
Create Stack Fixes
Removes check stack as that can timeout when a large
number of agents are requested
Waits for stack to be created before returning
JIRA: STORPERF-70
Change-Id: I1cbe45b1f60f0ecab0691f0822ed5643778d218b
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
mbeierl [Mon, 5 Sep 2016 12:13:28 +0000 (08:13 -0400)]
Installation Guide
Populate the installation guide
Change-Id: I271ee6d5a38195aaf95a9c821bee8049470d674f
JIRA: DOCS-124
Signed-off-by: mbeierl <mark.beierl@emc.com>
Mark Beierl [Wed, 24 Aug 2016 19:30:15 +0000 (15:30 -0400)]
Slope error
Test and fix for error in slope
STORPERF-74
Change-Id: I17a8e0e1e588deb875ecace85290f92167df1d5e
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Tim Rault [Fri, 15 Jul 2016 20:32:51 +0000 (16:32 -0400)]
Add Steady State Detection module
Added a Steady State Detection module containing a steady_state(data_series)
function that is able to return a boolean indicating wether or not steady
state is reached with the data_series being passed.
This module requires a data_treatment(data_series) and an average(data_series)
modules that have been added in this commit as well. The data treatment function
aims at formatting the data series that is passed to the high level steady_state
function to reach the requirement of each sub-module (slope, average and range).
Modified the Slope and Range functions so they return None when passed an empty
data series instead of 0 which was wrong. Modified the corresponding test cases.
Modified the math_range_test.py file to fix a bug in the 2 last tests.
Change-Id: I9c3854cb0a21cc37b0787b8afca0821eefaa203d
JIRA: STORPERF-60
JIRA: STORPERF-59
JIRA: STORPERF-61
JIRA: STORPERF-62
Signed-off-by: Tim Rault <tim.rault@cengn.ca>
Mark Beierl [Thu, 14 Jul 2016 20:20:44 +0000 (16:20 -0400)]
Separation of test and source
Moving the test files into their own top-level
directory to keep things clean
Change-Id: Ic50b881045bc59b003807923424345b335dd5c95
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Mark Beierl [Thu, 14 Jul 2016 03:26:00 +0000 (23:26 -0400)]
Enforce Style Guidelines
Update to fail verify if pep8 compliance not met.
Revert back to Coverage 4.1 to show code coverage
report in Jenkins again
Change-Id: Icb467451f101942255c7944ad796497609dcb07e
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Mark Beierl [Thu, 14 Jul 2016 20:08:51 +0000 (20:08 +0000)]
Merge "Fix missing test"
Tim Rault [Tue, 12 Jul 2016 19:30:51 +0000 (15:30 -0400)]
Add Range function for Steady State detection
Added a range_value function in utilities/math.py able to compute the range
of a series of y values : [y1, y2, ..., yn].
Implemented a test harness for this range_value function in the tests/utilities
section.
Renamed the math_slope.py and math_range.py test files to add _test.py for
Jenkins.
Cleaned up the code so it is compliant to the pep8 rules.
Renamed the previous 'math' modules (storperf/utilities/math.py
and storperf/test/utilities/math.py) as 'math_slope' to be
coherent with the new notation.
Change-Id: I02ccd2b87f0b72e7a28c416b593aae4d8ad97961
JIRA: STORPERF-57
JIRA: STORPERF-58
Signed-off-by: Tim Rault <tim.rault@cengn.ca>
Mark Beierl [Thu, 14 Jul 2016 04:11:23 +0000 (00:11 -0400)]
Fix missing test
All test files must end in _test.py or they don't get
executed
Change-Id: If3a46a66570f7d07d0e93de72438a8a46b3e0a22
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Tim Rault [Wed, 29 Jun 2016 14:54:55 +0000 (10:54 -0400)]
Add Least Squares slope function
Added a math module in utilities that contains a slope function
able to compute the slope of the best Least Squares curve fit
given a series of [x,y] values.
Implemented a test harness for this math module in the tests/utilities
section.
Change-Id: If4d63af092d0904b2269c5ee0991e18ab84533c0
JIRA: STORPERF-54
JIRA: STORPERF-55
JIRA: STORPERF-51
Signed-off-by: Tim Rault <tim.rault@cengn.ca>
Mark Beierl [Thu, 16 Jun 2016 19:51:41 +0000 (15:51 -0400)]
Force a compatible version of Coverage
LiClipse / PyDev only works with 3.4
Change-Id: I351df5f8120889af07b10ebb7a740d1e318cb1c2
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Mark Beierl [Thu, 26 May 2016 15:14:05 +0000 (11:14 -0400)]
Autocreate the key pair
Change-Id: Ib4b8cb92b4cbc7dd778363335b6d0e22ae1993fb
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Mark Beierl [Fri, 20 May 2016 13:30:46 +0000 (09:30 -0400)]
Standardize the ReST API
Change-Id: I004824711abf17f06781302cf48a0b0e3d095ecb
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Mark Beierl [Fri, 13 May 2016 14:49:28 +0000 (08:49 -0600)]
Fixed logic indendation bug
Change-Id: I6cb17c699ae3b88a591278da23d60dfc0da91e40
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Mark Beierl [Thu, 12 May 2016 21:57:32 +0000 (15:57 -0600)]
Fixed spacing for swagger docs
Change-Id: I994153d03981f9b706834ab2ab09196e235cc7ce
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Mark Beierl [Thu, 12 May 2016 16:05:25 +0000 (10:05 -0600)]
Results DB Reporting
Add the ability to push results to the test result db. If
the environment variable TEST_DB_URL is defined, results
will be pushed there. If not, no push is attempted.
Change-Id: Ib833530d7379c5f37f0d2904a83d31a4ee559ae6
JIRA: STORPERF-13
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Mark Beierl [Wed, 11 May 2016 21:38:26 +0000 (15:38 -0600)]
Max test duration
Add a maximum time limit for any one given test so
that silly mistakes like block size 512, queue depth 1
does not end up running for 2 days
JIRA: STORPERF-53
Change-Id: I1f3e5046e1dd346fc5b28a7b935df2ee9aa6ba3d
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Mark Beierl [Wed, 11 May 2016 16:54:48 +0000 (10:54 -0600)]
Job Run Metadata
Add the ability to store arbitrary metadata about the job for
later reporting
Change-Id: If7f1d0a69111567d69db865baec6c20f9a1f494f
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Mark Beierl [Tue, 10 May 2016 23:15:54 +0000 (17:15 -0600)]
Fix double loop bug
Change-Id: I47f20dec309d7ab8402f40f6cf09828aa134e902
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Mark Beierl [Tue, 10 May 2016 16:48:53 +0000 (10:48 -0600)]
Auth timeout fix and VM image selection
Fix the OpenStack client authentication timeout bug where we never
reauthenticate after authentication expires
Add the ability to specify what OS image from the Glance catalog
should be used for the Agent VM
Change-Id: I2ff8f5598b8d58ee2bf654b3572e9841b24cc9de
JIRA: STORPERF-42
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Mark Beierl [Sun, 8 May 2016 14:09:47 +0000 (10:09 -0400)]
Add plots
Adds matplotlib
Adds support for generating graphs showing performance results
Change-Id: Iba344baab89e35c0d5891a9d6b4c22c37666511e
JIRA: STORPERF-44
JIRA: STORPERF-50
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Mark Beierl [Thu, 5 May 2016 02:53:07 +0000 (22:53 -0400)]
Add Stats report and Swagger UI
Add Swagger web ui at /swagger
Add ability to fetch read/write latency status via ReST ui
Can now delete where stack was removed from OpenStack but not from the
storperf DB
Change to use Floating IPs instead of private IP
Fix delete bug where there was no dependency on resources in
the resource group.
JIRA: STORPERF-19
JIRA: STORPERF-20
Change-Id: I1d9627d81f3c309b178a9b68cc306a4101c1a231
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
Mark Beierl [Thu, 5 May 2016 02:53:07 +0000 (22:53 -0400)]
Add Stats report and Swagger UI
Add Swagger web ui at /swagger
Add ability to fetch read/write latency status via ReST ui
Can now delete where stack was removed from OpenStack but not from the
storperf DB
Change to use Floating IPs instead of private IP
Fix delete bug where there was no dependency on resources in
the resource group.
JIRA: STORPERF-19
JIRA: STORPERF-20
Change-Id: I0a4b3386789c38d6745906ba896b8ff851dc122f
Signed-off-by: Mark Beierl <mark.beierl@emc.com>