Proper Job Metrics

Uses all FIO jobs, not just job.1 when calculating metrics.

Fixes bug when multiple volumes are created, but thread gate
is not big enough.

Change-Id: I473b2d19848c6ebc15e7669d84fade52d10fb97d
JIRA: STORPERF-263
Signed-off-by: mbeierl <mark.beierl@dell.com>

Merge "Local Documentation Builds"

Local Documentation Builds

    This adds configuration for performing local documentation builds
    with the following simple command:

    tox -e docs

Change-Id: I8d7b3af60c12f4d426e3d6fc64eae66b356d94a6
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>

Fix links to remove references to submodules

All references to submodules must be removed for docs to
work going forward.

Can be tested once your project has a local tox file

Change-Id: I93cbb1a71696a9c8f8d8a5dd27b800521bb8c84f
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>

Fix 3rd_party link in reporting

Updates links to 3rd party resources in
reporting module. This fixes graphs not
being generated.

Change-Id: I8bdb37f3b6948bc2fd09a8cf3d0b0f1588cafaf0
JIRA: STORPERF-258
Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>

Fixing series data.

Changes the min and max series to also contain the
index to make plotting easier.

Change-Id: Ifbb43658338d6389705e7f146fa1ca6e13c202ce
Signed-off-by: mbeierl <mark.beierl@dell.com>

Fixing Suprious Exception

When the results are too small to calculate
the slope, an exception is reported in the
logs.  This change avoids triggering the
exception criteria.

Change-Id: Iae886cde6244e9077ff94812bd830c48adaef365
Signed-off-by: mbeierl <mark.beierl@dell.com>

Calculate Data Series

Adds the min, max and actual slope values to the
final report metrics so that end users do not
have to calculate these values.

Change-Id: Ic98ec5cbfcdf7447d2bffc46e9bd05e087c72965
JIRA: STORPERF-257
Signed-off-by: mbeierl <mark.beierl@dell.com>

Update Tools

Updates to latet tools and corrects non-pep8
compliance

Change-Id: Ic1dd8e8ee9d3ac5360e53ed3578d631f4da28161
Signed-off-by: mbeierl <mark.beierl@dell.com>

Merge "Allow user to specify stack name on stack create"

Allow user to specify stack name on stack create

this allow Storperf to run multiple time at same time
using same OpenStack

Adds stack_name to all /configurations API requests as
an optional parameter.

Adds stack_name to the /jobs API POST as an optional
parameter.

Adds stack_name to the /initializations API as an
optional parameter.

Adds all stack info to the metadata for later reporting.

JIRA: STORPERF-256
Change-Id: Ief69c69472e08ee821555f3a006ab9edc7ec177f
Signed-off-by: Ameed Ashour <Ameed.Ashour.ext@nokia.com>

Tiding up post run

Sometimes extra slave IPs are left behind in memory
and deleting a job shows multiples of the same IP
being cancelled.

Change-Id: I7a1bd2f327a46a89fcb3df7e25356c946afb8262
Signed-off-by: mbeierl <mark.beierl@dell.com>

Allow user to specify subnet cidr on stack create

Change-Id: If910ac18f405c98a0e1f48d38d338ad4f61f6004
JIRA: STORPERF-255
Signed-off-by: Ameed Ashour <Ameed.Ashour.ext@nokia.com>

Allow multiple initializes

Fixes a bug where custom workloads could take priority
over the initialization API and the warm up does not
actually work

Change-Id: I984fc8d5e8e2871bb7f4420924efe38e2608cb4d
Signed-off-by: mbeierl <mark.beierl@dell.com>

Initialization API

Adds a new API that performs initialization of the target
filename or device instead of having to rely on the
magic _warm_up workload name.

Change-Id: Icb7ece05fb6190802df08f5a4aeeba62652757db
JIRA: STORPERF-254
Signed-off-by: mbeierl <mark.beierl@dell.com>

Merge "Collect slave info"

Collect slave info

Adds the output of uname -a to the metadata for each
slave.  Additional information about each slave can
also be added as needed in the future.

Change-Id: Ifb3d06599c0f1b7a4ffe06a7c98b151e62ba7bd8
JIRA: STORPERF-253
Signed-off-by: mbeierl <mark.beierl@dell.com>

Revert "Set self.stack_id = None after delete stack"

This reverts commit 6114b084b3fd47e638172cbbe64c6ea9e627e66d.

Change-Id: I089fbbf924a2c979e3cea619d8c5bc90820ff691
Signed-off-by: mbeierl <mark.beierl@dell.com>

Revert FIO to 2.99

Change-Id: I14cd60f7d359666a403b4535824d0c9b8a05df34
Signed-off-by: mbeierl <mark.beierl@dell.com>

Merge "Support Custom Workloads"

Merge "Set self.stack_id = None after delete stack"

Set self.stack_id = None after delete stack

Change-Id: I09ad953776804f17f5eedf296955ced51c5ed3a4
JIRA: STORPERF-251
Signed-off-by: Ameed Ashour <Ameed.Ashour.ext@nokia.com>

Switch to upstream nginx

Uses the official upstream nginx container image instead
of building a custom one to support ARM (aarch64).

Uses the official upstream node image instead of building
a customer one for ARM.

Change-Id: Ib465333204d3f1718da8cfb314cad32d955a3d2b
JITA: STORPERF-250
Signed-off-by: mbeierl <mark.beierl@dell.com>

Support Custom Workloads

Refactors interaction with test_executor to clean up the
tight coupling.

Adds ability to specify custom workloads.

Change-Id: Idbadcec1f42714e96c5f96d1e45c05982a531503
JIRA: STORPERF-246
Co-Authored-By: Ameed.Ashour.Ext@Nokia.com
Signed-off-by: mbeierl <mark.beierl@dell.com>

Adds volume_type support

Adds a new optional parameter, volume_type, to the configurations
REST API, allowing the user to specify the volume type to create.

Change-Id: I29b7bee442a5e1b6b98be439c06a58e3fd322943
JIRA: STORPERF-217
Co-Authored-By: Ameed.Ashour.Ext@Nokia.com
Signed-off-by: mbeierl <mark.beierl@dell.com>

Update release notes

Change-Id: I41ae2a5730684056e6854f22201544c5c486bd3e
Signed-off-by: mbeierl <mark.beierl@dell.com>

Fixes daily run

Change-Id: I8f17efe0d0866a3dc6ecbbabe07985b93ac445e6
Signed-off-by: mbeierl <mark.beierl@dell.com>

Use MultiThreaded SNAPS

Take advantage of multiple threads in SNAPS to get info on the
stack more quickly.

Change-Id: Ifbfaec4fb6f1a4a322c327176c82200b5f69d874
JIRA: STORPERF-245
Signed-off-by: mbeierl <mark.beierl@dell.com>

Adds IP Addresses to Config API

Uses the IP addresses of the VMs in the stack to populate
a new slave_addresses field in the REST API.

Change-Id: I363a4d118cf5c786f4faf8432ea884cb010c6db5
JIRA: STORPERF-239
Signed-off-by: mbeierl <mark.beierl@dell.com>

Speed up Builds

Adding a new keyserver and ulimit to help speed up
builds.

Change-Id: If79ba1e533bfe2044606d98047abe9fa342aefb4
Signed-off-by: mbeierl <mark.beierl@dell.com>

Merge "Nomination of Shrenik as Committer"

Merge "Adds Volume Count and Dynamic Reload"

Nomination of Shrenik as Committer

Change-Id: Ia114f41816f73af3fb9312b76e970aff25df21c9
Signed-off-by: mbeierl <mark.beierl@dell.com>

Merge "Auto Generated INFO.yaml file"

Auto Generated INFO.yaml file

INFO.yaml meant to be machine readable.
This file was auto generated from an ldap lookup
and your projects INFO file

Meeting times are not currently filled out.
please ammend this patchset to complete

Going forward comitter promotions should be done
against this file.

PTLs:
Must be merged for you to gain delete access on
testresults.opnfv.org

If project_lead: is missing (my script could not parse)
please amend with same from commiters section eg:

project_lead: &opnfv_$project_ptl
    name: 'Lead Name'
    email: 'lead email'
    id: 'lead lfid'
    company: 'lead company'

Change-Id: I8b7d209deacfb26e2869ef9b24a2df812be1a5be
Signed-off-by: agardner <agardner@linuxfoundation.org>

Adds Volume Count and Dynamic Reload

Adds a volume_count parameter that allows the user to
change the number of volumes.  Test execution still
uses each volume specified and appends it to the host
ip address in the graphite metrics.

Changes the cache policy of the stack from SNAPS-OO
so that changes made to the stack are refelcted in
StorPerf.

Fixes the documentation path and updates the docs
for the above changes.

Change-Id: I5b9160b469e80d4f7d6906ac270bb3b75411fb5a
JIRA: STORPERF-242
Signed-off-by: mbeierl <mark.beierl@dell.com>

Update release notes

Change-Id: Ifc4742dd43a267e6319f5c5a9eb66ed7de49aaa4
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Marking 3rd Party Software

Move all non Apache2.0/CC-BY-4.0 licensed files into
a 3rd_party directory

Change-Id: I4172063500f8bb2fa3ac767d1be8c6c5cf12aa7b
JIRA: STORPERF-241
Signed-off-by: mbeierl <mark.beierl@dell.com>

Fixing daily job

Use Ubuntu 16.04 instead as it is LTS and not subject to change
Enhance error reporting on stack creation failure

Change-Id: Ie187ae44ce66564da9779733a418fc8bb4e1c320
JIRA: STORPERF-240
Signed-off-by: mbeierl <mark.beierl@dell.com>

Nomination of Shrenik Jain as commiter

Change-Id: Ia0ef7b449d2cf8214ef8f0e535d58c719a93d909
Signed-off-by: mbeierl <mark.beierl@dell.com>

Updates for JOID Integration

Changes daily to use the script from JOID to fetch OS
information.
Adds more environment variables to the OSCreds.

Change-Id: I8cc07f82d6cc1bb70987a29947cc4093e8a2ff56
JIRA: STORPERF-238
Signed-off-by: mbeierl <mark.beierl@dell.com>

Removes Configuration DB

Removes the configuration DB from storperf_master and replaces
it with direct calls to Heat.  Allows for container to
discover an existing stack if it already exists.

Change-Id: I32e767d5173dbfd58aa1d2127a478a1d36392592
JIRA: STORPERF-236
Signed-off-by: mbeierl <mark.beierl@dell.com>

Merge "WIP - Use SNAPS to launch StorPerf Stack"

WIP - Use SNAPS to launch StorPerf Stack

Change-Id: I8857e6e0dd2bf9cd7c38cf18a7c239d7eb993d05
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Merge "Add metadata url to reporting docs"

Add metadata url to reporting docs

Missing URL created confusion as to which url is to be entered
in reporting module.

Change-Id: I0d2db471a8335c8ea8e4f434da4223ec5a0e8741
JIRA: STORPERF-230
Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>

Fixes Availability Zone Support

Fixes typo and passes the availability zone parameter
through all the heat templates.

Change-Id: I12d9d5d32ceb6461833fcfb4ea2961a34b97c35a
JIRA: STORPERF-225
Signed-off-by: mbeierl <mark.beierl@dell.com>

Merge "Fixes missing Python libs"

Fixes missing Python libs

Explicitly call out the version of cryptography lib so that we don't
get cannot import name certificate_transparency.

Change-Id: Ib36ea8e23414b8a297ca9dd3f322ed30d3dafb5f
Signed-off-by: mbeierl <mark.beierl@dell.com>

Resolve error in fetching metrics

There seems to be an update in the json format used.
The data is present at ['details']['metrics'] rather
than ['metrics']

JIRA: STORPERF-229

Change-Id: I7c3ee319ef4a128c33f5e2a26e10b6ff03a471d3
Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>

Update pip requirements

Change-Id: I3d4566e1f2a7893ff9a52179ac4a897fcb53ac18
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Add SNAPS as a pip requirement

- Remove common OpenStack requirements
- Will result in conflicts
- Use SNAPS built from master branch

JIRA: STORPERF-227

Change-Id: Ie4facfa092bafefe15168042fb94ea7ff9bac7d0
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Merge "Prevent user from starting a second job while one is already running."

Merge "User Interface for homepage"

Merge "Harmonization titles of test project documents"

Merge "Update release notes"

Harmonization titles of test project documents

Change-Id: I5f6b916f7254605f592e0670e49c41b5ea54c3be
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>

Fixing daily job

Change-Id: I3ec92a7688106e7caa33be89926a7bea6b757596
Signed-off-by: mbeierl <mark.beierl@dell.com>

Improving Reporting

Changes IOPS and BW to summation vs. average.
Adds fixed 0 y axis to all graphs

Change-Id: I3379597bda04b030424a25c7309a02c982fdb706
Signed-off-by: mbeierl <mark.beierl@dell.com>

Merge "Adding FUEL Support"

Adding FUEL Support

Changes to Ubuntu 17.04 to overcome issue in 4.4
kernel on ARM for hotplug of cinder volumes.

Adds support for FUEL MCP certificate for SSL
communication with OpenStack.

Hard codes the target device to /dev/vdc for FUEL
as /dev/vdb is reserved for the OpenStack config
drive.

Change-Id: I17dae23f455448f632e0921dbdae45824bbeaa61
Signed-off-by: mbeierl <mark.beierl@dell.com>

Update release notes

Updates release notes for Euphrates
* Changes in Sections
* Tags not specified so used euphrates.1.0
* Add details of logs' availability

Change-Id: I6fe021a85aed03d033d34fb83b489ca24dc5950f
JIRA: STORPERF-211
Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>

Fixing Termination

exit 0 was put in by accident

Change-Id: Id188e3744746552edabbc763e12b749762be9e4a
Signed-off-by: mbeierl <mark.beierl@dell.com>

Prevent user from starting a second job while one is already running.

JIRA: STORPERF-214

Change-Id: I1fe7c0bc61dfa7899d39cee1d13f99b2435115cd
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Adding SSL Certificate Support

Change-Id: I4a45e5602afc3a1c303a44adc15c9ef94fe732bb
Signed-off-by: mbeierl <mark.beierl@dell.com>

Fixing test results.

Change-Id: I13ea847491f2758fd2003c0b206ec7a1356f3fb2
JIRA: STORPERF-216
Signed-off-by: mbeierl <mark.beierl@dell.com>

User Interface for homepage

Experimental changes.
* Used Bootstrap to create a minimalistic UI

Change-Id: I0f2ac253b695510b54ba18ab942958df8a174e85
JIRA: STORPERF-212
Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>

Merge "Fix Test Results"

Fix Test Results

Updates the key/values that are sent to testresults db.
Fixes the PASS/FAIL to ignore _warm_up job.

Change-Id: I8af292cd764637cd12cbdb5a2a3e114fbeda5665
Signed-off-by: mbeierl <mark.beierl@dell.com>
JIRA: STORPERF-216

Merge "Returns job id and status"

Returns job id and status

- If the user GETs for job without ID and type status,
  return all jobs along with status

JIRA: STORPERF-213

Change-Id: I5518acae45f259644c961c6dc9f0cb170b86b6e1
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Fixing Results DB Keys

Update keys pushed to testresults DB so they match
the expected values.

JIRA: STORPERF-216

Change-Id: I837254fbfb2837d6abfc22d6d33878f60227480c
Signed-off-by: mbeierl <mark.beierl@dell.com>

Merge "Inlining of the graphs JIRA: STORPERF-141"

Inlining of the graphs
JIRA: STORPERF-141

Change-Id: I94e82bab9796ae2e966435cb9c5b9f3651d82c06
Signed-off-by: saksham115 <saksham.agrawal@research.iiit.ac.in>

Adding Proxy Path Support

Adds WSGI wrapper to allow the path to be arbitrary as
long as it is passed in the reverse proxy

Change-Id: I6feca119093a3b3c60ad615f4e4b59bb2c212800
Signed-off-by: mbeierl <mark.beierl@dell.com>

Merge "Implementing the extension: Display of Steady State Convergence Report - All block sizes"

Implementing the extension: Display of Steady State Convergence Report - All block sizes

In addition, introducing an intermediary page for single json portal.
JIRA: STORPERF-141

Change-Id: I6dd7f43b1f0fd8293c4872e6a7c3ef909f2ddb83
Signed-off-by: saksham115 <saksham.agrawal@research.iiit.ac.in>

Fixing Typo and Adding Logs

Change-Id: Ib4271c4400ded3c27517ffca45343c4ae4613662
Signed-off-by: mbeierl <mark.beierl@dell.com>

Merge "Add Multi Arch to Docker"

Add Multi Arch to Docker

Adds multi arch support to the launching of the
containers.

Change-Id: Iee89cfad3dc455fe8fdd7861d73fadbe314c2c1e
JIRA: STORPERF-220
Signed-off-by: mbeierl <mark.beierl@dell.com>

Merge "Documentation for storperf-reporting module JIRA: STORPERF-141"

Documentation for storperf-reporting module
JIRA: STORPERF-141

Change-Id: I3a228737093d7ea3b645789fb2c7569ed4e932d5
Signed-off-by: saksham115 <saksham.agrawal@research.iiit.ac.in>

Adds graphite and swaggerui containers to installation.rst

swaggerui and graphite containers were missing.
JIRA: STORPERF-209

Change-Id: I4697d1641a0accc13daa60637e4195064a42a83c
Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>

Adds StorPerf developer guide

The wiki for Development Environment has been converted in .rst format.
JIRA: STORPERF-201

Change-Id: I4e2bc792a8704e4f933f0ea61533c1bf5955c64d
Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>

Merge "Fixing daily"

Fixing daily

Changes daily to not exit on diff, and continue cleanup

Change-Id: Ifed60a1a44d9aead5cb3cb9f65c24a8acaec502a
Signed-off-by: mbeierl <mark.beierl@dell.com>

Corrects url in docs/index.rst

The toctree in docs/index.rst point to ./user/installation.rst instead of
./testing/user/installation.rst
JIRA: STORPERF-208

Change-Id: If58eef5bc4eddb8fba2030c5e80aac1f45e85288
Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>

Merge "Creating intermediate page for the single-data-json files JIRA: STORPERF-163"

Creating intermediate page for the single-data-json files
JIRA: STORPERF-163

Change-Id: I401073eed70b298ae0c2fa60b2548e4a38d96fbb
Signed-off-by: saksham115 <saksham.agrawal@research.iiit.ac.in>

Merge "Changing Daily to Docker Pull"

Remove 8000 as exposed port from documentation

After using http-frontend 8000 is no longer exposed.
JIRA: STORPERF-207

Change-Id: I419d28ac36faa7a2231ff382c79feb5322ef9be0
Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>

Adds ENV_FILE to create_compose.py

env_file was accidentally removed.
JIRA: STORPERF-202

Change-Id: Ib2bcb3ab8e2fe8cec7a3a7fa7ef8160f77ec5bc8
Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>

Changing Daily to Docker Pull

Changes the daily job to pull images from Docker.io instead
of using docker-compose build to build the image from local
sources.

Reduces the default run time to ~30 minutes unless overridden
in the job definition.

Change-Id: Ib153b66454363f91813dc9c946f6b46156c502bd
JIRA: STORPERF-204
Signed-off-by: mbeierl <mark.beierl@dell.com>

Update Output Format

Show sample of standardized JSON output for single
job run.

Change-Id: Iec20cdcb3de02550bdca5da6257be21cbb4c0c1f
JIRA: STORPERF-203
Signed-off-by: mbeierl <mark.beierl@dell.com>

Remove localhost from emitter.py

emitter.py sends metrics to localhost and storperf-graphite.
Since no graphite module is present at localhost, it
needs to be removed from emitter as well.
JIRA: STORPERF-205

Change-Id: I0d5732160ff39a332b088c8ba540ca6f6a483e12
Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>

Merge "Add documentation create-compose.py error"

Add documentation create-compose.py error

Adds statement specifying dependency of python2
on future package.
Adds a newline at end of test-usage.rst

Change-Id: I3b692c700e7ef2e202f8d85387ae761b2da689ad
JIRA: STORPERF-190
Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>

Fix Job Status Report

Changes the loop for creating job status and list of
job workloads to run down to a single function instead
of two loops.  Uses single function to drive both status
and job workloads to execute.

Change-Id: Ia173b8450a857d032a862d03c62bfc1b248583da
JIRA: STORPERF-186
Signed-off-by: mbeierl <mark.beierl@dell.com>

Merge "Adding Taseer Ahmed as commiter"

Merge "Adding default ARCH"