Job run lifecycle rework

Change the way slave jobs are managed so that they are in step
with each other, and we can track the overall thread that is
running them.  This lays groundwork for STORPERF-20 and
STORPERF-44

JIRA: STORPERF-33 STORPERF-43

Change-Id: Iaff48a2823ba85d6512e9782fd9091a72639835c
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Tests in verify

Run the tests in the verify command instead
of just merge so that way patches can be
rejected if tests fail

Change-Id: I8907618a324296460a71a51d087926f9089e0d21
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Test Run Default Values

Change test run to default to 64k blocks with 100% of attached storage
being tested.

JIRA: STORPERF-33

Change-Id: Id803d0493fb2c35691911ed79d226443a01503f3
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Graphite module load fix - reopen

Create symlinks for whisper so that Graphite
can find the modules at runtime. Needs to be
done after Graphite is installed

Change-Id: I383557138fa083d4ffeea307868465f72efaeb69
JIRA: STORPERF-41
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Incorrect name

StorPerf agent now uses storperf in ssh
HOT uses default name StorPerf Ubuntu 14.04

Change-Id: Ie87443955c73d1e81fb3a75b90e4a65a9ac6560b
JIRA: STORPERF-39
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Fixup initilization

Fetch the target from the correct field.
Initialize the workloads to a known value

Change-Id: Iadea5b580671fc2e4a1394248b800a446a37824a
JIRA: STORPERF-36 STORPERF-37
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

FIO needs sudo

Use sudo for fio when profiling a device.

Change-Id: Ibbcbb15a2c33e1e58b7e340f9c3f6de5958f5636
JIRA: STORPERF-40
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Deadlock in job_db

Change order of operation so that we do not attempt
to lock the same mutex twice in a row.

Change-Id: I1f874d720e2b66d9b272be0202482b22d24ef2b2
JIRA: STORPERF-42
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Merge "Cinder fix"

Cinder fix

Fix so that Cinder will use Tenant ID instead of name

Change-Id: I2d30db61dffc4f381d64e8d99449a2c55c5928a9
JIRA: STORPERF-38
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Graphite module load fix

Create symlinks for whisper so that Graphite
can find the modules at runtime.

Change-Id: Ie0defb180a29ba430978be091d6683a6cf7d5891
JIRA: STORPERF-41
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

DB Access Mutex

Addition of a mutex to prevent mutiple, simultaneous DB accesses as SQLite is single threaded

Change-Id: Iad2cd94015f7fb604dc6b60636db939099f52757
JIRA: STORPERF-32
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Developer build process fix

Fix the installation os setuptools so that it
does not conflict with mock.

Change-Id: I7c497d36c80a795fc99b329da2d171a265e4eacc
JIRA: STORPERF-35
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Fixed typo

SSHD failed to start due to typo in supervisord.conf

Change-Id: I23fd1452b83dd28d1c2c24760a5d428e01f90799
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Remote slave agent workload

Add storperf master object to manage stack
lifecycle.
Add configuration db.
Creation of CLI vs. main so that ReST API
and CLI API can be kept clear.
Fixed License in files.
Changed DB objects to be thread safe.
Added ssh server to container if desired
for CLI.

Change-Id: Idfe84bfb7920e6ce19d27462593c21ea86e7b406
JIRA: STORPERF-29
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Switching merge job to virtualenv

Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Workload reporting

Use a local db to track start/end times of runs so we
can go back to the carbon db and summarize values
at reporting time based off the raw data.

Change-Id: Ie62afd339fd1c15d82bc56c93c7cba5bd4f90fe2
JIRA: STORPERF-29
Signed-off-by: mbeierl <mark.beierl@emc.com>

Additional FIO and development build support

Add async IO development package so that FIO can
take advantage of that in order to drive queue
depth up.
Add supervisord to container so graphite and
carbon can start automatically
Add a developer build script so we can create
a container based on current state of local
repo

Change-Id: Ibd57f484b2fa41aa48a1c4fb06217e7d6e1c0b3a
JIRA: STORPERF-15
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Adding Jose Lausuch as commiter

Change-Id: I22c24e2bfd8f08ce4ff7f18794280582f564b8f0
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Create dockerfile to build the storperf image

JIRA: STORPERF-15

Change-Id: I1e35694e8b091caa3718c341f9f95217e5b0b609
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>

This should not be under source code control

Change-Id: Ia4f84fef338401604a704cd5b690b7bddd968886
Signed-off-by: Mark Beierl <mark.beierl@emc.com>

Adding workload modules

Adding the ablity to define workloads in modules which can be
referenced from the API.  Breaking out the test execution into
its own class so it will be easier to support ReST or other
interfaces.

Added flake8 and code coverage reports where possible to
merge and verify jobs

Change-Id: Ieb51e4e7e1e989288a6f81f4757709669914a196
JIRA: STORPERF-21
Signed-off-by: mbeierl <mark.beierl@emc.com>

Adding Heat template for staging StorPerf master node

Change-Id: I1e55290013f31272952f23869a02d68ca08cd4a7
JIRA: STORPERF-12
Signed-off-by: mbeierl <mark.beierl@emc.com>

Integration with Releng

Added verify, merge and daily jobs that will be
called automatically by Gerrit/LF Jenkins on
workflow change

Change-Id: I3ae85593b6aeac4a1a7abb51354b9cc6fa1fd813
JIRA: RELENG-41
Signed-off-by: Mark Beierl <mark@jemms.net>

Logging and timestamp

Added logging and fixed issue if fio does not produce the current timestamp
in its output

JIRA: STORPERF-4

Change-Id: Ifd0dbc4e17d984907e63089ebfae1d0e9e749dcc
Signed-off-by: mbeierl <mark.beierl@emc.com>

Main and fio interaction

JIRA: STORPERF-4

Change-Id: I60efb773848459f994662db8f050174ab9c86bd0
Signed-off-by: mbeierl <mark.beierl@emc.com>

Creation of converters

JIRA: STORPERF-6

Change-Id: Id81a129807a984ad4af669e3f0f84c1e7ced5552
Signed-off-by: mbeierl <mark.beierl@emc.com>

Creation of emitters

JIRA: STORPERF-7

Change-Id: I0a34af62ef850c9fc3e117b5c53283fc8d17561f
Signed-off-by: mbeierl <mark.beierl@emc.com>

Created converters

JIRA: STORPERF-6

Change-Id: Idba1718a8ad8243872ca100ed10b1c457221d147
Signed-off-by: mbeierl <mark.beierl@emc.com>

Added PyDev projects

JIRA: STORPERF-1

Change-Id: I1bf9ff0d7f512d3441ac23795fbe80b4884795dd
Signed-off-by: mbeierl <mark.beierl@emc.com>

Added Jenkins scripts
JIRA: STORPERF-12
JIRA: STORPERF-1

Change-Id: I222381a690c89324058c8b6510b33a94c0ce0052
Signed-off-by: mbeierl <mark.beierl@emc.com>

Adding INFO and LICENSE for review

Change-Id: Ic565f117347ed80a5aee703254224c6f4b57b80e
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>

Initial empty repository