releng.git
7 years agoxci: Introduce XCI_LOOP variable to control what to do properly 63/32963/4 danube.1.0
Fatih Degirmenci [Tue, 4 Apr 2017 16:18:54 +0000 (09:18 -0700)]
xci: Introduce XCI_LOOP variable to control what to do properly

XCI has different jobs/loops to run
- patchset verification jobs (currently bifrost and osa in future)
- periodic jobs (bifrost and osa)
- daily jobs (for OPNFV platform deployment and testing)

The same scripts/playbooks used by XCI will also be used by developers.

We need to do different things depending on the context the scripts
and playbooks are executed.
- periodic jobs will use latest of everything to find working versions
of the components. (periodic osa will use unpinned role requirements
for example)
- daily jobs will use pinned versions in order to bring up the platform
and run OPNFV testing against it. (daily deployment will use pinned
versions and role requirements for example)
- developers might choose to use pinned versions or latest

Depending on what loop we are running, we need to do things differently
in scripts and playbooks. This variable will help us to do this in easy way.

We can of course do pattern matching of the job name but it will not
work if the scripts are used outside of Jenkins.

The default loop for non-Jenkins execution is set to daily as we want
developers to use working versions unless they change it to something
else intentionally.

Change-Id: Iff69c77ae3d9db2c14de1783ce098da9e9f0c83d
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: Fix build blocker so downstream jobs can be started 55/32955/1
Fatih Degirmenci [Tue, 4 Apr 2017 14:14:37 +0000 (07:14 -0700)]
xci: Fix build blocker so downstream jobs can be started

Change-Id: Ie33bcbbe1d4c4fd2166c8931bd9f135cf4200263
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: Fix the haproxy service and gnocchi db sync problem 27/32827/3
Fatih Degirmenci [Fri, 31 Mar 2017 20:55:45 +0000 (22:55 +0200)]
xci: Fix the haproxy service and gnocchi db sync problem

This patch reflects the fix Tianwei found for the keystone and gnocchi
issues with HA deployment.

https://gerrit.opnfv.org/gerrit/#/c/32367/

The keystone issue should be fixed upstream but until that happens, we
can use the patch here to move us forward.

Previously removed OpenStack services have also been enabled to
try as close deployment as possible to upstream openstack-ansible.

Change-Id: Ib7b1cfe0f363381466b43a3249667c638c09d9fd
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoMerge "xci: Create periodic osa jobs to find working version"
Fatih Degirmenci [Tue, 4 Apr 2017 13:42:50 +0000 (13:42 +0000)]
Merge "xci: Create periodic osa jobs to find working version"

7 years agoxci: Adjust and fix jobs and scripts 99/32899/6
Fatih Degirmenci [Sun, 2 Apr 2017 17:08:41 +0000 (10:08 -0700)]
xci: Adjust and fix jobs and scripts

This change
- fixes GIT_BASE in jobs
- adjusts build blockers
- fixes where the flavor vars should be sourced from
- sources flavor vars for bifrost periodic jobs
- renames the xcimaster node to opnfv to be consistent
- removes obsolete xci-provision.sh script
- enable additional openstack services including tempest to
  ensure the deployment is sane

Change-Id: Ifdce1da52d68a26c2b87e1bd3b1996ec119d8d90
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoMerge "Removing _l3 from Apex scenario names in master"
Tim Rozet [Mon, 3 Apr 2017 16:08:51 +0000 (16:08 +0000)]
Merge "Removing _l3 from Apex scenario names in master"

7 years agoMerge "Updating Apex ENV Var Names"
Tim Rozet [Mon, 3 Apr 2017 15:43:53 +0000 (15:43 +0000)]
Merge "Updating Apex ENV Var Names"

7 years agoChange Danube image for reporting 03/32903/1
Morgan Richomme [Mon, 3 Apr 2017 06:51:05 +0000 (08:51 +0200)]
Change Danube image for reporting

to be sync with communication

Change-Id: I7747416ab73f85d979d405afd9b87d57faac2bf0
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
7 years agoxci: Create periodic osa jobs to find working version 25/32825/7
Fatih Degirmenci [Fri, 31 Mar 2017 20:20:17 +0000 (22:20 +0200)]
xci: Create periodic osa jobs to find working version

These jobs run periodically against the HEAD of master and stable/ocata
branches in order to attempt deployment and help us to find more
recent working versions to pin.

In perfect world, these jobs should be run post-merge, helping us
to move faster but lack of resources prevent us doing that.

One thing to note here is that we use the pinned version of bifrost
in order to make sure we change one thing at a time to reduce the
delta.

Change-Id: Ieaff7e80581c7577b253b3646ca386313295a45a
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoMerge "xci: Create periodic bifrost jobs to find working version"
Fatih Degirmenci [Sun, 2 Apr 2017 16:59:23 +0000 (16:59 +0000)]
Merge "xci: Create periodic bifrost jobs to find working version"

7 years agoMerge "xci: Configure daily job to use xci scripts"
Fatih Degirmenci [Sun, 2 Apr 2017 16:51:15 +0000 (16:51 +0000)]
Merge "xci: Configure daily job to use xci scripts"

7 years agoMerge "Dial in docker and ssh environment"
Tim Rozet [Sat, 1 Apr 2017 16:00:17 +0000 (16:00 +0000)]
Merge "Dial in docker and ssh environment"

7 years agochange openrc file path to /etc/yardstick/openstack.creds 61/32861/1
chenjiankun [Sat, 1 Apr 2017 09:09:16 +0000 (09:09 +0000)]
change openrc file path to /etc/yardstick/openstack.creds

JIRA: YARDSTICK-623

Now almost yardstick openrc file is in /etc/yardstick/openstack.creds.
But only in prepare_env.sh it is /home/opnfv/openrc.
So I unified it and change it to /etc/yardstick/openstack.creds in the
follow patch:
https://gerrit.opnfv.org/gerrit/#/c/32005/
Also there is some adapt work to do in releng.

Change-Id: I7764582dec1d9a8f74e53b23e23d98021a20589b
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoadd daisy unittest verify job 39/32739/3
SerenaFeng [Fri, 31 Mar 2017 08:35:39 +0000 (16:35 +0800)]
add daisy unittest verify job

Change-Id: Iab5b7126f72efa942e6e1a25d0a1af67c4c52aa6
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
7 years agoUpdate block parameters 49/32849/3
Julien [Sat, 1 Apr 2017 03:42:19 +0000 (11:42 +0800)]
Update block parameters

Fix issue:
1. father job block child jobs
2. deploy the env in daisy-virtual slaves

Change-Id: Idcda4b8ca5fcf9abbfae3c60bf656a0901a20e02
Signed-off-by: Julien <zhang.jun3g@zte.com.cn>
7 years agoDial in docker and ssh environment 79/32679/3
Jamo Luhrsen [Fri, 31 Mar 2017 03:56:51 +0000 (20:56 -0700)]
Dial in docker and ssh environment

- need the key to be in /tmp/.ssh/ because that is what robot is
  expecting.
- need to run docker with -ti

Change-Id: I8260e749d6afefec33b447d8fdbb89b3d4d39941
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
7 years agoAdd tox support 31/29231/5
Julien [Wed, 22 Feb 2017 14:14:06 +0000 (22:14 +0800)]
Add tox support

be easier to test jjb locally before submit for review.
add unitest in modules dir to tox(tox -emodules)

Change-Id: Ief4f10debc567d1d3ba111685c86b812a2058697
Signed-off-by: Julien <zhang.jun3g@zte.com.cn>
7 years agoxci: Create periodic bifrost jobs to find working version 23/32823/3
Fatih Degirmenci [Fri, 31 Mar 2017 19:59:51 +0000 (21:59 +0200)]
xci: Create periodic bifrost jobs to find working version

These jobs run periodically against the HEAD of master and stable/ocata
branches in order to attempt provisioning and help us to find more
recent working versions to pin.

In perfect world, these jobs should be run post-merge, helping us
to move faster but lack of resources prevent us doing that.

Change-Id: I6f6b2fcc58eda112b1e811a7b11269e928bbceef
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: Configure daily job to use xci scripts 21/32821/5
Fatih Degirmenci [Fri, 31 Mar 2017 19:13:31 +0000 (21:13 +0200)]
xci: Configure daily job to use xci scripts

Daily jobs are now switched to using xci-deploy.sh script together
with the environment variables, playbooks, and so on.

These jobs do not set any version for any of the component as
the point with these jobs is to test the platform itself, not the
tools.

DIB related stuff is still left as parameters to deploy job for SUSE
and CentOS jobs so we can override what is set by xci depending
on the distro.

Change-Id: I5a5292e6bae8fdd052858108db409e8d495fbf24
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoApex: fixes writing sha info into properties 19/32819/1
Tim Rozet [Fri, 31 Mar 2017 18:26:18 +0000 (14:26 -0400)]
Apex: fixes writing sha info into properties

Change-Id: Idc5ca86dbc51d83860f26244a4ed7d88015552d0
Signed-off-by: Tim Rozet <trozet@redhat.com>
7 years agoApex: Fixes regexp to match label names as well 15/32815/1
Tim Rozet [Fri, 31 Mar 2017 17:57:50 +0000 (13:57 -0400)]
Apex: Fixes regexp to match label names as well

Change-Id: I42f8836320e4bce2f890aa4a17d59f53efab7f97
Signed-off-by: Tim Rozet <trozet@redhat.com>
7 years agoxci: Update main script and readme 07/32807/3
Fatih Degirmenci [Fri, 31 Mar 2017 15:54:33 +0000 (17:54 +0200)]
xci: Update main script and readme

This change
- updates the main script to run the playbooks
- creates the initial version of the readme file

Change-Id: I4110433bce541a5d9645f34457f9e1b1ee93df19
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoUpdating Apex ENV Var Names 05/32805/1
Dan Radez [Fri, 31 Mar 2017 15:33:39 +0000 (11:33 -0400)]
Updating Apex ENV Var Names

- CONFIG and RESOURCES have been replaced by BASE and IMAGES in Danube

Change-Id: I1b1d4e73b1f4e8a13d63bd199ec4c91e853d14a6
Signed-off-by: Dan Radez <dradez@redhat.com>
7 years agoxci: Create playbook to destroy, create and provision VM nodes 85/32785/2
Fatih Degirmenci [Fri, 31 Mar 2017 13:02:16 +0000 (15:02 +0200)]
xci: Create playbook to destroy, create and provision VM nodes

This change moves preparation (cloning repos, combining opnfv/bifrost
with openstack/bifrost), destroying and creating VM nodes from the
script into a separate playbook.

This requires the host to have ansible installed. The version of ansible
to install using pip currently matches to what bifrost uses but it is
hardcoded and needs to be fixed properly.

The reason for having this as a playbook to simplify the script and
increase the reuse. This playbook will be used for
- developer sandbox
- periodic bifrost jobs to run against latest on given branch and
promoting bifrost sha1 to pin later on
- daily jobs to run using pinned versions of bifrost

Change-Id: I033f12290dfea19d4c74be80eea7203211c0369e
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoMerge "xci: Add ansible files for sandbox mini flavor"
Fatih Degirmenci [Fri, 31 Mar 2017 08:15:02 +0000 (08:15 +0000)]
Merge "xci: Add ansible files for sandbox mini flavor"

7 years agoxci: Add ansible files for sandbox ha flavor 21/32221/6
Fatih Degirmenci [Wed, 29 Mar 2017 13:43:00 +0000 (15:43 +0200)]
xci: Add ansible files for sandbox ha flavor

This patch adds noha target host configuration playbook, inventory, variable
files and so on to use until we have time to fix things more properly and some
other functionality becomes available in upstream. This approach will result in
duplicates but it is something we can perhaps live with.

The playbook to configure target hosts will be same with the one we will
have for noha flavor but for different for the flavor mini.

The user variables and openstack user configuration will be different between
flavors and keeping deployment specific configuration.

Change-Id: I4e2b375b9f8f6bd5f8c5da91a522b78d61a58125
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoMerge "xci: Add ansible files for sandbox noha flavor"
Fatih Degirmenci [Fri, 31 Mar 2017 07:49:30 +0000 (07:49 +0000)]
Merge "xci: Add ansible files for sandbox noha flavor"

7 years agoMerge "Add wait method for Docker builds"
Jose Lausuch [Fri, 31 Mar 2017 07:49:08 +0000 (07:49 +0000)]
Merge "Add wait method for Docker builds"

7 years agoAdd wait method for Docker builds 19/32419/4
jose.lausuch [Thu, 30 Mar 2017 08:51:32 +0000 (10:51 +0200)]
Add wait method for Docker builds

By default, if a docker build job triggers and
there is another one running at the same time,
it will abort the job.
This adds a wait method with a timeout to avoid that.

Change-Id: Ica86885c60ce4137c85474ec4b7441ac5bab600c
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
7 years agoMerge "unify raise exception process"
Serena Feng [Fri, 31 Mar 2017 01:42:44 +0000 (01:42 +0000)]
Merge "unify raise exception process"

7 years agoxci: Add ansible files for sandbox mini flavor 19/32219/4
Fatih Degirmenci [Wed, 29 Mar 2017 13:40:23 +0000 (15:40 +0200)]
xci: Add ansible files for sandbox mini flavor

This patch adds mini target host configuration playbook, inventory, variable
files and so on to use until we have time to fix things more properly and some
other functionality becomes available in upstream. This approach will result in
duplicates but it is something we can perhaps live with.

The user variables and openstack user configuration will be different between
flavors and keeping deployment specific configuration.

Change-Id: Ie312dfa2047d094b590de970c1436d69f4c69668
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: Add ansible files for sandbox noha flavor 17/32217/7
Fatih Degirmenci [Wed, 29 Mar 2017 13:11:27 +0000 (15:11 +0200)]
xci: Add ansible files for sandbox noha flavor

This patch adds noha target host configuration playbook, inventory, variable
files and so on to use until we have time to fix things more properly and some
other functionality becomes available in upstream. This approach will result in
duplicates but it is something we can perhaps live with.

NFS configuration is converted into a role and the rest is adjusted accordingly.

The playbook to configure target hosts will be same with the one we will
have for ha flavor but for different for the flavor mini.

The user variables and openstack user configuration will be different between
flavors and keeping deployment specific configuration.

Change-Id: I8faceae846285fc3e4260cbced5b740a9b0c3766
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoxci: Move role configure-network to the right place 03/32603/1
Fatih Degirmenci [Thu, 30 Mar 2017 20:49:23 +0000 (22:49 +0200)]
xci: Move role configure-network to the right place

Incorrectly placed role configure-network causes ansible to skip
the roles at the beginning of the playbook.

Change-Id: Id85e9684eb86acad7c11104b434a319c37e16903
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoMerge "xci: Add ansible files for sandbox aio flavor"
Fatih Degirmenci [Thu, 30 Mar 2017 20:18:24 +0000 (20:18 +0000)]
Merge "xci: Add ansible files for sandbox aio flavor"

7 years agoMerge "Modify interactions with installer VM to set up jenkins-ci for cbench test"
Tim Rozet [Thu, 30 Mar 2017 18:23:52 +0000 (18:23 +0000)]
Merge "Modify interactions with installer VM to set up jenkins-ci for cbench test"

7 years agoxci: Add ansible files for sandbox aio flavor 23/32223/2
Fatih Degirmenci [Wed, 29 Mar 2017 13:44:13 +0000 (15:44 +0200)]
xci: Add ansible files for sandbox aio flavor

This patch adds aio opnfv host configuration playbook, inventory, variable
files and so on to use until we have time to fix things more properly and some
other functionality becomes available in upstream. This approach will result in
duplicates but it is something we can perhaps live with.

The playbook to configure opnfv host is different from the playbook used for
the rest of the flavors as our target host is the opnfv host itself. This is
the reason for not having target host configuration playbook.

This installation of aio will be driven by upstream scripts/playbooks entirely
and we just execute the scripts we have in openstack-ansible repo.

Change-Id: Ica814bdac1d324414f3add382a8241de49c93a2e
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoprototypes: bifrost: Remove ironic templates 09/32509/1
Markos Chandras [Thu, 30 Mar 2017 14:00:48 +0000 (15:00 +0100)]
prototypes: bifrost: Remove ironic templates

This effectively reverts d8235c3c97f4 and 7c1b8bf89d6ce since
upstream has now fixed the issues reported in
https://review.openstack.org/#/c/450681/

Change-Id: I35588146654d9141bc9357faa3d44e8799c5b706
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "xci: Ensure using flavor inventory"
Fatih Degirmenci [Thu, 30 Mar 2017 13:29:43 +0000 (13:29 +0000)]
Merge "xci: Ensure using flavor inventory"

7 years agoxci: Networking fixes to introduce role and interface var 81/32481/2
Fatih Degirmenci [Thu, 30 Mar 2017 12:11:59 +0000 (14:11 +0200)]
xci: Networking fixes to introduce role and interface var

Network configuration task and accompanied handler put into a role
and handler is converted to task.

Distro specific var, interface, is introduced to ensure we do not
hardcode the interface which might not be available.

Update the templates accordingly.

Change-Id: I667620fe22c93a9b20a1d8c1b7b0051d7647b591
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoRemoving _l3 from Apex scenario names in master 69/32269/2
Dan Radez [Thu, 30 Mar 2017 12:46:40 +0000 (08:46 -0400)]
Removing _l3 from Apex scenario names in master

Change-Id: I9169434d3dc62c911d351f8238af2c5daf314d99
Signed-off-by: Dan Radez <dradez@redhat.com>
7 years agoMerge "dovetail: fix wrapper disable problem"
Jun Li [Thu, 30 Mar 2017 12:35:48 +0000 (12:35 +0000)]
Merge "dovetail: fix wrapper disable problem"

7 years agoxci: Ensure using flavor inventory 79/32479/1
Fatih Degirmenci [Thu, 30 Mar 2017 12:07:06 +0000 (14:07 +0200)]
xci: Ensure using flavor inventory

This is needed in order to configure target hosts that are in the
flavor inventory file rather than what is there by default, which
is aio.

Change-Id: Iab27ed71a3d7c03f8fbbec8ceb7af92259320412

7 years agoMerge "xci: Add common and OS family ansible var files"
Fatih Degirmenci [Thu, 30 Mar 2017 11:02:31 +0000 (11:02 +0000)]
Merge "xci: Add common and OS family ansible var files"

7 years agoxci: Add common and OS family ansible var files 17/32417/2
Fatih Degirmenci [Thu, 30 Mar 2017 08:50:50 +0000 (10:50 +0200)]
xci: Add common and OS family ansible var files

OS family vars_files are currently empty and put there to show
the intend. (kind of TODO)

opnfv.yml holds non-distro and non-flavor specific variables.

Change-Id: I65aff2650257f2df00fd1f0a0638fd1aff596ac4
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoMerge "bugfix: fix the docker_cleanup path"
mei mei [Thu, 30 Mar 2017 09:22:23 +0000 (09:22 +0000)]
Merge "bugfix: fix the docker_cleanup path"

7 years agoMerge "disable TestAPI update temporarily"
Serena Feng [Thu, 30 Mar 2017 08:37:53 +0000 (08:37 +0000)]
Merge "disable TestAPI update temporarily"

7 years agoMerge "xci: Add main playbooks and files"
Fatih Degirmenci [Thu, 30 Mar 2017 08:00:43 +0000 (08:00 +0000)]
Merge "xci: Add main playbooks and files"

7 years agounify raise exception process 95/32395/2
SerenaFeng [Thu, 30 Mar 2017 07:33:19 +0000 (15:33 +0800)]
unify raise exception process

Change-Id: I109ef9550a57e218b6f5c9196812b33133d34134
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
7 years agodovetail: fix wrapper disable problem 89/32389/1
xudan [Thu, 30 Mar 2017 07:01:38 +0000 (07:01 +0000)]
dovetail: fix wrapper disable problem

JIRA: DOVETAIL-377

Since there are two wrappers in dovetail-ci-jobs.yml and dovetail-weekly-jobs.yml,
respectively, the first wrapper (build-name and timeout) is disable.
Combine them into one wrapper with build-name, timeout and fix-workspace-permissions.

Change-Id: I4a4f766fc90612be2642bc01708d93392fb163ed
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoreplace self-defined http codes with standard definitions 73/32373/1
SerenaFeng [Thu, 30 Mar 2017 06:01:30 +0000 (14:01 +0800)]
replace self-defined http codes with standard definitions

Change-Id: I3045dc690e0bc1186f5c548cb533462dd03130d9
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
7 years agodisable TestAPI update temporarily 69/32369/2
SerenaFeng [Thu, 30 Mar 2017 03:33:40 +0000 (11:33 +0800)]
disable TestAPI update temporarily

recently I plan to make some effort on TestAPI,
add scenario processing exceptions, perfect swaggr documents,
refactor unreasonable coding...etc, all of those will not change
the original process or data structure, whilst many patches
will be submitted. Because there is latency during TestAPI update,
and it will cause test results lost, so I think it is better to
disable TestAPI automatic update for now and re-enable it when the
work gets done.

Change-Id: I5ceab808350a1ece500c8743622d197326aa5419
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
7 years agoModify interactions with installer VM to set up jenkins-ci for cbench test 21/32321/3
Jamo Luhrsen [Wed, 29 Mar 2017 22:53:52 +0000 (15:53 -0700)]
Modify interactions with installer VM to set up jenkins-ci for cbench test

- was grabbing stackrc for SDN_CONTROLLER_IP, but it actually in overcloudrc
- need to skip hostkeychecking for scp operations
- change permissions and ownership of /tmp/.ssh/ files so jenkins-ci can
  take over as the user

Change-Id: I2d8f3aadfd6eff35a288a4e49eabb035bb2560ef
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
7 years agobugfix: fix the docker_cleanup path 49/32349/1
yuyang [Thu, 30 Mar 2017 01:59:46 +0000 (09:59 +0800)]
bugfix: fix the docker_cleanup path

JIRA: RELENG-196
JIRA: BOTTLENECK-148

The path for calling docker_cleanup.sh is incorrect which causing
building job fail. This patch is to fix the issue.

Change-Id: I2a8ea79383123f541f4e67bc58a3f2f3e3d9beeb
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoxci: Add main playbooks and files 35/32235/9
Fatih Degirmenci [Wed, 29 Mar 2017 14:59:02 +0000 (16:59 +0200)]
xci: Add main playbooks and files

This patch adds the main/common playbooks, files, and templates to
be used for all flavors.

The provisioning and OpenStack installation process will be as below
- provision VMs for flavor using bifrost
- once the VMs are provisioned, configure-localhost.yml playbook will
be run, preparing the localhost in order to ensure the right playbooks
(configure-opnfvhost.yml and configure-targethosts.yml), inventory files
and var files are in place before we proceed with configuring opnfv host.
- after getting the right files for the flavor, opnfv host will be
configured using configure-opnfvhost.yml playbook.
- finally, the target hosts will be configured.
- once the above process is completed, openstack-ansible playbooks will
be run, setting up hosts, infrastructure and OpenStack.

Change-Id: I6e08b2cfdab9627f765e6fc414917b09f953cab2
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoMerge "prototypes: bifrost: Remove /opt/stack from previous deployments"
Fatih Degirmenci [Wed, 29 Mar 2017 16:46:26 +0000 (16:46 +0000)]
Merge "prototypes: bifrost: Remove /opt/stack from previous deployments"

7 years agoMerge "add rename scenario exceptions"
Morgan Richomme [Wed, 29 Mar 2017 16:36:56 +0000 (16:36 +0000)]
Merge "add rename scenario exceptions"

7 years agoMerge "dovetail: fix wipe workspace error"
Jun Li [Wed, 29 Mar 2017 15:06:16 +0000 (15:06 +0000)]
Merge "dovetail: fix wipe workspace error"

7 years agoprototypes: bifrost: Remove /opt/stack from previous deployments 31/32231/1
Markos Chandras [Wed, 29 Mar 2017 14:40:03 +0000 (15:40 +0100)]
prototypes: bifrost: Remove /opt/stack from previous deployments

/opt/stack is being created by bifrost so the destroy-env.sh
script should be responsible for cleaning up all the remnants.
That way we can use the destroy-env.sh script outside of Jenkins
as well.

Change-Id: I72d9737cf2446ff3ffc02f195337a6873eceb5c0
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "Add docker-compose files and requirements"
Morgan Richomme [Wed, 29 Mar 2017 14:30:42 +0000 (14:30 +0000)]
Merge "Add docker-compose files and requirements"

7 years agoMerge "xci: Destroy/undefine only the VMs we created"
Fatih Degirmenci [Wed, 29 Mar 2017 13:46:33 +0000 (13:46 +0000)]
Merge "xci: Destroy/undefine only the VMs we created"

7 years agoSet the jobs 4 hours apart 45/32145/4
Cristina Pauna [Wed, 29 Mar 2017 07:52:02 +0000 (10:52 +0300)]
Set the jobs 4 hours apart

A non-ci pod is made ci-pod for danube release, therefore this patch
modifies the cron jobs to be 4 hours apart instead of 8

This commit should be merged after the lable of the pods are changed
Request: OPNFV Helpdesk #39128

Change-Id: Ic88180d01d9ea03d03b79355cd78891ad612c59b
Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
7 years agoxci: Destroy/undefine only the VMs we created 77/32077/2
Fatih Degirmenci [Tue, 28 Mar 2017 17:20:37 +0000 (19:20 +0200)]
xci: Destroy/undefine only the VMs we created

Destroying/undefining all the VMs on host might cause issues for the
users. This change tries to reduce the possibility of it by removing
VMs listed by vbmc.

Change-Id: I5134043309722632df68a0800c6403e6f39a8d16
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agodovetail: fix wipe workspace error 81/32181/5
MatthewLi [Wed, 29 Mar 2017 09:14:16 +0000 (05:14 -0400)]
dovetail: fix wipe workspace error

JIRA: DOVETAIL-377

workspace wipe clean error log
https://build.opnfv.org/ci/job/dovetail-compass-virtual-debug-master/365/console
this is caused of wrong permissions with files under $WORKSPACE

seems the former method in dovetail-run not take effects(log into host, it's still root:root,
not $USER:$USER_GROUP)

use global fix workspace permission in wrapper to replace former method

Change-Id: I6ceaaf630590666f3b3db5f2628334879df2b8fb
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
7 years agoMerge "Make prescm step workspace permission fix a macro available to all"
Fatih Degirmenci [Wed, 29 Mar 2017 09:34:02 +0000 (09:34 +0000)]
Merge "Make prescm step workspace permission fix a macro available to all"

7 years agoadd rename scenario exceptions 71/32171/4
SerenaFeng [Wed, 29 Mar 2017 09:02:43 +0000 (17:02 +0800)]
add rename scenario exceptions

JIRA: RELENG-163

Change-Id: I680a181a3c1728034e5782de4bc65cc07f64540c
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
7 years agoMerge "bugfix: Bottlencks cleanup docker-compose dockers"
mei mei [Wed, 29 Mar 2017 09:27:23 +0000 (09:27 +0000)]
Merge "bugfix: Bottlencks cleanup docker-compose dockers"

7 years agoMake prescm step workspace permission fix a macro available to all 83/32183/1
Fatih Degirmenci [Wed, 29 Mar 2017 09:19:01 +0000 (11:19 +0200)]
Make prescm step workspace permission fix a macro available to all

bifrost-verify jobs have been using this without issues and it is
needed for many other jobs in order to avoid unnecessary failures.

This change makes workspace permission fix prescm step a macro.

Change-Id: Ib5678dbf21c17ce640a600d2a06ebed9674663fa
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoMerge "keep methods' name/docstring after decorator"
Serena Feng [Wed, 29 Mar 2017 09:08:50 +0000 (09:08 +0000)]
Merge "keep methods' name/docstring after decorator"

7 years agoprototypes: bifrost: Fix Ironic drivers for VMs 47/32147/1
Markos Chandras [Wed, 29 Mar 2017 08:09:03 +0000 (09:09 +0100)]
prototypes: bifrost: Fix Ironic drivers for VMs

Commit d8235c3c97f4("Set database pool_size in ironic.conf and
inspector.conf templates") added a copy of the ironic.conf.j2
template file to workaround an upstream bug but it also changed
the default ironic drivers leading to broken introspection. We use
virtual BMC for controlling the VMs and this expects ipmi ironic
drivers so we fix that.

Change-Id: Ibb2cc58738ec1693e136bdce7335cd1b861ec613
Fixes: d8235c3c97f4("Set database pool_size in ironic.conf and inspector.conf templates")
Signed-off-by: Markos Chandras <mchandras@suse.de>
7 years agoMerge "Adjust the testcase name for Bottlenecks stress test job"
mei mei [Wed, 29 Mar 2017 02:43:48 +0000 (02:43 +0000)]
Merge "Adjust the testcase name for Bottlenecks stress test job"

7 years agoMerge "xci: Make OSA playbook to use during installation configurable"
Fatih Degirmenci [Tue, 28 Mar 2017 23:15:32 +0000 (23:15 +0000)]
Merge "xci: Make OSA playbook to use during installation configurable"

7 years agoMerge "xci: Rename the deployment host to opnfv"
Fatih Degirmenci [Tue, 28 Mar 2017 20:46:30 +0000 (20:46 +0000)]
Merge "xci: Rename the deployment host to opnfv"

7 years agoxci: Make OSA playbook to use during installation configurable 81/32081/1
Fatih Degirmenci [Tue, 28 Mar 2017 18:41:28 +0000 (20:41 +0200)]
xci: Make OSA playbook to use during installation configurable

Change-Id: Ie6f079bb61905ca0458778b78fef799777b24efa
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoApex: adds OVN to danube daily 75/32075/1
Tim Rozet [Tue, 28 Mar 2017 17:21:40 +0000 (13:21 -0400)]
Apex: adds OVN to danube daily

Change-Id: I1d1b07fa3273a8766e0ec109d89e6c81b2d515d1
Signed-off-by: Tim Rozet <trozet@redhat.com>
7 years agoxci: Rename the deployment host to opnfv 73/32073/1
Fatih Degirmenci [Tue, 28 Mar 2017 17:02:19 +0000 (19:02 +0200)]
xci: Rename the deployment host to opnfv

Reflect the changes to other impacted files as well.

Change-Id: I106f4e47fe5c75d288f4878fe6ec9f8ff39c652e
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoApex: disables vfio-pci for baremetal fdio 69/32069/1
Tim Rozet [Tue, 28 Mar 2017 16:20:28 +0000 (12:20 -0400)]
Apex: disables vfio-pci for baremetal fdio

According to FDS folks, uio_pci_generic (default) should work with UCSB
baremetal.  We also hit a bug in UCSB where vfio-pci isn't working with
VPP.  Therefore falling back to uio_pci_generic.

Change-Id: Id9a6fe5be91aaf8476292a46c15c6e876616f4a6
Signed-off-by: Tim Rozet <trozet@redhat.com>
7 years agoMerge "Create Catalogue page"
Morgan Richomme [Tue, 28 Mar 2017 14:53:49 +0000 (14:53 +0000)]
Merge "Create Catalogue page"

7 years agoMerge "xci: Add/update variables to tool, user, and flavors"
Fatih Degirmenci [Tue, 28 Mar 2017 14:32:33 +0000 (14:32 +0000)]
Merge "xci: Add/update variables to tool, user, and flavors"

7 years agoMerge "jjb: xci: bifrost-cleanup: Retry 'gsutil rm' on failures"
Markos Chandras [Tue, 28 Mar 2017 14:20:46 +0000 (14:20 +0000)]
Merge "jjb: xci: bifrost-cleanup: Retry 'gsutil rm' on failures"

7 years agoxci: Add/update variables to tool, user, and flavors 55/32055/3
Fatih Degirmenci [Tue, 28 Mar 2017 13:20:43 +0000 (15:20 +0200)]
xci: Add/update variables to tool, user, and flavors

Updates
- RAM allocations for the flavors mini and noha increased to 12GB.
- Distro variables introduced to tool as it will be used by the CI and
the developers.
- LOG_PATH and RUN_TEMPEST are now available in user variables.

Change-Id: I4a73d7b79761d81f605cdb3fa9771ca40e9f9f02
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoChange jenkins user:group name according to Node Name. 45/31645/4
zshi [Fri, 24 Mar 2017 02:06:27 +0000 (10:06 +0800)]
Change jenkins user:group name according to Node Name.

JIRA: DOVETAIL-377

Change-Id: I55eebdd55c2cf91d74d166b0b31a0601efe0a751
Signed-off-by: zshi <zshi@redhat.com>
7 years agoxci: Yet another try to find how best to structure stuff 27/32027/1
Fatih Degirmenci [Mon, 27 Mar 2017 23:04:27 +0000 (01:04 +0200)]
xci: Yet another try to find how best to structure stuff

Summary of changes are
- flavors directory has been removed and the flavor config files are
moved into config and renamed to <flavor>-vars
- common files are put under file
- files specific to flavors are put under file/<flavor> directories
- templates and var files are stored in template and var directories
respectively
- 3 playbooks are created

Change-Id: I8a93e0947ccb02f93a6c8f00da27e0cc6b4dc21e
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoSet database pool_size in ironic.conf and inspector.conf templates 19/32019/2
Fatih Degirmenci [Tue, 28 Mar 2017 09:34:54 +0000 (11:34 +0200)]
Set database pool_size in ironic.conf and inspector.conf templates

min_pool_size and max_pool_size are undefined in ironic.conf and inspector.conf
templates, causing issues during ironic-dbsync and ironic-inspector-dbsync.

https://build.opnfv.org/ci/job/opnfv-bifrost-verify-trusty-virtual-master/224/console

This issue is there for stable/ocata as well.

These should be got rid of once the patch on openstack/bifrost is merged.
https://review.openstack.org/#/c/450681/

Change-Id: I678835e763022a7168e498047bb65d140895e019
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoMerge "KVMFORNFV: Modifying forbidden-file-paths."
Jose Lausuch [Tue, 28 Mar 2017 08:19:33 +0000 (08:19 +0000)]
Merge "KVMFORNFV:  Modifying forbidden-file-paths."

7 years agoMerge "Add and insert new project icons"
Morgan Richomme [Tue, 28 Mar 2017 07:47:07 +0000 (07:47 +0000)]
Merge "Add and insert new project icons"

7 years agokeep methods' name/docstring after decorator 89/31989/1
SerenaFeng [Tue, 28 Mar 2017 06:30:49 +0000 (14:30 +0800)]
keep methods' name/docstring after decorator

applying functools.wraps() to keep the name and docstring
of the original function which is decorated

Change-Id: Id612039921566dd48f8d8797abe30f23aaf99301
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
7 years agoKVMFORNFV: Modifying forbidden-file-paths. 87/31987/1
kalyanreddy [Tue, 28 Mar 2017 06:15:19 +0000 (11:45 +0530)]
KVMFORNFV:  Modifying forbidden-file-paths.

This patch is used to add forbidden-file-paths so that kvmfornfv
verify job will not be triggered if the patch includes changes
only to docs/

Change-Id: I9de20549507be2eadaba7c99bc6de3b28d3c3ce1
Signed-off-by: Gundarapu Kalyan Reddy <reddyx.gundarapu@intel.com>
7 years agobugfix: Bottlencks cleanup docker-compose dockers 69/31969/1
yuyang [Tue, 28 Mar 2017 03:15:39 +0000 (11:15 +0800)]
bugfix: Bottlencks cleanup docker-compose dockers

JIRA: RELENG-196
JIRA: BOTTLENECK-148

The bottlenecks_cleanup script can not clean some dockers and
their images that created by docker-compose.
This may cause the following test using dockers
created in last test. This patch is to fix this issue.

Change-Id: I83d294020596ad5d04302793084a432cae789685
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoAdjust the testcase name for Bottlenecks stress test job 57/31957/3
yuyang [Tue, 28 Mar 2017 01:34:47 +0000 (09:34 +0800)]
Adjust the testcase name for Bottlenecks stress test job

JIRA: RELENG-195
JIRA: BOTTLENECK-143

The name of stress test in Bottlenecks has been changed
due to the new entrance for it.
So CI job for the stress test should be adjusted.

Change-Id: I8432ea1c2dacb6cf42f09a5b74c3c6a93970a242
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoMerge "Use docker image id instead of tag to remove yardstick Docker image with tag...
Jun Li [Tue, 28 Mar 2017 01:13:48 +0000 (01:13 +0000)]
Merge "Use docker image id instead of tag to remove yardstick Docker image with tag:<None>"

7 years agoAdd docker-compose files and requirements 43/31943/2
Kumar Rishabh [Mon, 27 Mar 2017 19:44:31 +0000 (01:14 +0530)]
Add docker-compose files and requirements

This adds docker-compose file to define a multi-container
vnf_catalogue service alongwith helper service to migrate the schema.

Requires docker-compose installation

To run :: docker-compose up
The webapp by default would be accessible at ip_address:3000

Change-Id: I32daf7f76fb1d82116545187395cd96535c94541
Signed-off-by: Kumar Rishabh <shailrishabh@gmail.com>
7 years agoApex: fixes dpdk jobs with ODL 29/31929/1
Tim Rozet [Mon, 27 Mar 2017 16:22:15 +0000 (12:22 -0400)]
Apex: fixes dpdk jobs with ODL

Change-Id: I9c33e6661b2dce1b0e5a77d3ed47bf7eebd3bb2c
Signed-off-by: Tim Rozet <trozet@redhat.com>
7 years agoMerge "Monkey patch paramiko _custom_start_client"
Jose Lausuch [Mon, 27 Mar 2017 12:50:07 +0000 (12:50 +0000)]
Merge "Monkey patch paramiko _custom_start_client"

7 years agoMonkey patch paramiko _custom_start_client 95/31895/4
George Paraskevopoulos [Mon, 27 Mar 2017 10:07:45 +0000 (13:07 +0300)]
Monkey patch paramiko _custom_start_client

A quick fix for the Unexpected kw arg in _custom_start_client error.
Monkey patches this fix:
https://github.com/robotframework/SSHLibrary/pull/159/files

Change-Id: Iaca2c3cb402f1f24d096c947bec5cb3e6aaf77d6
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
7 years agoAdd and insert new project icons 87/31887/1
Morgan Richomme [Mon, 27 Mar 2017 09:14:42 +0000 (11:14 +0200)]
Add and insert new project icons

Change-Id: I4334bca1ab02a5d26b84b934cb718b3753ce0a13
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
7 years agoxci: Enable node provisioning and shuffle/rename stuff 81/31881/4
Fatih Degirmenci [Mon, 27 Mar 2017 08:29:01 +0000 (10:29 +0200)]
xci: Enable node provisioning and shuffle/rename stuff

This change enables node provisioning using bifrost based on the chosen
flavor.

Other changes include
- move flavor specific stuff (playbooks, inventory, vars) into their own
folders so it is easier to copy them over.
- rename flavors and get rid of xci from them.
- introduce env-vars to keep variables that are not really user variables.

Please note that this patch contains empty files and so on due to still
trying to find best way to structurei things. Apart from this, there will
probably be lots of duplications here and there which will be taken care
of once things settle.

Change-Id: I04a5d422e5b018439bafea5e68e65255ae38d22b
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
7 years agoMerge "Avoid build conflicts in build server"
Serena Feng [Mon, 27 Mar 2017 02:32:49 +0000 (02:32 +0000)]
Merge "Avoid build conflicts in build server"

7 years agoCreate Catalogue page 03/31203/3
chenjiankun [Tue, 21 Mar 2017 14:48:54 +0000 (14:48 +0000)]
Create Catalogue page

JIRA: RELENG-193

1.create a page to list all project.
2.This page can get test case list of certain project.
3.This page can show information of certain test case.

Change-Id: I79e0d3aafa99c054865a0d2948b99918802f32a7
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoApex: adds dpdk scenarios to daily 41/31741/1
Tim Rozet [Sat, 25 Mar 2017 00:59:36 +0000 (20:59 -0400)]
Apex: adds dpdk scenarios to daily

Change-Id: I0b0b33cf3021e2c0fb868eca749ab61eed7b3792
Signed-off-by: Tim Rozet <trozet@redhat.com>
7 years agojjb: xci: bifrost-cleanup: Retry 'gsutil rm' on failures 35/31735/2
Markos Chandras [Fri, 24 Mar 2017 22:17:15 +0000 (22:17 +0000)]
jjb: xci: bifrost-cleanup: Retry 'gsutil rm' on failures

Sometimes 'gsutil rm' may fail for unknown reasons like the following
one:

[...]
/ [7/10 objects]  70% Done
/ [8/10 objects]  80% Done
/ [9/10 objects]  90% Done
Operation completed over 10 objects.
CommandException: 1 files/objects could not be removed.

Try a few more times to remove the objects before giving up.

Change-Id: I6905a806446dac41ddc43d4195514a5233480ccd
Signed-off-by: Markos Chandras <mchandras@suse.de>