teststeps: Improvements and bugfixing of teststeps 21/46521/7
authorMartin Klozik <martinx.klozik@intel.com>
Thu, 31 Aug 2017 13:01:18 +0000 (15:01 +0200)
committerMartin Klozik <martinx.klozik@intel.com>
Fri, 3 Nov 2017 08:36:29 +0000 (08:36 +0000)
commitb1534957e463b5e34957a8d48ce5c6b0552ffbb4
tree10985b181d62cffb4ea36355de66dc8ea4edbf8a
parent87f6e48ca1b17361955f0d31551b0c6360028688
teststeps: Improvements and bugfixing of teststeps

This patch introduces several improvements and small bugfixes
of teststeps. These changes were identified during implementation
of OVS/DPDK regression tests.

Patch content:
* teststeps: step aliases were implemented
* teststeps: improved filtering by regex for any step, which returns string
  or list of stings; filter will process all lines
* teststeps: support for log object
* teststeps: support for trafficgen get_results call
* teststeps: configurable suppression of step validation
* trafficgen: remove old results before traffic is executed
* trafficgen: support for flow control on/off (IxNet)
* trafficgen: support for configurable learning frames (IxNet)
* trafficgen: support for runtime changes of TRAFFICGEN_PKT_SIZES, _DURATION
  and _LOSSRATE
* vnf: flush pexpect output of previous commands
* vnf: use execute_and_wait() to ensure correct cmds order
* vnf: dpdk vHost User interface name set according to its type,
  e.g. dpdkvhostuserclient
* vswitch: support for OVS restart
* decap: simplify configuration of tunneling decapsulation tests
* settings: values of all configuration options are restored after TC execution
* modified formatting of test description used by --list
* testcase name and description is logged before its execution
* small bugfixes

JIRA: VSPERF-539

Change-Id: I550ba0d897ece89abd3f33d6d66f545c4d863e7b
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
23 files changed:
3rd_party/ixia/ixnetrfc2544.tcl
conf/03_traffic.conf
conf/04_vnf.conf
conf/__init__.py
conf/integration/02_vswitch.conf
conf/integration/03_traffic.conf
core/traffic_controller.py
core/traffic_controller_rfc2544.py
core/traffic_controller_rfc2889.py
docs/testing/developer/devguide/design/vswitchperf_design.rst
docs/testing/user/userguide/integration.rst
docs/testing/user/userguide/teststeps.rst
testcases/testcase.py
tools/functions.py
tools/pkt_gen/ixnet/ixnet.py
tools/teststepstools.py
vnfs/qemu/qemu.py
vnfs/qemu/qemu_dpdk_vhost_user.py
vnfs/vnf/vnf.py
vsperf
vswitches/ovs.py
vswitches/ovs_dpdk_vhost.py
vswitches/vswitch.py