1 .. This work is licensed under a Creative Commons Attribution 4.0 International License.
2 .. http://creativecommons.org/licenses/by/4.0
3 .. (c) <optionally add copywriters name>
4 .. _barometer-oneclick-userguide:
6 =======================================
7 OPNFV Barometer One Click Install Guide
8 =======================================
14 The intention of this user guide is to outline how to use the ansible
15 playbooks for a one click installation of Barometer. A more in-depth
16 installation guide is available with the
17 :ref:`Docker user guide <barometer-docker-userguide>`.
20 One Click Install with Ansible
21 ------------------------------
24 Proxy for package manager on host
25 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
27 This step has to be performed only if host is behind HTTP/HTTPS proxy
29 Proxy URL have to be set in dedicated config file
31 1. CentOS - ``/etc/yum.conf``
35 proxy=http://your.proxy.domain:1234
37 2. Ubuntu - ``/etc/apt/apt.conf``
41 Acquire::http::Proxy "http://your.proxy.domain:1234"
43 After update of config file, apt mirrors have to be updaited via
50 Proxy environment variables (for docker and pip)
51 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
53 This step has to be performed only if host is behind HTTP/HTTPS proxy
55 Configuring proxy for packaging system is not enough, also some proxy
56 environment variables have to be set in the system before ansible scripts
58 Barometer configures docker proxy automatically via ansible task as a part
59 of *one click install* process - user only has to provide proxy URL using common
60 shell environment variables and ansible will automatically configure proxies
61 for docker(to be able to fetch barometer images). Another component used by
62 ansible (e.g. pip is used for downloading python dependencies) will also benefit
63 from setting proxy variables properly in the system.
65 Proxy variables used by ansible One Click Install:
71 Variables mentioned above have to be visible for superuser (because most
72 actions involving ``ansible-barometer`` installation require root privileges).
73 Proxy variables are commonly defined in ``/etc/environment`` file (but any other
74 place is good as long as variables can be seen by commands using ``su``).
76 Sample proxy configuration in ``/etc/environment``:
80 http_proxy=http://your.proxy.domain:1234
81 https_proxy=http://your.proxy.domain:1234
82 ftp_proxy=http://your.proxy.domain:1234
88 * sudo permissions or root access are required to install ansible.
89 * ansible version needs to be 2.4+, because usage of import/include statements
91 The following steps have been verified with Ansible 2.6.3 on Ubuntu 16.04 and 18.04.
92 To install Ansible 2.6.3 on Ubuntu:
96 $ sudo apt-get install python
97 $ sudo apt-get install python-pip
98 $ sudo -H pip install 'ansible==2.6.3'
99 $ sudo apt-get install git
101 The following steps have been verified with Ansible 2.6.3 on Centos 7.5.
102 To install Ansible 2.6.3 on Centos:
106 $ sudo yum install python
107 $ sudo yum install epel-release
108 $ sudo yum install python-pip
109 $ sudo -H pip install 'ansible==2.6.3'
110 $ sudo yum install git
113 When using multi-node-setup, please make sure that ``python`` package is
114 installed on all of the target nodes (ansible during 'Gathering facts'
115 phase is using ``python2`` and it may not be installed by default on some
116 distributions - e.g. on Ubuntu 16.04 it has to be installed manually)
123 $ git clone https://gerrit.opnfv.org/gerrit/barometer
124 $ cd barometer/docker/ansible
128 Edit inventory file and add hosts:
129 ``$barometer_dir/docker/ansible/default.inv``
136 [collectd_hosts:vars]
138 insert_ipmi_modules=true
139 #to use master or experimental container set the collectd flavor below
140 #possible values: stable|master|experimental
144 #hostname or ip must be used.
145 #using localhost will cause issues with collectd network plugin.
149 #NOTE: As per current support, Grafana and Influxdb should be same host.
156 #NOTE: currently one zookeeper host is supported
165 Change localhost to different hosts where neccessary.
166 Hosts for influxdb and grafana are required only for ``collectd_service.yml``.
167 Hosts for zookeeper, kafka and ves are required only for ``collectd_ves.yml``.
170 Zookeeper, Kafka and VES need to be on the same host, there is no
171 support for multi node setup.
173 To change host for kafka edit ``kafka_ip_addr`` in
174 ``./roles/config_files/vars/main.yml``.
176 Additional plugin dependencies
177 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
179 By default ansible will try to fulfill dependencies for ``mcelog`` and
180 ``ipmi`` plugin. For ``mcelog`` plugin it installs mcelog daemon. For ipmi it
181 tries to insert ``ipmi_devintf`` and ``ipmi_si`` kernel modules.
182 This can be changed in inventory file with use of variables ``install_mcelog``
183 and ``insert_ipmi_modules``, both variables are independent:
187 [collectd_hosts:vars]
189 insert_ipmi_modules=false
192 On Ubuntu 18.04 the deb package for mcelog daemon is not available in official
193 Ubuntu repository. In that case ansible scripts will try to download, make and
194 install the daemon from mcelog git repository.
199 Generate ssh keys if not present, otherwise move onto next step.
200 ssh keys are required for Ansible to connect the host you use for Barometer Installation.
206 Copy ssh key to all target hosts. It requires to provide root password.
207 The example is for ``localhost``.
212 $ ssh-copy-id root@localhost
214 Verify that key is added and password is not required to connect.
218 $ sudo ssh root@localhost
221 Keys should be added to every target host and [localhost] is only used as an
222 example. For multinode installation keys need to be copied for each node:
223 [collectd_hostname], [influxdb_hostname] etc.
225 Download and run Collectd+Influxdb+Grafana containers
226 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
228 The One Click installation features easy and scalable deployment of Collectd,
229 Influxdb and Grafana containers using Ansible playbook. The following steps goes
230 through more details.
234 $ sudo -H ansible-playbook -i default.inv collectd_service.yml
236 Check the three containers are running, the output of ``docker ps`` should be similar to:
241 CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
242 a033aeea180d opnfv/barometer-grafana "/run.sh" 9 days ago Up 7 minutes bar-grafana
243 1bca2e4562ab opnfv/barometer-influxdb "/entrypoint.sh in..." 9 days ago Up 7 minutes bar-influxdb
244 daeeb68ad1d5 opnfv/barometer-collectd "/run_collectd.sh ..." 9 days ago Up 7 minutes bar-collectd
246 To make some changes when a container is running run:
250 $ sudo docker exec -ti <CONTAINER ID> /bin/bash
252 Connect to ``<host_ip>:3000`` with a browser and log into Grafana: admin/admin.
253 For short introduction please see the:
254 `Grafana guide <http://docs.grafana.org/guides/getting_started/>`_.
256 The collectd configuration files can be accessed directly on target system in
257 ``/opt/collectd/etc/collectd.conf.d``. It can be used for manual changes or
258 enable/disable plugins. If configuration has been modified it is required to
263 $ sudo docker restart bar-collectd
265 Download and run collectd+kafka+ves containers
266 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
270 $ sudo ansible-playbook -i default.inv collectd_ves.yml
272 Check the containers are running, the output of ``docker ps`` should be similar to:
277 CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
278 29035be2dab5 zookeeper:3.4.11 "/docker-entrypoint._" 7 minutes ago Up 7 minutes bar-zookeeper
279 eb8bba3c0b76 opnfv/barometer-ves "./start_ves_app.s..." 6 minutes ago Up 6 minutes bar-ves
280 86702a96a68c opnfv/barometer-kafka "/src/start_kafka.sh" 6 minutes ago Up 6 minutes bar-kafka
281 daeeb68ad1d5 opnfv/barometer-collectd "/run_collectd.sh ..." 6 minutes ago Up 6 minutes bar-collectd
284 To make some changes when a container is running run:
288 $ sudo docker exec -ti <CONTAINER ID> /bin/bash
290 List of default plugins for collectd container
291 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
293 From Jerma release, the supported dpdk version is 19.11
295 If you would like to use v18.11, Do the following changes:
296 1.Update the dpdk version to v18.11 in <barometer>/src/package-list.mk
297 2.Replace all 'common_linux' string with 'common_linuxapp' in <barometer>/src/dpdk/Makefile
299 If you would like to downgrade to a version lower than v18.11, Do the following changes:
300 1.Update the dpdk version to a version lower than v18.11(Eg:- v16.11) in <barometer>/src/package-list.mk
301 2.Replace all 'common_linux' string with 'common_linuxapp' in <barometer>/src/dpdk/Makefile
302 3.Change the Makefile path from '(WORKDIR)/kernel/linux/kni/Makefile' to (WORKDIR)/lib/librte_eal/linuxapp/kni/Makefile in '(WORK_DIR)/src/dpdk/Makefile'.
304 By default the collectd is started with default configuration which includes
305 the following plugins:
306 * ``csv``, ``contextswitch``, ``cpu``, ``cpufreq``, ``df``, ``disk``,
307 ``ethstat``, ``ipc``, ``irq``, ``load``, ``memory``, ``numa``,
308 ``processes``, ``swap``, ``turbostat``, ``uuid``, ``uptime``, ``exec``,
309 ``hugepages``, ``intel_pmu``, ``ipmi``, ``write_kafka``, ``logfile``,
310 ``mcelog``, ``network``, ``intel_rdt``, ``rrdtool``, ``snmp_agent``,
311 ``syslog``, ``virt``, ``ovs_stats``, ``ovs_events``, ``dpdkevents``,
312 ``dpdkstat``, ``dpdk_telemetry``
315 Some of the plugins are loaded depending on specific system requirements and can be omitted if
316 dependency is not met, this is the case for:
317 * ``hugepages``, ``ipmi``, ``mcelog``, ``intel_rdt``, ``virt``, ``ovs_stats``, ``ovs_events``
319 List and description of tags used in ansible scripts
320 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
322 Tags can be used to run a specific part of the configuration without running
323 the whole playbook. To run a specific parts only:
327 $ sudo ansible-playbook -i default.inv collectd_service.yml --tags "syslog,cpu,uuid"
329 To disable some parts or plugins:
333 $ sudo ansible-playbook -i default.inv collectd_service.yml --skip-tags "en_default_all,syslog,cpu,uuid"
335 List of available tags:
338 Install docker and required dependencies with package manager.
341 Configure proxy file for docker service if proxy is set on host environment.
344 Remove collectd config files.
346 ``copy_additional_configs``
347 Copy additional configuration files to target system. Path to additional
348 configuration is stored in
349 ``$barometer_dir/docker/ansible/roles/config_files/vars/main.yml`` as
350 ``additional_configs_path``.
353 Set of default read plugins: ``contextswitch``, ``cpu``, ``cpufreq``, ``df``,
354 ``disk``, ``ethstat``, ``ipc``, ``irq``, ``load``, ``memory``, ``numa``,
355 ``processes``, ``swap``, ``turbostat``, ``uptime``.
358 The following tags can be used to enable/disable plugins: ``csv``,
359 ``contextswitch``, ``cpu``, ``cpufreq``, ``df``, ``disk,`` ``ethstat``,
360 ``ipc``, ``irq``, ``load``, ``memory``, ``numa``, ``processes``, ``swap``,
361 ``turbostat``, ``uptime``, ``exec``, ``hugepages``, ``ipmi``, ``kafka``,
362 ``logfile``, ``mcelogs``, ``n``etwork``,`` ``pmu``, ``rdt``, ``rrdtool``,
363 ``snmp``, ``syslog``, ``virt``, ``ovs_stats``, ``ovs_events``, ``uuid``,
364 ``dpdkevents``, ``dpdkstat``, ``dpdk_telemetry``.