5 .. index:: systemd; operating a cluster
8 Running Ceph with systemd
9 ==========================
11 For all distributions that support systemd (CentOS 7, Fedora, Debian
12 Jessie 8 and later, SUSE), ceph daemons are now managed using native
13 systemd files instead of the legacy sysvinit scripts. For example::
15 sudo systemctl start ceph.target # start all daemons
16 sudo systemctl status ceph-osd@12 # check status of osd.12
18 To list the Ceph systemd units on a node, execute::
20 sudo systemctl status ceph\*.service ceph\*.target
25 To start all daemons on a Ceph Node (irrespective of type), execute the
28 sudo systemctl start ceph.target
34 To stop all daemons on a Ceph Node (irrespective of type), execute the
37 sudo systemctl stop ceph\*.service ceph\*.target
40 Starting all Daemons by Type
41 ----------------------------
43 To start all daemons of a particular type on a Ceph Node, execute one of the
46 sudo systemctl start ceph-osd.target
47 sudo systemctl start ceph-mon.target
48 sudo systemctl start ceph-mds.target
51 Stopping all Daemons by Type
52 ----------------------------
54 To stop all daemons of a particular type on a Ceph Node, execute one of the
57 sudo systemctl stop ceph-mon\*.service ceph-mon.target
58 sudo systemctl stop ceph-osd\*.service ceph-osd.target
59 sudo systemctl stop ceph-mds\*.service ceph-mds.target
65 To start a specific daemon instance on a Ceph Node, execute one of the
68 sudo systemctl start ceph-osd@{id}
69 sudo systemctl start ceph-mon@{hostname}
70 sudo systemctl start ceph-mds@{hostname}
74 sudo systemctl start ceph-osd@1
75 sudo systemctl start ceph-mon@ceph-server
76 sudo systemctl start ceph-mds@ceph-server
82 To stop a specific daemon instance on a Ceph Node, execute one of the
85 sudo systemctl stop ceph-osd@{id}
86 sudo systemctl stop ceph-mon@{hostname}
87 sudo systemctl stop ceph-mds@{hostname}
91 sudo systemctl stop ceph-osd@1
92 sudo systemctl stop ceph-mon@ceph-server
93 sudo systemctl stop ceph-mds@ceph-server
96 .. index:: Ceph service; Upstart; operating a cluster
100 Running Ceph with Upstart
101 =========================
103 When deploying Ceph with ``ceph-deploy`` on Ubuntu Trusty, you may start and
104 stop Ceph daemons on a :term:`Ceph Node` using the event-based `Upstart`_.
105 Upstart does not require you to define daemon instances in the Ceph
108 To list the Ceph Upstart jobs and instances on a node, execute::
110 sudo initctl list | grep ceph
112 See `initctl`_ for additional details.
118 To start all daemons on a Ceph Node (irrespective of type), execute the
127 To stop all daemons on a Ceph Node (irrespective of type), execute the
133 Starting all Daemons by Type
134 ----------------------------
136 To start all daemons of a particular type on a Ceph Node, execute one of the
139 sudo start ceph-osd-all
140 sudo start ceph-mon-all
141 sudo start ceph-mds-all
144 Stopping all Daemons by Type
145 ----------------------------
147 To stop all daemons of a particular type on a Ceph Node, execute one of the
150 sudo stop ceph-osd-all
151 sudo stop ceph-mon-all
152 sudo stop ceph-mds-all
158 To start a specific daemon instance on a Ceph Node, execute one of the
161 sudo start ceph-osd id={id}
162 sudo start ceph-mon id={hostname}
163 sudo start ceph-mds id={hostname}
167 sudo start ceph-osd id=1
168 sudo start ceph-mon id=ceph-server
169 sudo start ceph-mds id=ceph-server
175 To stop a specific daemon instance on a Ceph Node, execute one of the
178 sudo stop ceph-osd id={id}
179 sudo stop ceph-mon id={hostname}
180 sudo stop ceph-mds id={hostname}
184 sudo stop ceph-osd id=1
185 sudo start ceph-mon id=ceph-server
186 sudo start ceph-mds id=ceph-server
189 .. index:: Ceph service; sysvinit; operating a cluster
195 Each time you to **start**, **restart**, and **stop** Ceph daemons (or your
196 entire cluster) you must specify at least one option and one command. You may
197 also specify a daemon type or a daemon instance. ::
199 {commandline} [options] [commands] [daemons]
202 The ``ceph`` options include:
204 +-----------------+----------+-------------------------------------------------+
205 | Option | Shortcut | Description |
206 +=================+==========+=================================================+
207 | ``--verbose`` | ``-v`` | Use verbose logging. |
208 +-----------------+----------+-------------------------------------------------+
209 | ``--valgrind`` | ``N/A`` | (Dev and QA only) Use `Valgrind`_ debugging. |
210 +-----------------+----------+-------------------------------------------------+
211 | ``--allhosts`` | ``-a`` | Execute on all nodes in ``ceph.conf.`` |
212 | | | Otherwise, it only executes on ``localhost``. |
213 +-----------------+----------+-------------------------------------------------+
214 | ``--restart`` | ``N/A`` | Automatically restart daemon if it core dumps. |
215 +-----------------+----------+-------------------------------------------------+
216 | ``--norestart`` | ``N/A`` | Don't restart a daemon if it core dumps. |
217 +-----------------+----------+-------------------------------------------------+
218 | ``--conf`` | ``-c`` | Use an alternate configuration file. |
219 +-----------------+----------+-------------------------------------------------+
221 The ``ceph`` commands include:
223 +------------------+------------------------------------------------------------+
224 | Command | Description |
225 +==================+============================================================+
226 | ``start`` | Start the daemon(s). |
227 +------------------+------------------------------------------------------------+
228 | ``stop`` | Stop the daemon(s). |
229 +------------------+------------------------------------------------------------+
230 | ``forcestop`` | Force the daemon(s) to stop. Same as ``kill -9`` |
231 +------------------+------------------------------------------------------------+
232 | ``killall`` | Kill all daemons of a particular type. |
233 +------------------+------------------------------------------------------------+
234 | ``cleanlogs`` | Cleans out the log directory. |
235 +------------------+------------------------------------------------------------+
236 | ``cleanalllogs`` | Cleans out **everything** in the log directory. |
237 +------------------+------------------------------------------------------------+
239 For subsystem operations, the ``ceph`` service can target specific daemon types
240 by adding a particular daemon type for the ``[daemons]`` option. Daemon types
249 .. _Valgrind: http://www.valgrind.org/
250 .. _Upstart: http://upstart.ubuntu.com/index.html
251 .. _initctl: http://manpages.ubuntu.com/manpages/raring/en/man8/initctl.8.html