5 ceph.git/ceph-object-corpus is a submodule.::
8 archive/$version/objects/$type/$hash # a sample of encoded objects from a specific version
10 You can also mark known or deliberate incompatibilities between versions with::
12 archive/$version/forward_incompat/$type
14 The presence of a file indicates that new versions of code cannot
15 decode old objects across that $version (this is normally the case).
18 How to generate an object corpus
19 --------------------------------
21 We can generate an object corpus for a particular version of ceph like so.
23 #. Checkout a clean repo (best not to do this where you normally work)::
27 git submodule update --init --recursive
29 #. Build with flag to dump objects to /tmp/foo::
31 rm -rf /tmp/foo ; mkdir /tmp/foo
32 ./do_autogen.sh -e /tmp/foo
38 MON=3 OSD=3 MDS=3 RGW=1 ./vstart.sh -n -x
40 #. Use as much functionality of the cluster as you can, to exercise as many object encoder methods as possible::
42 ./rados -p rbd bench 10 write -b 123
44 ./init-ceph stop osd.1
45 for f in ../qa/workunits/cls/*.sh ; do PATH=".:$PATH" $f ; done
46 ../qa/workunits/rados/test.sh
49 ./init-ceph restart mds.a
51 Do some more stuff with rgw if you know how.
57 #. Import the corpus (this will take a few minutes)::
59 test/encoding/import.sh /tmp/foo `./ceph-dencoder version` ../ceph-object-corpus/archive
60 test/encoding/import-generated.sh ../ceph-object-corpus/archive
62 #. Prune it! There will be a bazillion copies of various objects, and we only want a representative sample.::
64 pushd ../ceph-object-corpus
68 #. Verify the tests pass::
72 #. Commit it to the corpus repo and push::
74 pushd ../ceph-object-corpus
75 git checkout -b wip-new
76 git add archive/`../src/ceph-dencoder version`
77 git commit -m `../src/ceph-dencoder version`
78 git remote add cc ceph.com:/git/ceph-object-corpus.git
91 #. If everything looks good, update the submodule master branch, and commit the submodule in ceph.git.