Tag Archives: Lustre

ZFS Lustre on Centos 7

Leave a comment

Install epel and DKMS:
yum install https://dl.fedoraproject.org/pub/epel/epel-release-latest-7.noarch.rpm
yum install dkms

Install ZFS: (found https://github.com/zfsonlinux/zfs/wiki/RHEL-%26-CentOS)
yum install http://archive.zfsonlinux.org/epel/zfs-release.el7.noarch.rpm
yum install zfs

Install libzfs-devel:
yum install libzfs2-devel.x86_64

Run configure in lustre dir, look for:
checking whether to enable zfs… yes

Create zpool:
zpool create mdt /dev/loop5

Format fs, Lustre creates device in zpool:
mkfs.lustre –backfstype=zfs –mgs –mdt –index=0 –fsname test –reformat mdt/mdt

Can also directly use backing loop file:
mkfs.lustre –backfstype=zfs –mgs –mdt –index=0 –fsname test –reformat mdt/mdt /tmp/test-mdt

references:
http://lustre.ornl.gov/ecosystem-2016/documents/tutorials/Stearman-LLNL-ZFS.pdf
http://warpmech.com/?news=tutorial-getting-started-with-lustre-over-zfs

Lustre Crash Tool Extensions

2 Comments

This will let you dump the Lustre log from a kernel vmcore:
https://github.com/Xyratex/crash-tools/tree/master/cr-ext

This is an extended backtrace plugin/extension for crash that decodes the parameters in a nice way, and maybe works:
https://wiki.hpdd.intel.com/display/~jhammond/XBT+-+extended+backtrace+extension+for+crash

Here’s how to load the extension:
sh> mod -S
MODULE NAME SIZE OBJECT FILE
MODULE NAME SIZE OBJECT FILE
ffffffffa000f460 dm_mod 84337 /lib/modules/2.6.32-431.20.3.el6_lustre.g5a7c614.x86_64/kernel/drivers/md/dm-mod.ko

crash> extend /root/lustre-ext.so
/root/lustre-ext.so: shared object loaded
crash> lustre -l /tmp/foo.dl
lustre_walk_cpus(0, 5, 1)
cmd: p (*cfs_trace_data[0])[0].tcd.tcd_cur_pages
p (*cfs_trace_data[0])[0].tcd.tcd_pages.next
…
lustre: Dumped 355 total debug pages from 2 CPUs to /tmp/foo.dl