Eiger: Difference between revisions

Eiger (view source)

670 bytes removed , 27 February 2021

→‎A benchmark: remove - too old

2,652

edits

@@ Line 14: / Line 14: @@
 Update 2016-06-05 (Toine Schreurs): a HDF5 file may be compressed with [https://www.hdfgroup.org/HDF5/docNewFeatures/FileSpace/h5repack.htm h5repack], ''e.g.'' by <code>h5repack -i <in.h5> -o <out.h5> -f GZIP=6</code> (6 is the default compression level of gzip). This should be a good way to reduce the size of master files while keeping them compatible with processing, but needs to be tested. Whether h5repack uses parallel gzip is not clear from the docs.
-== A benchmark ==
-Any comparisons should be based on a common dataset. I downloaded from https://www.dectris.com/datasets.html their latest dataset
-ftp://dectris.com/EIGER_16M_Nov2015.tar.bz2 (900 frames) and processed it on a single unloaded CentOS7.2 64bit machine with dual Intel(R) Xeon(R) CPU E5-2667 v2 @ 3.30GHz , HT enabled (showing 32 processors in /proc/cpuinfo), on a local XFS filesystem (all defaults), with four JOBs and 12 PROCESSORS (the XDS.INP that Dectris provides suggests 8 JOBs of 12 PROCESSORS, but I changed that).
-On multi-socket machines, there are additional considerations having to do with their NUMA architecture - see [[Performance]].
 == Troubleshooting ==