News: GPFS at 91%; hasyutils

• GPGS at 91%: The core gpfs file system is running full, 1 PiB still available. Data production in 2022 3-4 PiB estimated. We will discuss with IT about the available options:
  • Reduce snapshots: currently snapshot files have a lifetime of 40 days.
  • Remove certain files in scratch_cc. Problems: (1) this directory is used to store intermediate results. (2) deleted files are covered by snapshots (40 days)

    Remark: Files below this directory is not dCache-saved anyway.

  • Reduce time-on-disk: 180 days after end of beamtime (externals), 720 days (DESY participation).
  • Extend 180 days after beamtime policy also to old data. The old policy was: move files to dCache, if they have not been accessed for 180 days.
  • Stop staging files.

  A new files server will be purchased. Negotiations are ongoing. The new system might have the size of 4.6 PiB (notice that a 2.4 PiB system runs out of maintenance in September)

• hasyutils:
  • HasyUtils.refreshDiffractometers(): select default crysteal file name, /home/p99user/crystal/defaultcrystal.txt, the not specified in online.xml
  • avoid hasattr( proxy, attrName) in Python3: details see here