util_scratch_dir_avail_for_me not working on ZFS filesystem

[edoapra]

Describe the bug
util_scratch_dir_avail_for_me() does not work correctly on FreeBSD zfs filesystem by returning bogus values

Describe settings used

FreeBSD fbsd 13.2-STABLE FreeBSD 13.2-STABLE stable/13-n254954-d94a88d249b0 GENERIC arm64
FreeBSD was used from Qemu
NWChem 7.2.0 plus recent master patches for FreeBSD issues

Attach log files

  avail0,avail1,avail0-avail1                  3180                 3180                    0
  avail0,avail1,avail0-avail1                  3180                 3180                    0
  avail0,avail1,avail0-avail1                  3180                 3180                    0
  avail0,avail1,avail0-avail1                  3180                 3180                    0

 Integral file          = ./c2h4_dat.aoints.0
 Record size in doubles =  65536        No. of integs per rec  =  43688
 Max. records in memory =    185        Max. records in file   =   6041
 No. of bits per label  =      8        No. of bits per value  =     64


 #quartets = 1.222D+05 #integrals = 8.656D+06 #direct =  0.0% #cached =100.0%

To Reproduce
run the QA tests c2h4

[edoapra]

Workaround
Compiling with USE_NOFSCHECK=1 should fix the problem.
USE_NOIO=1 will avoid I/O altogether

[edoapra]

This bug might cause some of the #752 failures, unless the Qemu I/O management is the root cause.

[klopata]

I also see this issue when using ZFS on Linux, thus it is probably related to the ZFS file system and is not BSD-specific.

Ubuntu 22.04, Linux 5.19.0-41
ZFS via kernel module (zfsutils-linux) using pool directly built from NVMe drives (no virtualization)
NWChem 7.2.0

Running the c2h4 test:

 avail0,avail1,avail0-avail1               1241336              1241336                    0
 avail0,avail1,avail0-avail1               1241336              1241336                    0
 avail0,avail1,avail0-avail1               1241336              1241336                    0
 avail0,avail1,avail0-avail1               1241336              1241336                    0

Integral file          = /work/scratch/c2h4_dat.aoints.0
Record size in doubles =  65536        No. of integs per rec  =  43688
Max. records in memory =     63        Max. records in file   =  87351
No. of bits per label  =      8        No. of bits per value  =     64

USE_NOFSCHECK=1 works, as Edo recommends.

[edoapra]

util_fsync() still does not seem to work on ZFS filesystems