Unexpected 'zstash ls' output #234

jjbenedict · 2022-11-09T22:32:54Z

jjbenedict
Nov 9, 2022

I need to retrieve some E3SM output files from NERSC-HPSS and put them on disk. @ndkeen's Confluence page indicates that the location of files on HPSS is:
/home/n/ndk/2021/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12
(Through subsequent discussions with @ndkeen, I learned that /zstash needs to be appended to the end of this path.) The E3SM case name is 202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12. I wanted to list available files in the run directory, so I did the following:

(e3sm_unified_1.7.1_nompi) jjbenedi@cori07:/project/projectdirs/e3sm/benedict/e3sm_v1_output/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12> zstash ls -l --hpss=/home/n/ndk/2021/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12/zstash "run/*" | head
id	name	size	mtime	md5	tar	offset
99362	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.cam.i.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035059200	
99363	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.cam.r.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035060736	
99364	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.cam.rs.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035062272	
99365	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.clm2.r.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035063808	
99366	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.clm2.rh0.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035065344	
99367	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.cpl.r.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035066880	
99368	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.mosart.r.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035068416	
99369	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.mosart.rh0.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035069952	
99370	run/20180129.DECKv1b_piControl.ne30_oEC.edison.cam.i.0501-01-01-00000.nc	1238731020	2018-03-27 23:12:55	38f970576c6dd8755c523f4032a19c5f	000122.tar	84035071488

The returned list of files unexpectedly shows files associated with an E3SM case name other than 202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12. I also modified the zstash command to list all of the files, and still there were no instances of case "202101027". I asked Noel if there was something wrong with the archiving, and he did the following:

(e3sm_unified_1.7.1_nompi) login24% zstash ls -l --hpss=/home/n/ndk/2021/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12/zstash "run/*" | head
id      name    size    mtime   md5     tar     offset
21564   run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.h1.2055-02-10-00000.nc   1262842796      2022-02-17 23:05:14.339574      0b04d4db8cd2a12b15be5ca466022550        00032d.tar      93090676224
21565   run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.h2.2055-02-10-00000.nc   3371704040      2022-02-17 23:04:20.066573      6a6f6a0cbd91d261e13b2f19d6405066        00032d.tar      94353520640
21566   run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.h3.2055-02-10-00000.nc   1934695032      2022-02-17 23:04:53.869571      315205cab82998467076112587b0a352        00032d.tar      97725226496
21567   run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.h4.2055-02-10-00000.nc   970475736       2022-02-17 23:05:00.185698      174d27c3fcd218cc2438dd97516540fb        00032d.tar      99659923456
21568   run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.i.2016-01-01-00000.nc    19334314248     2022-02-17 22:49:35.304308      ca47bd5d0fb728bcdad9318ee84dc6d7        00032d.tar      100630401024
21569   run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.i.2017-01-01-00000.nc    19334314248     2022-02-17 22:49:10.516463      5368636143dbde7885bf3166b3211b5e        00032e.tar      0
21570   run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.i.2018-01-01-00000.nc    19334314248     2022-02-17 22:49:23.273025      1e3686e5a1d5d85ce1ecf0eecde9be53        00032e.tar      19334316032
21571   run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.i.2019-01-01-00000.nc    19334314248     2022-02-17 22:49:35.191568      09d1d6ebb86a3936d5db26831cb2f418        00032e.tar      38668632064
21572   run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.i.2020-01-01-00000.nc    19334314248     2022-02-17 22:49:41.701493      afec5df6da0ec91a27378dfb73063fa5        00032e.tar      58002948096

So, Noel is seeing the correct/expected file listing. Noel and I are using the same zstash command. Noel gets the same (correct) results on perlmutter and cori. I get my same (incorrect) results on perlmutter and cori. Neither of us can explain why this is happening. Any ideas?

forsyth2 · 2022-11-09T23:02:03Z

forsyth2
Nov 9, 2022
Maintainer

This is very strange. I'm trying to see what output I get, but I just get an error.

In e3sm_unified_1.7.1_nompi environment on Cori:

$ zstash ls -l --hpss=/home/n/ndk/2021/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12/zstash "run/*" | head
INFO: Transferring file from HPSS: zstash/index.db
ERROR: Error=Transferring file from HPSS: index.db, Command was `hsi -q "cd /home/n/ndk/2021/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12/zstash; get index.db"`. This command includes `hsi`. Be sure that you have logged into `hsi`.
Traceback (most recent call last):
  File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.7.1_nompi/bin/zstash", line 10, in <module>
    sys.exit(main())
  File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.7.1_nompi/lib/python3.9/site-packages/zstash/main.py", line 70, in main
    ls()
  File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.7.1_nompi/lib/python3.9/site-packages/zstash/ls.py", line 34, in ls
    matches: List[FilesRow] = ls_database(args, cache)
  File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.7.1_nompi/lib/python3.9/site-packages/zstash/ls.py", line 104, in ls_database
    hpss_get(hpss, get_db_filename(cache), cache)
  File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.7.1_nompi/lib/python3.9/site-packages/zstash/hpss.py", line 123, in hpss_get
    hpss_transfer(hpss, file_path, "get", cache, False)
  File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.7.1_nompi/lib/python3.9/site-packages/zstash/hpss.py", line 98, in hpss_transfer
    run_command(command, error_str)
  File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.7.1_nompi/lib/python3.9/site-packages/zstash/utils.py", line 55, in run_command
    raise Exception(error_str)
Exception: Error=Transferring file from HPSS: index.db, Command was `hsi -q "cd /home/n/ndk/2021/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12/zstash; get index.db"`. This command includes `hsi`. Be sure that you have logged into `hsi`.

I know I'm logged into hsi so I'm not sure what's going on here. I confirmed I can run with a different HPSS path:

zstash ls -l --hpss=/home/projects/e3sm/www/WaterCycle/E3SMv2/LR/v2.LR.historical_0201 "run/*" | head
INFO: Transferring file from HPSS: zstash/index.db
id	name	size	mtime	md5	tar	offset
58447	run/CASEROOT	71	2021-07-29 01:29:08.527175	d2121f5a00369cf6f11ad0c136f8e7ad	00005f.tar	57233413120	
58448	run/Walltime.Remaining	10	2021-07-29 12:33:33.990741	ee2df9facd2190bf4f91a9ef57e72fc6	00005f.tar	57233415168	
58449	run/atm_chunk_costs.66193.210722-174933.gz	70801	2021-07-23 21:29:13	280b0d48a3e84c0e63cf578fc4a9a6e5	00005f.tar	57233417216	
58450	run/atm_chunk_costs.66414.210724-020228.gz	70771	2021-07-25 05:35:46	9e103fcb38ff45d1e1f9f59412c7962c	00005f.tar	57233489920	
58451	run/atm_chunk_costs.66668.210725-053556.gz	70769	2021-07-26 09:10:55	b04c4afad215affbbb9ead16d0506bd0	00005f.tar	57233562624	
58452	run/atm_chunk_costs.66954.210726-171636.gz	70887	2021-07-27 20:59:31	b09abad5b7a1dd416911a17891cd2be3	00005f.tar	57233635328	
58453	run/atm_chunk_costs.67673.210727-160001.gz	70706	2021-07-28 20:06:23	7311216c498a6a9739a048dd8f595cbd	00005f.tar	57233708032	
58454	run/atm_chunk_costs.67962.210728-202907.gz	69583	2021-07-29 12:47:41	1d53ba04b5e4dd94d182176d3d0ca0e3	00005f.tar	57233780736	
58455	run/atm_in	18124	2021-07-29 01:29:08.959837	2da17e129e5c8ca1fa42234e1e7b28aa	00005f.tar	57233851904

Same behavior on Perlmutter using the e3sm_unified_1.8.0rc3_nompi environment.

2 replies

forsyth2 Nov 9, 2022
Maintainer

$ hsi -q "cd /home/n/ndk/2021/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12/zstash; get index.db"
*** hpss_Open: Access denied [-13: HPSS_EACCES] 
    /home/n/ndk/2021/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12/zstash/index.db
*** get: Error -1 on transfer. index.db from /home/n/ndk/2021/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12/zstash/index.db

It might be a permissions issue? For me at least?

I can see index.db in hsi though.

$ hsi
$ cd /home/n/ndk/2021/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12/zstash
$ ls index.db
index.db
$ ls -l index.db
-rw-r-----    1 ndk       ndk          3903488 Mar 22  2022 index.db

@ndkeen Perhaps try expanding to world readable?

forsyth2 Nov 9, 2022
Maintainer

For instance:

$ hsi
$ cd /home/projects/e3sm/www/WaterCycle/E3SMv2/LR/v2.LR.historical_0201
$ ls -l index.db
-rw-r--r--    1 golaz     e3sm        10489856 May  4  2022 index.db

ndkeen · 2022-11-10T00:14:53Z

ndkeen
Nov 10, 2022

OK I made some chmod commands. Not sure a handful of files had different permissions than others.

1 reply

forsyth2 Nov 10, 2022
Maintainer

Thanks. Now I keep getting a BrokenPipeError, but notably I do at least get 20211021-maint-1.0 files.

$ zstash ls -l --hpss=/home/n/ndk/2021/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12/zstash "run/*" | head
INFO: Transferring file from HPSS: zstash/index.db
id	name	size	mtime	md5	tar	offset
21564	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.h1.2055-02-10-00000.nc	1262842796	2022-02-17 23:05:14.339574	0b04d4db8cd2a12b15be5ca466022550	00032d.tar	93090676224	
21565	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.h2.2055-02-10-00000.nc	3371704040	2022-02-17 23:04:20.066573	6a6f6a0cbd91d261e13b2f19d6405066	00032d.tar	94353520640	
21566	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.h3.2055-02-10-00000.nc	1934695032	2022-02-17 23:04:53.869571	315205cab82998467076112587b0a352	00032d.tar	97725226496	
21567	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.h4.2055-02-10-00000.nc	970475736	2022-02-17 23:05:00.185698	174d27c3fcd218cc2438dd97516540fb	00032d.tar	99659923456	
21568	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.i.2016-01-01-00000.nc	19334314248	2022-02-17 22:49:35.304308	ca47bd5d0fb728bcdad9318ee84dc6d7	00032d.tar	100630401024	
21569	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.i.2017-01-01-00000.nc	19334314248	2022-02-17 22:49:10.516463	5368636143dbde7885bf3166b3211b5e	00032e.tar	0	
21570	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.i.2018-01-01-00000.nc	19334314248	2022-02-17 22:49:23.273025	1e3686e5a1d5d85ce1ecf0eecde9be53	00032e.tar	19334316032	
21571	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.i.2019-01-01-00000.nc	19334314248	2022-02-17 22:49:35.191568	09d1d6ebb86a3936d5db26831cb2f418	00032e.tar	38668632064	
21572	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.i.2020-01-01-00000.nc	19334314248	2022-02-17 22:49:41.701493	afec5df6da0ec91a27378dfb73063fa5	00032e.tar	58002948096	
Traceback (most recent call last):
  File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.7.1_nompi/bin/zstash", line 10, in <module>
    sys.exit(main())
  File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.7.1_nompi/lib/python3.9/site-packages/zstash/main.py", line 70, in main
    ls()
  File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.7.1_nompi/lib/python3.9/site-packages/zstash/ls.py", line 36, in ls
    print_matches(args, matches)
  File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.7.1_nompi/lib/python3.9/site-packages/zstash/ls.py", line 207, in print_matches
    print(col, end="\t")
BrokenPipeError: [Errno 32] Broken pipe

ndkeen · 2022-11-10T01:04:40Z

ndkeen
Nov 10, 2022

That is also what I see

0 replies

jjbenedict · 2022-11-10T15:31:27Z

jjbenedict
Nov 10, 2022
Author

New (and even more confusing) information: I'm getting identical (incorrect) results regardless of what HPSS path I provide to zstash:

jjbenedi@cori03:~> source /global/common/software/e3sm/anaconda_envs/load_e3sm_unified_1.7.1_cori-haswell.sh
(e3sm_unified_1.7.1_nompi) jjbenedi@cori03:~> zstash ls -l --hpss=/home/n/ndk/2021/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12/zstash "run/*" | head
id	name	size	mtime	md5	tar	offset
99362	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.cam.i.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035059200	
99363	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.cam.r.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035060736	
99364	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.cam.rs.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035062272	
99365	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.clm2.r.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035063808	
99366	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.clm2.rh0.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035065344	
99367	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.cpl.r.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035066880	
99368	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.mosart.r.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035068416	
99369	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.mosart.rh0.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035069952	
99370	run/20180129.DECKv1b_piControl.ne30_oEC.edison.cam.i.0501-01-01-00000.nc	1238731020	2018-03-27 23:12:55	38f970576c6dd8755c523f4032a19c5f	000122.tar	84035071488	
(e3sm_unified_1.7.1_nompi) jjbenedi@cori03:~> zstash ls -l --hpss=/home/projects/e3sm/www/WaterCycle/E3SMv2/LR/v2.LR.historical_0201 "run/*" | head
id	name	size	mtime	md5	tar	offset
99362	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.cam.i.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035059200	
99363	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.cam.r.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035060736	
99364	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.cam.rs.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035062272	
99365	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.clm2.r.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035063808	
99366	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.clm2.rh0.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035065344	
99367	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.cpl.r.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035066880	
99368	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.mosart.r.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035068416	
99369	run/20171228.beta3rc13_1850.ne30_oECv3_ICG.edison.mosart.rh0.0331-01-01-00000.nc	0	2018-01-30 19:36:32	None	000122.tar	84035069952	
99370	run/20180129.DECKv1b_piControl.ne30_oEC.edison.cam.i.0501-01-01-00000.nc	1238731020	2018-03-27 23:12:55	38f970576c6dd8755c523f4032a19c5f	000122.tar	84035071488

This is utterly perplexing and I feel like it has to be human error (me), but I simply copied the commands that @forsyth2 used above.

6 replies

jjbenedict Nov 10, 2022
Author

On cori login node: /global/homes/j/jjbenedi

forsyth2 Nov 10, 2022
Maintainer

Try:

$ rm /global/homes/j/jjbenedi/index.db
$ rm /global/homes/j/jjbenedi/zstash/index.db
$ zstash ls -l --hpss=/home/n/ndk/2021/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12/zstash "run/*" | head

jjbenedict Nov 10, 2022
Author

Ah, okay, now I see the 'zstash/index.db' structure and I was erroneously using that repeatedly. I created a new directory in the project space and now get identical results to what you (@forsyth2 ) and @ndkeen got -- BrokenPipeError:

(e3sm_unified_1.7.1_nompi) jjbenedi@cori03:/project/projectdirs/e3sm/benedict/insitu_data/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12> zstash ls -l --hpss=/home/n/ndk/2021/202101027-maint-1.0-tro.A_WCYCL20TRS_CMIP6_HR.ne120_oRRS18v3_ICG.unc12/zstash "run/*" | head
INFO: Transferring file from HPSS: zstash/index.db
id	name	size	mtime	md5	tar	offset
21564	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.h1.2055-02-10-00000.nc	1262842796	2022-02-17 23:05:14.339574	0b04d4db8cd2a12b15be5ca466022550	00032d.tar	93090676224	
21565	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.h2.2055-02-10-00000.nc	3371704040	2022-02-17 23:04:20.066573	6a6f6a0cbd91d261e13b2f19d6405066	00032d.tar	94353520640	
21566	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.h3.2055-02-10-00000.nc	1934695032	2022-02-17 23:04:53.869571	315205cab82998467076112587b0a352	00032d.tar	97725226496	
21567	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.h4.2055-02-10-00000.nc	970475736	2022-02-17 23:05:00.185698	174d27c3fcd218cc2438dd97516540fb	00032d.tar	99659923456	
21568	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.i.2016-01-01-00000.nc	19334314248	2022-02-17 22:49:35.304308	ca47bd5d0fb728bcdad9318ee84dc6d7	00032d.tar	100630401024	
21569	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.i.2017-01-01-00000.nc	19334314248	2022-02-17 22:49:10.516463	5368636143dbde7885bf3166b3211b5e	00032e.tar	0	
21570	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.i.2018-01-01-00000.nc	19334314248	2022-02-17 22:49:23.273025	1e3686e5a1d5d85ce1ecf0eecde9be53	00032e.tar	19334316032	
21571	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.i.2019-01-01-00000.nc	19334314248	2022-02-17 22:49:35.191568	09d1d6ebb86a3936d5db26831cb2f418	00032e.tar	38668632064	
21572	run/20211021-maint-1.0-tro.A_WCYCLSSP585_CMIP6_HR.ne120_oRRS18v3_ICG.unc12.cam.i.2020-01-01-00000.nc	19334314248	2022-02-17 22:49:41.701493	afec5df6da0ec91a27378dfb73063fa5	00032e.tar	58002948096	
Traceback (most recent call last):
  File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.7.1_nompi/bin/zstash", line 10, in <module>
    sys.exit(main())
  File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.7.1_nompi/lib/python3.9/site-packages/zstash/main.py", line 70, in main
    ls()
  File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.7.1_nompi/lib/python3.9/site-packages/zstash/ls.py", line 36, in ls
    print_matches(args, matches)
  File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.7.1_nompi/lib/python3.9/site-packages/zstash/ls.py", line 207, in print_matches
    print(col, end="\t")
BrokenPipeError: [Errno 32] Broken pipe

The BrokenPipeError only occurs if you're piping to head, so probably not a big deal. I'll look in /archive to see if I can find the data files I need, but for right now things are looking better.

forsyth2 Nov 10, 2022
Maintainer

The BrokenPipeError only occurs if you're piping to head, so probably not a big deal

Ah, ok that's good to know.

for right now things are looking better.

Great!

jjbenedict Nov 10, 2022
Author

To bring some closure to this, the lesson learned is that when you want to run zstash to list or retrieve HPSS files, first create a clean directory on disk (where you want to copy the HPSS files to -- let's call it filesFromHPSS), then run zstash commands from within filesFromHPSS. A zstash subdirectory is created within filesFromHPSS. My error occurred because I was running zstash commands that were inherently referenced an existing ./zstash/index.db file, and this was not intended. Thanks your help @forsyth2 .

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Unexpected 'zstash ls' output #234

{{title}}

Replies: 4 comments 9 replies

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

Unexpected 'zstash ls' output #234

jjbenedict Nov 9, 2022

Replies: 4 comments · 9 replies

forsyth2 Nov 9, 2022 Maintainer

forsyth2 Nov 9, 2022 Maintainer

forsyth2 Nov 9, 2022 Maintainer

ndkeen Nov 10, 2022

forsyth2 Nov 10, 2022 Maintainer

ndkeen Nov 10, 2022

jjbenedict Nov 10, 2022 Author

jjbenedict Nov 10, 2022 Author

forsyth2 Nov 10, 2022 Maintainer

jjbenedict Nov 10, 2022 Author

forsyth2 Nov 10, 2022 Maintainer

jjbenedict Nov 10, 2022 Author

jjbenedict
Nov 9, 2022

Replies: 4 comments 9 replies

forsyth2
Nov 9, 2022
Maintainer

forsyth2 Nov 9, 2022
Maintainer

forsyth2 Nov 9, 2022
Maintainer

ndkeen
Nov 10, 2022

forsyth2 Nov 10, 2022
Maintainer

ndkeen
Nov 10, 2022

jjbenedict
Nov 10, 2022
Author

jjbenedict Nov 10, 2022
Author

forsyth2 Nov 10, 2022
Maintainer

jjbenedict Nov 10, 2022
Author

forsyth2 Nov 10, 2022
Maintainer

jjbenedict Nov 10, 2022
Author