Prod. Globus/NESE infrastructure, next step: Upload GEOCHEM data to NESE

[landreev]

Now that the OMAMA package has been deposited and the documentation pr is in review, GEOCHEM is next in line. I'm not 100% yet if we should ask them to guinea-pig the new depositor documentation and handle it themselves (that would probably need to wait on #268 to be reviewed and tested), or if that's something we can do for them (they have something like 1TB in the first batch; i.e., pocket change by our new standards). In either case, some back and forth with them will be needed as their data may not be compliant with the no small files requirement.

[landreev]

Writing to Bob now. Lots of questions about their data in its current state on their server, http://ftp.as.harvard.edu.

[cmbz]

2024/07/10

• @landreev any updates from Bob on this?
• @sbarbosadataverse I think you've been in touch with him recently too?

[sbarbosadataverse]

Connected with Bob for Geos-Chem and received instructions from Leonid on preparing the data for both NESE and s3 storage. Waiting on his details about the PDFs in the collection.

[sbarbosadataverse]

Bob sent the specs for the PDF and some other data formats, at about 700TB total.