Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Need to develop a tape pool strategy. #12

Open
bnlawrence opened this issue Nov 4, 2022 · 2 comments
Open

Need to develop a tape pool strategy. #12

bnlawrence opened this issue Nov 4, 2022 · 2 comments
Assignees
@bnlawrence
Labels
ceda/jasmin gcm data organisation

Comments

@bnlawrence
Copy link
Contributor

bnlawrence commented Nov 4, 2022 •
edited
Loading

We probably want to separate the data on tapes, need to discuss with the CEDA/JASMIN group:

Need at least:

  • dumps and boundary conditions pool
  • high frequency pool
  • monthly data pool
  • RCM data pool
@bnlawrence bnlawrence self-assigned this Nov 4, 2022
@bnlawrence
Copy link
Contributor Author

bnlawrence commented Nov 4, 2022 •
edited
Loading

Current estimates of GCM volumes would be

Volume Source
900 TB "normal" atmosphere data
450 TB "normal" ocean and ice data
540 TB compressed atmosphere dumps (monthly)
50 TB ocean and ice dumps (yearly)
30-200 TB 10 TB per regional model for frames
2-2.2 PB All in

So o(1.5PB) of science data, split amongst the high-frequency and monthly pools (details coming).
o(0.7PB) of dumps and boundary conditions (number of regional model frames tbd).

@bnlawrence
Copy link
Contributor Author

Depends on resolving #13 first!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@bnlawrence bnlawrence

Labels
ceda/jasmin gcm data organisation
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@bnlawrence