Skip to content

IOOS' Coastal Modeling Cloud Sandbox provides a framework for developing, modifying and running models in the cloud. It provides repeatable configurations, model code and required libraries, input data and analysis of model outputs. The Sandbox supports not only the development of services and models, but also Cloud HPC to run and validate models.

License

Notifications You must be signed in to change notification settings

ioos/Cloud-Sandbox

IOOS Cloud Sandbox

The IOOS Cloud Sandbox is a collaborative platform for running regional coastal models in the cloud.

It provides repeatable configurations, model code and required libraries, input data, and analysis of model outputs. The Sandbox provisions Cloud HPC to aid in the development of services and models, and also supports running and validating models. The Sandbox is intended for use across industries and is inclusive to anyone who wants to develop, enhance, and run coastal models.

Use cases

  • Inter-organization collaboration
  • University graduate courses
  • Hindcasts/Reanalysis
  • Research to Operations (R2O)
  • On-demand HPC capacity
  • Quasi-operational HPC fail-over (natural disasters, data-center problems)
  • AI/ML training

Deployment options

  • Self deployed/hosted: Deploy using your own AWS cloud account
  • IOOS hosted: NOAA AWS Government Cloud – Lynker contract
  • RPS hosted: Isolated secure Virtual Private Cloud (VPC)

The Cloud Sandbox has been used to run:

I want to...

Software Stack

The Cloud Sandbox uses CloudFlow to orchestrate the execution of the model. CloudFlow is a customized workflow for running models built on Prefect Workflows.

Modeling Stack

Software Architecture

The Cloud Sandbox uses Terraform to deploy resources to the cloud. The sandbox currently only supports the Amazon Web Services (AWS) cloud platform.

Software Architecture

  • Head Node: The head node is the machine that runs the CloudFlow scheduler. Users can SSH into this machine to run CloudFlow tasks.
  • Preconfigured AMI: This Amazon Machine Image (AMI) contains all of the necessary code to run the model. This image will run on the worker nodes.
  • Worker Nodes: The worker nodes are provisioned by Terraform and run CloudFlow tasks. This runs the preconfigured AMI.

About

IOOS' Coastal Modeling Cloud Sandbox provides a framework for developing, modifying and running models in the cloud. It provides repeatable configurations, model code and required libraries, input data and analysis of model outputs. The Sandbox supports not only the development of services and models, but also Cloud HPC to run and validate models.

Resources

License

Code of conduct

Stars

Watchers

Forks

Packages

No packages published