AWS deployment details ?

[fpavogt]

Dear wis2box gurus,

Not sure if this is the right place to ask, but I'm looking for more info on the AWS deployments options for the wis2box. Is there anyway to get more details on the demonstration deployments (e.g. for Malawi) ?

What services are being used, specifically ? Is Fargate an option at all (not having the need actively maintain a server would be great) ?

Are there any tools that would enable such deployements to be easily replicated for other countries (e.g. by means of AWS CLI-compatible sets of instructions of scripts) ?

Just keen to figure out a bit better how things work in practice (inc. S3 buckets, etc ...).

[maaikelimper]

Hi Frederic,

The deployments on AWS for countries such as Malawi, involved wis2box running the default docker-compose-stack on an EC2-instance hosted in the Amazon cloud, so these implementations were not using serverless technology.

It would be great if you could help us contribute to the wis2box-community by providing AWS-CLI-compatible sets of instructions of scripts and I can provide assistance by explaining the different wis2box-services in the default docker-compose stack.

The wis2box-storage is using MinIO which can be replaced by S3, while the other services could, in theory, be deployed as containers on Fargate. Unfortunately I have no experience running the wis2box-services in Fargate but since all services are containerized it should be possible to run these in a serverless environment.

So in short, no sorry I have no scripts or instructions to get started but I am happy to help you get started with this.

@tomkralidis : I'm reminded that I had promised David Podeur for similar help to run wis2box on Kubernetes. Do you have any suggestion on how to assist users with serverless implementation of wis2box ?

kind regards,
Maaike

[jmaxmarno]

Hi Frederic,
We have a wis2box running on an AWS EC2 instance. Additionally we have an implementation of a WIS2 global cache that is running on AWS managed services including an ECS Fargate cluster for the mqtt client and mqtt broker components. I'm happy to answer any other questions, feel free to send me an email (max.marno@synopticdata.com)

[fpavogt]

Thanks for the info @jmaxmarno ! I might definitely get in touch once we start toying around the code for real.

[maaikelimper]

Hi @jmaxmarno , would you be able to share the scripts you used to the setup the MQTT client and MQTT broker components on ECS Fargate here on GitHub ?

[maaikelimper]

@fpavogt to answer your question:
"How much effort would you say is needed to deploy a "Malawi-like" solution from scratch"

For someone that is comfortable with Linux and EC2 this is should be very little effort (1 day of work?)

Here is how to quickly deploy and configure the wis2box as was done for Malawi/Zambia/Namibia:

Fire-up an EC2-instance (t3a.medium or greater) and follow the instructions in the user guide :
https://docs.wis2box.wis.wmo.int/en/latest/user/getting-started.html
https://docs.wis2box.wis.wmo.int/en/latest/user/setup.html

Once the wis2box is deployed and configured you need to find a way to send data into the wis2box-incoming bucket, the solution for which might be different depending on your input-source. You could use a python-script that copies data from the input-source and sends it to the wis2box. An example how to upload data to the wis2box-incoming bucket using python is described here:
https://docs.wis2box.wis.wmo.int/en/latest/user/data-ingest.html#automating-data-ingestion