Introduce dataset limitations for the to be registered datasets.

[Steffengreiner]

What are you missing?

Currently, there are no limitations on the type of files or file sizes of the to be stored datasets. As long as the directory tree is linked correctly to the measurements, the users can freely register any kind of data to their measurements. While this is permissive and easy-to-use, it opens up multiple vulnerabilties.

Why do you need a solution?

1.) Users are able to upload personalized data, which would violate legal requirements.
2.) Users are able to misuse our service as a personal archive system, flooding our server with unusable data.
3.) Without some sort of file validation have no way to curate incoming datasets for completeness or accuracy.

Ideas

1.) Introduce a user based storage limit, within the upload server and datastore server which can't be exceeded.
2.) Introduce a policy within the data manager ecosystem which informs the user of the kind of data we support and don't support.
3.) Introduce dataset validators, which checks for file quality and file availability dependent on the domain requirements.