What are Dataset Sizes?

[ghalimi]

Defintion Dataset Size Dataset

[ghalimi]

Dataset Sizes define how datasets should be handled based on their (uncompressed) size:

Code	Size	Size Range	Interactivity	Mult. Func.	Cloud	Basic Part.	VM	Adv. Part.	Cluster
XS	1 MB	0-10 MB	✅
S	100 MB	10 MB - 1 GB	✅	✅
M	10 GB	1 GB - 100 GB	✅	✅	✅	✅	✅
L	1 TB	100 GB - 10 TB	✅	✅	✅	✅	✅	✅
XL	100 TB	10 TB - 1 PB	✅	✅	✅	✅	✅	✅	✅

• Interactivity: Simple queries complete within 2 seconds or less.
• Multiple Functions: Requires multiple serverless functions for initial scan.
• Cloud: Requires STOIC Cloud (otherwise, STOIC App is sufficient).
• Basic Partitions: Datasets must be partitioned.
• Advanced Partitions: Partitions must be defined from actual table columns.
• VM: Requires the use of at least one Virtual Machine.
• Cluster: Requires the use of a cluster of Virtual Machines.