Automation (load & delete)

Automation

Dataset maintenance => Dataset => Automation

---

Data load

Every data source can be used for automated data loading. After configuration, a job can be schedules every hour or every day

1. Select a data source type and press "+"
2. Enter the specific settings for the data source
3. Timestamp of data load this option can be used to add the timestamp of the data load to every data record. This is usefull to create historic reports
4. Delete data before load this option is used when a full refresh of all data is requested. All data will be removed before the load
5. Test run when the flag is set, the data load can be simulated and the expected result will be shown for debugging purposes
6. The job can be scheduled with the Nextcloud job scheduler

---

Data deletion

Data deletion can be used to perform a regular data set cleanup to delete data e.g. of last month automatically.

1. Select "+ New deletion" in the lower section
2. Enter the selection in the same format as in the report filter

---

Automation options

Dataloads can be executed in several ways:

• manual via the "load now" button
• scheduled by using the Nextcloud background job environment: daily or hourly
• execute via occ command occ analytics:load **Dataload ID**