This repository has been archived by the owner on May 24, 2022. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 2
Functional Range of the current Release
Bo Ferri edited this page Nov 23, 2016
·
2 revisions
The currently released version of d:swarm serves purposes of demonstration and testing and is meant to validate the working principles of the web-based graphical user interface - the Backoffice.
At the stage of the current release you can model these ETL processes:
- Import sample data resources in CSV, XML and JSON to d:swarm. Note: data resources that are imported with the d:swarm Backoffice should be of a small size up to 1,000 records, since they should only act as samples to verify the mappings with its transformations. Larger amounts of data should be processed with our task processing unit.
- Configure the processing of this data resource to be able to convert it into a data model following our generic graph data model. A configuration for CSV data contains parameters such as column delimiter etc.
- Create projects for bundling mappings that can be utilised in a job of a task to convert the data.
- Define mappings to transform the input data following the output schema.
- Define data transformation routines for each mapping using a basic set of transformation functions.
- Configure filters for the mapping inputs to be able to process values selective.
- Execute data transformations on the imported sample data while modelling and save the results in a central data hub following our generic graph data model.
- View and explore the results within the graphical user interface of the graph database.
- Export all data of the central data hub in JSON, RDF or XML for further use.
Besides you can use the entities in the projects, e.g., the mappings, to execute them with larger amounts of data with help of our task processing unit. This is especially recommend to apply mappings onto larger datasets.
- Our design ideas for the GUI are not yet realized completely in the current release.
- A user or rights management model is not implemented yet. Consequently, all users are allowed to do everything. All users have access to all data resources imported to d:swarm and can manipulate and overwrite projects of other all other users. The data in the central data hub is the result of the work of all users.
- There are further functional restrictions that will be resolved in due time according to our outlook.
- next: Import Sample Data
- previous: Overview
- Overview
- misc
- Graph Data Model
- Server-Installation (Productive Environment)
- Maintenance
- HowTos
- Use Cases