Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Direct functionality between datastores #2144

Open
nnhjy opened this issue Jun 6, 2023 · 7 comments
Open

Direct functionality between datastores #2144

nnhjy opened this issue Jun 6, 2023 · 7 comments
Labels
enhancement Enhancement of existing feature
Milestone

Comments

@nnhjy
Copy link
Member

nnhjy commented Jun 6, 2023

It would be nice if the magic "Merger" could filter out a subset from its upstream datastore (entities, parameters, etc.) as per users' request. With that, the Merger becomes a generic tunnel for data transmission between datastores, which we haven't had yet.

@nnhjy nnhjy added the enhancement Enhancement of existing feature label Jun 6, 2023
@jkiviluo
Copy link
Member

jkiviluo commented Jun 6, 2023

The current workaround is to use exporter and importer back-to-back. Another option is to use API functions.

We have to think how we develop both merger and data transformer going forward, but it has to wait until we finish v0.8 changes.

@jkiviluo jkiviluo added this to the V1.0 milestone Jun 6, 2023
@soininen
Copy link
Contributor

soininen commented Jun 6, 2023

You can currently filter parameter values and entities by scenario and tool filters.

@DillonJ
Copy link
Contributor

DillonJ commented Jun 6, 2023

I definitely agree we need more datastore to datastore functionality.

@nnhjy nnhjy changed the title Filter for the Merger Direct functionality between datastores Jun 6, 2023
@nnhjy
Copy link
Member Author

nnhjy commented Jun 6, 2023

You can currently filter parameter values and entities by scenario and tool filters.

This option seems the most proper way to go. Can we allow filtering by alternative as well? @soininen

@nnhjy
Copy link
Member Author

nnhjy commented Jun 6, 2023

We have to think how we develop both merger and data transformer going forward ...

The icon "data transformer" can be confusing as it only works along with some "executable" icons. It might fit better in the link as the filter does.

@jkiviluo
Copy link
Member

jkiviluo commented Jun 6, 2023

Alternative filtering is coming... We don't seem to have an issue about it though.

@soininen
Copy link
Contributor

soininen commented Jun 7, 2023

I opened issues about moving Data transformer functionality into connections (#2146) and alternative filters (#2147). Both have been on my mind for some time now.

Not sure if there is anything else here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Enhancement of existing feature
Projects
None yet
Development

No branches or pull requests

5 participants