Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature request: AWS cost estimate #9046

Open
scholtalbers opened this issue Nov 28, 2019 · 9 comments
Open

Feature request: AWS cost estimate #9046

scholtalbers opened this issue Nov 28, 2019 · 9 comments

Comments

@scholtalbers
Copy link
Contributor

scholtalbers commented Nov 28, 2019

On usegalaxy.eu (https://github.com/usegalaxy-eu/galaxy/blob/release_19.09_europe/templates/show_params.mako#L227) there is a cost estimate for running the same job on AWS.
This might be a nice feature for any Galaxy instance to give the user(and admin) an idea of what their computation costs.

Wishlist:

  • total cost per job (instance, data transfer)
  • total cost of a history (sum of all jobs + data storage)
  • cost of storage usage

The instance estimate is what .eu is already providing, but it doesn't yet include any datastorage/transfer costs. See also https://gitter.im/usegalaxy-eu/Lobby?at=5ddf80f446397c721c4b1b85

@nsoranzo
Copy link
Member

Ping @bgruening

@bgruening
Copy link
Member

I know I talked to Jelle and then he created this issue :)

@HadleyKing
Copy link
Contributor

@nsoranzo,
This is one of the things that @kee007ney and I are trying to work on with our project. We would be happy to try and help out with developing/testing this.

@bgruening
Copy link
Member

@HadleyKing let me know if you need more informations. @scholtalbers already linked some code above.

@HadleyKing
Copy link
Contributor

I think Step 1: enable this script (or a copy of it) to load when you select an invocation under the User -> Workflow Invocations
Once we were able to see an example that could aggregate the requisite info, we could tweak it and test it for accuracy.

@HadleyKing
Copy link
Contributor

Or maybe it could be part of the View screen as well. Maybe under About this Workflow?

@bgruening
Copy link
Member

I will talk to @OlegZharkov ... maybe he has time to look into it. I guess some portable Vue components with a flexible config file to provide the pricing-table could be useful.

@HadleyKing
Copy link
Contributor

HadleyKing commented Feb 19, 2020

I would be happy to help... but I am a total noob.
@jpat1546 and I want to implement this functionality into a BCO extension.

HadleyKing added a commit to biocompute-objects/galaxy that referenced this issue Jul 24, 2020
RE #28 and galaxyproject#9046 and galaxyproject#9621

    GET /api/invocations/{invocations_id}/aws_estimate
    Return a dictionary with an AWS estimate for a workflow invocation.
Changes to be committed:
	modified:   lib/galaxy/webapps/galaxy/api/workflows.py
	modified:   lib/galaxy/webapps/galaxy/buildapp.py
@HadleyKing
Copy link
Contributor

Using what I made in #10029 it should be possible to take the JobMetrics.vue and apply a version of it to the invocations space, maybe replicating it for the invocation. And those functions could probably be easily rewritten for the history, but I have not been using the history APIs much outside of pulling them into the invocation functions. And I have not looked at the history UI at all.

HadleyKing added a commit to biocompute-objects/galaxy that referenced this issue Jul 25, 2020
galaxyproject#9621
and
galaxyproject#9046
Changes to be committed:
	modified:   lib/galaxy/webapps/galaxy/api/workflows.py
	modified:   lib/galaxy/webapps/galaxy/buildapp.py
nsoranzo pushed a commit to biocompute-objects/galaxy that referenced this issue Feb 25, 2022
RE #28 and galaxyproject#9046 and galaxyproject#9621

    GET /api/invocations/{invocations_id}/aws_estimate
    Return a dictionary with an AWS estimate for a workflow invocation.
Changes to be committed:
	modified:   lib/galaxy/webapps/galaxy/api/workflows.py
	modified:   lib/galaxy/webapps/galaxy/buildapp.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants