Skip to content
This repository has been archived by the owner on Dec 5, 2019. It is now read-only.

Migrate Spark jobs to newer EMR versions #848

Open
jezdez opened this issue Nov 13, 2017 · 1 comment
Open

Migrate Spark jobs to newer EMR versions #848

jezdez opened this issue Nov 13, 2017 · 1 comment

Comments

@jezdez
Copy link
Contributor

jezdez commented Nov 13, 2017 •
edited
Loading

The majority of scheduled Spark jobs run an old version of EMR and need to be updated. I think this should include at first doing a one-time notification of their owners and updating their EMR release to a newer version.

Mid- and long-term wise this should be done automatically as soon as a new non-experimental version is added to ATMO (notify all job owners that a new stable EMR release has been added).
@jezdez
Copy link
Contributor Author

jezdez commented Nov 13, 2017

This kinda refs #847

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jezdez