Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Genie job submission should support a mechanism to specify file dependencies as attachments #28

Closed
sriramkrishnan opened this issue Sep 18, 2013 · 1 comment
Closed

Genie job submission should support a mechanism to specify file dependencies as attachments #28

sriramkrishnan opened this issue Sep 18, 2013 · 1 comment
Assignees
@sriramkrishnan
Labels
feature

Comments

@sriramkrishnan
Copy link
Contributor

Currently file dependencies are passed around as locations on S3 (or any file system that Hadoop supports, that is accessible to the Genie server). This adds an additional step, where clients have to first stage the dependencies, which then gets downloaded to the Genie server.

In addition, Genie should support a mechanism to POST file dependencies as attachments.
@ghost ghost assigned sriramkrishnan Sep 18, 2013
sriramkrishnan added a commit that referenced this issue Sep 18, 2013
@sriramkrishnan
Issue #28: first pass at support for attachments
78d8d4f
sriramkrishnan added a commit that referenced this issue Sep 20, 2013
@sriramkrishnan
Issue #28: adding minor comment
2e0a1f4
sriramkrishnan added a commit that referenced this issue Sep 25, 2013
@sriramkrishnan
Issue #28: adding some more error handling
0b0c3aa
sriramkrishnan added a commit that referenced this issue Sep 25, 2013
@sriramkrishnan
Adding issue #28 to changelog
b39de2e
sriramkrishnan added a commit that referenced this issue Sep 25, 2013
@sriramkrishnan
Issue #28: adding a python test
40b3ac5
sriramkrishnan added a commit that referenced this issue Sep 25, 2013
@sriramkrishnan
Merge pull request #30 from /issues/28
981882d 
Pull request for Issues/28
sriramkrishnan added a commit that referenced this issue Sep 25, 2013
@sriramkrishnan
Issue #28: fixing some findbugs violations
ca0182c
sriramkrishnan added a commit that referenced this issue Oct 29, 2013
@sriramkrishnan
Issue #28: fixing another findbugs violation
0f36e67
sriramkrishnan added a commit that referenced this issue Oct 29, 2013
@sriramkrishnan
Issue #28: fixing findbug, avoiding reliance on default encoding
4b3a8cd
@sriramkrishnan
Copy link
Contributor Author

Closing this as basic inline attachment works. Further improvements will be tracked by separate issues.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sriramkrishnan sriramkrishnan

Labels
feature
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@sriramkrishnan