Change repl member access modifiers for Zeppelin scalding interpreter#1563
Merged
johnynek merged 1 commit intotwitter:developfrom May 31, 2016
Merged
Conversation
Collaborator
|
Thanks! Would love to see a blog post on using Zepplin with scalding. |
Collaborator
|
Not quite a blog post, but not sure if you have seen this - https://zeppelin.incubator.apache.org/docs/0.5.6-incubating/interpreter/scalding.html |
1 task
Author
|
The zeppelin pull request was merged this morning. I put together a draft blog post -https://medium.com/@prasadwagle/apache-zeppelin-scalding-interpreter-ae3f749a32e3#.pqsvmk4nd. Can you please send me your feedback? |
Contributor
Note that libjars is a comma-separated list of globs. A single-file-path glob file is resolved to itself. A single directory path is equivalent to the glob directory/* |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The Zeppelin scalding interpreter is used to
create notebooks and visualizations with scalding code.
Given below is a skeleton of the code. ZeppelinScaldingShell is a subclass of BaseScaldingShell and getRepl is similar to process except that it returns a ScaldingILoop instead of calling repl.process.
out = new ByteArrayOutputStream();
PrintWriter printWriter = new PrintWriter(out, true);
ScaldingILoop interpreter = ZeppelinScaldingShell.getRepl(args, printWriter);
interpreter.createInterpreter();
res = interpreter.intp().interpret(code); // code is received from the web browser
output = out.toString(); // this is sent to the web browser
The ZeppelinScaldingShell.getRepl method needs scaldingREPL to be protected and storedHdfsMode to be public.