[ZEPPELIN-335][DOCS] Minor update for pig.md#2
Merged
zjffdu merged 3 commits intozjffdu:ZEPPELIN-335from Oct 9, 2016
Merged
Conversation
zjffdu
added a commit
that referenced
this pull request
Oct 17, 2016
### What is this PR for? Based on #338 , I refactor most of pig interpreter. As I don't think the approach in #338 is the best approach. In #338, we use script `bin/pig` to launch pig script, it is different to control that job (hard to kill and get progress and stats info). In this PR, I use pig api to launch pig script. Besides that I implement another interpreter type `%pig.query` to leverage the display system of zeppelin. For the details you can check `pig.md` ### What type of PR is it? [Feature] ### Todos * Syntax Highlight * new interpreter type `%pig.udf`, so that user can write pig udf in zeppelin directly and don't need to build udf jar manually. ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-335 ### How should this be tested? Unit test is added and also manual test is done ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Author: Ali Bajwa <abajwa@hortonworks.com> Author: AhyoungRyu <ahyoungryu@apache.org> Author: Jeff Zhang <zjffdu@gmail.com> Closes apache#1476 from zjffdu/ZEPPELIN-335 and squashes the following commits: 73a07f0 [Jeff Zhang] minor update a1b742b [Jeff Zhang] minor update on doc e858301 [Jeff Zhang] address comments c85a090 [Jeff Zhang] add license 58b4b2f [Jeff Zhang] minor update of docs 1ae7db2 [Jeff Zhang] Merge pull request #2 from AhyoungRyu/ZEPPELIN-335/docs fe014a7 [AhyoungRyu] Fix docs title in front matter df7a6db [AhyoungRyu] Add pig.md to dropdown menu 5e2e222 [AhyoungRyu] Minor update for pig.md 39f161a [Jeff Zhang] address comments 05a3b9b [Jeff Zhang] add pig.md a09a7f7 [Jeff Zhang] refactor pig Interpreter c28beb5 [Ali Bajwa] Updated based on comments: 1. Documentation: added pig.md with interpreter documentation and added pig entry to index.md 2. Added test junit test based on passwd file parsing example here https://pig.apache.org/docs/r0.10.0/start.html#run 3. Removed author tag from comment (this was copied from shell interpreter https://github.com/apache/incubator-zeppelin/blob/master/shell/src/main/java/org/apache/zeppelin/shell/ShellInterpreter.java#L42) 4. Implemented cancel functionality 5. Display output stream in case of error 2586336 [Ali Bajwa] exposed timeout and pig executable via interpreter and added comments 7abad20 [Ali Bajwa] initial commit of pig interpreter
zjffdu
pushed a commit
that referenced
this pull request
Nov 7, 2016
## What is this PR for? The PR is a interpreter for [Apache Beam](http://beam.incubator.apache.org) which is an open source unified platform for data processing pipelines. A pipeline can be build using one of the Beam SDKs. The execution of the pipeline is done by different Runners . Currently, Beam supports Apache Flink Runner, Apache Spark Runner, and Google Dataflow Runner. ### What type of PR is it? - Feature ### Todos * Test case * Review Comments * Documentation ### What is the Jira issue? * [ZEPPELIN-682] ### How should this be tested? - Start the Zeppelin server - The prefix of interpreter is `%beam` and then write your code with required imports and the runner ### Screenshots (if appropriate)   ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: mahmoudelgamal <mahmoudf.elgamal@gmail.com> Author: mfelgamal <mahmoudf.elgamal@gmail.com> Author: Fouad <fuad.assayadi@gmail.com> Closes apache#1334 from mfelgamal/beam-interpreter-static-repl-7 and squashes the following commits: da66c27 [mahmoudelgamal] Modify condition of checking static modifier 55c1322 [mahmoudelgamal] set spark version to 1.6.2 and throw original exception 27d7690 [mahmoudelgamal] set spark version to 1.6.1 and some modifications 750041c [mahmoudelgamal] Add readme file and modify pom file and travis.yml ca88f94 [mahmoudelgamal] edit pom file and .travis.yml 3d65427 [mahmoudelgamal] update .travis.yml file f19f98d [mahmoudelgamal] Make easy example with imports ands some modifications 74c14ca [mahmoudelgamal] Update the licenses acc7afb [mahmoudelgamal] Change beam to version 0.2.0 e821614 [mahmoudelgamal] Removing hadoop-core and print stack trace to failure 5cb7c7b [mahmoudelgamal] Add some changes to doc and pom file 75fc4f7 [mahmoudelgamal] add interpreter to navigation.html and remove extra spaces and lines 9b1b385 [mahmoudelgamal] put beam in alphabetical order 9c1e25d [mahmoudelgamal] Adding changes like logging and conventions and license 2aa6d65 [mahmoudelgamal] changing class name to StaticRepl and adding some modifications 7cf25fb [mahmoudelgamal] Adding some tests 3c5038f [mahmoudelgamal] Modifying the documentation 5695077 [mahmoudelgamal] Modifying pom file and Making documentation 26fc59b [mahmoudelgamal] Refactoring of the code 3a2bd85 [mahmoudelgamal] Adding the beam to zeppelin 7 ab7ee2d [mahmoudelgamal] beam interpreter 85957ff [mfelgamal] Merge pull request #10 from apache/master 852c3d3 [mfelgamal] Merge pull request #9 from apache/master a4bcc0d [mfelgamal] Merge pull request #8 from apache/master 858f1e1 [mfelgamal] Merge pull request #7 from apache/master 03a1e80 [mfelgamal] Merge pull request #4 from apache/master 2586651 [Fouad] Merge pull request #2 from apache/master
zjffdu
pushed a commit
that referenced
this pull request
Jan 19, 2018
### What is this PR for? This PR fixes the issue of newlines and tabs breaking results in the SQL interpreter in Livy. The Livy interpreter will return incorrect results if a row contains \n or \t characters. In the case of the newline, the result will be: Line is missing from results if the \n appears anywhere but the end of a cell `String index out of range: 17` if it appears at the end of a cell In the case of the tab, the result will be misaligned columns if the tab appears in the middle of a cell The output showing these error is attached to the Jira. I have changed the parsing and any newline or tab characters will be escaped ### What type of PR is it? Bug Fix ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-3098 ### How should this be tested? Unittests have been added ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Alex Bush <alex.bush@coxauto.co.uk> Author: Alex Bush <bushnoh@users.noreply.github.com> Closes apache#2701 from bushnoh/zeppelin-3098 and squashes the following commits: 9f2f6e3 [Alex Bush] Merge pull request #3 from apache/master 14e120d [Alex Bush] Merge pull request #2 from apache/master 46981fd [Alex Bush] Merge pull request #1 from apache/master ee5a41b [Alex Bush] Merge remote-tracking branch 'upstream/master' 67a93b5 [Alex Bush] Merge branch 'master' of https://github.com/bushnoh/zeppelin 31cdbdc [Alex Bush] Added another comment explaining the regexp change d054af0 [Alex Bush] Force a dummy change for Travis 64a42be [Alex Bush] Fix for newline and tab in data
zjffdu
pushed a commit
that referenced
this pull request
Sep 28, 2018
### What is this PR for? By using the Raft protocol, multiple Zeppelin-Server groups are built into a Zeppelin cluster, the cluster State Machine is maintained through the Raft protocol, and the services in the cluster are agreed upon. The Zeppelin-Server and Zeppelin-Interperter services and processes are stored in the Cluster MetaData. Metadata information; ### What type of PR is it? [Feature] ### Todos * [x] add raft algorithm atomix jar * [x] add cluster state machine * [x] add state machine query command * [x] add state machine delete command * [x] add state machine put command * [x] Isolate the netty JAR package introduced by atomix ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3610 ### How should this be tested? [CI pass](https://travis-ci.org/liuxunorg/zeppelin/builds/418742522) ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? Yes Author: liuxunorg <33611720@qq.com> Author: Jeff Zhang <zjffdu@gmail.com> Closes apache#3183 from liuxunorg/ZEPPELIN-3610 and squashes the following commits: c899b15 [liuxunorg] uncomment maven-dependency-plugin. af728bd [liuxunorg] add more doc to explain this class's responsibility. d268ee7 [Jeff Zhang] fix test (#2) 97f17ac [liuxunorg] Cluster Raft module design
zjffdu
pushed a commit
that referenced
this pull request
Apr 8, 2020
…refused ### What is this PR for? - an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete when i try remove a paragraph. ### What type of PR is it? - Bug Fix ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-4712 ### Questions: Does the licenses files need update? NO Is there breaking changes for older versions? NO Does this needs documentation? NO Author: xiejiajun <xiejiajun02@163.com> Author: xie-jia-jun <xiejiajun02@163.com> Closes apache#3710 from xiejiajun/branch-0.9 and squashes the following commits: 9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9 9bc5605 [xiejiajun] bug fix: when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete. 97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9 9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly (cherry picked from commit 3fdd8bb) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
zjffdu
pushed a commit
that referenced
this pull request
Jul 12, 2020
…Interpreter database connection pool ### What is this PR for? - Added support for personalized configuration of the JDBCInterpreter database connection pool. - This feature can be used to solve the runtime error caused by HiveServer2 Session timeout. - This connection pool configuration Compatible with [the official configuration of dbcp2 ](http://commons.apache.org/proper/commons-dbcp/configuration.html) ### What type of PR is it? [Feature] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-4941 ### How should this be tested? * manually tested * Supported configuration items - validationQuery - testOnBorrow - testOnCreate - testOnReturn - testWhileIdle - timeBetweenEvictionRunsMillis - maxWaitMillis - maxIdle - minIdle - maxTotal ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? NO Author: xiejiajun <xiejiajun02@163.com> Author: JakeXie <xiejiajun02@163.com> Author: xie-jia-jun <xiejiajun02@163.com> Closes apache#3844 from xiejiajun/jdbc-pool-config and squashes the following commits: 3bb622b [xiejiajun] use html table display datasource pool configuration in the jdbc.md document 88b1ce0 [xiejiajun] jdbc interpreter datasource connection pool document 1f2eb55 [xiejiajun] Compatible with the official configuration of dbcp2 connection pool 5c7f666 [xiejiajun] JDBCInterprete supports personalized database connection pool configuration to cope with scenarios such as HiveSession timeout 3d57719 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9 0e5f65a [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9 076668a [JakeXie] Merge pull request #7 from apache/branch-0.9 00e14dd [JakeXie] Merge pull request #5 from apache/branch-0.9 9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9 9bc5605 [xiejiajun] bug fix: when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete. 97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9 9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly
zjffdu
pushed a commit
that referenced
this pull request
Jul 20, 2020
…Spark Interpreter Scala REPL ### What is this PR for? - Support for manually specifying the Java version of Spark Interpreter Scala REPL. - This feature can be used to resolve runtime errors caused by reference to third-party libraries that use high-version Java in Spark Interpreter. ### What type of PR is it? [Feature] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/projects/ZEPPELIN/issues/ZEPPELIN-4950 ### How should this be tested? * manually tested * Specify spark.repl.target through %spark.conf or when configuring Spark Interpreter * Reference and call a Java method in a third-party library developed using Java 8 and using Java 8 features such as interface static methods through the Spark interpreter. If the call is successful, it means the test passed ### Screenshots (if appropriate) - A runtime error will be triggered when we reference a third-party library that uses the new features of Java8 if we using the default value `jvm-1.6` of `settings.target.value` :  ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? Yes Author: xiejiajun <xiejiajun02@163.com> Author: JakeXie <xiejiajun02@163.com> Author: xie-jia-jun <xiejiajun02@163.com> Closes apache#3852 from xiejiajun/spark_repl_target and squashes the following commits: d131f19 [xiejiajun] spark.md docs fix 6872054 [xiejiajun] add spark.repl.target to spark.md docs 6a05b4f [xiejiajun] Support for manually specifying the Java version of Spark Interpreter Scala REPL 6a2cf04 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into branch-0.9 076668a [JakeXie] Merge pull request #7 from apache/branch-0.9 00e14dd [JakeXie] Merge pull request #5 from apache/branch-0.9 9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9 9bc5605 [xiejiajun] bug fix: when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete. 97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9 9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly (cherry picked from commit 054651f) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
zjffdu
pushed a commit
that referenced
this pull request
Oct 18, 2020
…refused ### What is this PR for? - an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete when i try remove a paragraph. ### What type of PR is it? - Bug Fix ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-4712 ### Questions: Does the licenses files need update? NO Is there breaking changes for older versions? NO Does this needs documentation? NO Author: xiejiajun <xiejiajun02@163.com> Author: xie-jia-jun <xiejiajun02@163.com> Closes apache#3710 from xiejiajun/branch-0.9 and squashes the following commits: 9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9 9bc5605 [xiejiajun] bug fix: when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete. 97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9 9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly
zjffdu
pushed a commit
that referenced
this pull request
Oct 18, 2020
…Interpreter database connection pool ### What is this PR for? - Added support for personalized configuration of the JDBCInterpreter database connection pool. - This feature can be used to solve the runtime error caused by HiveServer2 Session timeout. - This connection pool configuration Compatible with [the official configuration of dbcp2 ](http://commons.apache.org/proper/commons-dbcp/configuration.html) ### What type of PR is it? [Feature] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-4941 ### How should this be tested? * manually tested * Supported configuration items - validationQuery - testOnBorrow - testOnCreate - testOnReturn - testWhileIdle - timeBetweenEvictionRunsMillis - maxWaitMillis - maxIdle - minIdle - maxTotal ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? NO Author: xiejiajun <xiejiajun02@163.com> Author: JakeXie <xiejiajun02@163.com> Author: xie-jia-jun <xiejiajun02@163.com> Closes apache#3844 from xiejiajun/jdbc-pool-config and squashes the following commits: 3bb622b [xiejiajun] use html table display datasource pool configuration in the jdbc.md document 88b1ce0 [xiejiajun] jdbc interpreter datasource connection pool document 1f2eb55 [xiejiajun] Compatible with the official configuration of dbcp2 connection pool 5c7f666 [xiejiajun] JDBCInterprete supports personalized database connection pool configuration to cope with scenarios such as HiveSession timeout 3d57719 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9 0e5f65a [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9 076668a [JakeXie] Merge pull request #7 from apache/branch-0.9 00e14dd [JakeXie] Merge pull request #5 from apache/branch-0.9 9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9 9bc5605 [xiejiajun] bug fix: when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete. 97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9 9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly
zjffdu
pushed a commit
that referenced
this pull request
Oct 18, 2020
…Spark Interpreter Scala REPL ### What is this PR for? - Support for manually specifying the Java version of Spark Interpreter Scala REPL. - This feature can be used to resolve runtime errors caused by reference to third-party libraries that use high-version Java in Spark Interpreter. ### What type of PR is it? [Feature] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/projects/ZEPPELIN/issues/ZEPPELIN-4950 ### How should this be tested? * manually tested * Specify spark.repl.target through %spark.conf or when configuring Spark Interpreter * Reference and call a Java method in a third-party library developed using Java 8 and using Java 8 features such as interface static methods through the Spark interpreter. If the call is successful, it means the test passed ### Screenshots (if appropriate) - A runtime error will be triggered when we reference a third-party library that uses the new features of Java8 if we using the default value `jvm-1.6` of `settings.target.value` :  ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? Yes Author: xiejiajun <xiejiajun02@163.com> Author: JakeXie <xiejiajun02@163.com> Author: xie-jia-jun <xiejiajun02@163.com> Closes apache#3852 from xiejiajun/spark_repl_target and squashes the following commits: d131f19 [xiejiajun] spark.md docs fix 6872054 [xiejiajun] add spark.repl.target to spark.md docs 6a05b4f [xiejiajun] Support for manually specifying the Java version of Spark Interpreter Scala REPL 6a2cf04 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into branch-0.9 076668a [JakeXie] Merge pull request #7 from apache/branch-0.9 00e14dd [JakeXie] Merge pull request #5 from apache/branch-0.9 9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9 9bc5605 [xiejiajun] bug fix: when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete. 97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9 9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
As you can see in the file changes, nothing much changed. I just handled wired markdown rendering, typo, and added a table of contents. Ah also added
pig.mdto dropdown menu list. Please feel free to use this :)