ZEPPELIN-1115: Python - interpreter for SQL over DataFrame #1164
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
bzz
changed the title
bzz
changed the title
docs/interpreter/python.md
Outdated
|
|
||
| ## Pandas integration | ||
| [Zeppelin Display System]({{BASE_PATH}}/displaysystem/basicdisplaysystem.html#table) provides simple API to visualize data in Pandas DataFrames, same as in Matplotlib. | ||
| Apace Zeppelin [Table Display System]({{BASE_PATH}}/displaysystem/basicdisplaysystem.html#table) provides build-in data visualization capabilities. Python interpreter leverages it to visualize Pandas DataFrames though similar `z.show()` API, same as with [Matplotlib integration](#matplotlib-integration). |
Member
Author
There was a problem hiding this comment.
Thank you for proof-reading! Late night commits a bad...
Contributor
There was a problem hiding this comment.
You mean built-in?
And how about adding this link http://pandas.pydata.org/pandas-docs/stable/generated/pandas.DataFrame.html to Pandas DataFrames? It would be helpful to users i think :)
(Great work indeed! 👍 )
bzz
force-pushed
the
ZEPPELIN-1115/python/add-sql-for-dataframes
branch
from
d20c678 to
886949b
Compare
docs/interpreter/python.md
Outdated
|
|
||
| ## Technical description | ||
|
|
||
| For in-depth technical details on current implementation plese reffer [python/README.md](https://github.com/apache/zeppelin/blob/master/python/README.md). |
Contributor
There was a problem hiding this comment.
There is a typo. plese reffer -> please refer to
Member
Author
|
Documentation review addressed in e432961 |
Member
Author
|
feedback on graceful failure addressed in a378226 |
Member
|
Thanks for the improvement, LGTM |
bzz
force-pushed
the
ZEPPELIN-1115/python/add-sql-for-dataframes
branch
from
11da87c to
a378226
Compare
Member
Author
|
Thank you guys for prompt reviews! Have added one minor TODO item to cleanup test profiles on CI, will merge after #747 |
bzz
force-pushed
the
ZEPPELIN-1115/python/add-sql-for-dataframes
branch
from
a378226 to
0f2f852
Compare
Member
Author
|
Done, merging after CI ♻️ if there is no further discussion |
PhilippGrulich
pushed a commit
to SWC-SENSE/zeppelin
that referenced
this pull request
Aug 8, 2016
### What is this PR for? Add new interpreter to Python group: `%python.sql` for SQL over DataFrame support ### What type of PR is it? Improvement ### TODOs * [x] add new interpreter `%python.sql` * [x] add test * [x] make Python-dependant tests, excluded from CI * PythonInterpreterWithPythonInstalledTest * PythonPandasSqlInterpreterTest * run manually by `mvn -Dpython.test.exclude='' test -pl python -am` * [x] add docs `%python.sql` * [x] make `%python.sql` fail gracefully in case there is no Pandas or PandaSQL installed * [x] after apache#747 is merged - rebase and remove `-Dpython.test.exclude=''` from both profiles ### What is the Jira issue? [ZEPPELIN-1115](https://issues.apache.org/jira/browse/ZEPPELIN-1115) ### How should this be tested? `mvn -Dpython.test.exclude='' test -pl python -am` should pass or manually run - Given the DataFrame i.e ``` %python import pandas as pd rates = pd.read_csv("bank.csv", sep=";") ``` - SQL query it like ``` %python.sql SELECT * FROM rates LIMIT 10 ``` ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? No, no dependencies were included in source or binary release * Is there breaking changes for older versions? No * Does this needs documentation? Yes Author: Alexander Bezzubov <bzz@apache.org> Closes apache#1164 from bzz/ZEPPELIN-1115/python/add-sql-for-dataframes and squashes the following commits: 0f2f852 [Alexander Bezzubov] Fail SQL gracefully if no python dependencies installed aca2bdf [Alexander Bezzubov] Fix typos in docs ⚡ 158ba6a [Alexander Bezzubov] Remove third-party dependant test from CI 5fe46fc [Alexander Bezzubov] Update Python Matplotlib notebook example 72884c8 [Alexander Bezzubov] Add docs for %python.sql feature e931dc4 [Alexander Bezzubov] Make test for PythonPandasSqlInterpreter usable 76bbb44 [Alexander Bezzubov] Complete implementation of the PythonPandasSqlInterpreter f6ca1eb [Alexander Bezzubov] Add %python.sql to interpreter menue 11ba490 [Alexander Bezzubov] Add draft implementation of %python.sql for DataFrames
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What is this PR for?
Add new interpreter to Python group:
%python.sqlfor SQL over DataFrame supportWhat type of PR is it?
Improvement
TODOs
%python.sqlmvn -Dpython.test.exclude='' test -pl python -am%python.sql%python.sqlfail gracefully in case there is no Pandas or PandaSQL installed-Dpython.test.exclude=''from both profilesWhat is the Jira issue?
ZEPPELIN-1115
How should this be tested?
mvn -Dpython.test.exclude='' test -pl python -amshould pass or manually runGiven the DataFrame i.e
SQL query it like
Screenshots (if appropriate)
Questions: