-
Notifications
You must be signed in to change notification settings - Fork 28.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-36239][PYTHON][DOCS] Remove some APIs from documentation. #33458
Conversation
Test build #141396 has finished for PR 33458 at commit
|
Kubernetes integration test starting |
Kubernetes integration test status success |
Test build #141460 has finished for PR 33458 at commit
|
Kubernetes integration test starting |
Kubernetes integration test status success |
Merged to master and branch-3.2. |
### What changes were proposed in this pull request? This PR proposes removing some APIs from pandas-on-Spark documentation. Because they can be easily workaround via Spark DataFrame or Column functions, so they might be removed In the future. ### Why are the changes needed? Because we don't want to expose some functions as a public API. ### Does this PR introduce _any_ user-facing change? The APIs such as `(Series|Index).spark.data_type`, `(Series|Index).spark.nullable`, `DataFrame.spark.schema`, `DataFrame.spark.print_schema`, `DataFrame.pandas_on_spark.attach_id_column`, `DataFrame.spark.checkpoint`, `DataFrame.spark.localcheckpoint` and `DataFrame.spark.explain` is removed in the documentation. ### How was this patch tested? Manually build the documents. Closes #33458 from itholic/SPARK-36239. Authored-by: itholic <haejoon.lee@databricks.com> Signed-off-by: Hyukjin Kwon <gurwls223@apache.org> (cherry picked from commit 86471ad) Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
What changes were proposed in this pull request?
This PR proposes removing some APIs from pandas-on-Spark documentation.
Because they can be easily workaround via Spark DataFrame or Column functions, so they might be removed In the future.
Why are the changes needed?
Because we don't want to expose some functions as a public API.
Does this PR introduce any user-facing change?
The APIs such as
(Series|Index).spark.data_type
,(Series|Index).spark.nullable
,DataFrame.spark.schema
,DataFrame.spark.print_schema
,DataFrame.pandas_on_spark.attach_id_column
,DataFrame.spark.checkpoint
,DataFrame.spark.localcheckpoint
andDataFrame.spark.explain
is removed in the documentation.How was this patch tested?
Manually build the documents.