Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HDDS-12004. [Doc] Other applications known to work with Ozone #8042

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

jojochuang
Copy link
Contributor

What changes were proposed in this pull request?

HDDS-12004. [Doc] Other applications known to work with Ozone

  • This doc summarizes all known applications that integrate with Ozone. It's important to note that these integrations are offers by other application developers or vendors, and I'm just collecting the respective info for informational purposes.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-12004

How was this patch tested?

Doc only change.

https://github.com/jojochuang/ozone/actions/runs/13775050547

Screenshot 2025-03-10 at 2 26 32 PM

Change-Id: I611024c9d5f51988c93ab06251affb1c3abd5da7
Change-Id: I20dd1a4a12478ca0e03a8285c897c70336c1f32b
Change-Id: I4a7c7931de79f42489169169136cb83ee31e0d8f
Copy link
Contributor

@errose28 errose28 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for looking into this @jojochuang, but overall I don't think we have enough content here for an actual page. From what I can see all the examples would be better served by having their own page, or given as examples of possible integrations under the existing S3 or ofs interface pages.


For more information, see the [File Systems](https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/) documentation.

* PyArrow https://hackmd.io/@cxorm/cxorm
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is just someone's personal note, and uses o3fs which is not recommended. If we want to detail pyarrow support, it would be better to document it ourselves.


These integrations are not maintained by the Apache Ozone community. If you have any questions or issues, please contact the respective tool or application maintainers.

## Open Source
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These open source options all seem like they should have dedicated pages under the Integrations section. I don't see why Hive or Impala would get their own page while Nifi or Flink would not.

For more information, see the [File Systems](https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/) documentation.

* PyArrow https://hackmd.io/@cxorm/cxorm
* Cloudera Hue can access Ozone through Ozone HTTPFS interface https://gethue.com/blog/discover-the-power-of-apache-ozone-using-the-hue-file-browser/
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can also convert this into a top level docs page and test it. This is more of a blog than a docs link.

Comment on lines +58 to +59
* Teradata https://docs.teradata.com/r/Enterprise_IntelliFlex_VMware/Teradata-VantageTM-Native-Object-Store-Getting-Started-Guide-17.20
* Starburst https://docs.starburst.io/latest/connector/starburst-ozone.html
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There's not much Ozone specific on these pages. They would probably be better suited as examples given under the S3 integration section.


* PyArrow https://hackmd.io/@cxorm/cxorm
* Cloudera Hue can access Ozone through Ozone HTTPFS interface https://gethue.com/blog/discover-the-power-of-apache-ozone-using-the-hue-file-browser/
* Alluxio https://docs.alluxio.io/os/user/stable/en/ufs/Ozone.html
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The banner at the top says these are old/archived docs. The current version has no mention of Ozone, likely because it fits under the HDFS and S3 sections already.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting... as far as I can tell that doc I referred to is a "stable" version, and I can tell the Ozone support is still in the current codebase: https://github.com/Alluxio/alluxio/tree/main/underfs/ozone

@adoroszlai adoroszlai added the documentation Improvements or additions to documentation label Mar 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants