Skip to content

Commit 9c65073

Browse files
authored
[DOCS] Clarify expected availability of HDFS for the HDFS Repository (#25220)
If a cluster is configured with an HDFS repository and a node is started, that node must be able to reach HDFS, or else when it attempts to add the repository from the cluster state at start up it will fail to connect and the repository will be left in an inconsistent state. Adding a blurb in the docs to outline the expected availability for HDFS when using the repository plugin.
1 parent 39d9c8a commit 9c65073

File tree

1 file changed

+9
-0
lines changed

1 file changed

+9
-0
lines changed

docs/plugins/repository-hdfs.asciidoc

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -76,6 +76,15 @@ The following settings are supported:
7676
the pattern with the hostname of the node at runtime (see
7777
link:repository-hdfs-security-runtime[Creating the Secure Repository]).
7878

79+
[[repository-hdfs-availability]]
80+
[float]
81+
===== A Note on HDFS Availablility
82+
When you initialize a repository, its settings are persisted in the cluster state. When a node comes online, it will
83+
attempt to initialize all repositories for which it has settings. If your cluster has an HDFS repository configured, then
84+
all nodes in the cluster must be able to reach HDFS when starting. If not, then the node will fail to initialize the
85+
repository at start up and the repository will be unusable. If this happens, you will need to remove and re-add the
86+
repository or restart the offending node.
87+
7988
[[repository-hdfs-security]]
8089
==== Hadoop Security
8190

0 commit comments

Comments
 (0)