Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document set-up for 3.x Hadoop based installation #205

Open
pjeli opened this issue Mar 8, 2019 · 1 comment
Open

Document set-up for 3.x Hadoop based installation #205

pjeli opened this issue Mar 8, 2019 · 1 comment
Assignees
Labels
documentation Documentation needed

Comments

@pjeli
Copy link
Collaborator

pjeli commented Mar 8, 2019

After having just experimented with a 3.x based cluster I have found that it may be required to run with nna.support.bootstrap.overrides=false if you are running security (Kerberos) and that you should provide a custom dfs.ha.namenode.id to satisfy the bootstrap process.

Ideally these challenges should go away when NNA becomes a simple ServicePlugin but until then we should document this so others can have an easier time with the current RPM installation.

@pjeli pjeli added the documentation Documentation needed label Mar 8, 2019
@pjeli pjeli added this to the 1.6.2 Release milestone Mar 8, 2019
@pjeli pjeli self-assigned this Mar 8, 2019
@pjeli pjeli changed the title Document set-up for 3.x Hadoop based NN installation Document set-up for 3.x Hadoop based installation Mar 10, 2019
@pjeli pjeli removed this from the 1.6.2 Release milestone Apr 15, 2019
@pjeli
Copy link
Collaborator Author

pjeli commented Jul 30, 2024

If you are running into the following issues "Could not determine own NameNode HA ID" or "dfs.namenode.lazypersist.file.scrub.interval.sec must be non-zero" or "Class org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer not found" do the following on the NNA hdfs-site.xml:

  1. Set block secret manager enabled to false. NNA does not need block tokens anyway as it does NOT talk to DataNodes.
  2. Set "dfs.namenode.lazypersist.file.scrub.interval.sec" to -1 to satisfy bootstrap. Again, we are not going to be doing any writes / modifications via NNA. It is purely reading it's own metadata.
  3. If you have "dfs.namenode.inode.attributes.provider.class" set, remove it. NNA does not provide Ranger support or require Ranger look-ups.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Documentation needed
Projects
None yet
Development

No branches or pull requests

1 participant