Skip to content

check for active RM is broken for kerberized clusters #57

@dimon222

Description

@dimon222

Basically in title.
Default response for non-authenticated request is 401 to enforce handshake with new Kerberos ticket from client. Sadly, current code is expecting 200 OK response for basic activeness check.

So if your cluster is kerberized and requires auth, you will fail to initialize resourcemanager context and code will crash with exception "No RM is active"

Options

  1. Accept 401 as valid response for active RM validation
  2. Inject/rewrite active check to use authentication for access via something more modern like requests library (existing is very python-native but not flexible for Auth as it requires to do headers meddling manually)

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions