Add support for custom headers and cookies in HDFS provider

[makrushin-evgenii]

Description

This will make it possible to configure HDFS client via Apache Knox gateway, which requires cookies with hadoop-jwt token:

requests_session = requests.Session()
requests_session.cookies.update({'hadoop-jwt': '***'})
hdfs_client = hdfs.InsecureClient("https://***/gateway/staging/webhdfs/v1", session=requests_session)

Use case/motivation

Configure HDFS connection via Apache Knox gateway

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[amolsr]

I want to work on this. Please assign this to me. Thanks.