[SPARK-3814][SQL] Bitwise & does not work in Hive

[ravipesala]

Currently there is no support of Bitwise & in Spark HiveQl and Spark SQL as well. So this PR support the same.
I am closing #2710 as it has conflicts to merge

Author : ravipesala ravindra.pesala@huawei.com

[AmplabJenkins]

Can one of the admins verify this patch?

[AmplabJenkins]

Can one of the admins verify this patch?

[marmbrus]

ok to test

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21551/Test FAILed.

[marmbrus]

If the standard Scala numeric doesn't support the operation, I think I'd prefer we just put the logic in the expression's eval function. Otherwise I'm afraid the types will get too unwieldy.

[marmbrus]

A few other comments:

• Would it be possible to support bitwise or as well since that code will be very similar?
• New expressions should have tests in ExpressionEvaluationSuite as well.

[marmbrus]

BitwiseAnd

[ravipesala]

Since this PR has conflicts , I created new PR #2772 and handled review comments in it.

[scwf]

Hi, @ravipesala, you don't need create a new PR, you can update you pr here(use git push to update this branch)

[ravipesala]

Thank you @scwf , I have created new PR since it has merge conflicts. It will not be neat If I rebase and push to old PR because it will show all changed files which are merged while rebasing.

[marmbrus]

I don't think that is correct. Github shows whatever the difference is between the head commit of the PR branch and apache/master. Intermediate changes/merges should not show up. Also our merge script squashes all commits to a single commit when we actually add code to master, so it really doesn't matter if there are other things in the middle.