Skip to content

Conversation

@LuciferYang
Copy link
Contributor

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

@github-actions github-actions bot added the BUILD label Dec 28, 2022
<artifactId>protobuf-java</artifactId>
<version>${protobuf.hadoopDependency.version}</version>
<scope>${hadoop.deps.scope}</scope>
<version>${protobuf.version}</version>
Copy link
Contributor Author

@LuciferYang LuciferYang Dec 28, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have tested all maven test with -Phadoop-2 and -Phadoop-3, and all tests passed.

If feasible, we don't need to explicitly declare protobuf.version in each module that requires protobuf-java 3.x(such as core, sql, connect and protobuf), but this also changes protobuf-java version in dev/deps/spark-deps-hadoop-x-hive-2.3 from 2.5.0 to 3.x

@gengliangwang

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Of course, it may be safer to remove -Phadoop-2 completely before doing this work

@bjornjorgensen
Copy link
Contributor

Are there anything we can do with this one?

<version>2.6.1</version>

@bjornjorgensen
Copy link
Contributor

oh.. #33133 the Guava problem..

@LuciferYang
Copy link
Contributor Author

@bjornjorgensen The pr is still being tested. I feel strange that the yarn module can pass the test with -Phadoop-2.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants