-
Notifications
You must be signed in to change notification settings - Fork 13
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
PubSubLite java.lang.NoSuchMethodError #637
Comments
I had the same issue. Basically transitive dependencies are missing, so you have to download a fat jar "with-dependencies.jar" and append it to Spark's classpath. |
I can not find pubsublite-spark-sql-streaming -- with dependency jar on maven central. but i packaged from this source and used it but it does not work. r u using latest version 1.0 ? |
Found the issue, actually the latest change on the google-cloud-pubsublite has changed the |
I get NoSuchMethodError while trying to read message from pubsublite using spark structured streaming application.
i do see the getCallContext() method with required parameter and classes are present at package
com.google.cloud.pubsublite.internal.wire
which is available in google-cloud-pubsublite-1.12.5 jarI also noticed another thing Upon looking at the
PartitionSubscriberFactory getSubscriberFactory()
method incom.google.cloud.pubsublite.spark.PslReadDataSourceOptions
it indeed using different consumercom.google.cloud.pubsublite.SequencedMessage
vs setMessageConsumer expectingcom.google.cloud.pubsublite.proto.SequencedMessage
Environment details
General, Core, and Other are also allowed as types
The text was updated successfully, but these errors were encountered: