You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I found currently, ZparkIO Test cannot work with Spark 3.2.x and Spark 3.3.x
I simply created a project from demo (sbt new leobenkel/zparkio.g8), fixed some issues to make it work. I need to read a delta table so I added delta-core in my sbt file.
When I run the application I found delta-core is not working with 3.1.x spark. And if I upgrade to 3.2.x and run again I found the following issue.
* Upgrade to latest versions
Address #217 and #213
* Remove bad options for some scala version
* Simplify ci-cd
* Remove other conflicting scoptions
* Better system for the scalaCoptions
* More fixes
* More fixes
* Try again
* Add sbt cache
I found currently, ZparkIO Test cannot work with Spark 3.2.x and Spark 3.3.x
I simply created a project from demo (sbt new leobenkel/zparkio.g8), fixed some issues to make it work. I need to read a delta table so I added delta-core in my sbt file.
When I run the application I found delta-core is not working with 3.1.x spark. And if I upgrade to 3.2.x and run again I found the following issue.
[error] stack trace is suppressed; run 'last update' for the full output
[error] stack trace is suppressed; run 'last ssExtractDependencies' for the full output
[error] (update) lmcoursier.internal.shaded.coursier.error.FetchError$DownloadingArtifacts: Error fetching artifacts:
[error] https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.10.2/avro-mapred-1.10.2-hadoop2.jar: not found: https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.10.2/avro-mapred-1.10.2-hadoop2.jar
[error] (ssExtractDependencies) lmcoursier.internal.shaded.coursier.error.FetchError$DownloadingArtifacts: Error fetching artifacts:
[error] https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.10.2**/avro-mapred-1.10.2-hadoop2.ja**r: not found: https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.10.2/**avro-mapred-1.10.2-hadoop2.jar**
[error] Total time: 4 s, completed Dec 10, 2022, 9:37:14 AM
The text was updated successfully, but these errors were encountered: