java.lang.NoSuchMethodError: org.apache.spark.sql.types.DecimalType$.Unlimited

[witwall]

spark-xml with spark 2.0 got the error,

Error in invokeJava(isStatic = TRUE, className, methodName, ...) : 
  java.lang.NoSuchMethodError: org.apache.spark.sql.types.DecimalType$.Unlimited()Lorg/apache/spark/sql/types/DecimalType;
    at com.databricks.spark.xml.util.InferSchema$.<init>(InferSchema.scala:50)
    at com.databricks.spark.xml.util.InferSchema$.<clinit>(InferSchema.scala)
    at com.databricks.spark.xml.XmlRelation$$anonfun$1.apply(XmlRelation.scala:46)
    at com.databricks.spark.xml.XmlRelation$$anonfun$1.apply(XmlRelation.scala:46)
    at scala.Option.getOrElse(Option.scala:121)
    at com.databricks.spark.xml.XmlRelation.<init>(XmlRelation.scala:45)
    at com.databricks.spark.xml.DefaultSource.createRelation(DefaultSource.scala:66)
    at com.databricks.spark.xml.DefaultSource.createRelation(DefaultSource.scala:44)
    at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:315)
    at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:149)
    at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:122)
    at org.apache.spark.sql.

[HyukjinKwon]

Thanks for reporting this. I should upgrade this. FYI, here is the related issue #137

I will submit a PR soon.

[HyukjinKwon]

Let me tag this as a duplicate so that I can manage the similar issues together. If you strongly feel this is not a duplicate, I will remove the tag! Thanks again!

[meangrape]

I have the same problem.

[HyukjinKwon]

I opened a PR hrre, #150 . I will merge some other PRs and release 0.4.0 as soon as this one is reviewed.

[nandakishore8031]

I faced the same issue too.

[HyukjinKwon]

I released 0.4.0 for Spark 2.x and 0.3.4 for Spark 1.x. So, this is resolved (manually tested). I am closing this. Please feel free to reopen if any of you faces this issue again. Thank all!

[ivaradagit]

Hello, i am using "spark-xml_2.11-0.4.1.jar" in python and i am still having the same issue. Can you please help!

[gbassan-br]

@ivaradagit use the 0.4.0 to avoid the error

[horizonfrost]

I am using spark-xml_2.10-0.2.0.jar but still facing the same issue

[valasatava]

I had this problem with 0.2.0. Switching to 0.4.0 solved it.

[jonjuscorpion666]

problem got resolved for me as well when switching to 0.4.0

[elghali]

same here with 0.4.0