[IOTDB-91] Improve tsfile-spark-connector to support spark 2.4.3

[samperson1997]

Improve tsfile-spark-connector to support spark 2.4.3 as is mentioned in issue IOTDB-91.

Spark has decoupled internal Row from external Row, which influences TsFileWriterFactory (extends OutputWriterFactory) and TsFileOutputWriter (extends OutputWriter). Therefore, function toTsRecord has to change param type from Row to InternalRow.

[LeiRui]

The commands I used in the spark-shell:

import org.apache.iotdb.tsfile._
val df = spark.read.tsfile("testDirect.tsfile") 
df.show
df.write.tsfile("output")

[samperson1997]

The commands I used in the spark-shell:

import org.apache.iotdb.tsfile._
val df = spark.read.tsfile("testDirect.tsfile") 
df.show
df.write.tsfile("output")

Hi,

I have tried the same file created by TsFileWrite.java, and the commands of reading and writing all passed. I thought the failure may be caused by inconsistent spark version: the spark version should be updated to 2.3 / 2.4, and the tsfile-spark-connector-0.8.0-SNAPSHOT.jar needs to be built again with the accordingly spark version in pom.xml.

[LeiRui]

The commands I used in the spark-shell:

import org.apache.iotdb.tsfile._
val df = spark.read.tsfile("testDirect.tsfile") 
df.show
df.write.tsfile("output")

Hi,

I have tried the same file created by TsFileWrite.java, and the commands of reading and writing all passed. I thought the failure may be caused by inconsistent spark version: the spark version should be updated to 2.3 / 2.4, and the tsfile-spark-connector-0.8.0-SNAPSHOT.jar needs to be built again with the accordingly spark version in pom.xml.

Tests pass successfully.