Skip to content

Commit

Permalink
Replace the HIVE SQL OpenX SerDe with LazySimpleSerDe
Browse files Browse the repository at this point in the history
It is accepted by Glue, Athena and Spark/Databricks by default
without needing an extra JAR.
  • Loading branch information
laurikoobas committed May 16, 2020
1 parent 6fb4dec commit 8e0451d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion rosbag/rosbag_msg2hive.go
Original file line number Diff line number Diff line change
Expand Up @@ -128,7 +128,7 @@ create external table if not exists bag.{{.bt}}{{.tablename}}{{.bt}} (
sqlSuffixTemplateString := ` >
)
partitioned by (dt string)
row format serde 'org.openx.data.jsonserde.JsonSerDe'
row format serde 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe'
with serdeproperties (
'serialization.format' = '1' ) location '{{.tablename}}/' tblproperties ('has_encrypted_data'='false')
;
Expand Down

0 comments on commit 8e0451d

Please sign in to comment.