You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This function takes a org.apache.spark.sql.catalyst.json.JSONOptions, and creates a new ai.rapids.cudf.JSONOptions based on the input JSON options with some default settings the plugin uses. Currently, there seem some default settings missing, such as withLines(true) as suggested in #11898 (comment). We should add all missing default options there. We also should consolidate creating the ai.rapids.cudf.JSONOptions across the whole code base.
The text was updated successfully, but these errors were encountered:
Note that #11898 introduces a new util function that returns a ai.rapids.cudf.JSONOptions.Builder with default options. We could add missing options in that function once the PR is merged. Also consider renaming the new function based on the discussion in #11898 (comment).
This function takes a
org.apache.spark.sql.catalyst.json.JSONOptions
, and creates a newai.rapids.cudf.JSONOptions
based on the input JSON options with some default settings the plugin uses. Currently, there seem some default settings missing, such aswithLines(true)
as suggested in #11898 (comment). We should add all missing default options there. We also should consolidate creating theai.rapids.cudf.JSONOptions
across the whole code base.The text was updated successfully, but these errors were encountered: