You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
allowUnquotedControlChars: Allows JSON Strings to contain unquoted control characters (ASCII characters with value less than 32, including tab and line feed characters) or not.
This is off by default with Spark, but on by default with CUDF, so we need to have a way to fix this or we will not return nulls when we should.
The text was updated successfully, but these errors were encountered:
allowUnquotedControlChars is what CUDF supports by default already. We need a way to disable it because that is what Spark has by default.
revans2
changed the title
[FEA]JSON reader: support unquoted field name and control chars
[FEA] Support allowUnquotedControlChars for JsonToStructs and ScanJson
Mar 13, 2024
From the Spark JSON option,
allowUnquotedControlChars
: Allows JSON Strings to contain unquoted control characters (ASCII characters with value less than 32, including tab and line feed characters) or not.This is off by default with Spark, but on by default with CUDF, so we need to have a way to fix this or we will not return nulls when we should.
The text was updated successfully, but these errors were encountered: