Feature / CSV null handling (#168)

* Support nulls in lenient CSV parser (doesn't work for strings) * Move CSV codec into a separate module * Update test for parsing empty strings with lenient CSV parser
finos · Sep 9, 2022 · 9183d63 · 9183d63
1 parent 00b9e71
commit 9183d63
Show file tree

Hide file tree

Showing 5 changed files with 448 additions and 372 deletions.
diff --git a/tracdap-libs/tracdap-lib-test/src/main/resources/sample_data/csv_nulls.csv b/tracdap-libs/tracdap-lib-test/src/main/resources/sample_data/csv_nulls.csv
@@ -0,0 +1,8 @@
+boolean_field,  integer_field,  float_field,  decimal_field,  string_field,   date_field,   datetime_field
+,               0,              0.0,          0.00,           Hello world 0,  1970-01-01,   1970-01-01T00:00:00
+false,          ,               1.0,          1.00,           Hello world 1,  1970-01-02,   1970-01-01T00:00:01
+true,           2,              ,             2.00,           Hello world 2,  1970-01-03,   1970-01-01T00:00:02
+false,          3,              3.0,          ,               Hello world 3,  1970-01-04,   1970-01-01T00:00:03
+true,           4,              4.0,          4.00,           ,               1970-01-05,   1970-01-01T00:00:04
+false,          5,              5.0,          5.00,           Hello world 5,  ,             1970-01-01T00:00:05
+true,           6,              6.0,          6.00,           Hello world 6,  1970-01-07,