Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Support nanosecond timestamps in parquet (NVIDIA#10063)
Closes rapidsai/cudf#9393 This PR was intended to support nanoseconds for both duration and timestamp types in parquet. It introduces `LogicalType`-handling on both reader and writer sides. This PR also includes code cleanups like moving `CompactProtocolReader` to its own file. Finally, nanosecond durations remain unchanged since it's not fully supported by `pyarrow` i.e. nanosecond durations are truncated to microseconds (see [here](https://github.com/apache/arrow/blob/release-7.0.0/cpp/src/arrow/python/datetime.cc#L259-L264)). Authors: - Yunsong Wang (https://github.com/PointKernel) Approvers: - Robert Maynard (https://github.com/robertmaynard) - Vukasin Milovanovic (https://github.com/vuule) - Devavret Makkar (https://github.com/devavret) - Karthikeyan (https://github.com/karthikeyann) URL: rapidsai/cudf#10063
- Loading branch information