-
Notifications
You must be signed in to change notification settings - Fork 11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Export Exasol Table into AWS S3 as Parquet format #16
Commits on Jan 22, 2019
-
Configuration menu - View commit details
-
Copy full SHA for a369225 - Browse repository at this point
Copy the full SHA a369225View commit details
Commits on Jan 23, 2019
-
Start Exasol table to S3 export as parquet format
This commit only adds the ExportPath class.
Configuration menu - View commit details
-
Copy full SHA for 1d777fe - Browse repository at this point
Copy the full SHA 1d777feView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7fab7da - Browse repository at this point
Copy the full SHA 7fab7daView commit details
Commits on Jan 25, 2019
-
Configuration menu - View commit details
-
Copy full SHA for c6b2907 - Browse repository at this point
Copy the full SHA c6b2907View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6faa6c2 - Browse repository at this point
Copy the full SHA 6faa6c2View commit details
Commits on Jan 29, 2019
-
Configuration menu - View commit details
-
Copy full SHA for c268f63 - Browse repository at this point
Copy the full SHA c268f63View commit details -
Configuration menu - View commit details
-
Copy full SHA for a81db06 - Browse repository at this point
Copy the full SHA a81db06View commit details
Commits on Jan 30, 2019
-
Configuration menu - View commit details
-
Copy full SHA for 53dff6b - Browse repository at this point
Copy the full SHA 53dff6bView commit details -
Configuration menu - View commit details
-
Copy full SHA for a5ded42 - Browse repository at this point
Copy the full SHA a5ded42View commit details
Commits on Feb 1, 2019
-
Configuration menu - View commit details
-
Copy full SHA for 81b119b - Browse repository at this point
Copy the full SHA 81b119bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 661e6f6 - Browse repository at this point
Copy the full SHA 661e6f6View commit details -
Add initial export functionality
- Adds ParquetWriter - Adds RowWriteSupport However, there are still some more changes needed: - Decide on decimal to int32 or int64 based on precision - Improve the import functionality with date and timestamps
Configuration menu - View commit details
-
Copy full SHA for 3932d77 - Browse repository at this point
Copy the full SHA 3932d77View commit details
Commits on Feb 4, 2019
-
Configuration menu - View commit details
-
Copy full SHA for e9e1dd8 - Browse repository at this point
Copy the full SHA e9e1dd8View commit details -
Configuration menu - View commit details
-
Copy full SHA for b32e100 - Browse repository at this point
Copy the full SHA b32e100View commit details
Commits on Feb 5, 2019
-
Configuration menu - View commit details
-
Copy full SHA for 9f1d1f5 - Browse repository at this point
Copy the full SHA 9f1d1f5View commit details
Commits on Feb 8, 2019
-
Configuration menu - View commit details
-
Copy full SHA for e572bad - Browse repository at this point
Copy the full SHA e572badView commit details -
Configuration menu - View commit details
-
Copy full SHA for c6013c2 - Browse repository at this point
Copy the full SHA c6013c2View commit details
Commits on Feb 11, 2019
-
Do not separate decimal values into int32 or int64 values
This does not make sense in this case, because both when reading or writing exasol will provide correct Java type, e.g, BigDecimal if decimal with precision and scale and regular Integer or Long if int32 or int64.
Configuration menu - View commit details
-
Copy full SHA for a8daf06 - Browse repository at this point
Copy the full SHA a8daf06View commit details -
ExaIterator cannot emit Scala
math.BigDecimal
. Change it into `java…….math.BigDecimal`.
Configuration menu - View commit details
-
Copy full SHA for 9540696 - Browse repository at this point
Copy the full SHA 9540696View commit details -
Add fs.LocalFileSystem into configuration
S3AFileSystem somehow requires local temp directory, before uploading to S3. This currently only tested for AWS S3. I will update this for GCP or Azure if they require this filesystem when performing tests for those platforms.
Configuration menu - View commit details
-
Copy full SHA for 7466de1 - Browse repository at this point
Copy the full SHA 7466de1View commit details -
Fix bug when converting date into days (since epoch) and back
An example date was: `0001-01-01`, or in general days before 1970. After writing this `0001-01-01` as a days since epoch and when reading back I was getting `0001-12-31`. The solution was to incorporate the timezone offset millis and take the *floor* of the millis per day.
Configuration menu - View commit details
-
Copy full SHA for 5023000 - Browse repository at this point
Copy the full SHA 5023000View commit details