Releases: ClickHouse/spark-clickhouse-connector
Releases · ClickHouse/spark-clickhouse-connector
v0.3.0
Notable Changes
- Support Spark 3.3 (#105)
- Add conf spark.clickhouse.write.repartitionByPartition
- Add conf spark.clickhouse.write.localSortByPartition
- Add conf spark.clickhouse.write.localSortByKey
- Support use gzip on writing
- Always retry to write same instance
- Remove SupportsTruncate
- Simplify configuration
- Initial support LowCardinality
- Bump Jackson 2.13.3
- Core: Fix retry method
- Core: gRPC client exposes inputCompressionType option
- Spark 3.3: Implement SupportsPushDownLimit (#112)
- Spark 3.3: Enable tests which were failed because of SPARK-39313
- Spark 3.3: Hack version for partition toYYYYMMDD(toDate(col))
- Spark 3.3: Add conf spark.clickhouse.write.repartitionStrictly
- Performance: Avoid creating JacksonGenerator when writing each row
- Playground: Support for using buildx to build cross-platform images (#128)
- Playground: Add missing container_name for Zookeeper
- Playground: Change ClickHouse catalog name
- Playground: Upgrade Spark 3.3.0 (#134)
- Playground: Remove iceberg
- Playground: Add CloudBeaver (#115)
- Playground: Fix ARG PROJECT_VERSION
- Playground: Fix KYUUBI_CONF_DIR
- Playground: Add TPCHCatalog
- Logs: Refine node information
- Logs: Add clickhouse node info when error ocurrs (#129)
- Logs: Print compression cost time
- Docs: Update README for ARM platform users
- Docs: Update README for testing w/ different Spark Scala versions
- Test: Support overwrite ClickHouse image by CLICKHOUSE_IMAGE (#132)
- Test: Testing TPC-DS tiny scale (#121)
- Test: Move test to package org.apache.spark.sql.clickhouse
- Docs: Update document adding Developers sections
- Docs: Hide navigation in home page
- Git: Ignore patch files
- Minor: Remove unused try
v0.2.1
- Playground: Upgrade kyuubi-spark-connector-tpcds
- Playground: Add missing container_name for Zookeeper
- Clean up code for Spark 3.2
v0.2.0
Notable Changes
- Provide docker-compose-based playground
- Support create Distributed table (#101)
- Support create database on cluster (#102)
- Support write Decimal type (#103)
- Update ClickHouseErrCode
- gRPC: Add comments for protocol changes
- gRPC: Follow up upstream upgrade gRPC IDL (#88)
- Build: Enhance the auto-publish workflow
- Test: Upgrade testcntainers_scala_version to 0.40.7 to support docker compose v2 (#99)
- Test: Upgrade ClickHouse 22.3.3.44 (#85)
- Test: Upgrade clickhouse-jdbc 0.3.2-patch8 (#90)
- Test: Disable Spark codegen in test
- Test: Add TPC-DS 1GB test (#104)
v0.1.2
v0.1.1
v0.1.0
It's the first public release, which compatible with Spark 3.2 and Scala 2.12&2.13.