Skip to content

Releases: ClickHouse/spark-clickhouse-connector

v0.3.0

18 Jun 16:37
0b14ab8
Compare
Choose a tag to compare

Notable Changes

  • Support Spark 3.3 (#105)
  • Add conf spark.clickhouse.write.repartitionByPartition
  • Add conf spark.clickhouse.write.localSortByPartition
  • Add conf spark.clickhouse.write.localSortByKey
  • Support use gzip on writing
  • Always retry to write same instance
  • Remove SupportsTruncate
  • Simplify configuration
  • Initial support LowCardinality
  • Bump Jackson 2.13.3
  • Core: Fix retry method
  • Core: gRPC client exposes inputCompressionType option
  • Spark 3.3: Implement SupportsPushDownLimit (#112)
  • Spark 3.3: Enable tests which were failed because of SPARK-39313
  • Spark 3.3: Hack version for partition toYYYYMMDD(toDate(col))
  • Spark 3.3: Add conf spark.clickhouse.write.repartitionStrictly
  • Performance: Avoid creating JacksonGenerator when writing each row
  • Playground: Support for using buildx to build cross-platform images (#128)
  • Playground: Add missing container_name for Zookeeper
  • Playground: Change ClickHouse catalog name
  • Playground: Upgrade Spark 3.3.0 (#134)
  • Playground: Remove iceberg
  • Playground: Add CloudBeaver (#115)
  • Playground: Fix ARG PROJECT_VERSION
  • Playground: Fix KYUUBI_CONF_DIR
  • Playground: Add TPCHCatalog
  • Logs: Refine node information
  • Logs: Add clickhouse node info when error ocurrs (#129)
  • Logs: Print compression cost time
  • Docs: Update README for ARM platform users
  • Docs: Update README for testing w/ different Spark Scala versions
  • Test: Support overwrite ClickHouse image by CLICKHOUSE_IMAGE (#132)
  • Test: Testing TPC-DS tiny scale (#121)
  • Test: Move test to package org.apache.spark.sql.clickhouse
  • Docs: Update document adding Developers sections
  • Docs: Hide navigation in home page
  • Git: Ignore patch files
  • Minor: Remove unused try

v0.2.1

20 May 04:49
b924fe0
Compare
Choose a tag to compare
  • Playground: Upgrade kyuubi-spark-connector-tpcds
  • Playground: Add missing container_name for Zookeeper
  • Clean up code for Spark 3.2

v0.2.0

03 May 09:14
9afb24f
Compare
Choose a tag to compare

Notable Changes

  • Provide docker-compose-based playground
  • Support create Distributed table (#101)
  • Support create database on cluster (#102)
  • Support write Decimal type (#103)
  • Update ClickHouseErrCode
  • gRPC: Add comments for protocol changes
  • gRPC: Follow up upstream upgrade gRPC IDL (#88)
  • Build: Enhance the auto-publish workflow
  • Test: Upgrade testcntainers_scala_version to 0.40.7 to support docker compose v2 (#99)
  • Test: Upgrade ClickHouse 22.3.3.44 (#85)
  • Test: Upgrade clickhouse-jdbc 0.3.2-patch8 (#90)
  • Test: Disable Spark codegen in test
  • Test: Add TPC-DS 1GB test (#104)

v0.1.2

15 Apr 05:25
0180994
Compare
Choose a tag to compare

Support partitioned by Date Type (#82)

v0.1.1

12 Apr 19:51
d0f3dbb
Compare
Choose a tag to compare

Fix: Read Date type should return Int instead of Long (#79)

v0.1.0

11 Apr 16:44
9541697
Compare
Choose a tag to compare

It's the first public release, which compatible with Spark 3.2 and Scala 2.12&2.13.