Skip to content

Commit

Permalink
release version 3.0.1 (#530)
Browse files Browse the repository at this point in the history
Co-authored-by: zhangli20 <zhangli20@kuaishou.com>
  • Loading branch information
richox and zhangli20 authored Jul 23, 2024
1 parent 343ad84 commit 6f27604
Show file tree
Hide file tree
Showing 5 changed files with 14 additions and 14 deletions.
2 changes: 1 addition & 1 deletion .github/workflows/build-ce7-releases.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ jobs:
strategy:
matrix:
sparkver: [spark303, spark324, spark333]
blazever: [3.0.0]
blazever: [3.0.1]

steps:
- uses: actions/checkout@v4
Expand Down
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -72,7 +72,7 @@ _You could either build Blaze in dev mode for debugging or in release mode to un
Blaze._

```shell
SHIM=spark333 # or spark303
SHIM=spark333 # or spark303/spark324
MODE=release # or pre
mvn package -P"${SHIM}" -P"${MODE}"
```
Expand Down
13 changes: 4 additions & 9 deletions RELEASES.md
Original file line number Diff line number Diff line change
@@ -1,15 +1,10 @@
# blaze-v3.0.0
# blaze-v3.0.1

## Features
* Supports using spark.io.compression.codec for shuffle/broadcast compression
* Supports date type casting
* Refactor join implementations to support existence joins and BHJ building hash map on driver side
* Supports spark3.0/3.2/3.3.

## Performance
* Fixed performance issues when running on spark3 with default configurations
* Use cached parquet metadata
* Refactor native broadcast to avoid duplicated broadcast jobs
* Supports spark333 batch shuffle reading
fix GetJsonObject conversion, supporting faster get_json_object with sonic-rs.

## Bugfix
* Fix in_list conversion in from_proto.rs
* fix childOrderingRequiredTag computation logic.
9 changes: 7 additions & 2 deletions dev/docker-build/centos7/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,10 +1,15 @@
FROM centos:7

# install common tools
RUN sed -i 's/mirrorlist/#mirrorlist/g' /etc/yum.repos.d/CentOS-*
RUN sed -i 's|#baseurl=http://mirror.centos.org|baseurl=http://vault.centos.org|g' /etc/yum.repos.d/CentOS-*
RUN echo "sslverify=false" >> /etc/yum.conf
RUN sed -i "s/mirror.centos.org/vault.centos.org/g" /etc/yum.repos.d/*.repo
RUN sed -i "s/^#.*baseurl=http/baseurl=https/g" /etc/yum.repos.d/*.repo
RUN sed -i "s/^mirrorlist/#mirrorlist/g" /etc/yum.repos.d/*.repo
RUN yum update -y
RUN yum install -y centos-release-scl epel-release
RUN sed -i "s/mirror.centos.org/vault.centos.org/g" /etc/yum.repos.d/*.repo
RUN sed -i "s/^#.*baseurl=http/baseurl=https/g" /etc/yum.repos.d/*.repo
RUN sed -i "s/^mirrorlist/#mirrorlist/g" /etc/yum.repos.d/*.repo
RUN yum install -y libzip unzip wget cmake3 openssl-devel

# install gcc-11
Expand Down
2 changes: 1 addition & 1 deletion pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@
</modules>

<properties>
<revision>3.0.0-SNAPSHOT</revision>
<revision>3.0.1-SNAPSHOT</revision>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<arrowVersion>15.0.2</arrowVersion>
<protobufVersion>3.21.9</protobufVersion>
Expand Down

0 comments on commit 6f27604

Please sign in to comment.