Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

release version 3.0.1 #530

Merged
merged 1 commit into from
Jul 23, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/build-ce7-releases.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ jobs:
strategy:
matrix:
sparkver: [spark303, spark324, spark333]
blazever: [3.0.0]
blazever: [3.0.1]

steps:
- uses: actions/checkout@v4
Expand Down
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -72,7 +72,7 @@ _You could either build Blaze in dev mode for debugging or in release mode to un
Blaze._

```shell
SHIM=spark333 # or spark303
SHIM=spark333 # or spark303/spark324
MODE=release # or pre
mvn package -P"${SHIM}" -P"${MODE}"
```
Expand Down
13 changes: 4 additions & 9 deletions RELEASES.md
Original file line number Diff line number Diff line change
@@ -1,15 +1,10 @@
# blaze-v3.0.0
# blaze-v3.0.1

## Features
* Supports using spark.io.compression.codec for shuffle/broadcast compression
* Supports date type casting
* Refactor join implementations to support existence joins and BHJ building hash map on driver side
* Supports spark3.0/3.2/3.3.

## Performance
* Fixed performance issues when running on spark3 with default configurations
* Use cached parquet metadata
* Refactor native broadcast to avoid duplicated broadcast jobs
* Supports spark333 batch shuffle reading
fix GetJsonObject conversion, supporting faster get_json_object with sonic-rs.

## Bugfix
* Fix in_list conversion in from_proto.rs
* fix childOrderingRequiredTag computation logic.
9 changes: 7 additions & 2 deletions dev/docker-build/centos7/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,10 +1,15 @@
FROM centos:7

# install common tools
RUN sed -i 's/mirrorlist/#mirrorlist/g' /etc/yum.repos.d/CentOS-*
RUN sed -i 's|#baseurl=http://mirror.centos.org|baseurl=http://vault.centos.org|g' /etc/yum.repos.d/CentOS-*
RUN echo "sslverify=false" >> /etc/yum.conf
RUN sed -i "s/mirror.centos.org/vault.centos.org/g" /etc/yum.repos.d/*.repo
RUN sed -i "s/^#.*baseurl=http/baseurl=https/g" /etc/yum.repos.d/*.repo
RUN sed -i "s/^mirrorlist/#mirrorlist/g" /etc/yum.repos.d/*.repo
RUN yum update -y
RUN yum install -y centos-release-scl epel-release
RUN sed -i "s/mirror.centos.org/vault.centos.org/g" /etc/yum.repos.d/*.repo
RUN sed -i "s/^#.*baseurl=http/baseurl=https/g" /etc/yum.repos.d/*.repo
RUN sed -i "s/^mirrorlist/#mirrorlist/g" /etc/yum.repos.d/*.repo
RUN yum install -y libzip unzip wget cmake3 openssl-devel

# install gcc-11
Expand Down
2 changes: 1 addition & 1 deletion pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@
</modules>

<properties>
<revision>3.0.0-SNAPSHOT</revision>
<revision>3.0.1-SNAPSHOT</revision>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<arrowVersion>15.0.2</arrowVersion>
<protobufVersion>3.21.9</protobufVersion>
Expand Down
Loading