From 66ab715a6bef2d88edc33f146a6c7a504cc7c388 Mon Sep 17 00:00:00 2001 From: yangjie01 Date: Mon, 20 Feb 2023 08:17:13 -0600 Subject: [PATCH] [SPARK-42490][BUILD] Upgrade protobuf-java from 3.21.12 to 3.22.0 ### What changes were proposed in this pull request? This pr aims upgrade `protobuf-java` from 3.21.12 to 3.22.0 ### Why are the changes needed? The new version bring some improvements like: - Use bit-field int values in buildPartial to skip work on unset groups of fields. (https://github.com/protocolbuffers/protobuf/commit/2326aef1a454a4eea363cc6ed8b8def8b88365f5) - Fix serialization warnings in generated code when compiling with Java 18 and above (https://github.com/protocolbuffers/protobuf/pull/10561) - Enable Text format parser to skip unknown short-formed repeated fields. (https://github.com/protocolbuffers/protobuf/commit/6dbd4131fa6b2ad29b2b1b827f21fc61b160aeeb) - Add serialVersionUID to ByteString and subclasses (https://github.com/protocolbuffers/protobuf/pull/10718) and some bug fix like: - Mark default instance as immutable first to avoid race during static initialization of default instances. (https://github.com/protocolbuffers/protobuf/pull/10770) - Fix Timestamps fromDate for negative 'exact second' java.sql.Timestamps (https://github.com/protocolbuffers/protobuf/pull/10321) - Fix Timestamps.fromDate to correctly handle java.sql.Timestamps before unix epoch (https://github.com/protocolbuffers/protobuf/pull/10126) - Fix bug in nested builder caching logic where cleared sub-field builders would remain dirty after a clear and build in a parent layer. https://github.com/protocolbuffers/protobuf/issues/10624 The release notes as follows: - https://github.com/protocolbuffers/protobuf/releases/tag/v22.0 ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Pass GitHub Actions Closes #40084 from LuciferYang/SPARK-42490. Authored-by: yangjie01 Signed-off-by: Sean Owen --- pom.xml | 2 +- project/SparkBuild.scala | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/pom.xml b/pom.xml index 7a81101d2d493..ae65be7d3e33b 100644 --- a/pom.xml +++ b/pom.xml @@ -124,7 +124,7 @@ 2.5.0 - 3.21.12 + 3.22.0 3.11.4 ${hadoop.version} 3.6.3 diff --git a/project/SparkBuild.scala b/project/SparkBuild.scala index 4b077f593fe48..2c3907bc734d6 100644 --- a/project/SparkBuild.scala +++ b/project/SparkBuild.scala @@ -88,7 +88,7 @@ object BuildCommons { // Google Protobuf version used for generating the protobuf. // SPARK-41247: needs to be consistent with `protobuf.version` in `pom.xml`. - val protoVersion = "3.21.12" + val protoVersion = "3.22.0" // GRPC version used for Spark Connect. val gprcVersion = "1.47.0" }