Skip to content

Commit

Permalink
azure-cosmos release 4.53.1, spark 4.24.1 (#37944)
Browse files Browse the repository at this point in the history 
Co-authored-by: annie-mac <xinlian@microsoft.com>
  • Loading branch information
@xinlian12
xinlian12 and annie-mac committed Dec 6, 2023
1 parent 41243ba commit 0ab6b40
Show file tree
Hide file tree
Showing 24 changed files with 51 additions and 63 deletions.
10 changes: 5 additions & 5 deletions eng/versioning/version_client.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -98,14 +98,14 @@ com.azure:azure-core-test;1.22.1;1.23.0-beta.1
com.azure:azure-core-tracing-opentelemetry;1.0.0-beta.42;1.0.0-beta.43
com.azure:azure-core-tracing-opentelemetry-samples;1.0.0-beta.1;1.0.0-beta.1
com.azure:azure-core-version-tests;1.0.0-beta.1;1.0.0-beta.1
com.azure:azure-cosmos;4.53.0;4.54.0-beta.1
com.azure:azure-cosmos;4.53.0;4.53.1
com.azure:azure-cosmos-benchmark;4.0.1-beta.1;4.0.1-beta.1
com.azure:azure-cosmos-dotnet-benchmark;4.0.1-beta.1;4.0.1-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3_2-12;1.0.0-beta.1;1.0.0-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.24.0;4.25.0-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;4.24.0;4.25.0-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;4.24.0;4.25.0-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;4.24.0;4.25.0-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.24.0;4.24.1
com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;4.24.0;4.24.1
com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;4.24.0;4.24.1
com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;4.24.0;4.24.1
com.azure:azure-cosmos-encryption;2.7.0;2.8.0-beta.1
com.azure:azure-cosmos-test;1.0.0-beta.6;1.0.0-beta.7
com.azure:azure-cosmos-tests;1.0.0-beta.1;1.0.0-beta.1
Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-benchmark/pom.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -51,7 +51,7 @@ Licensed under the MIT License.
<dependency>
<groupId>com.azure</groupId>
<artifactId>azure-cosmos</artifactId>
<version>4.54.0-beta.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
<version>4.53.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
</dependency>

<dependency>
Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-dotnet-benchmark/pom.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ Licensed under the MIT License.
<dependency>
<groupId>com.azure</groupId>
<artifactId>azure-cosmos</artifactId>
<version>4.54.0-beta.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
<version>4.53.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
</dependency>

<dependency>
Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-encryption/pom.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ Licensed under the MIT License.
<dependency>
<groupId>com.azure</groupId>
<artifactId>azure-cosmos</artifactId>
<version>4.54.0-beta.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
<version>4.53.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
</dependency>

<dependency>
Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-kafka-connect/pom.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ Licensed under the MIT License.
<dependency>
<groupId>com.azure</groupId>
<artifactId>azure-cosmos</artifactId>
<version>4.54.0-beta.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
<version>4.53.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
</dependency>

<!-- Added this provided dependency to include necessary annotations used by "reactor-core".
Expand Down
8 changes: 1 addition & 7 deletions sdk/cosmos/azure-cosmos-spark_3-1_2-12/CHANGELOG.md
View file
Original file line number Diff line number Diff line change
@@ -1,16 +1,10 @@
## Release History

### 4.25.0-beta.1 (Unreleased)

#### Features Added

#### Breaking Changes
### 4.24.1 (2023-12-06)

#### Bugs Fixed
* Fixed `SecurityException` with message `java.lang.SecurityException: class "org.apache.spark.SparkInternalsBridge$"'s signer information does not match signer information of other classes in the same package` when deploying the Spark connector in Databricks by copying it directly to `/databricks/jars` instead of going through the usual deployment APIs or UI-deployment. To fix this issue, instead of using a `bridge-approach` reflection is used to use the internal API necessary to publish custom metrics. See [PR 37934](https://github.com/Azure/azure-sdk-for-java/pull/37934)

#### Other Changes

### 4.24.0 (2023-12-01)

#### Features Added
Expand Down
8 changes: 6 additions & 2 deletions sdk/cosmos/azure-cosmos-spark_3-1_2-12/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-1_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|--------------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.24.1 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.\*, 9.\* |
| 4.24.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.\*, 9.\* |
| 4.23.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.\*, 9.\* |
| 4.22.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.\*, 9.\* |
Expand Down Expand Up @@ -80,6 +81,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-2_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.24.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.24.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.23.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.22.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
Expand Down Expand Up @@ -116,6 +118,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-3_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.24.1 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.24.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.23.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.22.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
Expand All @@ -134,6 +137,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-4_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.24.1 | 3.4.0 | 8 | 2.12 | 13.\* |
| 4.24.0 | 3.4.0 | 8 | 2.12 | 13.\* |
| 4.23.0 | 3.4.0 | 8 | 2.12 | 13.\* |
| 4.22.0 | 3.4.0 | 8 | 2.12 | 13.\* |
Expand All @@ -143,11 +147,11 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
### Download

You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 8 from Maven:
`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.24.0`
`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.24.1`

You can also integrate against Cosmos DB Spark Connector in your SBT project:
```scala
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.24.0"
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.24.1"
```

Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).
Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-spark_3-1_2-12/pom.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
</parent>
<groupId>com.azure.cosmos.spark</groupId>
<artifactId>azure-cosmos-spark_3-1_2-12</artifactId>
<version>4.25.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
<version>4.24.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
<packaging>jar</packaging>
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-1_2-12</url>
<name>OLTP Spark 3.1 Connector for Azure Cosmos DB SQL API</name>
Expand Down
8 changes: 1 addition & 7 deletions sdk/cosmos/azure-cosmos-spark_3-2_2-12/CHANGELOG.md
View file
Original file line number Diff line number Diff line change
@@ -1,16 +1,10 @@
## Release History

### 4.25.0-beta.1 (Unreleased)

#### Features Added

#### Breaking Changes
### 4.24.1 (2023-12-06)

#### Bugs Fixed
* Fixed `SecurityException` with message `java.lang.SecurityException: class "org.apache.spark.SparkInternalsBridge$"'s signer information does not match signer information of other classes in the same package` when deploying the Spark connector in Databricks by copying it directly to `/databricks/jars` instead of going through the usual deployment APIs or UI-deployment. To fix this issue, instead of using a `bridge-approach` reflection is used to use the internal API necessary to publish custom metrics. See [PR 37934](https://github.com/Azure/azure-sdk-for-java/pull/37934)

#### Other Changes

### 4.24.0 (2023-12-01)

#### Features Added
Expand Down
8 changes: 6 additions & 2 deletions sdk/cosmos/azure-cosmos-spark_3-2_2-12/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-2_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.24.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.24.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.23.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.22.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
Expand Down Expand Up @@ -64,6 +65,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-3_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.24.1 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.24.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.23.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.22.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
Expand All @@ -82,6 +84,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-1_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|--------------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.24.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 8.\*, 9.\* |
| 4.24.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 8.\*, 9.\* |
| 4.23.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 8.\*, 9.\* |
| 4.22.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 8.\*, 9.\* |
Expand Down Expand Up @@ -133,6 +136,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-4_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.24.1 | 3.4.0 | 8 | 2.12 | 13.* |
| 4.24.0 | 3.4.0 | 8 | 2.12 | 13.* |
| 4.23.0 | 3.4.0 | 8 | 2.12 | 13.* |
| 4.22.0 | 3.4.0 | 8 | 2.12 | 13.* |
Expand All @@ -142,11 +146,11 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
### Download

You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 10 from Maven:
`com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12:4.24.0`
`com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12:4.24.1`

You can also integrate against Cosmos DB Spark Connector in your SBT project:
```scala
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-2_2-12" % "4.24.0"
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-2_2-12" % "4.24.1"
```

Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).
Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-spark_3-2_2-12/pom.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
</parent>
<groupId>com.azure.cosmos.spark</groupId>
<artifactId>azure-cosmos-spark_3-2_2-12</artifactId>
<version>4.25.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;current} -->
<version>4.24.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;current} -->
<packaging>jar</packaging>
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-2_2-12</url>
<name>OLTP Spark 3.2 Connector for Azure Cosmos DB SQL API</name>
Expand Down
8 changes: 1 addition & 7 deletions sdk/cosmos/azure-cosmos-spark_3-3_2-12/CHANGELOG.md
View file
Original file line number Diff line number Diff line change
@@ -1,16 +1,10 @@
## Release History

### 4.25.0-beta.1 (Unreleased)

#### Features Added

#### Breaking Changes
### 4.24.1 (2023-12-06)

#### Bugs Fixed
* Fixed `SecurityException` with message `java.lang.SecurityException: class "org.apache.spark.SparkInternalsBridge$"'s signer information does not match signer information of other classes in the same package` when deploying the Spark connector in Databricks by copying it directly to `/databricks/jars` instead of going through the usual deployment APIs or UI-deployment. To fix this issue, instead of using a `bridge-approach` reflection is used to use the internal API necessary to publish custom metrics. See [PR 37934](https://github.com/Azure/azure-sdk-for-java/pull/37934)

#### Other Changes

### 4.24.0 (2023-12-01)

#### Features Added
Expand Down
8 changes: 6 additions & 2 deletions sdk/cosmos/azure-cosmos-spark_3-3_2-12/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-3_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.24.1 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.24.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.23.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.22.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
Expand All @@ -46,6 +47,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-2_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.24.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.24.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.23.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.22.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
Expand Down Expand Up @@ -82,6 +84,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-1_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|--------------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.24.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.24.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.23.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.22.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
Expand Down Expand Up @@ -133,6 +136,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-4_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.24.1 | 3.4.0 | 8 | 2.12 | 13.* |
| 4.24.0 | 3.4.0 | 8 | 2.12 | 13.* |
| 4.23.0 | 3.4.0 | 8 | 2.12 | 13.* |
| 4.22.0 | 3.4.0 | 8 | 2.12 | 13.* |
Expand All @@ -142,11 +146,11 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
### Download

You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 11 from Maven:
`com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.24.0`
`com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.24.1`

You can also integrate against Cosmos DB Spark Connector in your SBT project:
```scala
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-3_2-12" % "4.24.0"
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-3_2-12" % "4.24.1"
```

Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).
Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-spark_3-3_2-12/pom.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
</parent>
<groupId>com.azure.cosmos.spark</groupId>
<artifactId>azure-cosmos-spark_3-3_2-12</artifactId>
<version>4.25.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;current} -->
<version>4.24.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;current} -->
<packaging>jar</packaging>
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-3_2-12</url>
<name>OLTP Spark 3.3 Connector for Azure Cosmos DB SQL API</name>
Expand Down
8 changes: 1 addition & 7 deletions sdk/cosmos/azure-cosmos-spark_3-4_2-12/CHANGELOG.md
View file
Original file line number Diff line number Diff line change
@@ -1,16 +1,10 @@
## Release History

### 4.25.0-beta.1 (Unreleased)

#### Features Added

#### Breaking Changes
### 4.24.1 (2023-12-06)

#### Bugs Fixed
* Fixed `SecurityException` with message `java.lang.SecurityException: class "org.apache.spark.SparkInternalsBridge$"'s signer information does not match signer information of other classes in the same package` when deploying the Spark connector in Databricks by copying it directly to `/databricks/jars` instead of going through the usual deployment APIs or UI-deployment. To fix this issue, instead of using a `bridge-approach` reflection is used to use the internal API necessary to publish custom metrics. See [PR 37934](https://github.com/Azure/azure-sdk-for-java/pull/37934)

#### Other Changes

### 4.24.0 (2023-12-01)

#### Features Added
Expand Down
Loading

0 comments on commit 0ab6b40

Please sign in to comment.