Skip to content

Commit

Permalink
cosmos spark 4.3.1 release (Azure#24090)
Browse files Browse the repository at this point in the history
* cosmos spark 4.3.1 release

* Clarifying DBX runtime support explicitly

* Update README.md
  • Loading branch information
FabianMeiswinkel authored Sep 13, 2021
1 parent d9cdd99 commit de01351
Show file tree
Hide file tree
Showing 4 changed files with 18 additions and 15 deletions.
2 changes: 1 addition & 1 deletion eng/versioning/version_client.txt
Original file line number Diff line number Diff line change
Expand Up @@ -77,7 +77,7 @@ com.azure:azure-core-tracing-opentelemetry;1.0.0-beta.14;1.0.0-beta.15
com.azure:azure-cosmos;4.19.0;4.20.0-beta.1
com.azure:azure-cosmos-benchmark;4.0.1-beta.1;4.0.1-beta.1
com.azure:azure-cosmos-dotnet-benchmark;4.0.1-beta.1;4.0.1-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.4.0-beta.1;4.4.0-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.3.1;4.3.1
com.azure:azure-cosmos-encryption;1.0.0-beta.8;1.0.0-beta.9
com.azure:azure-data-appconfiguration;1.2.2;1.3.0-beta.1
com.azure:azure-data-appconfiguration-perf;1.0.0-beta.1;1.0.0-beta.1
Expand Down
6 changes: 4 additions & 2 deletions sdk/cosmos/azure-cosmos-spark_3-1_2-12/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,9 @@
## Release History

## 4.4.0-beta.1 (Unreleased)

### 4.3.1 (2021-09-13)
#### Key Bug Fixes
* Fixed issue resulting in option `spark.cosmos.read.maxItemCount` not always being honored
* Fixed issue resulting in dropping some events when using Spark Streaming when config option `spark.cosmos.changeFeed.itemCountPerTriggerHint` is configured.

### 4.3.0 (2021-08-11)
#### Configuration Changes
Expand Down
23 changes: 12 additions & 11 deletions sdk/cosmos/azure-cosmos-spark_3-1_2-12/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,24 +28,25 @@ https://github.com/Azure/azure-sdk-for-java/issues/new

## Version Compatibility

| Connector | Minimum Spark Version | Minimum Java Version | Supported Scala Versions |
| ------------- | --------------------- | -------------------- | ----------------------- |
| 4.3.0 | 3.1.1 | 8 | 2.12 |
| 4.2.0 | 3.1.1 | 8 | 2.12 |
| 4.1.0 | 3.1.1 | 8 | 2.12 |
| 4.0.0 | 3.1.1 | 8 | 2.12 |
| 4.0.0-beta.3 | 3.1.1 | 8 | 2.12 |
| 4.0.0-beta.2 | 3.1.1 | 8 | 2.12 |
| 4.0.0-beta.1 | 3.1.1 | 8 | 2.12 |
| Connector | Minimum Spark Version | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
| ------------- | --------------------- | -------------------- | ----------------------- | ----------------------------- |
| 4.3.1 | 3.1.1 | 8 | 2.12 | 8.\*, 9.\* |
| 4.3.0 | 3.1.1 | 8 | 2.12 | 8.\*, 9.\* |
| 4.2.0 | 3.1.1 | 8 | 2.12 | 8.\* |
| 4.1.0 | 3.1.1 | 8 | 2.12 | 8.\* |
| 4.0.0 | 3.1.1 | 8 | 2.12 | 8.\* |
| 4.0.0-beta.3 | 3.1.1 | 8 | 2.12 | 8.\* |
| 4.0.0-beta.2 | 3.1.1 | 8 | 2.12 | 8.\* |
| 4.0.0-beta.1 | 3.1.1 | 8 | 2.12 | 8.\* |

## Download

You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 8 from Maven:
`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.3.0`
`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.3.1`

You can also integrate against Cosmos DB Spark Connector in your SBT project:
```scala
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.3.0"
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.3.1"
```

Cosmos DB Spark Connector is available on [Maven Central Repo](https://search.maven.org/search?q=g:com.azure.cosmos.spark).
Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-spark_3-1_2-12/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@

<groupId>com.azure.cosmos.spark</groupId>
<artifactId>azure-cosmos-spark_3-1_2-12</artifactId>
<version>4.4.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
<version>4.3.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
<packaging>jar</packaging>
<name>OLTP Spark Connector for Azure Cosmos DB SQL API</name>
<description>OLTP Spark Connector for Azure Cosmos DB SQL API</description>
Expand Down

0 comments on commit de01351

Please sign in to comment.