Skip to content

Commit

Permalink
Cosmos Spark connector GA Release (Azure#21612)
Browse files Browse the repository at this point in the history
* add some logs

* fix format

* change backofftime

* No ru tracking if response come back out of cycle

* fix compile

* fix tests

* fix tests

* remove unused import

* resolve comments

* Fixing a scenario where bulk operations fail with 410 on container split.

* Splits are taking longer somehow! So increasing the timeout for QueryValidationTests::splitQueryContinuationToken

* Splits are taking longer somehow! So increasing the timeout for readFeedDocumentsAfterSplit()

* Cosmos Spark Connector GA release

Co-authored-by: annie-mac <annie-mac@annie-macs-MacBook-Pro.local>
Co-authored-by: Bhaskar Mallapragada <bhaskar.mallapragada@microsoft.com>
  • Loading branch information
3 people authored May 17, 2021
1 parent 1ab1784 commit 10c03bf
Show file tree
Hide file tree
Showing 4 changed files with 12 additions and 6 deletions.
2 changes: 1 addition & 1 deletion eng/versioning/version_client.txt
Original file line number Diff line number Diff line change
Expand Up @@ -74,8 +74,8 @@ com.azure:azure-core-tracing-opentelemetry;1.0.0-beta.10;1.0.0-beta.11
com.azure:azure-cosmos;4.15.0;4.16.0-beta.1
com.azure:azure-cosmos-benchmark;4.0.1-beta.1;4.0.1-beta.1
com.azure:azure-cosmos-dotnet-benchmark;4.0.1-beta.1;4.0.1-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.0.0;4.0.0
com.azure:azure-cosmos-encryption;1.0.0-beta.4;1.0.0-beta.5
com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.0.0-beta.4;4.0.0-beta.4
com.azure:azure-data-appconfiguration;1.1.11;1.2.0-beta.2
com.azure:azure-data-appconfiguration-perf;1.0.0-beta.1;1.0.0-beta.1
com.azure:azure-data-confidentialledger;1.0.0-beta.1;1.0.0-beta.2
Expand Down
7 changes: 6 additions & 1 deletion sdk/cosmos/azure-cosmos-spark_3-1_2-12/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,9 +1,14 @@
## Release History

### 4.0.0-beta.4 (Unreleased)
### 4.0.0 (2021-05-14)
#### Configuration Renames
* Renamed data source name `cosmos.changeFeed` to `cosmos.oltp.changeFeed`, See [PR](https://github.com/Azure/azure-sdk-for-java/pull/21184).

#### Key Bug Fixes
* Fixed a bug in bulk write when using Gateway mode that could cause job failures during partition splits
* Improved the client-side throughput control algorithm to allow saturating the allowed throughput
* Added debug-level logging to help client-side throughput control investigations

### 4.0.0-beta.3 (2021-05-05)
* Cosmos DB Spark 3.1.1 Connector Preview `4.0.0-beta.3` Release.
#### Configuration Renames
Expand Down
7 changes: 4 additions & 3 deletions sdk/cosmos/azure-cosmos-spark_3-1_2-12/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,21 +30,22 @@ https://github.com/Azure/azure-sdk-for-java/issues/new

| Connector | Spark | Minimum Java Version | Supported Scala Versions |
| ------------- | ------------- | -------------------- | ----------------------- |
| 4.0.0 | 3.1.1 | 8 | 2.12 |
| 4.0.0-beta.3 | 3.1.1 | 8 | 2.12 |
| 4.0.0-beta.2 | 3.1.1 | 8 | 2.12 |
| 4.0.0-beta.1 | 3.1.1 | 8 | 2.12 |

## Download

You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 8 from Maven:
`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.0.0-beta.3`
`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.0.0`

You can also integrate against Cosmos DB Spark Connector in your SBT project:
```scala
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.0.0-beta.3"
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.0.0"
```

Cosmos DB Spark Connector is available on [Maven Central Repo](https://search.maven.org/artifact/com.azure.cosmos.spark/azure-cosmos-spark_3-1_2-12/4.0.0-beta.3/jar).
Cosmos DB Spark Connector is available on [Maven Central Repo](https://search.maven.org/artifact/com.azure.cosmos.spark/azure-cosmos-spark_3-1_2-12/4.0.0/jar).

### General

Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-spark_3-1_2-12/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@

<groupId>com.azure.cosmos.spark</groupId>
<artifactId>azure-cosmos-spark_3-1_2-12</artifactId>
<version>4.0.0-beta.4</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
<version>4.0.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
<packaging>jar</packaging>
<name>OLTP Spark Connector for Azure Cosmos DB SQL API</name>
<description>OLTP Spark Connector for Azure Cosmos DB SQL API</description>
Expand Down

0 comments on commit 10c03bf

Please sign in to comment.