Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bump cloud.google.com/go/spanner from 1.43.0 to 1.44.0 in /sdks #141

Open
wants to merge 12 commits into
base: master
Choose a base branch
from
Open

Bump cloud.google.com/go/spanner from 1.43.0 to 1.44.0 in /sdks #141

wants to merge 12 commits into from

Commits on Feb 22, 2023

  1. Add retry logic to Python boot script. 

    This will allow runners to act more quickly on failures
rather than wait for all workers to die before the exiting
the container.
    @robertwb @lostluck
    robertwb authored and lostluck committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    a436d7d View commit details
    Browse the repository at this point in the history

  2. More verbose messaging.

    @robertwb @lostluck
    robertwb authored and lostluck committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    7c61823 View commit details
    Browse the repository at this point in the history

  3. Bump github.com/testcontainers/testcontainers-go in /sdks (apache#25517) 

    Bumps [github.com/testcontainers/testcontainers-go](https://github.com/testcontainers/testcontainers-go) from 0.15.0 to 0.18.0.
- [Release notes](https://github.com/testcontainers/testcontainers-go/releases)
- [Commits](testcontainers/testcontainers-go@v0.15.0...v0.18.0)

---
updated-dependencies:
- dependency-name: github.com/testcontainers/testcontainers-go
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    @dependabot @lostluck
    dependabot[bot] authored and lostluck committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    11c797e View commit details
    Browse the repository at this point in the history

  4. [Avro] Use "extensions/avro" instead of avro from"core" in Java SDK m… 

    …odules (apache#24992)

* Use "extensions/avro" instead of avro from"core" in Java SDK modules

* Use "extensions/avro" instead of avro from"core" in sdks/java/io/kafka

* Use "extensions/avro" instead of avro from"core" in sdks/java/io/google-cloud-platform

* Resolve rebase conflicts

* Use "extensions/avro" for Dataflow runner

* Use "extensions/avro" for core-construction runner

* Add avro extension as a dependency for direct runner

* Copy Avro-related tests to Avro extension

* Address review comments

* Depend javaPreCommit on extensions:avro

* Address review comments

* Revert CountingSource.java

* Up-to-date Avro usages
    @aromanenko-dev @lostluck
    aromanenko-dev authored and lostluck committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    622168e View commit details
    Browse the repository at this point in the history

  5. PCollection data sampling for Java SDK harness apache#25064 (apache#2… 

    …5354)

PCollection data sampling for Java SDK harness apache#25064

This adds the capability for the Java SDK harness to sample in-flight elements. The implementation modifies the ProcessBundleDescriptor when received by the BundleProcessor to create additional DataSampling PTransforms on PCollections. The samples are then returned when the SDK receives a SampleDataRequest.

Task apache#25064
    @rohdesamuel @lostluck
    rohdesamuel authored and lostluck committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    ed1afb3 View commit details
    Browse the repository at this point in the history

  6. Add partitioned reads to JDBC SchemaIO (apache#25577) 

    * Fix up the JDBCSchemaIO to support partitioned reads on a column (I believe numeric and datetime are currently supported). Start adding a JdbcPartitionedReadSchemaTransformProvider as a more generic SchemaTransform. This fits better with the SchemaTransform approach as the partitioned read is actually a different transform entirely from the non-partitioned version.

* Removed the PartitionedReadSchemaTransformProvider pending further discussion. Added a test to the Python side that should exercise this pathway (though this is difficult to fully verify). Verified that it is actually run during tests and that it will fail if something is very wrong though.

* address comments

* Support Int16 type in schema

* Fix pylint; fix unsafe cast; fix test

---------

Co-authored-by: Byron Ellis <byronellis@google.com>
    @Abacn @lostluck
    2 people authored and lostluck committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    f711951 View commit details
    Browse the repository at this point in the history

  7. Deprecate Avro API classes in "sdks/java/core"

    @aromanenko-dev @lostluck
    aromanenko-dev authored and lostluck committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    c2ff502 View commit details
    Browse the repository at this point in the history

  8. Bump github.com/aws/aws-sdk-go from 1.33.0 to 1.34.0 in /sdks (apache… 

    …#25469)

Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.33.0 to 1.34.0.
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Changelog](https://github.com/aws/aws-sdk-go/blob/v1.34.0/CHANGELOG.md)
- [Commits](aws/aws-sdk-go@v1.33.0...v1.34.0)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    @dependabot @lostluck
    dependabot[bot] authored and lostluck committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    b0f141e View commit details
    Browse the repository at this point in the history

  9. ML model evaluation website page (apache#25589)

    @Juta @lostluck
    Juta authored and lostluck committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    c27dbb1 View commit details
    Browse the repository at this point in the history

  10. Add Data Sampling capability URN to Java SDK (apache#25593) 

    * Add Data Sampling capability URN to Java SDK

* trigger tests

* Update runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/Environments.java

---------

Co-authored-by: Sam Rohde <srohde@google.com>
Co-authored-by: Lukasz Cwik <lcwik@google.com>
    @rohdesamuel @lukecwik @lostluck
    3 people authored and lostluck committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    0b3c609 View commit details
    Browse the repository at this point in the history

  11. Add anchor link for the logo wall (apache#25594)

    @aaltay @lostluck
    aaltay authored and lostluck committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    6629402 View commit details
    Browse the repository at this point in the history

  12. Bump cloud.google.com/go/spanner from 1.43.0 to 1.44.0 in /sdks 

    Bumps [cloud.google.com/go/spanner](https://github.com/googleapis/google-cloud-go) from 1.43.0 to 1.44.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md)
- [Commits](googleapis/google-cloud-go@spanner/v1.43.0...spanner/v1.44.0)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/spanner
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
    @dependabot
    dependabot[bot] authored Feb 22, 2023
    Configuration menu
    Copy the full SHA
    f2c49ff View commit details
    Browse the repository at this point in the history