Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update dependency io.grpc:grpc-netty-shaded to v1.43.1 - autoclosed #534

Conversation

mend-for-github-com[bot]
Copy link

This PR contains the following updates:

Package Update Change
io.grpc:grpc-netty-shaded minor 1.31.1 -> 1.43.1

By merging this PR, the below issues will be automatically resolved and closed:

Severity CVSS Score CVE GitHub Issue
High 7.7 WS-2021-0419 #462

Release Notes

grpc/grpc-java

v1.43.1

Bug Fixes
  • core: fix a race condition when calling ManagedChannel#enterIdle() (#​8761)
Dependencies

v1.43.0

API Changes
  • alts: Make GoogleDefaultChannelCredentials take a CallCredentials (#​8548)
  • binder: Support BinderChannelBuilder.forTarget (#​8633)
  • inprocess: Add support for anonymous in-process servers (#​8589)
Bug Fixes
  • census: fixed a bug which in rare cases, a NullPointerException may be thrown by recordFinishedAttempt(). Users not enabling grpc-census are not impacted by this bug (#​8706)
  • xds: stop generating UUIDs for filter chains that lack them. The UUID was preventing the XdsServer from noticing when a control plane sent a needless duplicate update, causing XdsServer to drain all its existing connections to use the “new” configuration #​8663
  • xds: fix a bug where XdsServer didn’t block start() when configuration is missing, and instead errored. #​8660
New Features
  • protoc-gen-grpc-java plugin support for Apple M1 architecture (#​7690)
  • okhttp: introduced new TLS1.2 cipher suites and internal okhttp implementation for TLS1.3 prepared (#​8650)
  • netty: Add ability to set system property -Dio.grpc.netty.disableConnectionHeaderCheck=false to disable HTTP Connection header check. This is a temporary workaround to allow fixing out-of-spec HTTP/2 clients (#​8683)
Dependencies
Acknowledgement

@​beatrausch
@​benjaminp Benjamin Peterson
@​cfredri4
@​kdubb Kevin Wooten

v1.42.2

Bug Fixes
  • census: fixed a bug which in rare cases, a NullPointerException may be thrown by recordFinishedAttempt(). Users not enabling grpc-census are not impacted by this bug (#​8706)
  • core: fix a race condition when calling ManagedChannel.enterIdle() (#​8746)
Dependencies

v1.42.1

Bug fixes:

  • xds: fix a bug that invalid resources from the control plane was internally classified as missing configuration, but instead it should be classified as a transient error. This will change load balancing states on failure handling behavior: for example, missing LDS at xDS server would make it enter “not serving” mode but a transient error does not affect serving status. #​8690
  • xds: fix a bug where XdsServer didn’t block start() when configuration is missing, and instead errored. #​8690
  • xds: stop generating UUIDs for filter chains that lack them. The UUID was preventing the XdsServer from noticing when a control plane sent a needless duplicate update, causing XdsServer to drain all its existing connections to use the “new” configuration #​8688

New feature:

  • netty: Add ability to set system property -Dio.grpc.netty.disableConnectionHeaderCheck=false to disable HTTP Connection header check. This is a temporary workaround to allow fixing out-of-spec HTTP/2 clients #​8683
  • compiler: Protoc plugin for macOS x86 is duplicated to be used on the aarch architecture, to ease use on arm64 macs. The plugin is not actually ARM64, just named as such. Future work will need to compile it appropriately #​8680

v1.42.0

In this release we drop support for Android API level 18 or lower (Jelly Bean or earlier), following Google Play Service’s discontinued updates for Jelly Bean (API levels 16, 17 & 18).

API Changes
  • xds: Added XdsServerBuilder.overrideBootstrapForTest() to provide bootstrap override for testing purposes. This way, the test does not need to use the shared environment variable for bootstrap injection. (#​8575)
  • api: Stabilize the Status.asException(Metadata) method. (#​8520)
  • core/auth: Remove CallCredentials2 (#​8572). CallCredentials2 was introduced in 1.16.0 to ease migration of CallCredentials to an abstract class. CallCredentials has been preferred over CallCredentials2 since 1.19.0
Bug Fixes
  • netty: Requests with Connection header are malformed. This is required per HTTP/2. The server now rejects such requests. To improve debuggability for clients, Metadata.Key will log if creating a key for “Connection”
  • grpclb: Fix “IllegalStateException: already in fallback” channel panic, by not starting fallback timer if already in fallback (#​8646). This builds on the fix in 1.38.1. The bug was introduced in 1.38.0.
  • core, netty, okhttp: Fix AbstractManagedChannelImplBuilder#maxInboundMessageSize(int) ABI (#​8607). Solves the issue with NettyChannelBuilder.maxInboundMessageSize(int) and OkHttpChannelBuilder.maxInboundMessageSize(int) not working in rare cases when pre-1.33 builds combined with post-1.33. See issue #​8313 for the details.
New Features
  • binder: A new transport with channel and server builders which support cross-process and cross-application communication on Android. BinderChannel is production ready and in use by several Google applications, though the APIs are still experimental and subject to change. It does not currently support rpc-level flow control for streaming RPCs. See gRFC L73 for background.
  • xds: implemented rbac filter per A41 xDS RBAC. This is the first HTTP filter supported on server-side.
  • stub: add ServerCallStreamObserver.setOnCloseHandler(Runnable). Notified when gRPC has completed processing the RPC. (#​8452)
Behavior Changes
  • core: gRPC-Java library discards any Content-Length header set by the application because in most cases this header is blindly forwarded from some other source and is incorrect for gRPC payload.
  • netty: Use Host header on server-side if :authority is not present
  • rls: the cache_size in route lookup config is limited to 5M
  • core: changed the level mapping ChannelLogger uses for java.util.logging.Level (#​8531). It is now possible to enable Java logging for Channelz’s INFO without also enabling DEBUG (previously they were both FINEST).
Dependencies
  • Compatibility with the upcoming Bazel 5 added. This required dropping support for Bazel 1-3. Bazel 4 or later is required (#​7598)
  • netty: bump netty to 4.1.63.Final and tcnative to 2.0.38.Final. (#​8167)
Improvements
  • core: io.grpc.util.AdvancedTlsX509KeyManager and AdvancedTlsX509TrustManager support loading configuration from static files. (#​8525)
  • core: io.grpc.util.CertificateUtils.getPrivateKey() now supports RSA and EC key algorithms

v1.41.2

Bug Fixes
  • core: fix a race condition when calling ManagedChannel.enterIdle() (#​8763)
  • xds: stop generating UUIDs for filter chains that lack them. The UUID was preventing the XdsServer from noticing when a control plane sent a needless duplicate update, causing XdsServer to drain all its existing connections to use the “new” configuration #​8736
Dependencies

v1.41.1

Bug Fixes
  • grpclb: Fix “IllegalStateException: already in fallback” channel panic, by not starting fallback timer if already in fallback (#​8646). This builds on the fix in 1.38.1. The bug was introduced in 1.38.0.

v1.41.0

For users requiring Java 7, the later grpc-java 1.44 release dropped support for Java 7. This v1.41.x branch is the selected gathering point for users continuing to require Java 7. See gRFC P5.

API Changes
  • stub: Mark Stub-based MetadataUtils methods deprecated (#​8395). The interceptor-based versions have been stable for a long time and are preferred
Bug Fixes
  • census: Fixed a data race in CensusStatsModule which in rare cases may cause NullPointerException (#​8459)
  • xds: Fixed a bug in SharedCallCounterMap which in rare cases may cause NullPointerException (#​8397)
  • core: ServerCall.isCancelled() and ServerCallStreamObserver.isCancelled() implementations no longer incorrectly return true at the end of every RPC (#​8408)
  • core: ManagedChannel no longer immediately exits idle mode after an enterIdle() call when it has any calls in progress
  • netty-shaded: Modify the shading operation to transform native-image resources so they correctly reference shaded class names (#​7540)
  • netty-shaded: Rename native-image resources to avoid collisions with Netty’s copy, which were modified starting in 1.39.0
  • rls: avoid NullPointerException in RLS in certain circumstances when calling channel.getState(true) or if a parent load balancer requests a connection (#​8379)
New Features
  • xds: xDS-based TLS security (gRFC 29) is now stable
  • util: Added new classes AdvancedTlsX509TrustManager and AdvancedTlsX509KeyManager, which support reloading keys and trust roots as they change. They also can make custom verification easier by handling the hostname verification. (#​8175)
  • xds: Added XdsNameResolverProvider.createForTest() to allow using a different bootstrap configuration in tests (#​8358)
Behavior Changes
  • rls: migrated the deprecated server and path fields in RouteLookupRequest to using the new extra_keys field in RLS config
Improvements
  • api: Document that NameResolvers shouldn’t block within their methods (#​8398). The offload executor should be used for blocking operations
  • stub: Document StreamObserver is an async API, and how it internally may buffer (#​8449)
Dependencies
  • Upgraded error_prone_annotations to 2.9.0
  • cronet: Cronet upgraded to version 92.4515.131

v1.40.2

grpclb: Fix “IllegalStateException: already in fallback” channel panic, by not starting fallback timer if already in fallback (#​8646). This builds on the fix in 1.38.1. The bug was introduced in 1.38.0.

v1.40.1

Bug Fixes
  • xds: fixed channel panic with NullPointerException if a cluster is configured with RING_HASH LB policy.

v1.40.0

API Changes
  • api: Removed deprecated method ClientStreamTracer.Factory.newClientStreamTracer(CallOptions callOptions, Metadata headers).
  • api: Deprecated ClientStreamTracer.StreamInfo.getTransportAttrs() and ClientStreamTracer.StreamInfo.Builder.setTransportAttrs().
  • api: Added new method ClientStreamTracer.streamCreated(Attributes transportAttrs, Metadata headers).
  • core: Stabilized ManagedChannelBuilder.enableRetry() and ManagedChannelBuilder.disableRetry().
Bug Fixes
  • core: Fix a flow control issue if retry is enabled (#​8401).
  • core: Fix a race between client call cancel() and start() if retry is enabled (#​8386).
  • xds: Fix the race condition in SslContextProviderSupplier's updateSslContext and close (#​8294).
  • xds: If “server_listener_resource_name_template” is not set or xds_v3 is not in use, log an error and fail XdsServer start() instead of NPE.
  • netty: The Netty server produces plain-text error messages for non-gRPC clients. The error pages’ Content-Type incorrectly had encoding=utf-8. It now has charset=utf-8.
New Features
  • compiler: Added GrpcGenerated annotation with CLASS retention to the top-level generated class. This can be used by annotation processors to detect or ignore the generated code.
  • api: Added ServerCallExecutorSupplier experimental API. This allows for a per-service/method executor to handle the server call based on each RPC call information at runtime. (#​8266).
  • xds: Added xDS retry support (gRFC-A44).
Behavior Changes
  • core: The gRPC built-in retry feature is enabled by default. (Users can call ManagedChannelBuilder.disableRetry() to turn off retry if they do not want this feature, for example if they have already implemented an application level retry.) ManagedChannelBuilder.enableRetry() will no longer have the side that disables Census stats and tracing as in previous versions.
Dependencies
Improvements
  • api: Clarify the ServerCallHandler API contract in Javadoc (#​8339).
  • netty: Allow transparent retries for servers that lack graceful two-stage GOAWAY connection shutdown, such as nginx and gRPC C core. This refined a workaround introduced in 1.34.0 for a Netty header processing GOAWAY bug fixed in 4.1.54.Final, but that we are giving time for the fix to work its way through the ecosystem (#​8359).
  • testing: Make more obvious in Javadoc that GrpcServerRule has been replaced.
  • api: Use <scheme,provider> map in nameResoverRegistry. This makes scheme matching more clear and explicit in name resolver API.(#​8323).

v1.39.0

API Changes

  • Static methods in Builders that always throw are now annotated @​DoNotCall. This annotation can be noticed by ErrorProne and inform you of a mistake at compile time instead of runtime. This applies to static methods like InProcessServerBuilder.forPort(int) which are inherited from base classes like ServerBuilder/ManagedChannelBuilder yet are a bug if used.
  • api, core: Support zero copy into protobuf. New APIs have been added to support the custom implementation of a zero-copy Protobuf deserialization marshaller. The HasByteBuffer API exposes ByteBuffers underlying the InputStream being passed to the Marshaller and the Detachable API allows custom Marshaller to take over the ownership of buffers for performing delayed deserialization.
  • NettyChannelBuilder supports SocketAddress with ChannelCredentials.

Bug Fixes

  • netty: Remove Maven pom.properties from netty-shaded jar. The properties don’t add much value and mainly confuse tools in a shaded jar.
  • netty-shaded: Modify the shading operation to transform native-image resources so they correctly reference shaded class names (#​7540)
  • xds: Shut down the scheduledExecutorService in the CertificateProvider when it is shutdown.
  • xds: Close the SslContexrProviderSupplier when a CDS LoadBalancer is shut down to prevent leakage.
  • xds, grpclb: Use a standalone Context for control plane RPCs. The existing behavior of implicitly using the Context in ThreadLocal can cause control plane RPCs to be cancelled prematurely, in cases the data plane RPC is made within a gRPC service to another service. To avoid being impacted by data plane RPC lifecycle, the fix creates standalone Context for control plane RPCs.
  • xds: cluster_resolver LB policy should wait until all clusters are resolved before propagating endpoints to child LB policy. Previously, the cluster_resolver LB policy propagated partially resolved results (endpoints for a subset of clusters) to its child LB policy, which can cause RPCs to be sent to less favored clusters before endpoints of more favored clusters are discovered.
  • xds: use load assignment endpoint address in Cluster as the DNS hostname for LOGICAL_DNS. The LOGICAL_DNS concept was misunderstood previously. Instead of using the channel authority, the hostname should be given by Cluster resource in CDS responses.
  • grpclb: skip fallback if the LB is already in fallback mode. An invariant check for gRPCLB LB policy’s internal state introduced by #​8035 is broken in case the LB policy is in fallback mode while receiving an address update without remote balancer addresses. The fix mitigated the temporal invariant violation.

New Features

  • compiler: Add support for ppc64le on RHEL8.

Dependencies

  • Protobuf upgraded to 3.17.2
  • We now use custom Gradle logic to determine if Maven’s requireUpperBoundDeps would fail for our published artifacts instead of Gradle’s failOnVersionConflict. This means we now make use of fewer dependency exclusions (#​8238). failOnVersionConflict has similar behavior to dependencyConvergence but we previously lacked a more precise tool to detect cases where Maven would downgrade dependencies. We strongly encourage all Maven users to use Maven Enforcer’s requireUpperBoundDeps and continue to discourage using dependencyConvergence

Acknowledgements

@​lepistone Leonardo Pistone
@​shirodkara Amit Shirodkar
@​cfredri4

v1.38.1

Bug Fixes

  • grpclb: skip fallback if the LB is already in fallback mode. An invariant check for gRPCLB LB policy’s internal state introduced by #​8035 is broken in case the LB policy is in fallback mode while receiving an address update without remote balancer addresses. It caused a channel panic (INTERNAL: Panic! This is a bug!) due to the exception IllegalStateException: already in fallback. The fix mitigated the temporal invariant violation.
  • xds: shut down the scheduledExecutorService in the CertificateProvider when it is shutdown

v1.38.0

gRPC Java 1.38.0 Release Notes

API Changes

  • services: move classes with protobuf dependency into io.grpc.protobuf.services. Users currently using BinaryLogging, HealthChecking, Channelz should migrate to use the corresponding classes in io.grpc.protobuf.services. (#​8056)
  • ChannelCredentials and ServerCredentials and are now stable. Notably, this also includes TlsChannelCredentials and TlsServerCredentials that allow mTLS configuration without a direct dependency on Netty. The description of the new API can be found in gRFC L74. These APIs are intended to “replace” the implicit security defaults of channels/servers as well as the usePlaintext() and useTransportSecurity() methods on the channel and server builders. The previous APIs are stable so will not be removed. Over time, documentation and examples will be migrated to the new API

Bug Fixes

  • xds: Fixed a bug that xDS users may experience null pointer exception in rare cases (#​8087)
  • netty: Fixed a bug that client RPCs may fail with a wrong exception with message "Maximum active streams violated for this endpoint" when receiving GOAWAY while MAX_CONCURRENT_STREAMS is reached. After the fix the client RPC should fail with UNAVAILABLE status in such a scenario. (#​8020)
  • xds: Fixed a bug that xDS LB policies may process and propagate load balancing state update from its child LB policy after itself being shut down. This can be cascaded and result in hard-to-reason behaviors if any one layer of the LB policies does not clean up its internal state after shutdown.

Behavior Changes

  • core, grpclb, xds: let leaf LB policies explicitly refresh name resolution when subchannel connection is broken. Custom LoadBalancer implementations should refresh name resolution (with Helper.refreshNameResolution()) when seeing its created subchannel becomes IDLE or TRANSIENT_FAILURE. Currently the Channel will do it for you and log a warning. But this operation will be removed in the future releases. (#​8048)
  • netty: Added support for OpenJSSE

Dependencies

  • Upgrade Guava to 30.1 (#​8100). As part of #​4671 grpc-java will drop support for Java 7, with no impact to Android API levels supported. Guava is going through the same process and in this Guava release it warns when used on Java 7. If you are using Java 7 and are impacted, please comment on #​4671. The Java 7 check may be noticed by Android builds and fail without language-level desugaring. We expect most users have already enabled language-level desugaring, but if not it would be necessary to add to your build.gradle:
android {
    compileOptions {
        sourceCompatibility JavaVersion.VERSION_1_8
        targetCompatibility JavaVersion.VERSION_1_8
    }
}
  • auth: Allow pre- and post-0.25.0 behavior from google-auth-library-java, for Bazel users. google-auth-library-java 0.25.0 changed its behavior for JWT that caused a gRPC test to fail. The failure was benign but prevented Bazel users from using newer versions of the library

v1.37.1

Bug Fixes

  • netty: fixed a bug that client RPCs may fail with a wrong exception with message "Maximum active streams violated for this endpoint" when receiving GOAWAY while MAX_CONCURRENT_STREAMS is reached. After the fix the client RPC should fail with UNAVAILABLE status in such a scenario.
  • grpclb, xds: fixed a day-one issue that the control plane RPC are using the same Context as the inbound application RPC, which can cause control plane RPC aborted when the inbound application RPC completes.
  • xds: fixed a bug that xDS LB policies may process and propagate load balancing state update from its child LB policy after itself being shut down. This can be cascaded and result in hard-to-reason behaviors if any one layer of the LB policies does not clean up its internal state after shutdown.

v1.37.0

Behavior Changes

  • alts: make both GoogleDefaultChannelCredentials and ComputeEngineChannelCredentials choose ALTS for backends given by xDS TD. Changes for ComputeEngineChannelCredentials were missing, but they really should be the same.
  • api: added a convenient ServerBuilder.addServices() API that allows adding a list of services instead of iterating through list and calling addService().
  • api: deleted some NameResolver APIs that have been marked as deprecated since 1.21 release.
  • api: implemented admin interface API, which automatically loads available admin services in a given binary. Currently, it only includes Channelz and CSDS with dependencies required at runtime.
  • context: move pendingDeadline.cancel out of synchronized block.
  • netty: allow connection handshakes (e.g., TCP, TLS) to be interrupted by channel.shutdown(). Previously shutdownNow() was required for prompt shutdown if a connection was handshaking.
  • xds: change in parsing ADS responses for LDS, RDS, CDS, and EDS resources. Before this release, gRPC parsing logic for ADS response containing multiple resources was to stop resource processing on the first encountered error, followed by NACK with the details of this single error. With this change, the parsing logic processes all resources and collects all processing errors. If any error occurred, a NACK is issued with concatenated error messages of all errors encountered. The rationale and the detailed design can be found in gRFC A40 — ADS Parsing Logic Update: Continue After First Error.
  • xds: change system property name for reading bootstrap config from io.grpc.xds.bootstrapValue to io.grpc.xds.bootstrapConfig.
  • xds: circuit breaking, timeout and fault injection are enabled by default. Previously they were protected by environment variables.
  • xds: use the new server_listener_resource_name_template property from the bootstrap file for server side xDS processing as per the gRFC A36-xds-for-servers.md.

New Features

  • api: TlsChannelCredentials and TlsServerCredentials now support client certificates and custom KeyManagers/TrustManagers. grpc-netty fully supports these options. grpc-okhttp does not support keyfile-based configuration; you’d need to use a KeyManager. Most users of Netty’s SslContext and GrpcSslContexts should be able to migrate and are encouraged to do so, because this API does not have a Netty dependency and so is planned to become stable.
  • netty: added support for OpenJSSE.
  • okhttp: support compiling with okio 2.x API for Bazel users. grpc-okhttp was already compatible with okio 2 at runtime.
  • xds: XdsServingStatusListener has been implemented as per the gRFC A36-xds-for-servers.md.
  • xds: add proto leakage check at gradle build. Create a new Gradle task depends on shadowJar. It examines the outputs of shadowJar package prefix to make sure it is inside within the package.
  • xds: added CsdsService. It is safe for production but are Experimental APIs to resolve issues discovered as they see usage. The rationale and description of the new API can be found in gRFC A40: xDS Configuration Dump via Client Status Discovery Service in gRPC.
  • xds: implement gRPC server side validations and filterChain match of xDS configuration as per the gRFC A36-xds-for-servers.md.
  • xds: WeightedTargetLoadBalancer collect all failure child pickers to log more error details.

Bug Fixes

  • grpclb: gRPCLB would buffer RPCs indefinitely if failing to fallback because the resolver provides no fallback addresses. Now it turns into TRANSIENT_FAILURE for such cases.
  • xds: fix CdsLoadBalancer2 childLb shutdown behavior. Previously these childLbs are not properly shutdown, which might cause channel panic as client channel is referenced by those childLbs.
  • Fixed an UnsupportedOperationException incompatibility with Netty 4.1.60.Final (#​7953). This allows users of grpc-netty that may be using Netty elsewhere in their application to upgrade their Netty version to avoid exposure to recent Netty CVEs. gRPC itself is not impacted by those CVEs.
  • grpclb: fixed a race between address update and LB stream recreation, which would cause channel panic if the resolver refreshes the result while gRPCLB is in LB stream backoff.
  • grpclb: gRPCLB ignored CONNECTING subchannels when aggregating the overall LB state, which would cause RPCs to fail prematurely if there are subchannels in its initial connection.
  • grpclb: now we allow multiple authorities in lb backends instead of flattening to the first authority.
  • interop-testing: fix alts handshaking race: add proper synchronization on the AltsTestServer object lock, this way, alts client and alts server won’t race on the AltsTestServer during Alts handshake negotiation.
  • xds: fixed a bug that would drop some node information (e.g., user-agent) when reporting to LRS (#​7964).
  • xds: the xDS resolver did not clear its state when control plane resources were revoked before offloading the xDS LB plugin. It would treat the next update as duplicate if the control plane recovers and never comes back to use those resources. Now this is fixed.

Documentation

  • example-tls: ported to TlsChannelCredentials/TlsServerCredentials and no longer depends on Netty at compile time.
  • examples: add ALTS example README.md.

Dependencies

  • gradle: bumped protobuf-gradle-plugin version to 0.8.15
  • xds: envoy proto updated to commit ac9a26373. Added xDS v3 csds.proto with dependencies.

Acknowledgements

@​spkrka Kristofer Karlsson
@​njhill Nick Hill
@​ulfjack Ulf Adams

v1.36.2

Bug Fixes

  • grpclb: fixed a day-one issue that the control plane RPC are using the same Context as the inbound application RPC, which can cause control plane RPC aborted when the inbound application RPC completes.
  • netty: Fixed a bug that client RPCs may fail with a wrong exception with message "Maximum active streams violated for this endpoint" when receiving GOAWAY while MAX_CONCURRENT_STREAMS is reached. After the fix the client RPC should fail with UNAVAILABLE status in such a scenario. (#​8020)
  • xds: Fixed a bug that xDS users may experience null pointer exception in rare cases (#​8087)
  • xds: the xDS resolver did not clear its state when control plane resources were revoked before offloading the xDS LB plugin. It would treat the next update as duplicate if the control plane recovers and never comes back to use those resources. Now this is fixed.

v1.36.1

  • Fix an UnsupportedOperationException incompatibility with Netty 4.1.60.Final (#​7953). This allows users of grpc-netty that may be using Netty elsewhere in their application to upgrade their Netty version to avoid exposure to recent Netty CVEs. gRPC is not impacted by those CVEs so a Netty upgrade for gRPC itself is not necessary
  • xds: Fixed a bug that would drop some node information (e.g., user-agent) when reporting to LRS (#​7964)
  • xds: Renamed io.grpc.xds.bootstrapValue system property to io.grpc.xds.bootstrapConfig. This more closely matches the environment variable (GRPC_XDS_BOOTSTRAP_CONFIG) and avoids future confusion (#​7968)
  • xds: Fixed a possible IllegalStateException causing Channel panic during LB shutdown (#​7942). The bug was introduced in v1.36.0. The issue likely most impacts xDS users that may leave a channel unused (no RPCs) for 30 minutes since idle timeout triggers LB shutdown

v1.36.0

API Changes

  • Added .class file hack to ease removal of internal ABIs (https://github.com/grpc/grpc-java/pull/7834). This does not impact source code (API); it only impacts code compiled with a different version of gRPC than it runs with (ABI). Users of the transport-specific and experimental channel/server builders (NettyChannelBuilder, NettyServerBuilder, OkHttpChannelBuilder, InProcessChannelBuilder, CronetChannelBuilder) are commonly referencing internal ABIs due to overly-specific generics in gRPC. There is now a .class file hack in place which preserves ABI compatibility for old builds while causing javac to use the intended public API for new builds. In a future release we will remove the internal ABI for these experimental APIs (https://github.com/grpc/grpc-java/issues/7211) which may cause runtime failures. Recompiling with this release or later will prevent your code from using those ABIs and so you will not be impacted by the ABI removal. This is related to the temporary ABI breakage in v1.33.0.
  • Deleted deprecated LoadBalancer.Helper APIs as they had been deprecated since v1.22 release (#​7793).
  • Deprecated LoadBalancer.Helper.createResolvingOobChannelBuilder(String target) in favor of the new experimental API createResolvingOobChannelBuilder(String target, ChannelCredentials creds). The two APIs differ not only in signature but also in the default authority of the returned builder. See their javadoc for more detail.

Behavior Changes

  • ManagedChannelBuilder.overrideAuthority() is now used even if the NameResolver uses EquivalentAddressGroup.ATTR_AUTHORITY_OVERRIDE. Previously the NameResolver’s override would be used
  • grpclb: keep RR Subchannel state in TRANSIENT_FAILURE until becoming READY (#​7816). This enhancement was previously made to the round_robin policy, but now also applies to grpclb
  • netty: On server-side, stop logging expected STREAM_CLOSED exceptions. This reduces log pollution

New Features

  • services: Add support for grpc.channelz.v1.Channelz.GetServer, as defined in channelz.proto
  • xds: support reading bootstrap config directly from env var (GRPC_XDS_BOOTSTRAP_CONFIG) or system property (io.grpc.xds.bootstrapValue) values
  • alts: Introduce AltsContext to allow outside packages access to ALTS peer information

Bug Fixes

  • core: Fixed a bug where RPCs queued waiting for a connection can use user-provided executors after the ManagedChannel is terminated (#​6283)
  • core: Fixed a bug where RPCs queued waiting on CallCredentials can use user-provided executors after the ManagedChannel is terminated (#​7813)

Documentation

  • api: add nullable annotation to Status.trailersFromThrowable (#​7856). The annotation doesn’t change behavior, it just makes the behavior more clear

Dependencies

  • alts: Remove dependency on Apache Commons Lang

Acknowledgements

@​elharo Elliotte Rusty Harold
@​lriuui0x0 Rui Liu
@​martin-schaub Martin Schaub
@​njhill Nick Hill
@​ReginFell Serhii Zabelnykov

v1.35.1

  • Fix an UnsupportedOperationException incompatibility with Netty 4.1.60.Final (#​7953). This allows users of grpc-netty that may be using Netty elsewhere in their application to upgrade their Netty version to avoid exposure to recent Netty CVEs. gRPC is not impacted by those CVEs so a Netty upgrade for gRPC itself is not necessary
  • xds: Fixed a bug that would drop some node information (e.g., user-agent) when reporting to LRS (#​7964)

v1.35.0

Bug Fixes

  • core: Fix CompositeChannelCredentials to no longer use CallCredentials for OOB channels. OOB channels are available for load balancing policies to use to communicate with an LB server. It is mainly used by gRPC-LB. This resolves the incompatibility of the 1.34.0 release with googleapis.com.
  • alts: Limit number of concurrent handshakes to 32. ALTS uses blocking RPCs for handshakes. If the handshake server has a limit to number of concurrent handshakes this can produce a deadlock. Limiting to 32 should workaround the problem for the majority of the cases. A later fix will allow handshake RPCs to be asynchronous
  • xds: Fix missed class relocations for generated code. grpc-xds previously exposed generated code for multiple 3rd-party protobuf generated code classes outside of the io.grpc package. They are now shaded to avoid colliding with other users of the classes
  • xds: Fix a user visible stack trace showing java.util.NoSuchElementException when the environment variable GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT was set and the application contains an xDS configured gRPC server. The exception was benign and was seen when the connection was dropped before an SslContextProvider was available.
  • xds: Decouple xds channel creation and bootstrapping. This fixes the bug caused by the lifecycle mismatch between XdsClient and its channel to the xDS server. Creating a new XdsClient (previous one shutdown due to no Channel using it) would create and use a new xDS channel.
  • xds: Fix races between creating subchannls and Channel shutdown caused by delaying address/config propagation between LB policies. An exception will be thrown if Channel's shutdown() has been called and receiving an EDS update while the Channel has not completely shutdown.

Dependencies

  • Guava updated to 30.0-android
  • Animal Sniffer annotations updated to 1.19
  • Error Prone annotations updated to 2.4.0
  • Perfmark updated to 0.23.0
  • compiler: Linux artifacts now built using CentOS 7. Previously CentOS 6 was used, but that distribution is discontinued and no longer available in our build infrastructure
  • netty: Upgrade to Netty 4.1.52 and tcnative 2.0.34. Note that this Netty release enables TLSv1.3 support. mTLS failures with TLSv1.3 will have different error messages than in TLSv1.2
  • auth,alts: google-auth-library-java updated to 0.22.2
  • census: OpenCensus updated to 0.28.0
  • protobuf: googleapi’s common protos updated to 2.0.1
  • okhttp: Okio updated to 1.17.5
  • xds: re2j updated to 1.5
  • xds: bouncycastle updated to 1.67
  • gradle: bumped protobuf-gradle-plugin version to 0.8.14
  • android, cronet: upgraded the latest support Android version to 29

Acknowledgments

@​amnox
@​horizonzy
@​wanyingd1996

v1.34.1

Bug Fixes

  • core: Fix CompositeChannelCredentials to no longer use CallCredentials for OOB channels. OOB channels are available for load balancing policies to use to communicate with an LB server. It is mainly used by gRPC-LB. This resolves the incompatibility of the 1.34.0 release with googleapis.com.
  • alts: Limit number of concurrent handshakes to 32. ALTS uses blocking RPCs for handshakes. If the handshake server has a limit to number of concurrent handshakes this can produce a deadlock. Limiting to 32 should workaround the problem for the majority of the cases. A later fix will allow handshake RPCs to be asynchronous
  • xds: Relocate (shade) all generated code; a few classes had previously been missed
  • xds: Fixed an issue when GRPC_XDS_EXPERIMENTAL_NEW_SERVER_API=true where gRPC would request non-existent resources

v1.34.0

This release has a severe bug when using CompositeChannelCredentials that predominantly impacts googleapis.com (#​7643). You may be impacted in the future even if not impacted today. If you contact googleapis.com, please use 1.34.1 instead.

API Changes

  • api: added io.grpc.ForwardingServerBuilder (#​7633)

New Features

  • Added ChannelCredentials and ServerCredentials. They are safe for production but are Experimental APIs to resolve issues discovered as they see usage. The rationale and description of the new API can be found in gRFC L74. In short, these APIs are intended to “replace” the implicit security defaults of channels/servers as well as the usePlaintext() and useTransportSecurity() methods on the channel and server builders. The previous APIs are stable so will not be removed, but are expected to be deprecated in the future. Since these new APIs will be widely used, we encourage users to try the APIs out and report any problems experienced so they can be corrected before the APIs become stable (#​7294, #​7601)
  • As part of ChannelCredentials and ServerCredentials there are now XdsChannelCredentials and XdsServerCredentials added that can be used to enable use of XDS provided credentials on the channel and server. A File-watcher certificate provider has been implemented to support these Xds Credentials. The example in example-xds has been enhanced to be a full xDS example with XdsChannelCredentials and XdsServerCredentials to illustrate their usage. (#​7497, #​7636)
  • xds: added support for setting bootstrap file with java system property (#​7620)

Bug Fixes

  • netty: abrupt GOAWAY should not cause INTERNAL status. It is now UNAVAILABLE. This was a regression introduced in v1.33.0. The error was in the form StatusRuntimeException: INTERNAL: http2 exception with a cause similar to Http2Exception$StreamException: Cannot create stream 222691 greater than Last-Stream-ID 222689 from GOAWAY. This was mainly observed when a C core-based gRPC server shut down. (#​7501)
  • core, netty, okhttp, cronet: fixed builders ABI backward compatibility broken in v1.33.0 (#​7552). For details, see v1.33.1 release note.
  • core: round robin should ignore name resolution error for channel state change when there are READY subchannels (#​7595). Previously the round_robin load balancing policy puts the Channel into TRANSIENT_FAILURE if encountering name resolution failures even if it has received usable addresses.
  • core: fixed floating-point number formatting Locale in error messages (#​7473)
  • android: make Channel always enterIdle() upon network recover (#​7611). This is for AndroidChannelBuilder. It avoids failing new RPCs prematurely when the device detects the network has recovered while resuming connections.
  • xds: only reschedule time for unresolved resources upon ADS stream restarts (#​7582). The management server can choose not to send resources it has previously sent when the RPC stream is recreated. So the client will keep using resources it has saved previously.
  • alts: create handshaker RPC lazily (#​7630). Previously the handshake RPCs start before the TCP connection is established, which might be leaked forever if the connection is never established.

Documentation

  • api: added implementation note regarding server interceptors and thread locals (#​7482)
  • api: clarify expectations regarding ServerCall#close (#​7580)

Behavior Changes

  • netty: differentiate GOAWAY closure status descriptions (#​7502). Previously many different GOAWAY-related errors all produced the same status description. Now they each should use their own specific description which should allow distinguishing between issues like weak server GOAWAY behavior, MAX_CONCURRENT_STREAMS interfering with eager transport selection, and local races. We now also use UNAVAILABLE in more cases, although the cases that benefit should be rare
  • xds: added support case insensitive path matching (#​7506). The xDS traffic splitting now supports the case-insensitive option for path matching.
  • alts: add a timeout to AltsHandshakerStub. A default of 20 seconds is used (#​7589)

Dependencies

  • all: bumped google auth libraries to version 0.22.0 (#​6652)

Acknowledgements

@​attila123
@​erikjoh
@​jbdeboer
@​ST-DDT
@​sullis
@​susinmotion

v1.33.1

Bug Fixes

  • Fix builders ABI backward compatibility broken in v1.33.0, see #​7552
    • netty: The class io.grpc.netty.NettyServerBuilder reverted to extend internal class io.grpc.internal.AbstractServerImplBuilder
    • netty: The class io.grpc.netty.NettyChannelBuilder reverted to extend internal class io.grpc.internal.AbstractManagedChannelImplBuilder
    • okhttp: The class io.grpc.okhttp.OkhttpChannelBuilder reverted to extend internal class io.grpc.internal.AbstractManagedChannelImplBuilder
    • core: The class io.grpc.inprocess.InProcessChannelBuilder reverted to extend internal class io.grpc.internal.AbstractManagedChannelImplBuilder
    • cronet: The class io.grpc.cronet.CronetChannelBuilder reverted to extend internal class io.grpc.internal.AbstractManagedChannelImplBuilder
  • api: ForwardingServerBuilder reverted until the permanent fix of the issue with ABI compatibility of delegating classes
  • okhttp: exclude Internal* from javadoc
  • netty: Abrupt GOAWAY should not cause INTERNAL status. It is now UNAVAILABLE. This was a regression introduced in v1.33.0. The error was in the form StatusRuntimeException: INTERNAL: http2 exception with a cause similar to Http2Exception$StreamException: Cannot create stream 222691 greater than Last-Stream-ID 222689 from GOAWAY. This was mainly observed when a C core-based gRPC server shut down.
  • core: fix floating-point number formatting Locale

v1.33.0

This release broke ABI in a non-planned way for NettyServerBuilder, NettyChannelBuilder, and similar. See https://github.com/grpc/grpc-java/issues/7552. If you are impacted, please use an earlier version until v1.33.1 is available. A future ABI breakage may be necessary, but will be communicated explicitly at that time.

API Changes

  • netty: The class io.grpc.netty.NettyServerBuilder is no longer a subclass of the internal class io.grpc.internal.AbstractServerImplBuilder
  • netty: The class io.grpc.netty.NettyChannelBuilder is no longer a subclass of the internal class io.grpc.internal.AbstractManagedChannelImplBuilder
  • okhttp: The class io.grpc.okhttp.OkhttpChannelBuilder is no longer a subclass of the internal class io.grpc.internal.AbstractManagedChannelImplBuilder
  • core: The class io.grpc.inprocess.InProcessChannelBuilder is no longer a subclass of the internal class io.grpc.internal.AbstractManagedChannelImplBuilder
  • cronet: The class io.grpc.cronet.CronetChannelBuilder is no longer a subclass of the internal class io.grpc.internal.AbstractManagedChannelImplBuilder
  • api: Add ForwardingServerBuilder: a ServerBuilder that delegates to another builder by default
  • core: Add accessor for bare method name in MethodDescriptor (#​7339)
  • stub: On server-side when an RPC is cancelled, only throw StatusRuntimeException: CANCELLED from onNext() for streaming responses. Previously the exception was also thrown from onNext() for unary responses and from onComplete(), which didn’t help the server avoid unnecessary processing
  • okhttp: OkHttpChannelBuilder made final and can no longer be anonymous
  • api, core: delete io.grpc.LoadBalancer.loadBalancingConfig attribute (#​7440). The attribute was deprecated in v1.27.0, now it is completely deleted.

New Features

  • netty: Add support for IBMJSSE2 (#​7422)

Documentation

  • API documentation (Javadoc) for Server and Channel builders now correctly displays inherited methods and the class hierarchy

Bug Fixes

  • core: Reverted "delay sending cancel request on client-side when deadline expires" which introduced a memory leak (#​7105). It could also cause messages to arrive after the call was reported closed (e.g., onMessage() after onClose())
  • grpclb: Fixed a bug that RPC might be hanging when using grpclb balancer as a child balancer in a hierarchical load balancer tree (#​7434)
  • netty: TCP close during TLS handshake should be UNAVAILABLE, not UNKNOWN
  • netty: BDP ping accounting should occur after flow control. This resolves an incompatibility issue introduced in v1.30.0 and could be worked around via GRPC_EXPERIMENTAL_AUTOFLOWCONTROL=false introduced later. The symptom was a GOAWAY with “too_many_pings” without an aggressive keepalive configured. The environment variable is still available, but will be removed in the future

Behavior Changes

  • xds: Xds server channel credential option will be required in the xDS bootstrap file. Use {"type":"insecure"}” for plaintext (#​7396)

Dependencies

  • benchmarks: Removed -javaagent jvm option in CreateStartScripts, to allow running the benchmarks without building from source
  • Upgrade Conscrypt to 2.5.1
  • bazel: Remove Maven repositories from repositories.bzl, in favor of maven_install. v1.27.0 introduced support for maven_install and encouraged users to migrate. See examples/WORKSPACE for an example. maven_install dramatically reduces the boilerplate for maven dependencies and properly handles transitive dependencies and version selection. gRPC is not yet using the @maven workspace, so it is still possible to use other dependency tools.
  • Update protobuf gradle plugin version to 0.8.13 (#​7355)

Acknowledgements

@​codeblooded Benjamin Reed
@​kiwi1969 Russell Shaw
@​pkern Philipp Kern

v1.32.3

Bug Fixes

  • xds: Fixed JSON number types in internally generated service config for header matching (more specifically, range matching for numerical headers) (#​7880).

v1.32.2

Bug Fixes

  • netty: TCP close during TLS handshake should be UNAVAILABLE, not UNKNOWN
  • netty: BDP ping accounting should occur after flow control. This resolves an incompatibility issue introduced in v1.30.0 and could be worked around via GRPC_EXPERIMENTAL_AUTOFLOWCONTROL=false introduced later. The symptom was a GOAWAY with “too_many_pings” without an aggressive keepalive configured. The environment variable is still available, but will be removed in the future
  • alts: Reverted workaround for Conscrypt cipher performance. Conscrypt 2.5.0 has significantly improved performance and the workaround now decreases performance. Note that grpc-alts itself still depends on Conscrypt 2.2.1 to remain stable for this bug fix release, but users are encouraged to use newer a version of Conscrypt. The gains from Conscrypt 2.5.0 are significantly greater than what the workaround provided

v1.32.1

API Changes

  • api: Removed deprecated method ChannelBuilder.blockingExecutor() (#​7242). There should not be any users as it was deprecated the first release it was available and was renamed offloadExecutor().
  • grpclb: Make ATTR_LB_ADDRS public (#​7230). This is necessary to configure grpclb from a custom NameResolver

New Features

  • xds: perform header matching on concatenated multi-valued headers (#​7215)
  • xds: add header matching special cases for hiding/exposing some gRPC headers (#​7224). The only gRPC header available for header matching is “content-type”.
  • xds: support load reporting all clusters option and fix actual report interval measurement (#​7209). If the LRS response enables send_all_clusters, the client side will report loads for all clusters it is currently using.

Bug Fixes

  • core, alts, cronet: Fix ByteBuffer covariant method usages (#​7349). When built with Java 9+, internal usages of ByteBuffer APIs may cause runtime breakage for dependent applications running with Java 8. This is fixed now.
  • core: Fixed a bug that RPC may hang when hedging is enabled with a throttling configuration (#​7337)
  • netty: The environment variable GRPC_EXPERIMENTAL_AUTOFLOWCONTROL=false will now disable the BDP monitoring introduced in v1.30.0. This is intended to help diagnose a “too_many_pings” compatibility issue and will be removed once it is resolved. If you need to use the variable, please file an issue
  • benchmarks: Use correct classpath for scripts (the ones in the bin/ folder of the tar/zip), fixing NoClassDefFoundErrors. The classpath was probably broken starting in v1.30.
  • xds: routing policy should immediately update a picker that selects base on updated config (#​7233)

Dependencies

  • netty: Upgrade to Netty 4.1.51 and tcnative 2.0.31
  • android, cronet: Drop support for android SDK versions older than 16 ([#&#

@mend-for-github-com mend-for-github-com bot added the security fix Security fix generated by WhiteSource label Apr 18, 2022
@mend-for-github-com mend-for-github-com bot changed the title Update dependency io.grpc:grpc-netty-shaded to v1.43.1 Update dependency io.grpc:grpc-netty-shaded to v1.43.1 - autoclosed Apr 25, 2022
@mend-for-github-com mend-for-github-com bot deleted the whitesource-remediate/io.grpc-grpc-netty-shaded-1.x branch April 25, 2022 03:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
security fix Security fix generated by WhiteSource
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants