[Access] Implement gRPC streaming endpoint SubscribeBlocks #5307

UlyanaAndrukhiv · 2024-01-26T20:42:43Z

Context

This PR implements

SubscribeBlocks
SubscribeBlockHeaders
SubscribeBlockDigests

endpoints within the Access Node API to facilitate the streaming of blocks at the gRPC level.

This new endpoints have similar functionality of receiving new blocks/headers as SubscribeEvents. Additionally, subscribers can define the block status (BlockStatusSealed or BlockStatusFinalized) through an argument, receiving only blocks with the specified statuses.

As part of this PR:

The protobuf have been extended, see Added SubscribeBlocks, SendAndSubscribeTransactionStatuses in GRPC protobuf flow#1422 and Splitted subscribe blocks, headers and block digests rpc calls flow#1437).
flow-emulator have been extended (see [Access] Subscribe endpoints is missing flow-emulator#593)

… into UlyanaAndrukhiv/subscribe-blocks

access/api.go

engine/access/subscription/subscription.go

engine/access/state_stream/backend/handler.go

engine/access/subscription/blocks_watcher.go

…ndrukhiv/flow-go into UlyanaAndrukhiv/subscribe-blocks

peterargue

mostly small comments. I think this is pretty much ready to go.

Have you tried this out on localnet?

access/handler.go

engine/access/state_stream/backend/engine.go

engine/access/subscription/block_tracker.go

engine/access/subscription/execution_data_tracker.go

engine/access/rpc/backend/backend_stream_blocks_test.go

engine/access/subscription/base_tracker.go

engine/access/subscription/block_tracker.go

engine/access/subscription/execution_data_tracker.go

engine/access/subscription/base_tracker.go

engine/access/subscription/block_tracker.go

engine/access/subscription/execution_data_tracker.go

durkmurder

Left a few comments regarding documentation. I am sure open comment will be addressed so I am approving. Great job, very solid lift.

engine/access/subscription/execution_data_tracker.go

…tHighestHeight type

cmd/access/node_builder/access_node_builder.go

cmd/observer/node_builder/observer_builder.go

peterargue

looks good. Great work!

franklywatson · 2024-03-14T20:22:44Z

Tagging onflow/developer-grants#242 for Milestone 1 item 9 completion

…be-blocks [Access] Implement gRPC streaming endpoint SubscribeBlocks

UlyanaAndrukhiv and others added 11 commits December 19, 2023 16:30

Merged with master

8e24fde

Replaced protobuf version to new one

a2f4e9c

Implemented sealed blocks retriving

7f8356f

Updated protobuf, added tests for finalized subscribe blocks

118361f

Merged with stream-sealed

f6f2a16

Refactored structs and naming

9f5e399

Make universal functions in for block watcher

20e7d23

Added checks for block status

31d3f1e

Merge branch 'merge-stream-sealed' of github.com:Guitarheroua/flow-go…

69b04f1

… into UlyanaAndrukhiv/subscribe-blocks

Added test for subscribe blocks backend

ab097a6

Added more comments to subscribe blocks impl

c93df5b

UlyanaAndrukhiv requested review from peterargue, AlexHentschel, durkmurder and jordanschalm as code owners January 26, 2024 20:42

UlyanaAndrukhiv added 2 commits January 29, 2024 13:23

Updated subscriptionOnFinalizedBlock process

d84b1d4

Updated protobuf

7ba6f9d

UlyanaAndrukhiv mentioned this pull request Jan 29, 2024

Added SubscribeBlocks, SendAndSubscribeTransactionStatuses in GRPC protobuf onflow/flow#1422

Merged

UlyanaAndrukhiv added 2 commits January 29, 2024 15:16

Updated protobuf module

aa09fb1

Reverted back unnecessary changes

a7358b0

Guitarheroua mentioned this pull request Jan 29, 2024

[Access] SendAndSubscribeTransactionStatuses endpoint implementation for Access Streaming API #5310

Merged