Script Execution on Access Node

[koko1123]

Goal
Implement optional execution of scripts on the access node.

Design Proposal
Script execution is already being done on the execution node by using the script execution engine, which can be reused in this use case. The script execution engine needs to be changed to require slimmer interfaces which will be easier to conform to by the script execution module that will be built and will use the Pebble index database.
On the database population side, we will create a state indexer module that will be responsible for reacting to new data available from the state sync API triggered by the state requester engine using the callback. The indexer module will use an internal jobqueue to make sure we handle sequential indexing of new block data, as well as have good failover and retry logic already implemented.
The indexer module will use defined interfaces for persisting data in the indexer database.

A simple overview of the design:

Tasks

Beta Give feedback

1. [Script Execution] Define the index database interface #4667
   Execution +1
   
2. [Script Execution] Optimize the script execution engine required interfaces #4666
   Execution +1
   
3. Move register DB in Archive node to Access Node #4606
   Execution +1
   
4. [Script Execution] Execution Data Index #4639
   Execution +1
5. [Script Execution] State Data Indexer Module #4638
   Execution +1
   
6. [Script Execution] Ingest initial state snapshot #4673
   +0
   
7. [State Sync] Index events #4674
   S-Access +1
   
8. [Access] Load indexer and register db in node bootstrap #4778
   S-Access +1
   
9. Create FVM runtime with new pebble register database as store #4632
   Execution +1
   
10. [Script Execution] Configure script execution engine #4640
    Execution +1
    
11. Make use of Execution state sync data for Access node API requests #4631
    Execution +1
    
12. [Script Execution] Implement RPC APIs for script execution #4781
    Execution +1
    
13. [Access] Compare checkpoint's root node hash to root snapshot #4806
    Execution +1
    
14. [Access] Fix race condition in job consumer component #4839
    Bug Execution +2
    
15. [Access] Handle context canceled and deadline exceeded errors in script execution response #5030
    S-Access +1
    
16. [Access] Make script execution effort and timeouts configurable #4776
    S-Access +1
    

Testing

Beta Give feedback

1. [Access] Getting account from local storage returns not found error #4824
   Bug Execution +2
   
2. [Script Execution] Add support for GetBlockAtHeight on Access nodes #4880
   Bug Execution +2
   
3. [Script Execution] AN returning Internal error for ErrCodeInvalidArgumentError and ErrCodeCadenceRunTimeError #4881
   Bug Execution +2
   
4. [Script Execution] Add metrics label to track OutOfRange conditions #4900
   Execution S-Access +2
   
5. [Access] GetAccount using local data doesn't validate address matches chain #4918
   Bug S-Access +2
   
6. [Access] Script exec error comparison not matching semantically identical errors #4919
   Bug S-Access +2
   
7. [Access] Tuning and metrics for indexing and script execution #4798
   Execution S-Access +2
   
8. [Access] Benchnet testing script execution #4855
   Execution +1
   
9. [Access] rest GetAccount using local data doesn't validate address matches chain #4928
   Bug S-Access +2
   
10. [Access] UUID reset to 0 in local script execution #4938
    Bug Execution +2
    
11. [Access] Executing some scripts on ANs takes orders of magnitude longer than on ENs #4953
    S-Access +1