[suggestion] Re-entrant lazily evaluated pagination

[appetrosyan]

Feature request

To fix #3379 we should explore defaulting to reasonable pagination and optimising the behaviour for paginated query results to not cause a stoppage in Iroha.

Specifically pagination should be:

• Re-entrant. There should be a mechanism to request a query result, paginate it, and request a different part of the query result at a later time.
• Lazily-evaluated. We only want to compute the parts of the query which are relevant to generating the current page. If the query asks for all domains, but only the first 100 are present in the page, we should "pause" the evaluation until a different page is requested.
• Optimal. If the 3-rd page is requested, we only resume evaluation to find the 3rd page of results and nothing more.
• Idempotent. Requesting the same page twice is not an error. The result is identical.
• Functional reactive. If the data changed during the evaluation of the query, the result consistent with the old data is returned.
• Sessions expire. If a paginated result was requested and not resumed for a period of time, the re-entrant session expires and new data is returned.
• Resettable. The session can be reset under certain conditions to be discussed with @gv-timur and @arndey.

Motivation

Needed for internal projects

Who can help?

@mversic

[Mingela]

I'd ask to consider a simpler approach for an ordinary node relaxing re-entrance/session oriented properties and leave those for a specific node type only (i.e. archival) not to potentially flood Iroha's resources (valuable for transaction throughput) allocation with this kind of page management tasks.
Pagination is generally used in combination with sorting, so the same value appearance in a next page may indicate the change of the data set.
For the hundred percent accuracy I'd support using an archival node capable of binding a request to a specific block height WSV.

Anyway, that's just my perception, an evaluation of potential pitfalls/tradeoffs preserving each of the qualities listed is up to @mversic I believe.