feat(consume): enable loading of ethereum/tests/BlockchainTests

[danceratopz]

🗒️ Description

Enables loading ethereum/tests/BlockchainTests (except for 5 json files that define invalid fields via "bigint").

1. Makes post_state an optional field in blockchain fixtures.
2. Adds a list of fixtures to skip in genindex (the fixtures here all currently use bigint to define invalid fields in json).
3. Updates hasher to use _info["generatedTestHash"] as a synonym for _info["hash"] (this allows genindex to check whether the index.json is up-to-date for ethereum/tests; otherwise it must be regenerated every time).

This requires: ethereum/tests#1380.

Test loading of fixtures into EEST pydantic models with:

genindex -i ~/path/to/ethereum/tests/BlockchainTests/

Expected output:

Skipping '/home/dtopz/code/github/ethereum/tests/BlockchainTests/GeneralStateTests/stTransactionTest/ValueOverflowParis.json'
Skipping '/home/dtopz/code/github/ethereum/tests/BlockchainTests/InvalidBlocks/bc4895-withdrawals/withdrawalsAmountBounds.json'
Skipping '/home/dtopz/code/github/ethereum/tests/BlockchainTests/InvalidBlocks/bc4895-withdrawals/withdrawalsIndexBounds.json'
Skipping '/home/dtopz/code/github/ethereum/tests/BlockchainTests/InvalidBlocks/bc4895-withdrawals/withdrawalsValidatorIndexBounds.json'
Skipping '/home/dtopz/code/github/ethereum/tests/BlockchainTests/InvalidBlocks/bc4895-withdrawals/withdrawalsAddressBounds.json'
Indexing complete 🦄       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100% 0:00:48

The resulting index.json file contains 22953 tests.

🔗 Related Issues

#572

✅ Checklist

• All: Set appropriate labels for the changes.
• All: Considered squashing commits to improve commit history.
• All: Added an entry to CHANGELOG.md.
• All: Considered updating the online docs in the ./docs/ directory.
• Tests: All converted JSON/YML tests from ethereum/tests have been added to converted-ethereum-tests.txt.
• Tests: Included the type and version of evm t8n tool used to locally execute test cases: e.g., ref with commit hash or geth 1.13.1-stable-3f40e65.
• Tests: Ran mkdocs serve locally and verified the auto-generated docs for new tests in the Test Case Reference are correctly formatted.

[spencer-tb]

LGTM! Amazing that we can run these now :D

[spencer-tb]

My only confusion surrounding this is why hive/consensus has >100k tests where as we only have ~20k.

Is it 22953 test files maybe? Will have another look

[danceratopz]

My only confusion surrounding this is why hive/consensus has >100k tests where as we only have ~20k.

Is it 22953 test files maybe? Will have another look

Good question! @winsvega moved non-Cancun tests to "legacy tests" in the ethereum/tests branch being used here. We should try loading those tests too.

[marioevz]

LGTM, thanks!

[winsvega]

My only confusion surrounding this is why hive/consensus has >100k tests where as we only have ~20k.
Is it 22953 test files maybe? Will have another look

Good question! @winsvega moved non-Cancun tests to "legacy tests" in the ethereum/tests branch being used here. We should try loading those tests too.

This is to save time and to be able to edit existing tests without breaking anything.
Passing legacy tests should be enough to be able to sync with cancun mainnet. If not, then the mainnet covers all cases for up to cancun implementation.

The main tests are on >=Cancun to ensure that from current point on there will be no async hardforks. Thats why we focus on those.

[spencer-tb]

Perfect! Yeah this makes a lot of sense. There is no point in maintaining the older fork versions of the tests in my eyes.

But still a nice to have!

We should try loading those tests too.

Agreed!

Happy for you to merge this :)