Skip to content

Tests update 17.1: Reorganization

Latest
Latest
Compare
Choose a tag to compare
@winsvega winsvega released this 13 May 14:50
· 2 commits to develop since this release
v17.1
08b5fe3

The recent tests changes:

Archive Transition tests to legacy tests repo
Unify _info section with pyspecs format
Test name inside files in pyspecs format
Insert Prague precompiles into blockchain version of the tests

From now on there would be no new test vectors in this repository and existing ones will slowly be converted into https://github.com/ethereum/execution-spec-tests.
NOTE: Pyspecs doesn't cover all the vectors from this repo, but has many new vectors that are not covered in ethereum/tests
Eventually there will be only ethereum/legacytests repo with all .json tests from Frontier to Cancun.
And ethereum/execution-spec-tests will handle all the official ethereum testing vectors for all the froks.

Announcement

New docker instructions for all t8n supported clients: https://github.com/ethereum/retesteth/tree/develop#docker-instructions
The test process diagram: https://tinyurl.com/y525ezs7
Reminder of a brand new web interface for test debugging: http://retesteth.ethdevops.io/web/
Tests stats on latest builds: http://retesteth.ethdevops.io/
(implement test RPC support or t8ntool protocol to apply for the page. https://ethereum-tests.readthedocs.io/en/latest/t8ntool-ref.html)
Previous release link: https://github.com/ethereum/tests/releases/tag/v17.0

Test format

Tests Fillers

BlockchainTests/TransitionTests folders are deleted

GeneralStateTests/BlockchainTests Filled

BlockchainTests/TransitionTests folders are deleted

Field change in _info section:
generatedTestHash renamed to hash
new field repo == ethereum/tests

Test Regeneration

Update all:

PR #1489

  • Documentation

TESTS

  • Archive transition tests to legacy tests
    PR #1473

Converted to python Tests

  • Remove converted blake2 tests
    PR #1479

  • Remove EOF Stack tests
    PR #1478

  • Remove converted EOF JUMPF stack overflow tests
    PR #1481

  • delete converted EOF stack underflow tests
    PR #1476

  • **Remove non constant stack EOF tests **
    PR #1483

  • delete converted EOF RJUMP to self tests*
    PR #1485

  • Remove stack range maximally broad
    PR #1484

  • Remove converted EOF CALLF stack overflow tests
    PR #1474

  • remove converted calldataload and calldatasize tests
    PR #1477

  • remove converted instrinsic gas tests*
    PR #1488

  • remove test scenarios
    PR #1490

Cosmetic

Upcoming changes:

Support ALL existing .json tests with pyspecs consume
Convert .json .yml yo .py

Assets 2
Loading