Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable state tests for constantinople #1152

Closed
cburgdorf opened this issue Aug 7, 2018 · 4 comments
Closed

Enable state tests for constantinople #1152

cburgdorf opened this issue Aug 7, 2018 · 4 comments

Comments

@cburgdorf
Copy link
Contributor

What is wrong?

We currently do not run state tests against Constantinople.

How can it be fixed

  • Pin the fixtures submodule to a newer version that contains the Constantinople tests (lookup which version geth is pinned against)
  • Configure tests to run
  • Make tests green
@cburgdorf
Copy link
Contributor Author

I think I pushed this one as far as I could (see #1181) Both, the Py-EVM and ethereum/tests need to do some work before we can finish that.

@veox
Copy link
Contributor

veox commented Aug 30, 2018

FTR, I'm trying to tease apart the issues, by first updating the fixtures, in PR #1224.

I've determined the last successful merge commit in ethereum/tests that py-evm still passes (test_state_fixtures in particular, since that's what's failing in PR #1181). Used git bisect run for that, with a script; but it basically amounts to:

source .virtualenv/*/bin/activate
cd fixtures
git checkout develop
git bisect start develop 47b09f42c0681548a00da5ab1c98808b368af49a --
git bisect run sh -c "cd .. && pytest --cache-clear --quiet --exitfirst --show-capture=no -k 'test_state_fixtures'"
git bisect log

I also tried every merge commit from current develop to db8ae9de (also in an automated manner), and they all have at least one failure.


I think it'd be best to update the fixtures first before enabling ConstantinopleVM. Will try to step through the state failures one-by-one, to see which end (py-evm or ethereum/tests) is the culprit.


EDIT: For ref, here's a gist of merge commits in ethereum/tests that have failures ATM.

@veox
Copy link
Contributor

veox commented Oct 3, 2018

See #1224 (comment) for status of the approach after PR #1224 was merged.

There were seemingly changes in the test specification format, and it might not be prudent to try and "break through" those ethereum/tests commits without understanding the changes first; and whether they're still relevant, or can be "jumped over".

(FTR, I've laid off working on this.)

@carver
Copy link
Contributor

carver commented Dec 13, 2018

Confirmed finished in #1579

@carver carver closed this as completed Dec 13, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants