Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(ci): update CBMC proofs' Makefile.common #4703

Merged
merged 2 commits into from
Aug 26, 2024

Conversation

tautschnig
Copy link
Contributor

Description of changes:

In order to support upcoming work that uses loop invariants we need bugfixes to build rules, porting over what was already fixed upstream in model-checking/cbmc-starter-kit#195 (and further fixes starter kit's master branch).

Testing:

Tested in CI to make sure it does not adversely affect current CBMC proofs, and tested locally with upcoming work that will introduce loop invariants.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@rod-chapman
Copy link
Contributor

I have re-generated all proofs with the change, and all is well. This is needed for moving forwards with unbounded proofs (i.e. getting rid of UNWINDSET).

Copy link
Contributor

@lrstewart lrstewart left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is marked ready for review, but the CBMC proofs are failing in CI.

tests/cbmc/proofs/Makefile.common Outdated Show resolved Hide resolved
@rod-chapman
Copy link
Contributor

The CI runs gets to:

[2616/2689] s2n_stuffer_write_uint8: checking safety properties                 
Error: The operation was canceled.

Anyone know what that means?

@lrstewart
Copy link
Contributor

lrstewart commented Aug 13, 2024

The CI runs gets to:

[2616/2689] s2n_stuffer_write_uint8: checking safety properties                 
Error: The operation was canceled.

Anyone know what that means?

It says "Failing after 360m", so I'm guessing timeout?

Edit: definitely timeout. The summary for the job says "The job running on runner cbmc_ubuntu-latest_64-core_d5623345fda5 has exceeded the maximum execution time of 360 minutes."

@rod-chapman
Copy link
Contributor

I am trying to reproduce this problem on an EC2 instance now.

@rod-chapman
Copy link
Contributor

All proofs run fine on a 32-Core EC2 instance in about 7 minutes, so not sure what's wrong here.

@tautschnig tautschnig force-pushed the update-CBMC-Makefile.common branch 6 times, most recently from 14c8319 to aa93ac2 Compare August 16, 2024 15:14
@tautschnig
Copy link
Contributor Author

This is marked ready for review, but the CBMC proofs are failing in CI.

This is now fixed, we had to retain malloc-may-fail for coverage checking.

@dougch dougch added the CBMC Anything related to CBMC proofs. label Aug 21, 2024
In order to support upcoming work that uses loop invariants we need
bugfixes to build rules, porting over what was already fixed upstream in
model-checking/cbmc-starter-kit#195 (and further
fixes starter kit's master branch).
@rod-chapman
Copy link
Contributor

I have re-run all proofs on Intel/EC2 this morning on this branch, using both a wavefront build of CBMC, and release 6.1.0. All seems well. Can we get this merged now?

@lrstewart lrstewart enabled auto-merge (squash) August 26, 2024 16:27
@lrstewart lrstewart enabled auto-merge (squash) August 26, 2024 17:07
@tautschnig
Copy link
Contributor Author

What to make of the S2nIntegrationV2SmallBatch failure?

@camshaft
Copy link
Contributor

we've got a few flaky tests that need to be fixed. i just retried the failed job.

@lrstewart lrstewart merged commit ada65a7 into aws:main Aug 26, 2024
36 checks passed
@tautschnig tautschnig deleted the update-CBMC-Makefile.common branch August 27, 2024 09:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CBMC Anything related to CBMC proofs.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants