Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement resource usage CI nightly #1416

Open
rachitnigam opened this issue Apr 22, 2023 · 0 comments
Open

Implement resource usage CI nightly #1416

rachitnigam opened this issue Apr 22, 2023 · 0 comments
Labels
Status: Available Can be worked upon

Comments

@rachitnigam
Copy link
Contributor

rachitnigam commented Apr 22, 2023

The idea is to have a nightly that builds the latest version of the compiler, runs Vivado synthesis for a bunch of benchmarks, and uploads the results somewhere so they can be compared day-to-day. This will make for a good impetus to make the resource usage of designs generated by Calyx to go down over time.

I think we want the following desiderata:

  1. Easy to add a new benchmark: You should be able to add a file in a folder somewhere in the repo and the nightly should start synthesizing it
  2. Continuous: The nightly should track resource usage over many months so that we can see how each PR affects the resource usage
  3. Redeployable: It would be nice if we could setup specific, private versions of this nightly for each paper. For example, the AMC and Calyx 2.0 people might both be pushing on a paper at the same time and use something like this to track the resource changes over time.
  4. Extensible: Make it easy for people to add binaries to the working environment (probably a docker container) and use that to support new frontends. Again, thinking about AMC folks, they would want to deploy new versions of the compiler quickly and use that with the nightly

We've spent a long time making Calyx have the "right" abstractions. Now it's time to make sure that Calyx is highly competitive with the state of the art.

@rachitnigam rachitnigam added the Status: Available Can be worked upon label Apr 22, 2023
@rachitnigam rachitnigam added this to the Quality of Results milestone Apr 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Status: Available Can be worked upon
Projects
None yet
Development

No branches or pull requests

1 participant