[CI] Track performance numbers on a webpage #1035
Merged
+197
−8
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Yu-Zhewen
force-pushed
the
zhewen_track_perf
branch
from
432b6d5 to
9d71481
Compare
Yu-Zhewen
changed the title
yzhang93
reviewed
Jan 17, 2025
| results_html_path = sys.argv[3] | ||
|
|
||
| # Get the results for the current run. | ||
| with open(results_json_path, "r") as f: |
There was a problem hiding this comment.
I would suggest to put everything below this to a separate function. And the main only check the arguments and call the function.
newling
approved these changes
Jan 20, 2025
| if len(sys.argv) != 4: | ||
| print( | ||
| "Usage: python3 performance_publish.py <path_to_results_json> <path_to_results_history> <path_to_results_html>\n" | ||
| "This script reads the performance results from the specified JSON file, appends them to the history file, and generates an HTML visualizarion.\n" |
There was a problem hiding this comment.
Suggested change
| "This script reads the performance results from the specified JSON file, appends them to the history file, and generates an HTML visualizarion.\n" | |
| "This script reads the performance results from the specified JSON file, appends them to the history file, and generates an HTML visualization.\n" |
Yu-Zhewen
added a commit
that referenced
this pull request
Jan 21, 2025
The workflow: - run performance benchmarks the same way as before, generating `performance.log` - convert `performance.log` into `results.json` - switch to the `gh-pages` branch - append the new `results.json` data to `results_history.json` - create `results_history.html` based on the updated `results_history.json` (only when CI is triggered from the `main` branch) - commit the updated `results_history.json` and `results_history.html` using the action bot To preview what it looks like: [https://rawcdn.githack.com/nod-ai/iree-amd-aie/a70ddbeea9d0b0d14f8ab24208efc599bc3c2f39/results_history.html](https://rawcdn.githack.com/nod-ai/iree-amd-aie/a70ddbeea9d0b0d14f8ab24208efc599bc3c2f39/results_history.html) I don’t have access to set up the webpage for this repository, but once the `gh-pages` branch is properly configured, the webpage shall be live on [https://nod-ai.github.io/iree-amd-aie/results_history.html](https://nod-ai.github.io/iree-amd-aie/results_history.html)
|
@Yu-Zhewen This site doesn't seem to be live: https://nod-ai.github.io/iree-amd-aie/results_history.html |
Some additional setup is required to configure the I don’t have the necessary access to make this change. Could someone with the appropriate permissions assist? |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The workflow:
performance.logperformance.logintoresults.jsongh-pagesbranchresults.jsondata toresults_history.jsonresults_history.htmlbased on the updatedresults_history.json(only when CI is triggered from the
mainbranch)results_history.jsonandresults_history.htmlusing the action botTo preview what it looks like: https://rawcdn.githack.com/nod-ai/iree-amd-aie/a70ddbeea9d0b0d14f8ab24208efc599bc3c2f39/results_history.html
I don’t have access to set up the webpage for this repository, but once the
gh-pagesbranch is properly configured, the webpage shall be live on https://nod-ai.github.io/iree-amd-aie/results_history.html