-
Notifications
You must be signed in to change notification settings - Fork 329
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Query tests #184
Query tests #184
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not quite sure I understand the CI config changes, but the tests otherwise look good to me 👍
By the way, here's a quick and dirty solution for handling both local colored output and CI plain output so that one can run the locally as well: https://docs.rs/strip-ansi-escapes/0.1.0/strip_ansi_escapes/
We can deal properly with colors in a future PR.
CI config changes: This previous setup is not very useful because as it turns out This new setup comments out the currently unusable test. In the future (when The new setup establishes the use of the In the future, the current |
I looked into using I should be able to extract the stdout from the result and manually strip it and parse it. All I'm losing is the nice feature where I hand over a Vector of strings and it automatically parses items as lines of the stdout, but I should be able to reimplement that (or parse out the first line, which is all we need.) I feel we're trying to apply a quick and dirty solution that guts out some of the Abscissa features which is the main point of using Abscissa testing. I'd rather hold on with this and implement the currently agreed method of leaving out Abscissa and command-line parsing from testing. How does that sound? If you feel strongly about applying |
I've implemented the three tests without abscissa too. Based on my experience we should remove the abscissa tests, they are not needed and the new tests are more robust. As a next step, I would like to decompose the "simd" service into some mocked chain, but I need some more information on that. I'm not sure if that should go into this PR or a separate one. |
Sure, that sounds good! I was just mentioning as a potential quick and dirty hack, but didn't realize it wouldn't even work in that case. |
Thanks for the explanation! I am fine with leaving the commented out config, but we should perhaps add a comment there explaining why it's commented out. |
Good point about the CI. I looked through it again and realized that it's not worth keeping it. In this last commit, I
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks great! Much more readable, but also much more robust since we are not testing against the output of the CLI, which will likely change substantially in the future. Great job :)
* Query tests using abscissa * Old integration test disabled for now * Sad typo fix * Disabled color on acceptance tests * Retarget integration tests to pull_requests * Added query tests without using abscissa * Removed Abscissa testing, cleaned up CI folder * fmt sad fix
Description
This is a first stab at testing the queries in the relayer-cli. It uses abscissa's acceptance testing method.
This method is hard to troubleshoot and configuration is not granular enough. It works fine, so we should use it until better methods are implemented.
The relevant issues are already closed (#130, cosmos/ibc-rs#130, #151) but testing was missing there.
For contributor use:
docs/
) and code commentsFiles changed
in the Github PR explorer