Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add edition configuration to compiletest #90070

Merged
merged 1 commit into from
Oct 23, 2021

Conversation

llogiq
Copy link
Contributor

@llogiq llogiq commented Oct 19, 2021

This allows the compiletest configuration to set a default edition that can still be overridden with header annotations. Doing this will make it far easier for clippy to get our tests to the newest edition.

r? @Manishearth

@rust-highfive rust-highfive added the S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. label Oct 19, 2021
@llogiq llogiq force-pushed the compiletest-config-edition branch from a629541 to face139 Compare October 19, 2021 21:18
@llogiq
Copy link
Contributor Author

llogiq commented Oct 19, 2021

@Manishearth did you mean to r+?

@Mark-Simulacrum
Copy link
Member

Out of interest, is there a reason clippy want to blanket upgrade tests? rustc has been pretty happy I think with the existing defaults.

@Manishearth
Copy link
Member

@llogiq nah because I wanted to check again on desktop

important note: clippy uses https://github.com/Manishearth/compiletest-rs . I'd love to share compiletest with that of rustc but that has been hard to make happen.

@Manishearth
Copy link
Member

Anyway, I'd merge this if this were on compiletest-rs, i'll let the compiler team review it here

@llogiq
Copy link
Contributor Author

llogiq commented Oct 19, 2021

The reason is we want to use the new edition for all of our tests and writing an edition header in 548 files gets old rather quickly.

@llogiq
Copy link
Contributor Author

llogiq commented Oct 19, 2021

@Manishearth should I push the same PR to compiletest-rs?

@Manishearth
Copy link
Member

Yes please

@Mark-Simulacrum
Copy link
Member

The reason is we want to use the new edition for all of our tests and writing an edition header in 548 files gets old rather quickly.

Yes, but I'm asking why you have that goal. Happy to be pointed at PR/issue comments.

@Manishearth
Copy link
Member

Mostly because of rust-lang/rust-clippy#7842

@Manishearth
Copy link
Member

We could do it manually too

@Mark-Simulacrum
Copy link
Member

That issue does not have justification for why you want that. I'm asking because that reasoning may be useful for rustc itself, but I haven't seen it yet - that issue just states the fact...

@llogiq
Copy link
Contributor Author

llogiq commented Oct 20, 2021

Apart from that, I see it as a win for usability – being able to quickly check if all tests not explicitly tied to an edition still run with a new one ought to be worth those few easy to understand lines of code.

@Mark-Simulacrum
Copy link
Member

I'm happy to r+ this to be clear, but without a better understanding of why you want this it's hard to know whether this is the right way to go about it.

For example, the desire to verify cross-edition compatibility seems better done with a compare-mode similar to the one for NLL which ensures outputs are the same and such. Obviously, you can sort of emulate it manually, but if the goal is to ensure that compatibility going forward then that's likely the way to go.

If there's no real reason for the desire to migrate all tests to 2021, that's fine, we can just accept this, but I am feeling somewhat baffled by the repeated lack of justification presented (or acknowledgement that it isn't really justified by rationale) despite repeated attempts to seek it.

@Manishearth
Copy link
Member

@Mark-Simulacrum I don't think we're asking for an r+ here anymore; though I'm sure @llogiq is happy to keep this open if y'all end up interested in taking this.

I'm a bit confused as to why you would find a lack of justification provided within 15 hours to be a "baffling repeated lack of justification".

The justification for that issue is that we've had a couple things silently break on the latest edition (like rust-lang/rust-clippy#7723) and it seems reasonable to switch defaults so that most tests are on the latest edition unless they're testing something more edition-specific. Overall the latest edition is roughly what people are using themselves, crates may stay on old editions but typically if someone is hacking on them they'll upgrade eventually, and unlike rustc clippy only really applies to folks actively hacking on something. We'd like to be testing where the actual users are at. We could run tests on all editions but that would take much longer for very little benefit in most cases, so setting the default and then using that process to find tests that should be running on different or multiple editions can be done later.

@Mark-Simulacrum
Copy link
Member

I'm a bit confused as to why you would find a lack of justification provided within 15 hours to be a "baffling repeated lack of justification".

To be clear, I was confused by the responses to my question without providing the very useful context you just posted. I don't expect quick justification, but I was confused by the responses which implicitly seemed to be justification (but didn't have it in my opinion). I was happy to wait, but the replies given seemed to try to respond but not actually do so.

It makes sense to me that there'd be bugs like this -- particularly given the much tighter integration Clippy generally has with end-user code -- but it seems like you'd want to ensure that tests that fail on new editions are still working on old editions. I guess you can manually bump edition and then use revisions to continue testing older editions on the subset of tests which fail, it's certainly more economical than blanket running tests 3 times (2015/2018/2021).

@bors r+ rollup

@bors
Copy link
Contributor

bors commented Oct 20, 2021

📌 Commit face139be09be9ad05acbfb2a40075d1d77ac000 has been approved by Mark-Simulacrum

@bors bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Oct 20, 2021
@llogiq llogiq force-pushed the compiletest-config-edition branch from face139 to dd22b67 Compare October 20, 2021 15:14
@rust-log-analyzer

This comment has been minimized.

@llogiq llogiq force-pushed the compiletest-config-edition branch from dd22b67 to 65b3c85 Compare October 20, 2021 19:55
@llogiq
Copy link
Contributor Author

llogiq commented Oct 22, 2021

Sorry @Mark-Simulacrum I failed to remove spurious whitespace. It should now build correctly.

@Mark-Simulacrum
Copy link
Member

@bors r+ rollup

@bors
Copy link
Contributor

bors commented Oct 22, 2021

📌 Commit 65b3c85 has been approved by Mark-Simulacrum

matthiaskrgr added a commit to matthiaskrgr/rust that referenced this pull request Oct 22, 2021
…r=Mark-Simulacrum

Add edition configuration to compiletest

This allows the compiletest configuration to set a default edition that can still be overridden with header annotations. Doing this will make it far easier for clippy to get our tests to the newest edition.

r? `@Manishearth`
matthiaskrgr added a commit to matthiaskrgr/rust that referenced this pull request Oct 22, 2021
…r=Mark-Simulacrum

Add edition configuration to compiletest

This allows the compiletest configuration to set a default edition that can still be overridden with header annotations. Doing this will make it far easier for clippy to get our tests to the newest edition.

r? ``@Manishearth``
bors added a commit to rust-lang-ci/rust that referenced this pull request Oct 23, 2021
…askrgr

Rollup of 11 pull requests

Successful merges:

 - rust-lang#83233 (Implement split_array and split_array_mut)
 - rust-lang#88300 (Stabilise unix_process_wait_more, extra ExitStatusExt methods)
 - rust-lang#89416 (nice_region_error: Include lifetime placeholders in error output)
 - rust-lang#89468 (Report fatal lexer errors in `--cfg` command line arguments)
 - rust-lang#89730 (add feature flag for `type_changing_struct_update`)
 - rust-lang#89920 (Implement -Z location-detail flag)
 - rust-lang#90070 (Add edition configuration to compiletest)
 - rust-lang#90087 (Sync rustfmt subtree)
 - rust-lang#90117 (Make RSplit<T, P>: Clone not require T: Clone)
 - rust-lang#90122 (CI: make docker cache download and `docker load` time out after 10 minutes)
 - rust-lang#90166 (Add comment documenting why we can't use a simpler solution)

Failed merges:

r? `@ghost`
`@rustbot` modify labels: rollup
@bors bors merged commit 1782d13 into rust-lang:master Oct 23, 2021
@rustbot rustbot added this to the 1.58.0 milestone Oct 23, 2021
@llogiq llogiq deleted the compiletest-config-edition branch October 23, 2021 11:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants