Stabilize flags for doctest cross compilation #137096

ehuss · 2025-02-15T19:58:09Z

This makes the following changes in preparation for supporting doctest cross-compiling in cargo:

Renames --runtool and --runtool-arg to --test-runtool and --test-runtool-arg to maintain consistency with other --test-* arguments.
Stabilizes the --test-runtool and --test-runtool-arg. These are needed in order to support cargo's target.runner option which specifies a runner to execute a cross-compiled doctest (for example, qemu).
Stabilizes the --enable-per-target-ignores flag by removing it and making it unconditionally enabled. This makes it possible to disable a doctest on a per-target basis, which I think will be helpful for rolling out this feature.

These changes were suggested in https://rust-lang.zulipchat.com/#narrow/channel/266220-t-rustdoc/topic/stabilizing.20doctest.20xcompile/near/409281127

The intent is to stabilize the doctest-xcompile feature in cargo. This will help ensure that for projects that do cross-compile testing that their doctests are also covered. Currently there is a somewhat surprising behavior that they are ignored.

Closes #64245

try-job: x86_64-msvc-1

rustbot · 2025-02-15T19:58:17Z

r? @fmease

rustbot has assigned @fmease.
They will have a look at your PR within the next two weeks and either review your PR or reassign to another reviewer.

Use r? to explicitly pick a reviewer

rustbot · 2025-02-15T20:58:20Z

This PR modifies tests/run-make/. If this PR is trying to port a Makefile
run-make test to use rmake.rs, please update the
run-make port tracking issue
so we can track our progress. You can either modify the tracking issue
directly, or you can comment on the tracking issue and link this PR.

cc @jieyouxu

The Miri subtree was changed

cc @rust-lang/miri

bors · 2025-03-22T17:58:17Z

☔ The latest upstream changes (presumably #138830) made this pull request unmergeable. Please resolve the merge conflicts.

ehuss · 2025-03-23T19:59:19Z

@fmease @GuillaumeGomez Just checking if this can be put on the team's radar?

GuillaumeGomez · 2025-03-23T20:02:40Z

On my review list now. :)

GuillaumeGomez · 2025-03-23T22:24:15Z

I think they've been around for enough time. Let's start an FCP then.

@rfcbot fcp merge

rfcbot · 2025-03-23T22:24:17Z

Team member @GuillaumeGomez has proposed to merge this. The next step is review by the rest of the tagged team members:

Concerns:

~~forwarding-multi-args-mechanism~~ resolved by Stabilize flags for doctest cross compilation #137096 (comment)

Once a majority of reviewers approve (and at most 2 approvals are outstanding), this will enter its final comment period. If you spot a major issue that hasn't been raised at any point in this process, please speak up!

See this document for info about what commands tagged team members can give me.

src/doc/rustdoc/src/command-line-arguments.md

src/doc/rustdoc/src/write-documentation/documentation-tests.md

tests/rustdoc/doctest/doctest-runtool.rs

ehuss · 2025-03-28T01:24:52Z

In playing around with this, I noticed a slight annoyance when using --edition=2024 and mergeable tests. It always prints:

WARNING: No rustdoc doctest environment variable provided so doctests will be run in the same process

I'm wondering if it would make sense to somehow silence that warning when using --test-runtool?

I'm also wondering if it is the right choice to run in the same process. I could see arguments either way. Let me know if you have any opinion on that.

This renames `--runtool` and `--runtool-arg` to `--test-runtool` and `--test-runtool-arg` to maintain consistency with other `--test-*` arguments.

This removes the `--enable-per-target-ignores` and enables it unconditionally.

tests/run-make/rustdoc-default-output/output-default.stdout

notriddle · 2025-04-14T21:22:41Z

https://rust-lang.zulipchat.com/#narrow/channel/393423-t-rustdoc.2Fmeetings/topic/2025-04-14/near/512154144

In the meeting, we agreed that the shell-like lexing is bad, and so is splitting on spaces. --test-args ought to be deprecated in favor of --test-arg, and --doctest-compilation-args should be replaced with --doctest-compilation-arg.

fmease · 2025-04-14T21:27:07Z

@rfcbot resolve forwarding-multi-args-mechanism

I'll be creating a separate PR for these flags.

rfcbot · 2025-04-14T21:27:14Z

🔔 This is now entering its final comment period, as per the review above. 🔔

rfcbot · 2025-04-24T21:28:20Z

The final comment period, with a disposition to merge, as per the review above, is now complete.

As the automated representative of the governance process, I would like to thank the author for their work and everyone else who contributed.

This will be merged soon.

fmease · 2025-04-24T21:36:19Z

Thanks everyone! @bors r+ rollup

bors · 2025-04-24T21:36:22Z

📌 Commit 115341f has been approved by fmease

It is now in the queue for this repository.

…iaskrgr Rollup of 8 pull requests Successful merges: - rust-lang#137096 (Stabilize flags for doctest cross compilation) - rust-lang#140148 (CI: use aws codebuild for job dist-arm-linux) - rust-lang#140187 ([AIX] Handle AIX dynamic library extensions within c-link-to-rust-dylib run-make test) - rust-lang#140196 (Improved diagnostics for non-primitive cast on non-primitive types (`Arc`, `Option`)) - rust-lang#140210 (Work around cygwin issue on condvar timeout) - rust-lang#140213 (mention about `x.py setup` in `INSTALL.md`) - rust-lang#140229 (`DelimArgs` tweaks) - rust-lang#140248 (Fix impl block items indent) r? `@ghost` `@rustbot` modify labels: rollup

Rollup merge of rust-lang#137096 - ehuss:stabilize-doctest-xcompile, r=fmease Stabilize flags for doctest cross compilation This makes the following changes in preparation for supporting doctest cross-compiling in cargo: - Renames `--runtool` and `--runtool-arg` to `--test-runtool` and `--test-runtool-arg` to maintain consistency with other `--test-*` arguments. - Stabilizes the `--test-runtool` and `--test-runtool-arg`. These are needed in order to support cargo's `target.runner` option which specifies a runner to execute a cross-compiled doctest (for example, qemu). - Stabilizes the `--enable-per-target-ignores` flag by removing it and making it unconditionally enabled. This makes it possible to disable a doctest on a per-target basis, which I think will be helpful for rolling out this feature. These changes were suggested in https://rust-lang.zulipchat.com/#narrow/channel/266220-t-rustdoc/topic/stabilizing.20doctest.20xcompile/near/409281127 The intent is to stabilize the doctest-xcompile feature in cargo. This will help ensure that for projects that do cross-compile testing that their doctests are also covered. Currently there is a somewhat surprising behavior that they are ignored. Closes rust-lang#64245 try-job: x86_64-msvc-1

This updates the flags used for doctest xcompile to match the upstream changes in rust-lang/rust#137096 which renamed the flag.

This updates the flags used for doctest xcompile to match the upstream changes in rust-lang/rust#137096 which renamed and stabilized the flags.

This updates the flags used for doctest xcompile to match the upstream changes in rust-lang/rust#137096 which renamed and stabilized the flags. This cannot be merged until after nightly is published tonight.

rustbot assigned fmease Feb 15, 2025

fmease added the needs-fcp This change is insta-stable, so needs a completed FCP to proceed. label Feb 15, 2025

ehuss mentioned this pull request Feb 15, 2025

Tracking Issue for Cross Compiling Doctests #64245

Closed

This comment has been minimized.

Sign in to view

ehuss force-pushed the stabilize-doctest-xcompile branch from ab9d4c8 to a676b04 Compare February 15, 2025 20:58

rustbot added the A-run-make Area: port run-make Makefiles to rmake.rs label Feb 15, 2025

This comment has been minimized.

Sign in to view

ehuss force-pushed the stabilize-doctest-xcompile branch from a676b04 to 8aaa90b Compare February 15, 2025 22:01

ehuss force-pushed the stabilize-doctest-xcompile branch 2 times, most recently from a0799de to ddc6525 Compare March 22, 2025 23:04

GuillaumeGomez approved these changes Mar 23, 2025

View reviewed changes

rfcbot added proposed-final-comment-period Proposed to merge/close by relevant subteam, see T-<team> label. Will enter FCP once signed off. disposition-merge This issue / PR is in PFCP or FCP with a disposition to merge it. labels Mar 23, 2025

notriddle requested changes Mar 27, 2025

View reviewed changes

src/doc/rustdoc/src/command-line-arguments.md Outdated Show resolved Hide resolved

src/doc/rustdoc/src/write-documentation/documentation-tests.md Outdated Show resolved Hide resolved

tests/rustdoc/doctest/doctest-runtool.rs Show resolved Hide resolved

This comment has been minimized.

Sign in to view

ehuss added 4 commits March 27, 2025 19:04

Add test for doctest runtool

0340a86

Rename --runtool and --runtool-arg

ec25e33

This renames `--runtool` and `--runtool-arg` to `--test-runtool` and `--test-runtool-arg` to maintain consistency with other `--test-*` arguments.

Stabilize --test-runtool and --test-runtool-arg

6441701

Remove and stabilize --enable-per-target-ignores

7251b46

This removes the `--enable-per-target-ignores` and enables it unconditionally.

fmease mentioned this pull request Apr 9, 2025

Doctests do not set profile codegen options rust-lang/cargo#6570

Open

notriddle reviewed Apr 14, 2025

View reviewed changes

tests/run-make/rustdoc-default-output/output-default.stdout Outdated Show resolved Hide resolved

Fix grammar of --test-runtool-arg help text

115341f

rfcbot added final-comment-period In the final comment period and will be merged soon unless new substantive objections are raised. and removed proposed-final-comment-period Proposed to merge/close by relevant subteam, see T-<team> label. Will enter FCP once signed off. labels Apr 14, 2025

This was referenced Apr 15, 2025

rustdoc: Replace unstable flag --doctest-compilation-args with a simpler one: --doctest-build-arg #139863

Open

rustdoc: Deprecate option --test-args in favor of new insta-stable option --test-arg #139869

Open

rustbot mentioned this pull request Apr 24, 2025

Tracking issue for release notes of #137096: Stabilize flags for doctest cross compilation #140270

Open

bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-team Status: Awaiting decision from the relevant subteam (see the T-<team> label). labels Apr 24, 2025

matthiaskrgr mentioned this pull request Apr 24, 2025

Rollup of 8 pull requests #140273

Merged

bors merged commit 610ed82 into rust-lang:master Apr 25, 2025
6 checks passed

rustbot added this to the 1.88.0 milestone Apr 25, 2025

ehuss added a commit to ehuss/cargo that referenced this pull request Apr 25, 2025

Update doctest xcompile flags

a343813

This updates the flags used for doctest xcompile to match the upstream changes in rust-lang/rust#137096 which renamed the flag.

ehuss added a commit to ehuss/cargo that referenced this pull request Apr 25, 2025

Update doctest xcompile flags

ad333ec

This updates the flags used for doctest xcompile to match the upstream changes in rust-lang/rust#137096 which renamed and stabilized the flags.

ehuss mentioned this pull request Apr 25, 2025

Update doctest xcompile flags rust-lang/cargo#15455

Merged

ehuss added a commit to ehuss/cargo that referenced this pull request Apr 26, 2025

Update doctest xcompile flags

f10630f

This updates the flags used for doctest xcompile to match the upstream changes in rust-lang/rust#137096 which renamed and stabilized the flags.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Stabilize flags for doctest cross compilation #137096

Stabilize flags for doctest cross compilation #137096

ehuss commented Feb 15, 2025 •

edited by fmease

Loading

rustbot commented Feb 15, 2025

This comment has been minimized.

rustbot commented Feb 15, 2025

This comment has been minimized.

bors commented Mar 22, 2025

ehuss commented Mar 23, 2025

GuillaumeGomez commented Mar 23, 2025

GuillaumeGomez commented Mar 23, 2025

rfcbot commented Mar 23, 2025 •

edited

Loading

ehuss commented Mar 28, 2025

This comment has been minimized.

notriddle commented Apr 14, 2025

fmease commented Apr 14, 2025

rfcbot commented Apr 14, 2025

rfcbot commented Apr 24, 2025

fmease commented Apr 24, 2025

bors commented Apr 24, 2025

Stabilize flags for doctest cross compilation #137096

Stabilize flags for doctest cross compilation #137096

Conversation

ehuss commented Feb 15, 2025 • edited by fmease Loading

rustbot commented Feb 15, 2025

This comment has been minimized.

rustbot commented Feb 15, 2025

This comment has been minimized.

bors commented Mar 22, 2025

ehuss commented Mar 23, 2025

GuillaumeGomez commented Mar 23, 2025

GuillaumeGomez commented Mar 23, 2025

rfcbot commented Mar 23, 2025 • edited Loading

ehuss commented Mar 28, 2025

This comment has been minimized.

notriddle commented Apr 14, 2025

fmease commented Apr 14, 2025

rfcbot commented Apr 14, 2025

rfcbot commented Apr 24, 2025

fmease commented Apr 24, 2025

bors commented Apr 24, 2025

ehuss commented Feb 15, 2025 •

edited by fmease

Loading

rfcbot commented Mar 23, 2025 •

edited

Loading