[Test API] not able to disable individual test run/debug with RunProfile

[connectdotz]

Issue Type: Bug

In our extension (vscode-jest), we used the external jest watcher to auto-run tests when the tests or related source files change. In such use case, we used to disable manual test run for the individual test items (TestItem.runnable = false), while still supporting "restarting" the jest watch run for the workspace item. However, after switching to the new RunProfile, we lost the ability to disable the test run on the TestItem level and it would not make sense to fall back to "restart" jest run for the whole workspace...

Similar issue for debugging: we used to only support debugging on the file and individual test level, how to achieve this with the RunProfile?

We end up throwing errors in runTest to prevent the unsupported run/debug, which of course is not ideal. I know this issue has been raised in other discussions, this is now impacting our implementation, hopefully, it will get more urgent priority before release.

VS Code version: Code - Insiders 1.59.0-insider (Universal) (955a1ac, 2021-07-26T05:12:43.446Z)
OS version: Darwin x64 20.6.0
Restricted Mode: No

System Info

Item	Value
CPUs	Intel(R) Core(TM) i7-8700B CPU @ 3.20GHz (12 x 3200)
GPU Status	2d_canvas: enabled gpu_compositing: enabled metal: disabled_off multiple_raster_threads: enabled_on oop_rasterization: enabled opengl: enabled_on rasterization: enabled skia_renderer: disabled_off_ok video_decode: enabled webgl: enabled webgl2: enabled
Load (avg)	3, 4, 3
Memory (System)	32.00GB (2.79GB free)
Process Argv	--enable-proposed-api Orta.vscode-jest --crash-reporter-id bb07f68d-9e6c-4982-a12f-528f81d06cb6
Screen Reader	no
VM	0%

[connor4312]

The plan for this is to introduce test tags: #122208 (comment) (edit: dedicated issue for it #129456 )

Let me know if you see any problems with that for your scenario.

[connectdotz]

thanks, @connor4312 As long as we can enable/disable the runProfiles at the TestItem level and update the UI (run/debug buttons) accordingly, it should work. But maybe we can get away with yet another identifier like tags? Anyway, I left the comment in #129456 for further discussion

[connor4312]

Ok, cool. Let's merge this into that one then