Dask Runner Options test failure.

[alxmrs]

    Thanks. Python Precommit showing following test failure: https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/6286/

apache_beam.runners.dask.dask_runner_test.DaskOptionsTest.test_parser_destinations__agree_with_dask_client

AssertionError: 'vpt_vp_arg3' not found in ['address', 'loop', 'timeout', 'set_as_default', 'scheduler_file', 'security', 'asynchronous', 'name', 'heartbeat_interval', 'serializers', 'deserializers', 'extensions', 'direct_to_workers', 'connection_limit', 'kwargs']

apache_beam.runners.dask.dask_runner_test.DaskRunnerRunPipelineTest.test_create

TypeError: __init__() got an unexpected keyword argument 'vpt_vp_arg3'

Originally posted by @Abacn in #22421 (comment)

[alxmrs]

@Abacn: I have a question for you about this test – shouldn't the unexpected argument be dropped due to drop_defaults=True and retain_unknown_options=False?

beam/sdks/python/apache_beam/runners/dask/dask_runner_test.py

Line 61 in 735cb7b

for opt_name in dask_options.get_all_options(drop_default=True).keys():

[Abacn]

The unexpected vpt_vp_arg3 is from here:

beam/sdks/python/apache_beam/options/value_provider_test.py

Line 77 in 8a1aad6

def test_static_value_provider_positional_argument(self):

Looks like the test is contaminating some pipeline option namespace.

[pabloem]

Thanks for catching it. I am deactivating coverage tests in #23841, which seems like it can work around this issue for now.