Add testdriver support for WebDriver BiDi #45823
Merged
Community-TC Integration / wpt-firefox-nightly-results
succeeded
Aug 5, 2024 in 5m 1s
Community-TC (pull_request)
Collect results for all tests affected by a pull request in firefox.
Details
View task in Taskcluster
View logs in Taskcluster
WPT Command: python3 ./wpt run --channel=nightly --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --binary=/home/test/build/firefox/firefox firefox
Setting default value
Failed to read: session.screen0.slit.layer
Setting default value
Failed to read: session.screen0.toolbar.autoHide
Setting default value
Failed to read: session.screen0.toolbar.maxOver
Setting default value
Failed to read: session.screen0.toolbar.visible
Setting default value
Failed to read: session.screen0.toolbar.alpha
Setting default value
Failed to read: session.screen0.toolbar.layer
Setting default value
Failed to read: session.screen0.toolbar.onhead
Setting default value
Failed to read: session.screen0.toolbar.placement
Setting default value
Failed to read: session.screen0.toolbar.height
Setting default value
Failed to read: session.screen0.iconbar.mode
Setting default value
Failed to read: session.screen0.iconbar.alignment
Setting default value
Failed to read: session.screen0.iconbar.iconWidth
Setting default value
Failed to read: session.screen0.iconbar.iconTextPadding
Setting default value
Failed to read: session.screen0.iconbar.usePixmap
Setting default value
ERROR: Command errored out with exit status 1:
command: /home/test/web-platform-tests/_venv3/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-r_1k6h9x/mozdebug/setup.py'"'"'; __file__='"'"'/tmp/pip-install-r_1k6h9x/mozdebug/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-dun69bmd
cwd: /tmp/pip-install-r_1k6h9x/mozdebug/
Complete output (6 lines):
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'bdist_wheel'
----------------------------------------
ERROR: Failed building wheel for mozdebug
ERROR: Command errored out with exit status 1:
command: /home/test/web-platform-tests/_venv3/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-r_1k6h9x/mozlog/setup.py'"'"'; __file__='"'"'/tmp/pip-install-r_1k6h9x/mozlog/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-9w3mcklc
cwd: /tmp/pip-install-r_1k6h9x/mozlog/
Complete output (6 lines):
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'bdist_wheel'
----------------------------------------
ERROR: Failed building wheel for mozlog
0:00.00 INFO Set tests_root to /home/test/web-platform-tests
0:00.00 INFO Set metadata_root to /home/test/web-platform-tests
0:00.00 INFO Set manifest_update to True
0:00.00 INFO Set manifest_download to True
ERROR: Command errored out with exit status 1:
command: /home/test/web-platform-tests/_venv3/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-3bxm_62c/mozdevice/setup.py'"'"'; __file__='"'"'/tmp/pip-install-3bxm_62c/mozdevice/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-sc0wa2ku
cwd: /tmp/pip-install-3bxm_62c/mozdevice/
Complete output (6 lines):
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'bdist_wheel'
----------------------------------------
ERROR: Failed building wheel for mozdevice
ERROR: Command errored out with exit status 1:
command: /home/test/web-platform-tests/_venv3/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-3bxm_62c/mozprofile/setup.py'"'"'; __file__='"'"'/tmp/pip-install-3bxm_62c/mozprofile/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-npheof8m
cwd: /tmp/pip-install-3bxm_62c/mozprofile/
Complete output (6 lines):
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'bdist_wheel'
----------------------------------------
ERROR: Failed building wheel for mozprofile
ERROR: Command errored out with exit status 1:
command: /home/test/web-platform-tests/_venv3/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-3bxm_62c/mozrunner/setup.py'"'"'; __file__='"'"'/tmp/pip-install-3bxm_62c/mozrunner/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-64m0erah
cwd: /tmp/pip-install-3bxm_62c/mozrunner/
Complete output (6 lines):
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'bdist_wheel'
----------------------------------------
ERROR: Failed building wheel for mozrunner
0:13.15 INFO Identified 1 affected tests
0:13.15 INFO Using certutil /usr/bin/certutil
0:13.15 INFO Downloading geckodriver
0:13.15 INFO Attempting to install webdriver from nightly
0:13.59 INFO Extracted geckodriver to /home/test/web-platform-tests/_venv3/bin/geckodriver
0:13.60 INFO Installed b'geckodriver 0.35.0 (9f0a0036bea4 2024-08-03 07:11 +0000)'
0:13.62 INFO Downloading test prefs from https://hg.mozilla.org/mozilla-central/archive/tip.zip/testing/profiles/
0:17.28 INFO Test prefs downloaded to /home/test/web-platform-tests/_venv3/profiles/nightly/130.0
0:17.42 mozversion INFO application_buildid: 20240804212000
0:17.42 mozversion INFO application_changeset: f19c35b800f5811afa4b529f7821b073b2f10590
0:17.42 mozversion INFO application_display_name: Firefox Nightly
0:17.42 mozversion INFO application_id: {ec8030f7-c20a-464f-9b0e-13a3a9e97384}
0:17.42 mozversion INFO application_name: Firefox
0:17.42 mozversion INFO application_remotingname: firefox-nightly
0:17.42 mozversion INFO application_repository: https://hg.mozilla.org/mozilla-central
0:17.42 mozversion INFO application_vendor: Mozilla
0:17.42 mozversion INFO application_version: 130.0a1
0:17.42 mozversion INFO platform_buildid: 20240804212000
0:17.42 mozversion INFO platform_changeset: f19c35b800f5811afa4b529f7821b073b2f10590
0:17.42 mozversion INFO platform_repository: https://hg.mozilla.org/mozilla-central
0:17.42 mozversion INFO platform_version: 130.0a1
0:22.50 INFO Installed font: Ahem.ttf
0:23.31 wptserve INFO Starting http server on http://127.0.0.1:8002
0:23.40 wptserve INFO Starting http server on http://127.0.0.1:8000
0:23.40 wptserve INFO Starting http server on http://127.0.0.1:8001
0:23.46 wptserve INFO Starting http server on http://127.0.0.1:8003
0:23.46 wptserve INFO Starting https server on https://127.0.0.1:8446
0:23.47 wptserve INFO Starting https server on https://127.0.0.1:8445
0:23.48 wptserve INFO Starting https server on https://127.0.0.1:8443
0:23.48 wptserve INFO Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
0:23.48 wptserve INFO Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
0:23.48 wptserve INFO Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
0:23.50 wptserve INFO Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
0:23.50 wptserve INFO Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
0:23.50 wptserve INFO Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
0:23.50 wptserve INFO Starting https server on https://127.0.0.1:8444
0:23.52 wptserve INFO Starting http2 server on https://127.0.0.1:9000
0:23.57 wptserve INFO Starting WebTransport over HTTP/3 server on 127.0.0.1:11000
0:23.74 SUITE_START: web-platform-test - running 1 tests
0:29.90 INFO Using 1 child processes
0:29.91 INFO Setting up ssl
0:29.94 certutil Full command: /usr/bin/certutil -N -d /tmp/tmpo0avysa9.mozrunner -f /tmp/tmpo0avysa9.mozrunner/.crtdbpw
certutil b''
0:29.97 certutil b''
0:29.98 certutil b'\nCertificate Nickname Trust Attributes\n SSL,S/MIME,JAR/XPI\n\nweb-platform-tests CT,, \n'
0:29.98 INFO Application command: /home/test/build/firefox/firefox --marionette about:blank -profile /tmp/tmps_e5pjzo
0:29.99 INFO Starting runner
0:30.45 pid:1391 Full command: /home/test/build/firefox/firefox --marionette about:blank
pid:1391 [GFX1-]: glxtest: libpci missing
0:30.46 pid:1391 ATTENTION: default value of option mesa_glthread overridden by environment.
0:30.53 pid:1391 1722854684910 Marionette INFO Marionette enabled
0:30.60 pid:1391 1722854684975 Marionette INFO Listening on port 57087
Failed to read: session.screen0.titlebar.left
Setting default value
Failed to read: session.screen0.titlebar.right
Setting default value
0:32.76 pid:1391 console.error: ({})
0:33.46 pid:1391 [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
0:33.46 pid:1391 console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error for Amo: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
0:33.46 pid:1391 [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
0:33.47 pid:1391 console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error for Amp: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
0:33.48 pid:1391 [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
0:33.48 pid:1391 console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error for Wikipedia: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
0:33.48 pid:1391 [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
0:33.48 pid:1391 console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error for Mdn: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
0:33.50 pid:1391 [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
0:33.50 pid:1391 console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error for Yelp: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
0:33.58 TEST_START: /infrastructure/webdriver/bidi/subscription.html
0:33.72 WARNING Traceback (most recent call last):
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 766, in process_action
action_handler = self.actions[action]
KeyError: 'bidi.session.subscribe'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 898, in run_func
self.result = True, self.func(self.protocol, self.url, self.timeout)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 1024, in do_testharness
done, rv = handler(result)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 755, in __call__
return callback(url, payload)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 768, in process_action
raise ValueError(f"Unknown action {action}") from e
ValueError: Unknown action bidi.session.subscribe
0:33.72 TEST_END: ERROR, expected OK - Traceback (most recent call last):
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 766, in process_action
action_handler = self.actions[action]
KeyError: 'bidi.session.subscribe'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 898, in run_func
self.result = True, self.func(self.protocol, self.url, self.timeout)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 1024, in do_testharness
done, rv = handler(result)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 755, in __call__
return callback(url, payload)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 768, in process_action
raise ValueError(f"Unknown action {action}") from e
ValueError: Unknown action bidi.session.subscribe
0:33.72 INFO No more tests
0:33.72 pid:1391 1722854688096 Marionette INFO Stopped listening on port 57087
0:34.38 INFO Browser exited with return code 0
0:34.18 INFO Closing logging queue
0:34.18 INFO queue closed
0:34.39 SUITE_END
web-platform-test
~~~~~~~~~~~~~~~~~
Ran 1 checks (1 tests)
Expected results: 0
Unexpected results: 1
test: 1 (1 error)
Unexpected Results
------------------
ERROR /infrastructure/webdriver/bidi/subscription.html - Traceback (most recent call last):
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 766, in process_action
action_handler = self.actions[action]
KeyError: 'bidi.session.subscribe'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 898, in run_func
self.result = True, self.func(self.protocol, self.url, self.timeout)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 1024, in do_testharness
done, rv = handler(result)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 755, in __call__
return callback(url, payload)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 768, in process_action
raise ValueError(f"Unknown action {action}") from e
ValueError: Unknown action bidi.session.subscribe
0:34.39 INFO Got 1 unexpected results, with 0 unexpected passes
0:34.40 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
0:34.69 wptserve INFO Stopped http server on 127.0.0.1:8000
0:34.77 wptserve INFO Stopped http server on 127.0.0.1:8003
0:34.77 wptserve INFO Stopped http server on 127.0.0.1:8445
0:34.77 wptserve INFO Stopped http server on 127.0.0.1:8001
0:34.77 wptserve INFO Stopped http server on 127.0.0.1:8446
0:34.77 wptserve INFO Stopped http server on 127.0.0.1:8002
0:34.77 wptserve INFO Stopped http server on 127.0.0.1:8443
0:34.77 wptserve INFO Stopped http server on 127.0.0.1:8444
0:34.77 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
0:34.77 wptserve INFO Stopped http server on 127.0.0.1:9000
0:34.77 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
0:34.87 INFO Removed font: Ahem.ttf
0:34.89 INFO Closing logging queue
0:34.89 INFO queue closed
0:34.89 INFO Tolerating 1 unexpected results
[taskcluster 2024-08-05 10:44:50.928Z] === Task Finished ===
[taskcluster 2024-08-05 10:44:51.803Z] Successful task run with exit code: 0 completed in 95.943 seconds
Loading