Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add testdriver support for WebDriver BiDi #45823

Merged
merged 2 commits into from
Aug 5, 2024

bidi server can handle user prompt

b94fcdc
Select commit
Loading
Failed to load commit list.
Merged

Add testdriver support for WebDriver BiDi #45823

bidi server can handle user prompt
b94fcdc
Select commit
Loading
Failed to load commit list.
Community-TC Integration / wpt-firefox-nightly-results succeeded Aug 5, 2024 in 5m 1s

Community-TC (pull_request)

Collect results for all tests affected by a pull request in firefox.

Details

View task in Taskcluster
View logs in Taskcluster

WPT Command: python3 ./wpt run --channel=nightly --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --binary=/home/test/build/firefox/firefox firefox


Setting default value
Failed to read: session.screen0.slit.layer
Setting default value
Failed to read: session.screen0.toolbar.autoHide
Setting default value
Failed to read: session.screen0.toolbar.maxOver
Setting default value
Failed to read: session.screen0.toolbar.visible
Setting default value
Failed to read: session.screen0.toolbar.alpha
Setting default value
Failed to read: session.screen0.toolbar.layer
Setting default value
Failed to read: session.screen0.toolbar.onhead
Setting default value
Failed to read: session.screen0.toolbar.placement
Setting default value
Failed to read: session.screen0.toolbar.height
Setting default value
Failed to read: session.screen0.iconbar.mode
Setting default value
Failed to read: session.screen0.iconbar.alignment
Setting default value
Failed to read: session.screen0.iconbar.iconWidth
Setting default value
Failed to read: session.screen0.iconbar.iconTextPadding
Setting default value
Failed to read: session.screen0.iconbar.usePixmap
Setting default value
  ERROR: Command errored out with exit status 1:
   command: /home/test/web-platform-tests/_venv3/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-r_1k6h9x/mozdebug/setup.py'"'"'; __file__='"'"'/tmp/pip-install-r_1k6h9x/mozdebug/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-dun69bmd
       cwd: /tmp/pip-install-r_1k6h9x/mozdebug/
  Complete output (6 lines):
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help
  
  error: invalid command 'bdist_wheel'
  ----------------------------------------
  ERROR: Failed building wheel for mozdebug
  ERROR: Command errored out with exit status 1:
   command: /home/test/web-platform-tests/_venv3/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-r_1k6h9x/mozlog/setup.py'"'"'; __file__='"'"'/tmp/pip-install-r_1k6h9x/mozlog/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-9w3mcklc
       cwd: /tmp/pip-install-r_1k6h9x/mozlog/
  Complete output (6 lines):
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help
  
  error: invalid command 'bdist_wheel'
  ----------------------------------------
  ERROR: Failed building wheel for mozlog
 0:00.00 INFO Set tests_root to /home/test/web-platform-tests
 0:00.00 INFO Set metadata_root to /home/test/web-platform-tests
 0:00.00 INFO Set manifest_update to True
 0:00.00 INFO Set manifest_download to True
  ERROR: Command errored out with exit status 1:
   command: /home/test/web-platform-tests/_venv3/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-3bxm_62c/mozdevice/setup.py'"'"'; __file__='"'"'/tmp/pip-install-3bxm_62c/mozdevice/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-sc0wa2ku
       cwd: /tmp/pip-install-3bxm_62c/mozdevice/
  Complete output (6 lines):
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help
  
  error: invalid command 'bdist_wheel'
  ----------------------------------------
  ERROR: Failed building wheel for mozdevice
  ERROR: Command errored out with exit status 1:
   command: /home/test/web-platform-tests/_venv3/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-3bxm_62c/mozprofile/setup.py'"'"'; __file__='"'"'/tmp/pip-install-3bxm_62c/mozprofile/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-npheof8m
       cwd: /tmp/pip-install-3bxm_62c/mozprofile/
  Complete output (6 lines):
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help
  
  error: invalid command 'bdist_wheel'
  ----------------------------------------
  ERROR: Failed building wheel for mozprofile
  ERROR: Command errored out with exit status 1:
   command: /home/test/web-platform-tests/_venv3/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-3bxm_62c/mozrunner/setup.py'"'"'; __file__='"'"'/tmp/pip-install-3bxm_62c/mozrunner/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-64m0erah
       cwd: /tmp/pip-install-3bxm_62c/mozrunner/
  Complete output (6 lines):
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help
  
  error: invalid command 'bdist_wheel'
  ----------------------------------------
  ERROR: Failed building wheel for mozrunner
 0:13.15 INFO Identified 1 affected tests
 0:13.15 INFO Using certutil /usr/bin/certutil
 0:13.15 INFO Downloading geckodriver
 0:13.15 INFO Attempting to install webdriver from nightly
 0:13.59 INFO Extracted geckodriver to /home/test/web-platform-tests/_venv3/bin/geckodriver
 0:13.60 INFO Installed b'geckodriver 0.35.0 (9f0a0036bea4 2024-08-03 07:11 +0000)'
 0:13.62 INFO Downloading test prefs from https://hg.mozilla.org/mozilla-central/archive/tip.zip/testing/profiles/
 0:17.28 INFO Test prefs downloaded to /home/test/web-platform-tests/_venv3/profiles/nightly/130.0
 0:17.42 mozversion INFO application_buildid: 20240804212000
 0:17.42 mozversion INFO application_changeset: f19c35b800f5811afa4b529f7821b073b2f10590
 0:17.42 mozversion INFO application_display_name: Firefox Nightly
 0:17.42 mozversion INFO application_id: {ec8030f7-c20a-464f-9b0e-13a3a9e97384}
 0:17.42 mozversion INFO application_name: Firefox
 0:17.42 mozversion INFO application_remotingname: firefox-nightly
 0:17.42 mozversion INFO application_repository: https://hg.mozilla.org/mozilla-central
 0:17.42 mozversion INFO application_vendor: Mozilla
 0:17.42 mozversion INFO application_version: 130.0a1
 0:17.42 mozversion INFO platform_buildid: 20240804212000
 0:17.42 mozversion INFO platform_changeset: f19c35b800f5811afa4b529f7821b073b2f10590
 0:17.42 mozversion INFO platform_repository: https://hg.mozilla.org/mozilla-central
 0:17.42 mozversion INFO platform_version: 130.0a1
 0:22.50 INFO Installed font: Ahem.ttf
 0:23.31 wptserve INFO Starting http server on http://127.0.0.1:8002
 0:23.40 wptserve INFO Starting http server on http://127.0.0.1:8000
 0:23.40 wptserve INFO Starting http server on http://127.0.0.1:8001
 0:23.46 wptserve INFO Starting http server on http://127.0.0.1:8003
 0:23.46 wptserve INFO Starting https server on https://127.0.0.1:8446
 0:23.47 wptserve INFO Starting https server on https://127.0.0.1:8445
 0:23.48 wptserve INFO Starting https server on https://127.0.0.1:8443
 0:23.48 wptserve INFO Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:23.48 wptserve INFO Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:23.48 wptserve INFO Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:23.50 wptserve INFO Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:23.50 wptserve INFO Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:23.50 wptserve INFO Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:23.50 wptserve INFO Starting https server on https://127.0.0.1:8444
 0:23.52 wptserve INFO Starting http2 server on https://127.0.0.1:9000
 0:23.57 wptserve INFO Starting WebTransport over HTTP/3 server on 127.0.0.1:11000
 0:23.74 SUITE_START: web-platform-test - running 1 tests
 0:29.90 INFO Using 1 child processes
 0:29.91 INFO Setting up ssl
 0:29.94 certutil Full command: /usr/bin/certutil -N -d /tmp/tmpo0avysa9.mozrunner -f /tmp/tmpo0avysa9.mozrunner/.crtdbpw
certutil b''
 0:29.97 certutil b''
 0:29.98 certutil b'\nCertificate Nickname                                         Trust Attributes\n                                                             SSL,S/MIME,JAR/XPI\n\nweb-platform-tests                                           CT,, \n'
 0:29.98 INFO Application command: /home/test/build/firefox/firefox --marionette about:blank -profile /tmp/tmps_e5pjzo
 0:29.99 INFO Starting runner
 0:30.45 pid:1391 Full command: /home/test/build/firefox/firefox --marionette about:blank
pid:1391 [GFX1-]: glxtest: libpci missing
 0:30.46 pid:1391 ATTENTION: default value of option mesa_glthread overridden by environment.
 0:30.53 pid:1391 1722854684910	Marionette	INFO	Marionette enabled
 0:30.60 pid:1391 1722854684975	Marionette	INFO	Listening on port 57087
Failed to read: session.screen0.titlebar.left
Setting default value
Failed to read: session.screen0.titlebar.right
Setting default value
 0:32.76 pid:1391 console.error: ({})
 0:33.46 pid:1391 [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
 0:33.46 pid:1391 console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error for Amo: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
 0:33.46 pid:1391 [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
 0:33.47 pid:1391 console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error for Amp: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
 0:33.48 pid:1391 [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
 0:33.48 pid:1391 console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error for Wikipedia: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
 0:33.48 pid:1391 [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
 0:33.48 pid:1391 console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error for Mdn: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
 0:33.50 pid:1391 [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
 0:33.50 pid:1391 console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error for Yelp: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
 0:33.58 TEST_START: /infrastructure/webdriver/bidi/subscription.html
 0:33.72 WARNING Traceback (most recent call last):
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 766, in process_action
    action_handler = self.actions[action]
KeyError: 'bidi.session.subscribe'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 898, in run_func
    self.result = True, self.func(self.protocol, self.url, self.timeout)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 1024, in do_testharness
    done, rv = handler(result)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 755, in __call__
    return callback(url, payload)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 768, in process_action
    raise ValueError(f"Unknown action {action}") from e
ValueError: Unknown action bidi.session.subscribe

 0:33.72 TEST_END: ERROR, expected OK - Traceback (most recent call last):
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 766, in process_action
    action_handler = self.actions[action]
KeyError: 'bidi.session.subscribe'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 898, in run_func
    self.result = True, self.func(self.protocol, self.url, self.timeout)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 1024, in do_testharness
    done, rv = handler(result)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 755, in __call__
    return callback(url, payload)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 768, in process_action
    raise ValueError(f"Unknown action {action}") from e
ValueError: Unknown action bidi.session.subscribe

 0:33.72 INFO No more tests
 0:33.72 pid:1391 1722854688096	Marionette	INFO	Stopped listening on port 57087
 0:34.38 INFO Browser exited with return code 0
 0:34.18 INFO Closing logging queue
 0:34.18 INFO queue closed
 0:34.39 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 1 checks (1 tests)
Expected results: 0
Unexpected results: 1
  test: 1 (1 error)

Unexpected Results
------------------
ERROR /infrastructure/webdriver/bidi/subscription.html - Traceback (most recent call last):
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 766, in process_action
    action_handler = self.actions[action]
KeyError: 'bidi.session.subscribe'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 898, in run_func
    self.result = True, self.func(self.protocol, self.url, self.timeout)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 1024, in do_testharness
    done, rv = handler(result)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 755, in __call__
    return callback(url, payload)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 768, in process_action
    raise ValueError(f"Unknown action {action}") from e
ValueError: Unknown action bidi.session.subscribe
 0:34.39 INFO Got 1 unexpected results, with 0 unexpected passes
 0:34.40 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 0:34.69 wptserve INFO Stopped http server on 127.0.0.1:8000
 0:34.77 wptserve INFO Stopped http server on 127.0.0.1:8003
 0:34.77 wptserve INFO Stopped http server on 127.0.0.1:8445
 0:34.77 wptserve INFO Stopped http server on 127.0.0.1:8001
 0:34.77 wptserve INFO Stopped http server on 127.0.0.1:8446
 0:34.77 wptserve INFO Stopped http server on 127.0.0.1:8002
 0:34.77 wptserve INFO Stopped http server on 127.0.0.1:8443
 0:34.77 wptserve INFO Stopped http server on 127.0.0.1:8444
 0:34.77 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:34.77 wptserve INFO Stopped http server on 127.0.0.1:9000
 0:34.77 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:34.87 INFO Removed font: Ahem.ttf
 0:34.89 INFO Closing logging queue
 0:34.89 INFO queue closed
 0:34.89 INFO Tolerating 1 unexpected results
[taskcluster 2024-08-05 10:44:50.928Z] === Task Finished ===
[taskcluster 2024-08-05 10:44:51.803Z] Successful task run with exit code: 0 completed in 95.943 seconds