Add testdriver support for WebDriver BiDi #45823
Community-TC (pull_request)
Smoketests for wptrunner
Details
View task in Taskcluster
View logs in Taskcluster
WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-chrome.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --enable-swiftshader --install-browser --install-webdriver chrome
WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-firefox.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --binary=/home/test/build/firefox/firefox firefox
WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-firefox_android.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --install-browser --install-webdriver --logcat-dir /home/test/artifacts/ firefox_android
8:41.31 TEST_START: /infrastructure/assumptions/blank.html
TEST-START | /infrastructure/assumptions/blank.html
8:42.10 TEST_END: PASS
TEST-PASS | /infrastructure/assumptions/blank.html | took 797ms
8:42.10 TEST_START: /infrastructure/assumptions/canvas-background.html
TEST-START | /infrastructure/assumptions/canvas-background.html
8:42.94 TEST_END: PASS
TEST-PASS | /infrastructure/assumptions/canvas-background.html | took 840ms
8:42.94 TEST_START: /infrastructure/assumptions/initial-color.html
TEST-START | /infrastructure/assumptions/initial-color.html
8:43.89 TEST_END: PASS
TEST-PASS | /infrastructure/assumptions/initial-color.html | took 949ms
8:43.89 TEST_START: /infrastructure/assumptions/medium-font-size.html
TEST-START | /infrastructure/assumptions/medium-font-size.html
mem avail: 11927 of 15806 MiB (75 %), swap free: 0 of 0 MiB ( 0 %)
8:44.77 TEST_END: PASS
TEST-PASS | /infrastructure/assumptions/medium-font-size.html | took 874ms
8:44.77 TEST_START: /infrastructure/assumptions/min-font-size.html
TEST-START | /infrastructure/assumptions/min-font-size.html
8:45.63 TEST_END: PASS
TEST-PASS | /infrastructure/assumptions/min-font-size.html | took 860ms
8:45.63 TEST_START: /infrastructure/reftest/green-ref.html
TEST-START | /infrastructure/reftest/green-ref.html
8:46.50 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/green-ref.html | took 868ms
8:46.50 TEST_START: /infrastructure/reftest/legacy/fuzzy-ref-2.html
TEST-START | /infrastructure/reftest/legacy/fuzzy-ref-2.html
8:47.42 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/legacy/fuzzy-ref-2.html | took 924ms
8:47.42 TEST_START: /infrastructure/reftest/legacy/reftest_and_fail.html
TEST-START | /infrastructure/reftest/legacy/reftest_and_fail.html
8:48.29 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/legacy/reftest_and_fail.html | took 870ms
8:48.29 TEST_START: /infrastructure/reftest/legacy/reftest_and_fail_0-ref.html
TEST-START | /infrastructure/reftest/legacy/reftest_and_fail_0-ref.html
8:49.20 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/legacy/reftest_and_fail_0-ref.html | took 910ms
8:49.20 TEST_START: /infrastructure/reftest/legacy/reftest_and_mismatch.html
TEST-START | /infrastructure/reftest/legacy/reftest_and_mismatch.html
8:50.13 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/legacy/reftest_and_mismatch.html | took 929ms
8:50.13 TEST_START: /infrastructure/reftest/legacy/reftest_and_mismatch_0.html
TEST-START | /infrastructure/reftest/legacy/reftest_and_mismatch_0.html
8:51.07 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/legacy/reftest_and_mismatch_0.html | took 939ms
8:51.07 TEST_START: /infrastructure/reftest/legacy/reftest_cycle.html
TEST-START | /infrastructure/reftest/legacy/reftest_cycle.html
8:51.93 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/legacy/reftest_cycle.html | took 862ms
8:51.94 TEST_START: /infrastructure/reftest/legacy/reftest_cycle_0-ref.html
TEST-START | /infrastructure/reftest/legacy/reftest_cycle_0-ref.html
8:52.75 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/legacy/reftest_cycle_0-ref.html | took 815ms
8:52.75 TEST_START: /infrastructure/reftest/legacy/reftest_cycle_1-ref.html
TEST-START | /infrastructure/reftest/legacy/reftest_cycle_1-ref.html
8:53.71 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/legacy/reftest_cycle_1-ref.html | took 955ms
8:53.71 TEST_START: /infrastructure/reftest/legacy/reftest_cycle_fail.html
TEST-START | /infrastructure/reftest/legacy/reftest_cycle_fail.html
8:54.60 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/legacy/reftest_cycle_fail.html | took 890ms
8:54.60 TEST_START: /infrastructure/reftest/legacy/reftest_cycle_fail_0-ref.html
TEST-START | /infrastructure/reftest/legacy/reftest_cycle_fail_0-ref.html
8:55.44 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/legacy/reftest_cycle_fail_0-ref.html | took 843ms
8:55.44 TEST_START: /infrastructure/reftest/legacy/reftest_fuzzy_chain_ini.html
TEST-START | /infrastructure/reftest/legacy/reftest_fuzzy_chain_ini.html
8:56.37 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/legacy/reftest_fuzzy_chain_ini.html | took 923ms
8:56.37 TEST_START: /infrastructure/reftest/reftest.https.html
TEST-START | /infrastructure/reftest/reftest.https.html
8:57.05 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest.https.html | took 683ms
8:57.05 TEST_START: /infrastructure/reftest/reftest.www.sub.html
TEST-START | /infrastructure/reftest/reftest.www.sub.html
8:57.51 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest.www.sub.html | took 457ms
8:57.51 TEST_START: /infrastructure/reftest/reftest_fuzzy_1.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_1.html
8:58.42 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_1.html | took 914ms
8:58.42 TEST_START: /infrastructure/reftest/reftest_fuzzy_ini_full.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_ini_full.html
8:58.92 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_ini_full.html | took 502ms
8:58.93 TEST_START: /infrastructure/reftest/reftest_fuzzy_ini_ref_only.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_ini_ref_only.html
8:59.47 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_ini_ref_only.html | took 539ms
8:59.47 TEST_START: /infrastructure/reftest/reftest_fuzzy_ini_short.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_ini_short.html
9:00.02 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_ini_short.html | took 560ms
9:00.02 TEST_START: /infrastructure/reftest/reftest_fuzzy_no_differences.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_no_differences.html
9:00.62 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_no_differences.html | took 595ms
9:00.62 TEST_START: /infrastructure/reftest/reftest_fuzzy_no_differences_1.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_no_differences_1.html
9:01.15 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_no_differences_1.html | took 532ms
9:01.15 TEST_START: /infrastructure/reftest/reftest_match.html
TEST-START | /infrastructure/reftest/reftest_match.html
9:01.63 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_match.html | took 475ms
9:01.63 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-0.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-0.html
9:02.54 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-0.html | took 911ms
9:02.54 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-1.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-1.html
9:03.00 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-1.html | took 454ms
9:03.00 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-2.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-2.html
9:03.73 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_match_and_mismatch-2.html | took 730ms
9:03.73 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-3.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-3.html
9:04.21 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_match_and_mismatch-3.html | took 486ms
9:04.21 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-4.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-4.html
9:05.00 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-4.html | took 789ms
9:05.00 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-5.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-5.html
9:05.86 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-5.html | took 863ms
9:05.87 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-6.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-6.html
9:07.40 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-6.html | took 1532ms
9:07.40 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-7.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-7.html
9:07.89 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-7.html | took 490ms
9:07.89 TEST_START: /infrastructure/reftest/reftest_match_fail.html
TEST-START | /infrastructure/reftest/reftest_match_fail.html
9:08.37 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_fail.html | took 476ms
9:08.37 TEST_START: /infrastructure/reftest/reftest_mismatch.html
TEST-START | /infrastructure/reftest/reftest_mismatch.html
9:08.90 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_mismatch.html | took 536ms
9:08.90 TEST_START: /infrastructure/reftest/reftest_mismatch_fail.html
TEST-START | /infrastructure/reftest/reftest_mismatch_fail.html
9:09.39 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_mismatch_fail.html | took 487ms
9:09.39 TEST_START: /infrastructure/reftest/reftest_multiple_match-0.html
TEST-START | /infrastructure/reftest/reftest_multiple_match-0.html
9:10.61 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_multiple_match-0.html | took 1223ms
9:10.61 TEST_START: /infrastructure/reftest/reftest_multiple_match-1.html
TEST-START | /infrastructure/reftest/reftest_multiple_match-1.html
9:11.13 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_multiple_match-1.html | took 522ms
9:11.14 TEST_START: /infrastructure/reftest/reftest_multiple_mismatch-0.html
TEST-START | /infrastructure/reftest/reftest_multiple_mismatch-0.html
9:12.68 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_multiple_mismatch-0.html | took 1545ms
9:12.68 TEST_START: /infrastructure/reftest/reftest_multiple_mismatch-1.html
TEST-START | /infrastructure/reftest/reftest_multiple_mismatch-1.html
9:13.65 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_multiple_mismatch-1.html | took 968ms
9:13.65 TEST_START: /infrastructure/reftest/reftest_ref_timeout.html
TEST-START | /infrastructure/reftest/reftest_ref_timeout.html
9:34.08 TEST_END: TIMEOUT
TEST-TIMEOUT | /infrastructure/reftest/reftest_ref_timeout.html | took 20426ms
9:34.08 TEST_START: /infrastructure/reftest/reftest_timeout.html
TEST-START | /infrastructure/reftest/reftest_timeout.html
mem avail: 11920 of 15806 MiB (75 %), swap free: 0 of 0 MiB ( 0 %)
9:54.19 TEST_END: TIMEOUT
TEST-TIMEOUT | /infrastructure/reftest/reftest_timeout.html | took 20117ms
9:54.19 TEST_START: /infrastructure/reftest/reftest_wait_0.html
TEST-START | /infrastructure/reftest/reftest_wait_0.html
9:57.14 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_wait_0.html | took 2943ms
9:57.14 TEST_START: /infrastructure/reftest/reftest_wait_TestRendered.html
TEST-START | /infrastructure/reftest/reftest_wait_TestRendered.html
9:58.07 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_wait_TestRendered.html | took 931ms
9:58.07 TEST_START: /infrastructure/reftest/reftest_window_load.html
TEST-START | /infrastructure/reftest/reftest_window_load.html
9:59.01 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_window_load.html | took 945ms
9:59.02 TEST_START: /infrastructure/reftest/size.html
TEST-START | /infrastructure/reftest/size.html
9:59.99 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/size.html | took 976ms
9:59.99 TEST_START: /infrastructure/reftest-wait.html
TEST-START | /infrastructure/reftest-wait.html
10:01.87 TEST_END: PASS
TEST-PASS | /infrastructure/reftest-wait.html | took 1880ms
10:01.87 INFO No more tests
No more tests
10:02.46 INFO STDOUT: cleanup aborted: Unable to remount device
STDOUT: cleanup aborted: Unable to remount device
10:02.14 INFO Closing logging queue
Closing logging queue
10:02.14 INFO queue closed
queue closed
10:02.63 INFO STDOUT: cleanup aborted: Unable to remount device
STDOUT: cleanup aborted: Unable to remount device
10:02.81 SUITE_END
web-platform-test
~~~~~~~~~~~~~~~~~
Ran 375 checks (219 subtests, 156 tests)
Expected results: 372
Skipped: 3 tests
Unexpected results: 0
OK
SUITE-END | took 460s
10:02.81 INFO STDOUT: cleanup aborted: Unable to remount device
STDOUT: cleanup aborted: Unable to remount device
10:02.81 INFO Got 0 unexpected results, with 0 unexpected passes
Got 0 unexpected results, with 0 unexpected passes
10:02.83 wptserve INFO Stopped http server on 127.0.0.1:8003
wptserve Stopped http server on 127.0.0.1:8003
10:02.89 wptserve INFO Stopped http server on 127.0.0.1:8000
wptserve Stopped http server on 127.0.0.1:8000
10:02.91 wptserve INFO Stopped http server on 127.0.0.1:8001
wptserve Stopped http server on 127.0.0.1:8001
10:02.96 wptserve INFO Stopped http server on 127.0.0.1:8443
wptserve Stopped http server on 127.0.0.1:8443
10:02.97 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
10:02.97 wptserve INFO Stopped http server on 127.0.0.1:8444
wptserve Stopped http server on 127.0.0.1:8444
10:03.11 wptserve INFO Stopped http server on 127.0.0.1:9000
wptserve Stopped http server on 127.0.0.1:9000
10:03.15 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
10:03.19 wptserve INFO Stopped http server on 127.0.0.1:8445
wptserve Stopped http server on 127.0.0.1:8445
10:03.25 wptserve INFO Stopped http server on 127.0.0.1:8002
wptserve Stopped http server on 127.0.0.1:8002
10:03.26 wptserve INFO Stopped http server on 127.0.0.1:8446
wptserve Stopped http server on 127.0.0.1:8446
10:03.33 INFO Removed font: Ahem.ttf
Removed font: Ahem.ttf
10:03.36 INFO Closing logging queue
Closing logging queue
10:03.36 INFO queue closed
queue closed
X connection to :99.0 broken (explicit kill or server shutdown).
[taskcluster 2024-08-05 11:00:22.048Z] === Task Finished ===
[taskcluster 2024-08-05 11:00:23.706Z] Successful task run with exit code: 0 completed in 1030.435 seconds