[Engineering task] Investigate flaky tests

[gladjohn]

Task type

Test

Description

This one fails in OneBranch Pipeline and not on PR pipeline.

Failed Kerberos_Interactive_AADAsync [2 m 23 s]
Error Message:
Test method Microsoft.Identity.Test.Integration.SeleniumTests.InteractiveFlowTests.Kerberos_Interactive_AADAsync threw exception:
OpenQA.Selenium.WebDriverException: The HTTP request to the remote WebDriver server for URL http://localhost:52547/session timed out after 120 seconds.

Other flaky tests :

Solution

fix the flaky tests

[bgavrilMS]

• ignore Kerberos tests (you can even remove the feature, there is a work item for it)
• remove some of the weak flows like DeviceCodeFlow ... no need to test that so much

[gladjohn]

how can we split this work @bgavrilMS. can we do another engineering excellence project?

[gladjohn]

more tests

[gladjohn]

[bgavrilMS]

What's the root cause of all these flaky tests?

[gladjohn]

What's the root cause of all these flaky tests?

needs to be investigated