Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tests exceeding playwright timeout and retrying are interrupted and RP launch runs forever #135

Open
noacohen1 opened this issue Feb 1, 2024 · 5 comments

Comments

@noacohen1
Copy link
Contributor

Hi,
Im using "@reportportal/agent-js-playwright": "^5.1.4" and "@playwright/test": "^1.41.1"
I experience the following behavior:
When i have a test that for instance seraches a locator and exceeds the playwright timeout while waiting, the 1 attempt obviusly failes like in here:
image

Then the test tries to perform a retry but the status is interrupted immidiatly, like in here:
image

And the whole launch is stuck on this test, even though the state is failed...

Screenshot 2024-02-01 at 14 57 42

@AmsterGet
Copy link
Member

Hello @noacohen1 !
Do you see any errors in the console?
Could you please also share an example to help us reproduce the issue on our end?

@noacohen1
Copy link
Contributor Author

Which console are you refering? those tests aren't running locally, they tun on a machine and in the machine logs the tests fails after a timeout and continue to the next test.
it's a long test that involves many files, i can paste here the main test function:
image

this is the part where the interrupted is thrown and the timeout exceeds:
image

@noacohen1
Copy link
Contributor Author

The issue here is that the locator is not correct and the 'target' element couldn't be found.
But I don't expect the launch to be interrupted and behave this way. i expect the test in this launch to fail.

@noacohen1
Copy link
Contributor Author

noacohen1 commented Feb 6, 2024

Hi i still have this timeout issue, this time i have a test that waits for timeout (playwright method)
image

This test is stuck for 8 hours...

image

This launch is still "running" even though all of the tests have passed. Is it possible that in this package there's a bug regarding playwright timeouts and report portal not knowing that the timeout has been reached?
image

@AmsterGet
Copy link
Member

Hi @noacohen1 !
Thank you for additional details.
We have previously fixed several issues related to Playwright timeouts, but it seems that not all cases have been fixed yet.
Unfortunately, we don't have enough team capacity to dive into this issue at this time.
We would appreciate it if you could provide a small set of tests and configuration that we can run to reproduce the issue as soon as we have enough time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants