Builds are often failing with timeout due to JFrog's Artifactory service (repo.jenkins-ci.org) being slow

[dduportal]

Service(s)

Artifactory

Summary

We were alerted in parallel by some users and our monitoring that Artificatory is slow to answer to requests, leading to slowness when downloading artifacts, avdn eventually build failures due to timeout.

Incident starting today around 08:50 UTC.

We are working on it.

Monitoring Metrics

To Do List

• Open incident on status.jenkins.io @lemeurherve
• Open an incident at Jfrog @lemeurherve
• Communicate to users on dev + infra mailing lists @dduportal

[jglick]

linking to #2752 again

[dduportal]

The incident is resolved. We never received any answer from Jfrog sdupport except the usual automatic email.

Please find attached a screenshot of the datadog monitor that summarize the impact measured on our monitoring system, as a comparison point to the real impact for end users + felt impact by the community:

The subject of ##2752 is going to be put on the next infra meeting agenda to ensure that impacts like this one would be limited in the future, as per @jglick recommendation (many thanks).