Make "timed" and other environment-sensitive tests optional [SPR-8458]

[spring-projects-issues]

Chris Beams opened SPR-8458 and commented

We currently have a number of timed tests that frequently fail on developer machines due to varying CPU speeds and system load. It would be better to make these tests optional and configure them to run only on the CI server, which is a more controlled and predictable environment.

This may be done using a mechanism like JUnit's @Rule, or possibly through their upcoming test categorization mechanism.

---

Issue Links:

• Clean up ignored JMX tests [SPR-8089] #12744 Clean up ignored JMX tests ("is depended on by")
• org.springframework.jmx.export.NotificationListenerTests is marked @Ignore but extends TestCase in 3.0.x branch [SPR-8587] #13231 org.springframework.jmx.export.NotificationListenerTests is marked @Ignore but extends TestCase in 3.0.x branch

[spring-projects-issues]

Chris Beams commented

This is complete with the introduction and application of the org.springframework.tests.Assume utility class and the org.springframework.tests.TestGroup enum. These work based on Junit 4's 'assumptions' model, and effectively prevent certain classes of tests (e.g. performance-sensitive) from being run by default. These tests are now run in a dedicated performance environment in a nightly CI build 1.