add --strict flag

[charlierudolph]

I'd like a --strict CLI flag that will cause my tests to exit with non-zero status if

• any test is marked as only
• any test is marked as skipped
• any test is marked as pending

[boneskull]

This may be a good solution to the problem of accidentally committing these.

@mochajs/mocha any opinions?

[dasilvacontin]

Hmm, I thought skipped tests are actually marked as pending?

People do commit these (looking at you .only), so I believe this is useful, and I'm looking forward to it.

Not so sure about the tests marked as skipped/pending.. If I skip tests is because I don't want to run them anymore, not even in prod.. not sure about you.

[armandabric]

I would love to have this!

If you do not want a test (even in prod): it's probably because this is a dead/outdated test and need to be deleted from the source code.

[dasilvacontin]

cc @mochajs/mocha

[danielstjules]

Could we use some different terminology so that it's not confused with node/v8's --use_strict ?

[boneskull]

How about --production

[IvanGuardado]

What is the status of this issue? I've been following the related PRs but they seem to be all closed.

I think this is an important configuration and I was surprised that it didn't exist since some commit could add a .only and the test suite would be giving invalid feedback...

Thanks!

[boneskull]

@IvanGuardado #1935 (comment)