With the change in function should_run_successfully() of commit 54337fab39f4c610bd5e5c51cea6a965e7bd7cdb: - RunPass => true, - Ui => self.props.pass_mode == Some(PassMode::Run), + RunPass | Ui => self.effective_pass_mode() == Some(PassMode::Run), The test cases under run-pass directory are tested for building only, the compiled test cases are not running any more. Does it work as design?