test: Add a new Github action to track failing conformance tests (#1519)

* Add the files needed for the mandatory conformance * test: Add the files needed for the mandatory conformance * Add a required status check for mandatory conform * Have the test skip the known failures * Add backslash * Space out known failures * Skip all the new line characters This is needed to make the mandatory conformance tests work * Add some more known failures to the list * Add more known failures to the list * Fix coerce logs command * Remove coerce logs line * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md --------- Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>
googleapis · Nov 22, 2024 · 6569c41 · 6569c41
1 parent da373b5
commit 6569c41
Show file tree

Hide file tree

Showing 3 changed files with 118 additions and 1 deletion.
diff --git a/.github/workflows/mandatory-conformance.yaml b/.github/workflows/mandatory-conformance.yaml
@@ -0,0 +1,44 @@
+# Copyright 2024 Google LLC
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#      http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+# Github action job to test core java library features on
+# downstream client libraries before they are released.
+on:
+  push:
+    branches:
+    - main
+  pull_request:
+name: mandatory-conformance
+jobs:
+  mandatory-conformance:
+    runs-on: ubuntu-latest
+    strategy:
+      matrix:
+        node: [ 14, 16, 18, 20 ]
+    steps:
+    - uses: actions/checkout@v4
+    - uses: actions/checkout@v4
+      with:
+        repository: googleapis/cloud-bigtable-clients-test
+        ref: main
+        path: cloud-bigtable-clients-test
+    - uses: actions/setup-node@v3
+      with:
+        node-version: ${{ matrix.node }}
+    - uses: actions/setup-go@v5
+      with:
+        go-version: '>=1.20.2'
+    - run: chmod +x .kokoro/mandatory-conformance.sh
+    - run: npm install
+    - run: go version
+    - run: .kokoro/mandatory-conformance.sh
diff --git a/.kokoro/mandatory-conformance.sh b/.kokoro/mandatory-conformance.sh
diff --git a/testproxy/known_failures.txt b/testproxy/known_failures.txt
@@ -1 +1,29 @@
-TestMutateRow_Generic_Headers\|TestMutateRow_Generic_DeadlineExceeded|TestMutateRows_Generic_CloseClient\|TestMutateRows_Retry_WithRoutingCookie\|TestReadModifyWriteRow_Generic_Headers\|TestReadModifyWriteRow_NoRetry_TransientError\|TestReadModifyWriteRow_Generic_DeadlineExceeded\|TestReadRow_Generic_DeadlineExceeded\|TestReadRow_Retry_WithRoutingCookie\|TestReadRow_Retry_WithRetryInfo\|TestReadRows_ReverseScans_FeatureFlag_Enabled\|TestReadRows_NoRetry_OutOfOrderError_Reverse\|TestReadRows_Retry_PausedScan\|TestReadRows_Retry_LastScannedRow\|TestReadRows_Retry_LastScannedRow_Reverse\|TestCheckAndMutateRow_NoRetry_TransientError\|TestCheckAndMutateRow_Generic_DeadlineExceeded
+TestMutateRow_Generic_Headers\|
+TestMutateRow_Generic_DeadlineExceeded\|
+TestMutateRows_Generic_CloseClient\|
+TestMutateRows_Retry_WithRoutingCookie\|
+TestMutateRows_Generic_DeadlineExceeded\|
+TestReadModifyWriteRow_Generic_Headers\|
+TestReadModifyWriteRow_NoRetry_TransientError\|
+TestReadModifyWriteRow_Generic_DeadlineExceeded\|
+TestReadRow_Generic_DeadlineExceeded\|
+TestReadRow_Retry_WithRoutingCookie\|
+TestReadRow_Retry_WithRetryInfo\|
+TestReadRows_ReverseScans_FeatureFlag_Enabled\|
+TestReadRows_NoRetry_OutOfOrderError_Reverse\|
+TestReadRows_Retry_PausedScan\|
+TestReadRows_Retry_LastScannedRow\|
+TestReadRows_Retry_LastScannedRow_Reverse\|
+TestReadRows_Retry_StreamReset\|
+TestReadRows_Generic_CloseClient\|
+TestReadRows_Generic_DeadlineExceeded\|
+TestReadRows_Retry_WithRoutingCookie\|
+TestReadRows_Retry_WithRoutingCookie_MultipleErrorResponses\|
+TestReadRows_Retry_WithRetryInfo\|
+TestReadRows_Retry_WithRetryInfo_MultipleErrorResponse\|
+TestCheckAndMutateRow_NoRetry_TransientError\|
+TestCheckAndMutateRow_Generic_DeadlineExceeded\|
+TestCheckAndMutateRow_Generic_Headers\|
+TestSampleRowKeys_Generic_Headers\|
+TestSampleRowKeys_Generic_DeadlineExceeded\|
+TestSampleRowKeys_Retry_WithRoutingCookie