Make it possible to make snapshot tests. Prepare environment for snapshot testing. #36419

KelvinOm · 2024-09-19T09:13:40Z

We cannot use snapshot tests, since the local environment and the environment in CI are different.

Related thread:
https://theappsmith.slack.com/archives/C025SE88KNE/p1726734752809939?thread_ts=1726721979.435589&cid=C025SE88KNE

## Description Disable all Anvil snapshot tests. The tests will be enabled after solving the #36419. Related thread https://theappsmith.slack.com/archives/C025SE88KNE/p1726721979435589 ## Automation /ok-to-test tags="@tag.All" ### 🔍 Cypress test results  > [!TIP] > 🟢 🟢 🟢 All cypress tests have passed! 🎉 🎉 🎉 > Workflow run: <https://github.com/appsmithorg/appsmith/actions/runs/10938186194> > Commit: ee5c8f4 > <a href="https://internal.appsmith.com/app/cypress-dashboard/rundetails-65890b3c81d7400d08fa9ee5?branch=master&workflowId=10938186194&attempt=2" target="_blank">Cypress dashboard</a>. > Tags: `@tag.All` > Spec: > <hr>Thu, 19 Sep 2024 11:14:18 UTC  ## Communication Should the DevRel and Marketing teams inform users about this change? - [ ] Yes - [x] No  ## Summary by CodeRabbit - **Bug Fixes** - Temporarily skipped multiple test suites for various Anvil widgets due to unresolved issues, preventing potential false negatives in testing. - Specific tests affected include those for Modal sizes, App Theming, Button, Checkbox, Currency Input, Heading, Icon Button, Inline Button, Input, Paragraph, Phone Input, Radio Group, Stats, Switch Group, Switch, Table, Toolbar Button, and Zone Section Widgets. These adjustments ensure the integrity of the testing process while issues are being addressed.

## Description Disable all Anvil snapshot tests. The tests will be enabled after solving the appsmithorg#36419. Related thread https://theappsmith.slack.com/archives/C025SE88KNE/p1726721979435589 ## Automation /ok-to-test tags="@tag.All" ### 🔍 Cypress test results  > [!TIP] > 🟢 🟢 🟢 All cypress tests have passed! 🎉 🎉 🎉 > Workflow run: <https://github.com/appsmithorg/appsmith/actions/runs/10938186194> > Commit: ee5c8f4 > <a href="https://internal.appsmith.com/app/cypress-dashboard/rundetails-65890b3c81d7400d08fa9ee5?branch=master&workflowId=10938186194&attempt=2" target="_blank">Cypress dashboard</a>. > Tags: `@tag.All` > Spec: > <hr>Thu, 19 Sep 2024 11:14:18 UTC  ## Communication Should the DevRel and Marketing teams inform users about this change? - [ ] Yes - [x] No  ## Summary by CodeRabbit - **Bug Fixes** - Temporarily skipped multiple test suites for various Anvil widgets due to unresolved issues, preventing potential false negatives in testing. - Specific tests affected include those for Modal sizes, App Theming, Button, Checkbox, Currency Input, Heading, Icon Button, Inline Button, Input, Paragraph, Phone Input, Radio Group, Stats, Switch Group, Switch, Table, Toolbar Button, and Zone Section Widgets. These adjustments ensure the integrity of the testing process while issues are being addressed.

sagar-qa007 · 2024-12-18T04:48:59Z

Fixed the chrome version. Re enabling test and verifying results.

sagar-qa007 · 2024-12-19T05:03:30Z

Found pixel mismatch, Writing CI for updating screenshot and store in zip file.

## Description Adding workflow for updating snapshot with github CI. Fixes #[`36419` ](#36419) ## Automation /ok-to-test tags="@tag.Sanity" ### 🔍 Cypress test results  > [!TIP] > 🟢 🟢 🟢 All cypress tests have passed! 🎉 🎉 🎉 > Workflow run: <https://github.com/appsmithorg/appsmith/actions/runs/12426577557> > Commit: 2660c07 > <a href="https://internal.appsmith.com/app/cypress-dashboard/rundetails-65890b3c81d7400d08fa9ee5?branch=master&workflowId=12426577557&attempt=2" target="_blank">Cypress dashboard</a>. > Tags: `@tag.Sanity` > Spec: > <hr>Fri, 20 Dec 2024 07:02:16 UTC  ## Communication Should the DevRel and Marketing teams inform users about this change? - [ ] Yes - [x] No  ## Summary by CodeRabbit - **New Features** - Enhanced CI workflow with new input parameters for snapshot updates and spec execution. - Added steps for uploading existing and new snapshot data during Cypress tests. - **Bug Fixes** - Improved artifact management and error handling in the CI process. - **Documentation** - Added comments for better understanding of workflow logic and input parameters. - **Refactor** - Streamlined job execution logic and conditional checks for test reruns.

## Description Uncommenting test cases as chrome browser version has been hardcoded now. Fixes [`Issue URL`](#36419) ## Automation /ok-to-test tags="@tag.Anvil" ### 🔍 Cypress test results  > [!TIP] > 🟢 🟢 🟢 All cypress tests have passed! 🎉 🎉 🎉 > Workflow run: <https://github.com/appsmithorg/appsmith/actions/runs/12429832882> > Commit: 6b601b1 > <a href="https://internal.appsmith.com/app/cypress-dashboard/rundetails-65890b3c81d7400d08fa9ee5?branch=master&workflowId=12429832882&attempt=1" target="_blank">Cypress dashboard</a>. > Tags: `@tag.Anvil` > Spec: > <hr>Fri, 20 Dec 2024 10:59:51 UTC  ## Communication Should the DevRel and Marketing teams inform users about this change? - [ ] Yes - [x] No  ## Summary by CodeRabbit - **New Features** - Enabled execution of previously skipped test suites for various Anvil widgets, including Checkbox, Button, Input, and others across different modes (Canvas, Preview, Deploy). - Enhanced visual testing capabilities by ensuring all theming configurations (light and dark modes) are validated for each widget. - **Bug Fixes** - Resolved issues causing test suites to be skipped, allowing comprehensive testing of widget functionality.

## Description Adding workflow for updating snapshot with github CI. Fixes #[`36419` ](#36419) ## Automation /ok-to-test tags="@tag.Sanity" ### 🔍 Cypress test results  > [!TIP] > 🟢 🟢 🟢 All cypress tests have passed! 🎉 🎉 🎉 > Workflow run: <https://github.com/appsmithorg/appsmith/actions/runs/12426577557> > Commit: 2660c07 > <a href="https://internal.appsmith.com/app/cypress-dashboard/rundetails-65890b3c81d7400d08fa9ee5?branch=master&workflowId=12426577557&attempt=2" target="_blank">Cypress dashboard</a>. > Tags: `@tag.Sanity` > Spec: > <hr>Fri, 20 Dec 2024 07:02:16 UTC  ## Communication Should the DevRel and Marketing teams inform users about this change? - [ ] Yes - [x] No  ## Summary by CodeRabbit - **New Features** - Enhanced CI workflow with new input parameters for snapshot updates and spec execution. - Added steps for uploading existing and new snapshot data during Cypress tests. - **Bug Fixes** - Improved artifact management and error handling in the CI process. - **Documentation** - Added comments for better understanding of workflow logic and input parameters. - **Refactor** - Streamlined job execution logic and conditional checks for test reruns.

## Description Uncommenting test cases as chrome browser version has been hardcoded now. Fixes [`Issue URL`](#36419) ## Automation /ok-to-test tags="@tag.Anvil" ### 🔍 Cypress test results  > [!TIP] > 🟢 🟢 🟢 All cypress tests have passed! 🎉 🎉 🎉 > Workflow run: <https://github.com/appsmithorg/appsmith/actions/runs/12429832882> > Commit: 6b601b1 > <a href="https://internal.appsmith.com/app/cypress-dashboard/rundetails-65890b3c81d7400d08fa9ee5?branch=master&workflowId=12429832882&attempt=1" target="_blank">Cypress dashboard</a>. > Tags: `@tag.Anvil` > Spec: > <hr>Fri, 20 Dec 2024 10:59:51 UTC  ## Communication Should the DevRel and Marketing teams inform users about this change? - [ ] Yes - [x] No  ## Summary by CodeRabbit - **New Features** - Enabled execution of previously skipped test suites for various Anvil widgets, including Checkbox, Button, Input, and others across different modes (Canvas, Preview, Deploy). - Enhanced visual testing capabilities by ensuring all theming configurations (light and dark modes) are validated for each widget. - **Bug Fixes** - Resolved issues causing test suites to be skipped, allowing comprehensive testing of widget functionality.

KelvinOm added the Anvil Pod Issue related to Anvil project label Sep 19, 2024

Nikhil-Nandagopal added the Task A simple Todo label Sep 19, 2024

KelvinOm assigned sagar-qa007 Sep 19, 2024

KelvinOm added QA Pod Issues under the QA Pod and removed Anvil Pod Issue related to Anvil project labels Sep 19, 2024

KelvinOm changed the title ~~Make it possible to take snapshot tests. Prepare the environment for snapshot testing~~ Make it possible to make snapshot tests. Prepare the environment for snapshot testing. Sep 19, 2024

github-actions bot removed the QA Pod Issues under the QA Pod label Sep 19, 2024

KelvinOm changed the title ~~Make it possible to make snapshot tests. Prepare the environment for snapshot testing.~~ Make it possible to make snapshot tests. Prepare environment for snapshot testing. Sep 19, 2024

KelvinOm mentioned this issue Sep 19, 2024

fix: disable anvil snapshots tests #36422

Merged

2 tasks

sagar-qa007 added the Stability Issue Every issue handle by Stability Pod label Oct 17, 2024

github-actions bot added the Stability Pod For all issues/tasks to be prioritized under Stability pod label Oct 17, 2024

sagar-qa007 mentioned this issue Dec 18, 2024

fix: Uncommented anvil cases #38218

Merged

2 tasks

This was referenced Dec 19, 2024

ci: Update screenshots with CI pipeline #38243

Closed

ci: Added ci option for snapshot #38261

Merged

sagar-qa007 closed this as completed in #38218 Dec 20, 2024

coderabbitai bot mentioned this issue Jan 7, 2025

chore: fix form widgets bugs #38492

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Make it possible to make snapshot tests. Prepare environment for snapshot testing. #36419

Make it possible to make snapshot tests. Prepare environment for snapshot testing. #36419

KelvinOm commented Sep 19, 2024

sagar-qa007 commented Dec 18, 2024

sagar-qa007 commented Dec 19, 2024

Make it possible to make snapshot tests. Prepare environment for snapshot testing. #36419

Make it possible to make snapshot tests. Prepare environment for snapshot testing. #36419

Comments

KelvinOm commented Sep 19, 2024

sagar-qa007 commented Dec 18, 2024

sagar-qa007 commented Dec 19, 2024