Skip to content

Conversation

@jfversluis
Copy link
Member

@jfversluis jfversluis commented Sep 23, 2025

This pull request updates the UI test pipeline steps to improve artifact publishing and snapshot diff validation across platforms. It also introduces a temporary UI change to help validate the new pipeline logic. The main changes are grouped below:

Pipeline improvements and artifact handling:

  • Replaces the deprecated PublishBuildArtifacts@1 task with the newer PublishPipelineArtifact@1 for publishing snapshot diff artifacts for Android, iOS, Windows, and Mac (Catalyst) platforms, ensuring more robust and modern artifact handling.
  • Uses the dynamic target framework ($(tfm)) from the build matrix instead of hardcoding net9.0 in artifact paths, making the pipeline more flexible and reducing maintenance overhead when frameworks change.
  • Adds explicit folder existence checks for each platform before attempting to publish artifacts, preventing pipeline errors when snapshot diff folders are missing.
  • Adds comments and clearer display names to improve the maintainability and readability of the pipeline steps. [1] [2]

After this change there are separate uitests-snapshots-results-* artifacts that only have the diffs so that people don't have to download gigabytes of data just for some screenshots. See below.

image

Screenshot taken from this build: https://dev.azure.com/xamarin/public/_build/results?buildId=151073&view=artifacts&pathAsName=false&type=publishedArtifacts

@jfversluis jfversluis added the area-infrastructure CI, Maestro / Coherency, upstream dependencies/versions label Sep 23, 2025
@jfversluis jfversluis marked this pull request as ready for review September 23, 2025 18:12
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This pull request refactors the UI test pipeline to improve artifact publishing for snapshot diffs across multiple platforms. The changes extract snapshot diff collection logic into a reusable template and modernize the artifact publishing approach.

Key changes:

  • Creates a new reusable template for collecting and publishing snapshot diff artifacts
  • Replaces deprecated PublishBuildArtifacts@1 tasks with modern PublishPipelineArtifact@1
  • Generates separate platform-specific artifacts instead of single combined artifacts

Reviewed Changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.

File Description
eng/pipelines/common/ui-tests.yml Adds template calls for snapshot diff collection across Android, iOS, Windows, and Mac platforms
eng/pipelines/common/ui-tests-steps.yml Removes old inline snapshot diff publishing logic and adds comment about Notification Center
eng/pipelines/common/ui-tests-collect-snapshot-diffs.yml New template implementing modernized snapshot diff collection and publishing logic

jfversluis and others added 2 commits September 23, 2025 20:15
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@jfversluis jfversluis merged commit bac2432 into main Sep 24, 2025
78 of 108 checks passed
@jfversluis jfversluis deleted the separate-snapshot-diffs-ci branch September 24, 2025 13:48
rmarinho pushed a commit that referenced this pull request Sep 29, 2025
* Update ui-tests-steps.yml

* Fake test snapshot diff

* Replace hardcoded tfm

* Update ui-tests-steps.yml

* Update ui-tests-steps.yml

* Different approach

* Update ui-tests.yml

* Update ui-tests.yml

* Update ui-tests.yml

* Reusable template

* Revert "Fake test snapshot diff"

This reverts commit 99c982a.

* Update eng/pipelines/common/ui-tests-collect-snapshot-diffs.yml

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Also check files in subfolders

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
# Conflicts:
#	eng/pipelines/common/ui-tests.yml
@PureWeen PureWeen mentioned this pull request Oct 21, 2025
2 tasks
@github-actions github-actions bot locked and limited conversation to collaborators Oct 25, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

area-infrastructure CI, Maestro / Coherency, upstream dependencies/versions

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants